Tongzhou Wang @TongzhouWang
representation of type 1→2 agi @mit Ex @pytorch @MetaAI @berkeley_ai wang.tz Joined November 2011-
Tweets189
-
Followers1K
-
Following1K
-
Likes896
There should be an easy, automated process to get official certificates for reviewing X papers at Y conference.
We have just released 🍷 FineWeb: 15 trillion tokens of high quality web data. We filtered and deduplicated all CommonCrawl between 2013 and 2024. Models trained on FineWeb outperform RefinedWeb, C4, DolmaV1.6, The Pile and SlimPajama!
Excited to share Penzai, a JAX research toolkit from @GoogleDeepMind for building, editing, and visualizing neural networks! Penzai makes it easy to see model internals and lets you inject custom logic anywhere. Check it out on GitHub: github.com/google-deepmin…
Our computer vision textbook is released! Foundations of Computer Vision with Antonio Torralba and Bill Freeman mitpress.mit.edu/9780262048972/… It’s been in the works for >10 years. Covers everything from linear filters and camera optics to diffusion models and radiance fields. 1/4
I assume the purpose of the focus on "ML for social impact" is to get URMs interested in the field (it would be good to hear from the NeurIPS people who created this...), but I think in reality this track will be used by already high-achieving students (not URMs) to further pad…
I assume the purpose of the focus on "ML for social impact" is to get URMs interested in the field (it would be good to hear from the NeurIPS people who created this...), but I think in reality this track will be used by already high-achieving students (not URMs) to further pad…
The US immigration system makes it incredibly hard for international scientists to stay and thrive. People often mention the existence of visas like EB-1 for talented individuals, but as a PhD student, I would have to spend 12-18 months without leaving the US for the process...
The US immigration system makes it incredibly hard for international scientists to stay and thrive. People often mention the existence of visas like EB-1 for talented individuals, but as a PhD student, I would have to spend 12-18 months without leaving the US for the process...
1/ Given high-dim time series data (e.g., video, text), we'd like to know "what happens in the future?" and "what happened between A and B?" Turns out temporal contrastive learning provably answers these questions! Paper+Code: arxiv.org/abs/2403.04082 Backstory and details below
Functional Reward Encodings (FRE) provide a simple, unsupervised approach to offline zero-shot RL: 1. Learn a robust latent space of reward functions, then 2. Train a generalist agent on *random functions*, such that new tasks naturally map to solutions. kvfrans.com/fre/
5 years ago DD couldn't get accepted anywhere. Now there is a workshop at CVPR. It's come along so far.
5 years ago DD couldn't get accepted anywhere. Now there is a workshop at CVPR. It's come along so far.
Glad to see that this isn't happening in 2024. Hope that future @icmlconf also takes into consideration LNY and other holidays celebrated by the community. Happy Lunar New Year everyone!
Glad to see that this isn't happening in 2024. Hope that future @icmlconf also takes into consideration LNY and other holidays celebrated by the community. Happy Lunar New Year everyone!
What's a hierarchical decision-making problem in which the (intuitive) hi-level is continuous, and the optimal control cost is easily computed?
Cool paper on how to train online multi-env actor-critic with a shared tsfmer backbone. I wonder what representation it learns.
Cool paper on how to train online multi-env actor-critic with a shared tsfmer backbone. I wonder what representation it learns.
Jim Fan @DrJimFan
230K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.
Phillip Isola @phillip_isola
13K Followers 156 Following Associate Professor in EECS at MIT, trying to understand the science of intelligence.
Xiaolong Wang @xiaolonw
11K Followers 961 Following Assistant Professor @UCSDJacobs Postdoc @berkeley_ai PhD @CMU_Robotics
Soumith Chintala @soumithchintala
187K Followers 887 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.
Shane Gu @shaneguML
28K Followers 1K Following Research Scientist & Manager @GoogleDeepMind Tokyo/MTV. ex: @GoogleAI Brain, @OpenAI. (JP: @shanegJP)
Elliott / Shangzhe Wu @elliottszwu
5K Followers 770 Following Postdoc @StanfordSVL working on unsupervised 3D perception and inverse rendering, PhD from @Oxford_VGG. Public office hours: https://t.co/iSSemSi1NQ
Yuandong Tian @tydsh
16K Followers 808 Following Research Scientist and Senior Manager in Meta AI (FAIR). AI-guided Optimization and Representation Learning. Novelist in spare time. PhD in @CMU_Robotics.
Eugene Vinitsky @EugeneVinitsky
13K Followers 2K Following Lets make multi-agent learning easy. Anti-cynic. RS at Apple, Asst. Prof at @nyutandon. He/him. Anonymous feedback: https://t.co/Mmmg7uPm1t
David Bau @davidbau
3K Followers 243 Following Computer Science Professor at Northeastern, Ex-Googler. Believes AI should be transparent. @[email protected] @davidbau.bsky.social https://t.co/wmP5LUZRTw
Kevin Frans @kvfrans
2K Followers 420 Following @berkeley_ai prev mit, read my thoughts: https://t.co/7CZsOTsiH8
Dinghuai Zhang 张鼎.. @zdhnarsil
2K Followers 1K Following PhD student at @Mila_Quebec. Ex intern at FAIR Labs @MetaAI. Previous math undergraduate at @PKU1898.
Abhishek Gupta @abhishekunique7
5K Followers 640 Following Assistant Professor at University of Washington. I like robots, and reinforcement learning. Previously: post-doc at MIT, PhD at Berkeley
Yilun Du @du_yilun
5K Followers 211 Following PhD student at @MIT_LISLab/@MITCoCoSci, Researcher at @pika_labs, Generative Models, Robot Learning. Interned at @MetaAI, @DeepMind, Research Fellow at @openai
Sirui Chen @eric_srchen
94 Followers 183 Following PhD in Stanford CS, Prev Undergrad at HKU. Interested in robotics
Charise Manila @charise_man
0 Followers 53 Following
Haotian Wang @HTW_ddnl
10 Followers 104 Following
Dorotha Marchant @DorothaMar75829
10 Followers 3K Following
fly51fly @fly51fly
5K Followers 2K Following BUPT prof | Sharing latest AI papers & insights | Join me in embracing the AI revolution! #MachineLearning #AI #Innovation
Brian Cheung @thisismyhat
4K Followers 550 Following This is my hat, there are many like it, but this one is mine. @MIT_CSAIL 🧢 | @berkeley_ai 🎓 | Google B̶r̶a̶i̶n̶ DeepMind 🎩
AssuntaLaporta @AssuntaLap8883
5 Followers 859 Following
Andrew Carr (e/🤸) @andrew_n_carr
16K Followers 3K Following science @getcartwheel AI writer @tldrnewsletter advisor @arcade_ai Past - Codegen @OpenAI, Brain @GoogleAI, world ranked Tetris player
yiyanglk @yiyanglk
11 Followers 139 Following
none @fbd_name
0 Followers 10 Following
Uzay @uzpg_
1K Followers 1K Following CS / Math / philosophy | Researching how we learn and create // what I want to do with my life | DMs open | MIT | Emergent Ventures | France-US
Xin Jin @Xander_K1ng
11 Followers 67 Following Second year graduate student, Chongqing Technology and Business University. || Research interest: Computer Vision, Data Augmentation.
Zlatan Ajanović @AjanovicZlatan
250 Followers 328 Following Roboticist | Researcher in AI and Robotics | Control, Planning and Learning for Autonomous Systems | PostDoc @tudelft | PhD from @tugraz
Luka Kovačević @luka_kovacc
101 Followers 410 Following Biostatistics PhD Student @mrc_bsu @cambridge_uni | Causality, ML & Genetics
Alexander Swerdlow @alexjswerdlow
10 Followers 197 Following
Xiaolong Li @lxiaol9
1K Followers 1K Following Applied Scientist @AWS AI. VLM, 3D vision | intern @MSFTResearch | former Student researcher @GoogleBrain | Ex-intern @Mitsubishi_USA
Ademi Adeniji @AdemiAdeniji
386 Followers 180 Following PhD @UCBerkeley. Prev @NVIDIAAI, @Stanford '21. Reinforcement Learning, Robot Learning, Behavior Foundation Models.
TomatoPope @TomatoPope
0 Followers 24 Following
Dan Haramati @DanHrmti
29 Followers 148 Following Master's Student - Technion | Reinforcement Learning
Aditya Singh @ditya__singh
29 Followers 273 Following
Frank @AI_learner73
1 Followers 529 Following
Arif Ahmad @arif_ahmad_py
305 Followers 7K Following All things AI, Computer Science and Circuits! Prev. @GoogleAI
SenaBeren @findingmerit
288 Followers 3K Following
Ehsan Naderi @EHSAN__NADERI
4 Followers 91 Following Computer Engineering @ Sharif University Of Technology
Meng Song @meng_song
88 Followers 213 Following PhD candidate@UCSD, Independent reinforcement learning researcher
Eva Louise Marie Gabr.. @e681554349
9 Followers 3K Following
Alex Andonian @alexjandonian
251 Followers 778 Following PhD student in EECS at MIT, studying topics in computer vision, machine learning, and AI
Guangyan Sun @GuangyanS
53 Followers 367 Following PhD @RITtigers🐯 | system 1→2 🧠 | RepE 🫥 | UG @sysu_1924 🦆
Do-Hyeon Lee @Lead_The_World_
44 Followers 178 Following Navigating brain-mind-behavior intricacies for efficient & responsible AI
Marwan Zouinkhi @mzouink
376 Followers 436 Following All tweets and comments represent my independent views
Fred Hoffman @frederickjrhoff
32 Followers 964 Following
Jatin Prakash @bicycleman15
30 Followers 431 Following Research Fellow at Microsoft Research | previously @iitdelhi
Dun Yang @B9virFnB3ic8wOV
23 Followers 945 Following
fzhiy @fzhiyu
2 Followers 65 Following PhD student in computer science @UniofExeter #FL #CL #Edge_AI
GyuBin Lee @gyubin0521
75 Followers 2K Following
Jens Tuyls @JensTuyls
332 Followers 775 Following PhD @PrincetonCS. Previously CS & Eng. @UCIrvine. Studying AI, ML, RL, #NLProc.
Sports Operations @SportsOps
131 Followers 856 Following Sports analytics and operations management.
Tianwei Yue @VyvyenYue
898 Followers 445 Following @MathGPTPro CEO/Founder | @YCombinator W24 | @LTIatCMU
Zhengbang Zhu @zhu990729
5 Followers 169 Following
Haoran Xu @ryanxhr
152 Followers 252 Following Ph.D. student @ UT Austin. Studying Deep Reinforcement Learning.
Charles Feinn @dynamics
201 Followers 537 Following learning & occasionally shouting thoughts into the void
Jim Fan @DrJimFan
230K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.
Yann LeCun @ylecun
713K Followers 718 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
Andrej Karpathy @karpathy
981K Followers 905 Following 🧑🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥
Google DeepMind @GoogleDeepMind
945K Followers 275 Following We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.
Jia-Bin Huang @jbhuang0604
51K Followers 285 Following Associate Professor @umdcs; Part-time Research Scientist @Meta. I like pixels.
Phillip Isola @phillip_isola
13K Followers 156 Following Associate Professor in EECS at MIT, trying to understand the science of intelligence.
Michael Black @Michael_J_Black
59K Followers 646 Following Director, Max Planck Institute for Intelligent Systems (@MPI_IS). Chief Scientist @meshcapade. Building 3D digital humans using vision, graphics, and learning.
Prof. Anima Anandkuma.. @AnimaAnandkumar
25K Followers 2K Following Bren Professor @caltech, Fmr Sr Director of #AI research @nvidia, Fmr Principal Scientist @awscloud, AI+Science, PDE, Neural operators. Views my own.
MIT CSAIL @MIT_CSAIL
298K Followers 22K Following MIT's Computer Science & Artificial Intelligence Laboratory (CSAIL). Media Inquiries: [email protected]
Percy Liang @percyliang
49K Followers 408 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | Pianist
Kosta Derpanis @CSProfKGD
48K Followers 197 Following #CS Associate Prof @YorkUniversity, #ComputerVision Scientist Samsung #AI, @VectorInst Faculty Affiliate, TPAMI AE, #CVPR2024/#ECCV2024 Publicity Co-chair
François Chollet @fchollet
470K Followers 770 Following Deep learning @google. Creator of Keras. Author of 'Deep Learning with Python'. Opinions are my own.
Xiaolong Wang @xiaolonw
11K Followers 961 Following Assistant Professor @UCSDJacobs Postdoc @berkeley_ai PhD @CMU_Robotics
Andrew Ng @AndrewYNg
1.0M Followers 913 Following Co-Founder of Coursera; Stanford CS adjunct faculty. Former head of Baidu AI Group/Google Brain. #ai #machinelearning, #deeplearning #MOOCs
Sergey Levine @svlevine
80K Followers 122 Following Associate Professor at UC Berkeley Co-founder, Physical Intelligence
Soumith Chintala @soumithchintala
187K Followers 887 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.
Rosanne Liu @savvyRL
33K Followers 969 Following Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS. Writing https://t.co/IbycyGfnDR
Horace He @cHHillee
24K Followers 449 Following Working at the intersection of ML and Systems @ PyTorch "My learning style is Horace twitter threads" - @typedfemale
Stas Bekman @StasBekman
7K Followers 268 Following Toolmaker. Software creator, optimizer and harmonizer. Makes things work and fly at @ContextualAI Training LLM/RAG/Generative AI/Machine Learning/Scalability
Shunyu Yao @ShunyuYao12
7K Followers 861 Following Language agents (ReAct, Reflexion, Tree of Thoughts) for digital automation (WebShop, SWE-bench, SWE-agent)
fly51fly @fly51fly
5K Followers 2K Following BUPT prof | Sharing latest AI papers & insights | Join me in embracing the AI revolution! #MachineLearning #AI #Innovation
Yoav Artzi @yoavartzi
13K Followers 163 Following Research/prof @cs_cornell + @cornell_tech🚡 / https://t.co/9YnWry7yHs / https://t.co/3VmRSyYm2d / asso. faculty director @arxiv / building https://t.co/f9QkzO5kaC
andy jones @andy_l_jones
4K Followers 326 Following engineering & research at @AnthropicAI. DC, SF, London
cynthia breazeal @cynthiabreazeal
8K Followers 31 Following Robot builder, MIT Media Lab professor, MIT Dean for Digital Learning, Entrepreneur, Mother of Robots giving robots a heart, too.
Rosa Cao @luosha
171 Followers 31 Following Thinking about philosophy, science, and how stuff works. Being confused. Thinking more.
Mike Schroepfer @schrep
104K Followers 278 Following Partner @Gigascale, Sr Fellow (Formerly CTO) @Meta, founder @AdditionalVent, . Investing in tech and science to fight climate change. AI
Simon Prince @SimonPrinceAI
9K Followers 333 Following Professor of Computer Science, University of Bath
Scott Gray @scottgray76
7K Followers 483 Following GPU Geek at @OpenAI. I have a long standing interest in neuroscience and its application to machine learning. He/Him.
Stanford AI Lab @StanfordAILab
137K Followers 319 Following The Stanford Artificial Intelligence Laboratory (SAIL), a leading #AI lab since 1963. ⛵️🤖 Emmy-winning video: https://t.co/lV9smZTC1m
Monica Lam @MonicaSLam
2K Followers 42 Following Professor, Computer Science Department at Stanford University.
Christopher Potts @ChrisGPotts
11K Followers 620 Following Stanford Professor of Linguistics and, by courtesy, of Computer Science, and member of @stanfordnlp and @StanfordAILab. He/Him/His.
Dan Jurafsky @jurafsky
27K Followers 297 Following Professor of linguistics and professor of computer science at Stanford and author of the James Beard award finalist "The Language of Food"
Wen Sun @WenSun1
269 Followers 34 Following Assistant Professor at Cornell CS. Machine Learning and Reinforcement Learning; check out the RL Algorithm and theory book here https://t.co/HROGwaflCn
Quan Vuong @QuanVng
2K Followers 234 Following Robotics Research at @Physical_int, ex-@GoogleDeepMind Perpetually trying to find a quiet place to read.
Rohin Shah @rohinmshah
5K Followers 89 Following Research Scientist at DeepMind. I publish the Alignment Newsletter.
Ani Kembhavi @anikembhavi
2K Followers 297 Following Senior Director @allen_ai + Affiliate Assoc Prof @UW 📷 : Visual Prog, Unified-IO, BiDAF 🤖 : ProcTHOR, Objaverse, SPOC 🌎 : SATLAS All views my own.
Alex Atallah @xanderatallah
49K Followers 3K Following Experiments: @openrouterai + @windowai_io. Previously: co-founder & CTO @OpenSea.
OpenRouter @OpenRouterAI
5K Followers 82 Following A router for LLMs. 120+ models, explorable data, and open-source inference. https://t.co/ZR8gPNSd52
文具女子博 @bungujoshi
90K Followers 671 Following すべての文具好き女子におくる、日本最大級の文具の祭典！｜2024年5月28日(火)～6月2日(日)：文具女子博 pop-up in 新宿2024｜※個別の質問にはご返信できません
Alex Nichol @unixpickle
8K Followers 389 Following Code, AI, and 3D printing. Opinions are my own, not my computer's...for now. Husband of @thesamnichol. Co-creator of DALL-E 2. Researcher @openai.
Aaron Defazio @aaron_defazio
6K Followers 370 Following Research Scientist at Meta working on optimization. Fundamental AI Research (FAIR) team
Eric Schmidt @ericschmidt
2.2M Followers 224 Following Former Executive Chairman & CEO and tweets from Schmidt Foundation
Alex Andonian @alexjandonian
251 Followers 778 Following PhD student in EECS at MIT, studying topics in computer vision, machine learning, and AI
Michael Littman @mlittmancs
8K Followers 160 Following
Brian Ichter @brian_ichter
2K Followers 178 Following Research Scientist at Google Brain, interested in robotics and AI
Cognition @cognition_labs
124K Followers 19 Following Makers of Devin, the first AI software engineer. We are an applied AI lab focused on reasoning, and code is just the beginning. Join us: https://t.co/tpfZwEwGiq
Physical Intelligence @physical_int
4K Followers 8 Following Physical Intelligence (Pi), bringing AI into the physical world.
Tianwei Yue @VyvyenYue
898 Followers 445 Following @MathGPTPro CEO/Founder | @YCombinator W24 | @LTIatCMU
yonatan @zozuar
39K Followers 152 Following
Fauna Robotics @faunarobotics
734 Followers 18 Following
Jesse Farebrother @JesseFarebro
645 Followers 309 Following PhD student @Mila_Quebec / @McGillU. Student Researcher @GoogleDeepMind.
@TongzhouWang I think reorganizing information can be seen as adding new information encoded in the reorganization scheme. For example, if you are reorganizing N bits of information with program P of length K bits, you are effectively adding K bits of new information.
@lauriewired Not really compression when the actual data isn't there though... Might as well just store the actual data on a database somewhere and store the url to access it in a file and call that "compression"
@ID_AA_Carmack I used to think that controlling movement through muscles was too complex but this ICLR paper changed my mind. But realism also requires modeling the subcutaneous and visceral adipose tissue (ie fat) and it's complex: more on that at #CVPR2024. github.com/martius-lab/de…
🚨 Iterative Reasoning Preference Optimization 🚨 - Iterative algorithm for reasoning tasks: generate pairs & apply DPO+NLL - Improves accuracy over iterations on GSM8K, MATH, ARC & beats baselines E.g. Llama2-70B GSM8K: 55.6%->81.6% (88.7% maj32) arxiv.org/abs/2404.19733 🧵(1/5)
never thought i'd be featured in the financial times, but if i am going to be featured, i'm glad it's because of my crazy commute! 😂 ft.com/content/26b552…
@cHHillee asked for an example of why you might want to ignore the constraint you're optimising over, and so i've knocked together the picture i had in my head
also true in optimisation algs! if you wanna optimise (f + g)(x), often much faster to optimise f(x) + g(y) + error(x, y)
Imitation learning works™ – but you need good data 🥹 How to get high-quality visuotactile demos from a bimanual robot with multifingered hands, and learn smooth policies? Check our new work “Learning Visuotactile Skills with Two Multifingered Hands”! 🙌 toruowo.github.io/hato/
The really cool part of REBEL is how it generalizes the classic Natural Policy Gradient algorithm (my favorite RL alg) while being as scalable as REINFORCE :) Some details:
In the words of Billy Idol, give a "rebel yell" for REBEL: a strikingly simple RL algorithm (it's just regression! no clipping / critics!) that scales to generative models (both LLMs and Diffusion Models!) and has deep theoretical interpretations: arxiv.org/abs/2404.16767. [1/8]
apparently Google laid off their entire Python Foundations team, WTF! ( @SkyLi0n who is one of the pybind11 maintainers just informed me, asking what ways they can re-fund pybind11) The team seems to have done substantial work that seems critical for Google internally as well.…
@zicokolter @pratyushmaini @A_v_i__S @SarahKSilverman Yeah I think this is going towards a form of counterfactual definition. You could say a string X seems memorized by LLM1 if it can be compressed more easily by LLM1 than some other alternative LLM2 that was clearly not trained on X. In this example, you use ZIP for LLM2
This was 6 years ago! I continue to run into people who tell me they've been following this and find it helpful. If you haven't already, take a look :) Calendar. Not to-do lists. deviparikh.substack.com/p/calendar-in-…
My first blog post! Several people have asked me for time management advice over the years. I was encouraged to believe that there is a good chance others might find the advice useful too :) Hence this post. Thoughts are welcome! medium.com/@deviparikh/ca…
First @nvidia DGX H200 in the world, hand-delivered to OpenAI and dedicated by Jensen "to advance AI, computing, and humanity":
oh no not this again
@dustinvtran what do you mean by "it's class"? Did Gemini 1.5 Pro's size ever get revealed?
phi-3 is here, and it's ... good :-). I made a quick short demo to give you a feel of what phi-3-mini (3.8B) can do. Stay tuned for the open weights release and more announcements tomorrow morning! (And ofc this wouldn't be complete without the usual table of benchmarks!)
@TongzhouWang This is as fast as I can make it... Need CUDA wizard from there. But before that I have to check my idea works.
@TongzhouWang I am trying to fight the SSM people and their pesky parallel scans.
We have just released 🍷 FineWeb: 15 trillion tokens of high quality web data. We filtered and deduplicated all CommonCrawl between 2013 and 2024. Models trained on FineWeb outperform RefinedWeb, C4, DolmaV1.6, The Pile and SlimPajama!
@TongzhouWang Currently I think junior authors gain more than they lose by including a famous senior author somewhere on their author list, and I'm suggesting that we should try to reduce the benefits of doing so.
Trends for United States
You might like
