I always found it puzzling how language models learn so much from next-token prediction, while video models learn so little from next frame prediction. Maybe it's because LLMs are actually brain scanners in disguise. Idle musings in my new blog post: sergeylevine.substack.com/p/language-mod…
a long day came to an end;
a farewell made
to the mellow sunshine, which
slips from the bright two eyes of our little one,
and seeing me, more calmly,-
her trusted human.
a long day came to an end;
says lovingly, a daughter to her father,
and without saying a word,
today.
~
न्यास्रो
आँखा सामुन्नेबाट बिलए भएर
कथा बनेका मायाका सम्झनाहरू,
हृदय भित्रै सुनाएर बाँचेकाहरू ।
दिन र रातको दौड माझ
मन ओभानो नराख्ने न्यास्रोहरू,
मुस्कुराउँदै जिवन बिताएर जानेहरू ।
"कहिले त ठिकै छ नी
बिसाउन भारी मनको,
रोई देउ पिर निचोरेर
एकलै कति लुकाएको "
~
I tell students on the first day of class that if you're truly learning it's supposed to feel uncomfortable. The reason is that real learning is not simply the accumulation of facts; it is deep understanding, building mental models of the world, and other higher-level abilities.…
Suppose you and I both have different features about the same instance. Maybe I have CT scans and you have physician notes. We'd like to collaborate to make predictions that are more accurate than possible from either feature set alone, while only having to train on our own data.
This paper has been in the making for so long that eight children across the co-author group were born between the time we started and now!
But it is finally out, and you can check it at arxiv.org/pdf/2503.13323
🧵Algorithmic Learning Theory (ALT) 2025 in Milan just wrapped up! And we've made it the most open ALT ever!
For the first time ever, ALT has
- Publicly visible reviews and rebuttals!
- Public recordings of all talks!
Check out this thread for links & highlights (and gelato) 1/n
Your optimization algorithm is a circuit!
In our NeurIPS 2024 Spotlight paper with Stephen Boyd, Tetiana Parshakova, Jaewook Suh @Jaewook_J_Suh, we present a framework for designing optimization algorithms using (electric) circuit theory.
(Video and paper links in reply)
(1/3)
I align w/ Terry Tao’s opinion on the current state of AI and LLMs — He neither overestimates nor underestimates them.
Enormous potential but still many mistakes.
Some AI enthusiasts won’t be thrilled ;)
youtube.com/watch?v=_sTDSO…
Michael Jordan gave a short, excellent, and provocative talk recently in Paris - here's a few key ideas
- It's all just machine learning (ML) - the AI moniker is hype
- The late Dave Rumelhart should've received a Nobel prize for his early ideas on making backprop work
1/n
A new paper 🥳🥳🥳
We present "Rate-In" - a technique that helps neural networks better express their uncertainty during inference, especially crucial for medical applications!
with Tal Zeevi, @ylecun, H. Stain Lawrence and John Onofrey
the moon and the chase
of being to becoming;
one of the stars,
forgotten each night
in the lap of mundane life.
the lovers and the loved one
inscribe fond memories of sunshine;
oblivious of the companionship,
slip away their love for time,
and surrender to nostalgia.
~
2K Followers 5K FollowingResearch Associate at ITRE (NC State). PhD from @UNC @DCRPCarolina. Works on AI/ML for transportation and energy planning. Board member @okfn_np.
143 Followers 1K FollowingTelecom Engineer(Tweets are my own & Retweets are not endorsement). #5G #vRAN #Brain #AI #IoT #Robots #Cloud #ML #BSNL #TelecomInnovation
3K Followers 3K FollowingA podcast that explores the underlying principles of complex systems - systems that defy our rational view of the world. By Sean Brady (@BradyHeywood).
252 Followers 141 FollowingAssociate Prof. in ML @UniOslo, PI Norway Centre of Excellence Integreat & VI, Area Chair @NeurIPSConf, Action Editor @TmlrOrg, Alum. @EPFL_en @VectorInst @UofT
2K Followers 269 FollowingWe are no longer active on this platform. Find us on LinkedIn and Bluesky. AI research・ 5 Universities・7 Collaboratories・10 Areas of Societal Impact・#P1
2K Followers 5K FollowingResearch Associate at ITRE (NC State). PhD from @UNC @DCRPCarolina. Works on AI/ML for transportation and energy planning. Board member @okfn_np.
8K Followers 233 FollowingGeorge Lowther, Author of Almost Sure blog, on maths, probability and stochastic calculus.
Also on YouTube https://t.co/VyOijwbe9l
4K Followers 1K FollowingHistorical and cultural theories about math and science theories. Fields Medal killjoy. @UoE_STIS by day, @MathHistFacts by night, @SIGMA_maths thru 2027.
1.4M Followers 1K FollowingBuilding @EurekaLabsAI. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets.
894 Followers 284 FollowingProfessor at TU Wien (Austria); research on #dataManagement, #queryOptimization, and #analytics with a focus on #knowledgeGraphs
@katjahose.bsky.social
349K Followers 318 FollowingInstitute Professor @MIT, @MITEcon. Co-Director of @MITShapingWork. Author of Why Nations Fail, The Narrow Corridor, and Power & Progress.
6K Followers 2K FollowingAssistant Professor of Rhetoric @ Virginia Tech. Researches disasters & communication, non-western and feminist rhetorics. Author of Transnational Assemblages
7K Followers 405 FollowingSome days, I want to write poems and some days, i want to be one. . I write poems,songs and stories. here's link to my channel. Subscribe if you like them
252 Followers 141 FollowingAssociate Prof. in ML @UniOslo, PI Norway Centre of Excellence Integreat & VI, Area Chair @NeurIPSConf, Action Editor @TmlrOrg, Alum. @EPFL_en @VectorInst @UofT
2K Followers 269 FollowingWe are no longer active on this platform. Find us on LinkedIn and Bluesky. AI research・ 5 Universities・7 Collaboratories・10 Areas of Societal Impact・#P1
4K Followers 237 FollowingAssistant Professor @Berkeley_EECS (ML+Econ+Algorithms). Foundations of Machine Learning, by the people, for the people!
Co-founder @let4all.
1K Followers 847 FollowingProfessor in Connectivity. Editor in Chief at IEEE JSAC. Interested in how to process information and how information processes us.