Research Scientist at Google DeepMind, working on Gemini.
(prev. PhD at ETH Zürich & MPI-IS Tübingen.)
No second-hand opinions. They are absolutely my own ;)sidakpal.com New YorkJoined October 2022
🚀 TOMORROW afternoon at ICLR: Learn about the directionality of optimization trajectories in neural nets and how it inspires a potential way to make LLM pretraining more efficient ♻️
(Poster# 585, hall 2b)
🚀 TOMORROW afternoon at ICLR: Learn about the directionality of optimization trajectories in neural nets and how it inspires a potential way to make LLM pretraining more efficient ♻️
(Poster# 585, hall 2b)
Don't miss out our spotlight ✨paper at ICLR 🇸🇬 about the loss landscape of Transformers and their special heterogeneous structure, done together with great collaborators!
x.com/wormaniec/stat…
Don't miss out our spotlight ✨paper at ICLR 🇸🇬 about the loss landscape of Transformers and their special heterogeneous structure, done together with great collaborators!
x.com/wormaniec/stat…
✨New Preprint ✨ Ever thought that reconstructing masked pixels for image representation learning seems sub-optimal?
In our new preprint, we show how masking principal components—rather than raw pixel patches— improves Masked Image Modelling (MIM).
Find out more below 🧵
Reinventing things has a bad rep in today's age. But is it really that bad? Maybe it's something to be even cultivated, like selectively?
The second post in this series of blogs is now out. Let's have a deeper look at this overused trope!
wovencircuits.substack.com/p/reinventing-…
I’m exploring a new form of writing—threads of human curiosity woven through the circuits of AI, crafting reflections that are, in the end, fully machine-generated, yet in a way profoundly human.
wovencircuits.substack.com/p/the-spirit-b…
Come, let's scale up the building one floor,
And, layer up the neural networks once more.
Soon our buildings will touch the sky,
And, our computers will bear AGI.
A quaint little hut in the mountains is out of fashion,
Satisfaction has no gradients for backpropagation.
~Fitoor
18K Followers 4K FollowingAssociate Professor at UC Berkeley. Former Research Scientist at Google DeepMind. ML/AI Researcher working on foundations of LLMs and deep learning.
1K Followers 842 FollowingPh.D. student @kaist_ai |
Intern at @Google @IBMResearch @MSFTResearch @Amazon |
ML for knowledge, languages, and their intersections at scale.
2K Followers 7K FollowingFounder, Imaginator ai
knowledge discovery 2D navigation TS ML DL recsys econ math incentives mech design finance networks bridges boundaries, Time, 3d type
75K Followers 3K FollowingEmpowering every investor and trader, every market day. Not a service channel. RT≠ endorsement. Imp Discl: https://t.co/PjwPtVTPpv
6K Followers 478 FollowingxAI, pre-train lead for v7, grok2&3&4 mini. ex-OpenAI, sole inventor of GPT4-turbo long-context. Core contributor to (GPT4/o/turbo, DaLLE 3, OAI Embedding v3)
540 Followers 157 FollowingStaff AI Scientist, Institute of Foundation Models @MBZUAI. Previously Research Manager @MITIBMLab @IBMResearch Stats PhD @UMich
3K Followers 668 FollowingFoundations of AI. I like simple & minimal examples and creative ideas. I also like thinking about going beyond the next token 🧮🧸
Google Research | PhD, CMU
163K Followers 166 FollowingCo-founder of Thinking Machines Lab @thinkymachines; Ex-VP, AI Safety & robotics, applied research @OpenAI; Author of Lil'Log
1K Followers 438 FollowingResearch Scientist @GoogleDeepMind,
pre-training and architecture research in Gemini, Gemma.
On leave from PhD with @AaronCourville.
Opinions are my own.
367 Followers 261 FollowingAssoc. prof at @tugraz: Efficient deep learning, embedded information processing and edge computing. A mix of theory and empirics. #StandWithUkraine🇺🇦
4K Followers 928 FollowingResearch fellow at Flatiron Institute, working on understanding optimization in deep learning. Previously: PhD in machine learning at Carnegie Mellon.
5K Followers 692 FollowingResearch Scientist @allen_ai, PhD in NLP 🤖 UofA. Ex @GoogleDeepMind @MSFTResearch @MilaQuebec 🚨🚨 NEW BLOG about LLMs reasoning: https://t.co/Ox0iOaqY7e
23K Followers 680 FollowingProfessor and Head of Machine Learning Department at @CarnegieMellon. Board member @OpenAI and @Qualcomm. Chief Technical Advisor @GraySwanAI.
27K Followers 2K FollowingProfessor at UMD. AI security & privacy, algorithmic bias, foundations of ML.
Follow me for commentary on state-of-the-art AI.
79K Followers 1 FollowingDemocratizing AI research, education, and technologies. Learn how to build with AI in our new AI Academy: https://t.co/zQXQt0Pem8
450 Followers 1K FollowingStatistical Physicist and Associate Professor @Unibo. Studied and worked in Rio, Rome, Paris, Lausanne, and London. PhD at @PhysicsUnipi.
Views are my own.
20K Followers 452 Followingphysics of language models @ Meta (FAIR, not GenAI)
🎓:Tsinghua Physics — MIT CSAIL — Princeton/IAS
🏅:IOI x 2 — ACM-ICPC — USACO — Codejam — math MCM
238 Followers 10 FollowingCultivating discussions and debates in the field of Deep Learning @ the University of Amsterdam, part of ELLIS.
Founded by @egavves, part of @UvA_IvI.
48K Followers 627 FollowingPenn-Integrates-Knowledge (PIK) Professor, Wharton & School of Arts & Sciences. Likes = interesting; Retweets = very interesting; Interesting ≠ endorsement
57K Followers 568 FollowingAssistant Prof of CS @UWaterloo, Faculty @VectorInst, Canada @CIFAR_News AI Chair. Joining @NYU_Courant September 2026. Co-EiC @TmlrOrg. I lead @TheSalonML.
690 Followers 664 Followingwork on foundations of AI, MLLM reliability/Eval, optimization, probability/stats, AI 4 math/science/med; Prof & director of center on AIF4S @USC 🚲🏔️🥾🏊♂️
5K Followers 668 FollowingIncoming Assistant Prof, Toyota Technical Institute at Chicago @TTIC_Connect
Recruiting PhD students (start 2026) 👀
Will irl - TC0 enthusiast
No recent Favorites. New Favorites will appear here.