Research Scientist, Google Brain now DeepMind
where cognitive science and machine learning meetcs.colorado.edu/~mozer San Francisco, CAJoined January 2022
[📜1/9] Does machine unlearning truly erase data influence? Our new paper reveals a critical insight: 'forgotten' information often isn't gone—it's merely dormant, and easily recovered by fine-tuning on just the retain set.
We are announcing the launch of Airial Travel’s open-to-all beta version for desktop today. Airial is your personal travel agent with AI superpowers which makes planning and booking trips as easy as dreaming them up. airial.travel
Me and Sanjeev co-founded Airial…
Excited to present "Recurrent Complex-Weighted Autoencoders for Unsupervised Object Discovery" at #NeurIPS2024!
TL;DR: Our model, SynCx, greatly simplifies the inductive biases and training procedures of current state-of-the-art synchrony models. Thread 👇 1/x.
The ability to properly contextualize is a core competency of LLMs, yet even the best models sometimes struggle. In a new preprint, we use #MechanisticInterpretability techniques to propose an explanation for contextualization errors: the LLM Race Conditions Hypothesis. [1/9]
🔍 New LLM Research 🔍
Conventional wisdom says that deep neural networks suffer from catastrophic forgetting as we train them on a sequence of data points with distribution shifts. But conventions are meant to be challenged!
In our recent paper led by @YanlaiYang, we discovered…
Nature Comms paper: Subtle adversarial image manipulations influence both human and machine perception! We show that adversarial attacks against computer vision models also transfer (weakly) to humans, even when the attack magnitude is small. nature.com/articles/s4146…
1/ Today we are excited to introduce Phenaki: phenaki.github.io, short-link-to-paper, a model for generating videos from text, with prompts that can change over time, and that is able to generate videos that can be as long as multiple minutes!
Two important breakthroughs from @GoogleAI this week - Imagen Video, a new text-conditioned video diffusion model that generates 1280x768 24fps HD video. And Phenaki, a model which generates long coherent videos for a sequence of text prompts. imagen.research.google/video/
We are excited to make the jump to complex real-world data with this class of models — and about the potential that slot-based models have for reducing the need for detailed human supervision when learning about the physical world.
6/7
Excited to share our work on self-supervised video object representation learning:
We introduce SAVi++, a slot-based video model that — for the first time — scales to Waymo Open driving scenes w/o direct supervision.
🖥️ slot-attention-video.github.io/savi++
📜 arxiv.org/abs/2206.07764
1/7
Overcoming temptation: Incentive design for intertemporal choice
arxiv.org/abs/2203.05782
We use AI models to help individuals adhere to long-term goals (e.g., retirement savings, weight loss) and avoid giving in to temptation.
77K Followers 2K Followinga combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre physicist at @nyuniversity (@CILVRatNYU) & @PrescientDesign
46K Followers 1K Following(On mat leave.) Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS.
49K Followers 9K FollowingI lead @Cohere_Labs. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, ML reliability. Changing spaces where breakthroughs happen.
10K Followers 851 FollowingI want to understand things deeply and explain them well. Building friendly AI @AnthropicAI
Give me anonymous feedback: https://t.co/7aBNrpbad8
15K Followers 216 FollowingAssociate Professor @ SFU (Research Chair), Research Scientist @ Google DeepMind, Associate Professor (status only) @ UofT. Opinions are my own.
28K Followers 1K FollowingResearch at @GoogleDeepMind. Controllable World Simulators (GNNs, Structured World Models, Neural Assets). Veo Team (Ingredients to Video Co-Lead)
48K Followers 672 FollowingProfessor, Santa Fe Institute. Mostly posting on https://t.co/4NpA2IL5Va (at-melaniemitchell). More thoughts at https://t.co/nC43NHRozX.
121K Followers 639 FollowingMila Scientific Director. Ex @Google DeepMind & Twitter Cortex. Father of 4. // Directeur scientifique à Mila. Ex @Google DeepMind & Twitter Cortex. Père de 4.
7K Followers 1K FollowingStaff Research Scientist at Google DeepMind. Interested in the science of deep learning. Current focus: Pushing boundaries of LLMs capabilities
6K Followers 5K FollowingDesigning deep tech at @exoultcom, @expedia (@vrbo) & @mckinsey alumni. Dog mom. Old soul, modern mind. Urban homesteader 👩🌾🍃 All views are my own
303 Followers 1K FollowingComputer Vision, Graphics, and ML | @unccs PhD Candidate | Student Researcher at @Google | Interested in many, many things. Optimist.
506 Followers 465 FollowingML PhD student @ml_tuberlin & @bifoldberlin. Diffusion post-training. Aiming to solve intelligence and use that for everything else. Views aren’t my employer’s.
422 Followers 579 FollowingSenior ML scientist@AWS AI working on multi-model models. PolygonRNN, 3DOP, PC training, TubeR. PhD (ABD) at University of Toronto ML group
56 Followers 138 FollowingPhD Student @Princeton | Intern @MSFTResearch | BTech @iitkgp |
Working at the intersection of cognitive neuroscience and machine learning
77K Followers 2K Followinga combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre physicist at @nyuniversity (@CILVRatNYU) & @PrescientDesign
46K Followers 1K Following(On mat leave.) Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS.
49K Followers 9K FollowingI lead @Cohere_Labs. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, ML reliability. Changing spaces where breakthroughs happen.
50K Followers 405 Following@AnthropicAI. Prev. @Google Brain/DeepMind, founding team @OpenAI. Computer scientist; inventor of the VAE, Adam optimizer, and other methods. ML PhD.
10K Followers 851 FollowingI want to understand things deeply and explain them well. Building friendly AI @AnthropicAI
Give me anonymous feedback: https://t.co/7aBNrpbad8
365K Followers 6K FollowingChief Scientist, Google DeepMind & Google Research. Gemini Lead. Opinions stated here are my own, not those of Google. TensorFlow, MapReduce, Bigtable, ...
28K Followers 1K FollowingResearch at @GoogleDeepMind. Controllable World Simulators (GNNs, Structured World Models, Neural Assets). Veo Team (Ingredients to Video Co-Lead)
121K Followers 639 FollowingMila Scientific Director. Ex @Google DeepMind & Twitter Cortex. Father of 4. // Directeur scientifique à Mila. Ex @Google DeepMind & Twitter Cortex. Père de 4.
7K Followers 1K FollowingStaff Research Scientist at Google DeepMind. Interested in the science of deep learning. Current focus: Pushing boundaries of LLMs capabilities
2K Followers 600 FollowingML/AI Research Engineer @GoogleAI. Working on Expressive ML and approaches in Human-AI Interactions. Opinions are my own. Formerly: @GoogleBrain, @GoogleMagenta
454 Followers 529 FollowingPhD student at Brown interested in deep learning + cog sci, but more interested in playing guitar. @NSF GRFP Fellow, @GoogleDeepMind Intern. He/Him.
38K Followers 7 FollowingProfessor of machine learning at the University of Cambridge. Opinions are my own. Author of "The Atomic Human"
Mainly found on @lawrennd.bsky.social
24K Followers 706 FollowingMember of the technical staff @ Anthropic. Most (in)famous for inventing diffusion models. AI + physics + neuroscience + dynamics.
6K Followers 761 FollowingSenior Research Scientist @GoogleDeepMind. I ∈ Optimization ∩ Machine Learning. Fan of @IronMaiden🤘.Here to discuss research 🤓
2K Followers 1K FollowingProf@KAIST, Chief Dreamer of Machine Learning & Mind Lab https://t.co/ato9yodtm5 Previously, professor at Rutgers, postdoc at Mila, and PhD at UC Irvine
1K Followers 438 FollowingResearch Scientist @GoogleDeepMind,
pre-training and architecture research in Gemini, Gemma.
On leave from PhD with @AaronCourville.
Opinions are my own.
2K Followers 673 FollowingResearch scientist at Google DeepMind. Ph.D. in Machine Learning from the University of Toronto / Vector Institute. @[email protected]
5K Followers 656 Following🇨🇦 Assistant Professor of Comp Sci. and Data Sci. at NYU. Machine Learning, Human-like AI. @agentic_ai_lab
Follow me on @mengyer.bsky.social
5K Followers 1K FollowingGenAI for *human* creativity in music + more. Assistant prof at CMU CSD, 🎼 G-CLef lab. Part time Google DeepMind, Magenta (views my own)
3K Followers 2K FollowingMachine learning / AI Safety at @AnthropicAI and University of Toronto / Vector Institute. Prev. @google (Blueshift Team) and @nvidia.