Afroz Mohiuddin @afrozenator
@OpenAI, ex @Google, @AIAtMeta. Interested in Science, Psychology, Investing and generally everything. Good Thoughts, Good Words, Good Deeds. github.com/afrozenator SF Bay Area, CA Joined April 2009-
Tweets508
-
Followers1K
-
Following5K
-
Likes8K
Today we're putting out an update to the JAX TPU book, this time on GPUs. How do GPUs work, especially compared to TPUs? How are they networked? And how does this affect LLM training? 1/n
this dostoevsky quote is a massive whitepill if your intuitions are statistically mature btw if he perma grinded like a good boy instead of "idling around" and "making errors" the probability that he'd have died as a noname normie journalist rounds to 1 if you pay attention…
Congratulations to the talented team @achowdhery @IrwanBello @real_ioannis
Congratulations to the talented team @achowdhery @IrwanBello @real_ioannis
"Raffiniert ist der Herrgott, aber boshaft ist er nicht" (God is subtle*, but malicious he is not.) — Albert Einstein * Also translated as: tricky, crafty, shrewd, sophisticated
Finance has four simple rules: maintain a clear mind, figure out asymmetries, detect circularities, and never talk to idiots.
“The test of a first-rate intelligence is the ability to hold two opposing ideas in mind at the same time and still retain the ability to function. One should, for example, be able to see that things are hopeless yet be determined to make them otherwise.” F. Scott Fitzgerald
o3: Leibniz wanted a single calculus, every thought settled by calculation. A LLM does just that: it turns all words into numbers, learns the patterns that link them. Its CoT is the arithmetic of reasoning. The old universal logic lives now in silicon, humming behind each reply
So happy our new multilingual benchmark MultiLoKo is finally out (after some sweat and tears!) arxiv.org/abs/2504.10356 Multilingual eval for LLMs... could be better, and I hope MultiLoKo will help fill some gaps in it + help study design choices in benchmark design @metaai
Coming from you @lukaszkaiser this means a lot 🥰
Coming from you @lukaszkaiser this means a lot 🥰
Very excited to share Llama 4 models with the world. The pre-training team has cooked over the past few months to launch Llama 4 Scout, Maverick, and Behemoth. A 🧵about pretraining Blog link: ai.meta.com/blog/llama-4-m…
Our Llama 4’s industry leading 10M+ multimodal context length (20+ hours of video) has been a wild ride. The iRoPE architecture I’d been working on helped a bit with the long-term infinite context goal toward AGI. Huge thanks to my incredible teammates! 🚀Llama 4 Scout 🔹17B…
Really proud to present this model to the world and really excited on what is coming ahead 🔥🦾🚀
Extremely proud to have pioneered large scale distillation for Maverick and really delighted to be working alongside an extremely talented team. We truly hope the OSS community enjoys the fruits of our labour.
Extremely proud to have pioneered large scale distillation for Maverick and really delighted to be working alongside an extremely talented team. We truly hope the OSS community enjoys the fruits of our labour.
Today is the start of a new era of natively multimodal AI innovation. Today, we’re introducing the first Llama 4 models: Llama 4 Scout and Llama 4 Maverick — our most advanced models yet and the best in their class for multimodality. Llama 4 Scout • 17B-active-parameter model…
I feel a little bit for the @GoogleDeepMind team.. You build a world changing model and everyone is posting Ghibli-fied pictures instead. But this is the core problem with Google - they can build the best models in the world but if they don’t focus on the consumer experience…

Yi Tay @YiTayML
46K Followers 81 Following research scientist @googledeepmind ✨♊, model co-lead/captain of gemini deepthink imo gold medal 🥇, opinions are my own.
Aakanksha Chowdhery @achowdhery
11K Followers 5K Following @Stanford @reflection_ai // Previously @GoogleDeepMind :: PaLM, Gemini // @MSFTResearch, @Princeton // views my own and subject to change
rohan anil @_arohan_
25K Followers 2K Following
James Bradbury @jekbradbury
13K Followers 9K Following Compute at @AnthropicAI! Previously JAX, TPUs, and LLMs at Google, MetaMind/@SFResearch, @Stanford Linguistics, @Caixin.
Sara Hooker @sarahookr
49K Followers 9K Following I lead @Cohere_Labs. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, ML reliability. Changing spaces where breakthroughs happen.
Rosanne Liu @savvyRL
46K Followers 1K Following (On mat leave.) Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS.
Barret Zoph @barret_zoph
21K Followers 1K Following CTO & Co-Founder Thinking Machines Lab (@thinkymachines) Past: - VP Research (Post-Training) @openai - Research Scientist at Google Brain
Adam Roberts @ada_rob
8K Followers 718 Following ai researcher & engineer @ Google DeepMind :: ♫ Co-lead Magenta & Lyria :: 📝 Foundational LLM work: TL for T5 & C4, core PaLM :: 👨💻 TL for T5x & SeqIO
Ian Tenney (@iftenney... @iftenney
2K Followers 535 Following Staff Research Scientist, People + AI Research @GoogleAI #GoogleResearch. Interpretability, analysis, and visualizations for LLMs. Opinions my own.
Nathan Benaich @nathanbenaich
61K Followers 34K Following solo member of investment staff @airstreet @airstreetpress @stateofaireport @raais
Matthew Johnson @SingularMattrix
13K Followers 3K Following Researcher at Google Brain. I work on JAX (https://t.co/UGa5tGfinF).
Christian Szegedy @ChrSzegedy
41K Followers 3K Following #deeplearning, #ai research scientist. Opinions are mine.
Neil Houlsby @neilhoulsby
6K Followers 339 Following Member of Technical Staff at Anthropic Amateur athlete https://t.co/G1kDE7Dyau
Jeremy Howard @jeremyphoward
259K Followers 6K Following 🇦🇺 Co-founder: @AnswerDotAI & @FastDotAI ; Prev: professor @ UQ; Stanford fellow; @kaggle president; @fastmail/@enlitic/etc founder https://t.co/16UBFTX7mo
Charlotte @2QGDj8AqUtEHRzE
4 Followers 328 Following
Anna Roberts @7BJjZ8jSyoSsq
0 Followers 192 Following Target 30%+ monthly | 2 pro-grade US ideas. Free alerts for entries, exits, and risk control. @CassfMoore
Peeuhew @Peeuhew8985
8 Followers 480 Following
gary @Vnlu1vEqPf
1 Followers 67 Following
michael bressler @mibressler
67 Followers 2K Following HiWi @TUMCDPS. Interested in computational law & technology policy.
GustaveSpenser @L3r5x1b761w80
1 Followers 196 Following
Scarlett Jackson @9C7CM4M2hfyps
0 Followers 159 Following 30%+ monthly goal | 2 selective US stocks only. Instant signals and concise plans—join free. @CassfMoore
Dong He @dongheuw
165 Followers 276 Following Scaling Llama Pretraining and Posttraining @AIatMeta. PhD @uwcse.
Alice @Ycocor5721372
16 Followers 1K Following
Tsutomu Ohkura @ohkura
2K Followers 445 Following グーグル先生のネタ本を作るひと。 今はGoogleの検索部門でLLMを検索に応用するチームの技術リード/マネージャーをしています。(このアカウントの発言はすべて個人的見解です)is2004 未踏スーパークリエーター ENTP
Jun (Muck) @koelschkoreaner
0 Followers 1K Following
BridgetHolmes @5r2Q3LfzRz2E55U
0 Followers 286 Following
HIKMAT ULLAH @HIKMATU59192289
31 Followers 751 Following This is hikmat ullah meaning of my name is wise, I am so quick in Silent
Weiwei Chu @ChuCwwvee
4 Followers 7 Following
zhangbwen海角 @zhangbwen155331
1 Followers 136 Following
Leo Chenghui Li @leo_chenghui
3 Followers 84 Following AI Research & Engineering @AIatMeta: Llama, Codec Avatars | Previously @CarnegieMellon, @CUHKOfficial
Adam Falls @AdamFalls172137
56 Followers 4K Following
Keahket @Keahket053
15 Followers 2K Following
Poorva Rane @PoorvaRane
197 Followers 771 Following Senior Research Engineer @ Google Deepmind #Veo3, #Imagen4, #Imagen3, #Veo
Saber Darabi @SADarabi
299 Followers 7K Following
AddieCloud @Frerwui5053474
24 Followers 1K Following "Healing isn’t just about fixing the body, it’s about mending the soul too."
Deepika Bablani @deepikabablani
266 Followers 1K Following Learning to learn. Machine Learning Research @Apple. Previously @IBMResearch and @CMU.
🇺🇸Release The E... @mcnultydigital
432 Followers 8K Following Don't Be A Trump First Pathetic “Patriotic” Pedo Protector Defending Delulu Donald’s Denying, Distracting & Deflecting
TheOrangeCoin @BTCOrangeCoin
241 Followers 2K Following
Otlermcaw @Otlermcaw42143
9 Followers 1K Following
Xirela @Xirela7449
23 Followers 488 Following
Qauma @Qauma3386
31 Followers 705 Following no matter where to go, what weather, remember to bring their own sunshine.
Deborah @yh13WWeKE8XTd
20 Followers 1K Following
QuantumTrading🇺�... @Sraralcar25392
43 Followers 2K Following 15-30% Monthly | 2 High-Conviction Stocks.Short-Term Gains: 15-20% in Days/Weeks.DM "JOIN" for WhatsApp Alerts. Live Trade Signals • Market Analysis
Vaibhav Balloli @v_balloli
180 Followers 2K Following Intern at AI Frontiers, MSR. AI for Social Good | Human-Centered AI | Ph.D. candidate at @UMichCSE. Ex-Microsoft Research, BITS Pilani.
TechSupercycle🇺�... @Jalleeq698
27 Followers 2K Following 15-30% Monthly | 2 High-Conviction Stocks.Short-Term Gains: 15-20% in Days/Weeks.DM "JOIN" for WhatsApp Alerts. Live Trade Signals • Market Analysis
Fauqoo @Fauqoo9237932
23 Followers 1K Following
Todor Mihaylov @tbmihaylov
774 Followers 1K Following Research Scientist, Working on Llama at @MetaAI
Josh Tarasoff @joshtarasoff
12K Followers 1K Following investing in Quality - nothing here is investment advice
rahul x @rahulme74418504
58 Followers 2K Following
Liang Ding @liangdingNLP
782 Followers 2K Following NLP/ML Researcher (working on developing GenAI and its human-centric applications) & Ex-@JD_Corporate @TencentGlobal @Sydney_Uni. Opinions are my own.
Yann LeCun @ylecun
948K Followers 764 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
AK @_akhaliq
425K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo ,submit papers here: https://t.co/UzmYN5YmrQ
Yi Tay @YiTayML
46K Followers 81 Following research scientist @googledeepmind ✨♊, model co-lead/captain of gemini deepthink imo gold medal 🥇, opinions are my own.
Aakanksha Chowdhery @achowdhery
11K Followers 5K Following @Stanford @reflection_ai // Previously @GoogleDeepMind :: PaLM, Gemini // @MSFTResearch, @Princeton // views my own and subject to change
Andrej Karpathy @karpathy
1.4M Followers 1K Following Building @EurekaLabsAI. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets.
Paul Graham @paulg
2.1M Followers 776 Following
François Chollet @fchollet
572K Followers 813 Following Co-founder @ndea. Co-founder @arcprize. Creator of Keras and ARC-AGI. Author of 'Deep Learning with Python'.
Jason Wei @_jasonwei
97K Followers 636 Following ai researcher @meta superintelligence labs, past: openai, google 🧠
Lucas Beyer (bl16) @giffmana
108K Followers 518 Following Researcher (now: Meta. ex: OpenAI, DeepMind, Brain, RWTH Aachen), Gamer, Hacker, Belgian. Anon feedback: https://t.co/xe2XUqkKit ✗DMs → email
rohan anil @_arohan_
25K Followers 2K Following
Behnam Neyshabur @bneyshabur
29K Followers 858 Following Research @AnthropicAI (Co-lead Discovery team) 💼 Past: Gemini @GoogleDeepMind (Co-led Blueshift team) 🧠 LLM Reasoning / AI Scientist 🎒Traveling & Backpacking
Jim Fan @DrJimFan
325K Followers 3K Following NVIDIA Director of Robotics & Distinguished Scientist. Co-Lead of GEAR lab. Solving Physical AGI, one motor at a time. Stanford Ph.D. OpenAI's 1st intern.
Jeff Dean @JeffDean
365K Followers 6K Following Chief Scientist, Google DeepMind & Google Research. Gemini Lead. Opinions stated here are my own, not those of Google. TensorFlow, MapReduce, Bigtable, ...
Kyunghyun Cho @kchonyc
77K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre physicist at @nyuniversity (@CILVRatNYU) & @PrescientDesign
Marcin Andrychowicz @Andr92277Marcin
3 Followers 4 Following
Marzieh Fadaee @mziizm
1K Followers 550 Following seeks to understand language. Head of @Cohere_Labs. PhD from @UvA_Amsterdam. https://t.co/YI5NC5J5e4. [email protected].
Haozhe Jiang @erichzjiang
20 Followers 111 Following
Andrew Curran @AndrewCurran_
33K Followers 13K Following 🏰 - I write about AI, mostly. Expect some strange sights.
Scott Jeen @enjeeneer
662 Followers 2K Following Predicting the future @_Mantic_AI. Previously PhD at Cambridge University. AI and reinforcement learning.
Figure @Figure_robot
141K Followers 1 Following Figure is an AI Robotics company building the world's first commercially viable autonomous humanoid robot.
Jacob Kahn @jacob_d_kahn
181 Followers 3 Following AI Researcher at FAIR, @MetaAI. CS Faculty at @Penn.
Jessie Lee Rubin 🇵... @manly_footwear
2K Followers 916 Following
Jeff Melnick @melnickjeffrey1
19K Followers 9K Following Recent: see link below for Manson book! Current: “Boston Sounds: Music in the City, the City in Music” ; UMass Boston American Studies; Anti-Zionist 🇵🇸
raulpuri.eth @TheRealRPuri
8K Followers 347 Following AI things @ OpenAI - ChatGPT Multimodal, Her, GPT4V, 4, 4o, 3.5, Codex | past: NVIDIA - megatron, sentiment neurons | go bears 🐻
Tolga Bilge @TolgaBilge_
4K Followers 699 Following AI policy @ai_ctrl | https://t.co/IiJWWuiWhD & https://t.co/Ep1VpsILyj | @Superforecaster — https://t.co/UJM9tu3gJU — https://t.co/cl89dttvRF
Dong He @dongheuw
165 Followers 276 Following Scaling Llama Pretraining and Posttraining @AIatMeta. PhD @uwcse.
X. Dong @SimonXinDong
899 Followers 385 Following Research Scientist@NVIDIA . Making LLMs e.g., Hymba, Nemotron serials. Ex @Harvard @Meta @Tencent| Views and opinions are my own
Kezhi Kong @KezhiKong
334 Followers 366 Following Research Scientist @NVIDIA working on Nemotron-*; PhD @UMDCS; BS @ZJU_China; opinions are my own
Sanjeev Satheesh @issanjeev
536 Followers 398 Following
Mostofa Patwary @mapatwary
33 Followers 16 Following
Qian Huang @qhwang3
14K Followers 331 Following prev @xai | CS PhD student @StanfordAILab (on leave)
Tsutomu Ohkura @ohkura
2K Followers 445 Following グーグル先生のネタ本を作るひと。 今はGoogleの検索部門でLLMを検索に応用するチームの技術リード/マネージャーをしています。(このアカウントの発言はすべて個人的見解です)is2004 未踏スーパークリエーター ENTP
Pedro Domingos @pmddomingos
101K Followers 176 Following Professor of computer science at UW and author of '2040' and 'The Master Algorithm'. Into machine learning, AI, and anything that makes me curious.
Omar Shams @smahsramo
1K Followers 613 Following ai agent at google. (exited) founder/ceo mutableai (yc w22). deepmind. theoretical particle physics. views my own.
💺 @patience_cave
4K Followers 582 Following patience, jimmy, openai is nothing without its good research takes time in the patience cave.
Weiwei Chu @ChuCwwvee
4 Followers 7 Following
Shaojie Bai @shaojieb
1K Followers 285 Following Doing AI at @thinkymachines. Previously GenAI+RLR @ Meta. CMU MLD. Twitter account for more than AI.
Eryk Helenowski @ErykHelenowski
515 Followers 236 Following
Bo Liu @cranialxix
473 Followers 210 Following Research Scientist @Meta FAIR | CS PhD @UT Austin | Former Research Intern @DeepMind, @Nvidia, @Baidu
Leo Chenghui Li @leo_chenghui
3 Followers 84 Following AI Research & Engineering @AIatMeta: Llama, Codec Avatars | Previously @CarnegieMellon, @CUHKOfficial
RL_Conference @RL_Conference
5K Followers 256 Following Home of the first annual reinforcement learning conference. Stay tuned up for updates!
Joost van Amersfoort @joost_v_amersf
2K Followers 306 Following Research Scientist @GoogleDeepMind -- PhD from @UniofOxford Scaling (Pre-)training in the Gemini team.
Yaroslav @512x512
49K Followers 363 Following Making apps. Building tools. Surfing the information superhighway. Previously @xAI @atlassian
Poorva Rane @PoorvaRane
197 Followers 771 Following Senior Research Engineer @ Google Deepmind #Veo3, #Imagen4, #Imagen3, #Veo
Sean Kirmani @SeanKirmani
3K Followers 547 Following Research @OpenAI. Interested in intelligence, understanding, and science.
Jiawei Zhao @jiawzhao
3K Followers 242 Following Research Scientist at Meta FAIR @AIatMeta, PhD @Caltech, GaLore, DeepConf
Jesse Michael Han @jessemhan
3K Followers 583 Following @morph_labs // prev. research @OpenAI / PhD in math and neural theorem proving
Harri Edwards @HarriLEdwards
311 Followers 221 Following Previously @OpenAI (Reasoning, Superalignment)
Thien Tran @gaunernst
1K Followers 223 Following
SzymonOzog @SzymonOzog_
2K Followers 150 Following Maximizing throughput at @Aleph__Alpha Educating people about GPUs at https://t.co/81rRJ4KWK1
Jonathan Gray @jgrayatwork
2K Followers 352 Following Inference @AnthropicAI. Previously: @MetaAI (FAIR), @openai
ℏεsam @Hesamation
36K Followers 573 Following ai engineer | rigorously overfitting on a learning curve
Yonglong Tian @YonglongT
3K Followers 244 Following Research Scientist @OpenAI. Prev RS@GoogleDeepMind, PhD@MIT. Opinions are my own.
Zhijing Jin @ZhijingJin
6K Followers 1K Following @zhijingjin.bsky.social☀️Assi. Prof@UofTCompSci. Postdoc@MPI_IS w/ @bschoelkopf. @CausalNLP + NLP4SocialGood @NLP4SG. Mentor & mentee @ACLMentorship
Weiyan Shi@ICLR and C... @shi_weiyan
6K Followers 1K Following Assistant professor @Northeastern | MIT TR #35under35 @techreview | Prev @StanfordNLP @Columbia @MetaAI | Co-developed CICERO | persuasive AI+AI safety #nlproc