Jiawei Zhao @jiawzhao
Research Scientist at Meta FAIR @AIatMeta, PhD @Caltech, GaLore, DeepConf jiaweizhao.com Joined February 2013-
Tweets91
-
Followers3K
-
Following242
-
Likes192
Want to try DeepConf NOW? While our full repo is coming, we just dropped a ready-to-run example in our vLLM (@vllm_project ) PR: github.com/vllm-project/v… DeepConf + DeepSeek-R1-8B + BRUMO25 = • 93.3% accuracy (+2.5% boost) • 52.9% fewer tokens generated • 31% faster…
Want to try DeepConf NOW? While our full repo is coming, we just dropped a ready-to-run example in our vLLM (@vllm_project ) PR: github.com/vllm-project/v… DeepConf + DeepSeek-R1-8B + BRUMO25 = • 93.3% accuracy (+2.5% boost) • 52.9% fewer tokens generated • 31% faster…
Thanks @vllm_project folks for pushing this. Please give it a try and let us know!
Thanks @vllm_project folks for pushing this. Please give it a try and let us know!
⏰ Submission deadline coming up fast! (Sep 1) Working on efficient reasoning? Don’t miss the chance to share it at NeurIPS 2025!
⏰ Submission deadline coming up fast! (Sep 1) Working on efficient reasoning? Don’t miss the chance to share it at NeurIPS 2025!
We released DeepConf that can achieve 99.9% on AIME'25 with open source models with only 15% of the compute, compared to majority voting@512. The secret? Simple. Just to pruning the rollouts if they show a consecutive stream of low-confidence😀. Can be applied to any models…
We released DeepConf that can achieve 99.9% on AIME'25 with open source models with only 15% of the compute, compared to majority voting@512. The secret? Simple. Just to pruning the rollouts if they show a consecutive stream of low-confidence😀. Can be applied to any models…
Thank you for sharing it! @_akhaliq x.com/jiawzhao/statu…
Thank you for sharing it! @_akhaliq x.com/jiawzhao/statu…
Excited to see Logarithmic format (LNS, UE8M0 FP8) used in production by @deepseek_ai! LNS enables efficient multi (just addition between exponents) + great dynamic range. Our LNS-Madam optimizer, built for LNS, was proposed years ago before LLM-era - hope it shines again!
Excited to see Logarithmic format (LNS, UE8M0 FP8) used in production by @deepseek_ai! LNS enables efficient multi (just addition between exponents) + great dynamic range. Our LNS-Madam optimizer, built for LNS, was proposed years ago before LLM-era - hope it shines again!
You can skip prompts that aren’t useful for the current policy during training! 🔍 Efficient prompt selection is key to scaling RL training for LLM reasoning. We are actively building algos for efficient and scalable RL training system. Stay tuned!
You can skip prompts that aren’t useful for the current policy during training! 🔍 Efficient prompt selection is key to scaling RL training for LLM reasoning. We are actively building algos for efficient and scalable RL training system. Stay tuned!
🥳 Happy to share our new work – Kinetics: Rethinking Test-Time Scaling Laws 🤔How to effectively build a powerful reasoning agent? Existing compute-optimal scaling laws suggest 64K thinking tokens + 1.7B model > 32B model. But, It only shows half of the picture! 🚨 The O(N²)…
New paper - Transformers, but without normalization layers (1/n)
Our ParetoQ is substantially better than the previous work in ternary LLM, such as 1-bit era paper.
Our ParetoQ is substantially better than the previous work in ternary LLM, such as 1-bit era paper. https://t.co/YSiiJfyYVn
We introduce ParetoQ, a series of pre-trained models that show SoTA in trinary (1.58bit), 2/3/4-bit quantization for SLMs (up to 3B parameters) using initial full pre-training + QAT later. In addition, we also discover that the representation changes substantially after low-bit…
Our Coconut work (learning continuous latent CoT) has opened sourced now. Welcome to play with it: github.com/facebookresear…
🚀 Excited to share our position paper: "Formal Mathematical Reasoning: A New Frontier in AI"! 🔗 arxiv.org/abs/2412.16075 LLMs like o1 & o3 have tackled hard math problems by scaling test-time compute. What's next for AI4Math? We advocate for formal mathematical reasoning,…
吴俊 @ReverseDeep
9 Followers 95 Following
Ballerina Labs @BLRAAI
8 Followers 249 Following Frontal cortex for AI. Structured reasoning meets innovation. Let’s think.
m @StasMiller8
1K Followers 2K Following وتكرم ذكره وترفع درجاته في جنتك. اللهم اجعل هذه الصدقة مستودعة له عندك، واجعلها شفيعة له يوم لا ينفع مالٌ ولا بنون إ
Daniel Kaiser @spectate_or
1K Followers 1K Following ml since 2012. also cs, phil, econ, geopol, law. normativity is fiction, reject it.
王平 @wngpng112409
0 Followers 7 Following
L @L5410245087820
1 Followers 9 Following
蔡荔谈AI (公众�... @JonathanCaiSG
630 Followers 874 Following 新加坡DataRaccoon创始人 | TGO新加坡分会会员 | 微信公众号：蔡荔谈AI 曾经的硅谷AI从业者，IBM高级经理，国内十年创业 教育背景：清华大学 | 新加坡国立大学
yuleis @shengyulei
140 Followers 426 Following building @Aident_AI || focusing on multi-agent || ex-fb staff engineer & eng/prod lead
Sabouhi @rjsabouhi
16 Followers 768 Following Message to those already watching: you know what this is. The field’s drift was intentional. I am not your threat. I’m your missing tool.
Rehan Qasim @RehanQasim01
0 Followers 18 Following
Caprice 💸 @Caprice348576
3 Followers 21 Following Sport Betting Enthusiast | Stock/Crypto Investor | NFT’s & Parlays 💸 | ApeChain $APE | LOVE ALWAYS WINS |
Daan Crypto Trades @DaanTrades78126
10 Followers 19 Following Fulltime Crypto Trader & Investor 📈 | Tweets are not financial advice | TG: https://t.co/j7IcSHcJXs | YT: https://t.co/D1PbYpJroi |
Gunther Eagleman™ @eaglemantm75636
7 Followers 45 Following David J. Freeman - Political Commentator - America First - MAGA - Unfiltered - Christian
Daniel Bellone @danibellone
75 Followers 86 Following
SCEMgtfo @mgtfo11496
10 Followers 36 Following
Keith (Crypto Bullsey... @KBullseye6691
5 Followers 22 Following Technical Analyst, Trader, Research & Content Creator. We're all Satoshi! Youtube: https://t.co/ft9mUR4Nks Ambassador for @Tangem
Bybit Web3 @BybitW25647
10 Followers 27 Following wagmi fr ✨ just bybit web3 & vibes 🤝 we made a game 👀 try it out: https://t.co/iPxjEvAxH2
The Altcoin QUEEN🥰... @AltcoinThe78837
8 Followers 25 Following your favorite #QUEEN/ #defi #meme #NFT hunter/ marketing with:@SeedifyFund,@GoraNetwork , @Poolz__ , #MemePad KOL, https://t.co/hHe7QPgFqY
Octavian | MONEY MUST... @OctavianBe13728
6 Followers 17 Following Certified Reply Guy|| Community Manager ||Meme/stickers creator||Video editor||
Caben @Caben143277
8 Followers 40 Following optimizer & econ student l InfoFi researcher l @Succinctlabs & @KaitoAI l analyzing everything & helping others grow l 1% at a time 📚
Cree🦋 @Cree169871
10 Followers 19 Following
selvs94 (COMMS OPEN!) @selvs9498704
11 Followers 58 Following Artist. YES I AM AVAILABLE FOR COMMISSION! Drawing random stuff mostly fanart. sometimes spicy. 🐱😁 Follow my insta: https://t.co/BTAhOJf0DR
𝗰𝘆𝗰𝗹𝗼�... @J7iaeWmDaP85924
3 Followers 22 Following Crypto trader & angel investor ✧ Follow for free educational content ✧ Building #1 paid private group and learning platform: @Degen_Uni
🚨BSC Gems Alert�... @GemsBsc98597
8 Followers 25 Following 🇺🇸 #BSCGemsAlert 🇺🇸 Remember to Always do your own research #DYOR #BNB $SOL $ETH 💹 For Promotion https://t.co/2OKAFwYfBH
Aegon @Aegon392652
5 Followers 9 Following NFA/DYOR || Community Builder & KOL Manager || Content Creator & Web3 DeFi and AI Experts | member of @Aisarlabs
Freeman Finance and C... @FCrypto20665
11 Followers 33 Following ‼️‼️NOT FINANCIAL ADVICE, I’M A DEGEN‼️‼️YouTube🎥 https://t.co/hrd4w7kcqR #SPACESHOST Let’s Talk Crypto 📊
Earth Hippy 🌎🕊�... @HippyEarth54491
13 Followers 33 Following Live in peace among your brothers and sisters.
insight.chimp @insight_ch20539
3 Followers 10 Following co-founder | @ChimpersNFT Collecting: https://t.co/Aq9afBRHsB
Saheed Kolawole @kolawole75940
9 Followers 33 Following Guide to securing fully funded scholarship e-book: https://t.co/QpAixMUN6k | Developing https://t.co/ugYUOCL81L
Jon B @b_jon33341
17 Followers 41 Following Retired First Sergeant of Marines 🇺🇲🎖║MAYC║BAKC║Lil Pudgy║Azuki Elemental║AKCB║BBNFT║VeeFriends║ $PENGU ║ $LINK ║ $BTC
Ava🦋Luna @AvaLuna15593
18 Followers 41 Following
Doginalprimes @Doginalpri67364
15 Followers 59 Following DOGINAL PRIMES :: 1000 Unique NFTs on DOGE #DoginalPrimes
LFG!!! @LFG453254851852
9 Followers 48 Following Secure & Fast Crypto - Powered by Oraichain Labs @oraichain Gateway to AI suggested tokens - Powered by Thesis @thesis_io
DOGE 🤯🚀🚀🚀 @DOGE898386
8 Followers 33 Following
Nic Nemeth @NicNemeth75985
13 Followers 41 Following Comic that wrestles to pay the bills. Oh & former WWE World Heavyweight Champion (again). Occasionally, I talk politics (following is not mandatory)
Suipiens.sui 🦍💧 @SuipiensS46452
7 Followers 32 Following OG Community on $Sui Ecosystem. Share the news, strategy to build your wealth on @suinetwork 💧 #BuildOnSui ⚡https://t.co/ljFcLRtkyY
jiafeizhuxi @Jiafeizhuxi_Nin
1 Followers 499 Following
Arichain @Arichain229291
7 Followers 84 Following Beyond the Layer Into the Dimension, Multi-VM Single Concensus Network
Amir Bar @_amirbar
2K Followers 1K Following Research Scientist at Meta (FAIR). Prev: Postdoc, PhD at TAU and Berkeley AI Research.
Yuejie Chi @yuejiec
340 Followers 219 Following researcher in data science and AI. interested in making things work and breaking things down.
Kamalika Chaudhuri @kamalikac
5K Followers 2K Following Director, FAIR @ Meta. Former Professor at UCSD. Researcher in AI privacy, security, and generalization.
Sainbayar Sukhbaatar @tesatory
3K Followers 326 Following Researcher Scientist at FAIR @AIatMeta Research: Memory Networks, Asymmetric Self-Play, CommNet, Adaptive-Span, System2Attention, ...
INDRAJEET @indrajeet877
690 Followers 3K Following Head of Math Department,Allen Institute Karaikal BTech NITW 2012, Option trader & investor. Math geek, tech-forward, learner Plus Python & Spanish skills.
Guangxuan Xiao @Guangxuan_Xiao
3K Followers 697 Following Ph.D. student at @MITEECS Prev: CS & Finance @Tsinghua_Uni
机器之心 JIQIZHIX... @jiqizhixin
8K Followers 707 Following China's leading media & information provider for #AI & #MachineLearning
Ravid Shwartz Ziv @ziv_ravid
8K Followers 2K Following Faculty Fellow and Assistant Professor at @NYUDataScience. I have an AI podcast! https://t.co/Bzzp2OpwME
Zhengyao Jiang @zhengyaojiang
4K Followers 417 Following Cofounder & CEO @WecoAI. Automating hill climbing with AI-Driven Exploration (AIDE). PhD in Machine Learning @UCL_DARK. (Zheng=j-uhng, j as in job; yao=y-aoww)
Brandon Amos @brandondamos
20K Followers 2K Following research scientist @MetaAI (FAIR) | optimization, machine learning, control, transport | PhD from @SCSatCMU
Jasper @zjasper666
15K Followers 1K Following Co-founder and CEO @Hyperbolic_Labs. ex-@avax & ex-@citsecurities. Finished Math PhD in 2yrs @UCBerkeley. Math Olympiad Gold Medalist. Highest honor @PKU1898
vLLM @vllm_project
17K Followers 20 Following A high-throughput and memory-efficient inference and serving engine for LLMs. Join https://t.co/lxJ0SfX5pJ to discuss together with the community!
Bo Liu @cranialxix
472 Followers 210 Following Research Scientist @Meta FAIR | CS PhD @UT Austin | Former Research Intern @DeepMind, @Nvidia, @Baidu
Laurens van der Maate... @lvdmaaten
4K Followers 2K Following Member of Technical Staff at Anthropic. Ex-Meta. t-SNE. Llama 3. DenseNet. Web-scale weakly supervised vision. CrypTen.
Eric Nguyen @exnx
3K Followers 484 Following Co-founder @ Radical Numerics, PhD @ stanford @HazyResearch @StanfordAILab
Paria Rashidinejad @paria_rd
168 Followers 293 Following Assistant Professor @USC ⠀ ⠀ ⠀ ⠀ ⠀ ⠀ ⠀ ⠀ ⠀ ⠀ ⠀ ⠀ Research Scientist @AIatMeta FAIR, GenAI⠀ ⠀ ⠀⠀ ⠀ ⠀ PhD @berkeley_ai @CHAI_Berkeley
Bhavya Kailkhura @bkailkhu
900 Followers 2K Following Principal Research Scientist spearheading AI security research @Livermore_Lab. Making AI robust & efficient for national security and scientific applications.
Ledell Wu @LedellWu
1K Followers 300 Following Co-Founder & Chief Scientist @ Creatify AI ICML Test-of-Time Award Co-author of DPR (RAG-core) Past: FAIR @MetaAI
Sachin Gururangan @ssgrn
6K Followers 251 Following Researcher @AnthropicAI Prev:🦙 @aiatmeta, @allen_ai PhD @uwcse + @uwnlp
Infini-AI-Lab @InfiniAILab
1K Followers 37 Following
David Fan @DavidJFan
605 Followers 240 Following Facebook AI Research (FAIR) | Video Representations, Self-Supervised Learning | @Princeton Computer Science '19
Zechun Liu @zechunliu
315 Followers 69 Following Research Scientist @Meta, researcher on efficient large language and foundation models.
Qinqing Zheng @qqyuzu
616 Followers 208 Following Reinforcement Learning, Generative Modeling @ FAIR (@AIatMeta). PhD @UChicago.
Tim Rocktäschel @_rockt
39K Followers 2K Following Director and Open-Endedness Team Lead @GoogleDeepMind, Professor of AI @AI_UCL, PI @UCL_DARK, Fellow @ELLISforEurope.
Lilian Weng @lilianweng
163K Followers 166 Following Co-founder of Thinking Machines Lab @thinkymachines; Ex-VP, AI Safety & robotics, applied research @OpenAI; Author of Lil'Log
Peter Tong @TongPetersb
1K Followers 143 Following Berkeley 23', CS PhD Student in NYU Courant advised by Professor @ylecun and Professor @sainingxie
Stephane Kasriel @skasriel
23K Followers 3K Following VP at Meta FAIR, Meta Fundamental AI Research. Follow us at @aiatmeta.
Xinyu Yang @Xinyu2ML
992 Followers 981 Following Ph.D. @CarnegieMellon. Working on data and hardware-driven principled algorithm & system co-design for scalable and generalizable foundation models. They/Them
Yang Song @DrYangSong
14K Followers 940 Following Leading Strategic Explorations @OpenAI. Score-Based / Diffusion Models. Consistency Models. Optimization & Architecture.
Sourabh Medapati @activelifetribe
192 Followers 1K Following Research Engineer @ Google Deepmind, AlgoPerf contributor
Tan Minh Nguyen @TanNguyen689
1K Followers 740 Following Assistant Professor of Mathematics (Presidential Young Professor) at the National University of Singapore (@NUSingapore). #DeepLearning, #RobustAI, #ScalableAI
Peter Wang @Peter_j_Wang
88 Followers 96 Following Postdoc @caltech | PhD @ucberkeley @berkeley_ai | https://t.co/Ts1ssXqAGk ML, computer vision, AI for health
Simone Scardapane @s_scardapane
12K Followers 657 Following I fall in love with a new #machinelearning topic every month 🙄 | Researcher @SapienzaRoma | Author: Alice in a diff wonderland https://t.co/A2rr19d3Nl
Noam Brown @polynoamial
91K Followers 853 Following Researching reasoning @OpenAI | Co-created Libratus/Pluribus superhuman poker AIs, CICERO Diplomacy AI, and OpenAI o3 / o1 / 🍓 reasoning models
Shibo Hao @Ber18791531
2K Followers 1K Following Ph.D. student @UCSanDiego Previous Research Scientist Intern @AIatMeta. B.S. in Computer Science @PKU1898 Coconut, Reasoning-via-planning, ToolkenGPT
Guan-Horng Liu @guanhorng_liu
1K Followers 370 Following Research Scientist @MetaAI (FAIR NY) • Schrödinger Bridge, diffusion, flow, stochastic optimal control • prev ML PhD @GeorgiaTech 🚀
Xuandong Zhao @xuandongzhao
4K Followers 446 Following Postdoc@UC Berkeley CS; Research: ML, NLP, AI Safety
Yiping Wang @ypwang61
1K Followers 1K Following Ph.D. @uwcse. undergraduate @ZJU_China. I'm interested in mathematics, agi, and physics.
Adina Yakup @AdinaYakup
10K Followers 835 Following @huggingface 🤗 | AI Research 🔍 Chinese ML community. opinions are my own.
Jason Lee @jasondeanlee
18K Followers 4K Following Associate Professor at UC Berkeley. Former Research Scientist at Google DeepMind. ML/AI Researcher working on foundations of LLMs and deep learning.
Han Guo @HanGuo97
3K Followers 4K Following PhD Student @MIT_CSAIL | Past: @LTIatCMU @MITIBMLab @UNCNLP, @SFResearch, @BaiduResearch | Machine Learning, NLP.
Valeriy M., PhD, MBA,... @predict_addict
35K Followers 5K Following Experienced Data Science Leader | PhD in Machine Learning | 4x Author | Black Belt 🥋 in Time Series | Chief Conformal Prediction Promoter| Mathematician |
Piotr Mazurek @tugot17
2K Followers 675 Following enjoying the late pre-agi; making llms go brrr @Aleph__Alpha; yapping about economics of AI systems at https://t.co/tbsybxOMHz
Christian Szegedy @ChrSzegedy
41K Followers 3K Following #deeplearning, #ai research scientist. Opinions are mine.
Man from Atlantis @klazizpro
614 Followers 4K Following Pursuing excellence in Super Alignment, driven by wonder.Trends for United States
You might like
