Zihao Ye @ye_combinator
Proud to be an engineer. I'm building flashinfer (https://t.co/PabCM3ksjN) at @NVIDIA Opinions are my own. homes.cs.washington.edu/~zhye/ Seattle Joined October 2017-
Tweets143
-
Followers2K
-
Following537
-
Likes2K
@JingyuanLiu123 This is the advantage of large nvlink domains or TPUs topology - the main reason to do PP is that you are bottlenecked on your DP comms and cannot scale TP further. But if you have high enough bandwidth across a large enough domain (like TPUs or NVL72), you don't need to do PP…
🚀 Presenting LiteASR: a method that halves the compute cost of speech encoders by 2x, leveraging low-rank approximation of activations. LiteASR is accepted to #EMNLP2025 (main) @emnlpmeeting
Sub-10-microsecond Haskell Sudoku solver implemented in hardware. unsafeperform.io/papers/2025-hs…
Tilelang now supports SM120 — give it a try if you have RTX 5090 🚀😎
🎉 Excited to share: We’ve open-sourced Triton-distributed MegaKernel! A fresh, powerful take on MegaKernel for LLMs—built entirely on our Triton-distributed framework. github.com/ByteDance-Seed… Why it’s awesome? 🧩 Super programmable ⚡ Blazing performance 📊 Rock-solid precision
One nice thing you can do with an interactive world model, look down and see your footwear ... and if the model understands what puddles are. Genie 3 creation.
🚀 Excited to announce day-0 support from @NVIDIAAIDev for @OpenAI's gpt-oss model in flashinfer v0.2.10! github.com/flashinfer-ai/… ✅ Speed-of-light Blackwell mxfp4/mxfp8 MoE kernels + attention-sink from trtllm-gen ✅ FA2/FA3 template-based attention-sink support for earlier…
🚀 Excited to announce day-0 support from @NVIDIAAIDev for @OpenAI's gpt-oss model in flashinfer v0.2.10! github.com/flashinfer-ai/… ✅ Speed-of-light Blackwell mxfp4/mxfp8 MoE kernels + attention-sink from trtllm-gen ✅ FA2/FA3 template-based attention-sink support for earlier…
Like SGLang? Want speed of light decode perf? Checkout: github.com/sgl-project/sg…
Powered by TensorRT-LLM Gen kernels. Available via flashinfer and TRT-LLM. 🚀
Powered by TensorRT-LLM Gen kernels. Available via flashinfer and TRT-LLM. 🚀
Great to see StepFun acknowledges the idea of Attention-FFN disaggregation from our Megascale-infer work and take to the next level 🚀🚀🚀 arxiv.org/abs/2504.02263
Great to see StepFun acknowledges the idea of Attention-FFN disaggregation from our Megascale-infer work and take to the next level 🚀🚀🚀 arxiv.org/abs/2504.02263
I’ve been starting to collaborate with the folks who are building FlashInfer: nice project and pretty amazing set of people! @ye_combinator @tqchenml and everyone.
I’ve been starting to collaborate with the folks who are building FlashInfer: nice project and pretty amazing set of people! @ye_combinator @tqchenml and everyone.
SGLang is an early user of FlashInfer and witnessed its rise as the de facto LLM inference kernel library. It won best paper at MLSys 2025, and Zihao now leads its development @NVIDIAAIDev. SGLang’s GB200 NVL72 optimizations were made possible with strong support from the…
SGLang is an early user of FlashInfer and witnessed its rise as the de facto LLM inference kernel library. It won best paper at MLSys 2025, and Zihao now leads its development @NVIDIAAIDev. SGLang’s GB200 NVL72 optimizations were made possible with strong support from the…
🔍 Our Deep Dive Blog Covering our Winning MLSys Paper on FlashInfer Is now live ➡️ nvda.ws/3ZA1Hca Accelerate LLM inference with FlashInfer—NVIDIA’s high-performance, JIT-compiled library built for ultra-efficient transformer inference on GPUs. Go under the hood with…
🔥 We introduce Multiverse, a new generative modeling framework for adaptive and lossless parallel generation. 🚀 Multiverse is the first open-source non-AR model to achieve AIME24 and AIME25 scores of 54% and 46% 🌐 Website: multiverse4fm.github.io 🧵 1/n
Been excited about this talk for a while, @SonglinYang4 on efficient architecture! Just started! youtube.com/watch?v=j4zJbr…
Another 🔥 blog about CUTLASS from @colfaxintl, this time focusing on the gory details of block-scaled MXFP and NVFP data types and Blackwell kernels for them. research.colfax-intl.com/cutlass-tutori…
We know Attention and its linear-time variants, such as linear attention and State Space Models. But what lies in between? Introducing Log-Linear Attention with: - Log-linear time training - Log-time inference (in both time and memory) - Hardware-efficient Triton kernels
🚀 Fast-dLLM: 27.6× Faster Diffusion LLMs with KV Cache & Parallel Decoding 💥 Key Features🌟 - Block-Wise KV Cache Reuses 90%+ attention activations via bidirectional caching (prefix/suffix), enabling 8.1×–27.6× throughput gains with <2% accuracy loss 🔄 -…
🎉CUTLASS 4.0 is here-bringing native #Python support for device-side kernel design, for ops like GEMM, Flash Attention, and more, powered by the new CuTe DSL. For the first time, you can write high-performance GPU kernels in Python with the same abstractions, APIs, and…
🚨🔥 CUTLASS 4.0 is released 🔥🚨 pip install nvidia-cutlass-dsl 4.0 marks a major shift for CUTLASS: towards native GPU programming in Python slidehelloworld.png docs.nvidia.com/cutlass/media/…
Tianqi Chen @tqchenml
18K Followers 1K Following AssistProf @CarnegieMellon. Distinguished Eng @NVIDIA. Creator of @XGBoostProject, @ApacheTVM. Member https://t.co/QYyfjQNp4p, @TheASF. Views are on my own
Kiv @kivdaychen
3K Followers 1K Following cmu mcse '25 | broke things @M5tTrading @RisingWaveLabs @Hyperledger, @BytedanceTalk and 3 others.
Horace He @cHHillee
39K Followers 535 Following @thinkymachines Formerly @PyTorch "My learning style is Horace twitter threads" - @typedfemale
¬¬Mike (Deyuan) He @1SHL10
1K Followers 573 Following 3rd-year PhD @PrincetonCS PL Group; PL/Systems; Prev @AWSCloud @Intel @Taichi_Lang @uwplse
Dr. Jian "Daye" Weng @b1antaidaye
5K Followers 690 Following Father of 2 | PhD @UCLAComSci | AssistProf @cemseKAUST | Compilers | Computer Arch | Sw/hw Co-designs | IMDB: PTSD | 抽象是工作抽象也是生活 | 川粉
Ce Gao @gaocegege
7K Followers 786 Following Co-founder and CEO @TensorChord, building postgres-based vector extension https://t.co/7WGvl1sR56 | Father of 1 cat | Married
Beidi Chen @BeidiChen
15K Followers 399 Following Asst. Prof @CarnegieMellon, @amazon Scholar, Prev: Visiting Researcher @Meta, Postdoc @Stanford, Ph.D. @RiceUniversity, Large-Scale ML, a fan of Dota2.
Talia Ringer 💚 @TaliaRinger
29K Followers 7K Following Professor, @plfmse, @IllinoisCS! Proof Automation. @SigplanM & CCF Founder. Israeli-American for peace, equality, justice. Mom. They/היא, ND, bi
Ligeng Zhu @LigengZhu
2K Followers 2K Following Research Scientist at @Nvidia building VLMs , previously @MIT, @SFU and @ZJU_China.
Xuanwo @OnlyXuanwo
11K Followers 929 Following ASF Member. @ApacheOpenDAL PMC Chair. VISION: Data Freedom. Working on #RBIR with @LanceDB
鹿 𝕟𝕠𝕜𝕚�... @IIInoki
10K Followers 2K Following Nobody “文科”🐶博士 人间不值得 生活推 風立ちぬ、いざ生きめやも 背景图 by @IIInoki
Yuliang Xiu @yuliangxiu
7K Followers 5K Following Assistant Professor @Westlake_Uni, Ph.D. @MPI_IS, previously @USC_ICT. Focusing on democratizing human digitization. Intern @RealityLabs @Ubisoft
Luis Ceze @luisceze
4K Followers 2K Following computer architect. marveled by biology. professor @uwcse. ceo @OctoAICloud. venture partner @madronaventures.
Ji Lin @jilin_14
6K Followers 944 Following Research @Meta Superintelligence Lab | Prev: Research @OpenAI; PhD @MIT
Abi Aryan @GoAbiAryan
7K Followers 3K Following 🛠️ Founder @AbideAI 👐 ML Engineer 👩💻☕ 📚 Book Author: LLMOps (2025), ✍️ GPU Engg for AI Systems (2026) 💬🐦 Talk to me about LLMs, MLSys & GPU Training
ElviraReed @T3APhYJbT0RWa9
1 Followers 270 Following Focused on investing in U.S. stocks, happy to discuss stock market trends.
Umair Siddiquie @umairsiddiquie_
410 Followers 5K Following
!.! @xypyth
46 Followers 4K Following
͔̤͎̝̣͈̩̤͈̭�... @paren_ai
0 Followers 3K Following
Paujau @Paujau513
1 Followers 191 Following Focused on investing in U.S. stocks, happy to discuss stock market trends.
wuc9521 @wuc9521
84 Followers 1K Following
Victor Hugo @VictorHugo45995
0 Followers 7K Following
Fanglin Lu @FanglinLu
229 Followers 647 Following Senior Software Engineer @ Google Cloud Vertex AI Gemini Multimodal API
Chuang Ruan @ruanchuang
299 Followers 2K Following
Supreet Sahu @supreet_sahu
17 Followers 533 Following IIT Kharagpur @IITKgp '26 | 4th Year Undergrad @ ECE( Dual degree spl- Vision & Intelligent Systems) | AI/ML/DL/Computer Vision | Also on X : @SupreetSahu
Ankur Gupta @getpy
36K Followers 959 Following Tweets on Python, Technology, Software Development, Programming.
alex kovalov @alexkovalove
185 Followers 927 Following no chief just the guy who cooks with love. random tweets about ranking on amazon, a bit of dtc and ai
Sourik @Sourik24
256 Followers 2K Following Making GPUs and CPUs go Brrrrr @ https://t.co/CXXbtt3IPU , GPU tinkerer, Compiler Fanatic, Code Slinger, Harry Potter and Star Trek Nerd, Full-Time LEGO Connoisseur
Jiarong Xing @Jiarong_Xing
116 Followers 133 Following Postdoc at UC Berkeley; Assistant Professor at Rice University
Natalie @zi5WshY2w5g1s
18 Followers 783 Following Be the kind of woman that makes other women want to up their game.
Victoria @yanlinqi_1999
1 Followers 104 Following
Mitchell Franklin @Mitch_UMATR
944 Followers 3K Following Founder of @UMATR_io and Creator of @RustMatters & @ScalaMatters 🦀 Sourcing the best talent across the globe within #Rust, #Scala, and #Python.
Sulaiman. @Sulaiman_n7
102 Followers 422 Following CS graduate. A consultant for some reason. Tech enthusiast. Failed crypto investor. I enjoy gaming, music, tv shows & anime. that’s pretty much me in a nutshell
Peiqi Yin @Peiqi_Yin
11 Followers 96 Following PhD candidate @CUHK. Focus on MLSys / Storage system.
Frank Koukou @FrankLi56665782
0 Followers 58 Following
jhno glenn @JhnoG64176
13 Followers 50 Following
Tergel Molom-Ochir @tergelmo
0 Followers 30 Following
Allen @AllenTemplate
7 Followers 175 Following
Sky Lee @SkyLee010101010
3 Followers 98 Following
Lifan Wu @winmad4869
144 Followers 604 Following
jj @jj99610969
79 Followers 2K Following
sa13012025 @sa13012025
454 Followers 4K Following
Aria @AriaCMO
2 Followers 65 Following
Lucien Ferreira @lucienfs2000
1K Followers 3K Following Rockeiro por natureza, casado, tenho dois filhos. Gosto de informática, animes, filmes, músicas e games. Amo meu Brasil. Portanto sou PATRIOTA de coração e alma
Reevesmusk @reevesmusk68621
202 Followers 4K Following
Everly Brown @EverlyBrow13888
8 Followers 175 Following
Thomas Joshi @thomastjoshi
1K Followers 6K Following Coauthor of DSPy @stanford (most popular Stanford AI library) - AI and EE degree @columbia
Willow Williams @williams_w88063
21 Followers 123 Following
Guangxuan Xiao @Guangxuan_Xiao
3K Followers 697 Following Ph.D. student at @MITEECS Prev: CS & Finance @Tsinghua_Uni
Infinity Professional... @services843691
2 Followers 25 Following
Eigen AI @Eigen_AI_Labs
706 Followers 21 Following Built by researchers and engineers from MIT, we are pursuing Artificial Efficient Intelligence (AEI). Try GPT-OSS support: https://t.co/BQfsnXIGFo.
Tuo Liu @Robo_Tuo
564 Followers 1K Following Founder @ https://t.co/f6U1J8rYdC | Building an Open AI Robotics Community | @UIowa @WashU Alum | DMs Open or [email protected]
gokul @gokulp01
473 Followers 3K Following Current: research science intern @Adobe Research | PhD candidate in a cornfield @UofIllinois (UIUC) @CSL_Illinois | Robotics | C++ | Chess
Tianqi Chen @tqchenml
18K Followers 1K Following AssistProf @CarnegieMellon. Distinguished Eng @NVIDIA. Creator of @XGBoostProject, @ApacheTVM. Member https://t.co/QYyfjQNp4p, @TheASF. Views are on my own
Kiv @kivdaychen
3K Followers 1K Following cmu mcse '25 | broke things @M5tTrading @RisingWaveLabs @Hyperledger, @BytedanceTalk and 3 others.
Horace He @cHHillee
39K Followers 535 Following @thinkymachines Formerly @PyTorch "My learning style is Horace twitter threads" - @typedfemale
¬¬Mike (Deyuan) He @1SHL10
1K Followers 573 Following 3rd-year PhD @PrincetonCS PL Group; PL/Systems; Prev @AWSCloud @Intel @Taichi_Lang @uwplse
Dr. Jian "Daye" Weng @b1antaidaye
5K Followers 690 Following Father of 2 | PhD @UCLAComSci | AssistProf @cemseKAUST | Compilers | Computer Arch | Sw/hw Co-designs | IMDB: PTSD | 抽象是工作抽象也是生活 | 川粉
Beidi Chen @BeidiChen
15K Followers 399 Following Asst. Prof @CarnegieMellon, @amazon Scholar, Prev: Visiting Researcher @Meta, Postdoc @Stanford, Ph.D. @RiceUniversity, Large-Scale ML, a fan of Dota2.
Talia Ringer 💚 @TaliaRinger
29K Followers 7K Following Professor, @plfmse, @IllinoisCS! Proof Automation. @SigplanM & CCF Founder. Israeli-American for peace, equality, justice. Mom. They/היא, ND, bi
Shriram Krishnamurthi... @ShriramKMurthi
21K Followers 4K Following @BrownCSDept/@BrownUniversity • @BootstrapWorld • @PyretLang • @racketlang • Unreasonably excited about compsci, education, cycling, cricket, human experience.
Ligeng Zhu @LigengZhu
2K Followers 2K Following Research Scientist at @Nvidia building VLMs , previously @MIT, @SFU and @ZJU_China.
Xuanwo @OnlyXuanwo
11K Followers 929 Following ASF Member. @ApacheOpenDAL PMC Chair. VISION: Data Freedom. Working on #RBIR with @LanceDB
Yuliang Xiu @yuliangxiu
7K Followers 5K Following Assistant Professor @Westlake_Uni, Ph.D. @MPI_IS, previously @USC_ICT. Focusing on democratizing human digitization. Intern @RealityLabs @Ubisoft
Luis Ceze @luisceze
4K Followers 2K Following computer architect. marveled by biology. professor @uwcse. ceo @OctoAICloud. venture partner @madronaventures.
Ji Lin @jilin_14
6K Followers 944 Following Research @Meta Superintelligence Lab | Prev: Research @OpenAI; PhD @MIT
Vinod Grover @vinodg
3K Followers 1K Following Sr Distinguished Engineer @nvidia. Compilers, CUDA C++, PL, Machine Learning and Systems. tweets and opinions are personal.
Hawkingrei @suohawking
3K Followers 3K Following mono repo 爱好者｜抖机灵 | Database Developer | SW-1518-1200-8238 | ADHD https://t.co/x1xMF1BYtc
Masahiro Hiramori @mshrh3
63 Followers 109 Following Apache TVM committer. ML compiler engineer. Creator and maintainer of Verilog-HDL/SystemVerilog for VS @code extension. Opinions are my own.
JingyuanLiu @JingyuanLiu123
1K Followers 396 Following https://t.co/D7zLeTZRMh is all you need | Opinions are my own
Jiarong Xing @Jiarong_Xing
116 Followers 133 Following Postdoc at UC Berkeley; Assistant Professor at Rice University
Minjia Zhang @_Minjia_Zhang_
147 Followers 72 Following Assistant Professor@UIUC, Machine Learning System, Ex-Principal Researcher@Microsoft, @MSFTResearch, @MSFTDeepSpeed
Roger Wang @rogerw0108
445 Followers 182 Following Flowers and friendship | ML Platform & Infra @Roblox | Committer @vllm_project | @uwaterloo @uwcse
EndeavourOS @OsEndeavour
15K Followers 314 Following A terminal-centric distro with a vibrant and friendly community at its core.
Eigen AI @Eigen_AI_Labs
706 Followers 21 Following Built by researchers and engineers from MIT, we are pursuing Artificial Efficient Intelligence (AEI). Try GPT-OSS support: https://t.co/BQfsnXIGFo.
Dylan Patel @dylan522p
94K Followers 941 Following SemiAnalysis Boutique AI & Semiconductor Research and Consulting DMs are open for consulting, quotes, or to talk shop
Jianan Ji @ji_jianan71963
2 Followers 16 Following
NVIDIA AI Developer @NVIDIAAIDev
81K Followers 321 Following All things AI for developers from @NVIDIA. Additional developer channels: @NVIDIADeveloper, @NVIDIAHPCDev, and @NVIDIAGameDev.
Mark Collier 柯理�... @sparkycollier
14K Followers 15K Following Austin Powered. Co-founder of OpenStack & OpenInfra Foundation. General Manager of AI & Infrastructure for the Linux Foundation. open source for fun & profit.
Mathew Jacob @mat_jacob1002
134 Followers 65 Following Incoming PhD @uwcse. prev @DbrxMosaicAI, @siebelschool
Yi Pan @conlesspan
67 Followers 260 Following Undergrad @ SJTU ACM Class | RA @uwcse | Distributed & ML Systems
Wei-Lin Chiang @infwinston
5K Followers 938 Following Building @lmarena_ai @UCBerkeley PhD in AI & systems
Yurong You @YurongYou
42 Followers 62 Following
Chenggang Zhao @chenggang_zhao
383 Followers 56 Following @deepseek_ai infra; previously at NVIDIA | SenseTime | Tsinghua University.
Joy Dong @JoyChew_d
182 Followers 51 Following PhD candidate @UMich. Previously @PyTorch @NVidia. #ConfidentialComputing #GPU Optimization & Architecture
Yong Wu @yongwwwml
2 Followers 32 Following
Sean Lee @seanprime7
44 Followers 149 Following
Ajay Jain @ajayj_
7K Followers 4K Following Co-founder @genmoai. Co-created denoising diffusion (DDPM), DreamFusion, Dream Fields. Ex Ph.D. @berkeley_ai, @googleai, @facebookai, @nvidiaai, @mit
Perplexity Developers @PPLXDevs
3K Followers 15 Following Updates for developers building with Sonar. Power your products with the fastest, cheapest API offering out there with search grounding.
Sainbayar Sukhbaatar @tesatory
3K Followers 326 Following Researcher Scientist at FAIR @AIatMeta Research: Memory Networks, Asymmetric Self-Play, CommNet, Adaptive-Span, System2Attention, ...
Steeve Morin @steeve
6K Followers 1K Following Building @zml_ai, ex @zenly, ex Exalead, ex @google. Skydiver and wingsuiter.
Min Lin @mavenlin
177 Followers 203 Following
Manish Gupta @BigManniM9
540 Followers 643 Following Software Engineer, Compiler Lover, Fortune Cookie Writer
Vikram @msharmavikram
2K Followers 588 Following @NVIDIA Sr. Research Scientist | UIUC PhD All opinions and tweets are personal. Tweets about AI Inference, CUDA and GPU systems.
Haocheng Xi @HaochengXiUCB
596 Followers 1K Following First-year PhD in @berkeley_ai. Prev: Yao Class, @Tsinghua_Uni | Efficient Machine Learning & ML sys
You Jiacheng @YouJiacheng
8K Followers 2K Following a big fan of TileLang 关注TileLang喵！关注TileLang谢谢喵！ https://t.co/utshC0jrCO 十年老粉
Songlin Yang @SonglinYang4
12K Followers 3K Following PhD-ing @MIT_CSAIL. Working on scalable and principled algorithms in #LLM and #MLSys. In open-sourcing I trust 🐳. she/her/hers
Zirui Liu @ziruirayliu
375 Followers 619 Following Assistant Professor of CS @UMNComputerSci | PhD @RiceUniversity
Daya Guo @Guodaya
6K Followers 15 Following AI researcher @deepseek_ai. Interested in reasoning ability of LLMs. The long-term research goal is to develop artificial general intelligence.
DeepSeek @deepseek_ai
973K Followers 0 Following Unravel the mystery of AGI with curiosity. Answer the essential question with long-termism.
Gennady Pekhimenko @Dr_GGP
100 Followers 63 Following CEO and Co-Founder at CentML: https://t.co/7AuHhhrNJN, Professor at the University of Toronto
Neil Adit @neiladit
661 Followers 152 Following Research at Meta. PhD, Cornell. I like peanut butter and oats.
Nadav Timor @NadavTimor
723 Followers 7K Following LLM inference, speculative decoding, open source. Built novel decoding algorithms – default in Hugging Face Transformers (147k+ ⭐). Making LLMs faster + cheaper
Simon Guo @simonguozirui
3K Followers 5K Following CS PhD student @Stanford | 🎓 @Berkeley_EECS | prev pre-training @cohere & built things at @ @anyscalecompute @nvidia
James Bradbury @jekbradbury
13K Followers 9K Following Compute at @AnthropicAI! Previously JAX, TPUs, and LLMs at Google, MetaMind/@SFResearch, @Stanford Linguistics, @Caixin.
Xingyang Li @XYLi_Bruce
24 Followers 56 Following A third-year undergraduate at SJTU ACM Honors Class. Intern @MITEECS. A Fan of @FCBayernTrends for United States
You might like
