Nadav Timor @NadavTimor
LLM inference, speculative decoding, open source. Built novel decoding algorithms – default in Hugging Face Transformers (147k+ ⭐). Making LLMs faster + cheaper github.com/keyboardAnt nyc Joined December 2017-
Tweets270
-
Followers722
-
Following7K
-
Likes1K
Local inference in your vscode is here
Local inference in your vscode is here
21
63
426
40K
104
Download Image
In inference, speculation parallelism sustains high MFU by hiding DP comms bottlenecks
In inference, speculation parallelism sustains high MFU by hiding DP comms bottlenecks
KV cache go brrr with @JunchenJiang's @lmcache! Join us tomorrow to learn more about next‑gen long‑context LLM inference: faster-llms.vercel.app
Nadav Timor retweeted
Algorithms developed by researchers in Prof. @DavidHarel50’s team and Intel Labs enable AI developers around the world to combine the power of different AI models “thinking” as one. The study led by PhD student @NadavTimor was presented at #ICML2025>> bit.ly/faster-ai-eng
Nadav Timor retweeted
Do you want to speed up your inference time by 2X for free? Using speculative decoding (SP) but want to use your own drafter? Want lossless speedup with one line? Go to @NadavTimor talk at ICML tomorrow at 3:30 PM and check out his poster afterward at 4:30 PM. Thank me later!
🎉 #icml2025 oral (top 1%) – our speculative decoding paper: arxiv.org/abs/2502.05202
Nadav Timor retweeted
Twitter! I can't believe no one told me that people are using vision encoders to retrieve document information these days. Based on a tip from @keyboardAnt I read the "ColPali: Efficient Document Retrieval with Vision Language Models" paper, and it is very cool.
Hiding the verification latency of speculative decoding = faster inference. Come chat with me about how! 📍 Poster #245 (Hall 3) 🕒 Today, 15:00–17:30
🚀 Vercel’s #StateOfAI survey highlights: 83% of teams run ≤3 models, 86% don’t train their own, and 46% say the biggest hurdle is latency or cost (23% latency + 23% cost). Devs are leaning hard on third‑party inference—OpenAI alone powers 83% of workloads
🚀 Vercel’s #StateOfAI survey highlights: 83% of teams run ≤3 models, 86% don’t train their own, and 46% say the biggest hurdle is latency or cost (23% latency + 23% cost). Devs are leaning hard on third‑party inference—OpenAI alone powers 83% of workloads
🚀 Calling all OSS contributors to vLLM, SGLang, HF Transformers, TGI, TRT-LLM & more — Join us at the Inference Engines Social @ ICLR 🇸🇬 📍 Singapore EXPO 🗓️ Apr 25, 13:00 Let’s hang out, swap ideas & share what we’re building! 🔗 lu.ma/42pobekx
starting in <45 min - faster-llms.vercel.app
Deepti @deeptigp
1K Followers 1K Following Asst. Professor in Computer Vision @ BU; Researcher @runwayml; ex-researcher @MetaAI, @UTCompSci , @iiit_hyderabad
Joël Niklaus @joelniklaus
621 Followers 530 Following MLE @huggingface previously: @harvey @Google @Theteamatx @Stanford @unibern
Gloria @inman_gloria6
268 Followers 3K Following
David Hall @dlwh
3K Followers 1K Following Research Engineering Lead at @StanfordCRFM. Previously co-founder at Semantic Machines ⟶ MSFT. Lead developer of Levanter and Marin @[email protected]
Zachary Charles @MatharyCharles
1K Followers 406 Following distributed machine learning @ google | sometimes mathematician
Matt @matt_dz
5K Followers 3K Following C++, Compilers, Computer Architecture, Generic Programming, GPGPU, HPC, Machine Learning, Numerics, Parallel Computing, Quantitative Finance
Raayan Dhar @raayandhar
232 Followers 1K Following @UCLA Trying to get out alive; probabilistic to a fault cur: TensorRT-LLM @NVIDIA
Arash Ahmadian @aahmadian_
2K Followers 695 Following scaling Gemini RL & post-training @GoogleDeepmind prev: @Cohere @CohereForAI
ElegantElle @raveyn1010
18 Followers 427 Following I’m always interested in new opportunities and collaborations
Jeff Rasley @jeffra45
877 Followers 1K Following @Snowflake AI Research Team. @DeepSpeedAI co-founder, @BrownCSDept PhD, @uwcse alum
Kimberly @griggskimberly1
327 Followers 3K Following
Ilene @ilenedalessio64
335 Followers 3K Following
Yunsheng Tian @YunshengTian
888 Followers 698 Following 🤖 Applied Scientist @Amazon FAR (Frontier AI & Robotics) | PhD @MIT_CSAIL
Bram @BramVanroy
1K Followers 827 Following @ku_leuven @ccl_kuleuven: Creative #NLG 🖋️ @ivdnt: Dutch #NLProc and #LLMs Creator of Dutch LLMs 🤖 Fellow at @huggingface 🤗 Prev. @lt3ugent, @SignON
Fbio @Fbio83026755802
1 Followers 3K Following
Lois @thralllois34
314 Followers 3K Following
DIENG Cheikh Ibra @dcheikhibra
56 Followers 2K Following Data & AI @ ENSAE 🤖 | From Dakar to Paris to the world 🌍 | Founder mindset ⚡ | (finance • media • sport • NLP • Crypto ) | Legacy. Growth. Impact.
Claire @P1iD1Egg6jmBg6j
29 Followers 570 Following Need a new content parntnerrr heheeh, link beloww lets see if we are closeeee!
Cuipcoot @Cuipcoot1837
98 Followers 2K Following
Chenyang Lyu 吕晨�... @Chenyang_Lyu
1K Followers 793 Following Staff Researcher @AlibabaGroup. Previously @MBZUAI, PhD from @ml_labs_irl and @dcucomputing @dcu interested in Large Language Models (LLMs).
Rohin Manvi @rohin_manvi
504 Followers 356 Following phd-ing @berkeley_ai w/ @svlevine | research @liquidai_ | prev @stanford @stanfordailab w/ @stefanoermon, swe @meta
Nicolas DUFOUR @nico_dufour
388 Followers 560 Following PhD student at IMAGINE (ENPC) and GeoVic (Ecole Polytechnique). Working on image generation. https://t.co/xA3XJiMuQR
Waeakee @Waeakee79492
27 Followers 2K Following
Seth Kimmel @sethkimmel3
225 Followers 701 Following Founder @sutro_sh - building tools to scale productivity, experimentation, and discovery.
Itai Mondshine @itaimond
20 Followers 89 Following
Gourav Datta @GouravDatta11
67 Followers 199 Following Assistant Prof. @ Case Western || Best PhD Dissertation Awardee @ USC Viterbi || Best Research Assistant & MHI scholar @ USC ECE || Applied Scientist at Amazon
Taneem @taneem_
12 Followers 399 Following @OpenShiftAI Engineering Manager @RedHat. Proud alum of @GeorgiaTech and @UArkansas
Liron Zahavi @ZahaviLiron
103 Followers 346 Following PhD student at the Weizmann Institute of Science
Kevin @Kevin54339227
5 Followers 235 Following
Paria Rashidinejad @paria_rd
168 Followers 293 Following Assistant Professor @USC ⠀ ⠀ ⠀ ⠀ ⠀ ⠀ ⠀ ⠀ ⠀ ⠀ ⠀ ⠀ Research Scientist @AIatMeta FAIR, GenAI⠀ ⠀ ⠀⠀ ⠀ ⠀ PhD @berkeley_ai @CHAI_Berkeley
Hanshi Sun @preminstrel
142 Followers 162 Following Research Scientist in ByteDance Seed | MLSys | Grad @CMU_ECE
Shanel Kulas @KulasShane41943
33 Followers 2K Following
Orlo Funk @FunkOrlo57431
74 Followers 4K Following
Talor Abramovich @AbramovichTalor
88 Followers 83 Following
David Cuartielles @dcuartielles
19K Followers 548 Following Co-founder of Arduino: https://t.co/0n4lBThx3F, Researcher at Malmo University: https://t.co/bMFiMA08pY, king of spreadsheet, master of calendars, lord of
Shahaf Bassan @shahaf_bassan
48 Followers 33 Following PhD student @ HUJI | Researching #ExplainableAI & #Interpretability
Andre Oliveira @andrebaach
364 Followers 596 Following founder/engineer/vibe coding operational excellence
Grace @9sleou
111 Followers 655 Following "Do you realize how many calories are in that?" "Do you realize how much I dont care?"
Jacqueline @KezpiJacqueline
22 Followers 334 Following Inspiring others to take action and make a difference. Creating the change they want to see in the world.
Andrej Karpathy @karpathy
1.4M Followers 1K Following Building @EurekaLabsAI. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets.
Bojan Tunguz @tunguz
252K Followers 8K Following ML ex Nvidia. Creator of @trainxgb. Data Scientist. Physicist. Catholic. Husband. Father. Stanford Alum. Memelord. e/xgb. AMDG.
Emad @EMostaque
288K Followers 23 Following Distributing Intelligence. Building the Intelligent Internet @ii_posts. Founder @StabilityAI.
Jim Fan @DrJimFan
325K Followers 3K Following NVIDIA Director of Robotics & Distinguished Scientist. Co-Lead of GEAR lab. Solving Physical AGI, one motor at a time. Stanford Ph.D. OpenAI's 1st intern.
François Chollet @fchollet
572K Followers 813 Following Co-founder @ndea. Co-founder @arcprize. Creator of Keras and ARC-AGI. Author of 'Deep Learning with Python'.
Yann LeCun @ylecun
948K Followers 764 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
George Hotz 🌑 @realGeorgeHotz
300K Followers 204 Following President @comma_ai. Founder @__tinygrad__
SynthLabs @synth_labs
15K Followers 46 Following Scaling Up Good Synthetic Reasoning We're hiring! ➡️ https://t.co/Gqtk6KrIy6 / DM 💬 @NathanThinks
AK @_akhaliq
425K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo ,submit papers here: https://t.co/UzmYN5YmrQ
Google DeepMind @GoogleDeepMind
1.2M Followers 279 Following We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.
BigCode @BigCodeProject
9K Followers 3 Following Open and responsible research and development of large language models for code. #BigCodeProject run by @huggingface + @ServiceNowRSRCH
Jay Hack @mathemagic1an
55K Followers 3K Following Building @codegen. Tweets about AI, computing and dev tools. Previously did startups, @palantir. Not a pseudonym.
Gabriel Peyré @gabrielpeyre
102K Followers 453 Following @CNRS researcher at @ENS_ULM. One tweet a day on computational mathematics.
Rosanne Liu @savvyRL
46K Followers 1K Following (On mat leave.) Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS.
Sebastian Raschka @rasbt
354K Followers 1K Following ML/AI researcher & former stats professor turned LLM research engineer. Author of "Build a Large Language Model From Scratch" (https://t.co/O8LAAMRzzW).
Brendan Dolan-Gavitt @moyix
30K Followers 6K Following Building offsec agents: https://t.co/G9EtnC2Gl3 PGP https://t.co/3WXr0RfRkv
Manuel Faysse @ManuelFaysse
2K Followers 398 Following NLP Research, interning at FAIR @AIatMeta + PhD Candidate @CentraleSupelec Prev: @imperialcollege, @epfl
Michal Geyer @GeyerMichal
437 Followers 369 Following Researcher at @Runwayml (Prev @GoogleDeepMind research intern, @WeizmannScience)
Katie Lewis @KatieLewisMIT
1K Followers 342 Following Research @runwayml , previously PhD @MIT_CSAIL Computer vision, generative & creative AI research. Opinions are my own.
Yining Shi @yining_shi
3K Followers 744 Following Director of Product Eng + Founding Engineer @runwayml | Adjunct professor @ITP_NYU, @ml5js, she/her.
Tomasz Łakomy @tlakomy
25K Followers 4K Following Staff Engineer / AI Safety @runwayml | ex Engineering Team Lead @Stedi | AWS Hero | Co-founder at @cloudashdev | @eggheadio instructor | AWS Certified | Be kind
Corina Gurau @corina_gurau
545 Followers 431 Following research @runwayml, past lives @airstreet @wayve_ai and @oxfordrobots
Anastasis Germanidis @agermanidis
4K Followers 416 Following Simple ideas, pursued maximally. Co-Founder & CTO @runwayml.
Jonathan Granskog @jongranskog
3K Followers 853 Following research @runwayml. vfx/3d graphics, generative models, photography. swedish-speaking finn.
Naveen Venkat @ServerProcessor
436 Followers 1K Following Research @ Runway | CV @ Carnegie Mellon University | CS @ BITS Pilani.
anneka goss @anneka_gss
827 Followers 888 Following WebGL, GLSL, React, XR, generative art @runwayml, formerly @active_theory et al.
Alejandro Matamala Or... @matamalaortiz
3K Followers 748 Following Co-founder / CDO @RunwayML https://t.co/K9wYeqbCvp
Deepti @deeptigp
1K Followers 1K Following Asst. Professor in Computer Vision @ BU; Researcher @runwayml; ex-researcher @MetaAI, @UTCompSci , @iiit_hyderabad
George Kopanas @gkopanas
2K Followers 412 Following @runwayml fiddling with video models and 3d -- inventor of Gaussian Splatting -- a climbing gym owner back at home -- previously @Google @Adobe @Inria @Arm
Jie Huang @jefffhj
13K Followers 636 Following Building intelligence @xAI. Grok-2🍍, 3🍫, 4🫐, 🪄. PhD from UIUC CS.
Tongyi Lab @Ali_TongyiLab
4K Followers 17 Following We advance the development of AGI and foster open source collaboration towards a smarter future.
Gaurav @gauravisnotme
2K Followers 454 Following Good model @xAI | prev. d-matrix, Google, ISRO Opinions are my own - always and forever
Nano Banana @NanoBanana
27K Followers 1 Following Nano Banana 🍌, aka Gemini 2.5 Flash Image, the world's most powerful image editing and generation model! Try it for free in the @GeminiApp
Bill Chen @realchillben
2K Followers 521 Following Applied @openai ; Prev @ycombinator @Retool @Meta ML @Columbia
prashant @prashantmital
2K Followers 1K Following solutions, startups & vibes @OpenAI // views my own
Marzieh Fadaee @mziizm
1K Followers 547 Following seeks to understand language. Head of @Cohere_Labs. PhD from @UvA_Amsterdam. https://t.co/YI5NC5J5e4. [email protected].
fabian @fabianstelzer
37K Followers 4K Following hey you. yes you. get in here, we're going to build insanely creative AI agents & workflows. co-founder of @heyglif / https://t.co/wGWdjY4Ted
Kartik Sreenivasan @KartikSreeni
1K Followers 573 Following Research scientist at MosaicML/Databricks. PhD from UW-Madison. Interested in LLMs, optimization, and the meaning of life.
Chi Jin @chijinML
5K Followers 456 Following Assistant Prof @Princeton. Previously: ML theory, RL & optimization. Now: AI for math, games & decision making.
Alex Hägele @haeggee
816 Followers 660 Following Fellow @AnthropicAI + PhD Student in Machine Learning @ICepfl MLO. MSc/BSc from @ETH_en. Previously: Student Researcher @Apple MLR
Zachary Charles @MatharyCharles
1K Followers 406 Following distributed machine learning @ google | sometimes mathematician
YIFENG LIU @YIFENGLIU_AI
176 Followers 25 Following CS Ph.D. student on LLM @ UCLA AGI Lab. Previous works: RPG, MARS, TPA, Kimi-1.5....
Andrei Semenov @AndreiSemenov17
127 Followers 247 Following MSc in Data Science at @EPFL_en | MIPT Alumnus
Konstantin Mishchenko @konstmish
7K Followers 652 Following Research Scientist @AIatMeta Previously Researcher @ Samsung AI Outstanding Paper Award @icmlconf 2023 Action Editor @TmlrOrg I tweet about ML papers and math
Ashwin Ramaswami @AshwinRamaswami
6K Followers 3K Following Technologist and lawyer. CTO and Co-founder, @CorridorSecure. Contact me at [email protected]
Sherry Yang @sherryyangML
4K Followers 427 Following Research Scientist @GoogleDeepMind. Previously PhD @UCBerkeley, M.Eng. / B.S. @MIT.
Joël Niklaus @joelniklaus
621 Followers 530 Following MLE @huggingface previously: @harvey @Google @Theteamatx @Stanford @unibern
Rahul Venkatesh @Rahul_Venkatesh
155 Followers 275 Following CS Ph.D. student at Stanford @NeuroAILab @StanfordAILab
Julie Kallini ✨ @JulieKallini
1K Followers 444 Following CS PhD @StanfordNLP 🌲 Previously: SWE @Meta, Class of '21 @PrincetonCS
Tony Lee @tonyh_lee
601 Followers 164 Following PhD Candidate @StanfordAILab @StanfordNLP. Working on LLaMA @AIatMeta . Author of HELM + extensions: https://t.co/xL2p3Z86mB.
lily clifford @lilyjclifford
1K Followers 249 Following founder, chief celery man officer @rimelabs, human-centered speech technologies also @stanfordnlp
Rime @rimelabs
977 Followers 10 Following AI voices with personality. On-prem and cloud TTS for IVRs and agents people actually want to talk to.
Yi Zhang @YiZhangZZZ
1K Followers 263 Following Reasoning @xAI, foundation models @Apple, Phi @MSFTResearch, DL theory @princeton
Rohith Kuditipudi @rckpudi
693 Followers 122 Following PhD student @StanfordAILab advised by John Duchi and @percyliang
Fundamental Research ... @Fundamental
4K Followers 7 Following Building digital human beings that live, care, and grow with us
Herumb Shandilya @krypticmouse
2K Followers 492 Following Researcher @fundamental | Research Assistant @StanfordCRFM | MSCS, ColBERT, DSPy @Stanford | Learning @forai_ml | Chill @CreworkHQTrends for United States
7.329 posts
60,4 B posts
12,3 B posts
53,4 B posts
78,4 B posts
7.395 posts
14,8 B posts
34,2 B posts
220 B posts
23,4 B posts
20,2 B posts
2.204 posts
3.884 posts
1.164 posts
1.371 posts
90,3 B posts
2.036 posts
You might like
Xinyun Chen
@xinyun_chen_
7K Followers
Shunyu Yao
@ShunyuYao12
19K Followers
Andreas Kirsch 🇺�...
@BlackHC
14K Followers
Danijar Hafner
@danijarh
22K Followers
Devendra Chaplot
@dchaplot
13K Followers
Arthur Mensch
@arthurmensch
51K Followers
David Luan
@jluan
11K Followers
Aravind Srinivas
@AravSrinivas
297K Followers
James Briggs
@jamescalam
10K Followers
Uri Alon
@urialon1
2K Followers
Brandon Amos
@brandondamos
20K Followers
Kevin Patrick Murphy
@sirbayes
61K Followers
Ethan Caballero is bu...
@ethanCaballero
11K Followers
Tianqi Chen
@tqchenml
18K Followers
Deep Learning For Cod...
@DL4Code
802 Followers