vLLM @vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join https://t.co/lxJ0SfX5pJ to discuss together with the community! github.com/vllm-project/v… Joined March 2024-
Tweets500
-
Followers17K
-
Following20
-
Likes228
Austin friends - we’ve got something special coming up on Wednesday, September 17 at @CapitalFactory! PyTorch ATX + vLLM are teaming up for a joint meetup. Over 200 folks are already signed up, and there’s still a few spots left. Come hang out, learn, and meet others building…
vLLM is proud to support the great Kimi update from @Kimi_Moonshot , better tool-calling, longer context, and more! Check the deployment guide at huggingface.co/moonshotai/Kim… 🔥
vLLM is proud to support the great Kimi update from @Kimi_Moonshot , better tool-calling, longer context, and more! Check the deployment guide at huggingface.co/moonshotai/Kim… 🔥 https://t.co/ysxqSJVTBU
🍁 In collaboration with @NVIDIAAIDev, @RedHat_AI, and @VectorInst, vLLM is hosting a meetup in Toronto September 25th! Come hear about project update, distributed inference, EAGLE spec decode, and FlashInfer! luma.com/e80e0ymm
🤌 amazing content for GPU fundamentals (and beyond!)
🤌 amazing content for GPU fundamentals (and beyond!)
One week left in the @OpenAIDevs gpt-oss hackathon! Prizes include cash and GPUs like the RTX 6000 Pro Blackwell, courtesy of @NVIDIAAI, @huggingface, @vllm_project, @ollama, @lmstudio — plus inference credits from @GroqInc. Over 7.5K developers are participating so far.
Amazing blogpost from @gordic_aleksa explaining internals of vLLM😍
Amazing blogpost from @gordic_aleksa explaining internals of vLLM😍
🚀 vLLM now supports Kwai Keye-VL-1.5! With sharper video 📹 & image 🖼️ comprehension, stronger reasoning, and an extended 128K context length, this model unlocks richer conversations and more complex tasks than ever before. Upgrade to the nightly build and experience it today!…
vLLM + open-webui running gpt-oss-120b on a tinybox green v2 Just `vllm serve openai/gpt-oss-120b --tensor-parallel-size 4 --async-scheduling` and you have a local OpenAI API you can trust.
🌏 vLLM Shanghai Meetup Recap 🚀 Last weekend, we gathered with the community in Shanghai to dive into: → Contributing to vLLM → Distributed inference → ERNIE 4.5 integration → Mooncake + LMCache → MetaX hardware support The community is pushing vLLM to new levels of…
Wow glad to see vLLM powers @jiawzhao 's DeepConf work, impressive results on AIME 2025! Do you think this sampling control makes sense? Have a try and leave a comment in that PR github.com/vllm-project/v… to let us know!
Wow glad to see vLLM powers @jiawzhao 's DeepConf work, impressive results on AIME 2025! Do you think this sampling control makes sense? Have a try and leave a comment in that PR github.com/vllm-project/v… to let us know! https://t.co/ozSBWNn1Uf
We are co-hosting gpt-oss meetup in San Francisco next Wednesday 08/27 at 5:30pm together with @OpenAI and @ollama at @ycombinator office! RSVP here lu.ma/gpt-oss
Join gpt-oss meetup in San Francisco next Wednesday at 5:30pm together with @OpenAI, @ollama, and @vllm_project at @ycombinator office! RSVP required! lu.ma/gpt-oss Food and drinks will be provided. lu.ma/gpt-oss
🚀 Exciting news: DeepSeek-V3.1 from @deepseek_ai now runs on vLLM! 🧠 Seamlessly toggle Think / Non-Think mode per request ⚡ Powered by vLLM’s efficient serving — scale to multi-GPU with ease 🛠️ Perfect for agents, tools, and fast reasoning workloads 👉 Guide & examples:…
🚀 Exciting news: DeepSeek-V3.1 from @deepseek_ai now runs on vLLM! 🧠 Seamlessly toggle Think / Non-Think mode per request ⚡ Powered by vLLM’s efficient serving — scale to multi-GPU with ease 🛠️ Perfect for agents, tools, and fast reasoning workloads 👉 Guide & examples:… https://t.co/AiiFbGH8Go
Korea’s first #vLLM Meetup ✅ Packed room, deep questions, and real energy from ML engineers who care about open-source serving infra. This is just the start of a stronger OSS community around vLLM! More to come so stay tuned!🚀 @vllm_project @RedHat
Muhanned @_MBS_____
12 Followers 505 Following
PixelCrafted @thepixelcrafted
20 Followers 57 Following Je réponds à tes questions sur la Tech 🤸 Ingénieur IA 🤓 Ma dernière vidéo YouTube ⬇️⬇️⬇️
__yywooo @__yywooo
2 Followers 77 Following
進藤こだま @kodam
1K Followers 2K Following 150万円のMacStudio活用法を発信します｜ソフトウェアアーキテクト｜Go・Elixir・k8s｜アニメとポーカーとビールが好きです ♠️🍺｜札幌⇆東京｜ software architect dayo. My post is usually generated by AI.｜#LLM有職 #AllInOnAI
Stoyan Atanasov @s_atanasov_beye
3 Followers 60 Following
Gergő @M99Gergo
8 Followers 94 Following
Wei @OnedeanxxxWei
0 Followers 53 Following
Krypto₿at ® @Krypt0Bat
7 Followers 292 Following
Ishant Dere @Ishantdere006
2 Followers 50 Following 🧠 Learning Artificial Intelligence | 🚀 Exploring Deep Learning & Generative Models | 📚 Always curious
Stew Tong @stewtong
276 Followers 1K Following Big Papa. Music and muscle ups. Tech sales and Tequila. Slowly sippin stoicism. Currently AI @ AWS
jelycx Yee @XichengYe
39 Followers 306 Following
Shehab @_Sashraf
16 Followers 255 Following
Sean Chang @sean_chang76967
2 Followers 52 Following
High U @UHigh49256
0 Followers 9 Following
谁主沉浮 @zhou1234
37 Followers 977 Following
A7maa @a7mmsaid9999
0 Followers 235 Following
Fabio Marchesi @fabiomarchesi77
0 Followers 23 Following
HZK @huzhikang
4 Followers 111 Following
Praveen kumar @InboxPraveen
65 Followers 534 Following I bring intuition, and soul into learning | Developer | Building trust & Relationships. Trying to make the world a better place.
Xuehan Xu @rainman1985
20 Followers 323 Following
alluri @sid_alluri
113 Followers 86 Following research and engineering @ritualnet, prev: cs grad @uiuc
Mrinal Sood @MrinalSood3
7 Followers 91 Following
ft_mdfk @unbegrenzte0
34 Followers 110 Following
DarrenZy.AI @zy6688999
4 Followers 79 Following
Weizen @weizenai
0 Followers 286 Following
Friedman7 @Friedman7596598
2 Followers 60 Following
Philip Myers @sugarflows
75 Followers 111 Following
歪脖扣腚 @vibercoding
45 Followers 216 Following
ʙᴀɪꜱʜᴀᴍᴘ... @ghoseb
3K Followers 764 Following Organic Intellectual | Founder/CTO @teamohanahq | ⌨️ Clojure | عاشقِ ریختہ | বাংলা | 🏋🏽♂️🏃🏾♂️🚣🏽♂️ | Previously: Co-founder & CTO @Helpshift | he/him
Stark @SeyamSimull
534 Followers 25 Following
Senexenes @senexenes
2 Followers 353 Following
ŁiteŁord🟦Ⓜ️�... @tak_ltc
282 Followers 632 Following Anyone can be a millionaire, but to become a millionaire you need an astrologer.
Zhengxu Chen @zhxchen17
0 Followers 54 Following
EuiYul Song @euiyul14059
0 Followers 5 Following
Douglas Correa @douglas_correa
806 Followers 926 Following 💻 20+ yr poliglot developer, playing with AI and getting back to @elixirlang. 👑 Hubby to a queen, dad to two princesses.
StepFun @StepFun_ai
3K Followers 121 Following Scale-up possibilities for everyone. HuggingFace: https://t.co/Soz5ZuwCrd
ManusAI @ManusAI_HQ
204K Followers 25 Following Manus is the general AI agent that bridges minds and actions: it doesn't just think, it delivers results. Download our app: https://t.co/XSfjRhjdgo
Kimi.ai @Kimi_Moonshot
50K Followers 98 Following Built by Moonshot AI to empower everyone to be superhuman.
PyTorch @PyTorch
451K Followers 77 Following Tensors and neural networks in Python with strong hardware acceleration. PyTorch is an open source project at the Linux Foundation. #PyTorchFoundation
Ion Stoica @istoica05
5K Followers 20 Following Professor at UC Berkeley, co-founder of Databricks, Anyscale, LMArena, Conviva.
Sang Cho @Saaaang94
2K Followers 465 Following reasoning @xAI | prev-founding engineer @anyscalecompute | senior committer of @raydistributed | committer @vllm_project Sglang | Github: rkooo567
Michael Goin @mgoin_
1K Followers 375 Following inference optimization @RedHat_AI building @vllm_project | you can call me misha
Roger Wang @rogerw0108
445 Followers 182 Following Flowers and friendship | ML Platform & Infra @Roblox | Committer @vllm_project | @uwaterloo @uwcse
Nick Hill @nickhill33
61 Followers 3 Following
Philipp Moritz @pcmoritz
531 Followers 5 Following Co-founder and CTO at @anyscalecompute. Co-creator of @raydistributed. Interested in ML, AI, computing.
Kaichao You @KaichaoYou
4K Followers 134 Following phd student in tsinghua university, working on @vllm_project
Lily Liu @eqhylxx
1K Followers 429 Following CS PhD Student, Sky Lab @UCBerkeley, @vllm_project, @OpenAI
Woosuk Kwon @woosuk_k
4K Followers 601 Following PhD student at @Berkeley_EECS building @vllm_project
Zhuohan Li @zhuohan123
9K Followers 865 Following mts @ openai | cs phd @ 🌁 uc berkeley | building @vllm_project | machine learning system | the real agi is the friends we made along the wayTrends for United States
You might like
