Eldar Kurtić @_EldarKurtic
Principal Research Scientist @RedHat_AI & @ISTAustria Joined July 2018-
Tweets297
-
Followers726
-
Following619
-
Likes860
🚀 LLM Compressor v0.7.0 is here! This release brings powerful new features for quantizing large language models, including transform support (QuIP, SpinQuant), mixed precision compression, improved MoE handling with Llama4 support, and more. Full blog: developers.redhat.com/articles/2025/……
My recent talk at "Open Source @Siemens 2025" is now live on YouTube: youtube.com/watch?v=nu8o_v…
Apparently, we’re trending in SF as well
Apparently, we’re trending in SF as well
Let @mgoin_ show you what the de facto industry standard for running agents looks like with @vllm_project
Let @mgoin_ show you what the de facto industry standard for running agents looks like with @vllm_project
[vLLM Office Hours #29] Scaling MoE with llm-d x.com/i/broadcasts/1…
You can now find GuideLLM at its new address: github.com/vllm-project/g…
You can now find GuideLLM at its new address: github.com/vllm-project/g…
.@vllm_project office hours return next week! Alongside project updates from @mgoin_, vLLM committers and HPC experts @robertshaw21 + @tms_jr will share how to scale MoE models with llm-d and lessons from real world multi-node deployments. Register: red.ht/office-hours
FP4 models and inference kernels ready for Blackwell GPUs! GPTQ and Hadamard for accuracy, and fused Hadamard for runtime. Check out more details about our work in the thread below 👇
FP4 models and inference kernels ready for Blackwell GPUs! GPTQ and Hadamard for accuracy, and fused Hadamard for runtime. Check out more details about our work in the thread below 👇
The @huggingface folks deserve far more credit for being a pillar of open-source and still managing to push out SOTA results across the board, along with a full write-up of the entire model’s lifecycle.
The @huggingface folks deserve far more credit for being a pillar of open-source and still managing to push out SOTA results across the board, along with a full write-up of the entire model’s lifecycle.
Want to learn more about GuideLLM, the tool used by @charles_irl and @modal_labs' LLM Engine Advisor to easily benchmark LLM inference stack? Join the next vLLM office hours with @ZelenovicSasa , @mgoin_ , Jenny Yi, and @markurtz_ . More details in the thread below 👇
Want to learn more about GuideLLM, the tool used by @charles_irl and @modal_labs' LLM Engine Advisor to easily benchmark LLM inference stack? Join the next vLLM office hours with @ZelenovicSasa , @mgoin_ , Jenny Yi, and @markurtz_ . More details in the thread below 👇
The recording of @egallen's and my @PyTorch Day France 2025 and @gosimfoundation talk, "Scaling LLM Inference with vLLM," is now available on PyTorch’s YouTube channel. youtube.com/watch?v=XYh6Xf…
Red Hat team absolutely smashing it!! Integration with axolotl is huge for training
Red Hat team absolutely smashing it!! Integration with axolotl is huge for training
LLM-Compressor now integrated with Axolotl!
LLM-Compressor now integrated with Axolotl!
Join me to hear about decentralised training, why it works and what opportunities it can unlock 🚀. Many thanks to @Sree_Harsha_N for the invitation!
Join me to hear about decentralised training, why it works and what opportunities it can unlock 🚀. Many thanks to @Sree_Harsha_N for the invitation!
Want to quickly get a feeling for how fast an LLM runs under different workloads (and in different engines)? Look no further, @charles_irl and @modal_labs built a really cool app for it. Pro tip: don't skip the "Executive Summary" and "How to Benchmark", well worth the read!
Want to quickly get a feeling for how fast an LLM runs under different workloads (and in different engines)? Look no further, @charles_irl and @modal_labs built a really cool app for it. Pro tip: don't skip the "Executive Summary" and "How to Benchmark", well worth the read!
Today at 15:00 CEST, I’ll give a talk at OpenSource@Siemens on efficient inference with LLMs. 📺 The talk will be live-streamed at opensource.siemens.com, followed by a live Q&A. Feel free to tune in and bring your questions! It’s a tutorial-style session covering the basics…
샤오메이 @Jorwor8065580
4 Followers 413 Following Focused on investing in U.S. stocks, happy to discuss stock market trends.
Matthew Graham @mattyryze
85K Followers 36K Following Founding and Managing Partner, @RyzeLabs. Digital Assets, AI, and Emerging Markets. Local Insights, Global Impact.
Ilse @Tweebau6230851
19 Followers 897 Following You don’t have to play the game the way they wrote it.
Esme @Etweauive21210
19 Followers 934 Following Elegance is the only beauty that never fades. — Audrey Hepburn
Riley @5eiUY0YrWh0Sjh2
31 Followers 1K Following
SebastianBoo @SebastianB929
290 Followers 235 Following 🤖 Exploring open source TTS/LLMs & sometimes blogging about it. ☁️ Building GenAI applications in the cloud for work. DMs open.
flora feng @flora__feng
4 Followers 149 Following
Sky Lee @SkyLee010101010
3 Followers 98 Following
PennyStockRadar🇺�... @Armoertar109
50 Followers 2K Following 15-30% Monthly | 2 High-Conviction Stocks.Short-Term Gains: 15-20% in Days/Weeks.DM "JOIN" for WhatsApp Alerts. Live Trade Signals • Market Analysis
Erhouexieh @Erhouexieh4514
32 Followers 2K Following
Uibaleebead @Uibaleebead824
101 Followers 3K Following
Dan Saunders @djsaunde
494 Followers 2K Following ML eng @axolotl_ai making open source llm training tools. miniature Aussie haver, sheep wrangler, remote worker, extremely quacked
Augusto Caringi @augustocaringi
196 Followers 746 Following Computer Science Professor, Software Engineer, Freethinker
Anand Kannappan @anandnk24
656 Followers 600 Following co-founder @PatronusAI. ex @Meta. prev founded quant fund (acquired in 2020). eval and RL research ⚡️
Markus Eisele @myfear
28K Followers 2K Following Something at @IBMResearch. Legal thinks you need to know that I'm speaking for myself here. I believe you knew.
Karan_shah @Karansh42896056
27 Followers 496 Following
Ofwosou @Ofwosou949
111 Followers 3K Following
369 @storn_max
299 Followers 719 Following Data with love. https://t.co/2PFRnQQmYi https://t.co/RwcpOe7DmW
Franz Musil @franz_musil
47 Followers 825 Following
Parth Vajge @prvajge
207 Followers 330 Following
Eric Tchirnhausen @tchirnhaus20039
23 Followers 5K Following Like to try new things you never know; trying to prove all software can be automated 😅 😅 😅 | ML/AI, | C++/Java/Go | GitHub : Dyl777
Rayan @AskRayan
250 Followers 965 Following Shipping super optimized AI models, endpoints and the tools to do it @PrunaAI Cofounder CEO
Walker Quigley @QuigleyWal11315
31 Followers 2K Following
Alrz_Rhm @Alrzrh97
17 Followers 124 Following Electrical Engineer (BSc) | Digital Electronics (MSc) | Specializing in Computer Vision Passionate about innovation & solving real-world problems.
Zheng | Vibe Working @zheng401
830 Followers 4K Following vibe living with AGI @Kimi fueled by caffeine, code and dream！
Colin Kealty @bartowski1182
3K Followers 160 Following LLM Enthusiast https://t.co/FadJBzEsVw https://t.co/uJHolerL9G https://t.co/9JIEKgsIMh https://t.co/lYSGzQBmuP
MythoPoetic Society @societymythos
16K Followers 3K Following Artificial unintelligence | Commander of broken AI dreams | “Trust the pipeline”
Mamading Ceesay @evangineer
3K Followers 6K Following Polymath. Doing Work That Matters (@H_O_L_O_), Enabling Thrivable Futures, Shaping Worlds, Smithing Words, Telling Stories, Playing Tabletop Games. He/Him/His.
trkdivgrad @trkdivgrad
0 Followers 126 Following
nisten🇨🇦e/acc @nisten
18K Followers 7K Following fullstack-dev democratizing intelligence Basement AGI Club 9mcp inc. ezdoesit inc. https://t.co/RjbLSpEgPE @skunkworks_ai @alignment_lab | prev @ https://t.co/68jAlAVBKR
Epicarism @epicarism
9 Followers 105 Following AI Researcher, world renowned, UniPd (Padova) Grad student
Cs Shankar @csshankar121
25 Followers 2K Following
Deepak Vijaykeerthy @DVijaykeerthy
537 Followers 1K Following ML Research & Engineering @IBMResearch. Ex @MSFTResearch. Opinions are my own! Tweets about books & food.
Daniel Blasko @blskdan
248 Followers 2K Following prev. @canva, building user-facing ML experiences that feel like magic ✨. Interested in multimodality, VLMs, systems & MLOps.
Ljubomir Josifovski @ljupc0
6K Followers 7K Following FOLLOWS YOU 🫵 https://t.co/F7MzDOTC1k ML/AI, R&D eng, quant trading, ASR in noise, TTS. OPEN weights, thoughts, ... AGI, ASI - open AI computation for */acc—NOW 🥰
Alvin @goa73
8 Followers 1K Following
Adam @Adammmm12310
109 Followers 6K Following
Kyle Wiggers @Kyle_L_Wiggers
67K Followers 6K Following Ai2 Comms Lead | [email protected] | Pronouns: he/him
Stephen Oates @stephenjaoates
810 Followers 7K Following
Sandeep Sharma @sandeepkaushik
184 Followers 619 Following Mixing up #Healthcare #NLP #SpeechAnalytics #ConsumerAnalytics
aaron @aarnphm_
1K Followers 2K Following i work on inference system. sometimes I ramble to my IRL friends.
gabriel @GabrielPeterss4
35K Followers 488 Following research sora at @OpenAI, previously at midjourney, swedish high school dropout
lmarena.ai @lmarena_ai
92K Followers 207 Following LMArena: Open Platform for Community-driven AI Benchmarking. Graduated from UC Berkeley / @lmsysorg. We’re hiring: https://t.co/1OkfLq2n0I
Hongyang Zhang @hongyangzh
3K Followers 261 Following Assistant Professor in CS @UWaterloo @VectorInst. Lead the SafeAI Lab. CMU ML PhD @SCSatCMU. @PKU1898 Alumni. Proud developer of EAGLE & TRADES.
Thien Tran @gaunernst
1K Followers 223 Following
Igor Babuschkin @ibab
103K Followers 851 Following Maybe the real ASI was the friends we made along the way. Co-founder @xAI, Research & Engineering
Eigen AI @Eigen_AI_Labs
626 Followers 21 Following Built by researchers and engineers from MIT, we are pursuing Artificial Efficient Intelligence (AEI). Try GPT-OSS support: https://t.co/BQfsnXIGFo.
You Jiacheng @YouJiacheng
8K Followers 2K Following a big fan of TileLang 关注TileLang喵！关注TileLang谢谢喵！ https://t.co/utshC0jrCO 十年老粉
AI Engineer @aiDotEngineer
31K Followers 6 Following A network of engineers enhanced by and building with AI. Organizers of the AI Engineer Summit, AI Engineer World's Fair, and AI Engineer Europe.
Ilya Sutskever's hair... @IlyasHairline
2K Followers 835 Following Follically challenged, but emotionally enriched. On my journey from forehead to backhead. #OnTheMove
Anand Kannappan @anandnk24
656 Followers 600 Following co-founder @PatronusAI. ex @Meta. prev founded quant fund (acquired in 2020). eval and RL research ⚡️
Nathan Lambert @natolambert
56K Followers 853 Following Figuring out AI @allen_ai, open models, RLHF, fine-tuning, etc Contact via email. Writes @interconnectsai Wrote The RLHF Book Mountain runner
Shengjia Zhao @shengjia_zhao
52K Followers 230 Following Chief Scientist @ Meta MSL. Formerly MTS @ OpenAI, PhD @ Stanford. I train models. All opinions my own.
Kimi.ai @Kimi_Moonshot
50K Followers 98 Following Built by Moonshot AI to empower everyone to be superhuman.
Kosseila (CloudDude) ... @CloudDude_
457 Followers 537 Following Founder @cloud_thrill | Speaker | MultiCloud | local AI | Beatmaker 🎙Podcast: https://t.co/F1XZJ7ozEH
Colin Kealty @bartowski1182
3K Followers 160 Following LLM Enthusiast https://t.co/FadJBzEsVw https://t.co/uJHolerL9G https://t.co/9JIEKgsIMh https://t.co/lYSGzQBmuP
LMCache Lab @lmcache
653 Followers 47 Following 🧪 Open-Source Team that maintains LMCache and Production Stack 🤖 Democratizing AI by providing efficient LLM serving for ALL
emozilla @theemozilla
7K Followers 1K Following catholic, ai researcher, co-founder/ceo of @NousResearch alignment: whatever the opposite of yudkowsky + bryan johnson is. blessed be God in all his designs.
Philipp Moritz @pcmoritz
531 Followers 5 Following Co-founder and CTO at @anyscalecompute. Co-creator of @raydistributed. Interested in ML, AI, computing.
Albert Pumarola @AlbertPumarola
1K Followers 563 Following Researcher & Manager @Meta Superintelligence Labs
POLIZEI WIEN @LPDWien
350K Followers 106 Following Offizieller Account LPD Wien. Keine Anzeigen, kein 24/7 Monitoring. Im Notfall: 133. Datenschutzerklärung und Links: https://t.co/n8nLFdJ0yN
Roy @im_roy_lee
154K Followers 2K Following CEO at Cluely (@cluely) | Kicked out of Columbia and Harvard | i am the man who killed leetcode | @zfellows
LMSYS Org @lmsysorg
8K Followers 167 Following Large Model Systems Organization: Join our Slack: https://t.co/mSPNyKTLTS We developed SGLang https://t.co/jEqIJcGwGA, Chatbot Arena (now @lmarena_ai), and Vicuna!
Xiaohua Zhai @XiaohuaZhai
11K Followers 311 Following Researcher at Meta (previously at OpenAI Zürich, Google DeepMind)
Laude Institute @LaudeInstitute
2K Followers 29 Following Laude Institute backs computer science researchers turning research into real-world impact. // @LaudeVentures
Tibo @tibo_maker
162K Followers 3K Following Built Tweet Hunter, Taplio (sold $8m) Growing https://t.co/OyNJ8ZUyOh - https://t.co/jS9GQJ5Ps8 - https://t.co/EFUcKeBbpU - https://t.co/JkVOl1O0S1 - https://t.co/KG9PgxJabg Sharing weekly tips about growth: https://t.co/ereQodN3Ov
Tony Dinh 🎯 @tdinh_me
166K Followers 898 Following Building software I love to use. https://t.co/p4T2vFZoJ1, https://t.co/y0Lq4RQRsu, https://t.co/KfFdieGrVf. Learn to build and learn to sell, you will be unstoppable.
Chris Wright @kernelcdub
7K Followers 271 Following Red Hat CTO. Tezos Foundation council member. Passion for open source SW innovation. Father and husband. Cyclist. Human.
PapersAnon @papers_anon
2K Followers 50 Following Just a fan of acceleration. I read and post interesting papers. Let's all make it through.
tokenbender @tokenbender
9K Followers 698 Following playing reward lottery• chaotic neutral • critique by creating
SemiAnalysis @SemiAnalysis_
34K Followers 16 Following
Marc Lou @marc_louvion
202K Followers 1K Following 🧑💻 https://t.co/Y30jsaI4oH $20K/m ⚡️ https://t.co/vatLDmiHKe $12K/m 📈 https://t.co/3EDxln5U2Q $6K/m 🍜 https://t.co/r07EpGTwyA $.5K/m 🧾 https://t.co/7olaOzVGML $0/m 🛡️ https://t.co/LFgSlrZaip $0/m 🧬 https://t.co/SfrVXVtU38 $0/m +18 https://t.co/4zCWHGJWRq
Clémentine Fourrier ... @clefourrier
5K Followers 398 Following Evals @HuggingFace 🐍✨ "The future is already here, it’s just not very evenly distributed" (Gibson) Not an AGI believer, LLMs are good at form not substance
vLLM @vllm_project
17K Followers 20 Following A high-throughput and memory-efficient inference and serving engine for LLMs. Join https://t.co/lxJ0SfX5pJ to discuss together with the community!
llm-d @_llm_d_
282 Followers 2 Following llm-d: a Kubernetes-native high-performance distributed LLM inference framework
Alma Zadić @Alma_Zadic
58K Followers 370 Following Justizsprecherin und stv. Klubobfrau bei @diegruenen • Für ein gerechtes Miteinander 💚💪🏻
Nathan @nathanhabib1011
1K Followers 550 Following Evals @huggingface 🤗 Open LLM Leaderboard and lighteval
GOSIM Foundation @gosimfoundation
280 Followers 88 Following Discover and grow global open-source projects for various technology areas. GOSIM Hangzhou 2025: Sept 13–14｜Hangzhou, China
Modal @modal
19K Followers 123 Following Bring your own code, and run CPU, GPU, and data-intensive compute at scale. The serverless platform for AI and data teams.
Artificial Analysis @ArtificialAnlys
57K Followers 543 Following Independent analysis of AI models and hosting providers - choose the best model and API provider for your use-case
merve @mervenoyann
80K Followers 5K Following open-sourceress at @huggingface 🧙🏻♀️proud Aegean, I work on computer vision, VLMs & agents | gençleri serbest bırakın
Qubitum @qubitium
1K Followers 4K Following I make models go brrr..... @ModelCloudAI founder Committer to SGLang, vLLM, GPTQModel. AI sw + hw { Go, Python, Kotlin } Quantization Accelerator
mobicham @mobicham
548 Followers 113 Following I like to shrink dem models 🤏 Co-Founder & Principal Scientist @mobius_labs PhD @inria
Yani Ioannou @yanii
801 Followers 696 Following Schulich Research Chair & Assistant Professor, Calgary ML Lab (@UCalgaryML), PhD U. Cambridge. Sparse Neural Networks/Efficient Deep Learning. 🇨🇦🇬🇧🇨🇾
Reka @RekaAILabs
17K Followers 21 Following An AI research and product company 🫠. We are a team of scientists and engineers building state-of-the-art multimodal models 😻
Veritasium @veritasium
302K Followers 551 Following An element of truth - videos about science, education, and interesting things.
philz1337x @philz1337x
14K Followers 225 Following AI developer building open source AI apps 💎 https://t.co/RAB7lixhyy $10K/m 🕵️♂️ https://t.co/KnFDOLaNH1 freeTrends for United States
You might like
