David Wei @kinddevilly
Fav:BigData, Flink, Numerical Analysis with c,python,java loving her is not a word ,but an action LAX Joined July 2011-
Tweets364
-
Followers113
-
Following2K
-
Likes2K
Vol:18 No:12 → Database Perspective on LLM Inference Systems vldb.org/pvldb/vol18/p5…
MLPs are so foundational, but are there alternatives? MLPs place activation functions on neurons, but can we instead place (learnable) activation functions on weights? Yes, we KAN! We propose Kolmogorov-Arnold Networks (KAN), which are more accurate and interpretable than MLPs.🧵
Thinking Machines Lab exists to empower humanity through advancing collaborative general intelligence. We're building multimodal AI that works with how you naturally interact with the world - through conversation, through sight, through the messy way we collaborate. We're…
I am pleased to announce a new version of my RL tutorial. Major update to the LLM chapter (eg DPO, GRPO, thinking), minor updates to the MARL and MBRL chapters and various sections (eg offline RL, DPG, etc). Enjoy! arxiv.org/abs/2412.05265
Giving your models more time to think before prediction, like via smart decoding, chain-of-thoughts reasoning, latent thoughts, etc, turns out to be quite effective for unblocking the next level of intelligence. New post is here :) “Why we think”: lilianweng.github.io/posts/2025-05-…
i think this is gonna be more like the renaissance than the industrial revolution
New blog post on the mental model I've used when working through complex or confusing papers on transactional systems. transactional.blog/blog/2025-deco…
Great read! Improving Recommendation Systems eugeneyan.com/writing/recsys… via @eugeneyan
Huge achievement: xLSTM kernels are now the fastest kernels both for training and inference. Faster than Flashattention or Mamba kernels. High arithmetic intensity. Optimized use of the GPU that set a new state of the art. Congratulations to the team. It is highly impressive.
Huge achievement: xLSTM kernels are now the fastest kernels both for training and inference. Faster than Flashattention or Mamba kernels. High arithmetic intensity. Optimized use of the GPU that set a new state of the art. Congratulations to the team. It is highly impressive.
New paper: turns out you can train deep nets without normalization layers by replacing them with a parameterized tanh()
New paper: turns out you can train deep nets without normalization layers by replacing them with a parameterized tanh()
I'm not a coauthor on this, but @CMUDB alum @huanchenzhang's latest paper is a big deal. Robust Predicate Transfer is sideways information passing on pure meth. DBMS reads all inputs first to build Bloom filters, then figures out the best join ordering automatically.
I'm not a coauthor on this, but @CMUDB alum @huanchenzhang's latest paper is a big deal. Robust Predicate Transfer is sideways information passing on pure meth. DBMS reads all inputs first to build Bloom filters, then figures out the best join ordering automatically. https://t.co/VRC6BPTnxP
Everyone has said it already, but just want to weigh in that this is so freaking cool.
Everyone has said it already, but just want to weigh in that this is so freaking cool.
Yes, I'm a big fan of Kalman filtering and fancier non-linear, non-Gaussian SSMs. Fun fact: you can also use this machinery to train neural networks from streaming, non-stationary data distributions. See my talk on Bayesian Online Natural Gradient (BONG ) murphyk.github.io/bong-talk/
Yes, I'm a big fan of Kalman filtering and fancier non-linear, non-Gaussian SSMs. Fun fact: you can also use this machinery to train neural networks from streaming, non-stationary data distributions. See my talk on Bayesian Online Natural Gradient (BONG ) murphyk.github.io/bong-talk/
Making LLMs run efficiently can feel scary, but scaling isn’t magic, it’s math! We wanted to demystify the “systems view” of LLMs and wrote a little textbook called “How To Scale Your Model” which we’re releasing today. 1/n
Jevons paradox strikes again! As AI gets more efficient and accessible, we will see its use skyrocket, turning it into a commodity we just can't get enough of. en.m.wikipedia.org/wiki/Jevons_pa…
Cool things from DeepSeek v3's paper: 1. Float8 uses E4M3 for forward & backward - no E5M2 2. Every 4th FP8 accumulate adds to master FP32 accum 3. Latent Attention stores C cache not KV cache 4. No MoE loss balancing - dynamic biases instead More details: 1. FP8: First large…
FOCS 2024 Nearly Optimal List Labeling youtu.be/dtNVZCx40xE?si… via @YouTube
My 8000-word note on agents: huyenchip.com//2025/01/07/ag… Covering: 1. An overview of agents 2. How the capability of an AI-powered agent is determined by the set of tools it has access to and its capability for planning 3. How to select the best set of tools for your agent 4.…
10 short videos about LLM infrastructure to help you appreciate Pages 12-18 of the DeepSeek-v3 paper (arxiv.org/abs/2412.19437) 🧵 youtube.com/watch?v=76gulN…
Vwodah @Vwodah415161
126 Followers 3K Following
Mary @OP68OZ25VLN7v
38 Followers 1K Following
Xuotmalx @Xuotmalx2058
51 Followers 1K Following
OptionIncomeX🇺🇸 @Kafir1276097
30 Followers 2K Following 15-30% Monthly | 2 High-Conviction Stocks.Short-Term Gains: 15-20% in Days/Weeks.DM "JOIN" for WhatsApp Alerts. Live Trade Signals • Market Analysis
SusannaArthur @Lh0ZT2251Ys4xxB
111 Followers 3K Following
Olga McClure @McclureOlg92642
27 Followers 2K Following
TheGoldenAnchor @TheGoldenAnvil
244 Followers 2K Following I'm here to experiment with what can be done with an X premium account and using it to compare and contrast with other AI ecosystems I use for work and projects
Johann Gutmann @GutmannJoh85382
30 Followers 2K Following
Bernie Jacobi @BernieJaco66865
43 Followers 1K Following
Khaled Alhajahmed �... @khaledalhaj07
51 Followers 266 Following
すみずすみえ @sumizusumi92341
87 Followers 2K Following
Madge Jenkins @PzX20q77gLE0Dc
75 Followers 7K Following
Erskine @xTs1v0s31Fx19
54 Followers 7K Following
Tesswi @TesswiqrH_
36 Followers 3K Following
Katie @katie_fahey4
161 Followers 3K Following
Thair @ThairJ9qiCO
47 Followers 5K Following
DoreenCharles @80ae7e1PW4i6Ojy
50 Followers 6K Following
Soudarez @SoudarezuC7EG
39 Followers 4K Following
Millie @teradatesh47176
78 Followers 7K Following
GriseldaMarner @bspR6zV7xCmIhB
71 Followers 7K Following
Roman Agabekov @agabekovroman
4K Followers 3K Following Building in public Autopilot for databases 🕹️🔄 Founder @releemhq (https://t.co/Ny4n5ske07) - Easy-to-use Database Performance Management tool 🛠️
Nethe @Nethe565396
43 Followers 5K Following
Fiona @lythaski11605
111 Followers 7K Following The best and most beautiful things in the world cannot be seen or even touched, they must be felt with heart.
PearlDunlop @om4P14OQy1YEi6
57 Followers 7K Following
Alice Cooper @AliceC98881u
48 Followers 736 Following
Kate Teahe @Teahe151163
117 Followers 7K Following I'm new to Twitter accounts so I tried the messaging feature and it's great to meet you.
Seigh @Seighhc1k
2 Followers 124 Following
Hugo Hadfield @HugoHadfield1
235 Followers 1K Following Cambridge PhD in Computer Vision, Robotics, Geometric Algebra. Working on robotics at NVIDIA. ex Wayve. Views entirely my own. https://t.co/MozMcA8ZHq
khainfiqaduw @khainfiqad8187
2 Followers 76 Following When it and repealed a whaling news reached the.
MurielDobbin @vKC03u40WiJQaJ
69 Followers 7K Following
Alice @smoughshe21855
95 Followers 7K Following Be the kind of woman who fixes another woman's crown without telling the world it's crooked.
Loughphoa @Loughphoa1myeD
5 Followers 245 Following
Michael @masumotoot89354
23 Followers 2K Following
Assaf Araki @BigData_ML
360 Followers 2K Following Father, husband, AI engineer and AI investor at Intel Capital. The opinions expressed are mine alone. #IamIntel
Katherine @obuchikiku23586
33 Followers 2K Following
NatividadGrote @84ErkF7tbar1y
20 Followers 3K Following
Danielle @w9Wm4ML6jqlVZGv
65 Followers 7K Following
UrsulaStella @pKxgh1Rc3HL9N
85 Followers 7K Following Learn as if you will live forever, live like you will die tomorrow Certified Nurse-Midwife (CNM) $NVDA, $TSLA and $MSFT 💼
Una @gomes_una53
266 Followers 3K Following
Animesh Gaitonde @animesh3436
271 Followers 467 Following SDE-3 @Amazon, Ex-@Airbnb, Ex-@Microsoft, Engineer from BITS Pilani, Writer
Patricia @norton56patrici
335 Followers 3K Following
Karen @hayes60karen
289 Followers 3K Following
Dian @dian_terry95
268 Followers 3K Following
Hue @g_hue2
262 Followers 3K Following
Pramod Goyal @goyal__pramod
8K Followers 286 Following Trying to change the world one line at a time
Sebastian Fernandez @snfernandez
1K Followers 563 Following Ex-hacker. Mostly EVM these days. Security and optimization for fun and profit at @BitFinding. Previously at @Microsoft, @MarshallWace.
charlie cummings @sickeningsprawl
304 Followers 172 Following Systems programming, compilers, and cybersecurity also on https://t.co/aZ5xQrko7Q
Hyrum Wright @hyrumwright
2K Followers 64 Following Father. Husband. Christian. Software Sanitation Engineer. Googler. Occasional professor.
Davis Blalock @davisblalock
15K Followers 168 Following Research scientist @GoogleDeepMind. Past: @Databricks, first hire @MosaicML, @MIT PhD. I post about AI technical progress + sometimes the business side.
Dan Roy @roydanroy
57K Followers 2K Following ML / AI researcher. Research Director and Canada CIFAR AI Chair, @VectorInst. Professor, @UofT (Statistics/CS).
Alexander Kirillov @_alex_kirillov_
8K Followers 364 Following Multimodality @thinkymachines. Previously: post-training MM lead @openai, research Scientist @facebookai Projects: GPT-4o, Advance Voice Mode, SegmentAnything.
WeAreLATech📍Los An... @WeAreLATech
9K Followers 4K Following Where LA Tech & Startups get together for connections and experiences🦄 award winning podcast https://t.co/3Ac3ENREil🎙️by @espreedevora #longla #latechweek💜
Karoline Leavitt @PressSec
1.5M Followers 114 Following Assistant to the President and the 36th White House Press Secretary
David Duvenaud @DavidDuvenaud
31K Followers 4K Following Machine learning prof @UofT. Former team lead at Anthropic. Working on generative models, inference, & latent structure.
indigo @indigo11
43K Followers 1K Following Co-founder of https://t.co/WosXbyLukR / Partner of Brilliant Phoenix / ex-Weibo. Investor, Writer, Coder, Gamer & Amateur Cook. e/acc, 𝕏 is my notebook …
David Gomes @davidrfgomes
2K Followers 414 Following Working on @cursor_ai (previously @neondatabase / @databricks, @singlestoredb, @unbabel)
Vivek Nathani @viveknathani_
793 Followers 390 Following engineer, prev: @marscomputer (wtfund c1/24), @investmintclub, interests: number theory, computers, financial markets
Michael Black @Michael_J_Black
84K Followers 702 Following Director, Max Planck Institute for Intelligent Systems (@MPI_IS). Chief Scientist @meshcapade. Building 3D digital humans using vision, graphics, and learning.
inigo quilez @iquilezles
50K Followers 44 Following Created Quill, Shadertoy, Pixar's Wondermoss. Math & Art Videos at * https://t.co/ugnT5WuRWq * https://t.co/w20vMC2I7d * https://t.co/SRkBTFQQLP
Richard McElreath �... @rlmcelreath
46K Followers 2K Following Director @MPI_EVA_Leipzig. Bayesian evolutionary anthropologist. Mostly absent from this site while writing books and maiming code.
Hyung Won Chung @hwchung27
38K Followers 302 Following AI Research Scientist @Meta Superintelligence Labs. Past: @OpenAI / @Google Brain / PhD @MIT
Fuheng Zhao @FuhengZ
543 Followers 775 Following Incoming assistant professor @UUtah | PhD from @dsl_ucsb | Prev intern @FoundationDB @SnowflakeDB @GraySystemsLab
Tobias Brandt (@tobia... @T0bias_Brandt
321 Followers 783 Following Chief Excel Officer, MAD* Scientist, Pythonista, Rustacian, PRQL Core Contributor (*: ML, AI, Data)
David Bau @davidbau
6K Followers 272 Following Computer Science Professor at Northeastern, Ex-Googler. Believes AI should be transparent. @[email protected] @davidbau.bsky.social https://t.co/wmP5LV0pJ4
lloyd tabb @lloydtabb
3K Followers 407 Following Looker Founder, makes things with bits. Trying to make a better SQL with Malloy https://t.co/MoIvlNp89X
Zhuang Liu @liuzhuang1234
11K Followers 1K Following Assistant Professor @PrincetonCS. researcher in deep learning, vision, models. previously @MetaAI, @UCBerkeley, @Tsinghua_Uni
Eyvind Bernhardsen @eyvind
112 Followers 113 Following @[email protected] So long, and thanks for all the tweets.
Ettore Randazzo @RandazzoEttore
1K Followers 245 Following Researcher @ Google. I work on self-organising systems and artificial life.🦎
Alex Mordvintsev @zzznah
18K Followers 2K Following Mad Scientist, DeepDream creator. Designing Self-Organising Systems and Programmable Artificial Life. https://t.co/rntipHzHW3
Ariel Herbert-Voss @adversariel
9K Followers 924 Following Founder @RunSybil. likes: offsec, LLMs, and dumb memes. prev: research scientist @OpenAI / CS PhD @Harvard / @defcon AI Village
Peter Holderrieth @peholderrieth
2K Followers 430 Following CS PhD student at @MIT • Generative Modeling and AI4Science • Prev: Stats/Neuro @OxfordUni• Math at @HCM_Bonn • Former: @AIatMeta
Huanchen Zhang @huanchenzhang
1K Followers 225 Following Assistant Professor @Tsinghua_Uni. Formerly @CarnegieMellon
Stefano Ermon @StefanoErmon
20K Followers 373 Following AI Prof @Stanford | CEO & Cofounder @InceptionAILabs | Co-inventor of DDIM, FlashAttention, DPO, GAIL, and score-based/diffusion models
Rowan Zellers @rown
14K Followers 973 Following multimodal @thinkymachines. I also like to climb rocks and throw pottery. https://t.co/5Er4j39K71 (he/him)
Peyman Milanfar @docmilanfar
93K Followers 492 Following Distinguished Scientist at Google. Computational Imaging, Machine Learning, and Vision. Tweets = personal opinions. May change or disappear over time.
Larry Ellison @larryellison
167K Followers 68 Following
Jiayi Pan @jiayi_pirate
13K Followers 1K Following 🧑🍳 Reasoning Agents @xAI | PhD on Leave @Berkeley_AI | Views Are My Own
Jacob Austin @jacobaustin132
7K Followers 918 Following Research at @GoogleDeepMind. Currently making LLMs go fast. I also play piano and climb. NYC. Opinions my own
Stanislav Kozlovski @BdKozlovski
16K Followers 454 Following "The Kafka Guy" 🧠 Have worked on Apache Kafka for 6+ years, now I write about it. (& the general data space) Low-frequency, highly-technical tweets. ✌️
Mark Chen @markchen90
64K Followers 333 Following Chief Research Officer at @OpenAI. Coach for the USA IOI Team.
Maarten Grootendorst @MaartenGr
7K Followers 36 Following 🧑💻 Data Scientist | Psychologist 📖 Author of "Hands-On LLMs" (https://t.co/BcSDNMOnWq) 🧙♂️ Open Sourcerer (BERTopic, PolyFuzz, KeyBERT) 💡 Demystifying LLMs
Unsloth AI @UnslothAI
31K Followers 457 Following Open source LLM fine-tuning & RL! 🦥 https://t.co/2kXqhhvLsb
Daniel Han @danielhanchen
28K Followers 2K Following Building @UnslothAI. Finetune train LLMs faster. LLMs bug hunter. OSS package https://t.co/aRyAAgKOR7. YC S24. Prev ML at NVIDIA. Hyperlearn used by NASA.
Alexander Yee @Mysticial
1K Followers 96 Following Computers, HPC, and Anime... Author of y-cruncher. https://t.co/rvlTfugM7J
ADSP: The Podcast @adspthepodcast
3K Followers 11 Following A podcast about algorithms and everything software related hosted by @code_report && (@blelbach || @ben_deane)Trends for United States
You might like
