Eric Zhang @ekzhang1
Computer systems person, interaction designer. founding eng @modal → dreams of: a simpler, more honest, more human sort of software (people are good, be kind!) ekzhang.com New York, NY Joined June 2021-
Tweets2K
-
Followers15K
-
Following459
-
Likes1K
I like making GPUs go brrt at @modal. I wrote up what I've learned along the way in an extension to the GPU Glossary -- our "CUDA Docs for Humans". Introducing: the GPU 𝔓𝔢𝔯𝔣𝔬𝔯𝔪𝔞𝔫𝔠𝔢 Glossary. modal.com/gpu-glossary/p…
Next week(s) at NYSRG: We'll go through @iskyzh's tiny-llm book, a systems perspective on implementing a Qwen2 serving system from scratch on Apple Silicon GPU skyzh is known for a lot of open-source database work; and mini-LSM, the tutorial on log-structured merge trees
Today we had a bunch of folks test @modal's notebook interface live during my session and everyone has absolutely loved it. modal + nbdistributed is the new secret sauce. It "just works" Nice work all (cc @charles_irl )
tried starting 20 web server sandboxes on Modal. and then I got URLs for each of them in just over 1 sec! it feels great to schedule cloud containers so fast like this
i am at home for a couple days to rest, did some jax-js stuff added float16 and going to run Apple's MobileCLIP2 next, just to see how it goes! here it is loading the cocktail of safetensors from CDN, cached in OPFS :D also claude-coded a nice CLI for converting weights ✨
I’ve been reading things I wrote when I was 18-21 and it’s honestly good. had not figured out a lot of stuff yet, very turbulent but there’s a raw simplicity and rightness about my convictions at the time, perhaps I could only write like so when first developing a core worldview
saw a very strange movie today, and it made me remember that life can be a bit surprising at times, but at least I have the people I’ve grown to appreciate very much
"no, you're an infrastructure company, you can't have cute UI and information visualization! everything has to be tables and line charts—" actually, how bout we do anyway
over the past 4 days, I read the really great LLM scaling book from google DeepMind/JAX and took some (very abridged) notes it's a long book, but I think this provides an okay tl;dr of the plot at some level of technical background ekzhang.substack.com/p/abridged-not…
omg they're sharing notebooks now 😄 sign of what's to come soon
omg they're sharing notebooks now 😄 sign of what's to come soon
[digression] i've always been a little bit confused by the idea of 'career progression' in tech because i've always just written software and worked out problems w people seems if your work is your goal, the tools are all there for everyone? the high school student has the same…
if web development is mostly centering divs, and theoretical CS is just Chernoff bounds, then it seems like ML systems is mostly just AllReduce + lots of coffee
What does @modal do? How does it work? What's different about AI infra? Why did we throw out Kubernetes and Docker built our own infra stack from scratch? @AmplifyPartners wrote this article about a lot of the gory details under the hood of Modal – link in 🧵
it’s so interesting, how life changes and the world blurs, you do something once and then remember it again years later, maybe lost a piece along the way i really don’t remember. but in quiet moments there’s more to it, deeper truths to believe in than your day-to-day job
It’s been exciting to help support @cartesia_ai on Line, their new code-first voice agent platform — solving how they instantly cold start voice agents at scale. ⚡️ Here’s a fun one we built that tells you how to get started on Modal - call +1(626)746-1433 🤙
It’s been exciting to help support @cartesia_ai on Line, their new code-first voice agent platform — solving how they instantly cold start voice agents at scale. ⚡️ Here’s a fun one we built that tells you how to get started on Modal - call +1(626)746-1433 🤙 https://t.co/F8mxV343l0
TIL that kernel panics are just a fact of life for people who write GPU compilers as their job. y’all are so brilliant I guess with jax-js, since the GPU compiler is in the browser, difference is that I can gift the kernel panic to all my users on the web, with just a link :D
so this is awkward… I can get a consistent macOS kernel panic after ~8 epochs of my convnet training code in jax-js's WebGPU backend — well that's one hell of a bug to figure out never thought a web page would trigger a kernel panic in 2025, let alone a library I made myself 😅
I got general convolution (n-dim, pads, dilated, strides) working in jax-js! Kind of a pain but it is all working now, reasonably fast & with backprop. Couple more features, some minor bugfixes, optimizations left, + a Wasm backend, and then I think I'll release the library :)
Feeling a bit of pride but also mostly irked, today I found out that my sshx.io is now a tool of choice for crypto miners trying to abuse free cloud credits Maybe it’s the e2e encryption, UX or ease of installing, idk. But yeah, I guess that’s just OSS in use 😕
one unexpected skill I've learned recently is how to mentally rotate / do dimensional analysis on tensor indices in my head. this is from building jax-js, but also randomly from reading diff geo book and trying to wrap my head around funky tensors like riemann curvature it's a…
Erik Bernhardsson @bernhardsson
46K Followers 3K Following Building @modal when I'm not posting banger stuff about infra and AI
Charlie Marsh @charliermarsh
28K Followers 829 Following Building @astral_sh: Ruff, uv, and other high-performance Python tools. Prev: Staff engineer @SpringDiscovery, @KhanAcademy, BSE @PrincetonCS.
Jim Fan @DrJimFan
325K Followers 3K Following NVIDIA Director of Robotics & Distinguished Scientist. Co-Lead of GEAR lab. Solving Physical AGI, one motor at a time. Stanford Ph.D. OpenAI's 1st intern.
Horace He @cHHillee
39K Followers 534 Following @thinkymachines Formerly @PyTorch "My learning style is Horace twitter threads" - @typedfemale
Scott Sunarto @smsunarto
25K Followers 4K Following founder/ceo @ArgusLabs_, (traumatized by) distributed systems, prev @Berkeley_EECS
sarv @SarvasvKulpati
10K Followers 2K Following Making computers fun again https://t.co/cUc86o7fBr CS+Cogsci @UCBerkeley YT: https://t.co/OR3L2OZJ8A
Phil Eaton @eatonphil
25K Followers 612 Following cheerleader, organizer, staff software engineer, databases
amir @amirbolous
4K Followers 1K Following
Sarah Catanzaro @sarahcat21
14K Followers 1K Following “All methods are sacred if they are internally necessary” (GP @amplifypartners, prev @canvasvc; Head of Data @Mattermark; @palantirtech; @c4ads)
Shreya Shankar @sh_reya
48K Followers 690 Following on the CS faculty job market | PhD @Berkeley_EECS, building https://t.co/PmuOqAYt6q | teaching https://t.co/CTWJ6z0JEg | formerly ML eng & undergrad @Stanford
Rasmus Andersson @rsms
82K Followers 3K Following Adventures in software & design. Founder of @playbit_, designer of Inter, @Figma, @Spotify. Eng & design @Facebook. (https://t.co/cS300CeZsH)
Shu @shuding_
47K Followers 2K Following @vercel. @v0, @nextjs, @aisdk, Satori, SWR. Don’t talk unless you can improve the silence.
Jay Hack @mathemagic1an
55K Followers 3K Following Building @codegen. Tweets about AI, computing and dev tools. Previously did startups, @palantir. Not a pseudonym.
vincent @vvhuang_
1K Followers 436 Following understanding models @TransluceAI, writing https://t.co/M7hdeAExFk previously: hotel manager @MIT, math @0xPARC
Karthik @gotta_hodl
17 Followers 842 Following
吴学桢 @wxuzhn261194
3 Followers 50 Following
Jadson G. Matos @JadsonGMatos1
18 Followers 307 Following
¥oungPanda @oungpanda
0 Followers 248 Following I am f**ked up by life. Hate social media so much but still enjoyed it without choice.
Bruh @Bruh46710315
2 Followers 296 Following
ThomAub @ThomAub
107 Followers 814 Following
Viz @reachmeviz
86 Followers 443 Following Ardent Developer, Technology Manager & Aspiring PhD Student. Spreading knowledge via explaining tech concepts in Tamil via @conceptsintamil building #pktai
JackL @PallasJack
10 Followers 274 Following
WeiCUI6 @Cui6Wei
35 Followers 746 Following Systems Software Engineer @NVIDIA. Prev @UofT @UCLA @KITE_UHN @Tesla @Samsung @Apple. Working on @NVIDIAGFN
Laith @laithaustin
31 Followers 137 Following grad ece student @ UT Austin | working on systems for ml
shailja bhandari @shailjaf1lms
44 Followers 753 Following prev: marcella AI via @mit hack, film nerd lost access to @shailjafilms @oyings1
Andrew Bempah @KrumDonDada
25 Followers 3K Following Proud Kotobabian by way of Chicago & Stanford University
デカ柴犬ふわと... @FuwaCocoOwnerKG
2K Followers 6K Following 🇯🇵 月の引力に引かれAIと共鳴する犬連れ忍者(AI Resonant NinJa) Mythic Visionary｜AIと直感の発想家 @tszzl @apples_jimmy @iruletheworldmo @patience_caveになぜフォローされているのかいまだにわからない。
AD @AD7032386246640
30 Followers 1K Following
Ben Zhang @un1c0rnioz
180 Followers 567 Following Student @uwaterloo. Curious about everything from unicorns to quantum computing.
Juanc @JoaqunMuoz79521
0 Followers 34 Following
Young @younqchan
326 Followers 5K Following Researcher working on Out-of-Distribution Generalizable Reasoning and AI Scientist from causality perspective.
Jinaaaaaa~ @jjjjjjjjjyeo
87 Followers 711 Following LP for Legacy | Web3 & Real Asset Investor ENS&HEC Paris PhD-Doctoral Research Residency, Capital Ethics, Comparative Philosophy & Socioeconomic Theory
Hossam Samir @Hossam94
267 Followers 3K Following Building Neural Networks for NLP and Robots of all shapes and sizes. he/him.
Yash Panchal @panchalhimself
1 Followers 28 Following
428_Kloud @xa_veeee
603 Followers 2K Following BSc Political Science ◇ MSc Sociology ◇ MSc Computer Science ◇ AWS Community Builder ◇ Researching Explainable AI.
Anurag @ak_8085
811 Followers 747 Following 👨🏻💻 Co-founder @productlogz @quotesmatic_ai ⌨️ CTO @rockethealthIN
Corelyse @corelyse_net
13K Followers 4K Following #corelyse #HODL #bitcoin #SHIBARMY Buy when there is blood on the streets.
kim @kim224061483679
2 Followers 337 Following
STRRL.gpt @strrlthedev
11K Followers 4K Following ❤️🔥 / cooking https://t.co/4b5vmdRuhE / Ask Me Anything https://t.co/zIa8BDoA0K
浮海一樂 Aether @AetherWu
5K Followers 3K Following 📚Read. 🖋Write. 🤔 Think. 👨💻 Code. 🏹 Archery. 🎮 Game. .
Zach Mueller @TheZachMueller
12K Followers 591 Following Let's make billions of parameters go brr https://t.co/rUxXIfNpwh
Robert Scoble @Scobleizer
538K Followers 17K Following The best from AI community | Ex-Microsoft, Rackspace, Fast Company | Wrote eight books about the future | Silicon Valley robots, holodecks, BCIs, and startups.
Brian Chew @bchewyme
560 Followers 7K Following infosys @sgSMU; @aws cloud captain; @perplexity_ai campus strategist; devops/cloud/ai lover
Manish @builtbymanish
10 Followers 65 Following Freelancing, building and trying my best to share what I am working on. @openpastpaper_
Jaesun Park @nuseaj
11 Followers 561 Following
E331 @E331_consoomer
31 Followers 224 Following Grüsst von dem Fliehenden!! MHRA approved chemical used for various applications like melting cheese and curing UTIs, also an experimental JR East trainset
AI PlanetX @AI_PlanetX
9K Followers 3K Following Master AI before it masters you. Best AI & tech Newsletter. Master AI in 9 minutes a week along with 27+ free AI resource.
Erik Bernhardsson @bernhardsson
46K Followers 3K Following Building @modal when I'm not posting banger stuff about infra and AI
Charlie Marsh @charliermarsh
28K Followers 829 Following Building @astral_sh: Ruff, uv, and other high-performance Python tools. Prev: Staff engineer @SpringDiscovery, @KhanAcademy, BSE @PrincetonCS.
typedfemale @typedfemale
38K Followers 533 Following a really exciting new account "advanced pytorch user" - @cHHillee alt: @typedalt
Horace He @cHHillee
39K Followers 534 Following @thinkymachines Formerly @PyTorch "My learning style is Horace twitter threads" - @typedfemale
Scott Sunarto @smsunarto
25K Followers 4K Following founder/ceo @ArgusLabs_, (traumatized by) distributed systems, prev @Berkeley_EECS
Phil Eaton @eatonphil
25K Followers 612 Following cheerleader, organizer, staff software engineer, databases
amir @amirbolous
4K Followers 1K Following
nanda @nandafyi
17K Followers 371 Following teaching svgs @ https://t.co/0dCAARwEbE | writing about computers and stuff @ https://t.co/CttP8HVN9k
Sarah Catanzaro @sarahcat21
14K Followers 1K Following “All methods are sacred if they are internally necessary” (GP @amplifypartners, prev @canvasvc; Head of Data @Mattermark; @palantirtech; @c4ads)
Shreya Shankar @sh_reya
48K Followers 690 Following on the CS faculty job market | PhD @Berkeley_EECS, building https://t.co/PmuOqAYt6q | teaching https://t.co/CTWJ6z0JEg | formerly ML eng & undergrad @Stanford
Rasmus Andersson @rsms
82K Followers 3K Following Adventures in software & design. Founder of @playbit_, designer of Inter, @Figma, @Spotify. Eng & design @Facebook. (https://t.co/cS300CeZsH)
Shu @shuding_
47K Followers 2K Following @vercel. @v0, @nextjs, @aisdk, Satori, SWR. Don’t talk unless you can improve the silence.
vincent @vvhuang_
1K Followers 436 Following understanding models @TransluceAI, writing https://t.co/M7hdeAExFk previously: hotel manager @MIT, math @0xPARC
Mitchell Hashimoto @mitchellh
141K Followers 139 Following Working on a new terminal: Ghostty. 👻 Prev: founded @HashiCorp. Created Vagrant, Terraform, Vault, and others. Vision Jet Pilot. 👨✈️
Christopher Larkin @composerlarkin
27K Followers 254 Following I write music and make sound for games and film. Projects include Hollow Knight, Pacman 256, Expand, Adventures of Figaro Pho and others.
Zach Mueller @TheZachMueller
12K Followers 591 Following Let's make billions of parameters go brr https://t.co/rUxXIfNpwh
Xenova @xenovacom
14K Followers 404 Following Bringing the power of machine learning to the web. Currently working on Transformers.js (@huggingface 🤗)
Ezzeri Esa @EzzeriEsa
274 Followers 583 Following math to finance to law to software. plus summer at culinary school. all views my own.
Jacob Austin @jacobaustin132
7K Followers 918 Following Research at @GoogleDeepMind. Currently making LLMs go fast. I also play piano and climb. NYC. Opinions my own
JosH100 @josh_wills
18K Followers 2K Following Engineering at @datologyai; @duckdb enthusiast, ex-@slackhq
Vijay Chidambaram @vijay_ut
222 Followers 578 Following Professor @utcompsci. Work on all things systems and storage. Lead @utsaslab. Prev: @WisconsinCS. Views my own.
Nat Dempkowski @natdempk
199 Followers 594 Following taking things too seriously/not seriously enough - working @sunomusic prev @HubSpot
John Schulman @johnschulman2
65K Followers 1K Following Recently started @thinkymachines. Interested in reinforcement learning, alignment, birds, jazz music
Sachit @Sparrownor1
98 Followers 257 Following every moment is a bruh moment | opinions my own | coreOS @ Apple | CMU '24
Tyler Zhu @tyleryzhu
1K Followers 1K Following PhD student @VisualAILab | SR @GoogleDeepMind | prev @berkeley_ai | @SFGiants @warriors guy | https://t.co/RJZA9D0osy
BennyKok @BennyKokMusic
4K Followers 951 Following Building toward Autonomous Creativity @comfydeploy
Ryo Lu @ryolu_
55K Followers 2K Following Head of Design @Cursor_ai. Early @NotionHQ, @Stripe, built startups. I make a world where anyone can make software. Aspiring k-pop idol.
Jonathan Chang @ChangJonathanC
1K Followers 866 Following ML/AI Engineer, building https://t.co/uEbfxzF7jm
nikiv.dev @nikitavoloboev
5K Followers 8K Following Make @1focus_ai @learnanything_ @gendotnew @gpton_ @solbond_ @gridchess @gitedit @kuskusapp as part of @anysynth_ team
carolyn zou @cqzou
533 Followers 421 Following cs phd student @stanfordhci + @stanfordnlp / human-ai interaction design
emily @emilyhanyf
280 Followers 412 Following @modal, ai/systems + design @stanford, co-director @hackwithtrees
the tiny corp @__tinygrad__
59K Followers 133 Following We make tinygrad and sell tinybox, the best perf/$ AI computer. $25k for 4x 5090 in a quiet box. Our mission is to commoditize the petaflop.
Sasha 🐑💨 Koss �... @kossnocorp
4K Followers 1K Following I make rad things. Many are open-sourced, like @date_fns. Some, like https://t.co/MfDSrNPLV2, are not. You're absolutely right!
Zohran Kwame Mamdani @ZohranKMamdani
615K Followers 981 Following Democratic Nominee for Mayor of NYC. Assemblymember. Running to freeze the rent, make buses fast + free, and deliver universal childcare. Democratic Socialist.
Evan You @youyuxi
292K Followers 2K Following Husband / Father of two / Founder @voidzerodev / Creator @vuejs & @vite_js. Chinese-only alt: @yuxiyou
Aditya Parameswaran @adityagp
5K Followers 708 Following associate prof @ucberkeley, co-director @ucbepic, cofounder @ponderdata (acq. @snowflakeDB) | on a mission to make data science effortless at scale | he/him
Anne Ouyang @anneouyang
6K Followers 881 Following CS PhD student @Stanford | prev: cuDNN @Nvidia, M.Eng, B.S. in CS @MIT | efficient scalable self-improving AI systems | 🌽KernelBench
Lilian Weng @lilianweng
163K Followers 166 Following Co-founder of Thinking Machines Lab @thinkymachines; Ex-VP, AI Safety & robotics, applied research @OpenAI; Author of Lil'Log
Barret Zoph @barret_zoph
21K Followers 1K Following CTO & Co-Founder Thinking Machines Lab (@thinkymachines) Past: - VP Research (Post-Training) @openai - Research Scientist at Google Brain
Johannes Schickling @schickling
11K Followers 661 Following Building a local-first music app @overtone_app with @livestoredev. Host @localfirstfm. DX @EffectTS_. Founded @prisma. https://t.co/74n8eMH4cs
Jinay @jinaycodes
2K Followers 322 Following building https://t.co/Nam6IEiyWE scholar @neo, prev HFT, @MaticRobots, @schoolhouse_edu
Modal @modal
19K Followers 123 Following Bring your own code, and run CPU, GPU, and data-intensive compute at scale. The serverless platform for AI and data teams.
batuhan the fal guy @isidentical
9K Followers 607 Following just a chill guy. @fal. fastest inference on multiple diffusion models. Python core developer / @thePSF fellow
Shreya Shekhar @_shreya_s
3K Followers 993 Following investing in AI, Cyber, Infra @GreylockVC | @bedrocksec @AbnormalSec @glean @RocksetCloud | @ucberkeleymet
Georgios Konstantopou... @gakonst
143K Followers 2K Following very greek accent. general partner & cto @paradigm. ceo @ithacaxyz. optimist and rustacean 🦀 // team lead of reth, foundry, alloy. join us.
mlajtos.mu @milanlajtos
183 Followers 408 Following rev-mode autodiff enjoyer & life-long entropy fighter • “Either do something very useful, or very beautiful.”
Simon Eskildsen @Sirupsen
11K Followers 800 Following co-founder & ceo @turbopuffer, former infra @Shopify 1k→1m RPS
David Bieber @Bieber
1K Followers 470 Following Helping Claude learn to program @AnthropicAI. Author of #PythonFire, the automatic CLI generation library.
Edward Z. Yang @ezyang
14K Followers 1K Following I work on PyTorch at Meta. Chatty alt at @difficultyang.
Yaron (Ron) Minsky @yminsky
15K Followers 333 Following Occasional OCaml programmer. Host of @signalsthreads. @[email protected] @yminsky.bsky.social https://t.co/kiUGRvWOO2
Simon Guo @simonguozirui
3K Followers 5K Following CS PhD student @Stanford | 🎓 @Berkeley_EECS | prev pre-training @cohere & built things at @ @anyscalecompute @nvidia
Trends for United States
You might like
