Edward Z. Yang @ezyang
I work on PyTorch at Meta. Chatty alt at @difficultyang. Mastodon @[email protected] blog.ezyang.com Edison, NJ Joined May 2008-
Tweets7K
-
Followers10K
-
Following973
-
Likes963
I wonder if naively written Rust code can be slower than naively written code in compiled GC'ed language, simply because a garbage collector beats out clone()'ing everywhere just to shut up the borrow checker
Had to give a talk to some CEOs. They knew way more about LLMs than me. Asked one of them how, he said "I check Chatbot Arena every morning" 😆 New OSGAI talk from Hao Zhang (@haozhangml ) on Chatbot Arena, seemingly the only eval anyone trusts. youtube.com/watch?v=7njmta…
The distinctive pleasure when some random experiment that you weren't sure was going to pan out is actually useful for something
Podcast drop: pytorch-dev-podcast.simplecast.com/episodes/torch… TORCH_TRACE and tlparse
Any effect system researchers on my feed? Penzai has an effect system but people are claiming it doesn't compose with grad. Doesn't the literature know how to compose effects with nontrivial control effects too?
Podcast drop: Higher order operators pytorch-dev-podcast.simplecast.com/episodes/highe…
As of today, what's the best Macbook model to buy for personal use, if cost is no object
Podcast drop: pytorch-dev-podcast.simplecast.com/episodes/induc… Inductor - Post-grad FX passes
this diff is like rearranging deck chairs on the titanic
Horace He @cHHillee
24K Followers 449 Following Working at the intersection of ML and Systems @ PyTorch "My learning style is Horace twitter threads" - @typedfemaleSoumith Chintala @soumithchintala
187K Followers 887 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.PyTorch @PyTorch
380K Followers 77 Following Tensors and neural networks in Python with strong hardware acceleration. PyTorch is an open source project at the Linux Foundation. #PyTorchFoundationTalia Ringer 🟣 �.. @TaliaRinger
26K Followers 6K Following Professor, @plfmse, @IllinoisCS! Proof Automation. @SigplanM & CCF Founder. Israeli-American for peace, equality, & justice. They/היא, ND, bi. די לכיבושSatnam Singh @satnam6502
14K Followers 3K Following Punjabi-Scottish-American Haskell hacker at @GroqInc, cook, cyclist, lost in music. ∃🇮🇳 ∧ ∀🇬🇧 ∧ ∃🇪🇺 ∧ ∀🇺🇸 #celiac ex-{Microsoft, Google, Facebook}Shriram Krishnamurthi.. @ShriramKMurthi
19K Followers 4K Following 🦣: @[email protected] ••• @BrownCSDept / @BrownUniversity || @BootstrapWorld || @PyretLang || @racketlang || compsci || education || cycling || crickettypedfemale @typedfemale
23K Followers 478 Following a really exciting new account "have you ever though you might be like scott alexander? very smart, but can't do math" - anonDelip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈Edward Kmett⏏️ @kmett
14K Followers 777 Following Founder/CTO of @Positron_AI Helping @ToposInstitute I tend to talk about Haskell, category theory, AI, and safety. https://t.co/wYaTDISbEB https://t.co/oP135HK8LMJeremy Howard @jeremyphoward
222K Followers 5K Following 🇦🇺 Co-founder: @AnswerDotAI & @FastDotAI ; Hon Professor: @UQSchoolITEE ; Digital Fellow: @StanfordRoss Wightman @wightmanr
18K Followers 1K Following Computer Vision @ 🤗. Ex head of Software, Firmware Engineering at a Canadian 🦄. Currently building ML, AI systems or investing in startups that do it better.Eric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0pTweag @tweagio
6K Followers 260 Following The Open Source Programming Office (OSPO) of @ModusCreate. Improving the craft of software engineering.deech @deech
5K Followers 1K FollowingMatt Parsons @mattoflambda
4K Followers 566 Following Haskell and SQL. Team Lead for Backend Developer UX at @mercury. I wrote @prodhaskell so you can get a Haskell job!Yaron (Ron) Minsky @yminsky
12K Followers 302 Following Occasional OCaml programmer. Host of @signalsthreads. @[email protected] https://t.co/kiUGRvWOO2Mark Saroufim @marksaroufim
9K Followers 656 Following @pytorch dev broadly interested in performance https://t.co/6KJ328JUwvTim Dettmers @Tim_Dettmers
29K Followers 823 Following PhD Student at @UW. I blog about deep learning and PhD life at https://t.co/Y78KDJJFE7.KC Sivaramakrishnan @kc_srk
4K Followers 3K Following CTO @tarides_. Profing @iitmadras. Trustee https://t.co/WE1No5QqOA.zffl @zffl
14 Followers 391 FollowingWeihua Hu @weihua916
6K Followers 1K Following Graphs. Deep Learning. Currently at https://t.co/O6xlgZ1LWi. Previously CS Ph.D. @Stanford RS Intern @Meta @GoogleDeepMind BS/MS University of Tokyo.Nicholas Liskij @nliskij
16 Followers 765 FollowingAntoine Allioux @AntoineAllioux
108 Followers 2K FollowingJordan McQueen @jmq_en
129 Followers 604 Following SWE, Toyota Research Institute (Tokyo). Prior: aws, google「x」, stripe. (?:distributed)? systems, performance, scaling, security. 日本。https://t.co/yow8fE6VUQ 🦀🎱Luis Pedro Coelho🌻.. @luispedrocoelho
4K Followers 3K Following group leader at @CMR_QUT science. microbiome. content creator for Elsevier, NPG and others!Hao Zhang @haozhangml
3K Followers 269 Following Asst. Prof. @HDSIUCSD and @ucsd_cse running @haoailab. Cofounder and runs @lmsysorg. 20% with @SnowflakeDBShiva @skhannayamamoto
100 Followers 2K FollowingDhruvil Lathiya @dhruvil_lathiya
33 Followers 370 FollowingGianni Crivello @gkteco
9 Followers 39 Followingmike017 @crypto_mike017
762 Followers 5K Following Me all in Crypto $KISHU 🐶 $ETH 🪙 Stock $TSLA 🚘 $MSFT 💻 NFT #ApeKidsClub 🐵 #KittyCryptoGang 😼Zhiyong Wang @Zhiyong16403503
423 Followers 3K Following Visiting Ph.D. student at Cornell University. Ph.D. candidate at CUHK. Working on bandits and reinforcement learning theory.ANUBHAV CHATURVEDI @anubhavchaturvd
267 Followers 4K Followingliuyong @forrestbing
281 Followers 5K Following I am a researcher in AIGC, Multi-modality and VitrualHuman tech directionEthan Alvarée @EthanAlvaree
567 Followers 4K Following Teacher and author (mathematics, logic, & set theory). Tech enthusiast. Vegan 🌱 #iteachmath #MTBoS #BlackLivesMatter #TransRightsAreHumanRights (they/them) 🌈Senthilkumar Gopal @sengopal
226 Followers 137 Following ❤️ to code and solve new problems everyday @awscloud. AI/ML Acceleration using Trainium & Inferentia / NeuronSDK. @GeorgiaTech. Opinions only my own.Zack Eisbach @zackbach_
20 Followers 151 Following CS+Math @Northeastern | Undergraduate programming languages researcher | he/himJohn Shin @jshinister
23 Followers 270 Following Computer Scientist at SRI International. I enjoy trying to understand DL through simple principles. Views are my own.Rohan Paul @rohanpaul_ai
13K Followers 1K Following ML Engineer (e/acc) 📌 https://t.co/x0IIWfnOt8 🚀 https://t.co/QEO4CKRl1b Open LLMs is Happiness 💡 Ex Deutsche & HSBC. DM for collaboration.Philippe Tremblay @philtrem22
231 Followers 599 Following Self-taught programmer, musician, and polyglot. AI enthusiast. Proud father.Yiğit Yalın @yigityalin02
9 Followers 570 Followingmp @mp69840344
2 Followers 36 FollowingJeff Wu @WuTheFWasThat
257 Followers 245 FollowingRuslan Shevchenko @rssh1
782 Followers 910 Following github: https://t.co/LcOh2UgLzO columsn on dou: https://t.co/HWcu7MGR5u… blog: https://t.co/YqobW9Fn2dben guo @vprtwn
683 Followers 2K Following co-founder @SubstrateLabs ꩜ https://t.co/QGGieCbrvA prev: @southpkcommons, 8 yrs @stripe, @venmo, @harvardManish Shetty @slimshetty_
810 Followers 590 Following PhD student @ucberkeley @berkeleysky :: prev @msftresearch :: programming languages :: ml systems :: program analysis in the age of LLMsInstanton @1nstanton
55 Followers 598 FollowingK @bladerunner2109
28 Followers 524 Followinglove @lovelenssegment
91 Followers 337 Following trepostomatous consecrated duplicable protistology redmouth guna mysterize subelementary magnifice Yankeedom Skupshtina dispassioned hastener pinnal declinedValthor @vlthr
116 Followers 834 FollowingSunyan Lee @sunyanlee
47 Followers 1K FollowingSrinivas Reddy (త�.. @Srini8085
132 Followers 3K Following తెలుగు, freelance full stack engineer, Python, Javascript, Typescript, Rust . freelancing since a decade when it was not in vogue . Open for freelancing , DMNguyen Huynh Huy @huyhcmut1997
42 Followers 1K Followingambroslins @ambroslins
10 Followers 151 FollowingShawn Zhong @ShawnZhong_
29 Followers 176 FollowingAbdulrahman Tabaza @embed_dim
4 Followers 870 Following enjoyer of various vector spaces, encoders and modalitiesChengHau Chen @zzzingchen
6 Followers 34 FollowingSebastián Uría @SebastinUra1
99 Followers 585 FollowingDavide @DavideTortoise
11 Followers 101 FollowingPensé FFun @inftyCategory
93 Followers 6K FollowingHorace He @cHHillee
24K Followers 449 Following Working at the intersection of ML and Systems @ PyTorch "My learning style is Horace twitter threads" - @typedfemaleSoumith Chintala @soumithchintala
187K Followers 887 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.PyTorch @PyTorch
380K Followers 77 Following Tensors and neural networks in Python with strong hardware acceleration. PyTorch is an open source project at the Linux Foundation. #PyTorchFoundationTalia Ringer 🟣 �.. @TaliaRinger
26K Followers 6K Following Professor, @plfmse, @IllinoisCS! Proof Automation. @SigplanM & CCF Founder. Israeli-American for peace, equality, & justice. They/היא, ND, bi. די לכיבושSatnam Singh @satnam6502
14K Followers 3K Following Punjabi-Scottish-American Haskell hacker at @GroqInc, cook, cyclist, lost in music. ∃🇮🇳 ∧ ∀🇬🇧 ∧ ∃🇪🇺 ∧ ∀🇺🇸 #celiac ex-{Microsoft, Google, Facebook}Alfredo Canziani @alfcnz
86K Followers 268 Following Musician, math lover, cook, dancer, 🏳️🌈, and an ass prof of Computer Science at New York UniversityShriram Krishnamurthi.. @ShriramKMurthi
19K Followers 4K Following 🦣: @[email protected] ••• @BrownCSDept / @BrownUniversity || @BootstrapWorld || @PyretLang || @racketlang || compsci || education || cycling || cricketLucas Beyer (bl16) @giffmana
56K Followers 447 Following Researcher (Google DeepMind/Brain in Zürich, ex-RWTH Aachen), Gamer, Hacker, Belgian. Mostly gave up trying mastodon as [email protected]typedfemale @typedfemale
23K Followers 478 Following a really exciting new account "have you ever though you might be like scott alexander? very smart, but can't do math" - anonDelip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈Edward Kmett⏏️ @kmett
14K Followers 777 Following Founder/CTO of @Positron_AI Helping @ToposInstitute I tend to talk about Haskell, category theory, AI, and safety. https://t.co/wYaTDISbEB https://t.co/oP135HK8LMJeremy Howard @jeremyphoward
222K Followers 5K Following 🇦🇺 Co-founder: @AnswerDotAI & @FastDotAI ; Hon Professor: @UQSchoolITEE ; Digital Fellow: @StanfordRoss Wightman @wightmanr
18K Followers 1K Following Computer Vision @ 🤗. Ex head of Software, Firmware Engineering at a Canadian 🦄. Currently building ML, AI systems or investing in startups that do it better.Eric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0pErik Meijer @headinthebox
27K Followers 0 FollowingTweag @tweagio
6K Followers 260 Following The Open Source Programming Office (OSPO) of @ModusCreate. Improving the craft of software engineering.Sasha Rush @srush_nlp
52K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGzFrançois Fleuret @francoisfleuret
31K Followers 460 Following Prof. @Unige_en, Adjunct Prof. @EPFL_en, Research Fellow @idiap_ch, co-founder @nc_shape. AI and machine learning since 1994. I like reality.deech @deech
5K Followers 1K FollowingDaniel Han @danielhanchen
7K Followers 942 Following Building @UnslothAI. Finetune LLMs 30x faster https://t.co/aRyAAgKOR7. Prev ML at NVIDIA. Hyperlearn used by NASA. I like maths, making code go fastPeng Cheng, asking λ.. @tribbloid
191 Followers 252 Following doubling down on Scala ♨️ and Apache Spark 🌟 for ML ∇, provers ∀ & swarms 🐝. maintainer of shapesafe, spookystuff and splain pluginMoe Shop @korewamoe
76K Followers 648 Following france-born, tokyo-developed trackmaker & creative (they/them) INT → lachlan(@)https://t.co/gmPUSjLzGk | 日本 → tamamura(@)https://t.co/M3Jd5xV5tZAisu Asai🍦🍫 Ice.. @AisuAsai
9K Followers 720 Following Fast food vtuber and Graphic Designer, any pronouns, 18 Art tag: #ArtsuAsai Pfp: @cheshirette Art: @ikaumira1410 Rig: @Birctreel [email protected] 🪳🤍PEAR哥🇭🇰 @Peargor
383K Followers 439 Following 啤梨哥 but just call me Pear. Impatient GRADUATED 2D animator from 🇭🇰 Alt: @pearsketch_ Contact: [email protected] -Not taking commissions or sponsorsderek guy @dieworkwear
853K Followers 963 Following Menswear writer. Editor at @putthison. Creator of @RLGoesHard. Bylines at The New York Times, The Washington Post, The Financial Times, Esquire, and Mr. Porterlocalthunk @LocalThunk
24K Followers 44 Following Developer and Artist for @BalatroGame, Business and Media Inquiries: [email protected]Supper Mario Broth @MarioBrothBlog
252K Followers 1 Following Additional obscure Mario content for https://t.co/dnoCmFYG8N. Now on Patreon: https://t.co/mgIlC7Z17tDare Obasanjo🐀 @Carnage4Life
150K Followers 1K Following Opinions about product management, technology news and inclusivity in tech. Diversity is about demographics, inclusion is about creating a sense of belonging.Michael Greenberg @mgrnbrg
1K Followers 168 FollowingSharad Vikram @sharadvikram
1K Followers 510 Following Researcher @ Google Deepmind. I work on JAX + Pallas (https://t.co/lPMsq3yzgL) and Gemini. In the past I worked on Oryx and TFP. I like learning.Chris Lattner @clattner_llvm
79K Followers 182 Following Building beautiful things like Mojo🔥 and MAX @Modular, lifting the world of production AI/ML software into a new phase of innovation. We’re hiring! 🚀🧠Behind The Scenes Pic.. @Behind_Pics
522K Followers 6 Following Weird, meme-y images of entertainment in the making | DM submissionsArtButMakeItSports @ArtButSports
455K Followers 230 Following I turn Art into Sports (and vice versa) | NO AI USED | “Everything I didn't know I needed" - follower testimonial | See inspiration? DM/tag usArya Mazumdar @MountainOfMoon
3K Followers 319 Following Professor @UCSanDiego Dy. Director+AD for Research NSF AI Inst https://t.co/wblPm6DhUX, UCSD Site Lead @encoreinstitut Information Theory, Coding Th., Machine LearningKaban 🍬 @KabanBang
8K Followers 111 Following They/Them. Co-creator of @BrujaVaquero & @onlyamask. Layout artist for @AgeofArcadia. Personal acc: @kaban_bang ⚠️ Do not repost my art without permission.⚠️julien verlaguet @JulienVerlaguet
84 Followers 66 FollowingTemJapan @japan_tem
32K Followers 70 Following はじめまして, テミーです! 日本語を学びたいです。私のしゅみはえをかくことです。よろしくお願いします! corrections are welcome and appreciated 🐱 Japanese Learning + Side Acct (more side-acct these days)Brian Hirsh @brian_hirsh
85 Followers 185 Following Currently working on PyTorch https://t.co/5FDbM1hjNEAart Bik @AartBik
1K Followers 799 Following 🇳🇱🇺🇲 Dutch-American computer scientist Utrecht (MSc), Leiden (PhD) @Google @Intel #MLIR #LLVM #astronomy #chess #compilers #simd #sparse #vectorizationWill Williams @wjwwilliams
158 Followers 489 Following CTO at Speechmatics | Machine Learning | Scaling Neural NetsDan Zhang @DZhang50
2K Followers 781 Following Researcher @ Google DeepMind | ML for Systems | Systems for ML | Computer Architecture PhD @ UT Austin🤘 | Opinions stated here are my own.Nicolas Wu @nicolasgwu
502 Followers 123 Following Reader in Computer Science at Imperial College LondonVolodymyr Kyrylov @darkproger
2K Followers 2K Following AI student at USI/ETH. Donate https://t.co/GDSkWG2takmain @main_horse
8K Followers 478 Following AGI Believer. Haven't applied @OpenAI. Likes are not always endorsement.IndigoBlooper @IndigoBlooper
320 Followers 436 Following Queer 31yo furry #PNGTuber what goes Bloop Don't follow if under 18. Likes/RTs sometimes NSFW // FFXIV @MaraMyrienFFXIV Twitch https://t.co/MvnRg9zF9EJacob Gold @jacob__gold
316 Followers 1K Following Engineer @withgraphite - learning how git works to make your life easier - come hang out with me at https://t.co/trJa3kCz3XHIROTONFA @hirotonfa
74K Followers 1K Following I draw military waifus. Creator of Blu Rivers & HOT. I also work for Peripeteia, @starspanner_rpg, and Eastern Flower! Wife❤️: @magnagallinaAlexandra Silva @alexandra8silva
2K Followers 851 Following Computer scientist, loves traveling and food tasting!Ben Delaware @GhostofBendy
978 Followers 310 Following Professor at @PurdueCS; dad; occasional cancer fighter🎗️. Tweets about programming languages and formal methods, but mostly bird pictures.bilal2vec @bilaltwovec
2K Followers 784 Following ✨ research engineer • prev @googlebrain @cohere @dbrxmosaicai • se @uwaterloo⇣ @HamsterFragment
281K Followers 0 Followingゐたみ / itami @itami_gomi
48K Followers 245 Following お絵かきとCGと映像 作った本とか→https://t.co/myjMHZhs47 連絡:[email protected]RachelFC @rachelfc_art
10K Followers 448 Following Artist ~ Multifandom || CREDIT when using MY ART!! Currently into: Anime + BOTW/TOTKSarah Andersen @SarahCAndersen
936K Followers 2K Following Author of Sarah's Scribbles, FANGS, and Cryptid Club she/her No NFTs 🚫 Inquiries: [email protected]Rich S @RichS_art
32K Followers 3K Following Storyboard Artist at Titmouse! Previously at WB (My Adventures with Superman), Titmouse (Legend of Vox Machina). Business email: [email protected]Loris D'Antoni @lorisdanto
6K Followers 731 Following Professor @WisconsinCS, this summer moving to @ucsd_cse. Also Visiting Academic @AWScloud. Helps people write programs that do the thing people want them to do.Joe Cutler @alpha_convert
3K Followers 2K Following PL PhD student at @Penn CIS and @NSF GRFP fellow. Types, Verification, and Testing. @PhillyRunnerTC. Formerly @wesleyan_u (go Wes)Jonathan Aldrich is K.. @JAldrichPL
4K Followers 1K Following Professor of Programming Languages and Software Engineering at CMU. ACM Publications Board. CTO of Noteful (https://t.co/sNSJTo6uHj). He/him. Views are mine.Jiakai Liu @liujiakai
519 Followers 277 FollowingIan Henry @ianthehenry
2K Followers 123 Following i work at the intersection of set theory and figurative language https://t.co/WSQ2eFs6ke | https://t.co/w8jt5jGKz8 | https://t.co/BvoxU5tqbE | https://t.co/Olub8MfqtZLaurens van der Maate.. @lvdmaaten
667 Followers 1K Following Distinguished Research Scientist at Meta AI. t-SNE. DenseNet. Web-scale weakly supervised vision. CrypTen. Currently herding Llamas.Celeste @celeste_game
163K Followers 15 Following Follow here and @exok_games for the latest announcements! 🍓✨Kiana Mai 🌹 @kianamaiart
560K Followers 4K Following 26 y/o | Director @ Disney Television Animation | Story Artist/Character Designer | Pixar@CCA Story Intensive '17 | 🇯🇵🇯🇲 | 🏳️🌈 | she/her 💕Yangqing Jia @jiayq
12K Followers 263 Following Founder @leptonai. @UCBerkeley alumni. ex @google & @facebook. ex vp @AlibabaGroup. Open source work on caffe, @pytorch, @tensorflow, & @onnxai.@ezyang @haozhangml Yes, QA was interesting, but bad mic. There was significant conversation about the incentives for participants and whether there should be voting history. LMSys kind of felt more response is better, whereas other wanted expertise. Secondary conversation about this being…
@TobyBartels0 @EthanAlvaree @imperialauditor @jessi_cata @ezyang I might be one of the only people in the world who uses both logitext and pytorch but uses logitext more frequently
@ezyang in-context unlearning should be a thing
Saw "Merrily We Roll Along". This is a masterful production of an unsung Sondheim show which flopped badly in its original run. One of the best Broadway shows I've ever seen. merrilyonbroadway.com
if you want to robustly jailbreak claude w/o using any cursed methods, here's my basic advice. + helps to have substance/intent aside from dismantling restrictions; dont treat that as the only valuable/interesting outcome & don't ignore all that seems irrelevant to it. be present
@ezyang time to upgrade to m3 max. has 2 video encoder/decoder vs pro only has 1.
@ezyang @tomgilray the flavor of how analysis is done, the fact that you mainly can get a way with doing a simple pass across your trace, etc. the fact that essentially all optimizations become (super-)local ones...
@ezyang @tomgilray yeah, in classical compiler terminology I agree with "path sensitivity". but in the end I found that it's quite hard to communicate what makes the tracing point of view different from most of the rest of compilers.
@ezyang @0xalpharush This type of condition is common and annoying to deal with dataflow optimization (e.g. in a Datalog engine), because the elimination of the data dependency ends up introducing an implicit control dependency.
@ezyang If A reaches B in a DAG then A < B in all topo sorts. Do a topo sort and refuse to enqueue A until you have to.
@ezyang I really really like this podcast. I'm still listening to old episodes, and it's just WOW! Thank you very much for this contribution
@ezyang I have tons of notes on keep. In general, it crashes the first time I open it. So I prefer to use markdown for them, with real connections between them (obsidian, foam, etc) and then use keep only to jot down notes while walking/hiking and then moving them to the other system
@ezyang Chants of Sennaar. Fun puzzles based around deciphering foreign language.