Sid @sid_srk
create things now: https://t.co/5VlY4Tnrho before: diffusion acceleration @runwayml pretraining and distributed training @cohere siddhartharao.com Toronto, Ontario Joined June 2010-
Tweets1K
-
Followers2K
-
Following678
-
Likes18K
Someone recently told me an early investor passed on Runway because we didn’t go to stanford or have phds (we went to art school at nyu) and decided instead to invest in a competitor with phd people that were friends of friends. Made me realize that building a good company…
got to catch this session in TORONTO. such a good course by sid, so good for the city
got to catch this session in TORONTO. such a good course by sid, so good for the city
Lecture 2 on Tokenizers by @sid_srk at @newsystems_ Starting from character representations to Byte Pair encoding, modeling reality from the ground up. Maybe, tokenizers are the hidden magic behind it all. The first jump from the real world!
TSFM has been challenging & fun! Led by @sid_srk, we explored tokens today. Neat find: GPT-4o counts "Toronto" as one token! 🌟
todays at @newsystems_ for Toronto School of Foundational Modeling, the folkenem be learning about tokenizers from first principles, and UTF-8. this weekend I will be streaming training BPE from scratch, target to do 1B tokens. s/o @sid_srk @caseploeg
Great foundation models start with great data + infrastructure. Both are table stakes, yet rarely talked about. Thrilled to have two incredibly talented speakers from Runway joining us to share their expertise on this (arguably the most important) topic!
Great foundation models start with great data + infrastructure. Both are table stakes, yet rarely talked about. Thrilled to have two incredibly talented speakers from Runway joining us to share their expertise on this (arguably the most important) topic!
Tokenization and all its troubles on Thursday at TSFM
- The owner at Golden Turtle stopped me on my way out yesterday, gifted me a mug and said “Thanks for being such a good customer” - Pictured, I got exactly what I ordered from Saffron spice but they wrote me a note saying they didn’t have my usual on the menu that day - The whole…
Toronto School of Foundational Modelling: Lecture 1 at New Stadium
The "slides" were made using my fav software: @KinopioClub
The "slides" were made using my fav software: @KinopioClub https://t.co/AnMVn1BeGw
A few visualizations from TSFM: Lecture 1
First poster for the IMAX re-release for ‘BACK TO THE FUTURE’ for the film’s 40th anniversary. In theaters on October 31.
attended the first tsfm lecture yesterday. really liked Sid’s approach of focusing on developing intuition instead of just going straight into the math
Thank you to everyone who showed up to the first lecture of TSFM. So excited to be on this journey with all of you! Will refine the format over the series based on your feedback and make it good :))) See you next Thursday
First class of the Foundational Model course at New Stadium was so cool! @newsystems_
tonight begins a school of foundation modelling. 60 students have been tasked with implementing gradient descent as their first assignment. really interested to see how this will progress. anyone who goes _all in_ on this will get so much value out of it.
For people asking about season 2, I want to make it happen

Sara Hooker @sarahookr
49K Followers 9K Following I lead @Cohere_Labs. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, ML reliability. Changing spaces where breakthroughs happen.
Rosanne Liu @savvyRL
46K Followers 1K Following (On mat leave.) Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS.
joanna @_joanna_yoo
1K Followers 591 Following applied ML @isomorphiclabs 🧬 prev. LLM scaling at @cohereAI 🇰🇷 🇨🇦 🇬🇧
Edward Grefenstette @egrefen
42K Followers 865 Following FR/US/GB AI/ML Person, Director of Research at @GoogleDeepMind, Honorary Professor at @UCL_DARK, @ELLISforEurope Fellow. All posts are personal.
Jim Fan @DrJimFan
325K Followers 3K Following NVIDIA Director of Robotics & Distinguished Scientist. Co-Lead of GEAR lab. Solving Physical AGI, one motor at a time. Stanford Ph.D. OpenAI's 1st intern.
Cohere Labs @Cohere_Labs
24K Followers 249 Following @Cohere's research lab and open science initiative that seeks to solve complex machine learning problems. Join us in exploring the unknown, together.
Jay Alammar @JayAlammar
46K Followers 1K Following Writer https://t.co/TquuQXlLOJ. O'Reilly Author https://t.co/Fl3uPAZHLg. LLM Builder @Cohere. Visualizing AI one concept at a time.
bilal @bilaltwovec
3K Followers 834 Following ✨ ai for science. tortured attention layers department
Miles Brundage @Miles_Brundage
61K Followers 12K Following AI policy researcher, wife guy in training, fan of cute animals and sci-fi, Substack writer, stealth-ish non-profit co-founder
Nathan Benaich @nathanbenaich
61K Followers 34K Following solo member of investment staff @airstreet @airstreetpress @stateofaireport @raais
Dan Roy @roydanroy
57K Followers 2K Following ML / AI researcher. Research Director and Canada CIFAR AI Chair, @VectorInst. Professor, @UofT (Statistics/CS).
kipply @kipperrii
9K Followers 971 Following "uncanny ability to be mentioned in every slack thread about code that's mysteriously breaking" - claude | alt @kipperriiii
rohan anil @_arohan_
25K Followers 2K Following
Rozhina Ghanavi @_ghnn_
3K Followers 401 Following PhD @mit & @mitsloan. IO, marketing, econ of tech, privacy, health, education. alum: @UofT @VectorInst @rotmanschool . 🇨🇦
Winnie Xu @winniethexu
2K Followers 544 Following making gemini think better @GoogleDeepmind, hopefully at scale (: bsc cs @UofT.
Batman @The_Batman_77
8 Followers 102 Following
Docal @Docal5215
135 Followers 3K Following
Jing Guo @guojing0
103 Followers 1K Following *Looking for PhD and jobs!* MSc in Math from Regensburg; BSc in Math and CS minor from Utah AI/ML/DL & Extremal combinatorics and theoretical computer science
Evidence-art.stx @Evidence474700
35 Followers 191 Following photographer Editor Web3 Developer NFT Artist DeFi Enthusiast
Ragavan Thurairatnam @RagavanThurair
148 Followers 200 Following Biological Boot Loader for Digital Super Intelligence @dessa, lecturer @UofT. Deep Learning since 2012
Jai @jai_mansukhanii
2K Followers 1K Following building cool interfaces @opensesame_dev / a16z @speedrun 005
샤오메이 @Ywarwee7205276
8 Followers 356 Following Focused on investing in U.S. stocks, happy to discuss stock market trends.
Xofeab @Xofeab41824
18 Followers 1K Following
DJ Iwannadoya @boomdotcom
183 Followers 1K Following
Billy Nicole @BillyVarga56848
505 Followers 3K Following
Sachi Sisodia @sahikshu
13 Followers 108 Following
Robert Mill @robert_vmill
34 Followers 76 Following AI solutions & gtm @ KPMG Founder of MakersLounge AI Prompt Library: https://t.co/oSyUWlY4Bo
alvvin @alvanliii
354 Followers 2K Following this account is for shitposting, follow my other acc @alvanlii for technical content, uwaterloo
Rashik Shahjahan @RashikShahjahan
52 Followers 107 Following Building and writing at https://t.co/ZSRMsAjn6C
aamna @aamnad3
117 Followers 242 Following figuring out what’s possible ✶ math @McMasterU | scholar @cansbridgeproj | @McMaster_MI
Josh Gonsalves @joshgonsalves_
2K Followers 2K Following CTRL+SHIFT @ctrlshift_ai // Building AI tools for the future of work & life. // Creating next-level video for brands (https://t.co/JcE5X044I5)
irfan sharif @irfansharifm
418 Followers 201 Following
m a i s h a ⁂ @maiphobe
589 Followers 1K Following 😎shenaniganmaxxing @socraticainfo || building @pex_labs @prismcollectiv_|| @uwaterloo
SFW3B @SFW3B
118 Followers 1K Following https://t.co/OYsVVHAycT | https://t.co/v7l65akTcn | https://t.co/eBrBPFsqV4
Sayan Chakraborty @shockrobortyy
295 Followers 2K Following ML (prev: @Qualcomm @BrownUniversity, @paytm, @clarisights)
!.! @xypyth
49 Followers 4K Following
Omair Shahid @OmairShahid
633 Followers 3K Following Product of progressive public policy; raised by public libraries and public education that produced a passion for politics. and apparently alliteration
Lucas Wang @GeneralBeluga
5 Followers 36 Following
Besher @mr_besher
34 Followers 525 Following
Zach Mueller @TheZachMueller
12K Followers 591 Following Let's make billions of parameters go brr https://t.co/rUxXIfNpwh
Distributed State @DistStateAndMe
3K Followers 2K Following cult leader/ exit liquidity at https://t.co/rH6EoYy4aK / basilica/ grail || Summoner of Divine Computation || Bittensor Maxi
Eltragdors @eltragdors
127 Followers 5K Following
DANU YELLOW @DanuYellow
23 Followers 359 Following
A R @arav1c
188 Followers 683 Following
. @photonradia
0 Followers 119 Following
Brendan Duke @brendanwduke
6 Followers 64 Following
♔ A @msamiie
312 Followers 261 Following
Wayne @waynedsouza
272 Followers 213 Following
Omar Nusrat @OmarNusrat
939 Followers 4K Following phd candidate @torontomet medical physics • prev @openai @ontariotech_u • co-chair @comptrainees
Vishav 🏴☠️ @VishaveCom
121 Followers 800 Following building on the internet... developer, designer, founder, creator, writer
Sara Hooker @sarahookr
49K Followers 9K Following I lead @Cohere_Labs. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, ML reliability. Changing spaces where breakthroughs happen.
Andrej Karpathy @karpathy
1.4M Followers 1K Following Building @EurekaLabsAI. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets.
cohere @cohere
108K Followers 4 Following Cohere builds secure, scalable, and private enterprise-grade AI solutions for real-world business problems. Join us: https://t.co/Yb2xItMObl
Rosanne Liu @savvyRL
46K Followers 1K Following (On mat leave.) Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS.
Yann LeCun @ylecun
948K Followers 764 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
AK @_akhaliq
425K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo ,submit papers here: https://t.co/UzmYN5YmrQ
joanna @_joanna_yoo
1K Followers 591 Following applied ML @isomorphiclabs 🧬 prev. LLM scaling at @cohereAI 🇰🇷 🇨🇦 🇬🇧
Edward Grefenstette @egrefen
42K Followers 865 Following FR/US/GB AI/ML Person, Director of Research at @GoogleDeepMind, Honorary Professor at @UCL_DARK, @ELLISforEurope Fellow. All posts are personal.
Jim Fan @DrJimFan
325K Followers 3K Following NVIDIA Director of Robotics & Distinguished Scientist. Co-Lead of GEAR lab. Solving Physical AGI, one motor at a time. Stanford Ph.D. OpenAI's 1st intern.
François Chollet @fchollet
572K Followers 813 Following Co-founder @ndea. Co-founder @arcprize. Creator of Keras and ARC-AGI. Author of 'Deep Learning with Python'.
Cohere Labs @Cohere_Labs
24K Followers 249 Following @Cohere's research lab and open science initiative that seeks to solve complex machine learning problems. Join us in exploring the unknown, together.
Jay Alammar @JayAlammar
46K Followers 1K Following Writer https://t.co/TquuQXlLOJ. O'Reilly Author https://t.co/Fl3uPAZHLg. LLM Builder @Cohere. Visualizing AI one concept at a time.
bilal @bilaltwovec
3K Followers 834 Following ✨ ai for science. tortured attention layers department
Brandon Chu @BrandonMChu
20K Followers 975 Following TBD next thing. Dad of two boys in Toronto 🇨🇦. Ex @shopify. Wrote https://t.co/WNIeUdS87E a long time ago.
Xander Chin @XanderChin
1K Followers 399 Following eng @westernu @schulichleaders | building and learning for fun
Pascal Thibeault @pascalthibeault
1K Followers 7K Following Tinkering with LLMs. Prev. Law @Medtronic & @thefertpartners | Writing: https://t.co/WNQB0NfBtf
Honnesh Rohmetra @create_compute
223 Followers 2K Following Following Curiosity, and exploring different dimensions of being a human. Run, Create, and Compute. AI Research Engineer. Ever Enchanted!
DG. @dataghees
1K Followers 6K Following scaling speech native LLMs @rimelabs the future is willed into existence. bioML, discovering new science, housing, industrial policy, local politics.
Zach Mueller @TheZachMueller
12K Followers 591 Following Let's make billions of parameters go brr https://t.co/rUxXIfNpwh
Tri Dao @tri_dao
32K Followers 632 Following Asst. Prof @PrincetonCS, Chief Scientist @togethercompute. Machine learning & systems.
♔ A @msamiie
312 Followers 261 Following
cloud @cloud11665
11K Followers 2K Following SIMD enjoyer, tensor rotator, LLM inference optimizoor | Technical Staff @ https://t.co/gQXVxhjcOm
Patrick Hsu @pdhsu
45K Followers 3K Following co-founder @ArcInstitute, @BerkeleyBioE professor | researcher & investor in genome editing, biotech, AI | 🇨🇦 @harvard @broadinstitute @editasmed, Fast Grants
Suhas Pai @piesauce
1K Followers 972 Following Co-founder/CTO @HudsonLabs. Author of an O'Reilly book on LLMs. Tweets about machine learning, #NLProc, Toronto, election predictions, public transit.
Alex Zhang @a1zhang
13K Followers 586 Following phd student @MIT_CSAIL + @SakanaAILabs, ugrad @Princeton, 🫵🏻 go participate in the @GPU_MODE kernel competitions!
Joelle Pineau @jpineau1
14K Followers 441 Following Chief AI Officer, @cohere Professor of Computer Science, @mcgillu Core academic member, @Mila_Quebec Ex-Meta (FAIR team)
clo @clo_wang
896 Followers 536 Following i love art + design • also host ⁂ @atelier_place • also prev @withdaydreamco • also biochem + forensic sci @UBC
rajan agarwal @_rajanagarwal
5K Followers 1K Following RL @amazonscience, se @uwaterloo, scholar @neo, prev @trykino @hitachi
The Other Stuff Podca... @OtherStuffPod
136 Followers 2 Following Conversations that explore the development of the modern world and different sides of interesting people. Hosted by @internetVin
Janice @j6kwan
125 Followers 623 Following I play real life Monopoly 🏡, improve company operations 📈, chase oreos on ice 🏒, train Muay Thai 🥊, & globetrot with my backpack 🌎#multipotentialite #cpa
Kevin Devereux @kevin_devereux
596 Followers 501 Following Assistant Professor in the Department of Economics at the Chinese University of Hong Kong. Find my research at https://t.co/7CpPJUZmCi
Maxwell Marler @MaxwellMarler
52 Followers 216 Following
Yacine Mahdid @yacinelearning
12K Followers 736 Following (neuro/ai) I make technical deep learning tutorials 👺
Cairox100v @cairox100v
162 Followers 159 Following
tobi lutke @tobi
416K Followers 2K Following @Shopify CEO by day, Dad in evening, hacker at night. Aspiring comprehensivist. (tweets auto delete eventually) retweet=noteworthy share, not endorsement
Jacob Klug @Jacobsklug
16K Followers 748 Following Co-founder @ https://t.co/qvqQeSj3My. Building software with AI.
CTRL + SHIFT @ctrlshift_ai
192 Followers 3 Following a signal for the next wave of creative intelligence // Come to a meetup https://t.co/URhuwTgf9H
Bram Sugarman @bram
3K Followers 505 Following Building. Investing. TBD. prev: VP @Shopify, VC @OMERSVentures, SE @EA
Arc Institute @arcinstitute
37K Followers 57 Following A new scientific institution for curiosity-driven biomedical science and technology.
Atal Agarwal 💜🚐... @atalovesyou
13K Followers 2K Following Immigrants Angel 👼 @OpenSphereAI, @ModelsMafiaLabs, @agihouseindia, @LegalBridgeAI, @Colive_planet, IRONMAN 140.6, living off-grid in van 🚐
tani @tanishqxyz
4K Followers 1K Following Design engineer | Designer @farcaster_xyz | Ex Design Lead at ▲ @Alchemy | Ex founder, Prev. built https://t.co/qP7PuszYLC and @palladium
Nasir @nasirk_
817 Followers 495 Following Working on anything to everything @runwayml prev @HavenStudiosInc, @Mila_Quebec
Ziyi Tang @tangziyi001
139 Followers 107 Following AI/ML Research Engineer @runwayml | ex-@meta AR/ CTRL-Labs/ Instagram | Lifelong student of art and technology
melani ✨ @melanimaheswar1
377 Followers 820 Following optimize for knowledge (opinions are my own) 🇨🇦 technical writer @DigitalOcean
Adam Fuhrer @adamfuhrer
24K Followers 428 Following software engineer & visual artist — https://t.co/6jgZWEQhGs
Viraat Aryabumi @viraataryabumi
692 Followers 447 Following multimodal @cohere | ex-scholar @cohere_labs | ex-MLE @amazondevscot Opinions are my own
Ashley Edwards @ashrewards
1K Followers 287 Following Research scientist at Google DeepMind. Past: Runway, Uber AI Labs, Georgia Tech
voltra @voltraenergy
145 Followers 8 Following
Alexander Stratmoen @alexstratmoen
862 Followers 522 Following Co-Founder @VoltraEnergy | things that go ⚡️@socraticainfo ⁂ | Velocity | YYC/Waterloo
Goodfire @GoodfireAI
9K Followers 20 Following Advancing humanity's understanding of AI through interpretability research. Building the future of safe and powerful AI systems.
Doyup @doyup_lee
396 Followers 373 Following Toward the next level of visual content creation. Ex @runwayml as a Foundational Contributor of Gen-3 alpha, Frames, and Gen-4. Opinions are my own.
🍥 Timmy 🍥 @IXITimmyIXI
16K Followers 6K Following Father&Husband | Community Manager @RunwayML| Generative Art Expert | A.I. Consultant | Integrative Thinker | Artist | Business - [email protected] He/Him