Shai Shalev-Shwartz @shai_s_shwartz
Computer Science @HebrewU; CTO @Mobileye #selfdrivingcars #ai #machinelearning Opinions are my own. Joined July 2022-
Tweets226
-
Followers2K
-
Following129
-
Likes138
אז כאילו אין קייטנות אבל ההורים אמורים לעבוד כרגיל? ברור.
All true, and I’ll add that Avi is also an amazing teacher.
All true, and I’ll add that Avi is also an amazing teacher.
📄Jamba whitepaper is out! The whitepaper details our in-depth ablations on this novel hybrid SSM-Transformer architecture, and how we chose to interleave Mamba, Transformer and MoE. arxiv.org/abs/2403.19887 Here are some highlights from the paper 👇1/6
I played a little with Jamba: it looks like an amazing model. In terms of architecture, the MoE implementation is very close to Mixtral's. What's great about it is that it hasn't been fine-tuned. Curious to see how much improvement we can get through SFT. I made a little…
I played a little with Jamba: it looks like an amazing model. In terms of architecture, the MoE implementation is very close to Mixtral's. What's great about it is that it hasn't been fine-tuned. Curious to see how much improvement we can get through SFT. I made a little… https://t.co/g01vjsZxvx
Introducing Jamba, our groundbreaking SSM-Transformer open model! As the first production-grade model based on Mamba architecture, Jamba achieves an unprecedented 3X throughput and fits 140K context on a single GPU. 🥂Meet Jamba ai21.com/jamba 🔨Build on @huggingface
First scaled-up Mamba release is here from AI21! Jamba is a hybrid SSM/Transformer MoE with 52B parameters (12B active), 256k context length (140k fits on a single A100), and significantly better inference throughput. The benchmarks make sense: looks like it outperforms…
I had a great conversation with MotorTrend's @EdLoh and @mt_loverman on humans, machines, and their interface in the context of driving experience and safety.
I had a great conversation with MotorTrend's @EdLoh and @mt_loverman on humans, machines, and their interface in the context of driving experience and safety.
Building a hands-off autonomous system is a significant challenge as it requires achieving two features that rarely come together: (i) the use of very advanced tech from the latest microchips, computer vision, sensor fusion, and the most advanced AI, and (ii) the system should…
Dan Roy @roydanroy
45K Followers 2K Following ML / AI researcher, emphasis on theory. Research Director and Canada CIFAR AI Chair, @VectorInst Professor, @UofT (Statistics/CS)Amnon Shashua @AmnonShashua
7K Followers 209 Following CEO @Mobileye. @OrCam, @AI21Labs, @ONEZEROBANK. Sachs Prof. Computer Science at Hebrew U. Passion for #AI, cycling and #SelfDrivingCars. Opinions are my ownAmin Karbasi @aminkarbasi
8K Followers 2K Following Associate Professor at Yale University, staff research scientist at Google.Francesco Orabona @bremen79
6K Followers 394 Following Associate professor at @KAUST_News. Formerly @BU_ece, @sbucompsc, @YahooResearch, @TTIC_Connect. ML theory&practice and history of scienceElad Hazan @HazanPrinceton
11K Followers 187 Following machine learning and optimization @PrincetonCS & Google DeepMind Princeton, dad^3Peter Richtarik @peter_richtarik
6K Followers 593 Following Federated Learning Guru. Tweeting since 20.5.2020. Lived in 🇸🇰🇺🇸🇧🇪🇬🇧🇸🇦Gergely Neu @neu_rips
9K Followers 666 Following ML theory nerd & AI non-enthusiast. thinking a lot about online learning these days!Michal Valko @misovalko
5K Followers 2K Following Llama @AIatMeta Paris & Inria & MVA - Ex: Gemini and BYOL @GoogleDeepMindBoaz Barak @boazbaraktcs
17K Followers 420 Following Computer Scientist. See also https://t.co/EXWR5k634w, https://t.co/SEVX6it6z3 ( @[email protected] , boaz.barak in threads ). Opinions my own.Thomas G. Dietterich @tdietterich
50K Followers 505 Following Distinguished Professor (Emeritus), Oregon State Univ.; Former President, Assoc. for the Adv. of Artificial Intelligence; Robust AI & Comput. SustainabilityTaylor Ogan @TaylorOgan
23K Followers 6K Following CEO at @snowbullcapital // In China for investment opportunities // Boston to Shenzhen // Grammar nut // Disclaimer: https://t.co/CYiDT5xlMLJason Lee @jasondeanlee
10K Followers 3K Following Associate Professor at Princeton and Research Scientist at Google DeepMind. ML/AI Researcher working on foundations of LLMs and deep learningPreetum Nakkiran @PreetumNakkiran
10K Followers 2K Following ML research @Apple. @sh_reya’s fiancé | PhD @Harvard, postdoc @UCSanDiego, EECS @Berkeley_EECS, "AI" @OpenAI, @GoogleAIUri Eliabayev @urieli17
13K Followers 1K Following AI Consultant and lecturer, Founder of the "Machine & Deep learning Israel" community (37K members), Contributor at @haaretzSam Power @sp_monte_carlo
17K Followers 7K Following Lecturer in Maths & Stats at Bristol. Interested in probabilistic + numerical computation, statistical modelling + inference. (he / him)Lénaïc Chizat @LenaicChizat
2K Followers 241 Following Assistant professor @epfl (previously @cnrs researcher). Interested by what's simple, beyond the obvious.Leshem Choshen 🤖�.. @LChoshen
4K Followers 548 Following 🥇 Collaborative LLMs 🥈 Opinionatedly sharing #ML & #NLP 🥉 Propagating us underdogs we owe science an alternative hype @IBMResearch & @MIT_CSAILthis time ain't diffe.. @meanstonks
0 Followers 4K FollowingKaylee Beckstead @BecksteadK66890
83 Followers 5K FollowingNico Acosta @acossta
9K Followers 1K Following Co-founder & CEO at @PropelDataCloud. Ex-product lead @ TwilioBill @Bill_tju
8 Followers 107 FollowingAmin Charusaie @charusaie
92 Followers 307 Following Machine Learning, Information Theory. PhD student at @MPI_IS .Marc Jourdan @MarcJourdan5
240 Followers 354 Following PhD student in Bandits at @InriaScool (ex SequeL)nitay alon @nitalon
231 Followers 449 Following PhD student @CseHuji and @MPICybernetics. Multi-agent RL, partner, theory of mind, dad (x3), AGI(maybe). (not an ordered list). @[email protected]Roulletbeurre @realRullebeurre
61 Followers 350 FollowingHongcheng Liu @HongchengLiu20
123 Followers 217 Following Associate Prof @UFISE. Interested in (high-dimensional) stochastic optimization, algorithms, machine learning, and applications in healthcare and transportationSujay Nagaraj @sujnagaraj
825 Followers 1K Following MD/PhD Student, Vanier Scholar @uoftmedicine @UofTCompSci Machine Learning in Medicine | Aspiring clinician/innovator | Views are my own | he/himxhv ufx @hchehcjc
19 Followers 37 FollowingAaron Defazio @aaron_defazio
6K Followers 364 Following Research Scientist at Meta working on optimization. Fundamental AI Research (FAIR) teamOmar Khattab @lateinteraction
11K Followers 2K Following CS PhD candidate @StanfordNLP. 2022 Apple Scholar in AI/ML. Author of ColBERT (https://t.co/2ZtgXoa1np), DSPy (https://t.co/BH7WmMKDXR), & various retrieval & LM systems.Seok-Ju Hahn (Adam) @vaseline_555
35 Followers 268 Following (pronunciation: 'suck-zoo') 🇰🇷 Bayesian, Singer, Meditator; Federated Learning, Optimization; 至道無難 唯嫌揀擇Keller Jordan @kellerjordan0
1K Followers 198 Following Independent research Prev MLE @ Hive AI, math @ UCSDKishan @kpb_in_acad
343 Followers 635 Following ಕನ್ನಡಿಗ #AI #RL Postdoc at #Caltech! Tweets aren't professional. Previous: @tamu @MSFTResearch @qualcomm_in Note: I often delete my tweets - insecurities!Asaf Yehudai @AsafYehudai
341 Followers 756 Following #NLProc researcher, CS Ph.D. student at @HebrewU (@nlphuj), and a researcher at @ibmresearch.Nicholas Liskij @nliskij
16 Followers 761 FollowingRahul Dave @rahuldave
2K Followers 5K Following Teaches and does Stats, ML and AI. Co-Founder and Chief Scientist https://t.co/EygMgQHg07. Former Lecturer at Harvard and Astrophysicist at Penn. Bayesian.Ahmed Khaled @akhaledv2
498 Followers 768 Following I like optimization, mathematics, and drawing. Ph.D. student at Princeton ECE. Pronouns: he/him.Souradip Chakraborty @SOURADIPCHAKR18
1K Followers 5K Following Ph.D. student, Univ. of Maryland @umdcs Past : #Walmart Labs, MS #IndianStatisticalInstitute #GDE #ML #Statistical #RL #Bayesian #Generalisation #DeepLearningSajad Rahmanian @blue_ocean_777
23 Followers 289 Following Currently a CS Master's Student @YorkU Prev: EE@SharifUTVictor Dong @VictorDong627
39 Followers 134 Following Machine learning researcher; RL; LLM; retired chess player ;)Thanh Nguyen-Tang @thanhnguyentang
484 Followers 1K Following (machine) learner @JohnsHopkins; slow science.uxatisb78spm @uxatisb78spm
33 Followers 278 FollowingFrancesco Cagnetta @Fraccagnetta
188 Followers 241 Following Theoretical physicist (bow tie included), inherently out of equilibrium. Studying deep learning and complex systems at @EPFL.Geogristle @geogristle
742 Followers 525 Following differential geometry & neurobiology steering the ship of theseus I;m thinking about thos NCCsLior 🎗️ @lior_bracha
57 Followers 335 Following PhD Student @ BIU. Computer Vision, Scene understanding.Marco Matthies @MarcoMatthies
91 Followers 2K Following Interested in math, programming, computational biology, AI, and investing.Alberto Bietti @albertobietti
2K Followers 1K Following Machine learning research. Research scientist @FlatironCCM, previously @MetaAI, @NYUDataScience, @Inria, @Quora.Mattes Mollenhauer @gaussianmeasure
2 Followers 56 Following Senior Machine Learning Researcher at @MMerantix | @FU_Berlin Postdoc AlumnusDan Biderman @dan_biderman
598 Followers 880 Following Final-year PhD student at @cu_neurotheory building ML systems for neuroscience. Also NLP research @DbrxMosaicAISpandan Senapati @SenapatiSpandan
2 Followers 27 Following CS Ph.D. @ USC | Prev CSE @ IIT Kanpur | Interested in Learning TheoryOscar Broekema @obr2021
2K Followers 2K Following Embedded Systems | FPGA | HDL | C/C++ | Linux | Hardware/Software Design | Water for Fuel | Ionisation | Hydrogen on demand | RISC-V | Space stuff | AISteve Shen @SteveSh00938072
1 Followers 2K FollowingAbhinav Gupta @backpropper
796 Followers 5K Following phd student @Mila_Quebec | ms @CILVRatNYU @NYU_Courant | previously @GoogleDeepMind @AIatMeta @GoogleAI @labsdotgoogle @MSFTResearch @AdobeResearchYann LeCun @ylecun
711K Followers 718 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.Csaba Szepesvari @CsabaSzepesvari
8K Followers 704 Following "If there is not folly in the world, then the world itself is folly. You must understand that mistakes are not always regrets." - Paul Tobin, Bandette🤠Amnon Shashua @AmnonShashua
7K Followers 209 Following CEO @Mobileye. @OrCam, @AI21Labs, @ONEZEROBANK. Sachs Prof. Computer Science at Hebrew U. Passion for #AI, cycling and #SelfDrivingCars. Opinions are my ownFrancesco Orabona @bremen79
6K Followers 394 Following Associate professor at @KAUST_News. Formerly @BU_ece, @sbucompsc, @YahooResearch, @TTIC_Connect. ML theory&practice and history of scienceBen Recht @beenwrekt
26K Followers 365 Following optimization. machine learning. uc berkeley. I blog at https://t.co/fkJujOPsJb The world won't end.Elad Hazan @HazanPrinceton
11K Followers 187 Following machine learning and optimization @PrincetonCS & Google DeepMind Princeton, dad^3Peter Richtarik @peter_richtarik
6K Followers 593 Following Federated Learning Guru. Tweeting since 20.5.2020. Lived in 🇸🇰🇺🇸🇧🇪🇬🇧🇸🇦Percy Liang @percyliang
49K Followers 408 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | PianistGergely Neu @neu_rips
9K Followers 666 Following ML theory nerd & AI non-enthusiast. thinking a lot about online learning these days!Behnam Neyshabur @bneyshabur
18K Followers 690 Following Senior Staff Research Scientist @GoogleDeepMind, Interested in reasoning w. LLMs, traveling & backpackingNeurIPS Conference @NeurIPSConf
111K Followers 35 Following New Orleans, Dec 10-16, 23. https://t.co/ga8aOw615g Tweets to this account are not monitored. Please send feedback to [email protected].Boaz Barak @boazbaraktcs
17K Followers 420 Following Computer Scientist. See also https://t.co/EXWR5k634w, https://t.co/SEVX6it6z3 ( @[email protected] , boaz.barak in threads ). Opinions my own.Jason Lee @jasondeanlee
10K Followers 3K Following Associate Professor at Princeton and Research Scientist at Google DeepMind. ML/AI Researcher working on foundations of LLMs and deep learningPreetum Nakkiran @PreetumNakkiran
10K Followers 2K Following ML research @Apple. @sh_reya’s fiancé | PhD @Harvard, postdoc @UCSanDiego, EECS @Berkeley_EECS, "AI" @OpenAI, @GoogleAIZachary Lipton @zacharylipton
59K Followers 2K Following Professor: CMU/@acmi_lab, CTO / CSO: @AbridgeHQ, Creator: @d2l_ai & https://t.co/QQt98VNLUp, Relapsing 🎷ICML Conference @icmlconf
70K Followers 17 Following Int'l Conf on ML • July 21-27, 2024 (Vienna, Austria) • #icml2024 • Contact: https://t.co/6saHKWV01y • https://t.co/sFwmcQNWkESergey Levine @svlevine
79K Followers 122 Following Associate Professor at UC Berkeley Co-founder, Physical IntelligenceEva Vlaardingerbroek @EvaVlaar
832K Followers 1K Following 🇳🇱 Commentator | Lawyer | “Shieldmaiden of the far right” (thanks Dutch Press) | As seen on Mark Steyn, Tucker Carlson & others | Support my work here 👇🏻Shaul Amsterdamski �.. @amsterdamski2
224K Followers 2K Following עיתונאי ב-@kann_news, #חיותכיס, #המנגנון, כותב טור ב-@calcalist. כתבתי ספר! קוראים לו #כסףטוב, לינק בביו. ירושלמי. לאחרונה התחלתי לשתות קפהיזמזמית @Lihi4Lihi
4K Followers 1K FollowingEran Malach @EranMalach
265 Followers 178 Following Research Fellow, Kempner Institute, Harvard UniversityChristian Szegedy @ChrSzegedy
32K Followers 2K Following #deeplearning, #ai research scientist. Opinions are mine.Edward Loh @EdLoh
12K Followers 8K Following Head of Editorial @MotorTrend + @MotorTrendGroup. Alum @TeachForAmerica & @USC. Cars, surfing, and food. Tweets are mine.Genius Thinking @GeniusGTX
133K Followers 0 Following Mental models, cognitive biases, quotes, and philosophy from the greatest thinkers.TRTH HRTZ @hrtz_trth
34 Followers 47 Following “The past was erased, the erasure was forgotten, the lie became the truth.” -George OrwellSubbarao Kambhampati .. @rao2z
16K Followers 29 Following AI researcher & teacher @SCAI_ASU. Works on Human-Aware AI. Former President of @RealAAAI; Chair of @AAAS Sec T. Here to tweach #AI. YouTube Ch: https://t.co/4beUPOmMW6Kobi Ohayon @KobiO14
2 Followers 27 Followingאימהות בחזי.. @IBahazit
662 Followers 213 Following אימהות בחזית נאבקות למען שירות שווה לכולםן, ללא יוצא מן הכלל!מגי אוצרי @MagiOtsri
28K Followers 1K Following סופרת (לא. לא מתפרנסים מזה) ודוקטור למשפטים (גם מזה לא). לרכישת הספר היפומאניה כנסו ללינק ⬇️Eran Efrat @Eran_Efrat
45K Followers 529 Following Entrepreneur, Managing partner at VerDiesel Group, converting waste to green energy♻️, animal lover, כותב גם בגלובס תרבותAmit Daniely @amit_daniely
21 Followers 103 FollowingIrit Dinur @IritDinur
256 Followers 220 FollowingTomas Pueyo @tomaspueyo
336K Followers 548 Following Understand deeply how the world works today to navigate the world of tomorrow. Join 80k ppl in my free newsletter:liorwolf @liorwolf
73 Followers 38 Following CEO, Mentee Robotics, and a Computer Science professor at TAUZEEKR @ZEEKRGlobal
7K Followers 132 Following The official Zeekr Twitter account. A brand with the premium electric vehicles #Zeekr001 #Zeekr009 #ZeekrX #Zeekr001FR #Zeekr007 #Zeekr009Grand #ZeekrMIXShie Mannor @MannorShie
240 Followers 16 Following A machine learning professor at the Technion, researcher at Nvidia, and co-founder of Jether Energy. A mathematician by training and skeptic by nature.Ami Wiesel @WieselAmi
73 Followers 207 FollowingKyle Vedder @KyleVedder
738 Followers 322 Following 3D Vision for real world robots. CS PhD candidate at Penn. Research intern at Nvidia, ex-research intern at ArgoAI.Yishay Mansour @YishayMansour
260 Followers 263 Following Professor of Computer Science, Tel Aviv University and Google research.Naveen Rao @NaveenGRao
28K Followers 786 Following VP GenAI @Databricks. Former CEO/cofounder MosaicML & Nervana/IntelAI. Neuro + CS. I like to build stuff that will eventually learn how to build other stuff.DuckDuckGo @DuckDuckGo
2.8M Followers 4 Following Independent internet privacy company. Download our browser on mobile and desktop. Unlike Chrome, it has privacy built in, including our private search engine.Zeyuan Allen-Zhu @ZeyuanAllenZhu
8K Followers 273 Following physics of language models @ Meta / FAIR IOI - USACO - MCM - ACM/ICPC - Codejam Tsinghua - MIT - Princeton/IAS - MSR - FAIRErnest Ryu @ErnestRyu
1K Followers 294 Following Interested in optimization and machine learning Assistant Professor Department of Mathematics, Seoul National University, KoreaNicolò Cesa-Bianchi @NicoloCB
2K Followers 121 Following Professor at the University of Milan, Italy Machine learning algorithmsCar Autonomy @CarAutonomy
109 Followers 131 Following Keep up-to-date with all the developments in autonomous vehicles and the manufacturers pursuing the self-driving dream.Davis Blalock @davisblalock
12K Followers 165 Following Research scientist + first hire @MosaicML. @MIT PhD. I write + retweet technical machine learning content. If you write a thread about your paper, tag me for RTSebastian Ruder @seb_ruder
80K Followers 1K Following Multilingual LLMs @cohere • Prev: @GoogleDeepMind • Newsletter: https://t.co/7JGh2qpG98Mehrdad Mahdavi @mehrdadmahdavi
488 Followers 1K Following machine learning researcher, and assistance professor at penn state universityTim van Erven @tverven
944 Followers 182 Following Associate professor in machine learning at the University of Amsterdam. Topics: (online) learning theory and the mathematics of explainable machine learning.Hobo Joe (unverifïed.. @jd_average
3K Followers 3K Following Tesla fan. Husband. Father. Veteran. FSD Beta Tester. $TSLA 🪑 hodler. #TeslaSushiMafia (Club) 🍣 proud Shih Tzu owner. Attended 🪑 holders meeting '22James Hoffmann @JamesHoffmann3
468 Followers 295 Following Christian first, believer in climate change, sustainable energy and space exploration. Tesla owner. Autonomous driving enthusiast. Waymo and Mobileye fan.Quentin Berthet @qberthet
2K Followers 2K Following Research Scientist at Google DeepMind Machine Learning - ParisNicolas Loizou @NicLoizou
1K Followers 292 Following Assistant Professor @JohnsHopkins. Optimization and Machine Learning.PUNS @ThePunnyWorld
658K Followers 5 Following Follow for the most hilarious puns and dad jokes! Not affiliated with any of my tweets.Mark Schmidt @MarkSchmidtUBC
2K Followers 215 Following I optimized a machine learning model once. It was terrible.Zhuoran Yang @zhuoran_yang
2K Followers 911 Following Assistant Professor of Statistics and Data Science @YaleLin Yang @lyang36
1K Followers 815 Following Assistant Professor of ECE@UCLA. ML, RL, big data, algorithms, astronomy.Tuo Zhao @tourzhao
2K Followers 375 Following Assistant Professor at Georgia Tech, Ph.D. in Computer Science. Research Interests: Machine Learning, Optimization, Statistics and Neural Language Models.Yu Bai @yubai01
3K Followers 2K Following Sr Research Scientist @SFResearch. PhD @Stanford. Researcher on foundation models, RL/games, deep learning, uncertainty quantification, and their theory.The axiomatic error undermining much of Western Civilization is “weak makes right”. If someone accepts, explicitly or implicitly, that the oppressed are always the good guys, then the natural conclusion is that the strong are the bad guys.
@dom_lucre That's because most people that claim to be autistic aren't really autistic. I was a nanny for autistic twins. One was mild and one was severe. And they both acted like this👇This boy is 19.
Snorkelling in the Red Sea with Michael I Jordan. Mike is visiting KAUST this week. cemse.kaust.edu.sa/events/event/a… cemse.kaust.edu.sa/events/event/d…
אין זמן לחטופים ואין זמן למדינת ישראל. #בחירות_עכשיו הפקה רוני פלסן. קרדיט רחפן איתי סלונים ואמיר טרקל. צולם אתמול ברחבת הבימה.
The Hebrew University of Jerusalem is honored to announce that three of its esteemed faculty members have been awarded the prestigious Israel Prize for their outstanding professional achievements. These recipients, both past and present faculty members, represent the university's…
incredibly impressed by @AI21Labs' Jamba today. This is the first legitimate Mixtral-killer we've seen and it came out of "nowhere": buttondown.email/ainews/archive… They've helped me redefine my idea of a model "weight class" from "number of parameters" (increasingly outdated with MoEs…
Worst nightmare caught on camera
Our new work on the emergence of induction heads when training Transformers on in-context learning of Markov chains. We show that the models exhibit multiple (!) phase transitions before finding the correct solution. Theory, experiments and cool videos in the blog and thread.
How do induction heads / in-context learning emerge? We study a new synthetic task to better understand how these circuits evolve (in stages!) over time. w/ @EdelmanBen, @SurbhiGoel_, @EranMalach & Nikos Tsilivis Blog: unprovenalgos.github.io/statistical-in… Paper: arxiv.org/abs/2402.11004 (1/7)
Talked at the Technion today, where I was a professor for 5 years, hosted by two former students who are now (fantastic) Technion professors (!): Dan Garber and Kfir Levy :-)
On Thursday, IDI’s Dr. Tehilla Shwartz Altshuler will join @zvikakrieger, former director of responsible innovation at @Meta, and @SapirJournal’s director @ChananWeissman for a discussion on “Disinformation, Gruesome Images, and Digital Fog of War.” January 11th, 12pm ET. Sign…
מהגיגיו של דורי בן זאב ב88FM "לא מחליפים שנה בזמן מלחמה, זה לא הזמן"
Great song in memory of the hero Ben Shimoni, murdered after saving 9 strangers at the Nova party massacre of Oct 7th: youtube.com/watch?v=hLOC5X…
Personal update: I've launched a project focused on explaining a new neural network. It was released at NeurIPS
My Parody on Woke People
If you come across a “Free Palestine” activist who calls #Hamas, Palestinian freedom fighters, or one of the Neo-Liberals who think they are fighting “Colonialism” and “Imperialism”, show them this video and see what they have to say. By @elicalebon Note: I reposted this video…
The re-branding of Israel's justified response to the rape-murder of 1200-1400 civilians as "the genocide in Gaza" truly is one of the most astonishing, insane things I have ever seen. You are not imagining this.