Fabian Schaipp @FSchaipp
working on optimization for machine learning. currently postdoc @inria_paris. sbatch and apero. fabian-sp.github.io Paris, France Joined July 2020-
Tweets436
-
Followers1K
-
Following675
-
Likes2K
Fabian Schaipp retweeted
Long in the making, finally released: Apertus-8B and Apertus-70B, trained on 15T tokens of open data from over 1800 languages. Unique opportunity in academia to work on and train LLMs across the full-stack. We managed to pull off a pretraining run with some fun innovations, ...
Long in the making, finally released: Apertus-8B and Apertus-70B, trained on 15T tokens of open data from over 1800 languages. Unique opportunity in academia to work on and train LLMs across the full-stack. We managed to pull off a pretraining run with some fun innovations, ... https://t.co/c8ECD4rp34
16
43
157
56K
40
Download Image
🚟 New blog post: On "infinite" learning-rate schedules and how to construct them from one checkpoint to the next fabian-sp.github.io/posts/2025/09/…
what goes around comes around #vision
FYI Adam will be on holiday the entire august
FYI Adam will be on holiday the entire august
Best tutorials are those that do not only promote the speakers' own work. #ICML2025
🚡 Come check out our poster on understanding LR schedules at ICML. Thursday 11am.
Pogacar didnt have a bad day since TdF 2023, stage 17. Quite astonishing #TDF2025
A paper that contains both the words "sigma-algebra" and "SwiGLU activations" ☑️ Also interesting results on embedding layer LRs.
Fabian Schaipp retweeted
We uploaded V3 of our draft book "The Elements of Differentiable Programming". Lots of typo fixes, clarity improvements, new figures and a new section on Transformers! arxiv.org/abs/2403.14606
is it allowed to write papers on μP only subject to using the most un-intuitive notation?
what are the best ressources for training and inference setup in diffusion models? ideally with (pseudo-)code
Optimization is the natural language of applied mathematics.
now accepted at #ICML 2025! ☄️
Senthil Kumar @SenthilKumarN_
68 Followers 2K Following Aspiring ML Researcher. Interested in Bayesian Machine Learning & RL.
L1Latency @Thoughts2Thrds
135 Followers 5K Following 🧠 Turning thoughts into threads ⚙️ 🔧 GEMMs on Blackwell, Hopper, Ampere!!
Stephen Oates @stephenjaoates
810 Followers 7K Following
Namhoon Lee @namhoonlee09
336 Followers 481 Following Assistant Professor of Computer Science and Engineering at POSTECH; Currently away on Sabbatical at IST Austria
Hexaly @_Hexaly
4K Followers 2K Following Hexaly is the world’s fastest optimization solver for Routing, Scheduling, Packing, and more. Join our fast-growing developer community!
Here we go @AvimanyuRoy3
651 Followers 3K Following
Thibaut Boissin @ThibautBoissin
248 Followers 203 Following
Pietro @aplietexe
5 Followers 614 Following
Saber Darabi @SADarabi
302 Followers 7K Following
Vadim Liventsev @vadimdotme
37 Followers 714 Following lead hip hop engineer @ https://t.co/y80r2iuMsN
Jingfeng Wu @uuujingfeng
1K Followers 1K Following Bsky: https://t.co/hUrRPJZ9BU Postdoc @SimonsInstitute @UCBerkeley; alumnus of @JohnsHopkins @PKU1898; DL theory, opt, and stat learning.
Vlarrerm @Vlarrerm133604
32 Followers 841 Following
Yfleuirdirn @Yfleuirdirn682
29 Followers 1K Following
Mussa Kambi @MussaKambi77202
16 Followers 861 Following
Dayal Kalra @dayal_kalra
403 Followers 570 Following Research intern @AIatMeta FAIR; PhD student @umdcs; Past @UMD_IPST, BS-MS @IISERPune
Valentina Pyatkin @valentina__py
3K Followers 1K Following Postdoc at the Allen Institute for AI @allen_ai and @uwnlp
Amin Karbasi @aminkarbasi
11K Followers 3K Following Senior director of Cisco Foundation AI, Former Chief Scientist at Robust Intelligence. ex Professor at Yale University, ex staff research scientist at Google.
Mathurin Massias @mathusmassias
2K Followers 180 Following Researcher @INRIA_lyon, Ockham team. Teacher @Polytechnique and @ENSdeLyon Machine Learning, Python and Optimization
Viet Nguyen Trong @ntrongviet
0 Followers 37 Following
Rohan Jain @JainRohan16
189 Followers 524 Following • MSc in ML @UCalgary, ML Researcher @ml_collective • Prev: Math + CS @UofT
Ali Ramlaoui @AliRamlaoui
97 Followers 232 Following ML Researcher | AI4Science and Materials Discovery
Chaim Baskin @ChaimBaskin
584 Followers 2K Following Assistant Professor (Senior Lecturer) at Ben-Gurion University of the Negev, Head of Intelligent Systems, Geometric Computing, and Sensing Lab
Ishaq @ishaqHMK
0 Followers 63 Following
Dongyeop Lee @dongyeop_lee2
32 Followers 195 Following Master's student at the Graduate School of Artificial Intelligence in @postech2020. Previously: student researcher at @google
Raymond Ng @Raymondng_aisg
9 Followers 1K Following
Caleb Martin @Digital_DAT
1K Followers 6K Following Building intelligent robots. Pro Human/humanity 🇺🇸
Ts @kp5395620377137
5 Followers 215 Following
Sai Koushik @SKoushik
149 Followers 1K Following Agentic Systems @InstalilyAI | @Penn alum | Exploring the intersection of computation and creativity, fueled by South Indian filter ☕
Inverted Triangle @invrtd_triangle
32 Followers 574 Following
henry castillo @henrycstllo
80 Followers 613 Following phd @tamu. prev: swe @stripe, bs @utaustin. i want to mechanistically understand models through the lens of training dynamics. 🇵🇪🏳️🌈
Roberto Halpin @rhalping
0 Followers 167 Following
Teodora @teodorasrec
22 Followers 72 Following MSc student. Training neural nets 📉 & making robot friends 🤖
Matthias Gallé @mgalle
2K Followers 1K Following Safety, Multilingual & Code lead @CohereAI. Born in 🇧🇷, raised in 🇩🇪, studied in 🇦🇷, living in 🇫🇷.
François Rozet @FrancoisRozet
670 Followers 136 Following datamancer, generative models, bayesian inference, dynamical systems, open-source software, phd with @glouppe
Andrei Semenov @AndreiSemenov17
130 Followers 249 Following MSc in Data Science at @EPFL_en | MIPT Alumnus
CSCS Lugano @cscsch
3K Followers 101 Following CSCS, the Swiss National Supercomputing Centre, develops and promotes technical and scientific services in the fields of high-performance computing. #weareAlps
Thibaut Boissin @ThibautBoissin
248 Followers 203 Following
Hexaly @_Hexaly
4K Followers 2K Following Hexaly is the world’s fastest optimization solver for Routing, Scheduling, Packing, and more. Join our fast-growing developer community!
IIT @IITalk
20K Followers 3K Following By promoting excellence in basic and applied research IIT contributes to the economic development of Italy
Politecnico di Torino @PoliTOnews
21K Followers 201 Following
Jonas Geiping @jonasgeiping
4K Followers 800 Following Machine Learning Research at the ELLIS Institute & Max-Planck for Intelligent Systems// Excited about fundamental questions in Safety & Efficiency of modern ML
EurIPS Conference @EurIPSConf
288 Followers 52 Following EurIPS is a community-organized, NeurIPS-endorsed conference in Copenhagen where you can present papers accepted at @NeurIPSConf
Valentina Pyatkin @valentina__py
3K Followers 1K Following Postdoc at the Allen Institute for AI @allen_ai and @uwnlp
Daniele Grattarola @riceasphait
2K Followers 867 Following Leading generative models @IsomorphicLabs | AI for drug discovery | Previously IDSIA, @EPFL
Amin Karbasi @aminkarbasi
11K Followers 3K Following Senior director of Cisco Foundation AI, Former Chief Scientist at Robust Intelligence. ex Professor at Yale University, ex staff research scientist at Google.
Sacha Braun @PotoSacho
30 Followers 53 Following PhD student in machine learning with Francis Bach & Michael I. Jordan: uncertainty quantification, conformal prediction, learning theory. https://t.co/dkoZLl0pDg
Sebastian Bordt@ICML @sbordt
290 Followers 600 Following Language models and interpretable machine learning. Postdoc @ Uni Tübingen.
Umar Jamil @hkproj
15K Followers 1K Following AI @MistralAI - Join the best AI community on Discord: https://t.co/zYH1DlgdbW - Opinions my own
Quentin @qtnx_
17K Followers 540 Following i use nixos btw, research engineer @mistralai, prev. https://t.co/SDROdHKqTQ, husband, all opinions my own
davinci @leothecurious
2K Followers 739 Following teaching robots to see by day, learning from nature by night. in search of elegant solutions to the metaproblem. infinitely curious.
Dan Roy @roydanroy
57K Followers 2K Following ML / AI researcher. Research Director and Canada CIFAR AI Chair, @VectorInst. Professor, @UofT (Statistics/CS).
Mathieu @miniapeur
34K Followers 2K Following Non-member of the technical staff. Gradient surfer by day, Möbius stripper by night. PhD @ai_ucl. Non-professional nice person.
Yaroslav Bulatov @yaroslavvb
8K Followers 930 Following [email protected] (ex-Google Brain, OpenAI, Meta) New Blog: https://t.co/SLix8Hrt4w Old Blog: https://t.co/Ur3GWKpmp6
Fondation Tara Océan @TaraOcean_
19K Followers 3K Following La #FondationTaraOcéan est la première fondation reconnue d’utilité publique consacrée à l’Océan en France. #ExplorerEtPartager
gensyn @gensynai
85K Followers 35 Following Gensyn is building the network for machine intelligence. Build with us: https://t.co/U6bMeo46wM
Kevin Frans @kvfrans
4K Followers 503 Following @berkeley_ai @reflection_ai prev mit, read my thoughts: https://t.co/7CZsOTrKRA
Daria_Surkova @Dari_Designs
4K Followers 221 Following Brand Designer. Exploring how to apply AI for graphic and motion design.
noahamsel @noahamsel
18 Followers 67 Following
James Sanders @james_s48
497 Followers 1K Following Trying to figure out what the heck is going on. I enjoy thinking about economics, AI, philosophy, and the NBA
Epoch AI @EpochAIResearch
27K Followers 7 Following Investigating the trajectory of AI for the benefit of society.
Γ(z) @gammaofzeta
11K Followers 2K Following Anti-speciesism 🌱, deep ecology. Mathematical physics. I like puzzles and riddles.
zed @zmkzmkz
4K Followers 1K Following #1 paperclip maximizer fan, occasionally on x-games mode. I really, really like watching loss graphs go down
Xidulu @xidulu
342 Followers 510 Following Xi Wang, Full-stack Bayesian, ECNU, UMass CICS, JHU CS, Fan of U-Shape
Damien Ferbach @damien_ferbach
577 Followers 194 Following PhD at @Mila_Quebec/ Previously student in Maths and theoretical Physics at @ENS_ULM
Jason Lee @jasondeanlee
18K Followers 4K Following Associate Professor at UC Berkeley. Former Research Scientist at Google DeepMind. ML/AI Researcher working on foundations of LLMs and deep learning.
Ryan D'Orazio @RyanDOrazio
485 Followers 354 Following PhD Student at Mila Quebec AI Institute, and Université de Montréal.
Francesco Cagnetta @Fraccagnetta
271 Followers 370 Following Theoretical physicist (bow tie included), inherently out of equilibrium. Studying data structure and deep learning. Marie Skłodowska-Curie fellow at @SISSA.
Katie Everett @_katieeverett
3K Followers 632 Following Machine learning researcher @GoogleDeepMind + PhD student @MIT. Opinions are my own.
You Jiacheng @YouJiacheng
8K Followers 2K Following a big fan of TileLang 关注TileLang喵！关注TileLang谢谢喵！ https://t.co/utshC0jrCO 十年老粉
Axel Parmentier @ParmentierAxel1
112 Followers 55 Following Researcher at Ecole des Ponts, Paris. Interested in operations research and the applications of machine learning to operations research
Pope Leo XIV @Pontifex
18.9M Followers 46 Following Welcome to the official account of His Holiness, Pope Leo XIV.
Luca Soldaini 🎀 @soldni
11K Followers 1K Following I like tokens! I lead the OLMo data team at @allen_ai w/ @kylelostat. Open source is fun 🤖☕️🍕🏳️🌈 Opinions are sampled from my own stochastic parrot
Nicholas Gao @n_gao96
442 Followers 180 Following Member of Technical Staff @cusp_ai Former: @TU_Muenchen, @MSFTResearch, @NasaAmes
Le Parisien | Paris @LeParisien_75
229K Followers 100 Following L’actu de la capitale avec @le_Parisien, le média de référence en Île-de-France
Frank Schneider @frankstefansch1
693 Followers 650 Following Postdoctoral researcher at the University of Tübingen working on (benchmarking) training methods for deep learning
Gabriele Berton @gabriberton
6K Followers 1K Following Postdoc @Amazon working on VLM - ex @CarnegieMellon @PoliTOnews @IITalkTrends for United States
183 B posts
47,6 B posts
61,5 B posts
170 B posts
200 B posts
38,9 B posts
63,7 B posts
7.142 posts
53,3 B posts
4.736 posts
4.922 posts
6.244 posts
4.606 posts
5.193 posts
127 B posts
36,2 B posts
2.463 posts
3.137 posts
8.996 posts
2.408 posts
You might like
Konstantin Mishchenko
@konstmish
7K Followers
Ben Grimmer
@prof_grimmer
3K Followers
Aaron Defazio
@aaron_defazio
8K Followers
Sierra Team
@Sierra_ML_Lab
439 Followers
Mathieu Dagréou
@Mat_Dag
492 Followers
Damek
@damekdavis
6K Followers
Till Richter
@TillRichter6
217 Followers
Dirk L.
@Dirque_L
1K Followers
Robert M. Gower 🇺�...
@gowerrobert
2K Followers
Eduard Gorbunov
@ed_gorbunov
612 Followers
Adrien Taylor
@TaylorAdrien
435 Followers
Samuel Horváth
@sam_hrvth
287 Followers
Quentin Bertrand
@Qu3ntinB
1K Followers
Samuel Vaiter
@vaiter
3K Followers
Yann Traonmilin
@YTraonmilin
209 Followers