Nuit Blanche: A Technical Blog @NuitBlog
Defeating the curse of dimensionality one algorithm at a time. 7M+ pageviews so far..Also the Advanced Matrix Factorization Jungle page https://t.co/dpQgesm8SY nuit-blanche.blogspot.com Paris, France Joined April 2019-
Tweets1K
-
Followers404
-
Following210
-
Likes2K
It was not just a signal processing course. It was the compressive Sensing chapter!
It was not just a signal processing course. It was the compressive Sensing chapter!
It is with great sadness that the Simons Foundation announces the death of its co-founder and chair emeritus, James Harris Simons. Jim was an award-winning mathematician, a legendary investor and a generous philanthropist. simonsfoundation.org/2024/05/10/sim…
Thrilled to share the recording from my Simons Foundation Presidential lecture given last Wednesday. What else than: Statistical Physics of Machine Learning :). youtu.be/TLHYwbrhGJc?si…
📢 Our new work LESS leverages the observation that pretrained LLMs Attention has intrinsically sparse+lowrank structure. ☝️So at inference time, we can decompose KV Cache into constant sparse and RNN states (because lowrank attention is RNN). This also explains why the recent…
📢 Our new work LESS leverages the observation that pretrained LLMs Attention has intrinsically sparse+lowrank structure. ☝️So at inference time, we can decompose KV Cache into constant sparse and RNN states (because lowrank attention is RNN). This also explains why the recent…
L1 regularization for sparse solutions - as usually taught - is actually terrible in practice! I’m always surprised how few people know this. To get good results, retrain with the sparsity pattern found from the initial L1 run, but without the regularizer. Works much better.
L1 regularization for sparse solutions - as usually taught - is actually terrible in practice! I’m always surprised how few people know this. To get good results, retrain with the sparsity pattern found from the initial L1 run, but without the regularizer. Works much better.
Any papers in compressive Sensing?
🎉@LightOnIO introduces Mambaoutai 1.6B: A game-changer in AI! With the novel WSD learning rate scheduler & positional weighting, it sets new standards for efficiency & accuracy. Dive into the future of #AI_Language_Models with our latest blogpost➡️lighton.ai/fr/blog/blog-4…
Widgerson: Turing
People seem to think that Abe Wald's study on survivorship of WW2 planes amount to "shielding where there aren't holes". Zooming out from the question asked of him: the really efficient shielding was a slew of accompanying P51s. #MastersoftheAir
Tao: Fields medal Donoho: Gauss prize Candès: MacArthur Genius Parisi: Nobel prize Talagrand: Abel prize Who am I missing?
Tao: Fields medal Donoho: Gauss prize Candès: MacArthur Genius Parisi: Nobel prize Talagrand: Abel prize Who am I missing?
Michel Talagrand has been awarded the Abel Prize, one of the highest honors in mathematics, for applying tools from high-dimensional geometry to complex probability problems. @jordanacep reports: quantamagazine.org/michel-talagra…
It used to be similar in Compressive Sensing with Nuit Blanche. I was really uneasy about it sometimes.
It used to be similar in Compressive Sensing with Nuit Blanche. I was really uneasy about it sometimes.
Nick Higham's blog was a gold mine nhigham.com
Nick Higham's blog was a gold mine nhigham.com
Come as you are! lighton.ai/jobs
Come as you are! We have 🚀8 job openings 🚀 at @LightOnIO across various teams, technical and business. Join us into making Enterprise LLMs the only thing! Full remote OK for tech positions. lighton.ai/en/jobs
We are excited as well! The meetup link is here: meetup.com/lighton-meetup…
We are excited as well! The meetup link is here: meetup.com/lighton-meetup…
Come and join the discussion on long sequence generation of #LLMs (10am EDT). I'll talk about recent work on efficient LLM inference, e.g., H2O, StreamingLLM, Dejavu, from different perspectives: 1) Efficiency: reduce KVCache & weight IOs bottleneck 2) New ability: interesting…
Come and join the discussion on long sequence generation of #LLMs (10am EDT). I'll talk about recent work on efficient LLM inference, e.g., H2O, StreamingLLM, Dejavu, from different perspectives: 1) Efficiency: reduce KVCache & weight IOs bottleneck 2) New ability: interesting…
Dictionary learning works! Using a "sparse autoencoder", we can extract features that represent purer concepts than neurons do. For example, turning ~500 neurons into ~4000 features uncovers things like DNA sequences, HTTP requests, and legal text. 📄transformer-circuits.pub/2023/monoseman…
A day after David Donoho explains the acceleration of AI, the folks at @AnthropicAI come up with work showing that LLM encode knowledge in a compressive fashion. arxiv.org/abs/2310.00865
A day after David Donoho explains the acceleration of AI, the folks at @AnthropicAI come up with work showing that LLM encode knowledge in a compressive fashion. arxiv.org/abs/2310.00865 https://t.co/CpzBpLWpAs

Ulugbek S. Kamilov @ukmlv
4K Followers 2K Following Donald L. Snyder Associate Prof of EE/CS at WashU. Ex ENS Paris, Google, MERL, Stanford, MIT, CMU, EPFL. Tennis player. I don’t eat animals. Ўзбекча гапираман.
Gabriel Peyré @gabrielpeyre
102K Followers 453 Following @CNRS researcher at @ENS_ULM. One tweet a day on computational mathematics.Igor Carron @IgorCarron
5K Followers 6K Following CEO https://t.co/b9fz6WvhTx @LightOnIO Paris Machine Learning Meetup (8200+) @ParisMLGroup https://t.co/jY1eeMkqJE (10M+ pageviews) @NuitBlog Rocket Scientist
Computational Imaging... @washucig
1K Followers 157 Following Computational Imaging Group (CIG) at WashU. Computational Imaging, Biomedical Imaging, Optimization, and AI. Director @ukmlv.
Vivek Goyal @ProfessorGoyal
769 Followers 192 Following
Laurent Daudet @Laurent_Daudet
1K Followers 1K Following Prof @univ_paris_cite. Co-founder at https://t.co/7tBdXi7xiV. Co-author of Dream Machine graphic novel on AI. PP by @WorldOfHalahala
Michael Bronstein @mmbronstein
53K Followers 6K Following #DeepMind Professor of #AI @UniofOxford / Director #AITHYRA / Chief Scientist @vant_ai / https://t.co/kZpGpDzYeV (opinions are mine) 🤖🧪🧬🎶🐎
Laurent Duval (resear... @laurentduval
908 Followers 514 Following Terrible puns #datascience #machinelearning #science #radio #music #anagram @laurentduval.bsky.social @[email protected] Opinions are nine
sylvain Gigan @sylvaingigan
5K Followers 2K Following Prof. @ScienceSorbonne | PI @comedialkb @lkb_lab @ENSParis - account currently not in use.
Mario Figueiredo @mariotelfig
2K Followers 467 Following Distinguished Prof of ECE and Feedzai Prof of machine learning @istecnico, @itnewspt Professor, photographer, music lover, curious about almost everything.
𝗔𝘆𝘂𝘀𝗵 @AB2World
620 Followers 367 Following @MIT Alum • EEE Faculty, Imperial College London @imperialeee. Current work: •- Inverse Problems •- Unconventional Sensing/Imaging. (Not so regular on twitter)
Simone Scardapane @s_scardapane
12K Followers 657 Following I fall in love with a new #machinelearning topic every month 🙄 | Researcher @SapienzaRoma | Author: Alice in a diff wonderland https://t.co/A2rr19d3Nl
Delip Rao e/σ @deliprao
61K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈
Low-rank Jack (go mat... @jacquesdurden
557 Followers 369 Following Follow me on Mastodon: @[email protected] (link below) I do not post anything anymore here. Just exit the faXist network.
Waheed U. Bajwa @SigProcessing
1K Followers 1K Following Professor @RutgersNB | Director @RutgersECE INSPIRE Lab | Student of #SignalProcessing, #MachineLearning, and #Statistics | 🇵🇰🇺🇸 | Img: SCholewiak (flickr)
Brian Spears @bkspears9
1K Followers 1K Following Physicist | applied mathematician | (secretly mechanical engineer). Machine learning for inertial confinement fusion and more @Livermore_Lab.
Alex Dimakis @AlexGDimakis
21K Followers 2K Following Professor, UC berkeley | Founder @bespokelabsai |
Tom Goldstein @tomgoldsteincs
27K Followers 2K Following Professor at UMD. AI security & privacy, algorithmic bias, foundations of ML. Follow me for commentary on state-of-the-art AI.
Lei Tian @LeiTian14
2K Followers 4K Following Assoc. Prof. @BU_ece. Ex. MIT, UC Berkeley, Tsinghua U. working on computational imaging.
Complex Media Optics ... @comedialkb
2K Followers 317 Following *Now on bluesky* we are the "Complex Media Optics" team of @lkb_lab -Principal Investigators @sylvaingigan @DeAguiar_ENS .
Yuriy Dzyuba @dzyuba_yuriy
2 Followers 156 Following
Digant Solanki @digantsolanki1
43 Followers 825 Following Editor and Founder The Economist Next Door Student At BITS Pilani
Tao Yao @taoyao2005
13 Followers 226 Following
Simone Giancola @GiancolaSimone
91 Followers 780 Following "Trying" Theory of Neural Nets & Learning, and memes.
Roman @GillelandKristi
387 Followers 607 Following I don’t do bios. I do signal (σῆμα) ⟴ 🜁 Polymath (πολυμαθής) 🜂 Autodidact (αὐτοδίδακτος) 🜃 Witch (μάγισσα) What I touch ⟡ transforms
jimcaptain @d_kapetanios
167 Followers 8K Following
Nikolay Dandanov @NDandanov
7 Followers 259 Following
Gupteswar Kousholya (... @kousolya
80 Followers 877 Following Argus News Reporter Bissamcuttack Dist (Rayagada)
Aleksandar @abukva
90 Followers 240 Following
Guillaume Chossière @gChossiere
42 Followers 3K Following
Shahin @SKhobahi
119 Followers 1K Following
Guillaume "Vermeille"... @Vermeille_
306 Followers 352 Following vi/vim. AI must be really open: research & weight. Deep Learning & Vision PhD. LLM R&D @ LightOn. Libertarien. #JeSuisNicolas
OptYu @OptYu_HENU
0 Followers 50 Following
Matthias Schöning @Schoemat92
141 Followers 2K Following artist painting and design musician Intensive Care Unit Nurse food technologist butcher master sportsman
Chaurasiya @Chaurasiya5
1 Followers 724 Following
Michael Evans @TeamTock
547 Followers 2K Following TOCK Analytics (my math project and totally awesome vaporware company that has fun). Exploring the world of applied category theory. Proven critical systems.
Federica @fgerace_
43 Followers 68 Following
eclectic leaps @eclecticleaps
46 Followers 723 Following Eclectic interests including AI, media and complex systems. Making a splash is our purest form.
Matt S @TheOneMattS
7 Followers 119 Following
conan kinde @ConanKinde
0 Followers 4K Following
Tom Hebbron @tomhebbron
117 Followers 1K Following
Observer @onlyStarGazer
9 Followers 598 Following
Krzakala Florent @KrzakalaF
3K Followers 388 Following I like Physics, Statistics, Machine learning, Computer Science & above all playing 🎸. Happy dad 👧 👧. Also professor @ EPFL. Views are my own.
Muzaffer Kal @🏡 �... @MuzafferKal_
2K Followers 6K Following Chips: ASIC, FPGA. CV/ML. Duck pictures by the lake. Some bread making.
Andrew Ashworth @fluxatron
8 Followers 21 Following
John McGarry @eJohnMcg
439 Followers 149 Following I don’t have a point of view; know not where I’m going to.
Aaron Hardin @aihardin
361 Followers 1K Following a tangled bank of biology, computers, and star wars
Grey @nashaez78497
203 Followers 5K Following See the world on the road, and get to know yourself on the way!
Nullius in Verba @TrustNoClaims
16 Followers 237 Following
Minh Khôi @_minhkhoi
20 Followers 241 Following Graduated CS student, focusing on System and Machine Learning
Murat emre Erkoç @meerkoc
0 Followers 44 Following
Nguyễn Nhật Minh ... @_minhkhoi_
7 Followers 113 Following
Testish @Testish452224
2 Followers 92 Following
Jiaming Liu @Jiaming__Liu
285 Followers 843 Following PhD in EE,computational imaging group (CIG)@wustlcig , Washington University in St.Louis (WUSTL).
Vicente Parot @VicenteParot
573 Followers 1K Following Electro-biophysical-medical engineer-scientist and neuro-technologist at https://t.co/23UeYlV4XW
Ilan Fridman Rojas @irfnali1
473 Followers 4K Following Data Scientist. Former Theoretical physicist.
Dave Kammeyer @davekammeyer
3K Followers 1K Following CEO @ https://t.co/JcJkseseWg Computer Vision, Machine Learning for High Reliability Systems
Tan Minh Nguyen @TanNguyen689
1K Followers 740 Following Assistant Professor of Mathematics (Presidential Young Professor) at the National University of Singapore (@NUSingapore). #DeepLearning, #RobustAI, #ScalableAI
Ulugbek S. Kamilov @ukmlv
4K Followers 2K Following Donald L. Snyder Associate Prof of EE/CS at WashU. Ex ENS Paris, Google, MERL, Stanford, MIT, CMU, EPFL. Tennis player. I don’t eat animals. Ўзбекча гапираман.
Peyman Milanfar @docmilanfar
93K Followers 494 Following Distinguished Scientist at Google. Computational Imaging, Machine Learning, and Vision. Tweets = personal opinions. May change or disappear over time.
Gabriel Peyré @gabrielpeyre
102K Followers 453 Following @CNRS researcher at @ENS_ULM. One tweet a day on computational mathematics.
Yann LeCun @ylecun
949K Followers 764 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.Igor Carron @IgorCarron
5K Followers 6K Following CEO https://t.co/b9fz6WvhTx @LightOnIO Paris Machine Learning Meetup (8200+) @ParisMLGroup https://t.co/jY1eeMkqJE (10M+ pageviews) @NuitBlog Rocket Scientist
Lenka Zdeborova @zdeborova
15K Followers 450 Following Professor at EPFL. Une mathémaphysinformaticienne. Passionate mushroom hunter. Tamer of two little dragons.
Ben Recht @beenwrekt
32K Followers 336 Following optimization. machine learning. uc berkeley. I blog at https://t.co/fkJujOPsJb The world won't end.
Computational Imaging... @washucig
1K Followers 157 Following Computational Imaging Group (CIG) at WashU. Computational Imaging, Biomedical Imaging, Optimization, and AI. Director @ukmlv.
Yi Ma @YiMaTweets
101K Followers 488 Following Chair Prof. in AI, HKU; Visiting Prof. of EECS, UCB New book on Principles of Intelligence: https://t.co/leZlkURb7j
Vivek Goyal @ProfessorGoyal
769 Followers 192 Following
Laurent Daudet @Laurent_Daudet
1K Followers 1K Following Prof @univ_paris_cite. Co-founder at https://t.co/7tBdXi7xiV. Co-author of Dream Machine graphic novel on AI. PP by @WorldOfHalahala
Kyle Cranmer @KyleCranmer
17K Followers 3K Following Director Data Science Institute @UWMadison @datascience_uw. EiC @MLSTjournal. Physics, stats/ML/AI, open science. same handle @sigmoid.social and bsky
Pierre Vandergheynst @trekkinglemon
3K Followers 233 Following Educator, scientist. Dad+++. I dig data and tweet about autism awareness. Opinions my own.
Michael Bronstein @mmbronstein
53K Followers 6K Following #DeepMind Professor of #AI @UniofOxford / Director #AITHYRA / Chief Scientist @vant_ai / https://t.co/kZpGpDzYeV (opinions are mine) 🤖🧪🧬🎶🐎
Dan Roy @roydanroy
57K Followers 2K Following ML / AI researcher. Research Director and Canada CIFAR AI Chair, @VectorInst. Professor, @UofT (Statistics/CS).
Martin Vetterli @MartinVetterli
18K Followers 2K Following President and Professor of Engineering at @EPFL. My account is not active anymore, follow me on LinkedIn. Why? https://t.co/jsfKMNy4kL
Shubhendu Trivedi @_onionesque
9K Followers 895 Following Cultivated Abandon. Twitter interests: Machine learning research, applied mathematics, mathematical miscellany, ML for physics/chemistry, books.
Laurent Duval (resear... @laurentduval
908 Followers 514 Following Terrible puns #datascience #machinelearning #science #radio #music #anagram @laurentduval.bsky.social @[email protected] Opinions are nine
sylvain Gigan @sylvaingigan
5K Followers 2K Following Prof. @ScienceSorbonne | PI @comedialkb @lkb_lab @ENSParis - account currently not in use.
Mario Figueiredo @mariotelfig
2K Followers 467 Following Distinguished Prof of ECE and Feedzai Prof of machine learning @istecnico, @itnewspt Professor, photographer, music lover, curious about almost everything.
Federica @fgerace_
43 Followers 68 Following
Minh Khôi @_minhkhoi
20 Followers 241 Following Graduated CS student, focusing on System and Machine Learning
IEEE Trans. on Comput... @IEEE_TCI
623 Followers 271 Following Official account for the IEEE Trans. on Computational Imaging journal. Check out our spotlight talks: https://t.co/K2swm1kowl
Stanley H. Chan @stanley_h_chan
7K Followers 134 Following Professor | computational imaging | machine learning | Purdue ECE
Hilton B. de Aguiar @deAguiar_ENS
637 Followers 458 Following shooting lasers on milk and brain, all controlled by computers. currently @Lab Kastler-Brossel, ENS/Paris. thoughts r from hilton, not Paris. PI @comedialkb
Zhaoran Wang @zhaoran_wang
4K Followers 1K Following Associate Professor @NorthwesternU | PhD @Princeton | studying Reinforcement Learning
Jason Lee @jasondeanlee
18K Followers 4K Following Associate Professor at UC Berkeley. Former Research Scientist at Google DeepMind. ML/AI Researcher working on foundations of LLMs and deep learning.
Qi Lei @Qi_Lei_
4K Followers 1K Following Assistant professor in Math and Data Science, NYU, Postdoc at Princeton ECE, PhD from UT Austin, interested in machine learning, deep learning and optimization
Tom Goldstein @tomgoldsteincs
27K Followers 2K Following Professor at UMD. AI security & privacy, algorithmic bias, foundations of ML. Follow me for commentary on state-of-the-art AI.
Jia-Jie Zhu (hiring) @__jzhu__
802 Followers 453 Following Head of research group in optimization / machine learning at Weierstrass Berlin. Former postdoc in machine learning @MPI_IS Tübingen, PhD in optimization @UF.
Yoann Altmann @YoannAltmann
316 Followers 400 Following Professor at Heriot-Watt University, Computational Imaging & Bayesian inference. He/his
Quanquan Gu @QuanquanGu
16K Followers 2K Following Professor @UCLA, Pretraining and Scaling at ByteDance Seed | Recent work: Build AGI | Opinions are my own
Jiaming Liu @Jiaming__Liu
285 Followers 843 Following PhD in EE,computational imaging group (CIG)@wustlcig , Washington University in St.Louis (WUSTL).
Volkan Cevher @CevherLIONS
3K Followers 656 Following Associate Professor of Electrical Engineering, EPFL. Amazon Scholar (AGI Foundations). IEEE Fellow. ELLIS Fellow.
Ilan Fridman Rojas @irfnali1
473 Followers 4K Following Data Scientist. Former Theoretical physicist.
Tan Minh Nguyen @TanNguyen689
1K Followers 740 Following Assistant Professor of Mathematics (Presidential Young Professor) at the National University of Singapore (@NUSingapore). #DeepLearning, #RobustAI, #ScalableAI
Ernest Ryu @ErnestRyu
6K Followers 345 Following Professor of Mathematics at UCLA. Interested in deep learning and optimization.
Robert Pless @rbpless
995 Followers 794 Following Professor at GWU, Developer of @traffickcam and @projectRephoto, mercenary interest in glitter and contemporary art. BlueSky: @pless.bsky.social
typedfemale @typedfemale
38K Followers 532 Following a really exciting new account "advanced pytorch user" - @cHHillee alt: @typedalt
ISCS @ISCompSensing
118 Followers 88 Following The 2025 International Symposium on Computational Sensing (ISCS) will take place in Luxembourg in June 2-6 2025.
Sai Prasanna @prassu_gvb
13 Followers 105 Following
Sam Buchanan @_sdbuchanan
1K Followers 1K Following Postdoc @Berkeley_EECS, previously @TTIC_Connect, PhD @EE_ColumbiaSEAS. Representation learning, theory and practice
Kayhan Batmanghelich @kbatmang
707 Followers 864 Following Assistant Prof Boston University, ECE interested ML in healthcare in general for real world application
Princeton SML @PrincetonSML
968 Followers 173 Following Princeton University Center for Statistics and Machine Learning
Priyanka Nanayakkara @priyakalot
441 Followers 438 Following Postdoc at Harvard CRCS | privacy & visualization https://t.co/LavRZKZXbH
Sayash Kapoor @sayashk
10K Followers 2K Following CS PhD candidate @PrincetonCITP. I tweet about AI agents, AI evals, AI for science. AI as Normal Technology: https://t.co/5amOkqKDf2 Book: https://t.co/DabpkhNrcM
Momin M. Malik @MominMMalik
518 Followers 187 Following Data Science Postdoctoral Fellow @BKCHarvard. Critical data analysis, social statistics, network models.
Michael Lones @michael_lones
151 Followers 100 Following A mutualistic collection of cells. Also a @HeriotWattUni academic doing research into machine learning, bio-inspired computing and other interesting things.
Marta Serra @m_serra_garcia
2K Followers 770 Following Behavioral economist and associate professor at UCSD Rady School of Management
jake hofman @jakehofman
6K Followers 571 Following senior principal researcher at msr nyc, adjunct professor at columbia
Jessica Hullman @JessicaHullman
8K Followers 804 Following Ginni Rometty Prof @NorthwesternCS | Fellow @IPRatNU | Uncertainty & decisions | Somewhere between theory & practice | Blogger @statmodeling
Gilles Vandewiele @Gillesvdwiele
1K Followers 563 Following Co-founder https://t.co/78QOapXjFT. Kaggle Master. PhD in CS Eng. I like doing stuff with data & algorithms.
Brandon Stewart @b_m_stewart
1K Followers 534 Following Associate Professor of Sociology, Princeton University
Arvind Narayanan @random_walker
124K Followers 492 Following Princeton CS prof. Director @PrincetonCITP. I use X to share my research and commentary on the societal impact of AI. BOOK: AI Snake Oil. Views mine.
Pavel Shtykovskiy @framrus
95 Followers 1K Following Particle physics and astrophysics -» predicting ad clicks at Yandex -» spoken language understanding -» LLM-powered NPCs at https://t.co/A3vXLHYYGN
Nina Jelїazkova @10705013
367 Followers 2K Following "civilization advances by extending the number of operations we can perform without thinking about them" 🐙
Bruno Loureiro @_brloureiro
587 Followers 634 Following Researcher at @ENS_ULM working on the crossroads between machine learning and statistical physics.
Aufinal @Aufinal
89 Followers 293 Following Assistant Professor in statistics @Ensai35, social-democrat, esports addict
Christian Szegedy @ChrSzegedy
41K Followers 3K Following #deeplearning, #ai research scientist. Opinions are mine.
Yaroslav Bulatov @yaroslavvb
8K Followers 930 Following [email protected] (ex-Google Brain, OpenAI, Meta) New Blog: https://t.co/SLix8Hrt4w Old Blog: https://t.co/Ur3GWKpmp6
Dongdong Chen @ddongchen
161 Followers 170 Following Assistant Professor @HeriotWattUni, Edinburgh. I like machine learning and imaging inverse problems.
Michael P. Sheehan @mpsheehan1995
49 Followers 140 Following PhD student researching Statistical and Compressive Learning at the University of Edinburgh.
Philippe Ciuciu @Philippe_Ciuciu
736 Followers 650 Following Director of Research @Neurospin (CEA) & Inria MIND in neuroimaging & neuroscience. CS-MRI, scale-free brain dynamics (MEG and fMRI).
Arthur Mensch @arthurmensch
51K Followers 860 Following Co-founder and CEO @MistralAI. Talk to le Chat https://t.co/ZMZG8rAlWz https://t.co/ydSK6xG4Ce https://t.co/b1uf0UK5U8