Sparse Hash AI @sparse_hash_ai
Sparse Hash AI Joined April 2021-
Tweets220
-
Followers5
-
Following133
-
Likes2K
Sometimes I find pure gold
RetoMaton is a neuro-symbolic framework that adds a symbolic memory layer to LLMs, built as a weighted finite automaton, on top of a frozen LLM to guide retrieval in a structured, interpretable, and reliable way So reasoning becomes more stable, transparent, and reliable.…
Can AI help understand how the brain learns to see the world? Our latest study, led by @JRaugel from FAIR at @AIatMeta and @ENS_ULM, is now out! 📄 arxiv.org/pdf/2508.18226 🧵 A thread:
Pleasant and humorous atmosphere.
I asked nano banana to take me across Middle-earth and this is what happened... all the details on how I made this video, below 🧵👇
A classic paper - "An Introduction to Autoencoders" covers the mathematics and the fundamental concepts of autoencoders. Autoencoders function by encoding data into a smaller representation through a neural network and then reconstructing it. This approach is often used for…
A nice and compact 101 page Matrix Calculus book on arxiv. introduces the extension of differential calculus to functions on more general vector spaces. focuses on practical computational applications, such as large-scale optimization and machine learning, where derivatives…
The paper proposes Token Order Prediction, an extra training signal that boosts next token modeling across many tasks. Instead of predicting exact future tokens like Multi-Token Prediction, it ranks vocabulary items by how soon they will appear within a window. This ranking…
Great paper from Sakana AI. Introduces Model Merging of Natural Niches (M2N2) An evolutionary merging method that fuses skills by evolving boundaries, preserving diversity, and pairing complementary parents. It drops fixed layer groups, uses random split points that grow over…
A new attention mechanism, Dynamic Sparse Attention, just dropped. The authors' evaluation is extensive, showing good performance. with DSA the model generates its attention mask, and an efficient kernel saves computation. Cool work! 🔗arxiv.org/pdf/2508.02124
attention sinks may be a bias in causal transformers. as some of you know, i've been writing a long blogpost on attention and its properties as a message-passing operation on graphs. while doing so, i figured i might have found an explanation for which attention sinks may be an…
LLM embedding spaces quietly compress many meanings into a small shared space that mirrors human judgments. 3D subspace captures about 50% of semantic variance. Psychology shows people judge words along a few axes, like how positive, how powerful, and how active. The authors…
I just came across this excellent blog post about the recent results we published about the capabilities of the new type of AI we are building (no deep learning!) at the @1000brainsproj 🤖 🧠 : gregrobison.medium.com/hands-on-intel…
1/ 🚨 @hojaeklee_tbp responds to "How Does a Reference Frame in Monty Differ From a Feature Map in a Convolutional Neural Network?" #AI #Neuroscience #ThousandBrains #SensorimotorAI
"Ninio's extinction illusion" There are twelve dots at crosses, but only a few dots are visible simultaneously. Ninio, J. & Stevens, K. A. (2000). Variations on the Hermann grid: an extnction illusion. Perception, 29, 1209-1217.
👨🔧 Github: CoreNN. Database for querying billions of vectors and embeddings in sublinear time on commodity machines. 1 billion Reddit comment embeddings in 15 ms from a 4.8 TB index on disk - Uses cheap flash storage, not expensive DRAM, costing 40x–100x less. - Scales from 1…
Beautiful Midjourney video. --- reddit. com/r/midjourney/comments/1mv3j2w/paint_world_9/
At MIT, I learned about RNNs in my NLP class with Prof. Michael Collins. He built a model from my keystrokes to predict who I was. To me, it felt like a magic box. Years later, when I had to teach RNNs, I forced myself to go inside the box. ⬇️ Download: byhand.ai/rnn…
One of the best resource on Reinforcement Learning ❤️ A classic 216 page overview covering the basic fundamentals of RL. The paper maps RL clearly, showing how agents learn good behavior from rewards and experience. The agent observes a situation, chooses an action, receives…
A classic 129 page paper/book from 2024. Frames entropy as missing information, then shows how physics quantifies and uses it. It starts from a concrete puzzle: hydrogen gas at room conditions carries about 23 bits of unknown information per molecule. Shannon entropy measures…
Stéphane Deny @StphTphsn1
4K Followers 7K Following Neuroscience & ML researcher. Posting about various topics on here. Tag me for a retweet.
Tiгpa @t_igra
13 Followers 244 Following
Fawshoos @Fawshoosol4Kou
25 Followers 538 Following
huze @HuzeYann
250 Followers 310 Following CS PhD @Penn, ex-CTFer / {{ $cv }} {{ $brain }} / Brain Encoding Model / 研究よりハンド / any pronounce
Fenil Doshi @fenildoshi009
610 Followers 2K Following PhD student @Harvard and @KempnerInst studying biological and machine vision | object perception | mid-level vision | cortical organization
Andrew Saxe @SaxeLab
5K Followers 381 Following Prof at @GatsbyUCL and @SWC_Neuro, trying to figure out how we learn. Bluesky: @SaxeLab Mastodon: @[email protected]
zed @zmkzmkz
4K Followers 1K Following #1 paperclip maximizer fan, occasionally on x-games mode. I really, really like watching loss graphs go down
Chris Olah @ch402
122K Followers 181 Following Reverse engineering neural networks at @AnthropicAI. Previously @distillpub, OpenAI Clarity Team, Google Brain. Personal account.
Samuel Vaiter @vaiter
3K Followers 324 Following @CNRS Researcher in maths & computer science. My (current) focus is machine learning and optimization.
Reborn @reborn_agi
8K Followers 392 Following The open ecosystem for AGI robots. https://t.co/QpUF4jsec3
Petar Veličković @PetarV_93
41K Followers 555 Following Senior Staff Research Scientist @GoogleDeepMind | Affiliated Lecturer @Cambridge_Uni | Assoc @clarehall_cam | GDL Scholar @ELLISforEurope. Monoids. 🇷🇸🇲🇪🇧🇦
Pramod Goyal @goyal__pramod
8K Followers 287 Following Trying to change the world one line at a time
Yaroslav Bulatov @yaroslavvb
8K Followers 930 Following [email protected] (ex-Google Brain, OpenAI, Meta) New Blog: https://t.co/SLix8Hrt4w Old Blog: https://t.co/Ur3GWKpmp6
Dirk Gütlin @DirkGutlin
1K Followers 1K Following Biologically plausible Neural Networks. Neuroscience, ML/AI, Complex Systems, Time Series, Stats, etc... PhD Candidate @CCNBerlin https://t.co/d5s0FqjKrb
CLaE @leafs_s
28K Followers 10K Following Neuroscience,Insular cortex, Neurobiology RT≠endors I do not reply to direct messages mstdn: @[email protected] Bluesky: @claeneuro.bsky.social
Thousand Brains Proje... @1000brainsproj
781 Followers 287 Following Reverse engineering the neocortex 🧠 to revolutionize AI 🤖. An open-source initiative backed by Jeff Hawkins and The Gates Foundation.
Viviane Clay @vkakerbeck
625 Followers 422 Following Director, Thousand Brains Project. Dr. rer. nat in Cognitive Computing. #neuroscience #EmbodiedAI #sensorimotor
Soran Ghaderi @soranghadri
221 Followers 754 Following Looking for PhD position | Reasoning 🧠💻 (Diffusion/EBMs/Flow-based/RL) | AI MSc @uni_of_essex GitHub: https://t.co/PBFenZJVnR | 🍒 cuRBLAS/🍓 TorchEBM libs
SpaceX @SpaceX
39.9M Followers 120 Following SpaceX designs, manufactures and launches the world’s most advanced rockets and spacecraft
Jaan Aru @jaaanaru
5K Followers 1K Following Raising two kids, running a lab & trying to do some funky research on the intersection of neuroscience, psychology and AI. 🇪🇪
Berfin Simsek @bsimsek13
774 Followers 388 Following Research fellow @FlatironCCM & @NYU, previously: Ph.D. @EPFL, intern @MetaAI. DL Theory 😎, Math 🥰, AI 🤗 Slowly migrating to @bsimsek.bsky.social
Valentin Schmutz @schmutz_val
218 Followers 238 Following Theoretical Neuroscientist | 🔎 Emergent neural population dynamics | Postdoc in Carandini-Harris lab @UCL | PhD from Gerstner lab @EPFL
Flavio Martinelli @FlaviohMar
160 Followers 440 Following I like brains 🧟♂️ 🧠 PhD student in computational neuroscience @compneuro_epfl
Qihong Lu | 吕其鸿 @Qihong_Lu
1K Followers 2K Following Computational models of learning and memory; Postdoc: @DShohamy @StefanoFusi2 @cu_neurotheory @ZuckermanBrain; PhD: @ptoncompmemlab @HassonLab @Princeton
Timothy Nguyen @IAmTimNguyen
12K Followers 449 Following Machine learning researcher at @GoogleDeepMind & mathematician. Host of The Cartesian Cafe podcast. All opinions are my own.
David Sussillo @SussilloDavid
13K Followers 838 Following Neural reverse engineer. Research scientist at Meta Reality Labs. Adjunct prof at Stanford. Prev: Google Brain, Stanford postdoc. Milton Hershey Alum.
Xiaolong Wang @xiaolonw
18K Followers 1K Following Associate Professor @UCSDJacobs Postdoc @berkeley_ai PhD @CMU_Robotics
Joe Pemberton @JoePemberton9
104 Followers 145 Following Postdoc in computational neuroscience at the University of Washington
Rui Ponte Costa @somnirons
3K Followers 1K Following Computational neuroscientist bringing machine and neural learning closer together @OxNeuro @OxfordDPAG | #firstgen | @ERC_Research Grantee 🇵🇹🇪🇺🇬🇧🌳
Kevin Frans @kvfrans
4K Followers 503 Following @berkeley_ai @reflection_ai prev mit, read my thoughts: https://t.co/7CZsOTrKRA
Simone Scardapane @s_scardapane
12K Followers 657 Following I fall in love with a new #machinelearning topic every month 🙄 | Researcher @SapienzaRoma | Author: Alice in a diff wonderland https://t.co/A2rr19d3Nl
François Fleuret @francoisfleuret
45K Followers 487 Following Research Scientist @meta (FAIR), Prof. @Unige_en, co-founder @nc_shape. I like reality.
Arnaud Pannatier @ArnaudPannatier
1K Followers 281 Following PhD Student @francoisfleuret 's Machine Learning Group Idiap Research Institute - @Idiap_ch EDIC EPFL - @EPFL_en
Erik Jenner @jenner_erik
918 Followers 152 Following Research scientist @ Google DeepMind working on AGI safety & alignment
William Merrill @lambdaviking
5K Followers 668 Following Incoming Assistant Prof, Toyota Technical Institute at Chicago @TTIC_Connect Recruiting PhD students (start 2026) 👀 Will irl - TC0 enthusiast
Sebastian Risi @risi1979
9K Followers 1K Following Researching @ ITU Copenhagen, @SakanaAILabs, Co-founder @ https://t.co/EeVHNpCcDq. Collective Intelligence | Self-Organizing AI | Neuroevolution. ERC GROW-AI.
Rhys Gould @rgould0
70 Followers 29 Following Science of deep learning // Part III theoretical physics at Cambridge (4th year) // Incoming CS PhD at UC Berkeley
Wes Gurnee @wesg52
3K Followers 229 Following Trying to read Claude’s mind. Interpretability at @AnthropicAI Prev: Optimizer @MIT, Byte-counter @Google
Josh Engels @JoshAEngels
1K Followers 117 Following Mech interp @GoogleDeepMind | on leave from my PhD @MIT. Let's use interp to make models safer today
Tanishq Mathew Abraha... @iScienceLuvr
80K Followers 1K Following CEO @SophontAI | Founder @MedARC_AI | PhD at 19 (2023) | ex Research Director Stability AI | Biomed. engineer @ 14 | TEDx talk➡https://t.co/xPxwKTq6Qb
Ethan @torchcompiled
9K Followers 841 Following trying to feel the magic. cofounder/research at @leonardoai_ (now at @canva).
Rohan Paul @rohanpaul_ai
83K Followers 8K Following Compiling in real-time, the race towards AGI. 🗞️ Don't miss my daily top 1% AI analysis newsletter directly to your inbox 👉 https://t.co/6LBxO8215l
elvis @omarsar0
263K Followers 664 Following Building with AI agents @dair_ai • Prev: Meta AI, Galactica LLM, Elastic, PaperswithCode, PhD • I share insights on how to build with AI Agents ↓
Thomas Ahle @thomasahle
8K Followers 736 Following Head of AI @NormalComputing. Ex @Meta, @BARCdk, SupWiz, @OxfordQuantum. Tweets on Math, AI, #dspy, Probability, ML, Algorithms and Randomness. Recently tensors.
Valeriy M., PhD, MBA,... @predict_addict
35K Followers 5K Following Experienced Data Science Leader | PhD in Machine Learning | 4x Author | Black Belt 🥋 in Time Series | Chief Conformal Prediction Promoter| Mathematician |
Hao AI Lab @haoailab
4K Followers 345 Following Hao AI Lab at UCSD. Our mission is to democratize large machine learning models, algorithms, and their underlying systems.
Vlado Boza @bozavlado
2K Followers 206 Following second of his name. Destroyer of ML hype. I also enjoy making neural networks smaller. https://t.co/nt7zlGRYROTrends for United States
You might like
