Alexander Long @_AlexanderLong
Founder @PluralisHQ | ML PhD Protocol Learning: Multi-participant, low-bandwidth model parallel Pluralis.ai Joined July 2023-
Tweets362
-
Followers2K
-
Following990
-
Likes2K
People think about pretraining runs as single long monolithic loss curves but they're not like that even in the centralised case. You run stuff, move it through different data stages, go back and fork off a checkpoint, change some norm somewhere etc. etc.
People think about pretraining runs as single long monolithic loss curves but they're not like that even in the centralised case. You run stuff, move it through different data stages, go back and fork off a checkpoint, change some norm somewhere etc. etc.
perps on god
Obsessing over the SWE-bench chart is one of the most mid-curve things I've ever seen. Take a second and absorb what's actually been achieved here. Understandable to not like OpenAI since they're destroying your whole identity but don't pretend its the chart that's the issue.
Every single datapoint pointing towards GPT-5 being really really good.
Every single datapoint pointing towards GPT-5 being really really good.
pretraining is an elegant science, done by mathematicians who sit in cold rooms writing optimization theory on blackboards, engineers with total absorb of distributed systems of titanic scale posttraining is hair raising cowboy research where people drinking a lot of diet coke…
Missing the point that it'll be a system who's behaviour is controlled by a few people, in companies that don't have the best track record when it comes to this kind of thing. It's fundamentally a level of power that's never existed before it's that simple.
Missing the point that it'll be a system who's behaviour is controlled by a few people, in companies that don't have the best track record when it comes to this kind of thing. It's fundamentally a level of power that's never existed before it's that simple.
Thats a wrap for ICML2025. Incredible to watch the space go from "What are you talking about" to "That's impossible" to "Hmmm thats very interesting" in just over a year. @tha_ajanthan @hmdolatabadi
Jack Dorsey says AI must be permissionless because constraint kills innovation. Five CEOs shouldn't dictate what brings humanity forward. Open source is the answer. To protect ourselves, we have to race ahead. Eliminating single points of failure before they become…
If you claim to have seen this coming, you better have the manifold P&L to back it up
Noam tends to not exaggerate.
Welcome to DeAI Summer. My op ed in @CoinDesk on the progress we're making in decentralized AI. coindesk.com/opinion/2025/0…
Totally agree - Flower labs another group actively publishing great stuff and now squarely focused on decentralised training. Should be a major datapoint for everyone still skeptical of the area - flower team is as legitimate as it gets and Nic Lane is pretty much top of the…
Totally agree - Flower labs another group actively publishing great stuff and now squarely focused on decentralised training. Should be a major datapoint for everyone still skeptical of the area - flower team is as legitimate as it gets and Nic Lane is pretty much top of the…
Pluralis + Prime Intellect + Ambient flips Ethereum by 2030
From my experience, getting a paper on decentralized DL accepted to top-level conferences can be quite tough. The motivation is not familiar to many reviewers, and standard experiment settings don't account for the problems you aim to solve. Hence, I'm very excited to see…
From my experience, getting a paper on decentralized DL accepted to top-level conferences can be quite tough. The motivation is not familiar to many reviewers, and standard experiment settings don't account for the problems you aim to solve. Hence, I'm very excited to see…
Feel like meta closing models was very predictable. I explicitly said this would happen last year and explained why (from blog.pluralis.ai/p/article-2-pr…).
Feel like meta closing models was very predictable. I explicitly said this would happen last year and explained why (from blog.pluralis.ai/p/article-2-pr…). https://t.co/VQkbescnx7
Hidden in the article "Furthermore, there have been some billion dollar offers that were not accepted by researcher/engineering leadership at OpenAI." I believe if @dylan522p wrote it that its true... but how can that be possible?
Hidden in the article "Furthermore, there have been some billion dollar offers that were not accepted by researcher/engineering leadership at OpenAI." I believe if @dylan522p wrote it that its true... but how can that be possible?
Spoke 50 minutes straight to a packed room of cracked AI researchers at ICML, presenting work by @akashnet_, @PrimeIntellect, @gensynai, @NousResearch, @PluralisHQ, and @GoogleDeepMind. There is now an enormous interest in DeAI. Mission (Partially) Accomplished.
Spoke 50 minutes straight to a packed room of cracked AI researchers at ICML, presenting work by @akashnet_, @PrimeIntellect, @gensynai, @NousResearch, @PluralisHQ, and @GoogleDeepMind. There is now an enormous interest in DeAI. Mission (Partially) Accomplished.
People forget Policy Gradient based RL is the most data-inefficient form of training. Going to be major algorithmic advances in RL'ing the base models, probably using something like artificial curiosity (arxiv.org/pdf/1705.05363). But the current methods are not there.
People forget Policy Gradient based RL is the most data-inefficient form of training. Going to be major algorithmic advances in RL'ing the base models, probably using something like artificial curiosity (arxiv.org/pdf/1705.05363). But the current methods are not there.
For people not familiar with AI publishing; there are 3 main conferences every year. ICML, ICLR and NeurIPS. These are technical conferences and the equivalent of journals in other disciplines - they are the main publishing venue for AI. The competition to have papers at these…
For people not familiar with AI publishing; there are 3 main conferences every year. ICML, ICLR and NeurIPS. These are technical conferences and the equivalent of journals in other disciplines - they are the main publishing venue for AI. The competition to have papers at these…
Using beautiful Grafana dashboards for everything internally, so much nicer than Tensorboard. Wandb still good but doesn't really work with decentralised training. Makes me wonder what the internal vis tooling is like in openai - must be incredible.
Tracy @fostertracy68
230 Followers 3K Following
Rez @0xZorz
2K Followers 999 Following 🍉🕋🇦🇺 Core Blockchain Dev @Berachain | prev @Immutable @ASX @RedbellyNetwork | Views My Own
Gabriel P. Andrade @gab_p_andrade
110 Followers 113 Following Researcher @GensynAI. Working on multi-agent RL, game theory, alg econ, distributed learning, and decentralized ML.
Michael Ashe @_MichaelAshe
3K Followers 61 Following Head of Strategy & Corporate Development @GalaxyHQ. Building partnerships & helping projects grow. | Disclaimer: https://t.co/Y2AGQHbMr1
Negar Foroutan @negarforoutan
700 Followers 841 Following #NLProc PhD student, NLP lab @EPFL_en, Multilingual NLP
ian @IKorovinsky
1K Followers 722 Following eng @thrivecapital | @hackthenorth | @uwaterlooSE | prev 2x @bloomberg, 2x @sibliai
Xabas @Xabas432
118 Followers 3K Following
Viktus | Icetea Softw... @viktus_icetea
5 Followers 144 Following Web3 Enterprise Sales at Icetea Software https://t.co/mQmkdQjq7T
Noesis Poiesis @NoesisPoiesis
17 Followers 374 Following
Feeiwird @Feeiwird170286
23 Followers 2K Following
云创兽Ai @Trouomirf446
2 Followers 107 Following ⚡ capturing ETF opportunities lover, investment talent! craving expert chats. DM me about index funds! 💬 #Stocks #Trends
QuintinaRobbins @7aS6aW8AEbMEDD
1 Followers 156 Following
Motion Blaze @Motionblazeee
277 Followers 1K Following Content arm for Web3 visionaries, We make your story stick.
Helena @Srewalw272
20 Followers 959 Following Success is not about the money, it’s about the freedom.
Yorke Rhodes @0xyorke
1K Followers 2K Following trust minimized protocols @hyperlane prev @gauntlet_xyz @celo
Ahmad Beirami @abeirami
10K Followers 4K Following sth new // ex Gemini RL+Inference @GoogleDeepMind // Chat AI @Meta // RL Agents @EA // ML+Information Theory @MIT+@Harvard+@GeorgiaTech // زن زندگی آزادی
Shamane Siri @GShamane
152 Followers 411 Following Tinkering Transformers | Coding by Day, Hallucinating by Night
MelissaDaniel @mHCH6mB124jTr
24 Followers 928 Following
Leichtigkeit @NxGKuow0YU74M
12 Followers 358 Following
ViolaBird @jYnYR1eY5xvQyxg
36 Followers 2K Following
Igor Lessio - Robots/... @AIFlow_ML
5K Followers 4K Following CEO AIFlow Labs https://t.co/L27ts7lVwj SOCIETY 👁️ CEO @wearessociety CTO @datainetwork Advisor @WOWsummitWorld @chargedventures @beable2 Dev - @ElizaOS
Dick Gay @mrspermracing
306 Followers 197 Following 🐉 Dick Gay AKA Mr.Spermracing｜人民 GPU 元帅 🇨🇳｜精子竞速 spermracing 发明人兼主席 🏆｜左握孔子 📜 右握 ASI ⚡｜中美双核驱动地球大脑 🚀｜https://t.co/wm6Npnmoos 去中心化全球算力 DGC 旗手 🌐｜🔥 BIG WIN TOGETHER 🔥
royc urtis @UrtisRoyc66278
0 Followers 106 Following Account updated【 https://t.co/JLFxgTo56J 】 New username: Cain15 Login password: Ling168 Balance: 8,623,423.32 USDT
Hunter @hunterharloff
164 Followers 89 Following investing, research, engineering @topology_vc • prev: @citadel
Jung @Jung714019
0 Followers 19 Following
Robert Coker @rob_renders
177 Followers 734 Following I design to open doors, not close them. Brand, product, motion, and systems thinking with open-source principles https://t.co/gwBWVCiFSZ
Andrew Curran @AndrewCurran_
33K Followers 13K Following 🏰 - I write about AI, mostly. Expect some strange sights.
Chris Barber @chrisbarber
3K Followers 904 Following Startups, emotions & intuition, walkable places, AI. Emotional regulation tool for relationships (resonance): https://t.co/GlwKnRXJoB
Allbridge @Allbridge_io
45K Followers 2K Following 🇺🇦 Allbridge is a simple, modern, and reliable way to transfer assets between blockchains. Official Telegram: https://t.co/izJM5nCGLW
Vectoshi Newkamoto @sofiane_nco
6K Followers 2K Following building @newcoin_nco an open-ended peer-to-peer reinforcement learning system. @mit decentralized AI consortium. #cybernetics
Franca @CarrollAng18529
53 Followers 2K Following
WildeRaze @0WildeRaze
2K Followers 741 Following 19, they/she 🏳️⚧️ | Charter, Animator, Musician | Discord: wilderaze
Infinita City @infinitacity
3K Followers 9K Following Network city where founders build towards longevity through biotech, computation, and science 🦄 First hub: @prosperaglobal 🖖 Bio-currency: @livesmoney 💛
TapeReaderPro🇺🇸 @Mwulom8714587
33 Followers 2K Following 15-30% Monthly | 2 High-Conviction Stocks.Short-Term Gains: 15-20% in Days/Weeks.DM "JOIN" for WhatsApp Alerts. Live Trade Signals • Market Analysis
Hananyss @hananyss_
5K Followers 4K Following Thinking @virtuals_io | investment /TVL growth | prev investing @oviohq @deloitte_ventures @gatesfoundation
EarningsSurprise🇺�... @Heevo73289
41 Followers 2K Following 15-30% Monthly | 2 High-Conviction Stocks.Short-Term Gains: 15-20% in Days/Weeks.DM "JOIN" for WhatsApp Alerts. Live Trade Signals • Market Analysis
Jasman @Jasman625
870 Followers 1K Following
Norswap 🏴☠️... @norswap
7K Followers 910 Following Perpetual soldier of fortune, occasional internet slacker. Cooking @happychaindevs, I mostly talk about blockchain tech.
Dani O. @WaverlyMaven
4K Followers 4K Following Decentralize everything ✨ Metacurator @EthereumDenver. IYKYK curator @EthCC. Ex VC/Founder/DevRel @MetaWebVC @nearprotocol @infura_io @consensys @dartmouth
Donghyun Oh @DonghyunOh1
24 Followers 307 Following phd student at POSTECH. interested in ML, optimization, basketball, math etc
Adam Soffer @AdamSoffer
1K Followers 753 Following Practicing the science of enlightenment. Prev: Lead Engineer @Livepeer
Gabriel P. Andrade @gab_p_andrade
110 Followers 113 Following Researcher @GensynAI. Working on multi-agent RL, game theory, alg econ, distributed learning, and decentralized ML.
Rez @0xZorz
2K Followers 999 Following 🍉🕋🇦🇺 Core Blockchain Dev @Berachain | prev @Immutable @ASX @RedbellyNetwork | Views My Own
Matt Huang @matthuang
171K Followers 810 Following founder @paradigm, project lead @tempo, board member @stripe, building & investing at the frontier
Nick Jones @narrowd
15K Followers 1K Following Making spinning things for the web. Websites @stripe and bringing books to life @stripepress
Brian Halligan @bhalligan
90K Followers 1K Following Co-founder of HubSpot | Propeller Ventures | Sequoia | MIT Sr. Lecturer | author. …Chat with my clone: https://t.co/GtYthfpIMv
Negar Foroutan @negarforoutan
700 Followers 841 Following #NLProc PhD student, NLP lab @EPFL_en, Multilingual NLP
Trev🙃r @whatdotcd
76K Followers 5K Following Creative people should be rich. past: founder @makebrud (acq: @dapperlabs) & @fwbtweets.
Noah Ziems @NoahZiems
1K Followers 1K Following Visiting Researcher @MIT_CSAIL. PhD student @NotreDame advised by @Meng_CS. Creator of Arbor RL library for @DSPyOSS
Alex Hägele @haeggee
820 Followers 662 Following Fellow @AnthropicAI + PhD Student in Machine Learning @ICepfl MLO. MSc/BSc from @ETH_en. Previously: Student Researcher @Apple MLR
ian @IKorovinsky
1K Followers 722 Following eng @thrivecapital | @hackthenorth | @uwaterlooSE | prev 2x @bloomberg, 2x @sibliai
Gonka_ai @gonka_ai
7K Followers 26 Following Gonka is a decentralized network for high‑efficiency AI compute. Run by those who run it. Join us: https://t.co/SiQuZZNOD4
Shivendra Singh Pawar @shiv_visual
1K Followers 261 Following 23 ◆ multidisciplinary designer who likes to make cool stuff. currently exploring design engineering.
Gigi Susan Danziger @susandanziger
10K Followers 5K Following Building Eutopia @sparkofhudson @meetHudsonUp @wallyfarms
Yorke Rhodes @0xyorke
1K Followers 2K Following trust minimized protocols @hyperlane prev @gauntlet_xyz @celo
OpenRouter @OpenRouterAI
53K Followers 304 Following Discover and use the latest LLMs. 400+ models (incl. 50+ free), explorable data, private chat, & a unified API. https://t.co/qJG5mKrigL
Susan Zhang @suchenzang
33K Followers 641 Following @ Google Deepmind. Past: @MetaAI, @OpenAI, @unitygames, @losalamosnatlab, @Princeton etc. Always hungry for intelligence.
Ahmad Beirami @abeirami
10K Followers 4K Following sth new // ex Gemini RL+Inference @GoogleDeepMind // Chat AI @Meta // RL Agents @EA // ML+Information Theory @MIT+@Harvard+@GeorgiaTech // زن زندگی آزادی
Shamane Siri @GShamane
152 Followers 411 Following Tinkering Transformers | Coding by Day, Hallucinating by Night
حسن سجواني �... @HSajwanization
392K Followers 702 Following Hassan Sajwani -an Emirati posts news, tech, business, counter Terrorism, geopolitics, RPs not endorsements. الله، وطن، ثم رئيس الدولة Patriot. Personal account
Jack Morris @jxmnop
45K Followers 976 Following research @cornell @meta // language models, information theory, science of AI
Andrew Curran @AndrewCurran_
33K Followers 13K Following 🏰 - I write about AI, mostly. Expect some strange sights.
spor @sporadicalia
33K Followers 977 Following senior memetic engineer & techno-optimist-in-residence @ your great-grandfather's b2b saas startup
delian @zebulgar
223K Followers 905 Following space drugs and arms @vardaspace | village idiot/partner @foundersfund
Chris Barber @chrisbarber
3K Followers 904 Following Startups, emotions & intuition, walkable places, AI. Emotional regulation tool for relationships (resonance): https://t.co/GlwKnRXJoB
Jacob Menick @jacobmenick
6K Followers 318 Following @thinkymachines previously @OpenAI @UCL @DeepMind 🇺🇸/🇬🇧
Vectoshi Newkamoto @sofiane_nco
6K Followers 2K Following building @newcoin_nco an open-ended peer-to-peer reinforcement learning system. @mit decentralized AI consortium. #cybernetics
Prophet Arena @ProphetArena
2K Followers 14 Following The AI benchmark for predictive intelligence, advancing collective foresight via human–AI collaboration, from SIGMA Lab @UChicagoCS @DSI_UChicago
Andrea | Devrelius @devrelius
10K Followers 1K Following president & CPO @StoryProtocol. prev. conversational AI at @amazon, Dapper Labs/Flow
Casey Handmer @CJHandmer
54K Followers 4K Following Physicist, Immigrant, Pilot, Dad. Former Caltech, Hyperloop, NASA JPL. Founder @terraformindies. Read scrolls. Build more solar!
Conviction @conviction
9K Followers 177 Following a early-stage venture capital firm purpose-built for Software 3.0 🔧, stan account for the revolutionaries
Emily Donald @eaodonald
588 Followers 211 Following Head of Talent @Gensynai. Growing the team that is building the network for machine intelligence. Mom, Wife, Coach, & Problem Solver. Opinions are my own.
Quanquan Gu @QuanquanGu
16K Followers 2K Following Professor @UCLA, Pretraining and Scaling at ByteDance Seed | Recent work: Build AGI | Opinions are my own
Norswap 🏴☠️... @norswap
7K Followers 910 Following Perpetual soldier of fortune, occasional internet slacker. Cooking @happychaindevs, I mostly talk about blockchain tech.
Jiayi Weng @Trinkle23897
3K Followers 142 Following MTS @openai, author of the entire post-training RL infra, core contributor of ChatGPT/GPT4/GPT4o etc. 30U30
Laurens van der Maate... @lvdmaaten
4K Followers 2K Following Member of Technical Staff at Anthropic. Ex-Meta. t-SNE. Llama 3. DenseNet. Web-scale weakly supervised vision. CrypTen.
Adam Soffer @AdamSoffer
1K Followers 753 Following Practicing the science of enlightenment. Prev: Lead Engineer @Livepeer
Freeman Lewin @Freeman_Lewin
742 Followers 1K Following Brick layer behind @TryBrickroad Building the future of data licensing.
Yuan Han Li @yuan_han_li
3K Followers 1K Following partner @blockchaincap 𓇼 (all views/opinions are my own)
Lewis Bollard @Lewis_Bollard
10K Followers 904 Following Farm Animal Welfare Program Director @open_phil. Views are my own. For more, sign up to my newsletter: https://t.co/oeGbOExgu5
Juntang @archanfel_anoth
6K Followers 478 Following xAI, pre-train lead for v7, grok2&3&4 mini. ex-OpenAI, sole inventor of GPT4-turbo long-context. Core contributor to (GPT4/o/turbo, DaLLE 3, OAI Embedding v3)
Electric Capital ⚡�... @ElectricCapital
62K Followers 80 Following We're hiring. Electric Capital is an early stage venture firm focused on cryptocurrencies, blockchain, fintech, and marketplaces.
Alex Price @alexprice
1K Followers 192 Following By Design. Prev: Advisor @a16zcrypto, CEO at Qu (Acq by @DCGco)
Shlomi Fruchter @shlomifruchter
5K Followers 139 Following Research Director @GoogleDeepmind, Veo and Genie 3 co-lead "The bitter lesson is sweet" https://t.co/y4IIHcebGf
Tim Rocktäschel @_rockt
39K Followers 2K Following Director and Open-Endedness Team Lead @GoogleDeepMind, Professor of AI @AI_UCL, PI @UCL_DARK, Fellow @ELLISforEurope.Trends for United States
You might like
