Stathis V. @techabilly
ml @stripe - but actually a 🤖 in disguise - ( )( )( ) offbit.github.io San Francisco, Ca Joined February 2010-
Tweets2K
-
Followers553
-
Following2K
-
Likes4K
1/n Multi-token prediction boosts LLMs (DeepSeek-V3), tackling key limitations of the next-token setup: • Short-term focus • Struggles with long-range decisions • Weaker supervision Prior methods add complexity (extra layers) 🔑 Our fix? Register tokens—elegant and powerful
Curious about how LLMs work? I discussed our recent research, and how to apply circuit tracing to answer arbitrary questions about how models work. We also snuck in a demo of an open source tool you can use today, and shared tips about getting into the field! Check it out!
Curious about how LLMs work? I discussed our recent research, and how to apply circuit tracing to answer arbitrary questions about how models work. We also snuck in a demo of an open source tool you can use today, and shared tips about getting into the field! Check it out!
The @stripe product keynote just finished! We announced a lot of new stuff. (We actually couldn't fit everything into the keynote.) Some highlights: • We've built and deployed the first general-purpose Payments Foundation Model. Trained on tens of billions of transactions and…
TL;DR: We built a transformer-based payments foundation model. It works. For years, Stripe has been using machine learning models trained on discrete features (BIN, zip, payment method, etc.) to improve our products for users. And these feature-by-feature efforts have worked…
Introducing the Stripe Economics of AI Fellowship: The economics of AI remains surprisingly understudied. The fellowship aims to help fill that gap, by supporting grad students and early-career researchers with $, data, a conference, and community –
We’ve added /llms.txt and Markdown to @stripe docs: docs.stripe.com/llms.txt Use the .md pages to quickly move Stripe knowledge into your LLM of choice. 📄
I'm so *wildly* excited to finally be able to share that I have joined Pacific Fusion and I'm starting an AI team! PF is the product of a rare alignment of a bunch of exceptional events. The result? A realistic path to fusion energy in years instead of decades. Story time! 🧵
I'm so *wildly* excited to finally be able to share that I have joined Pacific Fusion and I'm starting an AI team! PF is the product of a rare alignment of a bunch of exceptional events. The result? A realistic path to fusion energy in years instead of decades. Story time! 🧵
Big congratulations to the team @TryCoveAI !! They've put a lot of effort into creating a unique way to interact with LLMs.
Big congratulations to the team @TryCoveAI !! They've put a lot of effort into creating a unique way to interact with LLMs.
🚀 Today, we're thrilled to introduce Cove, a groundbreaking interface for thinking brilliantly with AI, and announce our seed round led by @sequoia Cove is not a chatbot. It’s AI unconstrained by a chat thread or document editor. See it in action:
Catch me if you can! Announcing Llama-rephraser: 13B models reaching GPT-4 performance in major benchmarks (MMLU/GSK-8K/HumanEval)! To validate results, we followed OpenAI's decontamination method and found no evidence of contamination...🤔 Blog: lmsys.org/blog/2023-11-1… [1/n]
Want to run LLMs locally on your Laptop?🤖💻 Here's a quick overview of the 5 best frameworks to run LLMs locally: 1. Ollama Ollama allows you to run LLMs locally through your command line and is probably the easiest framework to get started with. Just use the installer or the…
Today we’re opening access to Adept Experiments 🧪, a new way to explore the technology we are developing at Adept. Each experiment is a self-contained mini-tool or demo that showcases a part of our underlying tech. adept.ai/blog/experimen…
Myself and @kylelostat have just released peS2o 🍃🎓, a collection of 40M open-access papers carefully cleaned for LLM training. V1 has been used by @MosaicML to train MPT, and we have a V2 version! @huggingface page: huggingface.co/datasets/allen… feedback? github.com/allenai/peS2o/…
The #LLMs for Code Seminar is launching this week! 🧠 Join us online: bit.ly/LLMs-for-Code-… #AI4Code #LLMs4Code
Heard someone say “I don’t want to waste brain space on learning Chinese” PSA—that’s not how it works at all. Consistently *retrieving* information both deepens connections with the rest of your knowledge and frees up resources & working memory for more abstract thought. 🧵
I’m thrilled to announce that @carbon_re has raised a $4.8m seed round! We’ve been sitting on this news for a while to sort out all the legal bits, but we can finally share it around 🚀 It will help us grow the team, serve more customers, and kickstart an AI research group! 1/🧵
Unfortunate article in The Nation, the venerable US lefty mag, that appears not to have been fact-checked, so let’s do that fact-checking, shall we? There are 10 main claims made by author Paul Hockenos, so it’ll take a bit of a chonky🧵. But here goes: thenation.com/article/world/…
May I invite you to a fun thread about a delightful quirk of relativity theory? Starting with a simple fact about rotations, I’ll hope to give you some intuition about something that’s considered wildly counterintuitive: velocity addition. Intrigued? Buckle up!

Nathan Benaich @nathanbenaich
61K Followers 34K Following solo member of investment staff @airstreet @airstreetpress @stateofaireport @raais
yobibyte @y0b1byte
23K Followers 2K Following ViTaly, yobibyte, senior RS @ NVIDIA, Reinforcement Learning PhD from @UniofOxford, ex RS at Isomorphic Labs, intern @ MSR Cambridge, DeepMind, Facebook, NVIDIA
Eliyah Paz @EliyahPaz
17 Followers 142 Following
Kimon Fountoulakis @kfountou
2K Followers 90 Following Associate Professor at CS UWaterloo Machine Learning and AI Lab: https://t.co/Yrb5b8lwrT
Dwauawie @Dwauawie521434
13 Followers 935 Following
Torey Becker @ToreyB62285
44 Followers 3K Following
Hilma Runolfsson @HRunolfsso86332
27 Followers 2K Following
Boapoh @Boapoh374
10 Followers 803 Following
Braumau @Braumau5987687
12 Followers 924 Following
James Baker @baker_jame67841
1 Followers 46 Following
Isuupcos @Isuupcos81418
27 Followers 2K Following
Ody42 @ody42_
0 Followers 1K Following
Herman Waters @HermanWate90406
40 Followers 2K Following
Pensé FFun @inftyCategory
136 Followers 7K Following
Iris @MadisonGib72959
53 Followers 2K Following
Will Franceys @willfranceys
20 Followers 340 Following Independent ML Engineer and Data Scientist. Focussed on production data science. Formerly at @Expedia, @Channel4. Opinions are my own.
Lasse Mejlvang Tvedt @LasseLasseTime
198 Followers 653 Following Creative Technologist, https://t.co/Zb0X8sjBa6
Franco Battaglia @francobatta11
167 Followers 606 Following All abstractions are leaky https://t.co/XCErUzqMKA Software Engineer former✈️ @DespegarIng, ❤️ @Producteca
Anthony Roche @Anthony2389782
49 Followers 1K Following
Alejandro Romero @ale_romero0
498 Followers 997 Following Researcher @Banxico | Economist @CIDE_MX | Programming Technician @IPN_MX | Data Science, Antitrust Policy, and Financial Inclusion
Arun Jothi K @ArunJothi__1_BC
22 Followers 654 Following class ArunJothiK: def __init__(self): self.title = Red_Teaming_Specialist self.role = CED_Forensics self.location =National_Resident
Ryan @Ryan65125113
2 Followers 275 Following
Yousef Amirghofran @YAmirghofran
419 Followers 2K Following cs @IEUniversity | creator https://t.co/G1PaC82PZ5 learning & building with Go. studying Machine Learning.
Kevin L @kvnlpez
133 Followers 856 Following building supply chain AI Agent Hub | PhD in computational Neuroscience
Dhruv Shah @dhruvshah1214
319 Followers 1K Following search @openai prev: @palantirtech, @pennmandt.
Ubaid @ubaidmume
328 Followers 7K Following Students use AI for answers but don't actually learn - I'm fixing that
Chris Sperandio @sperand_io
4K Followers 5K Following building coplane, the agentic and auditable back office. previously, product @segment and corp dev @stripe.
Les Grossman @0xLes
718 Followers 4K Following
SoÐaPop @ImpulsiveDoge
2K Followers 1K Following Biomech tech. If you go down, we go down together. It's a Republic, not a Democracy. Fusion Ignition. Feedback, Feedback, Feedback. Gl, hf, dd.
seb @datauzi
212 Followers 822 Following data/growth human. lift+run w/o the fuss. chef in spirit. beat making for the love of the game.
𝕀.𝕍. 🌞 @deepstatenjoyer
4K Followers 904 Following artificial intelligence. deep state enjoyer. permabull. this is all comedy 🎭 haha 😆
Gabriele 🇪🇺 @thegalluzz
63 Followers 630 Following
devrecipes @dev_recipes
1 Followers 165 Following
Andrej Karpathy @karpathy
1.4M Followers 1K Following Building @EurekaLabsAI. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets.
Ferenc Huszár @fhuszar
42K Followers 1K Following Secular Bayesian. Professor of Machine Learning @Cambridge_CL. Talent aficionado at https://t.co/RbJkoLguey Alum of @Twitter, Magic Pony and @Balderton
Wojciech Zaremba @woj_zaremba
119K Followers 204 Following Co-Founder of OpenAI https://t.co/OCQ3mpf0IN
François Chollet @fchollet
572K Followers 813 Following Co-founder @ndea. Co-founder @arcprize. Creator of Keras and ARC-AGI. Author of 'Deep Learning with Python'.
David Pfau @pfau
29K Followers 2K Following Knowledge manifests itself in radiant dreams that shimmer like the wild sun Views are my own https://t.co/xqtVHHVI17 on 🦋
AK @_akhaliq
425K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo ,submit papers here: https://t.co/UzmYN5YmrQ
Nathan Benaich @nathanbenaich
61K Followers 34K Following solo member of investment staff @airstreet @airstreetpress @stateofaireport @raais
Google DeepMind @GoogleDeepMind
1.2M Followers 279 Following We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.
Kyunghyun Cho @kchonyc
77K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre physicist at @nyuniversity (@CILVRatNYU) & @PrescientDesign
Yann LeCun @ylecun
949K Followers 764 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
Jürgen Schmidhuber @SchmidhuberAI
163K Followers 0 Following Invented principles of meta-learning (1987), GANs (1990), Transformers (1991), very deep learning (1991), etc. Our AI is used many billions of times every day.
Soumith Chintala @soumithchintala
250K Followers 1K Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.
Patrick McKenzie @patio11
184K Followers 801 Following I work for the Internet and am an advisor to @stripe. These are my personal opinions unless otherwise noted.
Durk Kingma @dpkingma
50K Followers 405 Following @AnthropicAI. Prev. @Google Brain/DeepMind, founding team @OpenAI. Computer scientist; inventor of the VAE, Adam optimizer, and other methods. ML PhD.
yobibyte @y0b1byte
23K Followers 2K Following ViTaly, yobibyte, senior RS @ NVIDIA, Reinforcement Learning PhD from @UniofOxford, ex RS at Isomorphic Labs, intern @ MSR Cambridge, DeepMind, Facebook, NVIDIA
ℏεsam @Hesamation
36K Followers 575 Following ai engineer | rigorously overfitting on a learning curve
SemiAnalysis @SemiAnalysis_
34K Followers 16 Following
Sam Schoenholz @sschoenholz
7K Followers 666 Following @thinkymachines previously: @openai, google brain.
Alexander Wei @alexwei_
24K Followers 193 Following Reasoning @OpenAI. Co-built CICERO @MetaAI | @Berkeley_AI PhD '23 | @Harvard '20
davidad 🎇 @davidad
20K Followers 9K Following Programme Director @ARIA_research | accelerate mathematical modelling with AI and categorical systems theory » build safe transformative AI » cancel heat death
Rohan Pandey @khoomeik
38K Followers 2K Following descending cross-entropy to ascend entropy || prev research @OpenAI @CarnegieMellon '23
Luca Soldaini 🎀 @soldni
11K Followers 1K Following I like tokens! I lead the OLMo data team at @allen_ai w/ @kylelostat. Open source is fun 🤖☕️🍕🏳️🌈 Opinions are sampled from my own stochastic parrot
Albert Gu @_albertgu
18K Followers 88 Following assistant prof @mldcmu. chief scientist @cartesia_ai. leading the ssm revolution.
gabriel @GabrielPeterss4
35K Followers 485 Following research sora at @OpenAI, previously at midjourney, swedish high school dropout
Andre Saraiva @andresnds
3K Followers 138 Following o1-preview, o1-mini, o1, o3-mini,o4-mini, o3... Reasoning Researcher at OpenAI. Ex-DeepMind.
Casper Hansen @casper_hansen_
10K Followers 457 Following NLP Scientist | AutoAWQ Creator | Open-Source Contributor
Quentin Anthony @QuentinAnthon15
4K Followers 268 Following I make models more efficient. Google Scholar: https://t.co/kzVsAKPLgX
Kevin Lu @_kevinlu
9K Followers 216 Following @thinkymachines. formerly: - @openai: RL, synthetic data, efficient models - @berkeley_ai: decision transformer, universal computation
The Humanoid Hub @TheHumanoidHub
64K Followers 737 Following Humanoid Robots: Technology, Business, and Social Dynamics
Hanna Hajishirzi @HannaHajishirzi
9K Followers 443 Following Sr. Director of AI at @allen_ai, Prof at @uw_cse, lead OLMo, Tulu
Piotr Nawrot @p_nawrot
8K Followers 264 Following LLM Efficiency PhD @ Edinburgh | 🥇🥈 @ Flunkyball Polish Championships | 🥇 @ Jerry Hunter Pub's Bowling Tournament | 50000 🏆 & Legendary II @ Brawl Stars
Jack Morris @jxmnop
45K Followers 974 Following research @cornell @meta // language models, information theory, science of AI
Mark Chen @markchen90
64K Followers 333 Following Chief Research Officer at @OpenAI. Coach for the USA IOI Team.
Tatiana @ZePoLiTaT
657 Followers 1K Following Research Scientist @GoogleDeepMind - GenMedia - Veo 🇨🇴
Google Research @GoogleResearch
20K Followers 5 Following Impossible? Let’s see. From algorithms to neuroscience to AI, Google Research strives to progress science, advance society & improve billions of people’s lives.
Issam @AshtonIzmev
405 Followers 1K Following Partner & CTO at 34 Ventures | alpha self-improv e/acc https://t.co/O0SqC9MT6g
Joe Tegtmeyer 🚀 �... @JoeTegtmeyer
79K Followers 730 Following https://t.co/VR6w0U0PY5 CFI pilot. Drone videos about Giga Texas & Starbase. Interested in all things space related! Mayor of Cyber Beach!
MiniMax (official) @MiniMax__AI
18K Followers 11 Following Our mission is to build a world where intelligence thrives with everyone. MiniMax Agent: https://t.co/XzaTmAos0V
Sophia Yang, Ph.D. @sophiamyang
30K Followers 2K Following Head of Developer Relations @MistralAI | Board of @NumFOCUS
Vinod Khosla @vkhosla
690K Followers 600 Following entrepreneurship zealot, grounded technology possibilist, believer in the power of ideas, passionate about sustainability & impact
Brad Gerstner @altcap
177K Followers 1K Following Founder - Altimeter Capital. Luck befalls the curious mind. Counting life in days and acts of kindness. Views here personal.
Louis Kirsch @LouisKirschAI
2K Followers 781 Following Driving the automation of AI Research. Project Lead & Research Scientist @GoogleDeepMind. PhD @SchmidhuberAI. @UCL, @HPI_DE alumnus. All opinions are my own.
Shenzhi Wang🌟 @ShenzhiWang_THU
1K Followers 428 Following PhD Candidate @Tsinghua_Uni | Author of 🔥Beyond 80/20 Rule 🔥Avalon’s Game of Thoughts | Core Developer of 🔥Xwen-7B&72B-Chat🔥Llama3-8B&70B-Chinese-Chat
Aaron Begg @aaron_begg
4K Followers 2K Following @AnthropicAI | Chat with Claude: https://t.co/7w2gEKteuC | Build with Claude: https://t.co/ktsbQNA9D2
Lisan al Gaib @scaling01
21K Followers 655 Following lead them to paradise | intelligence is inherently about scaling | be kind to us AGI
Jack Parker-Holder @jparkerholder
8K Followers 779 Following Co-lead of Genie 3 @GoogleDeepMind & Honorary Associate Professor @UCL_DARK. Dad (👶🐶), CFC fan, BJJ. Views are my own :)