Andy J Yang @pentagonalize
Joined May 2020-
Tweets170
-
Followers140
-
Following996
-
Likes3K
"A calculator app? Anyone could make that." Not true. A calculator should show you the result of the mathematical expression you entered. That's much, much harder than it sounds. What I'm about to tell you is the greatest calculator app development story ever told.
Rare footage of the brilliance of Zakir Hussain
BPE is a greedy method to find a tokeniser which maximises compression! Why don't we try to find properly optimal tokenisers instead? Well, it seems this is a very difficult—in fact, NP-complete—problem!🤯 New paper + P. Whittington, @GregorBachmann1 :) arxiv.org/abs/2412.15210
Drop by @pentagonalize's poster tomorrow on the relationship between transformers and first-order logic! neurips.cc/virtual/2024/p… Wed 4:30-7:30 East Exhibit Hall A-C #2310
Excited to head to @NeurIPSConf today! I'll be presenting our work on the representational capabilities of Transformers and RNNs/SSMs. If you're interested in meeting up to discuss research or chat, feel free to reach out via DM or email!
First-time NeurIPS attendee here! Super excited to talk about our paper with @yveitsman, @mhahn29 and to discover the amazing work by everyone else :D neurips.cc/virtual/2024/p…
First-time NeurIPS attendee here! Super excited to talk about our paper with @yveitsman, @mhahn29 and to discover the amazing work by everyone else :D neurips.cc/virtual/2024/p…
A new gate was needed at the South Bend airport, so officials decided to upgrade the business center at the same time. southbendtribune.com/story/news/202…
📜New preprint w/ @nlpnoah and @yanaiela that evaluates the novelty of LM-generated text using our n-gram search tool Rusty-DAWG 🐶 Code: github.com/viking-sudo-rm… Paper: arxiv.org/abs/2406.13069
Stick-Breaking Attention: Out-of-box length extrapolation, thanks to removing the position embedding; Better performance than Softmax+RoPE on almost every task; Similar efficient implementation like Flash Attention. Do we still need Softmax+RoPE for Language Models?…
Automata ; Robotic arm
The World's First Transformer ASIC You ask, “What would you do with 500,000 tokens per second?” Build real AI applications! Current inference limitations hold us back from doing anything beyond immediately generating the first response for users. etched.com
❓ Thank You, Stingray ❓ Today’s LLMs are so powerful with strong general problem solving capabilities spanning across multiple languages. But, can LLMs disambiguate the semantic meaning across different languages? Our new paper delves deeper to answer this very question!
When do transformers length-generalize? Generalizing to sequences longer than seen during training is a key challenge for transformers. Some tasks see success, others fail — but *why*? We introduce a theoretical framework to understand and predict length generalization.
Joint work with @pentagonalize, Dana Angluin, Peter Cholak, and Anand Pillay
Joint work with @pentagonalize, Dana Angluin, Peter Cholak, and Anand Pillay
Fabの続き。タマコロへの変形まとめて変換しました。テーマ決めてやったほうがモチベあがっていいかも。これで4分の1くらいは終わったかな。カブクワが多いので標本みたいに一つにまとめたほうがいいかもな〜
Fabの続き。タマコロへの変形まとめて変換しました。テーマ決めてやったほうがモチベあがっていいかも。これで4分の1くらいは終わったかな。カブクワが多いので標本みたいに一つにまとめたほうがいいかもな〜 https://t.co/yzJZdecU9L
What makes some LM interpretability research “mechanistic”? In our new position paper in @BlackboxNLP, @sarahwiegreffe and I argue that the practical distinction was never technical, but a historical artifact that we should be—and are—moving past to bridge communities.
Pigmy hippopotamus Designed by Busi Folded by Monica #origami
Congratulations to @taguchi_c for winning a @lucy_institute Societal Impact Award for his work on creating language technologies for the Kichwa language community in Ecuador! @ND_CSE youtube.com/watch?v=HjsNOE…
Francine @Irxirlu6780
22 Followers 1K Following Your value doesn’t decrease based on someone’s inability to see your worth.
Antonis Anastasopoulo... @anas_ant
3K Followers 2K Following Assist. Prof at George Mason CS #nlproc MT, ASR, and documentation of endangered languages.
Godelieve @MZ7I28gBT9H78
22 Followers 1K Following
llvmvsllm @llvmvsllm
4 Followers 251 Following
Nahid Hasan @shishir9159
15 Followers 414 Following
Kenton Murray @kentonmurray
968 Followers 807 Following Natural Language Processing Research Scientist JHU. | PhD from Notre Dame. | Formerly at QCRI, CMU, and Princeton.
Chloellipop @lolo_glimmerz
160 Followers 1K Following Third graders in class, but I'm craving grown men after. Slide nasty in DMs, Vermont. 💌
Joshua Ackerman @b_l_c_k
113 Followers 1K Following CS PhD Student at Dartmouth, B.S. in Discrete Math from Carnegie Mellon. Focused on AI for cyber security with a growing interest in global security.
Louisa Conwill @louisaconwill
179 Followers 114 Following PhD candidate at @nd_cse. Bringing philosophical + religious traditions into ethical HCI. Formerly @focuscatholic and @amazon. @BrownUniversity and @asij alum.
AnarchEmber 🏳️�... @emberceptible
36 Followers 695 Following What if we kissed while destroying gender? | Bad back baddie | they/xe/she | 28, queer, leftist, t4t | 21+ please, MDNI
David Atkinson @diatkinson
230 Followers 1K Following PhD student @KhouryCollege. AI interpretability. Previously @EpochAIResearch.
Jackson Petty @jowenpetty
1K Followers 887 Following the passionate shepherd, to his love • ἀρετῇ • מנא הני מילי
galvanize (gail weiss... @gail_w
1K Followers 320 Following Trying to get off of here, dms checked rarely. Better to send an email postdoc, understanding neural networks. https://t.co/lnaKoR7vmc .
Narutatsu (Edward) Ri @narutatsuri
423 Followers 246 Following PhD Student @PrincetonPLI | BS @Columbia ‘24
alcuin ❄️ @scheminglunatic
6K Followers 1K Following pure, lazy, immutable ✝️ "In programming language theory, there is only moral correctness." 🐱👉investi(gati)bg ... #TRAD_801 and #AuDHD_NetSlop 🐢🦀🦥❄️🍛🐓
Ofir Press @OfirPress
15K Followers 6K Following I build tough benchmarks for LMs and then I get the LMs to solve them. SWE-bench & SWE-agent. Postdoc @Princeton. PhD @nlpnoah @UW.
Herbert Zhou @zh_herbert_zhou
89 Followers 159 Following 3rd year PhD @YaleLinguistics; Computational psycholinguistics.
Alexander Clark @alexandersclark
2K Followers 2K Following Linguist, philosopher, computer scientist, foodie, wine geek etc. I follow some people I disagree with. Don’t interpret my likes please.
Tom McCoy @RTomMcCoy
4K Followers 581 Following Assistant professor @YaleLinguistics. Studying computational linguistics, cognitive science, and AI. He/him.
⟦Simon Charlow⟧ @SimonCharlow
727 Followers 884 Following
Yana Veitsman @yveitsman
42 Followers 117 Following Research assistant - https://t.co/JL0k36OEQ1 Master student @LstSaar
Ruochen Zhang @ruochenz_
798 Followers 2K Following Interning @cohere, PhDing @Brown_NLP & @health_nlp, working on multilingual NLP and interpretability. Prev: Undergrad @sutdsg, she/they
Xinting Huang @huangxt233
132 Followers 124 Following PhD student https://t.co/9nBzEDGpxu currently working on interpretability of neural models https://t.co/5aNeNJBqnF
🌤️ beagle.bsky.s... @beagles_bagel
428 Followers 3K Following a genderqueer monkey that's figured out how to use every single computer program. i am without the binery, they/them. put alt text on yer memes.
Michael Hanna @michaelwhanna
613 Followers 438 Following PhD student at the University of Amsterdam / ILLC, interested in computational linguistics and (mechanistic) interpretability. Current Anthropic Fellow.
Eva Louise Marie Gabr... @e681554349
11 Followers 7K Following
Jun (Richard) Wang @AI_richard
36 Followers 1K Following
utkarsh @utkarsh_2105
661 Followers 2K Following he/him | CS undergrad BITS Pilani | (distributed, large, fast and so on) Systems for ML @MSFTResearch, prev @Inria
Yakmaz @yYakmazz
331 Followers 6K Following
Yining Lu @Yining__Lu
212 Followers 540 Following Second year CS PhD student @NotreDame | Intern: @amazon | Prev: @JHUCLSP 🦋: https://t.co/gPXvdPuesy
Ningzhi Tang @TangNingzhi
136 Followers 513 Following Ph.D. Student @ND_CSE | HCI+SE+AI | B.Eng. @SUSTechSZ
Ken Sible @kensible
35 Followers 110 Following PhD Student in Computer Science at University of Notre Dame
Yash Sarrof @yashYRS
136 Followers 144 Following Research Assistant https://t.co/iSGrDEoxG6 Pursuing Masters in NLP @LstSaar
Kantism-Chomskyism @improved_ends
121 Followers 2K Following
Mark Rofin @ ICML @broccolitwit
99 Followers 260 Following Research assistant at https://t.co/YkJnuIppPm & NLP student at @LstSaar
Michael Hahn @mhahn29
1K Followers 864 Following Professor at Saarland University @LstSaar @SIC_Saar. Previously PhD at Stanford @stanfordnlp. Machine learning, language, and cognitive science.
Marco🍞 @good_in_theory
254 Followers 1K Following I like computers, Korean, and computers-and-Korean. Language+keyboard stuff @Google PhD student @chokkanorg lab Interested in high school CS education.
King Randall, I. @NewEmergingKing
184K Followers 2K Following Leader, Teacher, and Guide for The X for Boys. 💪🏿👑 No labels necessary. Discover. 🌍 Email: [email protected]
thebes @voooooogel
15K Followers 885 Following "peaceful, albeit ominous" ꙮ website → https://t.co/aykxqKippW ꙮ games → https://t.co/3Pz19vHOwd ꙮ 💞💍📝 @holotopian ꙮ she/they 🏳️⚧️
Binh Pham @pham_blnh
715 Followers 417 Following building robots @humancomplab | website: https://t.co/6HUS3fdQkl | youtube: https://t.co/tmo0vX4Des
Adam Tauman Kalai @adamfungi
2K Followers 86 Following
Gilad @giladturok
988 Followers 3K Following CS phd student @cornell_tech 🐻 | probabilistic ml research 🤖 | novelty seeker 🤠 | Prev: @Uber @FlatironInst @Columbia
Your Friend Andy @OhHaiAndy
81K Followers 389 Following I like magic internet money and passive income.
yuwen lu @yuwen_lu_
3K Followers 3K Following visiting researcher @midjourney | phd candidate @nd_cse, human-ai interfaces, creativity, design | x-intern @apple, @google
Antonis Anastasopoulo... @anas_ant
3K Followers 2K Following Assist. Prof at George Mason CS #nlproc MT, ASR, and documentation of endangered languages.
Tinaᛏᛁᚾᚨ ከ�... @ninja_lt60
3K Followers 603 Following Linguistics and the world's ancient classics Architecture.Ancient tomb structures 𐎢𐎰𐎠𐎵𐎺𐎴𐎡𐎹𐏐𐎺𐏀𐎼𐎣𐏐🏹 ᠮᡳᠨᡳ ᠪᡝᡵᡳ ᡩᡝ ᡠᠯᡳ ᠪᡝ ᡨᡝᠪᡠᡥᡝᠪᡳ🏹ᚠᛁᛗᛁᚱ ᚨ ᛒᛟᚷᚨ🏹
heiner @HeinrichKuttler
18K Followers 1K Following Pretraining @xAI. Previously: @InflectionAI, @AIatMeta, @DeepMind, @Google, @LMU_Muenchen, PhD math-ph. Opinions my own. (Can be yours for a small fee.)
Lance Fortnow @fortnow
6K Followers 370 Following Professor. Complexity Theorist @iitcomputing @[email protected] @lance.fortnow.com
maria @avramidou
357 Followers 421 Following philosophy @uniofoxford / prev. physics @ucl, applied maths & stats @cambridge_uni
David Atkinson @diatkinson
230 Followers 1K Following PhD student @KhouryCollege. AI interpretability. Previously @EpochAIResearch.
Jack Lindsey @Jack_W_Lindsey
6K Followers 237 Following Neuroscience of AI brains @AnthropicAI. Previously neuroscience of real brains @cu_neurotheory.
Hideaki Sakaguchi @MannequinsJapon
933 Followers 49 Following SENSUAL MODERN COSTUMES designer / pattern maker /杉野学園ドレスメーカー学院特任教授/ 主に日々の制作を 📸https://t.co/FjZ7Rbh7RU
Shai Shalev-Shwartz @shai_s_shwartz
3K Followers 174 Following Computer Science @HebrewU; CTO @Mobileye #selfdrivingcars #ai #machinelearning Opinions are my own.
Yuxi on the Wired @layer07_yuxi
3K Followers 72 Following [email protected]:~$ whoami tech enby (agi/asi pronouns) (math ⊗ physic ⊗ comput).ist
Kenton Murray @kentonmurray
968 Followers 807 Following Natural Language Processing Research Scientist JHU. | PhD from Notre Dame. | Formerly at QCRI, CMU, and Princeton.
isabelle 🪐 @isabelleboemeke
85K Followers 945 Following Building a rad future with nuclear electricity | @isodope
Liv Boeree @Liv_Boeree
267K Followers 561 Following Host of the Win-Win Podcast. Slaying Moloch & Chasing Horizons 🚀 🌳🦾
🇺🇦 Dzmitry Bahd... @DBahdanau
10K Followers 37 Following Team member at something young. Adjunct Prof @ McGill. Member of Mila, Quebec AI Institute. Stream of consciousness is my own.
Agrim Gupta @agrimgupta92
6K Followers 320 Following Simulating reality @GoogleDeepMind | co-created: Veo2, Genie3, WALT | prev PhD @Stanford
Dimitris Papailiopoul... @DimitrisPapail
20K Followers 1K Following Researcher @MSFTResearch, AI Frontiers Lab; Prof @UWMadison (on leave); learning in context; thinking about reasoning; babas of Inez Lily.
Silvi Rouskin @silvirouskin
9K Followers 643 Following Asst. Prof. at Harvard Medical School. #RNA biology#viruses #AI # https://t.co/Ihy7mZhjL5 @harvardmicro ; opinions are my own. https://t.co/9lMkSHvpn9
Rabbit Lovers Communi... @RabbitLoversUSA
21K Followers 1K Following I have always wanted a bunny and I'll always have a rabbit the rest of my life. 🇺🇸🇺🇸 🛍 Rabbit Lovers Shop Here 👇
CAV @confCAV
796 Followers 0 Following 37th International Conference on Computer-Aided Verification. July 21-25, 2025 in Zagreb 🇭🇷. Publicity Co-Chairs: @ferhaterata & @frenkel_hadar. Use #cav25
Owain Evans @OwainEvans_UK
16K Followers 360 Following Runs an AI Safety research group in Berkeley (Truthful AI) + Affiliate at UC Berkeley. Past: Oxford Uni, TruthfulQA, Reversal Curse. Prefer email to DM.
Alexander Wei @alexwei_
24K Followers 193 Following Reasoning @OpenAI. Co-built CICERO @MetaAI | @Berkeley_AI PhD '23 | @Harvard '20
Chenxiao Yang @chenxiao_yang_
140 Followers 89 Following PhD @ TTIC, Working on LLM Reasoning, ML/DL Theory, Graph Learning
Psyho @FakePsyho
25K Followers 367 Following Game Designer; Problem Solver; past: OpenAI (Dota), Pro Competitive Programmer, Poker
Images AI Could Never... @imagesaicouldnt
295K Followers 169 Following a collection of memes that are uniquely human
Crystal @crystalsssup
11K Followers 603 Following Staff @Kimi_Moonshot prev. co-maker of ModelizeAI & gemsouls "Personality goes a long way" @UCSanDiego
spicypunk @bethgenewang
1K Followers 846 Following Mediocrity has gravity playing an infinite repeated game @_theresidency
Albert Gu @_albertgu
18K Followers 88 Following assistant prof @mldcmu. chief scientist @cartesia_ai. leading the ssm revolution.
noahdgoodman @noahdgoodman
5K Followers 158 Following Professor of natural and artificial intelligence @Stanford. Alignment at @GoogleDeepMind. (@StanfordNLP @StanfordAILab etc)
Mathieu @miniapeur
34K Followers 2K Following Non-member of the technical staff. Gradient surfer by day, Möbius stripper by night. PhD @ai_ucl. Non-professional nice person.
Zeyuan Allen-Zhu, Sc.... @ZeyuanAllenZhu
20K Followers 452 Following physics of language models @ Meta (FAIR, not GenAI) 🎓：Tsinghua Physics — MIT CSAIL — Princeton/IAS 🏅：IOI x 2 — ACM-ICPC — USACO — Codejam — math MCM
Tengyu Ma @tengyuma
37K Followers 565 Following Assistant professor at Stanford; Co-founder of Voyage AI (https://t.co/wpIITHLgF0) ; Working on ML, DL, RL, LLMs, and their theory.
Sham Kakade @ShamKakade6
16K Followers 495 Following Harvard Professor. Full stack ML and AI. Co-director of the Kempner Institute for the Study of Artificial and Natural Intelligence.
Asian Kosher Cowboy �... @0321K9
6K Followers 1K Following He/Brew🍺; Forged in PNW; Former Hill & Knesset staffer; CT Intelligence, Military, Defense, Aviation; Arak & Scotch Enjoyer; English|עברית|Deutsch|Dansk|普通话|粵語
Selin Kocalar @kocalars
7K Followers 657 Following Co-founder @GetDelve (AI-native compliance) | YC W24 | Z Fellows | Prod | prev AI at MIT
Learning Theory Allia... @let4all
2K Followers 37 Following Together we will build the future of the machine learning theory research community!
Louisa Conwill @louisaconwill
179 Followers 114 Following PhD candidate at @nd_cse. Bringing philosophical + religious traditions into ethical HCI. Formerly @focuscatholic and @amazon. @BrownUniversity and @asij alum.
Zohran Kwame Mamdani @ZohranKMamdani
622K Followers 984 Following Democratic Nominee for Mayor of NYC. Assemblymember. Running to freeze the rent, make buses fast + free, and deliver universal childcare. Democratic Socialist.
Trends for United States
You might like
