Nguyễn Đức Ánh @duc_anh2k2
Joined May 2024-
Tweets42
-
Followers1
-
Following84
-
Likes31
Couldn't resist. Here's a pure PyTorch from-scratch re-implementation of Gemma 3 270M in a Jupyter Notebook (uses about 1.49 GB RAM): github.com/rasbt/LLMs-fro…
Couldn't resist. Here's a pure PyTorch from-scratch re-implementation of Gemma 3 270M in a Jupyter Notebook (uses about 1.49 GB RAM): github.com/rasbt/LLMs-fro… https://t.co/9vF9U29pWh
🎯 Andrej Karpathy on how to learn.
Summary of GPT-OSS architectural innovations: 1. sliding window attention (ref: arxiv.org/abs/1901.02860) 2. mixture of experts (ref: arxiv.org/abs/2101.03961) 3. RoPE w/ Yarn (ref: arxiv.org/abs/2309.00071) 4. attention sinks (ref: streaming llm arxiv.org/abs/2309.17453)
what are large language models actually doing? i read the 2025 textbook "Foundations of Large Language Models" by tong xiao and jingbo zhu and for the first time, i truly understood how they work. here’s everything you need to know about llms in 3 minutes↓
As promised, my SOP draft is here: algoroxyolo.github.io/assets/pdf/lrz… Please lmk if you have any suggestions or you have any recommendations where you think I should apply or what I should do in my future research. As always RT appreciated!! #PhDApplication #NLP #HCI
New lecture recordings on RL+LLM! 📺 This spring, I gave a lecture series titled **Reinforcement Learning of Large Language Models**. I have decided to re-record these lectures and share them on YouTube. (1/7)
Despite theoretically handling long contexts, existing recurrent models still fall short: they may fail to generalize past the training length. We show a simple and general fix which enables length generalization in up to 256k sequences, with no need to change the architectures!
Are attention heads the right units to mechanistically understand Transformers' attention behavior? Probably not due the attention superposition! We extracted interpretable attention units in LMs and found finer grained versions of many known and novel attention behaviors. 🧵1/N
Statistical Learning Theory by Percy Liang web.stanford.edu/class/cs229t/n…
New paper - Transformers, but without normalization layers (1/n)
I've been reading this book alongside Deepseek. The math is mathing. The code is coding. The Deepseek is deepseeking! @deepseek_ai you made god!
Stanford “Statistics and Information Theory” lecture notes PDF: web.stanford.edu/class/stats311…
Stanford “Statistics and Information Theory” lecture notes PDF: web.stanford.edu/class/stats311… https://t.co/bJ097Zg52K
Excited to share a new project! 🎉🎉 doi.org/10.1101/2024.0… How do we navigate between brain states when we switch tasks? Are dynamics driven by control, or passive decay of the prev task? To answer, we compare high-dim linear dynamical systems fit to EEG and RNNs🌀 ⏬
Announcing MatMamba - an elastic Mamba2🐍architecture with🪆Matryoshka-style training and adaptive inference. Train a single elastic model, get 100s of nested submodels for free! Paper: sca.fo/mmpaper Code: sca.fo/mmcode 🧵(1/10)
A cool Github repo collecting LLM papers, blogs, and projects, with a focus on OpenAI o1 and reasoning techniques.
Excited to share a blog series I've been working on, diving deep into CUDA programming! Inspired by the #PMPP book & #CUDA_MODE!! Check out the links below...
[VAE] by Hand ✍️ A Variational Auto Encoder (VAE) learns the structure (mean and variance) of hidden features and generates new data from the learned structure. In contrast, GANs only learn to generate new data to fool a discriminator; they may not necessarily know the…
EVLM An Efficient Vision-Language Model for Visual Understanding In the field of multi-modal language models, the majority of methods are built on an architecture similar to LLaVA. These models use a single-layer ViT feature as a visual prompt, directly feeding it into the
Just got around to trying ColPali arxiv.org/abs/2407.01449 but for more general extraction tasks than poorly formatted/scanned documents with complicated SEC tables*. Pretty impressive! VLMs for efficient indexing and late interaction matching gives a sizeable boost.
The Transformers architecture clearly explained 👇🏻
VWAP_Strategy🇺🇸 @Itauror6509380
41 Followers 2K Following 15-30% Monthly | 2 High-Conviction Stocks.Short-Term Gains: 15-20% in Days/Weeks.DM "JOIN" for WhatsApp Alerts. Live Trade Signals • Market Analysis
Sharon Y. Li @SharonYixuanLi
11K Followers 803 Following Prof @WisconsinCS. Making AI reliable for the open world.
Ming Yin @MingYin_0312
2K Followers 923 Following ML, RL, AI. @Princeton Postdoc. PhDs in CS & STATs. Ex @awscloud AI. undergrad @USTC Math. Area Chair @NeurIPS @ICML.
Zixiang Chen @_zxchen_
1K Followers 2K Following Research Scientist at @SalesforceAI | Ph.D. from @UCLA | B.S. from @Tsinghua_Uni | Foundation Model, Theory, Reinforcement Learning | Opinions are my own
Dongruo Zhou @DongruoZ
382 Followers 150 Following Assistant Professor of Computer Science, Indiana University
Subhabrata Sen @subhabratasen90
642 Followers 141 Following Assistant Professor of Statistics, @Harvard. Opinions are my own.
Kaixuan Huang @KaixuanHuang1
1K Followers 923 Following AGI strategist. PhD Student @Princeton; Google PhD Fellowship 2024, Ex-Intern @GoogleDeepMind; undergrad @PKU1898. opinions my own
Guanyang Wang @GuanyangW
480 Followers 317 Following Assistant professor of statistics @RutgersU, former Ph.D of math @Stanford, undergrad of math @USTC.
Tianhao Wang @0920wth
196 Followers 252 Following Assistant Professor @HDSIUCSD. Previously Research Assistant Professor @TTIC_Connect and PhD in Statistics & Data Science @Yale.
Lunjia Hu @LunjiaH
468 Followers 278 Following Assistant Prof @Northeastern @KhouryCollege. Prev Postdoc Fellow @Harvard @HCRCS. CS PhD @StanfordTheory, Yao Class undergrad @Tsinghua_Uni
Zhiyuan Li @zhiyuanli_
2K Followers 317 Following Assistant Professor @TTIC_Connect. Previously Postdoc @Stanford and PhD @PrincetonCS. Deep Learning Theory.
Hieu Pham @hyhieu226
34K Followers 24 Following @openai | ex: @xai, @augmentcode, @GoogleBrain, @LTIatCMU, @Stanford, ACM ICPC, IMO🥈 Opinions are my own.
Khurram Javed @KhurramJaved_96
2K Followers 151 Following Developing algorithms for real-time reinforcement learning on robots. Research Scientist at Keen, a startup led by John Carmack. Prev ~ PhD with Richard Sutton
Alexander Terenin @avt_im
8K Followers 1K Following Decision-making under uncertainty, machine learning, artificial intelligence, from theory to practice · anti-ideological · Assistant Research Professor @Cornell
Sarath Chandar @apsarathchandar
6K Followers 605 Following Associate Professor @polymtl and @Mila_Quebec; Canada CIFAR AI Chair; Machine Learning Researcher. Pro-bono office hours: https://t.co/tK69DKRf9N?amp=1
Reinforcement Learnin... @rlai_lab
6K Followers 24 Following The official twitter handle of the RLAI lab at the University of Alberta
Rohan Paul @rohanpaul_ai
83K Followers 8K Following Compiling in real-time, the race towards AGI. 🗞️ Don't miss my daily top 1% AI analysis newsletter directly to your inbox 👉 https://t.co/6LBxO8215l
Ben Lamm @BenLamm
56K Followers 2K Following Present: @Colossal Past: Founder w/ exits to @liveperson @zynga @accenture. Love startups, science, defense, space. Fellow/Board of Trustee @explorersclub
Chenfeng_X @Chenfeng_X
1K Followers 946 Following PhD @UCBerkeley, Incoming Assistant Professor @UTCompSci, Senior Researcher @togethercompute. Working on building cooler things with fewer dollars 😊
Sanae Lotfi @LotfiSanae
3K Followers 373 Following AI Research Scientist @MetaAI (FAIR) | PhD from @nyuniversity
Arnav Goel @_goel_arnav
691 Followers 368 Following MSML @mldcmu | Pre-training, alignment and memorization | ex - @MSFTResearch, @nlp_usc, @Mila_Quebec, IBM | CSAI @IIITDelhi '25
Percy Liang @percyliang
84K Followers 417 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | Pianist
Tengyu Ma @tengyuma
37K Followers 565 Following Assistant professor at Stanford; Co-founder of Voyage AI (https://t.co/wpIITHLgF0) ; Working on ML, DL, RL, LLMs, and their theory.
Elad Hazan @HazanPrinceton
14K Followers 218 Following machine learning and optimization @PrincetonCS & Google DeepMind Princeton, dad^3
Ahmad Beirami @abeirami
10K Followers 4K Following sth new // ex Gemini RL+Inference @GoogleDeepMind // Chat AI @Meta // RL Agents @EA // ML+Information Theory @MIT+@Harvard+@GeorgiaTech // زن زندگی آزادی
Albert Gu @_albertgu
18K Followers 88 Following assistant prof @mldcmu. chief scientist @cartesia_ai. leading the ssm revolution.
AAAI @RealAAAI
30K Followers 93 Following Founded in 1979, AAAI is an international, nonprofit, scientific society devoted to promote research in, and responsible use of Artificial Intelligence.
Ernest Ryu @ErnestRyu
6K Followers 346 Following Professor of Mathematics at UCLA. Interested in deep learning and optimization.
Dakuo Wang @dakuowang
2K Followers 828 Following Associate Professor @Northeastern, DistinguishedSpeaker @TheOfficialACM Prev. @IBMResearch @StanfordHAI Ph.D. @UCIrvine #HCI #AI #CSCW #HumanAICollaboration
Trapit Bansal @TrapitBansal
32K Followers 247 Following AI Research @Meta | Co-Creator of OpenAI o1 | Previously @OpenAI, @MSFTResearch, @GoogleAI, @facebook, @iiscbangalore, and undergrad @IITKanpur
Arpit Bansal @arpitbansal297
1K Followers 834 Following Currently interning with Llama @Meta, PhD Candidate @UMDCS. Past @AmazonScience, @IITKgp. A brick in the creation of Artificial General Intelligence.
Science Magazine @ScienceMagazine
4.5M Followers 460 Following Cutting-edge research, news, commentary, and visuals from the Science family of journals. Follow @NewsfromScience for stories from our News team.
Chris @chatgpt21
16K Followers 766 Following Agi 2029 - Applied in RL, CL, and generalization | Program Manager | Investing in early startups 📈 E/CC 🦾🤖
Hunyuan @TencentHunyuan
25K Followers 6 Following Tencent's large model, encompasses text generation, image generation, video generation, and 3D generation.
Jim Fan @DrJimFan
325K Followers 3K Following NVIDIA Director of Robotics & Distinguished Scientist. Co-Lead of GEAR lab. Solving Physical AGI, one motor at a time. Stanford Ph.D. OpenAI's 1st intern.
Yann LeCun @ylecun
949K Followers 764 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
勃勃OC @bboczeng
177K Followers 680 Following 美股投资日报：https://t.co/8rs6JWg78E，免费订阅即可阅读，东半球最理性的基本面分析与市场总结；仅需$5一月，加入会员群共同讨论、分享和进步。入群链接见网站首页右上角“会员项目”板块。会员群不喊单不带单。推文和博客为个人意见，Not Financial Advice
山坞佬观世界 @Hammer_EU_9527
125K Followers 523 Following
Yi Ma @YiMaTweets
101K Followers 490 Following Chair Prof. in AI, HKU; Visiting Prof. of EECS, UCB New book on Principles of Intelligence: https://t.co/leZlkURb7j
AK @_akhaliq
425K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo ,submit papers here: https://t.co/UzmYN5YmrQ
Michael Anti @mranti
374K Followers 11K Following 安替, Globus, Global Research. A veteran journalist on International Affairs, Harvard Nieman Fellow '08, TEDGlobal Speaker.
Zhengzhong Tu @_vztu
6K Followers 2K Following Assistant Professor in AI/Physics @TAMU | AE @ IEEE-TIP | ex-@GoogleAI | PhD @UTAustin | BS @FudanUni | Intern @GoogleAI (x3) | GenAI, VLM, EmbodiedAI, MLSys
Yu Su (hiring postdoc... @ysu_nlp
11K Followers 948 Following cooking something new. prof. @osunlp. sloan fellow. intelligence and agents. author of Mind2Web, SeeAct, MMMU, HippoRAG, BioCLIP, UGround.
Kosta Derpanis @CSProfKGD
68K Followers 197 Following #CS Assoc Prof @YorkUniversity, #ComputerVision Scientist Samsung #AI, @VectorInst Faculty Affiliate, TPAMI AE, @ELLISforEurope Member #ICCV2025 Publicity Chair
Zhuang Liu @liuzhuang1234
11K Followers 1K Following Assistant Professor @PrincetonCS. researcher in deep learning, vision, models. previously @MetaAI, @UCBerkeley, @Tsinghua_UniTrends for United States
You might like
