Sangjun Park @cosmoquester
Artificial Intelligence Researcher cosmoquester.github.io Republic of Korea Joined July 2022-
Tweets24
-
Followers16
-
Following85
-
Likes38
For the year-end and New Year holidays, I've summarized a little bit of what I've been thinking about. You can watch it for fun, empathy and objection are all welcome! Reflection on the Conceptual Essence of Language Models, the Path to AGI cosmoquester.github.io/reflection-on-…
I am happy to announce that the first draft of my RL tutorial is now available. arxiv.org/abs/2412.05265
# RLHF is just barely RL Reinforcement Learning from Human Feedback (RLHF) is the third (and last) major stage of training an LLM, after pretraining and supervised finetuning (SFT). My rant on RLHF is that it is just barely RL, in a way that I think is not too widely…
A first in-person poster spotlight poster presentation at ICML 2024 by @cosmoquester
1/ How do humans and animals form models of their world? We find that Foundation Models for Embodied AI may provide a framework towards understanding our own “mental simulations”. 🧵👇 arxiv.org/abs/2305.11772 with awesome collaborators: @rishi_raj @mjaz_jazlab @GuangyuRobert
Our paper comparing human and LM reasoning -- now published (open source)!
Our paper comparing human and LM reasoning -- now published (open source)!
Not only can't LLMs plan, they can't even generate specifications of a problem (in PDDL) that a standard planner could solve.
Not only can't LLMs plan, they can't even generate specifications of a problem (in PDDL) that a standard planner could solve.
@alex_peys The problem isn't that it is a transformer. The problem is that it is an auto-regressive LLM. Auto-regressive LLMs that compute each token with a fixed number of computational steps can't reason, regardless of the details of the architecture.
Our paper has been accepted as a Spotlight Poster! Congratulations @cosmoquester Please visit our poster session and leave your comments and questions. icml.cc/virtual/2024/p… #ICML
Our paper has been accepted as a Spotlight Poster! Congratulations @cosmoquester Please visit our poster session and leave your comments and questions. icml.cc/virtual/2024/p… #ICML https://t.co/YEwaCSQ9zg
Nice article in Financial Time where I explain that Auto-Regressive LLM are insufficient to reach human-level intelligence (or even cat-level intelligence). But alternative architectures that I call "objective driven" may reach human-level intelligence one day. They use world…
Nice article in Financial Time where I explain that Auto-Regressive LLM are insufficient to reach human-level intelligence (or even cat-level intelligence). But alternative architectures that I call "objective driven" may reach human-level intelligence one day. They use world…
If you are a student interested in building the next generation of AI systems, don't work on LLMs
If you are a student interested in building the next generation of AI systems, don't work on LLMs
I am very pleased to announce my first paper "Memoria: Resolving Fateful Forgetting Problem through Human-Inspired Memory Architecture" at #ICML2024! Memoria processes long sequence information inspired by human memory systems. More Details: arxiv.org/abs/2310.03052
Excited to share our paper "Memoria: Resolving Fateful Forgetting Problem through Human-Inspired Memory Architecture" presented at ICML 2024! Congratulations to Sangjun Park! Preprint: arxiv.org/abs/2310.03052 #ICML2024
a random thought on RAG, inspired by the (successful) phd defense of @mrdrozdov (the committee consists of @andrewmccallum, @MohitIyyer, @JonathanBerant, @HamedZamani and me) kyunghyuncho.me/a-random-thoug…
📢Are you (or do you know) a PhD student with experience in transformers, LLMs, & cognitive neuroscience (esp PFC, hippocampus)? Still interviewing interns for a project following up on our earlier work: arxiv.org/abs/2310.00194 nips.cc/virtual/2023/p… job: jobs.careers.microsoft.com/global/en/job/…
Nuhea @NuheaxzVd
32 Followers 3K Following
jumbin @JeongbinLee_ai
1 Followers 16 Following
namul2 @namul2s
2 Followers 111 Following
이주홍 @roomylee
48 Followers 219 Following I'm a research scientist at Pingpong AI Research, Scatter Lab working on Natural Language Processing and Machine Learning.
KittyJoan @W9jC320hfM01Fsk
34 Followers 5K Following
Dave Burstein @AInews_wire
296 Followers 5K Following Rapid coverage of AI. Many tweets. @AIPrimes has just the most interesting.
Jiseon Kim @jiseon_kim1
220 Followers 522 Following PhD Student @ KAIST | 🔎AI alignment | 🤖LLM evaluation | 📜AI for Policy & Governance | 🏙️Computational Social Science | 💬NLP
Sukrati Gautam @sukrati_gautam
28 Followers 400 Following PhD candidate at @purdue | B’Tech @IITDelhi 21 | Prev intern @Bayer-Applied Data Scientist
Hun Tae Kim @HunTaeKim1
17 Followers 329 Following Still immature, trying to learn about the world we live in
HyunJin Kim @averyindoorpsn
26 Followers 69 Following Ph.D. student #SKKU Human Language Intelligence Lab. Interested in natural language processing, language modeling. Instagram: https://t.co/Vcn035RkiD
Jaehyeok Lee @jaehyeoklee2122
9 Followers 28 Following 李 在赫, South Korean, Ph.D. student, interested in NLP, music, https://t.co/4vipQJApAv
JiWoo Kim @nanjiwooya
25 Followers 29 Following
Jason (parody) @jasongfleischer
604 Followers 1K Following some kinda professor @UCSanDiego: machine learning, stats, neuro, circadian, aging. Since COVID-19 I've replaced soccer with armchair epidemiology.
Meenakshi Khosla @meenakshik93
973 Followers 630 Following Assistant Professor @UCSD @CogSci | Past: Postdoctoral researcher @MIT , Phd @Cornell, BTech @IITKanpur | Interested in biological and artificial intelligence
François Chollet @fchollet
572K Followers 813 Following Co-founder @ndea. Co-founder @arcprize. Creator of Keras and ARC-AGI. Author of 'Deep Learning with Python'.
Kevin Patrick Murphy @sirbayes
61K Followers 528 Following Research Scientist at Google DeepMind. Interested in Bayesian Machine Learning.
Weinan Sun @sunw37
784 Followers 675 Following Neuroscience, Artificial Intelligence, and Beyond. Assistant professor, Neurobiology and Behavior @CornellNBB
Haneul Yoo @HaneulYoo13
473 Followers 221 Following #NLProc PhD candidate at @kaistpr & Visiting scholar at @nyuniversity | Prev. @naver_ai_lab @upstageai @csiro @iamkepco
Journal of Machine Le... @JmlrOrg
15K Followers 3 Following Official twitter account for the Journal of Machine Learning Research (JMLR)
CogSci Society @cogsci_soc
15K Followers 1K Following Official twitter account of the Cognitive Science Society
Jennifer Hu @_jennhu
3K Followers 120 Following Research Fellow at @Harvard and incoming Asst Prof at @JohnsHopkins interested in language, cognition, and AI. Formerly: PhD @MIT.
Erin Grant @ermgrant
3K Followers 2K Following 🚨 I'm no longer active on Twitter. Find me on 🦋: @[email protected] Senior Research Fellow @GatsbyUCL & @SWC_Neuro {learning, representations} in 🧠💭🤖
Aran Nayebi @aran_nayebi
4K Followers 3K Following Asst Prof @CarnegieMellon Machine Learning (@mldcmu @SCSatCMU) | @BWFUND CASI Fellow | Building a Natural Science of Intelligence 🧠🤖 | Prev: @MIT, @Stanford
Jiseon Kim @jiseon_kim1
220 Followers 522 Following PhD Student @ KAIST | 🔎AI alignment | 🤖LLM evaluation | 📜AI for Policy & Governance | 🏙️Computational Social Science | 💬NLP
xAI @xai
1.8M Followers 38 Following
Jeff Dean @JeffDean
365K Followers 6K Following Chief Scientist, Google DeepMind & Google Research. Gemini Lead. Opinions stated here are my own, not those of Google. TensorFlow, MapReduce, Bigtable, ...
Hun Tae Kim @HunTaeKim1
17 Followers 329 Following Still immature, trying to learn about the world we live in
JinYeong Bak @NoSyu
880 Followers 711 Following 박진영/JinYeong Bak/朴秦永 Leader @ https://t.co/fOvQXsEjo6 Conversation Modeling Researcher who is not good at talking
Anna Ivanova @neuranna
5K Followers 1K Following Language and thought in brains vs machines. New Assistant Prof @ Georgia Tech Psychology. Previously: postdoc @MIT_Quest & PhD @mitbrainandcog. She/her
ICML Conference @icmlconf
78K Followers 12 Following Int'l Conf on Machine Learning • This account not monitored, Contact: https://t.co/6saHKWVxR6 • LinkedIn: https://t.co/YlU0lrSVna
HyunJin Kim @averyindoorpsn
26 Followers 69 Following Ph.D. student #SKKU Human Language Intelligence Lab. Interested in natural language processing, language modeling. Instagram: https://t.co/Vcn035RkiD
Jacob Andreas @jacobandreas
20K Followers 951 Following Teaching computers to read. Assoc. prof @MITEECS / @MIT_CSAIL / @NLP_MIT (he/him). https://t.co/5kCnXHjtlY https://t.co/2A3qF5vdJw
Kanaka Rajan @KanakaRajanPhD
12K Followers 2K Following Associate Professor at Harvard & Kempner Institute. Applying computational frameworks & ML to decode multi-scale neural processes. Marathoner. Rescue dog mom.
Jaehyeok Lee @jaehyeoklee2122
9 Followers 28 Following 李 在赫, South Korean, Ph.D. student, interested in NLP, music, https://t.co/4vipQJApAv
Christopher Manning @chrmanning
151K Followers 228 Following Director, @StanfordAILab. Assoc. Director, @StanfordHAI. Founder, @stanfordnlp. Prof. CS & Linguistics, @Stanford. IP @aixventureshq. 🇦🇺 Do #NLProc & #AI. 👋
Ida Momennejad @criticalneuro
15K Followers 2K Following Principal Researcher @MSFTResearch. I study memory & planning in brains. I build & evaluate AI.
Kording Lab 🦖 @KordingLab
45K Followers 3K Following Konrad kording, @Penn Prof, deep learning, brains, #causality, rigor, https://t.co/tTJW05RRfa, https://t.co/qf7ZHxjaK1, Transdisciplinary optimist, Dad, Loves outdoors, 🦖
noahdgoodman @noahdgoodman
5K Followers 158 Following Professor of natural and artificial intelligence @Stanford. Alignment at @GoogleDeepMind. (@StanfordNLP @StanfordAILab etc)
Stanford CoCoLab @stanfordcocolab
96 Followers 0 Following The Computation and Cognition Lab at Stanford University, led by Noah Goodman.
Tal Linzen @tallinzen
18K Followers 897 Following Professor @nyuling and @NYUDataScience, research scientist @GoogleAI, inventor of the word "bertology"
Brenden Lake @LakeBrenden
8K Followers 262 Following Associate Professor of Computer Science and Psychology @ Princeton. Posts are my views only
Cengiz Pehlevan @CPehlevan
3K Followers 1K Following Theoretical neuroscience, theory of neural computation, physics of learning and intelligence. Assistant Professor of Applied Mathematics @Harvard SEAS
Kyunghyun Cho @kchonyc
77K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre physicist at @nyuniversity (@CILVRatNYU) & @PrescientDesign
Griffiths Computation... @cocosci_lab
6K Followers 134 Following Tom Griffiths' Computational Cognitive Science Lab. Studying the computational problems human minds have to solve.
James DiCarlo @JamesJDiCarlo
4K Followers 46 Following Director, MIT Quest for Intelligence and Professor of Neuroscience, @MIT. Our research goal is to reverse engineer the mechanisms of human intelligence.
Alex Gu @minimario1729
4K Followers 2K Following intern @ meta, mit phd student (on job market!), llm for math+code / prev nvidia, aws, jane street / enjoys 🎹✈️⛷️⛵
Rylan Schaeffer @RylanSchaeffer
6K Followers 2K Following CS PhD Student at Stanford Trustworthy AI Research with @sanmikoyejo. Prev interned/worked @ Meta, Google, MIT, Harvard, Uber, UCL, UC Davis
FieteGroup @FieteGroup
4K Followers 230 Following Fiete group @MIT, theoretical and computational neuroscience. Run by the group. Follows and retweets are not an endorsement.
Katie Collins @katie_m_collins
2K Followers 984 Following Machine Learning PhD Student @Cambridge_Uni & Marshall Scholar | Student Researcher, @CambridgeMLG & @MITCoCoSci | @MIT '21 | Founder, @mitxharvard_wai
Helmholtz Institute f... @cpilab
4K Followers 112 Following We study human learning using tools from machine learning and improve machine learning using insights from cognitive science.
CBMM @MIT_CBMM
3K Followers 22 Following The Center for Brains, Minds and Machines is a multi-institutional NSF Center dedicated to the study of the science and engineering of intelligence.
CoCoSci MIT @MITCoCoSci
4K Followers 107 Following Computational Cognitive Science Group | MIT | BCS Latest updates from Josh Tenenbaum's lab + Alumni
Surya Ganguli @SuryaGanguli
18K Followers 523 Following Associate Prof of Applied Physics @Stanford, and departments of Computer Science, Electrical Engineering and Neurobiology. Venture Partner @a16z
Yann LeCun @ylecun
949K Followers 764 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
UCL_NeuroAI (inactive... @UCL_Neuro_AI
1K Followers 16 Following UCL NeuroAI community (inactive) Follow us on: @ucl-neuroai.bsky.social [email protected]
Bradley Love @ProfData
6K Followers 2K Following Senior research scientist at @LosAlamosNatLab. Former prof at @ucl and @UTAustin. CogSci, AI, Comp Neuro, AI for scientific discovery Also @profdata on Bluesky
David Krueger @DavidSKrueger
18K Followers 4K Following AI professor. Deep Learning, AI alignment, ethics, policy, & safety. Formerly Cambridge, Mila, Oxford, DeepMind, ElementAI, UK AISI. AI is a really big deal.Trends for United States
You might like
