llm reasoning and thinking is an action that belongs to the action space, e.g., sequential thinking mcp.
forget about all of the other anti patterns like react. those won’t scale. decomposition ftw.
from my blog post from last november.
Ilya’s top 30 paper recommendation is actually cracked, i knew about it but i just got a chance to skim the titles and dude!
it has cracked papers by G. Hinton, Karpathy, Chris Olah, covering nlp, vision, rnns, lstm, fundamental deep learning, and so much more.
Ilya Sutskever compiled a list of 30 papers. “If you really learn all of these, you’ll know 90% of what matters”
And, yeah. Wow.
If you haven't read ALL of these, take the time.
aman.ai/primers/ai/top…
We're missing (at least one) major paradigm for LLM learning. Not sure what to call it, possibly it has a name - system prompt learning?
Pretraining is for knowledge.
Finetuning (SL/RL) is for habitual behavior.
Both of these involve a change in parameters but a lot of human…
979 Followers 4K FollowingThe Original Hype Nerd 📣🤓 High-agency phenom 💪 5x Dad 👴🏻 10x Founder 🔄 Building since the 90s 💾 GTM SME 📈 Technological Pedagogist 👨🏻🏫
87 Followers 2K Followingcurrently@keyrocktrading prev. sold startup to public co. dropped out of school, student of life & markets. not investment advice, opinions my own, etc.
979 Followers 4K FollowingThe Original Hype Nerd 📣🤓 High-agency phenom 💪 5x Dad 👴🏻 10x Founder 🔄 Building since the 90s 💾 GTM SME 📈 Technological Pedagogist 👨🏻🏫
7K Followers 21 FollowingOpen source framework and cloud platform for building voice, video, and physical AI apps.
https://t.co/ntsaICjr6F
https://t.co/9SAvOVO0BM
50K Followers 5K FollowingCofounder and Head of Post Training @NousResearch, prev @StabilityAI
Github: https://t.co/LZwHTUFwPq
HuggingFace: https://t.co/sN2FFU8PVE
5K Followers 65 FollowingHelping you achieve mental & physical wealth forever | Multi-sport athlete, killed an auto-immune disease naturally, and sold a 7-figure business before 30
222K Followers 1 FollowingUpdates for developers building with the OpenAI Platform and API • Service status: https://t.co/kZwnwdYqOS • Support: https://t.co/qCi6M5ESZU
488K Followers 146 FollowingNobel Laureate. Co-Founder & CEO @GoogleDeepMind - working on AGI. Solving disease @IsomorphicLabs. Trying to understand the fundamental nature of reality.
205K Followers 5K FollowingVC at @MenloVentures. Formerly founding team @glean, @Google Search. @Cornell CS. Tweets about tech, immigration, India, fitness and search.
365K Followers 6K FollowingChief Scientist, Google DeepMind & Google Research. Gemini Lead. Opinions stated here are my own, not those of Google. TensorFlow, MapReduce, Bigtable, ...
6K Followers 1K FollowingResearch scientist at @GoogleDeepMind, working on generative models, deep learning, RL. PhD from @stanford. Gemini Diffusion lead.