(1/n) Check out our new paper: "Fantastic Pretraining Optimizers and Where to Find Them"! >4000 models to find the fastest optimizer! 2× speedups over AdamW? Unlikely. Beware under-tuned baseline or limited scale! E.g. Muon: ~40% speedups <0.5B & only 10% at 1.2B (8× Chinchilla)!
@NousResearch pulled off some magic with this Llama-3.1-405b finetune. Crazy uplift in performance on EQ & creative writing.
NousResearch/Hermes-4-405B on hf
join us tomorrow for our 2nd AMA on r/LocalLLaMA with Hugging Face Science, the team behind SmolLM, SmolVLM, and more
this is going to be a good one, for many reasons but i cannot say more than that at the moment :)
don't miss it, tomorrow 8am-11am PST
The Lore of Kalomaze! ⚡️
bringing a great pod with @kalomaze (20yo ml researcher, prime intellect) - we'd talked about training, finetuning, RL (environments and recipes), scaling, working at PI and a Lot of Lores!
(link in replies)
Super excited to announce that our research team at @huggingface will be doing an AMA on r/LocalLLaMA.
Come ask any questions to the team behind SmolLM, FineWeb and more! And who knows, maybe there’ll be a shiny new release to talk about?
Thursday 4th September, 8AM-11AM PST…
3K Followers 947 FollowingCreative developer @mercimichel, @awwwards Dev Jury, WebGL experiments doer, former teacher, proud member of @okaydevs, solo game dev & mostly naysayer.
4K Followers 196 FollowingBuilding WebGi SDK(https://t.co/IApxU5t99X) and iJewel3D(https://t.co/J4S4VDKO7r) for immersive 3D/AR rendering experiences on the web for eCommerce.
280 Followers 543 FollowingDegen meme lord ruling Solana charts like BONK via https://t.co/ffphq0w9yz trade portal on https://t.co/ZI6xlNrlx9. Lord over memes with me crowning viral trades and empires!
Use only gmgn ..
653 Followers 3K FollowingProduct of progressive public policy; raised by public libraries and public education that produced a passion for politics. and apparently alliteration
266 Followers 416 Followingwuahhhhh
Post-training @ https://t.co/jQT9G3hHUc, See what i've cooked on my HF @ https://t.co/QZABvVi2P0
AI/ML/LLMs, Creative Writing, pro himejoshi
4K Followers 196 FollowingBuilding WebGi SDK(https://t.co/IApxU5t99X) and iJewel3D(https://t.co/J4S4VDKO7r) for immersive 3D/AR rendering experiences on the web for eCommerce.
1K Followers 288 FollowingBuilding the node-based WebGL app @polygonjs
- Try it: https://t.co/t9OPIO51WT
Also Making Games, next up is Chess Twist https://t.co/YZvWNJIWv7
320K Followers 7K FollowingProfessor, biomedical scientist, human immunologist, aging & cancer immunotherapy. ALL IN ON AI. Interests: longevity, robotics, Scifi, space. Personal opinions
4K Followers 814 FollowingAI Engineer by title. AI Evangelist by calling. AI Evaluator by obsession.
Evaluates LLMs for breakfast, preaches AI usefulness all day long at @ellamindAI. 😎
20K Followers 1K FollowingResearcher @MSFTResearch, AI Frontiers Lab; Prof @UWMadison (on leave); learning in context; thinking about reasoning; babas of Inez Lily.
108K Followers 1 FollowingClaude is an AI assistant built by @anthropicai to be safe, accurate, and secure. Talk to Claude on https://t.co/ZhTwG8dz3D or download the app.
17K Followers 930 FollowingCo-founder and CTO of @CoreViewHQ GenAI/LLM addicted, Apple MLX, Microsoft 365, Azure, Kubernetes, Investor in innovation and Mensa member.
17K Followers 574 FollowingWe make AI models Dolphin and Samantha
BTC 3ENBV6zdwyqieAXzZP2i3EjeZtVwEmAuo4
https://t.co/3ri2GbWU13
https://t.co/zH0F3pSLuq @dphnAI
210K Followers 359 FollowingI build & teach AI stuff. Founder @TakeoffAI where we’re building an AI coding tutor. Come learn to code + build with AI at https://t.co/oJ8PNoAutE.
5K Followers 7 FollowingInteractive AI explainers.
Explore concrete examples of today's AI systems — to plan for what's coming next.
A project of @sage_future_
3K Followers 789 Followingrap battle maker
pfp by @thedogfamilyguy
banner by @ImTheGuySK3
🇺🇸/🇲🇽 34K+ Subscribers
the mind behind Deadpool vs Peter Griffin
🇵🇸
11K Followers 6K Followinghiring agentic humans @hud_evals / https://t.co/OZbFIovysh | owned @AIHubCentral (1 million users, acq.) climate protester. don't do the deferred life plan
56K Followers 853 FollowingFiguring out AI @allen_ai, open models, RLHF, fine-tuning, etc
Contact via email.
Writes @interconnectsai
Wrote The RLHF Book
Mountain runner
20K Followers 452 Followingphysics of language models @ Meta (FAIR, not GenAI)
🎓:Tsinghua Physics — MIT CSAIL — Princeton/IAS
🏅:IOI x 2 — ACM-ICPC — USACO — Codejam — math MCM
7K Followers 897 FollowingCEO at Revecore, former Partner at @BainCapVC + CEO of @ondeckcapital. Father of 2, husband of 1, occasional angel investor, relentless optimist.
59K Followers 133 FollowingWe make tinygrad and sell tinybox, the best perf/$ AI computer.
$25k for 4x 5090 in a quiet box.
Our mission is to commoditize the petaflop.
26K Followers 173 FollowingA North Star for open AGI. Co-founders: @fchollet @mikeknoop. President: @gregkamradt. Help support the mission - make a donation today.
31K Followers 1K FollowingPhilosopher, formerly @guidepostschool, currently @montessorium (and sibling schools), husband to @Gena_I_Gorlin, father to the creatures in my dadpoasts