Ph.D. student @WisconsinCS. Working on foundation models and breaking past scaling laws. Previously at CMU @mldcmu, UCSD @ucsd_cse, FCC @fresnocity.nick11roberts.science Madison, WIJoined April 2012
More data ≠ better fine-tuning. Sometimes the 'undertrained' model is more useful because it's still plastic. We need to map the capability vs. adaptability frontier better.
first i thought scaling laws originated in OpenAI (2020)
then i thought they came from Baidu (2017)
now i am enlightened:
Scaling Laws were first explored at Bell Labs (1993)
“Rubrics” have become a buzzword in AI, but the concept predates the hype. At @SnorkelAI, we’re excited to share a fun primer on what rubric‑based evaluation is—and why it’s critical for today’s generative and agentic models.
LLM judges are powerful for automated evaluation but expensive and biased.📣 Meet PAJAMA, a new framework that distills LLM judging logic into a compact, executable form (a new representation), cutting costs from thousands to just cents.🚀 We'll present at ICML PRAL on Friday!
Next up this morning at #ICML2025, we will be presenting our work on pseudolabeling-based semi-supervised learning (SSL).
East Exhibition Hall A&B # E-1304, 11 am to 1:30 pm
Paper: openreview.net/pdf?id=w4c5bLk…
Pseudolabeling-based SSL relies on the model’s confidence scores and…
Join us today in the morning poster session at #ICML2025.
We will talk about some neat ways for reducing uncertainty and improving LLM accuracy at test-time on multi-choice tasks (e.g., tool selection) using conformal prediction and an additional inference round.
📍 East…
Excited to be at ICML’25!!! I'll present papers on improving LLM inference and evaluation and pseudolabeling-based semi-supervised learning.
Come and say hi during these sessions, or chat anytime during the week!
[C1]. Prune 'n Predict: Optimizing LLM Decision-making with…
Heading to #ICML! I’ll be representing SprocketLab at @UWMadison and @SnorkelAI. Reach out if you want to chat about data-centric AI, data development, agents, and foundation models.
4K Followers 928 FollowingResearch fellow at Flatiron Institute, working on understanding optimization in deep learning. Previously: PhD in machine learning at Carnegie Mellon.
20K Followers 1K FollowingResearcher @MSFTResearch, AI Frontiers Lab; Prof @UWMadison (on leave); learning in context; thinking about reasoning; babas of Inez Lily.
18K Followers 4K FollowingAssociate Professor at UC Berkeley. Former Research Scientist at Google DeepMind. ML/AI Researcher working on foundations of LLMs and deep learning.
6 Followers 329 FollowingExplaining AI using Analogies and examples from the real world. Just get knowledge on the easy way and rememeber all the posts, by visualizing the ideas!
1K Followers 830 FollowingCS Ph.D. @Stanford, researching data quality, foundation models, and ML for Theorem Proving. Prev: @MIT, @MIT_CBMM, @IllinoisCS, @IBM. Opinions are mine. 🇲🇽
17K Followers 6K FollowingNeurodivergent physics student with a keen interest in multisensory integration and emergent perception. Exploring research on a proposed ‘sixth sense’. Δ
1.4M Followers 1K FollowingBuilding @EurekaLabsAI. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets.
6K Followers 618 Following@SnorkelAI @uwcse / prev @StanfordAILab – Interested in data management systems for machine learning, weak supervision, and impactful applications.
57K Followers 568 FollowingAssistant Prof of CS @UWaterloo, Faculty @VectorInst, Canada @CIFAR_News AI Chair. Joining @NYU_Courant September 2026. Co-EiC @TmlrOrg. I lead @TheSalonML.
4K Followers 928 FollowingResearch fellow at Flatiron Institute, working on understanding optimization in deep learning. Previously: PhD in machine learning at Carnegie Mellon.
20K Followers 1K FollowingResearcher @MSFTResearch, AI Frontiers Lab; Prof @UWMadison (on leave); learning in context; thinking about reasoning; babas of Inez Lily.
949K Followers 764 FollowingProfessor at NYU. Chief AI Scientist at Meta.
Researcher in AI, Machine Learning, Robotics, etc.
ACM Turing Award Laureate.
1K Followers 830 FollowingCS Ph.D. @Stanford, researching data quality, foundation models, and ML for Theorem Proving. Prev: @MIT, @MIT_CBMM, @IllinoisCS, @IBM. Opinions are mine. 🇲🇽
110K Followers 3K FollowingCPO @OpenAI, BoD @Cisco @nature_org, LTC @USArmyReserve
Prev: President @Planet, Head of Product @Instagram @Twitter
❤️ @elizabeth ultramarathons kids cats math
10K Followers 131 FollowingBuilding super-tiny AI models that (hopefully) think • YC S25 • Made @DiffusionBee • Previously: AI research @Microsoft, @CarnegieMellon, @Meta
46 Followers 0 FollowingWomen in AI Research (WiAIR) is dedicated to celebrating the remarkable contributions of female AI researchers from around the globe.
522 Followers 563 FollowingTechnical Advisor to the CEO @MicrosoftAI. Previously Neurosymbolic PhD @JhuCogsci, intern @ibmresearch and @msftresearch, and software @fitbit and @Google.
2K Followers 32 FollowingPrinceton University initiative enhancing fundamental understanding of AI, enabling its use in academic disciplines, and examining AI's societal implications.
418 Followers 656 Following@Kimi_Moonshot; PhD Student @ Soochow University; working on efficient methods for LLMs; disciple of parallel programming; INTP
2K Followers 1K Followingsystems that are nervous
postdoc @Stanford w/ @HazyResearch & @scott_linderman.
prev: neuro phd @cu_neurotheory, post training @DbrxMosaicAI
2K Followers 562 FollowingFictional aircraft design, mechanical pencil drawings and shitty worldbuilding!
🛩 #outskirtsproject discord is linked below
🎨 in media tab
🔞 on @NSF_32
420K Followers 13K FollowingWhat I have is a particular set of skills; skills that make me a nightmare for Nazi dickbags on the internet. I joke and drive a Nissan (parody)