LLM Evals Workshop @NeurIPS @LLM_eval
NeurIPS 2025 Workshop. Evaluating the Evolving LLM Lifecycle: Benchmarks, Emergent Abilities, and Scaling sites.google.com/corp/view/llm-… San Diego Joined July 2025-
Tweets19
-
Followers110
-
Following16
-
Likes16
Last 2 days to the deadline! If you're interested in helping with the reviewing process, please consider volunteering using the following form. There will be best reviewer awards! docs.google.com/forms/d/e/1FAI…
Last 2 days to the deadline! If you're interested in helping with the reviewing process, please consider volunteering using the following form. There will be best reviewer awards! docs.google.com/forms/d/e/1FAI…
Volunteer to be a reviewer: docs.google.com/forms/d/1JPQB2…
@abeirami Indeed! In our NeurIPS workshop @LLM_eval, we’ll tackle the most pressing evaluation challenges. Join us to discuss how we should design the next generation of evaluations with experts in the field! More details: sites.google.com/view/llm-eval-…
We are still in an Evaluation crisis!
needed this so badly
needed this so badly
I’m very excited to be co-organizing this @NeurIPSConf workshop on LLM evaluations! Evaluating LLMs is a complex and evolving challenge. With this workshop, we hope to bring together diverse perspectives to make real progress. See the details below:
I’m very excited to be co-organizing this @NeurIPSConf workshop on LLM evaluations! Evaluating LLMs is a complex and evolving challenge. With this workshop, we hope to bring together diverse perspectives to make real progress. See the details below:
Do not miss this one!
Very excited to announce that I’ll be co-organizing a @NeurIPSConf workshop on LLM evals! Identifying shortcomings in model capabilities in a robust, scientific way is a critical part of model development. Looking forward to discussing ideas and hearing from some eval experts!
Very excited to announce that I’ll be co-organizing a @NeurIPSConf workshop on LLM evals! Identifying shortcomings in model capabilities in a robust, scientific way is a critical part of model development. Looking forward to discussing ideas and hearing from some eval experts!
Evaluating LLMs is one of the most critical and nuanced challenges in AI today. I am super excited to be co-organizing this workshop @NeurIPSConf to discuss the most pressing evaluation challenges. Details 👇
Evaluating LLMs is one of the most critical and nuanced challenges in AI today. I am super excited to be co-organizing this workshop @NeurIPSConf to discuss the most pressing evaluation challenges. Details 👇
Yotam Perlitz 👾 @yotamperlitz
88 Followers 159 Following Research Scientist at @ibmresearch, Practicing #NLProc, #RL. Opinions are my own.
Amartya Hatua @amartya_hatua
41 Followers 565 Following Senior Data Scientist at Fidelity Investments
Gyuwan Kim @gyuwankim93
870 Followers 1K Following Ph.D. student @ucsbcs and @ucsbNLP, working on ML for #NLProc. Previously, @awscloud AI Labs, @Apple MLR, @MSFTResearch, @NAVER_AI_Lab, and @SeoulNatlUni.
005 @jiayi005
0 Followers 124 Following
Yzriga @Yzriga179
37 Followers 184 Following
Christian Internò @ChrisInterno
65 Followers 709 Following Researcher at @unibielefeld (@HammerLabML) and @Honda Research Institute EU, Visiting Researcher at @CSHL at the Department of Computational Neuroscience.
Anil Murthy @Anil_MurthyB
54 Followers 1K Following AI, LLMs, RL || PhD-ing in CS @SCAI_ASU || @ASU & @TAMU Aggie Alumnus || Likes to wrestle with existential questions from time to time || Sporadically here;
tao @tao33343772
5 Followers 83 Following
Duygu Ataman @_dataman_
1K Followers 446 Following Scientist/engineer working on computational models for language understanding and reasoning. Assistant professor @MetuCogSci.
Yulman Perez @Yulman_Perez
346 Followers 1K Following PhD Candidate in Energy Resources Engineering @stanford. Opinions = Mine.
Veljko Kovac @KovacVeljko
186 Followers 490 Following Tech Founder || @join_ef @AmlabUva @Cambridge_Uni
Özgür Güler @ozgurgulerx
532 Followers 2K Following Algorithmic Resistance — Human Dignity by Design #Ataturk #komorebi
trey 博士 🇭🇰 ... @Comparativist
8K Followers 7K Following currently writing/thinking about human and machine intelligence, domestication, and infrastructure on Substack while I rebuild my startup.
tony c @tonyc66993
1 Followers 505 Following
Sjoerd van Steenkiste @vansteenkiste_s
2K Followers 674 Following Researching AI models that can make sense of the world / Gemini @GoogleAI
Cozmin Ududec @CUdudec
360 Followers 2K Following @AISecurityInst Testing and Science of Evals. Ex quantum foundationalist.
Sungmin Cha @_sungmin_cha
382 Followers 264 Following Faculty Fellow @nyuniversity | PhD @SeoulNatlUni
Sai Suresh @saisuresh1999
40 Followers 204 Following Master Student @SIC_Saar in Data Science & AI Rashtrapati Scout Awardee (President Scout Awardee). Chess Player FIDE 1309(But could play like 1500+ :D).
Wes @WesleyPasfield
118 Followers 675 Following
Ash @arshiailaty
495 Followers 2K Following PhD @UCIrvine & @SDSU | EX-SWE-intern@Tesla گورستانِ ماه است شب!
Kaushik Doddamani @Kaushik_N_D
4 Followers 139 Following Masters in Data Science and AI @ IIT Madras
safir @safirgwe
45 Followers 702 Following
Sibayan Mitra @sibayan_mitra
31 Followers 45 Following
wlg @wlg64737265
4 Followers 182 Following
ibrahim ethem @satilik_karga
432 Followers 625 Following ''Bu adam bilim yapmak değil oyun oynamak istiyor'' Cognitive Science PhD Student - METU / Cognitive Science MSc - METU / Computer Engineering - Koç University
Iñigo L.R.B @Inigo_LRB
174 Followers 632 Following Senior NLP Engineer at #TrueFlag @Newtral 🎾🏃♂️🏊♂️💪🎶👨💻🇬🇧🙃 «You Aren't Gonna Need It»
Anupam Mohanty @anupamm002
13 Followers 339 Following
[email protected] @somfozbrie70554
0 Followers 64 Following
Kris miao @miaokris121816
3 Followers 116 Following
Syed Ashfaq @_syedashfaq
79 Followers 734 Following
Hamed Firooz @mamhamed
265 Followers 260 Following AI director @aiatmeta, focusing on #AI, #LLM, #Multimodal, #Safety. Opinions are my own
Siegfried Handschuh (... @sha_hsg
472 Followers 606 Following Professor of Data Science and Natural Language Processing #DataScience #NLP #AI #DeepLearning #BERT #Distributional_Semantic #Word_Embeddings #Multilingual
Roberto Santana @ai_research
812 Followers 970 Following Research on AI, evolutionary computation, machine learning, data mining and neuroinformatics. Currently Tenure Researcher in UPV/EHU. San Sebastian. Spain.
Dave Babich @nyctraderdave
28 Followers 474 Following Former BI Lead @ Kuehne + Nagel | Data Viz & AI in Logistics | Tableau. Currently building the future of specialized AI Agents for the logistics industry.
Soumendra Kumar Sahoo @soumendrak_
914 Followers 808 Following 📊 AI #Observability Architect at @PepsiCo 💼 Prev worked at @FreshworksInc, @IBM, @Wipro, @Accenture, & @TCS 🎓M. Tech in Data Science from @bitspilaniindia
Azmine Wasi @AzmineWasi
257 Followers 2K Following AI/ML Research (Biomolecules, GNN, Bio/MedAI, GenAI, Agents, HCI-HAI) 📊 Kaggle GM 📝 Explorer ⚙️ Seeking (PhD) Research Opportunities 🧬📌
Yu LI @yuli42472097
28 Followers 182 Following ZJU100 Professor, Security and Testing for ML, ML for Security, PhD graduated from The Chinese University of Hong Kong @CUHKofficial
Anna @AnushkaDeshpan8
30 Followers 1K Following
Isabela Albuquerque @isabela_alb
229 Followers 235 Following Research Scientist @DeepMind. She/her. 🇧🇷
Jason Wei @_jasonwei
98K Followers 636 Following ai researcher @meta superintelligence labs, past: openai, google 🧠
Minjoon Seo @seo_minjoon
2K Followers 578 Following Co-Founder & CEO at Config Intelligence, Associate Professor at KAIST
Xuechen Li @lxuechen
16K Followers 944 Following Previously @xai. Interested in the engineering and science for scaling. Opinions are my own. @Stanford PhD.
Nathan Lambert @natolambert
56K Followers 853 Following Figuring out AI @allen_ai, open models, RLHF, fine-tuning, etc Contact via email. Writes @interconnectsai Wrote The RLHF Book Mountain runner
Esin Durmus @esindurmusnlp
4K Followers 439 Following Researcher @anthropicai. Previously Postdoc @stanfordnlp and PhD @cornellcis. Working on large language models.
Sanmi Koyejo @sanmikoyejo
3K Followers 104 Following I lead @stai_research at Stanford. Co-founder @VirtueAI_co
NeurIPS Conference @NeurIPSConf
139K Followers 36 Following Vancouver, Dec 10-15, 24. https://t.co/ga8aOw6yUO Tweets to this account are not monitored. Please send feedback to [email protected].
Diyi Yang @Diyi_Yang
18K Followers 2K Following Assistant Professor @Stanford CS @StanfordNLP @StanfordAILab LLMs for Humans
Marius Hobbhahn @MariusHobbhahn
5K Followers 1K Following CEO at Apollo Research @apolloaievals prev. ML PhD with Philipp Hennig & AI forecasting @EpochAIResearch
Nithya Attaluri @attaluri_nithya
641 Followers 826 Following research engineer @googledeepmind // @miteecs @mitcsail bs & meng ‘23 // views my own
rishi @RishiBommasani
6K Followers 2K Following Societal/economic impacts of AI; AI policy & governance @StanfordHAI Stanford CS PhD w/ @percyliang @jurafsky Cornell CS undergrad w/ @clairecardie
Yangjun Ruan @YangjunR
995 Followers 713 Following Visiting @stanfordAILab | ML Ph.D. student @UofT & @VectorInst
Berivan Isik @BerivanISIK
11K Followers 1K Following Research scientist @GoogleAI. Gemini data & eval | prev: PhD @Stanford @StanfordAILabTrends for United States
You might like
