LLM4Eval Workshop @llm4eval
The Third Workshop on Large Language Models for Evaluation in IR (LLM4IREval@SIGIR2025) llm4eval.github.io Padua, Italy Joined February 2024-
Tweets44
-
Followers84
-
Following62
-
Likes40
Chirag Shah is this morning giving a keynote on: From Relevance to Reality: Scaling Human-Centered Evaluation in the LLM Era
0
2
5
257
1
Download Image
You are welcome to join us at Giotto Platea for the LLM4Eval workshop #SIGIR2025 .
The deadline for submitting your LLM evaluation paper is tomorrow. Looking forward to interesting contributions!
The deadline for submitting your LLM evaluation paper is tomorrow. Looking forward to interesting contributions!
LLM4Eval Workshop retweeted
We will host multiple breakout discussions to pick your brains 🧠 on the future challenges and research on this topic. Let's shape the LLMEval research agenda. Interested? Already have thoughts and ideas? Then, submit your extended abstracts or just join us in the workshop.
We will host multiple breakout discussions to pick your brains 🧠 on the future challenges and research on this topic. Let's shape the LLMEval research agenda. Interested? Already have thoughts and ideas? Then, submit your extended abstracts or just join us in the workshop.
LLM4Eval Workshop retweeted
In today's 2nd Workshop on #LLMs for Evaluation in #InformationRetrieval (#LLM4Eval) at #WSDM2025 (09:15 CET), @edgarmeij, our Head of #AI Platforms Engineering, will deliver a keynote on "Synthetic Evaluations & #GenAI Application Development" bloom.bg/4hyocEi #AI
LLM4Eval Workshop retweeted
The workshop will focus on models, techniques, data collections, and methodologies for information retrieval evaluation in the era of LLMs. #WSDM2025 #IR #Evaluation #Performance #Workshop #NLP #SIGIR
LLM4Eval Workshop retweeted
Organiser: @srahmanidashti, @cnsiro, @maliannejadi, @nickcr, @claclarke, @guglielm0f, @UnderdogGeek, @pt_ir , and @emine_yilm
LLM4Eval Workshop retweeted
The call for papers is now open for the second workshop of #LLM4Eval: 💡 See CFP: llm4eval.github.io/WSDM2025/cfp/ 🗓 Submission deadline: January 20, 2025
LLM4Eval Workshop retweeted
LLM4Eval Workshop retweeted
📢 Thrilled to announce that, "SynDL: A Large-Scale Synthetic Test Collection for Passage Retrieval" is publicly available. w/ @wangxieric, @emine_yilm, @nick_craswell, @UnderdogGeek, @pt_ir Check it out: arxiv.org/abs/2408.16312
LLM4Eval Workshop retweeted
Great panel discussion with @ian_soboroff, @lauradietz99, @claclarke, Michael Ekstrand moderated by @UnderdogGeek at @llm4eval. #SIGIR24
Eray Tuzun @eraytuzun
883 Followers 601 Following Researcher, Practitioner, PhD, Software Engineer. #ALM, #MSR, #Agile, #softwareanalytics, #DevOps, #SPLE
Martin Potthast @martinpotthast
714 Followers 797 Following Information Retrieval and Natural Language Processing; Professor @uni_kassel, @Hessian_AI, and @Sca_DS.AI.
Farhan Ali Arshad @FarhanArshad01
164 Followers 868 Following Software Automation Engineer | ML & NLP practitioner 🧑💻
Xiangyi Li 李向一 @xdotli
2K Followers 1K Following chat with any agent in iMessage. backed by @fdotinc. made @benchflow_ai @lemmahq
Rikiya Takehi @rikiyatakehi
160 Followers 243 Following 4th Yr undergrad @waseda_univ ex-@NIST | information retrieval | NLP | ML | RecSys | Off-Policy Evaluation and Learning |
Damiano Spina 🦋@da... @damiano10
1K Followers 1K Following PhD in Comp Sci., former DECRA, Senior Lecturer, @RMITComputing, @AdmsCentre. CM Camaleão, Capoeira @ACDP_Australia. Percussionist at @Wombatuque.
Danny To Eun Kim @TEKnologyy
544 Followers 1K Following PhD student @LTIatCMU working with @841io on NLP & IR | Prev: MEng @ai_ucl
Matthias Hagen @matthias_hagen
915 Followers 930 Following Professor of "Databases and Information Systems", Friedrich-Schiller-Universität Jena
Ferdinand Schlatt @fschlatt1
151 Followers 212 Following PhD Student, efficient and effective neural IR models 🧠🔎
Negar Arabzadeh @NegarEmpr
1K Followers 962 Following Postdoc at @UCBerkeley Sky Lab | Interested in Information Retrieval | 👩🏻💻Prev : @google, @MSFTResearch, @SpotifyResearch 📚:@UWaterloo
Sajad Ebrahimi @sadjadeb
104 Followers 146 Following MASc student at University of Guelph | NLP Enthusiast, Interested in Information Retrieval
Andrew Yates @andrewyates
1K Followers 911 Following Senior Research Scientist, HLTCOE, Johns Hopkins University. Information Retrieval, Natural Language Processing, and AI.
Mandeep Rathee @rathee_mandeep
62 Followers 154 Following PhD @l3s_luh Research Center, Hannover Germany
Jiqun Liu, PhD @JiqunL
428 Followers 634 Following Associate Professor @UofOklahoma: LLM evaluation and Agentic AI; Bounded Rationality 🧠; Information Retrieval. Previously: @RutgersU @PKU1898. RT ≠ endorsement
Zhaochun Ren @zhaochun_ren
1K Followers 932 Following Associate Professor @TMLeiden, @LIACS, @UniLeiden, working on Information Retrieval and Natural Language Processing. My tweets are my own.
Yashar Deldjoo @yashardel
870 Followers 2K Following Associate Professor @polibaofficial; #RecSys #GenerativeAI #FairML #TrustworthyAI #Risks #Harm #Evaluation
Sean MacAvaney @macavaney
2K Followers 590 Following he/him · Senior Lecturer (Assoc. Professor) at @GlasgowCS @TerrierTeam · working at the intersection of IR&NLP · PhD from @Georgetown IRLab
Sridhanya Ganapathi @SridhanyaArun
12 Followers 90 Following LLM Architect, GenAI Expert | Deep Learning, Deep Reinforcement Learning | Mtech Data science BITS Pilani
Matt Walters @iammattwalters
981 Followers 2K Following Vibing a second brain at Harmony Labs. Ex-Tesla. TechStars OG #SEAFALL2011. 7th Generation Texan. Dedicated to making the world better.
Lakshmi Panguluri @lakshmipangulur
59 Followers 761 Following
Mike Allton | AI for ... @mike_allton
51K Followers 8K Following AI for Creators & Solopreneurs | Automate your biz, reclaim your time. Host @ The AI Hat Podcast. Learn how below! 👇
whyOwhy @whyOwhy_K
0 Followers 17 Following
Danial Namazifard @IamDanialNamazi
676 Followers 6K Following Graduate Researcher at University of Tehran #NLProc #MachineLearning
Sushma Anand Akoju. S... @morals4kindness
94 Followers 1K Following PhD student | 3 Masters: Forensics, Info Sci, Data Sci | NLU & Neurosymbolic AI researcher | Community Educator @UNHSHARPP advocating consent | CIRTL Scholar
Peter West @PeterWestTM
1K Followers 751 Following AI / NLP Researcher Incoming faculty at @UBC_CS and @CAIDA_UBC Postdoctoral fellow at @StanfordHAI @stanfordnlp Former PhD student at @uwcse @uwnlp he/him
Mohamed Yahya محم�... @myahya
300 Followers 1K Following Sr. Software Engineer/Research Scientist, AI@Bloomberg. Working on NLProc etc. @elmnt14: قناة علميّة عن تكنولوجيا الحاسوب في حياتنا. Views exclusively mine.
Logan @qenoop
266 Followers 2K Following Product, AI, trading and software development. Formerly Google, YouTube, DeepMind, Salesforce. 100 yard dash fifth grader record holder at Kendall Elementary.
Haolun Wu @Haolun_Wu0203
281 Followers 325 Following Stanford @stai_research, @Mila_Quebec, @McGillU | Ex @GoogleAI, @MSFTResearch | human-centric AI, alignment, learning from human feedback, knowledge discovery
Eugene Yang @EYangTW
599 Followers 413 Following Information Retrieval | Research Scientist at HLTCOE @JohnsHopkins | CS PhD from @Georgetown | from Taiwan
Faeze Ghorbanpour @FaezeGhorbanpor
106 Followers 2K Following PhD at @TU_Muenchen NLP Researcher at @CisLmu Affiliated with @MunichCenterML
ʕ•.•ʔ @Phiradet_B
81 Followers 1K Following
Jo Kristian Bergum @jobergum
19K Followers 1K Following CEO https://t.co/sYmUNgPBq8 - The retrieval engine for agents.
Harsh Desai @dreamerharsh
1 Followers 7K Following
William Horton @hortonhearsafoo
1K Followers 3K Following Follow me for thoughts on applying GenAI in the healthcare industry! | Staff MLE
Shubham Chatterjee | ... @ShubhamC526
1K Followers 2K Following Assistant Professor of CS | Neural IR | RAG | Conversational IR | LLM | Tweets are my and ONLY MY own opinion
Sergio Soage @Sergio_Soage
878 Followers 6K Following artificial intelligence, math. Random stuff @ https://t.co/tqV9OIPsWE
Xiangyi Li 李向一 @xdotli
2K Followers 1K Following chat with any agent in iMessage. backed by @fdotinc. made @benchflow_ai @lemmahq
Rikiya Takehi @rikiyatakehi
160 Followers 243 Following 4th Yr undergrad @waseda_univ ex-@NIST | information retrieval | NLP | ML | RecSys | Off-Policy Evaluation and Learning |
Farhan Ali Arshad @FarhanArshad01
164 Followers 868 Following Software Automation Engineer | ML & NLP practitioner 🧑💻
Martin Potthast @martinpotthast
714 Followers 797 Following Information Retrieval and Natural Language Processing; Professor @uni_kassel, @Hessian_AI, and @Sca_DS.AI.
Stanford AI Lab @StanfordAILab
210K Followers 332 Following The Stanford Artificial Intelligence Laboratory (SAIL), a leading #AI lab since 1963. ⛵️🤖 Emmy-winning video: https://t.co/lV9smZTC1m
WSDM Conference @WSDMSocial
3K Followers 110 Following The official feed from the ACM WSDM 2026 conference #WSDM2026 -- https://t.co/SGoH0VbArB
Abhinav Gupta @backpropper
2K Followers 7K Following Research Scientist @GoogleDeepMind | Building Gemini
MuRS Workshop @ RecSy... @MuRS_WS
41 Followers 219 Following The 3rd Workshop on Music Recommender Systems. September at the ACM RecSys 2025 Conference in Prague, Czech Republic (and online) #RecSys2025
Marwah Alaofi @Marwah_k
468 Followers 1K Following Information Retrieval PhD candidate @RMIT 🔍🌱| Academic @Taibahu 🤹🏻♀️| @MonashUni alumna 💫 I research to satisfy inquisitive minds
Haolun Wu @Haolun_Wu0203
281 Followers 325 Following Stanford @stai_research, @Mila_Quebec, @McGillU | Ex @GoogleAI, @MSFTResearch | human-centric AI, alignment, learning from human feedback, knowledge discovery
Jo Kristian Bergum @jobergum
19K Followers 1K Following CEO https://t.co/sYmUNgPBq8 - The retrieval engine for agents.
ACM RecSys @ACMRecSys
5K Followers 1K Following The official feed for #RecSys2025: The ACM Conference on Recommender Systems, 22nd–26th September 2025
Michael Bendersky @bemikelive
2K Followers 365 Following @ Databricks / ex-Google DeepMind / ex-Google Research Interested in research at the intersection of IR & AI.
Johanne @JTrippas
951 Followers 473 Following @RMIT Vice-Chancellor's Senior Research Fellow. Prior, Research Fellow @unimelb. Interested in making the web accessible. Even the snail reached the ark. 🐌
Zhaochun Ren @zhaochun_ren
1K Followers 932 Following Associate Professor @TMLeiden, @LIACS, @UniLeiden, working on Information Retrieval and Natural Language Processing. My tweets are my own.
Glasgow IR Group @ir_glasgow
1K Followers 137 Following Glasgow Information Retrieval Group @GlasgowCS
Eugene Yang @EYangTW
599 Followers 413 Following Information Retrieval | Research Scientist at HLTCOE @JohnsHopkins | CS PhD from @Georgetown | from Taiwan
Claudia Hauff 🇪�... @CharlotteHase
4K Followers 2K Following IR * Applied NLP * Applied ML. Spotify.
Ryen White @ryen_white
431 Followers 70 Following @MSFTResearch GM & Dep Lab Dir | @UW Prof (CSE & iSchool) | @TWebACM EiC | @TheOfficialACM Fellow | SIGIR & SIGCHI Academy Member | @AyrUnitedFC
Krisztian Balog @krisztianbalog
2K Followers 280 Following Professor of computer science @UniStavanger, leading @iai_group & Staff research scientist @GoogleDeepMind. Current focus: https://t.co/5JiH909fhx
Andrew Yates @andrewyates
1K Followers 911 Following Senior Research Scientist, HLTCOE, Johns Hopkins University. Information Retrieval, Natural Language Processing, and AI.
Jiaxin Mao @maojiaxin
420 Followers 377 Following Associate Professor at GSAI of the Renmin University of China. Interested in information retrieval, Web search, and AI.
Sean MacAvaney @macavaney
2K Followers 590 Following he/him · Senior Lecturer (Assoc. Professor) at @GlasgowCS @TerrierTeam · working at the intersection of IR&NLP · PhD from @Georgetown IRLab
sophiaalthammer @sophiaalthammer
1K Followers 614 Following Member of Technical Staff in Retrieval-Augmented Generation Team @cohere, previously PhD in neural Information Retrieval @tu_wien
Oleg Zendel @OlegZendel
348 Followers 1K Following Research Fellow @ADMScentre, previously PhD in Comp Sci. @RMITComputing
Xi Wang @wangxieric
1K Followers 1K Following Lecturer of NLP @SheffieldNLP, previous Research Fellow @UCL, PhD @TerrierTeam Glasgow Uni. Research interests in Conversational AI, RAG and topics of NLP & IR.
Yashar Deldjoo @yashardel
870 Followers 2K Following Associate Professor @polibaofficial; #RecSys #GenerativeAI #FairML #TrustworthyAI #Risks #Harm #Evaluation
Suzan Verberne 🤹�... @suzan
3K Followers 2K Following 1980 | Full Professor of Natural Language Processing (@TMLeiden), @LIACS @UniLeiden | Lives in #Nijmegen | Mother of 2 | 👩🏻💻👩🏻🏫🤹♀️🌱 🎼
Peter West @PeterWestTM
1K Followers 751 Following AI / NLP Researcher Incoming faculty at @UBC_CS and @CAIDA_UBC Postdoctoral fellow at @StanfordHAI @stanfordnlp Former PhD student at @uwcse @uwnlp he/him
Agoston Weisz @AgostonWeisz
115 Followers 184 Following Google Deepmind GenMedia (Veo, Imagen) Google I/O moments (Veo 3, Imagen 4, Gemini Live Video and Screenshare)
Asli Celikyilmaz @ACL... @real_asli
3K Followers 1K Following Research Manager at FAIR Superintelligence Labs @Meta and Affiliate Faculty @uwcse | TACL editor-in-chief | Previously: @MSFTResearch, @UCBerkeley and @UofT
Elizabeth Churchill @xeeliz
7K Followers 515 Following Scientist, HCI & UX leader, Professor. Co-Editor in Chief, ACM Interactions.
Tianyu Gao @gaotianyu1350
5K Followers 903 Following CS PhD student @Princeton @Princeton_nlp @PrincetonPLI working on language models. Previously: @Tsinghua_Uni @TsinghuaNLP
Guglielmo Faggioli @guglielm0f
125 Followers 161 Following Post-doc at @iiia_unipd, @UniPadova. Information Retrieval, Evaluation, Privacy-preserving IR.
Jess @_jessiejsmith_
1K Followers 607 Following @ https://t.co/uKWDFWg7xD AI/ML Ethics PhD Candidate @CUBoulder Podcast: @RadicalAIPod 🎙️ PhD Fellow @Google she/her 🏳️🌈 🪴 💫
Negar Arabzadeh @NegarEmpr
1K Followers 962 Following Postdoc at @UCBerkeley Sky Lab | Interested in Information Retrieval | 👩🏻💻Prev : @google, @MSFTResearch, @SpotifyResearch 📚:@UWaterloo
Julia Kiseleva @julia_kiseleva
2K Followers 640 Following Chief Scientist @PleasePlatforms — AI agents, multi-modal, eval, learning from user feedback | Prev: @MSFTResearch @UvA_Amsterdam @bookingcom @bing @HPE_Labs
Mark Sanderson @IR_oldie
4K Followers 259 Following I'm a search engine researcher. I tweet about information retrieval (IR) and uni work. I'm at RMIT University, these are my personal opinions.
Hamed Zamani @HamedZamani
3K Followers 1K Following Assoc. Prof. @manningcics. Assoc. Director of the Center for Intelligent Information Retrieval (CIIR). Interested in IR, NLP & ML.
Damiano Spina 🦋@da... @damiano10
1K Followers 1K Following PhD in Comp Sci., former DECRA, Senior Lecturer, @RMITComputing, @AdmsCentre. CM Camaleão, Capoeira @ACDP_Australia. Percussionist at @Wombatuque.
Fernando Diaz @841io
5K Followers 1K Following Associate Professor, CMU. Researcher, Google. Evaluation and design of information retrieval and recommendation systems, including their societal impacts.
Nicola Ferro @frrncl
2K Followers 201 Following Information Retrieval, Digital Libraries, Evaluation - Full Professor in Computer Science at @UniPadova, leading @iiia_unipd #RussiaUkraineConflict #againstwar
Charlie Clarke @claclarke
990 Followers 1K Following Building and evaluating IR, QA, and RAG systems. Humbly serving as one of the @ass_deans for @WaterlooMath.Trends for United States
160 B posts
3.856 posts
48,1 B posts
21,8 B posts
3.990 posts
5.094 posts
8.595 posts
33,6 B posts
125 B posts
31,4 B posts
12,1 B posts
15,5 B posts
19,3 B posts
12,8 B posts
29,1 B posts
92,4 B posts
You might like
Elon Musk
@elonmusk
225.3M Followers
Barack Obama
@BarackObama
130.6M Followers
Cristiano Ronaldo
@Cristiano
115.7M Followers
Justin Bieber
@justinbieber
108.9M Followers
Donald J. Trump
@realDonaldTrump
108.8M Followers
Rihanna
@rihanna
107.6M Followers
Taylor Swift
@taylorswift13
93.7M Followers
NASA
@NASA
87.8M Followers
Lady Gaga
@ladygaga
81.7M Followers
YouTube
@YouTube
79.0M Followers
Kim Kardashian
@KimKardashian
74.4M Followers
The Ellen Show
@EllenDeGeneres
73.2M Followers
X
@X
68.9M Followers
Virat Kohli
@imVkohli
67.9M Followers
Bill Gates
@BillGates
66.4M Followers
Selena Gomez
@selenagomez
64.9M Followers
Neymar Jr
@neymarjr
63.9M Followers
CNN Breaking News
@cnnbrk
63.9M Followers
CNN
@CNN
63.7M Followers
Justin Timberlake
@jtimberlake
59.2M Followers