TREC RAG @ 2025 @TREC_RAG
Official Twitter account for the TREC RAG Tracks (2024 & 2025)! trec-rag.github.io Joined February 2024-
Tweets80
-
Followers354
-
Following32
-
Likes100
TREC RAG 2025 official retrieval baselines are available now! š„š„š„ Time to start generating those answers and submit them to eval base before August 17th! šļø Let the games begin, well you have less than a month remaining to submit! š»
TREC RAG 2025 official retrieval baselines are available now! š„š„š„ Time to start generating those answers and submit them to eval base before August 17th! šļø Let the games begin, well you have less than a month remaining to submit! š»
šØ TREC RAG 2025 update: Official baselines are now available! š Mark your calendars: submissions due August 17
šØ TREC RAG 2025 update: Official baselines are now available! š Mark your calendars: submissions due August 17
We are out with the official baselines for @TREC_RAG this year: github.com/castorini/ragnā¦ @Ushivani3 and I had fun putting together a strong Retrieve (Pyserini) -> Rerank (RankLLM) -> Augmented Gen (Ragnarƶk) baseline and we hope to see you all beat it!
We are out with the official baselines for @TREC_RAG this year: github.com/castorini/ragnā¦ @Ushivani3 and I had fun putting together a strong Retrieve (Pyserini) -> Rerank (RankLLM) -> Augmented Gen (Ragnarƶk) baseline and we hope to see you all beat it!
TREC RAG TOPICS ARE OFFICIALLY OUT NOW!!! š„š„š„ LET THE GAMES BEGIN! š„¶
TREC RAG TOPICS ARE OFFICIALLY OUT NOW!!! š„š„š„ LET THE GAMES BEGIN! š„¶
š¢š¢RAG 2025 topics are officially now released! šTest narratives are out now (total 105): trec-rag.github.io/annoucements/2ā¦ Let the games begin! #TREC2025 #RAG
We had a successful participation of over 45+ teams & 150+ runs last year in TREC RAG 2024! š„š„ We are back with @TREC_RAG 2025 this year! Make sure you participate in one of the RAG tracks this year to help accelerate RAG evaluation! ā”ā” Signup here: docs.google.com/forms/d/e/1FAIā¦
We had a successful participation of over 45+ teams & 150+ runs last year in TREC RAG 2024! š„š„ We are back with @TREC_RAG 2025 this year! Make sure you participate in one of the RAG tracks this year to help accelerate RAG evaluation! ā”ā” Signup here: docs.google.com/forms/d/e/1FAIā¦
Hello world! I'm back for TREC RAG 2025. Did you miss us?
Now we know RAG is alive (again). I'll be talking about evals this, evals that, evals!
Now we know RAG is alive (again). I'll be talking about evals this, evals that, evals!
2024 has been a fun year! Initial collab with @vectara on multilingual RAG benchmarking to coordinating a first-ever RAG track (@TREC_RAG) in TREC 2024 and lastly getting to intern at @DbrxMosaicAI! I predict 2025 will be the year of diversity & realistic evals in IR & RAG!
As @ian_soboroff notes kicking off TREC 2024, the 33rd iteration of the series, this is the 30th anniversary of BM25, introduced at TREC-3: trec.nist.gov/pubs/trec3/t3_ā¦
šļø We bring to you UMBRELA ā±ļø relevance judgments for the TREC 2024 RAG topics! It should be a good proxy for evaluating your retrieval pipelines with the TREC 2024 RAG test topics. New topics to assess your systems! In time, other judgments shall be made public too. š§āāļø
šļø We bring to you UMBRELA ā±ļø relevance judgments for the TREC 2024 RAG topics! It should be a good proxy for evaluating your retrieval pipelines with the TREC 2024 RAG test topics. New topics to assess your systems! In time, other judgments shall be made public too. š§āāļø
āļø UMBRELA qrels for the TREC 2024 RAG Track have been posted! arxiv.org/abs/2411.08275
āļø UMBRELA qrels for the TREC 2024 RAG Track have been posted! arxiv.org/abs/2411.08275
Vicki @jenkins_vicki22
360 Followers 3K Following
Ram Rot @RamRot4
0 Followers 94 Following
Marc Green @itsmarcgreen
98 Followers 912 Following founding ai engineer https://t.co/dJKBFlq4oI, 15 years soft eng, 11 years cybersec
Akari Asai @AkariAsai
18K Followers 867 Following Incoming Assistant Professor @SCSatCMU & research scientist @allen_ai. akariasai @ š¦
Belo Abhigyan @AbhigyanBelo
35 Followers 107 Following zippityzoppitygimmethepoppity https://t.co/uvtdp3bYyo
EIKI MURATA @em_portero
92 Followers 185 Following ML Engineer @AIShift_PR @cyberagent_ai ā Master @nlp_waseda
Jorge Ćlvarez @_JorgeAI_
4 Followers 128 Following
Marianne Sweeny @msweeny
3K Followers 893 Following IA polymath with SEO, Content Strategy, UX, Human AI. Former Pres @iainstitute #inmemoriam. Constructive irritant. Avowed heretic. Heresy here is my own.
Qingcheng Zeng @SteveZeng7
1K Followers 2K Following PhD-ing with @rfpvjr and @kaize0409 / social computing, LLMs / Big fan of @Arsenal / Intern @Snowflake @TencentGlobal @jhuclsp @NlpWestlake / Christian
Daniel Cer @daniel_m_cer
564 Followers 809 Following Research Scientist at @GoogleAI, @googIeresearch.
kovariance @kovariance
101 Followers 7K Following
John Miller @Mil47648008John
231 Followers 2K Following I worked as a civil engineer. I maintained and removed infrastructure facilities.I am currently an AI and machine learning engineer as a second career.
Svitlana Vakulenko ļæ½... @svakulenk0
1K Followers 1K Following Assistant Professor (tenure track) @wu_vienna #convsearch former @Apple, Amazon AGI
Martin Potthast @martinpotthast
714 Followers 797 Following Information Retrieval and Natural Language Processing; Professor @uni_kassel, @Hessian_AI, and @Sca_DS.AI.
Dirk Loss @dloss
832 Followers 213 Following
Mo Malekpour @mh_malekpour
1K Followers 1K Following SWE and Graduate Research Assistant @DAIS_PolyMtl & @Mila_Quebec | former Data Analyst @Divar_Official
Forrest Gao @linsen_gao
2 Followers 100 Following
Ramanujam @BryonActon
268 Followers 3K Following I hope you have not been leading a double life, pretending to be wicked and being good all the time. That would be hypocrisy.
DAIS š @ PolyMtl @dais_polymtl
139 Followers 624 Following Data & AI Systems group at @PolyMtl. Supervised by https://t.co/GoLsHyNaeq
Jakub Bartczuk @lambdaofgod
77 Followers 353 Following My opinions are not my own. They belong to the gnomes that live in my head
DaĆ°i Bjarnason @dadibja
45 Followers 795 Following
JĆ³nathan Heras @_Jonathan_Heras
149 Followers 623 Following Profesor del Departamento de MatemĆ”ticas y ComputaciĆ³n de la Universidad de La Rioja
Yukio Uematsu @alfyukio
109 Followers 104 Following Working for Telecom company. Interested in distributed processing and text mining
Francesca Pezzuti @f_pezzuti
27 Followers 156 Following PhD student at @DII_Pisa, focusing on Information Retrieval ššš»
Stijn @StijnSmits
1K Followers 1K Following DMs open mid/post-training, RL, synth data & domain-specific models Pioneered practical multi-Agent coding: https://t.co/XsYDaWVdgl ā° ā·ļø
Isaac Flath @isaac_flath
2K Followers 122 Following Teaching AI Assisted Coding at https://t.co/Yisgsz91iH
B a good chatbot @brbongco
202 Followers 731 Following RAG enthusiast. Builder CEO https://t.co/V10eHqHUGt āļø AI augmented lawyers enable justice at scale & are good for society
Igor Carron @IgorCarron
5K Followers 6K Following CEO https://t.co/b9fz6WvhTx @LightOnIO Paris Machine Learning Meetup (8200+) @ParisMLGroup https://t.co/jY1eeMkqJE (10M+ pageviews) @NuitBlog Rocket Scientist
Oleg Zendel @OlegZendel
348 Followers 1K Following Research Fellow @ADMScentre, previously PhD in Comp Sci. @RMITComputing
Thibaut @Thibaut_Maurel
0 Followers 16 Following
Melissa Pan @melissapan
2K Followers 529 Following CS PhD @UCBerkeley Sky Lab š» Systems & AI & Sustainability š Prev: @google, @ibm, @CarnegieMellonšāš¦ŗ, @UofTšØš¦
Ben ClaviƩ @bclavie
6K Followers 1K Following regressing linearly on a daily basis. wife guy who does retrieval. research @mixedbreadai, prev answerdotai
Shikib Mehri @shikibmehri
465 Followers 1K Following Research Lead @ContextualAI | Previously @AmazonScience; PhD @LTIatCMU
Michaƫl Benesty @pommedeterre33
3K Followers 665 Following Apply mathemagic to law understanding Head of R&D @LefebvreSarrut ex tax lawyer @Deloitte, CPA, financial audit, former core dev @XGBoostProject
Hydrocaburn @hydrocaburn
943 Followers 4K Following Aggregating an āun-intelligentāfeed. A Beaconsmith. unlock feed with time
Danial Namazifard @IamDanialNamazi
673 Followers 6K Following Graduate Researcher at University of Tehran #NLProc #MachineLearning
AHMAD AL-KHALDEY @AKhaldey
24 Followers 3K Following Artificial Intelligence | Cybersecurity | Digital Forensics
Akari Asai @AkariAsai
18K Followers 867 Following Incoming Assistant Professor @SCSatCMU & research scientist @allen_ai. akariasai @ š¦
Xiao Wang @_XiaoWang_
487 Followers 424 Following Assistant Professor/Lecturer at UIBE, School of Information Technology. Previously at University of Glasgow.
Nils Reimers @Nils_Reimers
14K Followers 512 Following VP AI Search @Cohere | ex-huggingface | Creator of SBERT (https://t.co/MKKOMfuQ4C)
Daniel Cer @daniel_m_cer
564 Followers 809 Following Research Scientist at @GoogleAI, @googIeresearch.
Shikib Mehri @shikibmehri
465 Followers 1K Following Research Lead @ContextualAI | Previously @AmazonScience; PhD @LTIatCMU
Ben ClaviƩ @bclavie
6K Followers 1K Following regressing linearly on a daily basis. wife guy who does retrieval. research @mixedbreadai, prev answerdotai
Melissa Pan @melissapan
2K Followers 529 Following CS PhD @UCBerkeley Sky Lab š» Systems & AI & Sustainability š Prev: @google, @ibm, @CarnegieMellonšāš¦ŗ, @UofTšØš¦
Zhaochun Ren @zhaochun_ren
1K Followers 932 Following Associate Professor @TMLeiden, @LIACS, @UniLeiden, working on Information Retrieval and Natural Language Processing. My tweets are my own.
Weiwei Sun @sunweiwei12
243 Followers 180 Following PhD student @LTIatCMU | Ex @VectorInst @Baidu_Inc @ShandongU @ic4ai | Working on NLP, LLM, IR
Omar Khattab @lateinteraction
24K Followers 3K Following Asst professor @MIT EECS & CSAIL (@nlp_mit). Author of https://t.co/VgyLxl0oa1 and https://t.co/ZZaSzaRaZ7 (@DSPyOSS). Prev: CS PhD @StanfordNLP. Research @Databricks.
OpenAI @OpenAI
4.3M Followers 3 Following OpenAIās mission is to ensure that artificial general intelligence benefits all of humanity. Weāre hiring: https://t.co/dJGr6Lg202
LlamaIndex š¦ @llama_index
101K Followers 28 Following Build AI agents over your documents Github: https://t.co/HC19j7vMwc Docs: https://t.co/QInqg2zksh LlamaCloud: https://t.co/yQGTiRSNvj
cohere @cohere
108K Followers 4 Following Cohere builds secure, scalable, and private enterprise-grade AI solutions for real-world business problems. Join us: https://t.co/Yb2xItMObl
Snowflake @Snowflake
58K Followers 1K Following Snowflake delivers the #AIDataCloud to help leading organizations share data, build applications and power their business with AI.
Vivek Raghunathan @vivek7ue
4K Followers 2K Following * SVP eng at @snowflakedb. * AI + search at @snowflakedb. * Co-founder @Neeva . #NeevaAI = AI search. * Ex-VP of Eng @Google (ads,YT, Google Now)
Jo Kristian Bergum @jobergum
19K Followers 1K Following CEO https://t.co/sYmUNgPBq8 - The retrieval engine for agents.
Guido Zuccon @guidozuc
2K Followers 752 Following Professor at The University of Queensland, leader of @IELabGroup (https://t.co/yLTRjRQAWA), Information Retrieval researcher
elliott c @echoi26
256 Followers 220 Following Embeddings @CohereAi previously @scale reformed bottom bucket tech investment banker @ Evercore
Maxime Voisin @maximevoisin_ai
908 Followers 801 Following Product for Tools/Agents/Deep Research @cohere. Previously @labelbox, @stanford computer vision labs.
Daniel Campos @spacemanidol
757 Followers 344 Following Mullet loving model merge of AI, search, and redneck. Thinking about how information retrieval moves beyond BM25
Sean MacAvaney @macavaney
2K Followers 590 Following he/him Ā· Senior Lecturer (Assoc. Professor) at @GlasgowCS @TerrierTeam Ā· working at the intersection of IR&NLP Ā· PhD from @Georgetown IRLab
Rodrigo Nogueira @rodrigfnogueira
2K Followers 311 Following Researcher in Deep Learning, Information Retrieval, and NLP
Waterloo's Cheriton S... @UWCheritonCS
2K Followers 409 Following The twitter account of the David R. Cheriton School of Computer Science.
University of Waterlo... @UWaterloo
99K Followers 583 Following #UWaterloo students, alumni and faculty are at the forefront of innovation. Our greatest impact happens together. š¤š
Nick Craswell @nick_craswell
918 Followers 238 Following Principal Architect @Microsoft | Australian | IR, Web Search, Data Mining | Products, metrics, data release #TRECDL #MSMARCO
Nandan Thakur @beirmug
2K Followers 3K Following PhD @uwaterlooš² IR & NLP | I like good evalsš l Prev: intern @DbrxMosaicAI @GoogleAI & RA @UKPLab | https://t.co/kxQprYr7Xn, https://t.co/YVvVjSyXOS, TREC-RAG and FreshStack! āØ
Jimmy Lin @lintool
15K Followers 844 Following I profess CS-ly at @UWaterloo about NLP/IR/LLM-ish things. I science at @yupp_ai and @Primal. Previously, I monkeyed code for @Twitter and slides for @Cloudera.
Ronak Pradeep @rpradeep42
656 Followers 588 Following PhD at @UWaterloo - LLMs + IR, @TREC_RAG. Now: @yupp_ai, Previous: @Apple @GoogleAI. There is no dark side in the moon, really. Matter of fact, it's all dark.
Microsoft @Microsoft
14.0M Followers 2K Following We're on a mission to empower every person and every organization on the planet to achieve more. Support: @MicrosoftHelpsTrends for United States
You might like
