Generation Evaluation & Metrics Workshop @gem_workshop
Official Handle of the 💎 Generation Evaluation & Metrics (GEM) workshop (ACL 2021, EMNLP 2022, EMNLP 2023) gem-benchmark.com Joined July 2023-
Tweets33
-
Followers84
-
Following1
-
Likes14
📢Please help us to spread the word: the GEM human evaluation team is launching a new multilingual shared task on data-to-text generation and summarization. More information at gem-benchmark.com/shared_task. We are looking forward to receiving your submissions! #NLProc #NLP
Finally, @ShuhaibMehri will present his work on instruction tuning for automatic evaluation of generative tasks (arxiv.org/abs/2310.20072) at the GEM workshop on Wed, Dec 6 at 11am SGT. He is applying to grad schools, talk to him if you're recruiting :) 7/7
On my way to @emnlpmeeting soon! Join me at @gem_workshop in Leo 2, 2:30pm on Dec 6 for a presentation about this paper. Thrilled to also contribute as a panelist in @WiNLPWorkshop on "Tackling Misinformation in Generative AI", 11:00am-12:00 in Leo 1 on Dec 6. See you there!
On my way to @emnlpmeeting soon! Join me at @gem_workshop in Leo 2, 2:30pm on Dec 6 for a presentation about this paper. Thrilled to also contribute as a panelist in @WiNLPWorkshop on "Tackling Misinformation in Generative AI", 11:00am-12:00 in Leo 1 on Dec 6. See you there!
1⃣ Stop by my poster presentation at the @gem_workshop on Dec 6 at 11:00am-12:30pm if you're interested in evaluating summarization for non-news data and how discourse structures can support applications like summarization across text types aclanthology.org/2023.findings-…
We have three papers led that will be presented at #EMNLP2023 and #GEMWorkshop centered around readability assessment and language model evaluation ✍️📢 Work done by @josephimperial_ and @harish See you in Singapore! 🌃🇸🇬
Excited🤩for the 3rd GEM Workshop EMNLP 2023! Here's the schedule for Dec 6! (in Singapore🇸🇬time) 9-10:30 Opening Remarks + 6 12min talks 10:30-11🧋Coffee Break 11-12:30🪧Poster Sess 1 12:30-14🍕Break 14-15:30 7 12min talks 15:30-16🧋Covfefe Break :P 16-17:30🪧Poster Sess 2 👇🏻
Excited to present our recent work at the GEM 💎Workshop, EMNLP 2023: “Elo Uncovered: Robustness and Best Practices in Language Model Evaluation” w/ @eddotman, @beyzaermis, @sarahookr, @mziizm 📃: arxiv.org/abs/2311.17295
At #EMNLP right now? Check out the GEM💎workshop. A lot of good prompt-based stuff 👇🧵 gem-benchmark.com/workshop
GEM logistics update: The venue has internet issues and we cannot get a stable zoom connection. If you are scheduled to give a talk in the early session and have the ability to go this afternoon instead let us know and we will reshuffle things. We are continuing to try to join.
Might be slightly last minute, but I’m thrilled to announce that I will also be giving a talk on our paper in the @gem_workshop this afternoon! 🤩 The session will start at 2pm, in room Leo 2, but it will also be co-hosted through zoom. Drop by and say hi! 😁
Might be slightly last minute, but I’m thrilled to announce that I will also be giving a talk on our paper in the @gem_workshop this afternoon! 🤩 The session will start at 2pm, in room Leo 2, but it will also be co-hosted through zoom. Drop by and say hi! 😁
Check out our poster "Robust Tooling and New Resources for Large Language Model Evaluation via Catwalk" at the @gem_workshop (11am - 12.30pm, Dec 6). Visit my collaborators from @allen_ai there too!
Heading to #EMNLP2023 today! Would love to catch up with old friends and meet new folks excited about interpretability, generation, and understanding LM internals 🔧 📜 - My collaborators at @allen_ai are presenting our poster on LM eval at the @gem_workshop at 11am today!
Today and Now!!! Checkout the fantastic talks and posters lined up at #GEM at #EMNLP2023. If you are interested in generation and evaluating it, come join us in room *Leo* for the exciting schedule today 🤩🤩 #NLProc
Today and Now!!! Checkout the fantastic talks and posters lined up at #GEM at #EMNLP2023. If you are interested in generation and evaluating it, come join us in room *Leo* for the exciting schedule today 🤩🤩 #NLProc
GEM workshop logistics: we are in LEO 2. Up two escalators and a bit of a walk. We have a rocket chat channel #gem-workshop we will monitor for questions. See you soon!
Looking forward to the GEM workshop at EMNLP ( @gem_workshop) where 45 papers on evaluation, generation and metrics were accepted this year! As AC I only saw 6 of them so far, and all the accepted ones presented interesting approaches and valuable contributions - don't miss!
Zrairoo @Zrairoo40458
42 Followers 678 Following
Nata Stulova🇺🇦 @s0nata2
65 Followers 475 Following Software Engineering Researcher ✍️ in 🇺🇦🇬🇧 about IT, life and russian genocide (currently of Ukrainians) views and opinions strictly personal 💅
Gauri @geekytwoshoes
314 Followers 4K Following
Haneul Yoo @HaneulYoo13
474 Followers 221 Following #NLProc PhD candidate at @kaistpr & Visiting scholar at @nyuniversity | Prev. @naver_ai_lab @upstageai @csiro @iamkepco
Siddharth Betala @SiddharthBetal
227 Followers 3K Following ML @entalpic_ai || 24 || IIT Madras || Prev interns @ UofT, UW || Interested in NLP, Explainability and AI4Science
Dara @dara_tourt
13 Followers 8K Following
Glenn Matlin @GlennMatlin
236 Followers 207 Following PhD Computer Science, @gtcomputing 🐝 RAPID AI: Reasoning, Analysis, and Planning for Interactive Decision-making with Artificial Intelligence
Alexandra DeLucia @Alexir563
622 Followers 750 Following @Google intern Summer 2024. @Sony intern Fall 2023. Computer Science PhD Student at @jhuclsp in the @mdredze group. @rollinscollege alum.
Dongqi Liu@ACL2025 @dongqi_me
324 Followers 1K Following A natural language generation student who is not good at language generation. PhD @LstSaar, Visiting PhD @EdinburghNLP, Master @VUamsterdam & @UvA_Amsterdam
KunLin Lee @LeeKLTW
23 Followers 844 Following
colgan roma @ColganRoma
6 Followers 346 Following
Shrestha Mohanty @shremoha
158 Followers 232 Following Grad Student Researcher @MIT, prev: Applied Scientist @Microsoft, MS @UCberkeley. Interested in AI, ML and NLP
Shuhaib Mehri @ShuhaibMehri
88 Followers 369 Following PhD @siebelschool @ConvAI_UIUC | Previously @IBMResearch @amazon
FWuuu @FWuuuuuu
16 Followers 369 Following AI & Security | Blackhat speaker | Now at Meituan & prev Alibaba Cloud
Urmish Thakker @UrmishThakker
595 Followers 2K Following LLM @SambanovaAI | | Ex-@arm research| @mlperf1| @BigscienceW| @TXInstruments,@AMD| @WisconsinCS| @bitspilaniindia
Learn Prompting @learnprompting
16K Followers 895 Following Creators of the Internet's 1st Prompt Engineering Guide. Trusted by 3M Users. Compete for $100K in Largest AI Red Teaming Competition: https://t.co/AEiLMn2jzy
Mukund Srinath @ EMNL... @MukundSrinath3
192 Followers 354 Following Machine Learning Scientist @ Expedia Group | NLP, IR and Trustworthy AI
Harshavardhan K @tsarshah
28 Followers 994 Following CS Grad Backend x AI Engineer Previously @cisco
Shashank @shashankpr16
404 Followers 1K Following Machine learning engineer, researcher, Culer, and Cat lover! Currently building intelligent applications @Atlassian
Irish Panda @IcingPanda
0 Followers 207 Following
Sara Hooker @sarahookr
49K Followers 9K Following I lead @Cohere_Labs. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, ML reliability. Changing spaces where breakthroughs happen.
Benjamin Muller @ben_mlr
950 Followers 2K Following Research in AI. Focusing on scaling language models multi-modally & multilingually. Llama pretraining team @AIatMeta
Yixin Wan @yixin_wan_
3K Followers 1K Following PhD student @UCLAComSci, Incoming Research Intern @TencentGlobal AI Lab | Trustworthy Generative Models | Previously @AmazonScience AGI, @MSFTResearch Asia
Khyathi Chandu @khyathi_chandu
1K Followers 489 Following Research Scientist @MistralAI| Previously at : AI2 @MetaAI @LTICMU @SCSatCMU @GoogleAI @Apple | RisingStars2020
Sallam Abualhaija @Belle0Paix
150 Followers 260 Following
Julian Salazar @JulianSlzr
1K Followers 527 Following Senior Research Scientist at @GoogleDeepMind; speech & audio LLMs for Gemini, Project Astra, Lyria RealTime; past lives in #NLProc, #SpeechProc, pure math.
Arij Riabi @ArijRiabi
595 Followers 2K Following PhD student working on NLP for low-resource, non-standardized language varieties
Jushaan Kalra @JushaanSingh
167 Followers 1K Following alleged prompt engineer | MS in NLP @CMU | Prev. ML @WadhwaniAI, @dtu_delhi, MSBK
Kalpesh Krishna @kalpeshk2011
3K Followers 1K Following Senior Research Scientist @GoogleDeepMind (Gemini team), PhD from @umass_nlp. Former undergrad @IITBombay and intern @GoogleDeepMind, @Allen_AI, @TTIC_Connect.
Linda @l_aldridge55
255 Followers 3K Following
ella rabinovich @ella_rabinovich
18 Followers 103 Following
Ivan Yamshchikov @kr0niker
2K Followers 496 Following Research Professor at CAIRO Technische Hochschule Würzburg-Schweinfurt Science, technology, society and how they affect each other.
Soravit “Beer” Ch... @schangpi
399 Followers 645 Following A computer scientist from Bangkok, Thailand. Research Scientist @GoogleDeepmind. Previous: @GoogleAI, @ShaLabUSC at @CSatUSC, & @BrownCSDept. He/Him. 🏳️🌈
Ziang Xiao @ZiangXiao
1K Followers 620 Following Assist. Prof. @JHUCompSci / HCI /AI4SocialScience, Model Evaluation, Information Seeking
Malikeh Ehghaghi @Malikeh5
467 Followers 392 Following ML Researcher at Vector Institute| PhD Student at UofT | Co-Host of Women in AI Research (WiAIR) Podcast
Nishant Subramani @nsubramani23
776 Followers 2K Following PhD student @LTIatCMU working on model interpretability; student researcher @google // Prev: intern @msftresearch, predoc @allen_ai // @BVB supporter // he/him
Tanvi Dinkar @t_dinkar
298 Followers 584 Following Post doc in Ethics in Conversational AI @HeriotWattUni | Background in CS and Linguistics. Robustness, Ethics, Dialogue, Pragmatics
Marziyeh Movahedi @MarziMovahedi
67 Followers 1K Following CAPTCHA Verified Human | Trained on Multi Modal Data over the past decades but not converged yet | #WomenLifeFreedom
Vigneshwaran N @Vigneshwaran__N
56 Followers 856 Following ML/NLP engineer. Curious about people and minds.
Sebastian Gehrmann @sebgehr
6K Followers 2K Following Head of Responsible AI, CTO office, @Bloomberg. (he/him) Formerly LLMs @ Google Brain / Harvard. views my ownTrends for United States
You might like
