Eval4NLP @eval4nlp

Workshop on Evaluation and Comparison of NLP Systems, co-located with #AACL2025. eval4nlp.github.io Joined October 2019

Tweets

60
Followers

306
Following

36
Likes

62

Eval4NLP @eval4nlp

a month ago

📢📢 This year Eval4NLP is co-located with #aacl2025. Our CFP is now out: eval4nlp.github.io/2025/cfp.html Paper submission deadline: September 29, 2025. Direct submission via OpenReview. ARR commitment deadline: October 27, 2025 Notification of acceptance: November 3, 2025

0 3 4 298 1

NLLG @NLLG_lab

2 months ago

Two more days left to apply 👇👇 x.com/NLLG_lab/statu…

NLLG @NLLG_lab

3 months ago

Two more days left to apply 👇👇 x.com/NLLG_lab/statu…

0 3 10 2K 2

0 3 3 955 1

NLLG @NLLG_lab

11 months ago

📢📢📢The NLLG lab has three new open fully funded PhD positions: 1⃣ - Next Generation LLMs 2⃣ - NLP for Science 3⃣ - Multimodal evaluation metrics Deadlines: End of October ℹ️More information: nl2g.github.io/positions

0 4 10 1K 1

NLLG @NLLG_lab

a year ago

📢📢👉👉@ChrLeiter presenting his work on how explainability can improve evaluation metrics for MT and summarization tomorrow at #eacl2024

Christoph Leiter @ChrLeiter

a year ago

📢📢👉👉@ChrLeiter presenting his work on how explainability can improve evaluation metrics for MT and summarization tomorrow at #eacl2024

0 0 1 414 0

1 1 4 348 1

Eval4NLP @eval4nlp

2 years ago

Eval4NLP23 has concluded. We thank everyone + congratulate our shared task winners on inducing high-quality metrics for MT+summ. using prompting and efficient models: "HIT-MI&T Lab" (even beating GEMBA + COMET🚀) & "DSBA". Shared task overview paper: arxiv.org/pdf/2310.19792…

1 4 16 2K 4

Eval4NLP @eval4nlp

2 years ago

Our accepted papers and program are now online: eval4nlp.github.io/2023/program.h… eval4nlp.github.io/2023/accepted-… Moreover, we're excited to have @alexfabbri4 as invited speaker on the topic of "Re-Evaluating Summarization Evaluation in the Era of LLMs" See u tomorrow 9am (UTC+8), online only!

0 4 12 2K 1

Eval4NLP @eval4nlp

2 years ago

📢📢To accommodate the recent ARR author response period, Eval4NLP @aaclmeeting extends the deadline for pre-reviewed papers until September 30th. Pre-reviewed papers must include: the paper along with its original reviews and scores. More details: eval4nlp.github.io

0 4 5 706 0

will depue @willdepue

2 years ago

Round #2 of DALLE images, using requests from y'all. Here's two animals mixed together into a new species.

will depue @willdepue

2 years ago

Round #2 of DALLE images, using requests from y'all. Here's two animals mixed together into a new species. https://t.co/QZWZatooNk

165 346 4K 1.0M 1K

Download Image

32 33 306 109K 54

Download Image

Eval4NLP @eval4nlp

2 years ago

📢📢 Don't forget: Pre-reviewed papers can be submitted to Eval4NLP @aaclmeeting until September 25 via Openreview Just include the paper and your meta-reviews along with reviews and all the scores. eval4nlp.github.io

0 2 5 1K 2

Eval4NLP @eval4nlp

2 years ago

Due to popular demand, the Eval4NLP workshop @ @aaclmeeting submission deadline has been moved to September 1. We look forward to your submissions! 📣📣 More infos: eval4nlp.github.io

0 7 4 2K 2

Eval4NLP @eval4nlp

2 years ago

📢📢Brief reminder that Eval4NLP submission deadline is this **Friday, 25.08.2023** Focus: Evaluation with/of LLMs, all other evaluation aspects also very welcome 2nd call4papers: aclweb.org/portal/content… Webpage: eval4nlp.github.io/2023/index.html Venue: @aaclmeeting (Bali 🏖️)

0 7 6 2K 0

juri @nlopitz

2 years ago

Shared task on explainable evaluation metrics: The development phase is running, but participation is still easily possible, there's also no necessity to train systems to take part. #nlproc #machinelearning Find out more @nlp_evaluation: eval4nlp.github.io/2023/shared-ta…

0 2 4 441 0

Eval4NLP @eval4nlp

2 years ago

📢📢📢 We have released the description of Eval4NLP's shared task on "Prompting LLMs as Explainable Evaluation Metrics" (for MT & summarization). Dev phase: Aug. 7 Test phase: Sep. 18 System Submission Deadline: Sep. 23 More details: eval4nlp.github.io/2023/shared-ta… 🚀🚀🚀

0 7 12 1K 3

Download Image

Eval4NLP @eval4nlp

2 years ago

📢📢📢 The Eval4NLP workshop will take place this year at AACL 2023. Special focus: Evaluation of/with LLMs. Including a shared task on Prompting LLMs as Explainable Metrics. 📢📢📢 Direct submission deadline: 25.08. Webpage: eval4nlp.github.io/2023/index.html CFP: eval4nlp.github.io/2023/cfp.html

0 13 18 3K 3

Eval4NLP @eval4nlp

3 years ago

Eval4NLP is happening tomorrow, starting at 10:30 UTC. Our combined program with @sum_eval includes some great paper presentations and invited talks from @peyrardMax and @rktamplayo. See you there tomorrow! eval4nlp.github.io/2022/program.h…

0 7 10 0 3

Eval4NLP @eval4nlp

3 years ago

The list of accepted papers is now on our website! eval4nlp.github.io/2022/accepted-… Congratulations to all of the authors, and we look forward to your presentations on November 20. FYI, registration for AACL is now open! aacl2022.org/Registration

0 3 11 0 0

Eval4NLP @eval4nlp

3 years ago

This year, Eval4NLP is accepting submissions of papers with reviews from other venues (see the CFP for more details eval4nlp.github.io/2022/cfp.html#…). Submit your paper and reviews here openreview.net/group?id=aclwe… by September 21, AOE!

0 3 6 0 0

Eval4NLP @eval4nlp

3 years ago

The deadline to submit to Eval4NLP has been extended to August 15! We will also be accepting papers with reviews from AACL in addition to ARR, both due September 21! eval4nlp.github.io/2022/cfp.html

0 5 9 0 0

Steffen Eger @egere14

3 years ago

I got three fully funded PhD positions in new BMBF project "Metrics4NLG". Topic: Evaluation for Text Generation (and text generation itself). Very cool interdisciplinary project :-). If you're interested or know anyone interested, drop me a line ([email protected]).

2 17 52 0 4

Eval4NLP @eval4nlp

3 years ago

The invitation to review for Eval4NLP 2022 was just sent out. If you would like to review (or know someone who does) but didn't get an email, get in contact with us! [email protected]