Dynabench @DynabenchAI

Official dynabench account dynabench.org Joined September 2020

Tweets

90
Followers

498
Following

5
Likes

72

Douwe Kiela @douwekiela

2 years ago

Progress in AI continues to outpace benchmarks. Check out this new plot, inspired by @DynabenchAI, that shows just how quickly it's happening. Read more about it here: contextual.ai/plotting-progr…

6 27 112 30K 30

Download Image

Dynabench @DynabenchAI

2 years ago

Big congrats to longterm Dynabenchers @douwekiela and @apsdehal on their exciting launch! Looking forward to seeing what you build! 🎉

Douwe Kiela @douwekiela

2 years ago

Big congrats to longterm Dynabenchers @douwekiela and @apsdehal on their exciting launch! Looking forward to seeing what you build! 🎉

38 38 422 120K 64

0 0 2 519 1

Today, Meta researchers together with @MLCommons working group, are launching DataPerf, the first platform for building data & data-centric AI algorithm leaderboards. We're excited for how DataPerf will help to push the data-centric AI field forward ⬇️

8 25 102 28K 22

Aaron Mueller @amuuueller

3 years ago

Announcing the BabyLM 👶 Challenge, the shared task at @conll_conf and CMCL'23! We’re calling on researchers to pre-train language models on (relatively) small datasets inspired by the input given to children learning language. babylm.github.io arxiv.org/abs/2301.11796

4 75 265 47K 60

Download Image

Mubashara Akhtar @akhtarmubashara

3 years ago

Great talk today by @max_nlp from @ucl_nlp @CohereAI on Dynamic Adversarial Data Collection at the @kclinformatics Distributed AI group!

0 2 16 0 3

Download Image

GenBench @GenBench

3 years ago

Ever wanted to know more about generalisation in NLP but overwhelmed with the number of papers on ArXiv? Fear not! We read 400+ papers, 600+ experiments, and designed a taxonomy 📝 to categorise the research for you! (1/n) 🧵 arxiv.org/abs/2210.03050

5 133 503 0 237

Download Image

Adina Williams @adinamwilliams

3 years ago

How can we improve benchmarking? The @DynabenchAI experiment aims to make faster progress with dynamic data collection, and today, we are pleased to introduce our next stage: @metaai has funded 5 exciting research proposals on the theme of "Rethinking Benchmarking”! Congrats to:

2 21 82 0 17

Dynabench @DynabenchAI

3 years ago

We are very excited to be teaming up with @MLCommons! Stay tuned for our upcoming new datasets and other updates!

MLCommons @MLCommons

3 years ago

We are very excited to be teaming up with @MLCommons! Stay tuned for our upcoming new datasets and other updates!

0 8 15 0 2

0 8 15 0 1

Davis Blalock @davisblalock

3 years ago

"DataPerf: Benchmarks for Data-Centric AI Development" What if instead of holding the data constant and benchmarking different models, we held the model constant and benchmarked different data pipelines? [1/7]