Doug Downey @_DougDowney

Researching AI for Science @allen_ai, Prof @northwesterncs Joined May 2020

Tweets

102
Followers

376
Following

214
Likes

451

Ai2 @allen_ai

2 weeks ago

As part of Asta, our initiative to accelerate science with trustworthy AI agents, we built AstaBench—the first comprehensive benchmark to compare them. ⚖️

3 14 103 9K 38

Download Image

Ai2 @allen_ai

2 weeks ago

Introducing Asta—our bold initiative to accelerate science with trustworthy, capable agents, benchmarks, & developer resources that bring clarity to the landscape of scientific AI + agents. 🧵

9 48 217 293K 97

Download Video

🚀 In March, we launched Paper Finder, an LLM-powered literature search agent that surfaces papers other tools miss. Now, we’re releasing an open-source snapshot to enable others to inspect & build on it—and reproduce the results. 🧵

7 63 461 35K 327

Download Image

Ai2 @allen_ai

3 weeks ago

With fresh support of $75M from @NSF and $77M from @nvidia, we’re set to scale our open model ecosystem, bolster the infrastructure behind it, and fast‑track reproducible AI research to unlock the next wave of scientific discovery. 💡

34 74 735 271K 89

Download Image

Ai2 @allen_ai

2 weeks ago

🚨 SciArena update + evaluation of new models including GPT-5! 🚨 With thousands of new votes, new LLMs are reshaping our leaderboard for scientific literature tasks. o3 still leads—but GPT-5, Claude Opus 4.1, & more are closing the gap.

9 4 119 22K 40

Download Gif

Hita K @_hitakam

a month ago

Are you a researcher in CS or a CS-adjacent field who could use help in refining your research ideas? Want to try our new AI-powered tool that helps with just that in a paid user study? Details and sign up here! forms.gle/UPFjyJ59uuZ5Zb…

2 7 20 4K 12

Ai2 @allen_ai

2 months ago

Great science starts with great questions. 🤔✨ Meet AutoDS—an AI that doesn’t just hunt for answers, it decides which questions are worth asking. 🧵

2 38 337 46K 241

Download Image

Ai2 @allen_ai

2 months ago

We’ve upgraded ScholarQA, our agent that helps researchers conduct literature reviews efficiently by providing detailed answers. Now, when ScholarQA cites a source, it won’t just tell you which paper it came from–you’ll see the exact quote, highlighted in the original PDF. 🧵

6 35 198 17K 97

Download Image

Doug Downey @_DougDowney

2 months ago

This was a fun collaboration led by @YilunZhao_NLP and @kaiyan_z from @armancohan's lab at Yale University. Annotators preferred o3 in our study, which was found to give more detailed and technical answers. Curious to see if community voting changes the picture!

Ai2 @allen_ai

2 months ago

2 13 98 13K 22

1 0 7 355 0

Ai2 @allen_ai

2 months ago

Introducing SciArena, a platform for benchmarking models across scientific literature tasks. Inspired by Chatbot Arena, SciArena applies a crowdsourced LLM evaluation approach to the scientific domain. 🧵

12 64 408 71K 210

Download Image

Semantic Scholar Research @ AI2 @ai2_s2research

4 months ago

@allen_ai @SemanticScholar is hiring an #ml #nlp #ai reasoning researcher for a Research Scientist, Agents for Science position with target start dates in 2025. Excited about developing AI systems with deep reasoning capabilities for science? Send an application our way!

1 11 20 3K 8

Download Image

Ai2 @allen_ai

5 months ago

Ever wonder how LLM developers choose their pretraining data? It’s not guesswork— all AI labs create small-scale models as experiments, but the models and their data are rarely shared. DataDecide opens up the process: 1,050 models, 30k checkpoints, 25 datasets & 10 benchmarks 🧵

11 119 659 70K 462

Download Image

Ai2 @allen_ai

5 months ago

For years it’s been an open question — how much is a language model learning and synthesizing information, and how much is it just memorizing and reciting? Introducing OLMoTrace, a new feature in the Ai2 Playground that begins to shed some light. 🔦

18 142 630 166K 316

Download Video

Ai2 @allen_ai

5 months ago

Imagine AI doing science: reading papers, generating ideas, designing and running experiments, analyzing results… How many more discoveries can we reveal? 🧐 Meet CodeScientist, a promising next step toward autonomous scientific discovery. 🧵

6 98 368 41K 235

Download Image

Ai2 @allen_ai

5 months ago

Meet Ai2 Paper Finder, an LLM-powered literature search system. Searching for relevant work is a multi-step process that requires iteration. Paper Finder mimics this workflow — and helps researchers find more papers than ever 🔍

19 217 1K 195K 907

Download Image

Ai2 @allen_ai

6 months ago

Announcing OLMo 2 32B: the first fully open model to beat GPT 3.5 & GPT-4o mini on a suite of popular, multi-skill benchmarks. Comparable to best open-weight models, but a fraction of training compute. When you have a good recipe, ✨ magical things happen when you scale it up!

29 161 671 90K 220

Download Image

Ai2 @allen_ai

6 months ago

We’re excited to share some updates to Ai2 ScholarQA: 🗂️ You can now sign in via Google to save your query history across devices and browsers. 📚 We added 108M+ paper abstracts to our corpus - expect to get even better responses! ✨ The backbone model has been updated to the…

3 37 167 11K 74

Download Image

Ai2 @allen_ai

6 months ago

Introducing olmOCR, our open-source tool to extract clean plain text from PDFs! Built for scale, olmOCR handles many document types with high throughput. Run it on your own GPU for free—at over 3000 token/s, equivalent to $190 per million pages, or 1/32 the cost of GPT-4o!

85 268 2K 280K 2K

Download Video

Ai2 @allen_ai

7 months ago

We took our most efficient model and made an open-source iOS app📱but why? As phones get faster, more AI will happen on device. With OLMoE, researchers, developers, and users can get a feel for this future: fully private LLMs, available anytime. Learn more from @soldni👇