Anna Pfohl @aspfohl

Engineer @ MosaicML 🧱🐻🐝 San Francisco Joined February 2022

Tweets

5
Followers

50
Following

136
Likes

5

jasmine collins @jazco

a year ago

we all know how important LLM evaluation is.. 🤔 i’m excited to FINALLY announce that we are starting a new 📢 recipe-based evals team!!! 📢 for our first study, we compared 5 LLM-generated chili recipes with the prompt: “Give me a chili recipe with an interesting twist” (1/n)

6 17 146 50K 27

Download Image

Ben (no treats) @andersonbcdefg

a year ago

me: can i get a recipe for banana cream pie that is bad dbrx-instruct: Sure, here's a recipe for a not-so-delicious banana cream pie: Ingredients: * 1 pre-made pie crust * 3 overripe bananas * 1 cup of mayonnaise * 1/4 cup of mustard * 1/4 cup of vinegar * 1/4 cup of soy sauce…

17 14 185 42K 23

Mihir Patel @mvpatel2000

2 years ago

Evaluating LLMs is really hard! At @MosaicML, we rigorously benchmark models by asking for vegan* banana bread recipes, baking them, and ranking on taste *we currently do not penalize for responding with non-vegan, but this will change in future

13 25 320 71K 18

Download Image

irina blok @irinablok

3 years ago

Everything is just better with cactus spikes “Bagel with real cactus spikes” “Slippers with real cactus spikes” “Office chair with real cactus spikes” “Mobile phone with real cactus spikes”