UpTrain @UpTrainAI

Eliminate Guesswork. Scale AI Confidently. uptrain.ai San Francisco Joined February 2023

Tweets

62
Followers

135
Following

9
Likes

162

Sourabh Agrawal @SourabhAgr03

a year ago

There have been numerous informal observations about prompt drifts in Large Language Models (LLMs), with the most notable case being GPT-4 showing signs of laziness, especially for coding tasks by the end of the previous year. Discussions on Twitter also hint at a decline in…

1 2 3 475 1

Download Image

LlamaIndex 🦙 @llama_index

a year ago

Open-source evaluation with @UpTrainAI! GenAI applications are complex and unpredictable, so you need to run evaluations to know whether the changes you make are improving your outcomes. Uptrain is a way to move beyond "vibes" based evaluation. Check out their guest blog post:…

1 13 102 10K 46

Download Image

Sourabh Agrawal @SourabhAgr03

a year ago

We are excited to announce the @llama_index <> @UpTrainAI integration! It’s been months in making, but we wanted to deliver something of real value to our community. Evaluations are not just about computing a final score for your application but getting actionable insights on…

0 9 27 3K 9

Download Image

langfuse.com @langfuse

2 years ago

Evals are fast becoming one of Langfuse's most adopted features after core observability. When logging a lot of production usage to Langfuse, teams start layering model-based evals on top of the manual checks and reviews to scale their evaluation.

1 2 11 1K 1

Download Image

UpTrain @UpTrainAI

2 years ago

UpTrain 🤝 @langfuse integration Now, you can seamlessly track the quality, latency and cost of your LLM applications, all in one place. Read more about it: blog.uptrain.ai/uptrain-langfu… Link to the tutorial: langfuse.com/cookbook/evalu…

0 1 10 817 1

Download Image

UpTrain @UpTrainAI

2 years ago

UpTrain v0.6.5 is out

0 0 3 160 0

Download Image

The developersIndia Community @devsinindia

2 years ago

🚨 Clueless about the LLM ecosystem? Join us for an exciting session about LLMs, RAG & much more with @SourabhAgr03, CEO @UpTrainAI Full Announcement: reddit.com/r/developersIn…

0 7 10 528 0

Download Image

UpTrain @UpTrainAI

2 years ago

A Chevy dealer's chatbot agrees to sell a Tahoe for $1! This is a classic example of jailbreaking through an LLM system and why an evaluation tool is needed Check out many such tidbits and more in our chat with @qdrant_engine here: youtube.com/watch?v=utOuPe…

0 1 3 155 0

Qdrant @qdrant_engine

2 years ago

🚀 Elevate your LLM game with another Vector Space Talk this week! Discover the intricacies of using LLM as a judge in evaluating applications with @SourabhAgr03, CEO & Co-Founder at UpTrain AI. 🤯 📅 Date: Feb. 8, 2024 🕒 Time: 5:00 pm CET 🌐 Link: buff.ly/4bjMwYZ

1 1 11 1K 2

Download Image

Y Combinator @ycombinator

2 years ago

.@UpTrainAI (YC W23) is a full-stack LLMOps platform to evaluate, experiment, monitor, and test LLM applications. It is open-source, enabling customization, and can be self-hosted to satisfy your data governance needs. ycombinator.com/launches/KGk-u…

9 6 37 13K 18

Download Gif

Sourabh Agrawal @SourabhAgr03

2 years ago

Exciting news to start the day! @UpTrainAI has been featured in @ycombinator's Top Generative AI Startups 2024 🚀 We're excited to continue pushing the boundaries of generative AI and making a difference in the industry. 💪 Check out OSS here - github.com/uptrain-ai/upt…

0 1 3 734 1

Download Image

Sourabh Agrawal @SourabhAgr03

2 years ago

🚀 It was great fun integrating SPADE, a novel framework for synthesizing LLM evaluations, with @UpTrainAI. Big shoutout to the authors: @sh_reya HaotianLi ParthAsawa @MadelonHulsebos YimingLin J.D. Zamfirescu @hwchase17 Will Fu-Hinthorn AdityaParameswaran @sirrice

1 5 12 3K 4

AJ Chan @itsajchan

2 years ago

What a great experience collaborating with @SourabhAgr03 and the team @UpTrainAI on this blog post where we break down what you can do to evaluate your RAGs when building with vector databases and LLMs. The Uptrain team are A+ players and I'm so glad we met in 2023! If you're…

Sourabh Agrawal @SourabhAgr03

2 years ago

3 9 24 3K 12

Download Image

0 2 11 699 3

UpTrain @UpTrainAI

2 years ago

0 0 1 72 0

Download Gif

Sourabh Agrawal @SourabhAgr03

2 years ago

Starting 2024 with a b[ang]log 💥 We recently wrote a blog, in collaboration with the @weaviate_io team, on the power of Retrieval Augmented Generation (RAG) to overcome the limitations of Language Models!

3 9 24 3K 12

Download Image

Sourabh Agrawal @SourabhAgr03

2 years ago

With all the recent chaos, if you are interested in trying out Claude, Mistral, Cohere, or others, @UpTrainAI provides an open-source tool to determine which one works best for you (without having to spend countless hours manually reviewing the responses)