Picture

Sandeep @sandeep1337

Data & Pretraining @MistralAI | Previously @NVIDIA | PhD @MILAMontreal | Masters @SCSatCMU | Intern at @MSFTResearch @facebookai @element_ai @DescriptApp sandeeplearning.com San Francisco, CA Joined February 2009
  • Tweets
    65
  • Followers
    2K
  • Following
    597
  • Likes
    1K
sandeep1337 Profile Picture

Sandeep @sandeep1337

7 months ago

We just dropped new 24B base and instruct models under the Apache 2.0 license. Pretraining this model was a ton of fun!

MistralAI Profile Picture

Mistral AI @MistralAI

7 months ago

We just dropped new 24B base and instruct models under the Apache 2.0 license. Pretraining this model was a ton of fun!

Sandeep retweeted
lmarena_ai Profile Picture

lmarena.ai @lmarena_ai

a year ago

The new Mistral Large 2 is here🔥 It's now leading the Arena hard leaderboards. Super impressive performance in Coding, Hard Prompts and Math, surpassing top-tier models GPT-4 Turbo/Claude Opus! Plus, it's an open-weight model -- another great news for the open-source…

GuillaumeLample Profile Picture

Guillaume Lample @ NeurIPS 2024 @GuillaumeLample

a year ago

The new Mistral Large 2 is here🔥 It's now leading the Arena hard leaderboards. Super impressive performance in Coding, Hard Prompts and Math, surpassing top-tier models GPT-4 Turbo/Claude Opus! Plus, it's an open-weight model -- another great news for the open-source… https://t.co/dlE1n5jF84

Sandeep retweeted
GuillaumeLample Profile Picture

Guillaume Lample @ NeurIPS 2024 @GuillaumeLample

a year ago

Today, we release Mistral Large 2, the new version of our largest model. Mistral Large 2 is a 123B-parameter model with a 128k context window. On many benchmarks (notably in code generation and math), it is superior or on par with Llama 3.1 405B. Like Mistral NeMo, it was trained…

MistralAI Profile Picture

Mistral AI @MistralAI

a year ago

Today, we release Mistral Large 2, the new version of our largest model. Mistral Large 2 is a 123B-parameter model with a 128k context window. On many benchmarks (notably in code generation and math), it is superior or on par with Llama 3.1 405B. Like Mistral NeMo, it was trained…

sandeep1337 Profile Picture

Sandeep @sandeep1337

a year ago

We released Mistral-NeMo 12B today. A model trained with some of my previous collaborators @nvidia. - 128K sequence length - 128k vocab size with good compression in 100+ languages. - Base & FP8 Instruct Model with strong results - Apache 2.0 Blog: mistral.ai/news/mistral-n…

Sandeep retweeted
MistralAI Profile Picture

Mistral AI @MistralAI

a year ago

mistral.ai/news/mistral-n…

sandeep1337 Profile Picture

Sandeep @sandeep1337

a year ago

Excited to share one of the things that I've been working on for the past few months after joining Mistral - Codestral-22B. Particularly satisfying to build a code assistant with FIM since it is what I use LLMs for the most. Try it for free on LeChat - chat.mistral.ai/chat

sandeep1337 Profile Picture

Sandeep @sandeep1337

a year ago

We just dropped the 8x22B Base and Instruct Models on @huggingface with an Apache 2.0 License! Looking forward to seeing what the open-source community cooks with this! Blog: mistral.ai/news/mixtral-8… HF base: huggingface.co/mistralai/Mixt… HF instruct: huggingface.co/mistralai/Mixt…

Sandeep retweeted
MistralAILabs Profile Picture

Mistral AI Labs @MistralAILabs

2 years ago

Thrilled to announce the first @MistralAI Hackathon in San Francisco on March 23-24! Sign up at: partiful.com/e/Zk9c9HVsmtsG… Keynote from Mistral AI founders: @arthurmensch & @GuillaumeLample. Mistral AI mentors: @dchaplot, @sandeep1337, @theo_gervet, @mjmj1oo, @sophiamyang

sandeep1337 Profile Picture

Sandeep @sandeep1337

2 years ago

Mistral Large (mistral.ai/news/mistral-l…) is now available at chat.mistral.ai/chat!

Sandeep retweeted
arthurmensch Profile Picture

Arthur Mensch @arthurmensch

2 years ago

We’re announcing a new optimised model today! Mistral Large has top-tier reasoning capacities, is multi-lingual by design, has native function calling capacities and a 32k model. The pre-trained model has 81.2% accuracy on MMLU. Learn more on mistral.ai/news/mistral-l…. Mistral…

Sandeep retweeted
dchaplot Profile Picture

Devendra Chaplot @dchaplot

2 years ago

We just released Mixtral 8x7B paper on Arxiv: arxiv.org/abs/2401.04088

Sandeep retweeted
arankomatsuzaki Profile Picture

Aran Komatsuzaki @arankomatsuzaki

2 years ago

Retrieval meets Long Context Large Language Models Llama with 32K context using retrieval-augmentation at generation outperforms finetuned LLM with 32K context via positional interpolation, while taking much less computation arxiv.org/abs/2310.03025

sandeep1337 Profile Picture

Sandeep @sandeep1337

4 years ago

Defended my PhD thesis "On Representation Learning for Generative Models of Text" @Mila_Quebec last week. Shoutout to my awesome committee @sleepinyourhat @chrisjpal, Yoshua Bengio, @AaronCourville, and Philippe Langlais. Excited about my next adventure as a researcher @NVIDIAAI.

Sandeep retweeted
RBCBorealis Profile Picture

RBC Borealis @RBCBorealis

5 years ago

Thrilled to share the winners of our 2020 Graduate Fellowship Awards. These awards are given to students who've shown outstanding #research capabilities and represent leading Canadian universities & #AI institutes. #Canada Read more: bit.ly/2MjLySh

Sandeep retweeted
shrimai_ Profile Picture

Shrimai @shrimai_

6 years ago

Our paper titled “Towards Content Transfer through Grounded Text Generation” with @MSFTResearch co-authors @chris_quirk and Michel Galley has been accepted to #naacl2019. Paper: arxiv-export-lb.library.cornell.edu/pdf/1905.05293 Dataset & Code: github.com/shrimai/Toward… Project Page: microsoft.com/en-us/research…

sandeep1337 Profile Picture

Sandeep @sandeep1337

6 years ago

If you're at #iclr2019, come check out our poster from 11-1 on Thursday (with @FacebookAI and @milamontreal) on text rewriting arxiv.org/abs/1811.00552. With collaborators @GuillaumeLample, Eric Smith, @LudovicDenoyer, Marc'Aurelio and Y-Lan.

Sandeep retweeted
boredyannlecun Profile Picture

Bored Yann LeCun @boredyannlecun

7 years ago

And now, starting at small forward..... AAAAAARONNNNNN ...... COOOOOOURVILLLLLLLLE!!!! #torched

IanOsband Profile Picture

Ian Osband @IanOsband

7 years ago

And now, starting at small forward..... AAAAAARONNNNNN ...... COOOOOOURVILLLLLLLLE!!!! #torched

Sandeep retweeted
FarzaTV Profile Picture

Farza 🇵🇰🇺🇸 @FarzaTV

7 years ago

Introducing PogChampNet: a deep convolutional net that takes only a video of Overwatch gameplay as input and can automatically extract the "highlight worthy" moments. Automatic montages! It was trained on data powered by Twitch chat and its memes. blog: goo.gl/KRFYZE

Sandeep retweeted
phillip_isola Profile Picture

Phillip Isola @phillip_isola

7 years ago

#BigGAN is so much fun. I stumbled upon a (circular) direction in latent space that makes party parrots, as well as other party animals:

Trends for United States

Ryan Clark
7.055 posts
Tylenol
25,2 B posts
#2KDay
77,2 B posts
Department of War
87,5 B posts
Alcaraz
57,7 B posts
Chargers
32,7 B posts
#SmackDown
19,9 B posts
Djokovic
51,4 B posts
S&P 500
5.629 posts
#FreeAngel
#CashAppFriday
8.686 posts
Hyundai
107 B posts
Chiefs
70,6 B posts
Eswatini
8.135 posts
Secretary of War
19,8 B posts
$HOOD
16,4 B posts
Chicago Sky
4.094 posts
#TSTheErasTour
Eric Adams
11,4 B posts
Sorber

You might like

Building next-gen AI at @thinkymachines. Past: Founding team @MistralAI, RS at Facebook AI Research. Ph.D. @SCSatCMU, BTech @iitbombay CS.
Devendra Chaplot
@dchaplot
13K Followers
Associate prof. at the University of Montréal and Mila. Research scientist Google DeepMind. Previously Stanford; UT Austin.
Ioannis Mitliagkas (�...
@bouzoukipunks
4K Followers
Assistant Professor @ Princeton (ML/RL+strategic decision-making+Law). Prev: Stanford (JD/PhD); McGill/Mila; Meta FAIR; Amazon; Cal Supreme Court.
Peter Henderson
@PeterHndrsn
4K Followers
Team member at something young. Adjunct Prof @ McGill. Member of Mila, Quebec AI Institute. Stream of consciousness is my own.
🇺🇦 Dzmitry Bahd...
@DBahdanau
9K Followers
AI Research @GoogleDeepMind, PhD in RL with Doina Precup and @MarlosCMachado. Previously @Apple & @Meta
Martin Klissarov
@MartinKlissarov
2K Followers
Research Scientist @Google_Deepmind. PhD at @MILA.
Nan Rosemary Ke
@rosemary_ke
5K Followers
Research Scientist @MetaAI; PhD from @mcgillu + @Mila_Quebec; I organize ML Reproducibility Challenge (@repro_challenge). I do research in Multimodal ML
Koustuv Sinha
@koustuvsinha
3K Followers
Thinking about thinking. Gemini ♊. Spent time at @Berkeley_EECS, @MPI_IS, @GoogleDeepMind.
Anirudh Goyal
@anirudhg9119
5K Followers
Scientist MAI, Prof @ EPFL, Ex-research scientist @ DeepMind, MSR, IBM Socials: https://t.co/qYmpvyUf0u, https://t.co/LZ5sWt7Asj
Caglar Gulcehre
@caglarml
5K Followers
Research Scientist @MSFTResearch NYC; Ex @SDAIA_SA @DreamFoldAI PhD @Mila_Quebec, intern @MSRMontreal @MSRNYC @AppleMLR; RL, Reasoning and LLMs
Riashat Islam
@riashatislam
2K Followers
Research Scientist @ServiceNowRSRCH. Gradient-descent enthusiast building LLM agents. Formerly @Mila_Quebec, @GoogleDeepmind, @AWScloud, @SpotifyResearch.
Massimo Caccia
@MassCaccia
2K Followers
NLP/DL from @mcgillu /CS. Style Analysis, Evaluation techniques for authorship identification/obfuscation. Ex DMaS, @rllabmcgill, and @Mila_quebec.🇵🇸 🇨🇦
Malik Altakrori, Ph.D...
@AltakroriM
859 Followers
Machine learning professor at Mila / University of Montreal. Like to understand things - ML, optimization and statistics, but also philosophy, society and yoga.
Simon Lacoste-Julien
@SimonLacosteJ
3K Followers
Associate Professor @polymtl and @Mila_Quebec; Canada CIFAR AI Chair; Machine Learning Researcher. Pro-bono office hours: https://t.co/tK69DKRf9N?amp=1
Sarath Chandar
@apsarathchandar
6K Followers
Researcher @ FAIR, Meta AI. Adjunct prof @ McGill. Core industry member @ Mila. Opinions are my own. (she/her)
Adriana Romero-Sorian...
@adri_romsor
1K Followers