Scott Fleming @_scott_fleming_
Biomedical Data Science Ph.D. Student, MS Student in CS (AI/ML) at Stanford University @StanfordAILab Stanford, CA Joined September 2011-
Tweets126
-
Followers254
-
Following515
-
Likes205
Our clinical #NLP work just published in @NatureMedicine! We present a framework to adapt & evaluate #LLMs for summarization. Physicians 🩺 prefer #LLM summaries to those of #medical experts❗ Big step to reduce documentation 📚 and focus more on personalized care 🙌 A 🧵
Are #LLMs ready for deployment into the clinic? How can we tell if they are vs. are not? @jasonafries does a great job laying out the current state of affairs for evaluating medical LLMs and how our recent work, MedAlign (medalign.stanford.edu), fits into the bigger picture.
Are #LLMs ready for deployment into the clinic? How can we tell if they are vs. are not? @jasonafries does a great job laying out the current state of affairs for evaluating medical LLMs and how our recent work, MedAlign (medalign.stanford.edu), fits into the bigger picture.
Super excited to present our work on MedAlign @RealAAAI #AAAI24 in the AI for Social Impact Track. Happening now in Room 217, come check out our work and the other great projects being presented if you're attending
Lots of hype around #LLMs in healthcare. What do clinicians really want from an #LLM? We asked them! Introducing #MedAlign, the first dataset of clinician-generated instructions + responses for EHRs 🏥🤖 📄Paper: arxiv.org/abs/2308.14089 🌐Website: medalign.stanford.edu
Evaluating few-shot learning is standard w/ LLMs but not EHR foundation models... yet! We're excited to release #EHRSHOT a dataset of ~7k patients + a foundation model pretrained on 2.57M de-identified EHRs #NeurIPS2023 📄 arxiv.org/abs/2307.02028 🌐 ehrshot.stanford.edu
Super excited to have led this work with my awesome collaborators! Check out our poster #440 at #NeurIPS2023🗓️ on Thursday from 5-7pm CST to learn more. 📽️ Slides/Talk: nips.cc/virtual/2023/p… 🌐Website: ehrshot.stanford.edu
Super excited to have led this work with my awesome collaborators! Check out our poster #440 at #NeurIPS2023🗓️ on Thursday from 5-7pm CST to learn more. 📽️ Slides/Talk: nips.cc/virtual/2023/p… 🌐Website: ehrshot.stanford.edu
We're excited to introduce #INSPECT a large-scale ✨3D multimodal✨medical imaging dataset #NeurIPS2023 19,402 Stanford Medicine Patients 🩻23,248 CT Scans + 📄Paired Radiology Notes 📈Longitudinal EHRs 🩺Clinician-validated task labels #DataCentricAI #Multimodal #3Dimaging 1/
Michael is not only incredibly smart, talented, and hard working, but also just a genuinely good person who cares deeply about science, rigor, and other people’s wellbeing. Couldn’t recommend this opportunity highly enough!
Michael is not only incredibly smart, talented, and hard working, but also just a genuinely good person who cares deeply about science, rigor, and other people’s wellbeing. Couldn’t recommend this opportunity highly enough!
Huge thanks to @SehjKashyap for highlighting our MedAlign work in this concise &!informative video: youtu.be/e-3TCn8WTMc?si… Come find us at #ML4H @SymposiumML4H in New Orleans today (Dec 10) where we’ll be giving a ⚡️talk at 15:35 CT! (And Follow/Subscribe @SehjKashyap!)
Can we build AI research agents to perform long-horizon tasks like ML engineering tasks e.g.Kaggle? Introducing our new work MLAgentBench: Benchmarking Large Language Models as AI Research Agents!
On leaderboard Stable LM 3b matches LLaMA v2 7b performance on 42% of the size (beats on SciQ, MMLU), similar architecture, runs much faster. Beats Falcon 7b, MPT-7b etc. It beats all 3b models, including fine-tuned ones. Smol, open LMs ftw 😍 huggingface.co/spaces/Hugging…
On leaderboard Stable LM 3b matches LLaMA v2 7b performance on 42% of the size (beats on SciQ, MMLU), similar architecture, runs much faster. Beats Falcon 7b, MPT-7b etc. It beats all 3b models, including fine-tuned ones. Smol, open LMs ftw 😍 huggingface.co/spaces/Hugging… https://t.co/iAq8fKfora
Great resource from @katieelink! Super excited and encouraged by the love and attention ❤️ that Healthcare 🩺 is getting from the AI community 🤖
Great resource from @katieelink! Super excited and encouraged by the love and attention ❤️ that Healthcare 🩺 is getting from the AI community 🤖
So you've created an ✨awesome✨ biomedical ML model, and now you want to (responsibly) share it with the world Here are some best practices for sharing medical models and demos ⤵️
More meaningful evaluation of medical LLMs is a key challenge currently, so it's really exciting to see work like this 🤩 You can even contribute your ideas for tasks involving electronic health records (link on their website)
More meaningful evaluation of medical LLMs is a key challenge currently, so it's really exciting to see work like this 🤩 You can even contribute your ideas for tasks involving electronic health records (link on their website)
🩺 Clinicians plz help! Large Language Models (#LLMs) can do a lot, but what do you _want_ them to do? Have an instruction you wish an LLM could handle at the bedside? Submit here: bit.ly/medalign to help us build LLMs aligned with clinician needs and preferences 🙏
🩺 Clinicians plz help! Large Language Models (#LLMs) can do a lot, but what do you _want_ them to do? Have an instruction you wish an LLM could handle at the bedside? Submit here: bit.ly/medalign to help us build LLMs aligned with clinician needs and preferences 🙏
Super excited to share our benchmark dataset + eval for #LLMs on Electronic Health Record (EHR)-based tasks! If you're curious how clinicians 🩺 will likely use LLMs in coming years, see @jasonafries' 🧵👇 + check out our 📄 (arxiv.org/abs/2308.14089)
Super excited to share our benchmark dataset + eval for #LLMs on Electronic Health Record (EHR)-based tasks! If you're curious how clinicians 🩺 will likely use LLMs in coming years, see @jasonafries' 🧵👇 + check out our 📄 (arxiv.org/abs/2308.14089)
The hypocrisy of starting the Doerr School of Sustainability and then deciding to ship athletic teams across the country every weekend by plane is astounding
The hypocrisy of starting the Doerr School of Sustainability and then deciding to ship athletic teams across the country every weekend by plane is astounding
Our survey on #LLMs for EHRs is out! We review 84 published Foundation Models for EHRs, discuss current limitations and opportunities. Great work by @MichaelWornow et al! 📝 Blog post hai.stanford.edu/news/shaky-fou… @StanfordHAI 🎓 Manuscript nature.com/articles/s4174…
Our survey on #LLMs for EHRs is out! We review 84 published Foundation Models for EHRs, discuss current limitations and opportunities. Great work by @MichaelWornow et al! 📝 Blog post hai.stanford.edu/news/shaky-fou… @StanfordHAI 🎓 Manuscript nature.com/articles/s4174…
Foundation models (FMs) such as #ChatGPT have the potential to revolutionize healthcare. But what's hype and what's real? This review from a team in @StanfordMed includes 84 clinical FMs + proposes an evaluation framework better suited to assess value. nature.com/articles/s4174…
You know something is trustworthy when adding the word “trustworthy” in front of it doesn’t make any sense. Like is anyone out there doing Trustworthy ANOVA research?

Tom Pollard @tompollard
2K Followers 2K Following
Judy Shen @judyhshen
3K Followers 1K Following Ph.D. Student @Stanford CS working on algorithmic fairness, privacy, and explainability. Formerly @mit @medialab, @UofT ✝️
Felipe Matsuoka @FelipeMatsuoka
13 Followers 235 Following Medical student interested in artificial intelligence in healthcare .
Una Batz @BatzUna46508
31 Followers 2K Following
Soosoez @SoosoezJGZ9k8
20 Followers 2K Following
Stanford AIDE @stanford_aide
16 Followers 158 Following @StanfordRad group dedicated to improving the safety, reliability, and equity of AI in healthcare, co-directed by @larson_david_b and @Dr_ASChaudhari
Manish Pandey 🧬 @Manish_GenAI
471 Followers 7K Following Co-Founder @FreeDoctr 🧬⚕️ , Building a collaborative Platform for Patients and Doctors. 🌐🩻 #GraphML, #GeometricDL, #Gen AI #ML ,#RL, #LLM, #AIForHealthcare
MX @marcusxiang
43 Followers 1K Following
RaeCoffey @WrN2cFvkW9Rat6d
77 Followers 7K Following
Suhana Bedi @BediSuhana42170
27 Followers 86 Following PhD at Stanford, pushing the boundaries of AI in healthcare
Amelia @S46Co1hyz675U
70 Followers 7K Following Building on the XRP ledger. ♥️ Wife, kids, 🦜 & programming (TS, nodejs, Linux ..)
Alyssa Unell @AlyssaUnell
227 Followers 183 Following CS PhD Student @StanfordAILab. Previously @MIT_CSAIL. Robustness and reliability of ML for healthcare.
Nuechit @NuechitrmTq
69 Followers 7K Following
William Rojas-Carabal... @warc97
38 Followers 108 Following MD @urosario Research fellow @NTU_LKCMedicine Visiting scholar @TTSH #Ophthalmology, #AI, #Uveitis
Rohan Pandey @rohan99pandey
631 Followers 481 Following Robustness, NLP & Healthcare | CS PhD @UMassAmherst @UMassBioNLP | Prev. @mckinsey @ShivNadarUniv | Opinions: Personal
EudoraSaul @6cp3ApCq1S32u
69 Followers 7K Following
Soynoathi @SoynoathiT__X4
24 Followers 3K Following
Katie Matton @katie_matton
415 Followers 363 Following PhD Student at MIT. Part of @MIT_CSAIL, @medialab. Researching ML + causality + interpretability for health and well-being.
McNetoo @NetooMc47863
71 Followers 7K Following
yang @hibaiyang
58 Followers 784 Following Long in self-evolving systems. Do a little bit about technology work
Danielle Belgrave @DaniCMBelg
7K Followers 2K Following VP of AI/ML @GSK. Curious about using AI to make the world a better place. Views my own.
Robin Ranjit Singh Ch... @robinc
2K Followers 5K Following 🌱 Head of Eng @AgFunder 🧠 AI:Reinforcement Learning/NLP 🎙️Host @TalkRLPodcast 💳 ex-@Microsoft ecomm PgmMgr 🤖 @UWaterloo CompEng 🇨🇦 🇮🇳
Sesabought @sesabought63524
77 Followers 7K Following A strong woman is one who is determined to do what others are determined not to do.
Research to the Peopl... @Research2People
520 Followers 2K Following Open Patient-Partnered Research For #Oncology and #RareDisease.
Better tech 👨�... @digitalhealthxx
8K Followers 7K Following 🚀 Bridging AI Innovation and Enterprise Systems for Real-World Impact
Henry Jin @jinnyboiii
2K Followers 7K Following Building @withLeoAI | AI Toolkit for Teachers https://t.co/4SSkxVltTn @Harvard and @UCBerkeley alum
Ben Viggiano @bviggiano_13
58 Followers 201 Following https://t.co/qVEAUIu2Tx | MS/Ph.D. student at Stanford working with the Ashley Lab (@euanashley)
Mayank Keoliya @KeoliyaMayank
85 Followers 302 Following PhD @ Penn, working on trustworthy AI for healthcare!
Lillian Sung @sung_lillian
98 Followers 116 Following
Ian Maurer 🧬 @imaurer
1K Followers 1K Following CTO @GenomOncology #genomics #precisiononcology #nlp
Wildtabby @xinyuxiangxxy
59 Followers 121 Following Biophysics PhD @stanford; some science..lots of random and weird personal interests. Wildlife, archaeology and herpetology fan. Have a pet snake 🐍
Ipsit Mantri @SriIpsit
488 Followers 6K Following Research Intern @INSIGHTLabBGU || Interned @SonyAI_global Tokyo || MS'25 @PurdueCS || CMMRS'23 || BTech EE'22 @IITBombay
Matt Gross @mgrosx
497 Followers 606 Following Focus on healthcare software that actually helps patients at https://t.co/4M3GpWmuE2 Technology for AI and APIs at https://t.co/0mnEOHQlbE
Mahvish @mishmashnash
1 Followers 150 Following
Onkar @Onkar2803
200 Followers 798 Following MS CS @ UC San Diego | NLP Researcher at UC San Diego Health
Imed-Eddine Haouli @ImedEddine_Ha
250 Followers 4K Following PhD Student in Artificial Intelligence | oneAPI Student Ambassador
Brad Clerkin @bradclerkin
146 Followers 242 Following IT strategist, technologist, consultant, and program manager. Big fan of family, friends, America, beer, coffee, weightlifting, and food.
sharkoff @sharkoff
385 Followers 2K Following Just your friendly Pediatric Endocrinologist and health IT specialist. I also dabble in crypto and blockchains. All views/tweets are my own.
Sajjad Fouladvand, Ph... @SajjadFV
198 Followers 829 Following Data Scientist at @JNJinnovation | PhD in CS | @universityofky @Stanford @StanfordBMIR @mayoclinic alumni
Shalmali Joshi @shalmali_joshi_
792 Followers 811 Following Assistant Professor, Columbia University. Machine Learning for Health @ColumbiaDBMI. Previously Harvard University, Vector Institute, UT Austin
Jay Rughani 🇺🇸 @JayRughani
5K Followers 1K Following Partner @a16z investing in healthcare technology. Prev @flatironhealth (acq by @roche for ~$2b) & @deloittehealth. Professional student.
Tom Hartvigsen @tom_hartvigsen
2K Followers 747 Following Assistant Professor of Data Science @UVA developing responsible machine learning and NLP methods for ever-changing environments. Recruiting PhD students!
Maya Varma @mayavarma23
120 Followers 67 Following @Stanford CS PhD student // @KnightHennessy, @NDSEG, & @QuadFellowship
Anastasios Nikolas An... @ml_angelopoulos
5K Followers 1K Following Building @lmarena_ai. Statistics, model evaluation. Formerly @Berkeley_EECS, @stanford_ee, student researcher @GoogleDeepMind.
Tom Pollard @tompollard
2K Followers 2K Following
Kyunghyun Cho @kchonyc
77K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre physicist at @nyuniversity (@CILVRatNYU) & @PrescientDesign
Bronwen Pugh @PughBronwe67361
1 Followers 0 Following
Eric Nguyen @exnx
3K Followers 484 Following Co-founder @ Radical Numerics, PhD @ stanford @HazyResearch @StanfordAILab
Neha Hulkund @NHulkund
312 Followers 387 Following PhD Student at @MIT_CSAIL working on AI for scientific data
Judy Shen @judyhshen
3K Followers 1K Following Ph.D. Student @Stanford CS working on algorithmic fairness, privacy, and explainability. Formerly @mit @medialab, @UofT ✝️
Lily Zhang @lilyhzhang
613 Followers 522 Following Research Scientist @GoogleDeepmind. Previously @Meta, @Google, @NYU, @Harvard.
Sanjana Srivastava @sanjana__z
553 Followers 592 Following AI PhD student @StanfordAILab @StanfordSVL | Previously @DeepMind @MITCSAIL @mitbrainandcog @MIT_CBMM
Julie Kallini ✨ @JulieKallini
1K Followers 443 Following CS PhD @StanfordNLP 🌲 Previously: SWE @Meta, Class of '21 @PrincetonCS
benahorowitz.eth @bhorowitz
691K Followers 629 Following
Reid Hoffman @reidhoffman
778K Followers 672 Following Co-Founder, LinkedIn. Currently using AI to cure cancer faster @manas_co.
Interconnects @interconnectsai
7K Followers 1 Following What you need to know about AI research trends, from @natolambert Wednesday mornings weekly, sometimes extra posts.
Sujay Nagaraj @sujnagaraj
789 Followers 1K Following MD/PhD Student, Vanier Scholar @uoftmedicine @UofTCompSci Machine Learning in Medicine | Aspiring clinician/innovator | Views are my own | he/him
Lucas Beyer (bl16) @giffmana
108K Followers 518 Following Researcher (now: Meta. ex: OpenAI, DeepMind, Brain, RWTH Aachen), Gamer, Hacker, Belgian. Anon feedback: https://t.co/xe2XUqkKit ✗DMs → email
Lex Fridman @lexfridman
4.4M Followers 589 Following Host of Lex Fridman Podcast. Interested in robots and humans.
Vinod Khosla @vkhosla
690K Followers 600 Following entrepreneurship zealot, grounded technology possibilist, believer in the power of ideas, passionate about sustainability & impact
Paul Graham @paulg
2.1M Followers 774 Following
Marc Andreessen 🇺�... @pmarca
1.9M Followers 27K Following Yes, I can see some risk that your threat to jail Internet company executives for not censorsing aggressively enough could backfire.
Nancy Pelosi Stock Tr... @PelosiTracker_
1.2M Followers 522 Following Highlighting Politicians' trades so we can invest alongside Goal: get them banned from trading. $800,000,000 invested on @joinautopilot_ so far
David Holzmüller @DHolzmueller
606 Followers 317 Following Postdoc in machine learning with @BachFrancis @GaelVaroquaux: neural networks, tabular data, atomistic ML, active learning, learning theory. Also on 🦋.
The AI Timeline @TheAITimeline
24K Followers 1 Following covering the latest AI & LLM research /// see "highlights" for all previous weekly threads /// building the best AI paper search engine @findmypapersai
Russell M. Nelson @NelsonRussellM
288K Followers 17 Following The authorized account for President Russell M. Nelson, President of The Church of Jesus Christ of Latter-day Saints.
Alyssa Unell @AlyssaUnell
227 Followers 183 Following CS PhD Student @StanfordAILab. Previously @MIT_CSAIL. Robustness and reliability of ML for healthcare.
Jan Leike @janleike
115K Followers 332 Following ML Researcher @AnthropicAI. Previously OpenAI & DeepMind. Optimizing for a post-AGI future where humanity flourishes. Opinions aren't my employer's.
Ben Poole @poolio
21K Followers 1K Following research scientist at google brain. phd in neural nonsense from stanford.
niki parmar @nikiparmar09
15K Followers 901 Following Working @Anthropic. Views expressed here are my own.
Mark Chen @markchen90
64K Followers 332 Following Chief Research Officer at @OpenAI. Coach for the USA IOI Team.
Christian Szegedy @ChrSzegedy
41K Followers 3K Following #deeplearning, #ai research scientist. Opinions are mine.
Ashish Vaswani @ashVaswani
25K Followers 2K Following
Denny Zhou @denny_zhou
21K Followers 541 Following Founded & lead the Reasoning Team in Google Brain (now part of Google DeepMind). Build LLMs to reason. Opinions my own.
lmarena.ai @lmarena_ai
92K Followers 207 Following LMArena: Open Platform for Community-driven AI Benchmarking. Graduated from UC Berkeley / @lmsysorg. We’re hiring: https://t.co/1OkfLq2n0I
Lukasz Kaiser @lukaszkaiser
9K Followers 78 Following
Noam Brown @polynoamial
91K Followers 852 Following Researching reasoning @OpenAI | Co-created Libratus/Pluribus superhuman poker AIs, CICERO Diplomacy AI, and OpenAI o3 / o1 / 🍓 reasoning models
Rohan Pandey @rohan99pandey
631 Followers 481 Following Robustness, NLP & Healthcare | CS PhD @UMassAmherst @UMassBioNLP | Prev. @mckinsey @ShivNadarUniv | Opinions: Personal
Sabri Eyuboglu @EyubogluSabri
1K Followers 308 Following Working on language model memory. CS PhD student @Stanford working with @HazyResearch and @james_y_zou. 🪬
Danielle Belgrave @DaniCMBelg
7K Followers 2K Following VP of AI/ML @GSK. Curious about using AI to make the world a better place. Views my own.
aahlad puli @aahladpuli
582 Followers 2K Following Faculty Fellow at NYU. AI/ML, OOD generalization, healthcare, causality.
Fred Sala @fredsala
1K Followers 647 Following Assistant Professor @WisconsinCS. Chief scientist @SnorkelAI. Working on machine learning & information theory.