Aman Khan @_amankhan
AI PM @arizeai ex @spotify @cruise @apple @ucberkeley amank.ai Joined December 2011-
Tweets491
-
Followers2K
-
Following568
-
Likes2K
PM to their eng team one day before a big launch
PM to their eng team one day before a big launch
0
95
683
1.2M
90
Seeing this a lot as well - @lennysan and I covered WTF are evals for PMs as a starting point, and then @petergyang and I covered an end to end workflow What people building AI products need to realize is that vibes will only get you so far. Evals = metrics that "matter"
Seeing this a lot as well - @lennysan and I covered WTF are evals for PMs as a starting point, and then @petergyang and I covered an end to end workflow What people building AI products need to realize is that vibes will only get you so far. Evals = metrics that "matter"
Aman Khan retweeted
@garrytan WTF is an eval: lennysnewsletter.com/i/153296003/ev… Learn how to write evals from @_amankhan: lennysnewsletter.com/p/beyond-vibe-…
Aman Khan retweeted
Trend I'm following: evals becoming a must-have skill for product builders and AI companies. It's the first new hard skill in a long time that PMs/engineers/founders have had to learn to be successful. The last one was maybe SQL, and Excel? A few examples: @garrytan: "Evals are…
Trend I'm following: evals becoming a must-have skill for product builders and AI companies. It's the first new hard skill in a long time that PMs/engineers/founders have had to learn to be successful. The last one was maybe SQL, and Excel? A few examples: @garrytan: "Evals are…
Aman Khan retweeted
"The best video on AI evals I've seen" If you want to learn AI evaluations from scratch by following a practical example, you should watch my free, step-by-step tutorial with @_amankhan. Link to video in post below.
"The best video on AI evals I've seen" If you want to learn AI evaluations from scratch by following a practical example, you should watch my free, step-by-step tutorial with @_amankhan. Link to video in post below. https://t.co/FudkdcChaM
Aman Khan retweeted
My biggest takeaways on building AI evaluations from my chat with @_amankhan (Head of Product at Arize). Link to the full video tutorial below.
Learning how to do evals should be practical + free - here's a quick primer. So glad this resonated @zarazhangrui 🙌
Learning how to do evals should be practical + free - here's a quick primer. So glad this resonated @zarazhangrui 🙌
Does anyone have any interesting applications of Claude code+subagents behind a UI? I’ve seen claudable - wondering what else is out there
Aman Khan retweeted
The best way to learn about AI evaluations is to watch 2 PMs build them live from scratch. Tomorrow, @_amankhan and I walk through creating evals for an AI customer support agent, including: ✅ Defining the eval criteria ✅ Labeling a golden dataset ✅ Aligning LLM judge…
Many of the labs heading this direction too sadly, from what I hear
Many of the labs heading this direction too sadly, from what I hear
95% seems really high and kind of a made up number, just saying.
Jeremy Yang @jeremyzyang
921 Followers 2K Following
Vaseem Khan @vakhan93
30 Followers 305 Following
Alex Willian @clonedoalex
4 Followers 277 Following
Debstep @xdebstep
863 Followers 3K Following Building @QuesteraAI | Prev @nvidia @tesla @visa @amazon also a @kp_fellows
Ruxue Jin @RuxueJ96549
1 Followers 46 Following
mokashi @moshw
55 Followers 406 Following Ex-PM, Data Governance Lead | Built AI-powered due diligence tools | Helping VCs and Founders make smarter investments through automation
Hemir Doshi @hemirdoshi
88 Followers 37 Following Building BeepKart: digital-first used 2-wheeler brand. Funded by @vertexventures @Stellaris_VP @ChirataeVC. Hiring [email protected]
Melanie Qualls @melaniequalls
230 Followers 1K Following Product Management, Entrepreneurship, SCUBA, @cleanbeachcrew
Nishant Mehta @MehtaCognition
60 Followers 977 Following Leading MehtaCognition, a management consultancy and coach serving leaders of education, nonprofits, and companies wishing to build their strategic muscle.
Allison Kiang @allisonkiang
1K Followers 4K Following investing in healthcare, fintech, climate at Twelve Below. prev scout @baincapvc Moonlight writer. past: @Contrary / @KomodoHealth /@columbia / Harker
JJ @Joseph_Jacob13
883 Followers 4K Following Building an Agentic OS for Supply Chain at burnt (YC S25). I used to buy 100m lbs of shrimp every year.
Gigi @gigiialc
4K Followers 931 Following prev voice agents @medialab | hacking @ https://t.co/YtzmtxgVP5 👩🏼💻 | https://t.co/aNCOgTNhYy 🌎 from spain
Tushar @tushar1_gupta
273 Followers 2K Following investing @WestBridge_Cap; ex-M&A banker @JPMorgan & operator. not the views of my employer. founders - would love to chat, feel free to pick a time!
bobi jj @jj_bobi
7 Followers 390 Following
Mutacious @mutacious
295 Followers 2K Following Privacy attorney; basketball junkie; blockchain enthusiast. Tweets regularly self-destruct.
Keshav Somasekhar @keshutd
30 Followers 213 Following
Steven Hurtado R. @Stevenhurtador
574 Followers 1K Following Aspiring polymath. Building the leading @coda_hq agency at Simpladocs & passionate about system thinking, biz streamlining & scaling ops with tech & AI
Daniel Habibi @catslikeseaweed
483 Followers 4K Following 🇺🇸 patriot 🦅 coding model tester 👾 codependent journalist 🔥✍️ cringe millennial 😹 automating fundraising 🥷
Colaeb @collabnelevate
852 Followers 737 Following Creating Opportunities, Leveraging Action, Efficiency, and Business. Connect with pre-vetted customers, access growth expertise, and scale your business.
Acopia Ventures @acopiaventures
99 Followers 153 Following Planning to raise or struggling now? | 70% fewer objections, under 2.5 months average raise with our novel process distilled from inside 15+ VC funds
soorya ignatius @sooryageddon
317 Followers 259 Following 18, building autonomous drones @fdotinc to keep your car from getting broken into. @northeastern or gap year?
Anjan @anjanps5
178 Followers 510 Following Builder & Innovator. Product, Engineering and design | Love working at the intersection of fields | Passionate about innovation and design |
Boo of the Booless @okoyedonaldson
2K Followers 2K Following Living multiple life | Burnout Human Beings
doron @dorong
518 Followers 4K Following
Tushar Sarang @watevadafa
22 Followers 227 Following Engineering Manager | Backend | DevOps | Python, Terraform, Typescript
Tiago Santos @tiagofcdsantos
46 Followers 689 Following All the Sports. Tasting Data and analyzing wine.
Fabio Secci @fabio_secci82
1 Followers 54 Following Design Leader | Strategy & Innovation | AI-Driven Vision - Building Teams that shape change.
fast008™️ @Rkleung
32 Followers 443 Following
Benoît Quartier @benqua
21 Followers 148 Following
Jay Mo @jayhxmo
4K Followers 3K Following Imagineer, Love & fury. Previously https://t.co/Xz9ff1rOPj
Arpan Punyani @arpanpunyani
1K Followers 5K Following Co-Founder and GP @garudavc, pre-seed/seed investor. Early @okta. Prev JD and equity analyst. Dad and Husband, Miami-born.
Arjun Rai 👨🏽... @arjunraime
2K Followers 5K Following Co-Founder, @RideHelmetApp Chef, @ArjunCooks | Advisor to Founders | 1 Exit | Micro Mobility | AdTech | MarTech 📍SF, NYC, Princeton
Rahul Kumaran @RahulKumaran4
2K Followers 2K Following Building @trybrowzer; @joinodf ODF26 | Blockchain, AI, Agents | prev: AI EM @YumaGroup, AI Fellow (Lead) @foundryservices, Co-Founder @widhya_org |
Shivang Raisurana @ShivangRaisuran
210 Followers 713 Following I just wanna make it easy for ppl to share stuff.
Liam McNamara ⁂ @liam_builds
624 Followers 3K Following 19, queen’s bhsc | building @matrixbiotech, @id8id8id8, research @ucsf
Kaivalya (Kai) Gandhi @KaiGandhi
1K Followers 2K Following Exploring what’s next | ODF19 @beondeck | Community @mission__ctrl | Product @yahoomail via @yahooapms | Co-Founder @goepoch | @uwaterloo Software alum
Swapnil Sudhir 🧑�... @swapnil_sudhir_
516 Followers 4K Following Next 15 years goal is to create a Fintech in US, a Nuclear Reactor in India and A defence company in India. That’s the plan. Underdog forever.
Dylan Mitic @DylanMitic
1K Followers 929 Following growing @groqinc | ops tsar @chapman_ceo + Econ & CS | Opinions are my own
Amy Xiao @amyxst
426 Followers 962 Following Founder @CloudGlueDev; Let your AI agent understand videos for the first time. Ex-ML/infra person @snap, @aws, @rbcborealis, @arizeai, math/physics @uoft
Rtzr @ryan_tzr
83 Followers 111 Following working on AI agents @ Manus AI | building things that change the world
Sean Kirmani @SeanKirmani
3K Followers 547 Following Research @OpenAI. Interested in intelligence, understanding, and science.
Patrick Loeber @patloeber
66K Followers 1K Following DevX @GoogleDeepMind, building Gemini API & AI Studio & Gemma. My views
Google AI Studio @GoogleAIStudio
43K Followers 2 Following The fastest path from prompt to production with Gemini
Rishabh Agarwal @agarwl_
17K Followers 792 Following Reinforcement Learner, Adjunct Prof at McGill. Ex MSL Meta, DeepMind, Brain, Mila, IIT Bombay. NeurIPS Best Paper
Luca Foschini @calimagna
2K Followers 2K Following President & CEO @Sagebio. Co-founder @evidation. Computer Science PhD. Health+machine learning+data privacy. Tweets by me. 🇺🇸🇮🇹🇫🇷
Mark Chen @markchen90
64K Followers 333 Following Chief Research Officer at @OpenAI. Coach for the USA IOI Team.
Jerry Tworek @MillionInt
22K Followers 677 Following Berry farmer @ OpenAI | o3, o1, GPT4, ChatGPT, Codex, Solved Rubik’s cube with robotic hand | cautious AI optimist
Zara Zhang @zarazhangrui
7K Followers 1K Following AI Product & GTM. Previously in VC. Harvard’17. Newsletter: https://t.co/77sCKIKi4Q YouTube: https://t.co/8xzbGWtf6w
Elon Musk @elonmusk
225.3M Followers 1K Following
Daniel San @dani_avila7
15K Followers 2K Following co-founder and CTO, building @aitmpl_com + @codegptAI + @deepgraphMCP | Powered by TypeScript & Pumpkin Spice Lattes ☕️
Khaled Saab @_khaledsaab
3K Followers 388 Following Researcher @OpenAI, prev: RS @GoogleDeepMind PhD @StanfordAILab @HazyResearch
Meng To @MengTo
121K Followers 415 Following Founder at @designcodeio and https://t.co/Kpiogf2zVu. I teach designers code and developers design.
elvis @omarsar0
263K Followers 664 Following Building with AI agents @dair_ai • Prev: Meta AI, Galactica LLM, Elastic, PaperswithCode, PhD • I share insights on how to build with AI Agents ↓
Eric Xiao @exiao3
505 Followers 2K Following @arizeai: AI tracing and evaluation 📈 https://t.co/MfPDytGEMg: AI investing research 👌🏼 https://t.co/x7aIddyKyY: AI decision helper ⛪️ https://t.co/gT8PHkiezS: AI bible
shyamal @shyamalanadkat
17K Followers 1K Following applied AI @openai. I work with the world's leading startups and developers to bring the benefits of safe AI to every human. views my own 🇮🇳 @dukeu
Nathan Lambert @natolambert
56K Followers 853 Following Figuring out AI @allen_ai, open models, RLHF, fine-tuning, etc Contact via email. Writes @interconnectsai Wrote The RLHF Book Mountain runner
Revanth Gangi Reddy @gangi_official
2K Followers 462 Following Lifting (model) weights @GoogleDeepMind. CS PhD at @IllinoisCDS.
Flo Crivello @Altimor
44K Followers 1K Following Founder @getlindy. "Striving to remember the obvious over grasping the esoteric."
Ian Nuttall @iannuttall
70K Followers 126 Following TLDR; I make software with AI and talk about it. Serial internet biz builder with multiple 6 & 7 figure exits. Always learning.
Sara Hooker @sarahookr
49K Followers 9K Following I lead @Cohere_Labs. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, ML reliability. Changing spaces where breakthroughs happen.
Laurens van der Maate... @lvdmaaten
4K Followers 2K Following Member of Technical Staff at Anthropic. Ex-Meta. t-SNE. Llama 3. DenseNet. Web-scale weakly supervised vision. CrypTen.
Carlos Villaumbrosia @villaumbrosia
7K Followers 104 Following @ProductSchool CEO | @TheProductBook 📖 | #ProductCon 🏟 | #TheProductPodcast 🎙 | #ProddyAwards 🏆
Andrew Hart @AndrewHartAR
28K Followers 671 Following Founder of Hyper @HyperARCo, “Indoor Location that actually works”. Built largest project for Apple ARKit, pioneered AR navigation, Mirador 🏳️🌈
Tanay Jaipuria @tanayj
69K Followers 3K Following partner @wing_vc investing in AI applications and infra. opinions, analysis, and banter on technology and business
Adam Wolff @dmwlff
11K Followers 570 Following Claude Code @AnthropicAI 🤖 Avid cook, dedicated snow person, yoga enthusiast
Shriya Nevatia @shriyanevatia
24K Followers 24K Following community / startups / creativity · prev. cos #fortlight 📓 · @thecouncilcap 😇 · @beondeck catalyst 🔥 · founder @violet_society 💜 · earnest optimist 🌱
Robert Scoble @Scobleizer
538K Followers 17K Following The best from AI community | Ex-Microsoft, Rackspace, Fast Company | Wrote eight books about the future | Silicon Valley robots, holodecks, BCIs, and startups.
Sid @sidbidasaria
5K Followers 191 Following building Claude Code @AnthropicAI previously @robinhoodapp @rubrikinc
Prem Qu Nair @premqnair
5K Followers 910 Following @cognition, previously @nuro @princeton. Pursuing 70mm, 225lb, and $0.10/piece
Gibson Biddle @gibsonbiddle
30K Followers 3K Following Former Netflix/Chegg VP/CPO. Many virtual talks/workshops. Guest lecturer @INSEAD & Stanford. My free “Ask Gib” Product Newsletter: https://t.co/EM21Ic1Ag4
Alexander Wei @alexwei_
24K Followers 193 Following Reasoning @OpenAI. Co-built CICERO @MetaAI | @Berkeley_AI PhD '23 | @Harvard '20
Lee Robinson @leerob
190K Followers 735 Following Teaching developers @cursor_ai, previously @vercel
Gautam Rangarajan @gautamnoh
25 Followers 90 Following Product Lead for Agentic Tools @ Heroku. Welcome to my opinion feed
Christopher Manning @chrmanning
151K Followers 228 Following Director, @StanfordAILab. Assoc. Director, @StanfordHAI. Founder, @stanfordnlp. Prof. CS & Linguistics, @Stanford. IP @aixventureshq. 🇦🇺 Do #NLProc & #AI. 👋
Dan Shipper 📧 @danshipper
72K Followers 2K Following co-founder / ceo @every | host of the AI & I podcast | “Thoreau with WiFi” - ChatGPT
Thariq @trq212
12K Followers 1K Following Claude Code @anthropicai. prev YC founder, mit media lab grad. opinions mine
William Allen @williamallen
6K Followers 2K Following Building at @cloudflare. Prior: Co-founder/CEO of Chamber (acq by @casaHODL), VP @Adobe (GM @contentauth, @Behance), COO Behance Inc, @TEDTalks many years ago.Trends for United States
51,7 B posts
111 B posts
42,3 B posts
13,5 B posts
20,9 B posts
30,5 B posts
21,8 B posts
2.393 posts
123 B posts
6.591 posts
2.042 posts
9.521 posts
2.197 posts
15,7 B posts
31,3 B posts
3.276 posts
35 B posts
4.445 posts
You might like
Lavish Saluja
@lavishsaluja
885 Followers
Johan Rydberg
@datamishap
256 Followers
Nikita
@njainn_
156 Followers
Akhil
@aperinch
19 Followers
anishsubedi
@anishsubedi__
146 Followers
Atena G. Mohammadi
@AtenaGMohammadi
61 Followers
Alex French
@alexjfrench
77 Followers