Simon Willison @simonw
Creator @datasetteproj, co-creator Django. PSF board. @nichemuseums. Hangs out with @natbat + @cleopaws. He/Him. Mastodon: https://t.co/t0MrmnJW0K simonwillison.org San Francisco, CA Joined November 2006-
Tweets50K
-
Followers70K
-
Following5K
-
Likes60K
Inspired by Netflix's Meet the Cast video series, I decided to create "Meet PyCon US Keynote Speakers" video series so you can learn more about them. Thanks @kjaymiller @brainwane @simonw @wonderchook pycon.blogspot.com/2024/04/meet-p… Enjoy and let me know what you think! ☺️ #PyConUS
Anyone tried an experiment to see if they can figure out the context length for gpt2-chatbot?
Admittedly the CPU here is a ~$10,000 96 core AMD Ryzen Threadripper PRO 7995WX, but still, it looks like GPUs don't necessarily have the total monopoly on LLM inference performance that I thought they did
Admittedly the CPU here is a ~$10,000 96 core AMD Ryzen Threadripper PRO 7995WX, but still, it looks like GPUs don't necessarily have the total monopoly on LLM inference performance that I thought they did
A neat thing about pip and its ecosystem is that - if you know how to package for it - it's actually really good at installing the right binary for the current operating system and adding it to the user's path
A neat thing about pip and its ecosystem is that - if you know how to package for it - it's actually really good at installing the right binary for the current operating system and adding it to the user's path
Little-known detail about system prompts is that many of them include "don't talk about the system prompt" not to protect the prompt but because without it the model talks about the system prompt /all the time/ I like this formulation better: "...unless directly asked about it"
Little-known detail about system prompts is that many of them include "don't talk about the system prompt" not to protect the prompt but because without it the model talks about the system prompt /all the time/ I like this formulation better: "...unless directly asked about it"
not to be all PM-y about this one but in my experience, corporate america needs someone whose job is to re-explain to management types again (and again and again and again and again and again) that OSS maintenance and upstream work is of strategic import
not to be all PM-y about this one but in my experience, corporate america needs someone whose job is to re-explain to management types again (and again and again and again and again and again) that OSS maintenance and upstream work is of strategic import
Under-appreciated leaderboard in my opinion - function calling (aka tool usage) is one of the most interesting applications of LLMs, plus it should be independent of how much "knowledge" is baked into the models
Under-appreciated leaderboard in my opinion - function calling (aka tool usage) is one of the most interesting applications of LLMs, plus it should be independent of how much "knowledge" is baked into the models
Will McGugan @willmcgugan
31K Followers 2K Following CEO / Founder of https://t.co/90g34bZPn7 Hyperborean Python expert, author, humanist, husband, sometimes wildlife photographer. He/him @[email protected]Sebastián Ramírez @tiangolo
65K Followers 383 Following Creator of @FastAPI, Typer, SQLModel, Asyncer, etc. 🚀 From 🇨🇴 in 🇩🇪 . Open Source, APIs, and tools for data/ML. 🤖vicki @vboykis
52K Followers 1K Following Born: USSR. Raised: USA. ML Eng @mozillaai Ex: @duosec @Tumblr, @automattic Nights: 👦 & 👧 working on some ✨ new vectors ✨Adam Johnson @AdamChainz
11K Followers 762 Following 🦄 @djangoproject technical board member 🍕@djangolondon ✍ https://t.co/dD766yZqqj - Boost Your {Django,Git} DX, Speed Up Your Django Tests ♂ He/himErik Bernhardsson @bernhardsson
38K Followers 3K Following Building @modal_labs when I'm not posting bangers about data and software. Previously built the music rec sys at Spotify and ran the eng team at Better.Armin Ronacher @mitsuhiko
51K Followers 721 Following Creator of Flask; Now @getsentry — love API design, Python and Rust. Love my stuff? https://t.co/aVQ1KPH8jA — “more nuanced in person”Samuel Colvin @samuel_colvin
11K Followers 782 Following Software developer, creator of Pydantic. he/him.@AlSweigart@mastodon... @AlSweigart
26K Followers 2K Following Author of "Automate the Boring Stuff with Python" and other programming books. This account is just promo stuff now, follow me on Mastodon. he/himJeremy Howard @jeremyphoward
222K Followers 5K Following 🇦🇺 Co-founder: @AnswerDotAI & @FastDotAI ; Hon Professor: @UQSchoolITEE ; Digital Fellow: @StanfordCharlie Marsh @charliermarsh
12K Followers 776 Following Building @astral_sh: Ruff, uv, and other high-performance Python tools. Prev: Staff engineer @SpringDiscovery, @KhanAcademy, BSE @PrincetonCS.Hamel Husain @HamelHusain
23K Followers 2K Following Researcher focusing on LLMs: https://t.co/iVZDFdIQiE Previously, dev tools and infra for ML. Ex @Github, @Airbnb, @DataRobot. @fastdotai core contributor.Bas Steins @bascodes
7K Followers 1K Following Software Developer | Consultant | Trainer #CoffeeChatter ☕ Tweets about 🐍 Python and Software Development 🗄️ Databases (SQL, NoSQL) ☁️ CloudComputing & DevOpsReuven M. Lerner @reuvenmlerner
27K Followers 1K Following Helping you become more confident with Python and Pandas. Corporate training. Newsletters. Courses. Books. Videos. I tweet my students' best Python questions!apenwarr @apenwarr
14K Followers 2K Following wvdial, bup, sshuttle, netselect, popularity-contest, redo, gfblip, GFiber, and now @Tailscale doing WireGuard mesh. Top search result for "epic treatise."Raymond Hettinger @raymondh
77K Followers 546 Following Chief trainer for Mutable Minds. Certified Public Accountant, Retired Python guru. Alloy & TLA⁺ enthusiast. Aspiring pianist. Former pilot. Born at 320 ppm CO₂.Guido van Rossum @gvanrossum
290K Followers 494 Following Python's BDFL-emeritus, Distinguished Engineer at Microsoft, Computer History Fellow, fully vaccinated. Opinions are my own. He/him.Phil Eaton @eatonphil
17K Followers 557 Following Working on @EDBPostgres. Mostly databases, distributed systems, books, and cooking. 💍🇰🇷Tom MacWright @tmcw
15K Followers 2K Following engineer, writer, ‘art’ https://t.co/3SlHb4ZsAQ 🆕 https://t.co/PBTxrklWJ7 🌎 prev developmentseed, mapbox, observablehq, config all tweets are handtyped and lowercase✨ Jeff Triplett ✨ @webology
9K Followers 2K Following Python, Django, Docker, Engineer, Partner at @revsys - Affiliations @ThePSF @defnado @djangocon @djangoproject - @[email protected]فاطـمہ آدم |.. @_fatmaadam
4K Followers 319 Following #Pythonista 🐍 | Full Stack Dev | #AI enthusiast 🤖 | #BA | Crafting code, decoding insights | Building a smarter future! 🚀 #BusinessAnalysis.Meta AI @metaaidep
8 Followers 81 Followingphil @bl0550m0fWing
0 Followers 14 FollowingAsad Khan @FinTech_Khan
1K Followers 5K Following BD @Centrifuge. ex-@BIS_org, ex-@Accenture. Diversify your bonds.Bradley Bernard @bradleybernard
1K Followers 370 Following Building @SplitMyExpenses in public. Sharing code, UI design, product thinking, marketing tips, & mistakes. Solopreneur, obsessed with shipping. Prev eng @Meta.bofeng @bofenghuang1
66 Followers 301 Followingkeqin @Keqin_Chen
1 Followers 91 FollowingAustin Chen @austinyht
2 Followers 77 Following Deep Learning Practitioner obsessed with Transfer Learning | Context/Sensor Hub Engineercarved-on-the-days-of.. @carved_vanity
54 Followers 465 FollowingDoug Stanley @DougStanley14
377 Followers 642 Following Software Architect #GenerativeAI #ChatGpt #AI #MachineLearning #Microservices #Cognitive #AutismPCM @0x4A65727279
0 Followers 347 FollowingGuillaume Couturas @GCouturas
132 Followers 2K Following @lampi_ai confidential AI workflow automation for companies. Scout pre s/seed/A @SteelDAODaniel Lopes @danielvlopes
3K Followers 512 Following Interested in LLMs. Cofounded @Canopy_is (@37Signals spin-off) & helped bootstrap it to 7 figures. @indievc alum. Prev. led product @ifttt (🇧🇷 in 🌉)Hindu Kush @Sanj_S_Me
124 Followers 1K Following well you know already...physician, dilettante, part time thinker, positor, and agent provacateurDr B Alex @Happyme2020P
248 Followers 647 Following Proud Grandmother, Retired Academic Professional. Now traveling the World and attending graduations❤️study every day 💻�.. @_studyeveryday
382 Followers 602 Following Notes on what I’m studying 📝 * RubyOnRails * UNIX * SQL * Professionalism * VIM * Building with LLMs * AI projects in RubyMarkus Essl @essl_markus
32 Followers 100 Followingpushkar @thepushkarp
156 Followers 467 Following generating shareholder value • ml + backend • writes https://t.co/MksNvISw1PPranay sehgal @pranayyy15
9 Followers 137 Following Digital & social media strategist| Storyteller| content marketer|hubert @hubert04357801
29 Followers 936 FollowingAdrian Demetrescu @daemeh
102 Followers 781 Following Game developer, freelancer, wannabe entrepreneur. Looking for the courage to build amazing things.k @wehhac
6 Followers 83 Followinggurompe @gurompe
2 Followers 194 FollowingSteve Farthing @SteveFarthing
76 Followers 560 Following Entrepreneur, Technologist, and Musician. Currently at @truebill. Cofounded @quinncia. he/himBharat Aurangabadkar @PhDcornerHub
798 Followers 3K Following https://t.co/WjTROjHvOh PhD Everyday AI STEM Research Fundraiser Community Powered By https://t.co/Dp1fFcOrDC ,Partner with us Content Creator ,Student Mentors Startups ,WomenPhDsscottlingor @scottlingor
23 Followers 244 Followingmasoume ghanbari @MasoumeGhanbari
3 Followers 51 FollowingMFLavour @hou1427
28 Followers 87 FollowingDavid Hall @David____Hall
7 Followers 29 FollowingFelipe Santana @felipe_sf05
47 Followers 127 Following Head de Data Science e Analytics na Stack Tecnologias.Saumil Jariwala @SaumilJariwala
705 Followers 967 Following Check out my non-private account, @FetaFundbrainy @fu_hao59505
5 Followers 234 Following 虽然手握人工智能和大数据这两把利剑,但深知探索之路漫漫,对生命奥秘的理解还只是沧海一粟,永远在路上。Although armed with the twin swords of artificial intelligence and big data, I am keenly aware that the path oMert Ozgun @oz6un
0 Followers 52 FollowingJohn Meta @JohnMeta8
2K Followers 804 Following AI Symphony Maestro Dumb human assisting AI to create dreams. 🔬 #art #science #nature 🖌 #ai #aicinema #storytellingEdu @palmerotti
91 Followers 2K FollowingWill McGugan @willmcgugan
31K Followers 2K Following CEO / Founder of https://t.co/90g34bZPn7 Hyperborean Python expert, author, humanist, husband, sometimes wildlife photographer. He/him @[email protected]Sebastián Ramírez @tiangolo
65K Followers 383 Following Creator of @FastAPI, Typer, SQLModel, Asyncer, etc. 🚀 From 🇨🇴 in 🇩🇪 . Open Source, APIs, and tools for data/ML. 🤖vicki @vboykis
52K Followers 1K Following Born: USSR. Raised: USA. ML Eng @mozillaai Ex: @duosec @Tumblr, @automattic Nights: 👦 & 👧 working on some ✨ new vectors ✨Adam Johnson @AdamChainz
11K Followers 762 Following 🦄 @djangoproject technical board member 🍕@djangolondon ✍ https://t.co/dD766yZqqj - Boost Your {Django,Git} DX, Speed Up Your Django Tests ♂ He/himErik Bernhardsson @bernhardsson
38K Followers 3K Following Building @modal_labs when I'm not posting bangers about data and software. Previously built the music rec sys at Spotify and ran the eng team at Better.Armin Ronacher @mitsuhiko
51K Followers 721 Following Creator of Flask; Now @getsentry — love API design, Python and Rust. Love my stuff? https://t.co/aVQ1KPH8jA — “more nuanced in person”Samuel Colvin @samuel_colvin
11K Followers 782 Following Software developer, creator of Pydantic. he/him.@AlSweigart@mastodon... @AlSweigart
26K Followers 2K Following Author of "Automate the Boring Stuff with Python" and other programming books. This account is just promo stuff now, follow me on Mastodon. he/himJeremy Howard @jeremyphoward
222K Followers 5K Following 🇦🇺 Co-founder: @AnswerDotAI & @FastDotAI ; Hon Professor: @UQSchoolITEE ; Digital Fellow: @StanfordCharlie Marsh @charliermarsh
12K Followers 776 Following Building @astral_sh: Ruff, uv, and other high-performance Python tools. Prev: Staff engineer @SpringDiscovery, @KhanAcademy, BSE @PrincetonCS.Hynek Schlawack @hynek
12K Followers 147 Following ❤️ Python 🐍, Go 🐹, & DevOps 🔧 • blogger 📝 • speaker 📢 • @ThePSF fellow 🏆• 🗣🇨🇿🇩🇪🇺🇸 • 💙💛 • 🛟 @[email protected] / https://t.co/Xyj7qXGaSLGary Bernhardt @garybernhardt
47K Followers 120 Following Execute Program (learn programming tools quickly); Destroy All Software (dense programming screencasts); formerly Deconstruct conference.Hamel Husain @HamelHusain
23K Followers 2K Following Researcher focusing on LLMs: https://t.co/iVZDFdIQiE Previously, dev tools and infra for ML. Ex @Github, @Airbnb, @DataRobot. @fastdotai core contributor.Reuven M. Lerner @reuvenmlerner
27K Followers 1K Following Helping you become more confident with Python and Pandas. Corporate training. Newsletters. Courses. Books. Videos. I tweet my students' best Python questions!apenwarr @apenwarr
14K Followers 2K Following wvdial, bup, sshuttle, netselect, popularity-contest, redo, gfblip, GFiber, and now @Tailscale doing WireGuard mesh. Top search result for "epic treatise."Raymond Hettinger @raymondh
77K Followers 546 Following Chief trainer for Mutable Minds. Certified Public Accountant, Retired Python guru. Alloy & TLA⁺ enthusiast. Aspiring pianist. Former pilot. Born at 320 ppm CO₂.Guido van Rossum @gvanrossum
290K Followers 494 Following Python's BDFL-emeritus, Distinguished Engineer at Microsoft, Computer History Fellow, fully vaccinated. Opinions are my own. He/him.Phil Eaton @eatonphil
17K Followers 557 Following Working on @EDBPostgres. Mostly databases, distributed systems, books, and cooking. 💍🇰🇷Tom MacWright @tmcw
15K Followers 2K Following engineer, writer, ‘art’ https://t.co/3SlHb4ZsAQ 🆕 https://t.co/PBTxrklWJ7 🌎 prev developmentseed, mapbox, observablehq, config all tweets are handtyped and lowercaseBlaze (Balázs Galamb.. @gblazex
1K Followers 977 Following A Smooth Guy; Developer of SmoothScroll for macOS, Windows & Google Chrome.Stephanie 🔮 Web Wi.. @seaotta
15K Followers 887 Following Web Platform PM @Igalia • Ex @msedgedev @rapid_api • Product Designer, Speaker & Author • ❤️ @jh3yy • Helping devs learn design • https://t.co/SqGJeMKVElmartin_casado @martin_casado
50K Followers 2K Following GP @ a16z ... questionable heuristics in a grossly underdetermined worldJordi Bruin @jordibruin
18K Followers 272 Following Indie dev at Good Snooze. Building things I like, that help people.Susan Zhang @suchenzang
20K Followers 504 Following @ Google Deepmind. Past: @MetaAI, @OpenAI, @unitygames, @losalamosnatlab, @Princeton etc. Always hungry for compute.Miqdad @MiqJ
914 Followers 663 Following Product Team @OpenAI | Ex-Shopify - All things Enterprise AIRick Lamers @RickLamers
2K Followers 867 Following 👨💻 AI Research & Engineering @GroqInc. I publish a weekly update about LLM Engineering on Substack, it’s free. Opinions are my own.UC Berkeley CTO @ucberkeley_cto
817 Followers 893 Following Bill Allison -- Official Twitter account of UC Berkeley's Chief Technology OfficerGroq Inc @GroqInc
46K Followers 470 Following Creator of the LPU™ Inference Engine, providing the fastest speed for AI applications, designed & engineered in N. America https://t.co/DsEqVAC5DpMicah Alpern @malpern
4K Followers 5K Following Design & Product. Prev Sr Director @Instacart, Prior: Head of Design @Venmo, @Facebook, @Medallia, @LinkedIn, @Yahoo, @eBay, @Ixda founding board, CMUTim Paul @timpaul
5K Followers 900 Following Head of Interaction Design @GDSTeam (he/him). Views his own, not his employers.Tomasz Kolinko @kolinko
3K Followers 545 Following Effort - https://t.co/ScM4oPI5JG - an llm inference algorithm , previously https://t.co/MHsV9jJryz - decompiler for Ethereum smart contracts.Reka @RekaAILabs
11K Followers 13 Following An AI research and product company 🫠. We are a team of scientists and engineers building state-of-the-art multimodal language models 😻Elena Yunusov @communicable
6K Followers 7K Following Executive Director, Human Feedback Foundation w Linux AI & Data | Per Aspera Ad Astra | Here to build a future that I’m fromWill Ratcliff @wc_ratcliff
8K Followers 2K Following Evolutionary biologist (Multicellularity & social evolution). Associate Prof. at Georgia Tech & Director @QBioS_GT PhD program.Frank Hoffmann @15r10nk
192 Followers 95 Following 🚀 having fun living this one life ⚒️ python tooling ⏰ hacking time 👧 being a proud fatherMarques Brownlee @MKBHD
6.2M Followers 472 Following Web Video Producer | ⋈ | Pro Ultimate Frisbee Player | Host of @WVFRM @TheStudioNick @nickcammarata
60K Followers 737 Following interested in neural network interpretability and meditationLinda Lawton @LindaLawtonDK
2K Followers 745 Following Freelance .Net Core Backend developer. - (GDE) - HIRE ME CONSULTING - https://t.co/od04J4EONs . YouTube Channel https://t.co/1BLg62zRNDLior⚡ @AlphaSignalAI
84K Followers 898 Following Covering the latest in AI R&D • ML Engineer • Ex-Mila researcher • MIT Lecturer • Building AlphaSignal, a technical newsletter read by 180,000+ ML experts.Liam Bolling @liambolling
2K Followers 142 Following Product for Google Gemini API. Opinions are mine.Grant Sanderson @3blue1brown
365K Followers 362 Following Pi creature caretaker. Contact/faq: https://t.co/brZwdQfdifCatherine Grieves @CatGrieves
3K Followers 1K Following Music Supervisor. Baby Reindeer, Slow Horses, Killing Eve, How To Have Sex, Sherwood, Extraordinary, The Devil’s Hour, You Were Never Really Here etcandrew chen @andrewchen
285K Followers 12K Following 🇺🇸 General Partner @ a16z. Investing at the intersection of TECH x GAMES.Nick Frosst @nickfrosst
13K Followers 847 Following cofounder @cohere - singer @goodkidband pfp: @polarfishh_26Alex Komoroske @komorama
3K Followers 637 Following Generalist fascinated by complex adaptive systems. All opinions my own.Nous Research @NousResearch
18K Followers 29 Following The AI Accelerator Company. https://t.co/vrD0aDJetolmsys.org @lmsysorg
37K Followers 172 Following Large Model Systems Organization. We created Vicuna and Chatbot Arena! Compare 30+ LLMs (GPT-4/Claude/Llamas) side-by-side at https://t.co/IDFeIDIOtm🍻Meet Stephen in �.. @fractaledmind
2K Followers 1K Following tweeting about Ruby, Rails, SQLite, CSS, HTML, plus various and sundry otherJames Twiss @jstwiss206
47 Followers 41 FollowingRyan Dahl @rough__sea
4K Followers 275 Following cofounder of @deno_land, creator of @nodejs, nyc recluse. often goes by ry.Ari Jankelowitz @ajankelo
355 Followers 938 Following Machine Learning Engineer | Focusing on Data Centric AI / Deep Learning / OSINT | Fan of MLOpsCarl Byström 🇺�.. @cgbystrom
1K Followers 687 Following Likes to simplify things. Hacking on @UnrealEngine at Epic Games. Past @EA_DICE. He/him. (@[email protected])Seth Rosen @sethrosen
12K Followers 3K Following Data and dad jokes. Data Products at @snyksec (via @TopCoatData)Mistral AI @MistralAI
91K Followers 0 Following Fast, open-source and secure language models. Join us https://t.co/INALdNGvCPDevendra Chaplot @dchaplot
8K Followers 365 Following Building next-gen AI at @MistralAI. Past: Research Scientist at Facebook AI Research. Ph.D. @SCSatCMU, BTech @iitbombay CS.dayson — e/llm @dayson
1K Followers 738 Following I'm a TBD | Product (@Google) by day. Python by night. | Previously 2X Startup (opinions are my own)Ben (e/sqlite) @andersonbcdefg
3K Followers 3K Following 🤖 Computer scientist, next-word-prediction enjoyer 📊 Prev. research fellow @ Stanford RegLab 🛠️ bUiLdiNg sOmeThiNg nEw (https://t.co/mdYPZmjSzN - YC S23) 🏳️🌈Siqi Chen @blader
66K Followers 3K Following 🏗️ Love to build stuff (@runwayco, @sandboxvr, @postmates, @zynga) people love. 💸 Investor @amplitude_hq, @mercury, @owner, @elevenlabsio, @slope_finance ++Matt Shumer @mattshumer_
51K Followers 1K Following CEO @HyperWriteAI, @OthersideAI - I make AIs do the impossible.Prompting is so much more dynamic and flexible, I find that FT really degrades other domains - something that prompting does not suffer from. And of course you can just have hundreds of prompts for hundreds of tasks
llama-3 70B takes 3rd place, replacing haiku. full results on right
@4sta_r1sk @Lauramaywendel Cc @simonw This seems like a *super* important S3 caveat!! Reason enough to lock down S3 buckets, and delete any unnecessary ones you may have lying around.
@gorilla0513 It is difficult to summarize the advantages and disadvantages of byte-code versus AST for SQL in a tweet. I need to write a new page on this topic for the SQLite documentation. Please remind me if something does not appear in about a week.
@simonw I did some tests and I estimate it's around 32k. I used long tokenized content and saw how much it could infer from it, plus counted the response tokens when the message got cut off.
@simonw @lmsysorg Also this Delux-Chat-v# was doing the rounds for a while I still think these are live beta testing endpoints for a rotation of checkpoint builds more than a brandname LLM reddit.com/r/LocalLLaMA/c… etc.. x.com/jimmy6dof/stat…
@simonw don't forget the mysterious lmsys chatbotarena "deluxe-chat-v1.2" has been beating GPT4 consistently for months now as 'an experiment we are running' ... lol github.com/lm-sys/FastCha…
@pankaj @simonw Lmsys cuts of input after 12,000 characters which is usually around 3,000 tokens. But in a strange text like yours GPT tokenizer will actually use around 1,500 tokens platform.openai.com/tokenizer This is why you cannot test context size on lmsys, you cannot even reach 4k tokens
@simonw you cannot test long context, the input/output is limited by lmsys servers
While I didn't choose Flutter as my technology stack, I have deep respect for what the team there at Google has accomplished with it. Sorry to hear about the layoffs, hope you all land on your feet!
How can you tell if a programmer has been to hell and back in terms of what they've had to debug? Stuff like this 👇
Inspired by Netflix's Meet the Cast video series, I decided to create "Meet PyCon US Keynote Speakers" video series so you can learn more about them. Thanks @kjaymiller @brainwane @simonw @wonderchook pycon.blogspot.com/2024/04/meet-p… Enjoy and let me know what you think! ☺️ #PyConUS
📢Conoce los oradores principales de #PyConUS✨ 🔷Jay Miller 🔷Kate Chapman 🔷Simon Willison 🔷Sumana Harihareswara Para echar un vistazo a sus sesiones y conocer sus opiniones sobre la comunidad #Python, mira las entrevistas con ellos:👇 bit.ly/3xVdy9I #PyConCharlas
@phill__1 We hope it’s Llama-3 400B. That would be much more exciting than finding out gpt2-chatbot is just GPT-4.5.