Nicholas Wilt @CUDAHandbook
Nicholas Wilt was on the inception team for CUDA, wrote The CUDA Handbook, and blogs at https://t.co/YkR71W07I7 cudahandbook.com Joined April 2013-
Tweets1K
-
Followers2K
-
Following63
-
Likes1K
Interesting take GPUs are massively parallel, latency-tolerant, high bandwidth. They use SRAM for latency tolerance rather than to make memory appear lower-latency, like CPUs. Many ASICs allocate their transistor budgets differently than GPUs. Are TPU or Trainium “GPUs”?
Interesting take GPUs are massively parallel, latency-tolerant, high bandwidth. They use SRAM for latency tolerance rather than to make memory appear lower-latency, like CPUs. Many ASICs allocate their transistor budgets differently than GPUs. Are TPU or Trainium “GPUs”?
Credit to @CoryDoctorow for popularizing (possibly inventing) this spicy word. merriam-webster.com/slang/enshitti…
Credit to @CoryDoctorow for popularizing (possibly inventing) this spicy word. merriam-webster.com/slang/enshitti…
Clock rates on x86 chips increased 40x across ten years: 25 MHz to 1,000 MHz. Ten years of free beer, computers getting magically faster on a quarterly basis. The end of Dennard scaling really complicated things.
Clock rates on x86 chips increased 40x across ten years: 25 MHz to 1,000 MHz. Ten years of free beer, computers getting magically faster on a quarterly basis. The end of Dennard scaling really complicated things.
If Moore’s Law were still on track, we wouldn’t be undergoing a packaging revolution.
Fantastic idea. Rescue those mRNA therapies that got left high and dry!
I always say, it’s all-but-impossible to write bug-free code, but you can aspire to write code where bugs are easy to fix.
I always say, it’s all-but-impossible to write bug-free code, but you can aspire to write code where bugs are easy to fix.
imho 4 spaces is best. 2 seems ingrained into the financial space, I think too narrow but I’ll do it if existing code bases do. 3 is too weird and 8 is too wide.
imho 4 spaces is best. 2 seems ingrained into the financial space, I think too narrow but I’ll do it if existing code bases do. 3 is too weird and 8 is too wide.
My own take is identical. Not a networking guy/mystified at the lack of adoption.. my working hypothesis is that it wasn’t backward compatible enough? This December 2024 article seems credible. networkworld.com/article/965192…
My own take is identical. Not a networking guy/mystified at the lack of adoption.. my working hypothesis is that it wasn’t backward compatible enough? This December 2024 article seems credible. networkworld.com/article/965192…
I suspect this is 50-year-old software engineering lore, or the C programming language wouldn’t have made signed integers the default…
I suspect this is 50-year-old software engineering lore, or the C programming language wouldn’t have made signed integers the default…
Are there any camera vendors who don’t treat their device properties as closely guarded IP? If so, their transparency could become a differentiator.
Are there any camera vendors who don’t treat their device properties as closely guarded IP? If so, their transparency could become a differentiator.
LOP3 is the bomb It’s quite interesting to look at generated CUDA code and see how the compiler makes use of it! Here’s a fun application by the inimitable Norbert Juffa, emulating a machine instruction that was removed from the hardware. forums.developer.nvidia.com/t/highly-tuned…
LOP3 is the bomb It’s quite interesting to look at generated CUDA code and see how the compiler makes use of it! Here’s a fun application by the inimitable Norbert Juffa, emulating a machine instruction that was removed from the hardware. forums.developer.nvidia.com/t/highly-tuned…
I’ve been low-key working on a reading list, and Agner Fog’s optimization manuals are right there next to Hacker’s Delight. The x86 microarchitecture doc is priceless. agner.org/optimize/micro…
I’ve been low-key working on a reading list, and Agner Fog’s optimization manuals are right there next to Hacker’s Delight. The x86 microarchitecture doc is priceless. agner.org/optimize/micro…
Languages are engineering tools. The landscape is littered with the corpses of projects and whole companies who prioritized implementation language over product roadmap. The failed Corel Office initiative (late 1990s) comes to mind; flagship feature: it was written in Java.
Languages are engineering tools. The landscape is littered with the corpses of projects and whole companies who prioritized implementation language over product roadmap. The failed Corel Office initiative (late 1990s) comes to mind; flagship feature: it was written in Java.
I don’t make the rules 🤷♂️

John Carmack @ID_AA_Carmack
1.1M Followers 273 Following AGI at Keen Technologies, former CTO Oculus VR, Founder Id Software and Armadillo Aerospace
Sean Baxter @seanbax
9K Followers 204 Following Principal Research Scientist at NVIDIA Circle C++ compiler moderngpu
Bryce Adelstein Lelba... @blelbach
17K Followers 2K Following Principal Architect at @NVIDIA working on programming languages. C++ Library Evolution chair emeritus. Frequent @traveloneworld flyer. Horology nerd.
Raja Koduri @RajaXg
46K Followers 2K Following Create, Clean, Consume is my aspirational routine. My interests math, computer graphics, silicon, software and music.
Tom Verbeure @tom_verbeure
5K Followers 237 Following Plays with FPGAs. There can never be enough LEDs. Hardware engineer at Nvidia, but my views here are my own. he/him. Also @tom_verbeure at the woolly elephant
Shevchenko @shevchenk031
0 Followers 210 Following
Nadav Timor @NadavTimor
723 Followers 7K Following LLM inference, speculative decoding, open source. Built novel decoding algorithms – default in Hugging Face Transformers (147k+ ⭐). Making LLMs faster + cheaper
j4orz @j4orz
156 Followers 68 Following i 🖤 tensor compilers. make the impossible hard, and the hard easy. talk is cheap, show me the code.
Ayushman Bansal @BansalAyushman
40 Followers 876 Following Homo-techno Be the glitch you want to see in the sim
pat @idiotslowdown
60 Followers 3K Following
Khullani @Khullani_
436 Followers 2K Following AI Governance & Policy | Founder Techne AI | @CarletonCollege & @UofMNLawSchool | Interests: Blockchain, AI Safety, Consciousness, and Philosophy
Jane @JanePitmanok
22 Followers 361 Following Books, music, and art fuel my soul and ignite my imagination. Let's explore the world of creativity together.
Joe Ton @tonindustries
53 Followers 17 Following ML Compiler & GPU Optimization | LLVM & PyTorch | Shares insights on parallel computing for AI research https://t.co/NH8OhsZY81
!.! @xypyth
49 Followers 4K Following
Bottyboy @Bottyboy8
7 Followers 453 Following
Zev Waldman MD @ZevWaldman
679 Followers 4K Following Pediatrician. Not a superhero but believe in truth, justice, and the American way. Appreciate hearing your perspective, but won’t always agree.
Dan Drennan @danjdrennan
119 Followers 719 Following PhD student in statistics | Dad 2x | Army Veteran Talking about statistics, tech, and parenting
gradient.flow32 @gradient_flow32
1 Followers 95 Following
Volkan İlbeyli @Varaquilex
1K Followers 773 Following Software Engineer, 3D Graphics & Performance Investing 📈 Finance 💵 Tech 💻 ex GPU DevTech Engineer @AMD Graphics @Unity Opinions are my own.
Gabriel @dss_gabriel
630 Followers 191 Following PhD candidate, HPC @ CEA. Architecture, distributed computing, memory management & data layout. RTFM 👹
Debabrata Mahanta @deb_0x0
39 Followers 197 Following
bret @BretHatin
1K Followers 224 Following progressive plus preserver, p-table walker, euphemia predictor, https://t.co/NUV4Hsux4y
. @Kamuics
94 Followers 235 Following
Adam Soliev @adamsoliev
0 Followers 134 Following
Rothschild @Rotschild313081
1 Followers 511 Following
Sharath Kumar K @SharathKumarK00
144 Followers 3K Following Programming for fun. Learning everything that interests me :) Overwhelmed by my wide area of interests ;) Wannabe the best hacker and programmer🤞🤞
zhuoyunwei @robinzyw31
124 Followers 2K Following
Fake Sonny Smith @fssmith
143 Followers 1K Following
John Bradley Bulster @theycallmebread
52 Followers 2K Following
vijay reddy @vijayreddy2047
4 Followers 543 Following
el_draggo @el_draggo
3 Followers 282 Following
Omeed Rad @omeedrad
442 Followers 2K Following Engineer. My name means hope, so I'm legally obligated to be optimistic.
nwf_ssa @nwf_ssa
0 Followers 31 Following
Khanh Le @lednhatkhanh
137 Followers 1K Following #javascript, #typescript, #go, #react #vuejs and currently learning #rust
Vivek Galatage @vivekgalatage
9K Followers 515 Following 20+ yrs of building browsers • chromium, webkit contributor • ♡ compilers, systems, languages • cur: browser co • prev: samsung, nokia, ibm • views are personal
David Pash @PashDavid34305
1 Followers 33 Following
jss @jsensarma
10K Followers 1K Following building @clearfeedai ex - co-founder @qubole, @Facebook, @NetApp, started @apachehive, @iitdelhi
Aleksey Pindrus @alekseypindrus
3 Followers 188 Following
Jonatan @jlalop
56 Followers 3K Following
John Carmack @ID_AA_Carmack
1.1M Followers 273 Following AGI at Keen Technologies, former CTO Oculus VR, Founder Id Software and Armadillo Aerospace
Sean Baxter @seanbax
9K Followers 204 Following Principal Research Scientist at NVIDIA Circle C++ compiler moderngpu
Dylan Patel @dylan522p
94K Followers 941 Following SemiAnalysis Boutique AI & Semiconductor Research and Consulting DMs are open for consulting, quotes, or to talk shop
Longhorn @never_released
14K Followers 143 Following Kernel/hypervisor engineer @awscloud EC2. Hobby @checkra1n. Mastodon: https://t.co/DsXP8PFgL0 Bluesky: https://t.co/dAOfFSSqY4
𝐷𝑟. 𝐼𝑎�... @IanCutress
49K Followers 1K Following Consultant, Chief Analyst, Influencer @TechTechPotato - @MoreThanMoore2x
Geoff Langdale @geofflangdale
3K Followers 127 Following CMU CS PhD; Hyperscan chief; Intel Principal Engineer. Side projects include a superoptimizer. he/him
:3 @Colonthreee
2K Followers 1K Following :3 | Energysaving for software: https://t.co/UrX8DbQFpi | Next-gen interactivity: https://t.co/q0HMde2KnN
unusual_whales @unusual_whales
2.5M Followers 2K Following Stocks/Options/Crypto/Market News + Tools. Not advice Get a bonus opening a new tastytrade account: https://t.co/wGf2ZdlXpw Discord: https://t.co/0xJ9e0ZYYG More: https://t.co/nsxZlPV0pC
Eric Lengyel @EricLengyel
18K Followers 231 Following • PhD, Computer Science • Creator of @SlugLibrary, @C4Engine • Math/gamedev author • #GeometricAlgebra researcher • Former Naughty Dog, Apple, Sierra
xlrndo @xlrndo
33 Followers 255 Following
LaurieWired @lauriewired
96K Followers 294 Following researcher @google; serial complexity unpacker; https://t.co/Vl1seeNgYK ex @ msft & aerospace
Proton @ProtonPrivacy
333K Followers 465 Following A better internet starts with privacy. Stay in control with e2e encrypted email, drive, docs, password mng, AI, & VPN. 🫶 Help @ProtonSupport 🐈⬛ New @asklumo
datenwolf – here to... @datenwolf
1K Followers 1K Following Hacker, Physicist, CCC, µC³, INTJ-T – recruiting an army of corvids Fediverse: https://t.co/CbplIR6P7S OrcID: 0000-0002-9413-3474 𓍘𓅱𓀁𓇋𓄿𓅱𓀗
Hyrum Wright @hyrumwright
2K Followers 64 Following Father. Husband. Christian. Software Sanitation Engineer. Googler. Occasional professor.
Dan Nystedt @dnystedt
38K Followers 1K Following Former journalist, now financial analyst. Based in Taipei. Tweet mainly about semiconductors and Taiwan. Not investment advice. Views are my own.
EDITH @Infopulsed
2K Followers 688 Following Singularitarian/post-humanism/technocratic hedonism/ML engineer and researcher/physicist
Daniel Galvez @memorypaladin
403 Followers 42 Following AI Developer Technology Engineer at NVIDIA. Speech recognition and computer architecture nerd. All opinions are my own, not my employer's.
David Velasquez, MD @davidevelasqu
14K Followers 919 Following Resident physician @BrighamWomens | fighting to make systems work for everyone l alum @USC ✌🏽@HarvardHBS @Kennedy_School @harvardmed | #firstgen
AMDGPU @AMDGPU_
5K Followers 285 Following AMDGPU is a community created by and for fans/enthusiasts of AMD processors and technologies. https://t.co/alPxz0TGTM
Grant Slatton @GrantSlatton
20K Followers 914 Following Recent writing at https://t.co/lCWFZXt72C Formerly built the world's fastest filesystem at AWS, now the fastest spreadsheet at https://t.co/hLkbCuJG7H
Simon Green @simesgreen
4K Followers 942 Following Research Engineer @ Meta / Oculus. Computer vision, graphics, NeRFs. Ex-NVIDIA.
Daniel Lemire @lemire
29K Followers 2K Following Software performance expert. Ranked in the top 2% of scientists globally (Stanford/Elsevier 2024) and among GitHub's top 1000 developers.
Chris Lattner @clattner_llvm
86K Followers 189 Following Building beautiful things like Mojo🔥 and MAX @Modular, lifting the world of production AI/ML software into a new phase of innovation. We’re hiring! 🚀🧠
Dan Liu @danqing_liu
8K Followers 45 Following I love the better @danqing. Co-founder / CEO of @lumahq. I write about crypto, China and design.
nod.ai @nod_dot_ai
166 Followers 52 Following https://t.co/h0CyxKdotZ is now part of AMD. Follow @AMD for tech updates.
typedfemale @typedfemale
38K Followers 533 Following a really exciting new account "advanced pytorch user" - @cHHillee alt: @typedalt
Miles Brundage @Miles_Brundage
61K Followers 12K Following AI policy researcher, wife guy in training, fan of cute animals and sci-fi, Substack writer, stealth-ish non-profit co-founder
Mecozzi for School Bo... @MecozziWestBOE
35 Followers 14 Following
Marc Brooker @MarcJBrooker
21K Followers 745 Following AI, agents, databases, and serverless at AWS. Views are my own.
Joe Beda @jbeda
47K Followers 1K Following Semi-retired technologist. He/Him. Stepping away from Twitter. Signal: jbeda.99 Bluesky: https://t.co/lhuhgjKJbf
Bill Budge 🇺🇦 @BillB
5K Followers 582 Following Construction Set maker. Ex Apple, 3DO, Electronic Arts, Sony Computer Entertainment, Google. The worst day coding is better than the best day working.
Internal Tech Emails @TechEmails
584K Followers 886 Following Internal tech industry emails that surface in public records. 🔍
Kat Stafford @kat__stafford
25K Followers 3K Following Journalist | Global Race & Justice Editor @Reuters | Past: @AP investigative writer | UofM Knight-Wallace Fellow alum | Former IRE Board VP
AI at AMD @AIatAMD
47K Followers 106 Following Advancing AI innovation together. Built with devs, for devs. Supported through an open ecosystem. Powered by AMD. #TogetherWeAdvance
Nicholas Malaya @nicholasmalaya
1K Followers 960 Following Computational Scientist, AMD. To Exascale, and beyond!
SIGARCH @sigarch
4K Followers 303 Following @TheOfficialACM Special Interest Group on Computer Architecture. Follow us on Mastodon at @[email protected]!
Tony Cox @tonycoxphoto
1K Followers 332 Following Senior software engineer at Meta. Previously: Valve, Microsoft, Bullfrog. Maths, aviation, music, and photography nerd. Find me on threads (tonycoxphoto).
Vijay @__tensorcore__
2K Followers 515 Following MLIR, CUTLASS,Tensor Core arch @NVIDIA. Mechanic @hpcgarage. Exercise of any 1st amendment rights are for none other than myself.
Donald Mitchell @DonaldM38768041
3K Followers 170 Following The Soviet Exploration of Venus, Bossart: America's Forgotten Rocket Scientist. Bell Labs, Princeton University, Microsoft Research.
Fifth Star Labs @FifthStarLabs
3K Followers 116 Following Blending design with technical expertise to fashion software that is beautiful, intuitive, and illuminating. Check out Sky Guide, available on the App Store!
Chris Laurel @cjlaurel
365 Followers 323 Following Astronomy nerd. iOS developer. Snowboarder. Spaniel wrangler. Iceberg hugger.
Gregory Stoner @angstroms
811 Followers 592 Following Love building out apps for Science, Data Science/Deep Learning, and VFX and CG production. Music is a passion via an electric guitar. All opinions are my own
Andy Jassy @ajassy
191K Followers 286 Following Lead Amazon, married and father of two kids, big sports/music/film fan, experienced buffalo wings eater. Go Kraken!
David Luebke @davedotluebke
3K Followers 193 Following VP Graphics Research, NVIDIA. I co-founded NVIDIA Research in 2006 after 8 years on the U. Virginia faculty. I research graphics, VR/AR, & lately AI+graphics.