@hyhieu226 Seems like you’re conflating DSLs with abstraction level. Mosaic is quite hard to write wrt triton. Normalizing for total wallclock time / flops is critical. I’m willing to bet (a lot) that doing so greatly shifts the distribution in favor of lower level programming models.
147 Followers 2K FollowingSoftware - Hardware Co - design / second year Phd / C++ / Verilog / CUDA / ML sys / DL framework / DSA / compute arch / model compression
2K Followers 515 FollowingMLIR, CUTLASS,Tensor Core arch @NVIDIA. Mechanic @hpcgarage. Exercise of any 1st amendment rights are for none other than myself.
43K Followers 3K FollowingWe're in a race. It's not USA vs China but humans and AGIs vs ape power centralization.
@deepseek_ai stan #1, 2023–Deep Time
«C’est la guerre.» ®1
18K Followers 1K FollowingAssistProf @CarnegieMellon. Distinguished Eng @NVIDIA. Creator of @XGBoostProject, @ApacheTVM. Member https://t.co/QYyfjQNp4p, @TheASF. Views are on my own
118K Followers 499 Followingindependent data-driven journalist. part-time pollster. author of the book & Substack STRENGTH IN NUMBERS. formerly 538, @theeconomist. community gardener
38K Followers 2K FollowingPersonal account. Director of Economics at @The_Budget_Lab. Former Chief Economist at @WhiteHouseCEA
Bluesky: @ernietedeschi.bsky.social
Threads: ernietedeschi_
8K Followers 233 FollowingGeorge Lowther, Author of Almost Sure blog, on maths, probability and stochastic calculus.
Also on YouTube https://t.co/VyOijwbe9l
243K Followers 2K FollowingSign up for my new newsletter! (Link below) Also: Co-author of Abundance, host of Plain English, and contributing writer at The Atlantic.
56K Followers 853 FollowingFiguring out AI @allen_ai, open models, RLHF, fine-tuning, etc
Contact via email.
Writes @interconnectsai
Wrote The RLHF Book
Mountain runner
793 Followers 85 FollowingThe Salem Center for Policy helps students, business leaders, and policy makers apply data-driven insights to complex problems.
265 Followers 270 FollowingI think and write about software, hardware, math, and foundational computing technologies.
MTS at Anthropic, all views are my own.