Oh @Apple you beauty!
A titan of code, with might so grand,
Silent as whispers, no fan's harsh demand.
Four hundred gigs of VRAM's quiet reign,
Power unrivalled, yet soft as a dream's gentle strain !!
The latest Gemma 270M model is amazing!
Some stats from the run:
Prompt: 14 tokens, 54.239 tokens-per-sec
Generation: 200 tokens, 263.191 tokens-per-sec
Peak memory: 1.028 GB
@awnihannun , @osanseviero
Check out the model to run using mlx : huggingface.co/mlx-community/…@Apple
So I think a business justification for MLX's CUDA backend is, it gives people a really good reason to purchase those insanely expensive Macs.
Of course I don't sell Macs, I'm doing it because it is so cool.
So Tesla traded around $320 the day (today) first Tesla robotaxis started roaming around. I just post this here as a historic marker. Things will get wild over the next 5 years and I want to come back to this post a couple of times later.
172 Followers 3K FollowingCoin Stories Host - #1 Show For #Bitcoin Education | Champion for the Working Class | Media Commentator | Awarded Journalist | First Gen 🇺🇸
17K Followers 3K FollowingHelping business owners grow with digital marketing | Paid Ads Expert | Ecom💰 17 years experience 🔥 $110,000,000+ in ad spend 📈
106 Followers 1K FollowingInternet Rocket Scientist, Gamer, Astronomer, Dad, Scotsman, Pilot. Makes videos about space and science https://t.co/3F2gDzj6kE
724 Followers 3K FollowingEverything around me was someone's lifework| Intelligence is the capacity for learning| Entrepreneur at heart(CS grad), broadly curious, I live & breathe EdTech
591 Followers 64 FollowingRun AI models like Llama, Gemma, and more on your iPhone and iPad. Offline. No login. No data collection. Powered by Apple MLX.
55K Followers 928 FollowingSleep nerd, biohacker, tennis and motorsport enthusiast. CEO @eightsleep: We power human performance through optimal sleep. MIA by way of NYC and 🇮🇹
24K Followers 249 Following@Cohere's research lab and open science initiative that seeks to solve complex machine learning problems. Join us in exploring the unknown, together.
17K Followers 3K FollowingHelping business owners grow with digital marketing | Paid Ads Expert | Ecom💰 17 years experience 🔥 $110,000,000+ in ad spend 📈
1K Followers 495 FollowingHelping teams build AI-augmented systems that actually work | ai & ml explorer | tech optimist | industry-to-tech translator |
ex-EPCM PM
1K Followers 744 FollowingPlatforms @ Blume Ventures| Building India's largest startup community @Headstarters | 24x7 with Startups, also a CA | ex-Microsoft, ex-Infosys, ex-Deloitte
1K Followers 543 FollowingSharing daily insights on practical ways to use Al, AI Agents, and Tools • Follow me to learn how to master AI in your daily life • AI Educator • DM for Collabs
12K Followers 3K FollowingLocalGlobe is the pre-seed and seed fund from the Phoenix Court family of funds, including @latitudevc, @gosolarvc, @basecampvc; and @phxcrt