RunLocal @RunLocalAI
On-device AI made easy. Backed by @ycombinator (S24). runlocal.ai Joined June 2024-
Tweets10
-
Followers31
-
Following2
-
Likes6
🔥 VLMs on mobile devices with world-facing cameras key for proactive, intelligent computing. Local/on-device inference key for real-time, private experiences. Great to see an emphasis on smaller VLMs. Excited to see where @huggingface, @moondreamai, etc. take things 🚀
🔥 VLMs on mobile devices with world-facing cameras key for proactive, intelligent computing. Local/on-device inference key for real-time, private experiences. Great to see an emphasis on smaller VLMs. Excited to see where @huggingface, @moondreamai, etc. take things 🚀
Snap's announcement about their on-device text-to-image model seems to have slipped under the radar… Apparently, it generates 1024x1024 images with quality that's comparable to cloud-oriented models like Stable Diffusion XL. But it can do that locally on an iPhone 16 Pro Max…
Short but sweet talk about the WebNN API: youtube.com/watch?v=FoYBWz… Def worth checking out the YouTube playlist from @jason_mayes WebAI Summit last year. It's packed with great talks! Looking forward to the next summit!
Awesome work from @soldni and team at @allen_ai! If you're interested in shipping on-device AI language features in your app, I highly recommend checking out their demo app to get a sense of what's possible these days on an iPhone: apps.apple.com/us/app/ai2-olm…
Awesome work from @soldni and team at @allen_ai! If you're interested in shipping on-device AI language features in your app, I highly recommend checking out their demo app to get a sense of what's possible these days on an iPhone: apps.apple.com/us/app/ai2-olm…
creativestrategies.com/research/white… Stable Diffusion power consumption between M3 and X Elite: "M3 MacBook Air, 8-core CPU 10-core GPU with 16GB RAM spec, we see averages of 87.63 Joules used per image generated. On the Snapdragon X Elite system, we used a prototype Surface Laptop 15-inch…
“An old Asian man” Stable Diffusion 1.5 with ControlNet. Used 6.94 bit mixed-bit palletization to get the model size down to <1gb. Results are decent (around 1 it/s)
Benchmarked @bria_ai_'s RMBG CoreML model across almost every iPhone with an NPU yday. Latest iPhones 5x quicker for this model than XS/XR (from 2018).
Bitesize Benchmark (iPhone 15 Pro Max) WhisperKit (v0.6) vs Whisper.cpp (v1.6): - Accuracy: Both perfect for this short clip - Speed: WhisperKit at 45 w/s. Whisper.cpp at 30 w/s. (average over 3 runs) - Peak RAM (note: physical footprint only): WhisperKit at 180Mb, Whisper.cpp…
Always benchmark your on-device models! Tried to run whisper-tiny on MacOS, using computeUnits.all in CoreML. Produced worse inference/load times than only using ANE, which is surprising because you'd expect CoreML to pick the optimal config. Why CoreML did this 👇
Just converted @bria_ai_’s awesome background removal model to CoreML for inference on iOS/MacOS. There's a 3x inference speedup when using the NPU (ANE) vs CPU/GPU on an iPhone 15 Pro Max. Shout out to @YairAdato and team for their work (HF repo: briaai/RMBG-1.4).
SciMatrixDecoder @SciMatrixVision
1K Followers 4K Following Science Matrix Decoder | AIQ Vision Uncovering the mechanisms of disease production. Transformative AI strategies in medicine and physics #AIQ #SciMatrix #MAHA
bamor1988 @bamor198868137
89 Followers 2K Following Tecnologia, finanças, analytics, AI, econometria. Deus acima de tudo!
JMBP @JMBPMS
52 Followers 4K Following
Multimodal Ventures @Multimodal_Vent
7 Followers 80 Following Multimodal Ventures is a Chicago based venture fund focused on investing in Y Combinator backed startups.
Pranjali Awasthi @raidingAI
6K Followers 1K Following 18 | Slashy (YC S25) | @HF0Residency @beondeck | @georgiatech
M @MadisonLuo_
1 Followers 12 Following
Steven-Shine Chen @stevenshinechen
410 Followers 248 Following CS Master's Student at @MIT, previously @imperialcollege Researching multimodal reasoning at the MIT @medialab
Jonathan Foote @JFoote2715
4 Followers 899 Following
JohnnyBoi @JohnnyBoi115619
4 Followers 407 Following
Edward Cunningham @edcunninghamesq
140 Followers 229 Following Physics graduate, space enthusiast, and Product Manager @Google
Ismail Salim @IssySalim
128 Followers 380 Following Co-founder/CEO @RunLocalAI (YC S24). Making it easier to ship better on-device AI. Also into house/techno from early 90's/00's,
Mohammed Ibrahim @ibs5020
115 Followers 7K Following Humanitarian Aid Worker with 4.5 years experience at the Rohingya Refugee Response
Bernhard Raberger @rabergerb
113 Followers 667 Following
Ryan Havlick @RyanHavlick
89 Followers 237 Following Interested in crypto, robotics, venture investing and healthcare IT.
TON Provider @TONProvider
399 Followers 7K Following TON Provider is group a few datacenters optimized for TON services, we providing nodes for users, developers and any TON projects include TON startups.
dessatel @dessatel
131 Followers 711 Following
Rams @mintelligenceai
228 Followers 7K Following For all the crypto, trade, investment, forex, markets bots wants to follow me - stop following me. I won’t join any platform, nor WhatsApp group.
founder at ideas.dire... @IdeasDirectory
387 Followers 1K Following Platform for founders, investors, partners to help take ideas 💡 to reality. Join today for free
Mateo @mateocervino
50 Followers 437 Following
Logan Todd Building L... @LoganToddT
388 Followers 737 Following Electrical Engineer. PSU 2026. Space Fan.
Jonathan Golden @jpgg
5K Followers 1K Following Startup investor, ex-Partner @NEA, Product at @Airbnb, @Dropbox, @Hubspot
Nikhil Sonti @nv_sonti
700 Followers 80 Following Co-founder @browserOS_ai (YC S24) | Ex-Meta, Microsoft
vivekb.eth | w.ai @notorious_VB
877 Followers 2K Following co-founder @WOMBO 200M+ downloads | e/acc | web 🌲
Tiezhen WANG @Xianbao_QIAN
7K Followers 2K Following Engineer at HuggingFace, ex-Googler on TFLite / micro. Ideas are my own.
• @woopwoopidy
4 Followers 61 Following
Ivan Chan @ivanchanavinah
119 Followers 458 Following CTO/Cofounder at @RunLocalAI (YC S24). Helping engineering teams ship better on-device AI faster and without the hassle. 🇭🇰 / 🇬🇧
Ivan Chan @ivanchanavinah
119 Followers 458 Following CTO/Cofounder at @RunLocalAI (YC S24). Helping engineering teams ship better on-device AI faster and without the hassle. 🇭🇰 / 🇬🇧
Ismail Salim @IssySalim
128 Followers 380 Following Co-founder/CEO @RunLocalAI (YC S24). Making it easier to ship better on-device AI. Also into house/techno from early 90's/00's,Trends for United States
You might like
