RoboTF-AI @RoboTF_AI

LocalAI 3.0.0 just dropped! - Backends as OCI plug-ins, installable in runtime. - @vllm_project , @huggingface diffusers, kokoro, chatterbox backends - Smaller and simpler images. - Voice understanding. - Latest llama.cpp updates @ggml_org Enjoy!

super excited about this!

LocalAI @LocalAI_API

5 months ago

super excited about this!

21 4 17 3K 7

Download Image

Building Ubuntu Server for AI LLMs Part 4: LLM Tools companion app for LocalAI. Model configuration editing, docker dashboard, and more! youtu.be/X6vn_uy8LcE?si… @YouTube

Updates, News, Local AI 2.27.0 Interface overhaul, Sycl Support, Mistral Small 24B during a quick coffee session youtu.be/yX0acRfH9V0?si… via @YouTube

LocalAI LLM Testing: Deepseek R1 Distill Llama 70B Deepdive VRAM/RAM at different context levels! We are talking about Deepseek R1 Distill Llama 70B at the VRAM needed at different context levels. Providing more insight on hardware requirements #localai youtu.be/rUd9AhcFacc

Mind-blown by this GitHub hack! 🤯 Simply change .com to .gg in any GitHub URL and instantly chat with the entire repo using AI. No more digging - just ask questions and get instant answers! Big thank you to @nisten who develops it and @thursdai_pod where it was mentioned. 👏

Nvidia cutting support for Maxwell, Pascal, and Volta cards in a future release! 🪦 youtu.be/qdRYDTbW2N4?si…

Behind the Scenes: Unboxing MinisForum MS-01, Major Network upgrades, Deepseek R1 Workbench session This week in the RoboTF lab: We had a major switch failure which leads into snowball effect of full network upgrade to 2.5GB, and 10GB youtu.be/bckNU2aCBzI

Building Ubuntu Server for AI LLMs from scratch Part 3: ComfyUI, Open WebUI, Flowise, n8n, and more! Come hang out with some coffee with other AI home labbers Sunday 11am EST/8am PST #localai #flowise #n8n #comfyui #openwebui youtu.be/kXnIBtYXctA?si… via @YouTube

WIN THE NEXT GENERATION OF RTX ⚡ The #GeForceRTX50 sweepstakes is here & we're giving you multiple chances to WIN a GeForce RTX 5090! Here's your first chance to enter: ⚫ Like this post ⚫ Comment #GeForceRTX50

Building Ubuntu Server for AI and LLMs from scratch Part 2: Nvidia Cuda Drivers, Toolkit, LocalAI! Getting the node bootstrapped with all the necessary software needed to run our first target of LocalAI (localai.io) with Docker. youtu.be/vkJaC8sBtmg

Building Ubuntu Server for AI and LLMs from scratch Part 1: Hardware build, Open Air Case, Multi-GPU Using parts sitting around with some new ones to build a server and come hang out with a few AI/LLM folks youtu.be/yvxwJrI7m5Y?si… via @YouTube

The Transformer's encoder clearly explained 👇🏻

Cutting up a Dell R720xd to add 2x Nvidia Tesla M40 24GB GPUs - Llama 3.3 70B, Qwen QwQ 32B Preview, Mistral 7B, Gemma 2 testing. Along with real basic SD3 Medium and LTX Video generation testing. Break out the old junk to do inference! youtu.be/zS9vIKbtp3I?si… via @YouTube

3 Uncensored AI comedians do the 12 Days of Christmas and roast AI Engineers with homelabs! 🎄 Happy Holiday! youtu.be/cdFNipBfzSo?si…

LocalAI LLM Testing: Llama 3.3 70B Q8, Multi GPU 6x A4500, and PCIe Bandwidth during inference #localai #gpuhardware youtu.be/ki_Rm_p7kao?si… via @YouTube

3 AI Comedians talk about Running a GPU Homelab for AI and Machine Learning using uncensored models! 🦾 🤣 youtu.be/_6aiGAbhTBI?si… via @YouTube

Project: Count your tokens for Huggingface models! 🪙 AutoTikTokenizer and Streamlit come together for a quick and handy application project. #autotiktokenizer #streamlit #LLM #Huggingface youtu.be/_uRbD8ItGFY?si… via @YouTube

I was looking for a good way to estimate tokens on open-source LLM's. I found a nifty project called autotiktokenizer github.com/bhavnicksm/aut… which is fantastic! ⭐️ I wrapped that up in a quick Streamlit app project you can see here: github.com/kkacsh321/robo…

Mistral 7B LLM AI Leaderboard: Gigabyte AMD Radeon RX 7600 XT 16GB uses ROCm to punch at the leaderboard #localai #LLM #mistral youtu.be/uwHiOtvm9go?si… via @YouTube