NebberCracker @NebberCrackker

Need Monte Carlo Simulation in life Joined October 2023

Tweets

66
Followers

12
Following

310
Likes

3K

Radiance Fields @RadianceFields

5 days ago

It's a bird. It's a plane. It's gaussian splatting. When @Framestore needed to bring Kryptonian tech to Earth, they turned to gaussian splatting. In the recently released Superman, every shot of Kal-El's parents is a dynamic splat. I spoke to the team at Framestore about…

9 39 346 93K 144

Download Video

NebberCracker @NebberCrackker

2 weeks ago

Solving Triton Puzzles is such a fun activity !!

0 0 1 40 0

Download Image

Jacob Austin @jacobaustin132

3 weeks ago

Today we're putting out an update to the JAX TPU book, this time on GPUs. How do GPUs work, especially compared to TPUs? How are they networked? And how does this affect LLM training? 1/n

38 530 3K 378K 5K

Download Image

Alex Zhang @a1zhang

3 weeks ago

announcing the @GPU_MODE x @scaleml summer speaker series happening next week, a 5⃣-day series where top researchers will teach about the algorithmic and systems-level advances that underpin `gpt-oss`! all content will be live-streamed & recorded for FREE on GPU MODE's YouTube!

1 45 271 28K 144

Download Image

Yacine Mahdid @yacinelearning

4 weeks ago

for those curious about how 1M context model is even possible here is a 47min deep dive on the minimax-01 open model in it we cover the lightning linear attention mechanism the hybridization strategy to make it work and how to go beyond and make the model multimodal wild stuff

8 38 560 22K 471

Download Image

NebberCracker @NebberCrackker

a month ago

Yo chat... Check out my article on batching strategies in LLMs Inference.. open.substack.com/pub/bargav/p/b… Any feedback back is highly appreciated 🤘

0 0 1 29 0

NebberCracker @NebberCrackker

2 months ago

Distributed Training.... I am coming to get ya.. !!

0 0 1 96 0

Download Image

Xiuyu Li @xiuyu_l

2 months ago

Sparsity can make your LoRA fine-tuning go brrr 💨 Announcing SparseLoRA (ICML 2025): up to 1.6-1.9x faster LLM fine-tuning (2.2x less FLOPs) via contextual sparsity, while maintaining performance on tasks like math, coding, chat, and ARC-AGI 🤯 🧵1/ z-lab.ai/projects/spars…

5 58 208 35K 133

Download Video

⁶𓅓t1h1🌻 @2PimpABfly

2 months ago

Me when I sing both parts of Luther

30 2K 15K 348K 592

Download Image

Han Guo @HanGuo97

3 months ago

We know Attention and its linear-time variants, such as linear attention and State Space Models. But what lies in between? Introducing Log-Linear Attention with: - Log-linear time training - Log-time inference (in both time and memory) - Hardware-efficient Triton kernels

16 201 1K 260K 847

Download Image

NebberCracker @NebberCrackker

3 months ago

I think after Attention (learnt back in 2020), Flash-Attention is the only machine learning algorithm that gave me immense happiness once I cracked it. #MachineLearning #Llm

0 0 1 25 0

Download Image

NebberCracker @NebberCrackker

4 months ago

Spent last week building an #LLM completely from scratch — and I mean everything: BPE tokenizer (optimized), Linear, SWIGLU, RoPE attention, and full Transformer blocks, AdamW, cross_entropy, and top-p decoding etc.. and trained on children stories. github.com/bargav25/llm

0 0 1 56 0

NebberCracker @NebberCrackker

4 months ago

wrapping up things in my current job to move to a new job. And the worst has come.... I've to document all my code now🥲

0 0 1 33 0

NebberCracker @NebberCrackker

4 months ago

How much time do you think it takes to train a Byte Pair Encoding Tokenizer on corpus of 2M docs? Well.... I did it in 2 mins. Main Thanks to MultiThreading and hashmaps. 😉 bargav.substack.com/p/bpe-tokenize… github.com/bargav25/fast_… #LLM #ArtificialIntelligence #DeepLearning

0 1 1 46 0

NebberCracker @NebberCrackker

5 months ago

I was one of them 🥲

JOLLY J✨ @DynamoSuperX

5 months ago

I was one of them 🥲

2K 18K 319K 14.8M 15K

0 0 1 45 0

NebberCracker @NebberCrackker

6 months ago

Just published my blog on Pipeline Parallelism fundamentals! Learn how it works. Check it out: medium.com/@bargav25/dist… Feedback welcome! More deep learning content coming soon. #MachineLearning #LLMs #DistributedTraining

0 0 0 30 0

NebberCracker @NebberCrackker

7 months ago

Hi! Our team is building a product for men's skincare. Could you please fill out this short form (2-3 minutes) to help us better understand what men are looking for? Thank you so much! #skincareroutine #skincare #ai #hackathon #ml #fashion forms.gle/3syFkLbbVhryWA…

0 0 0 41 0

NebberCracker @NebberCrackker

8 months ago

I just published KeypointNeRF: A New Approach to 3D Motion Capture Using Neural Radiance Fields #3DComputerVision #NeuralRadianceFields #DeepLearning #ComputerVision link.medium.com/lkKcgVjHLPb

0 0 0 31 0

NebberCracker @NebberCrackker

8 months ago

I just published Plan As You Go: How We Built an AI-Powered Boston Trip Planner in One Hour #machinelearning #Gemini #LLMs link.medium.com/2oEOQe4FLPb

0 0 0 33 0

DeepSeek @deepseek_ai

9 months ago

🚀 Introducing DeepSeek-V3! Biggest leap forward yet: ⚡ 60 tokens/second (3x faster than V2!) 💪 Enhanced capabilities 🛠 API compatibility intact 🌍 Fully open-source models & papers 🐋 1/n