Liger Kernel @liger_kernel
Efficient Triton Kernels for LLM Training github.com/linkedin/Liger… Joined August 2024-
Tweets24
-
Followers334
-
Following11
-
Likes6
Cool work!
VeOmni x Liger to enable scalable and efficient training!
VeOmni x Liger to enable scalable and efficient training!
Happy Chinese Lunar New Year! The Liger team is excited to announce our milestone of 1,000,000 downloads! Since our initial release in August 2024, we have observed tremendous growth in both usage and community engagement. We appreciate all the recognition and will continue to…
Liger Kernel v0.5 github.com/linkedin/Liger… Post Training Loss: Introducing the first open-source optimized post-training losses in Liger Kernel with ~80% memory reduction, featuring DPO, CPO, ORPO, SimPO, JSD, and more. No more OOM nightmares for post-training ML researchers!…
Lots to announce today! Axolotl 0.6.0 is out with: - new axolotl cli command - updated dependencies to latest on Transformers, TRL, Accelerate, PEFT, bitsandbytes, deepspeed, @liger_kernel - Support for Cut Cross Entropy - ReLoRA optimizer reset fixes - ADOPT optimizer 🧵
LinkedIn's Engineering blog on Liger Kernel is now live!! linkedin.com/blog/engineeri… Since its initial release in August 2024, Liger-Kernel has grown rapidly across the community, accumulating 3,500+ stars and 350k+ downloads. We have integrated with mainstream training…
With Liger-Kernel, you can now fine-tune Qwen2-VL @Alibaba_Qwen on @modal_labs by one command with 10%+ throughput and 50% less memory, thanks to the contribution from @tyleraromero! github.com/linkedin/Liger…
v0.4.1: Gemma 2 Support, CrossEntropy Patching FIx, and GroupNorm github.com/linkedin/Liger… 1. **Gemma 2 Support**: The long pending gemma 2 is finally supported thanks to Chun-Chih Tseng! He has implemented the nasty softcapping in fused linear cross entropy…
Liger Kernel v0.4.0 has arrived! github.com/linkedin/Liger… 1. Full AMD Support: We have partnered with embeddedllm.com to adjust the Triton configuration to fully support AMD! With version 0.4.0, you can run multi-GPU training with 26% higher speed and 60% lower memory…
@emnlpmeeting @nlee288 Thankfully, we now have more than 1,300 open checkpoints in the Hugging Face community🙌 And thanks to groundbreaking work by @liger_kernel team, you can use ORPO with up to 10 times more efficient memory usage🤯 github.com/linkedin/Liger…
Our tech report on Liger Kernel is now available on arXiv: arxiv.org/abs/2410.10989 We discuss the advantages of Triton, kernel fusion, kernel optimization (e.g. chunking, in-place, etc), the design philosophy of the interface, testing best practice, and benchmarks on a wide…
Exciting talk on LLM deployment and serving!
Exciting talk on LLM deployment and serving!
🚀 Liger Kernel has surpassed **100,000+ downloads** after a month! We're humbled by the many success stories shared by both the research community and enterprises. Our commitment remains strong: we'll continue to support more kernels and models while improving performance.…
🚀🚀 v0.3.0 Release 1. Large Vision Language Model Support (Qwen-VL) 2. Patch Kernels on Model Instances 3. SWIFT Trainer Integration 4. KL Divergence Kernel and extended cross entropy For the full release note, see github.com/linkedin/Liger… We are also hosting our 1st IRL…
🎉 We are excited to have surpassed 50,000 downloads (stable+nightly) in less than 3 weeks! We've added many new features and models. Expect something cool in the next release! github.com/linkedin/Liger…
!.! @xypyth
47 Followers 4K Following
Luis Guilherme Camps @luisgcamps
110 Followers 4K Following
AG @navierisstoked
17 Followers 1K Following
TeraK @tera_kora
145 Followers 1K Following
wxthon @wanghaiteng
1 Followers 790 Following
Dengos Wei @DengosWei
9 Followers 150 Following
www @_ab_li
1 Followers 678 Following
Allie Yang @Allie_yang4
9 Followers 33 Following
Dmitry Labazkin @labdmitriy
79 Followers 724 Following
Ryan Huang @nvbkdw
91 Followers 2K Following Part-time Indie hacker building: 🎨 https://t.co/dZTgHfSbHW 💰 https://t.co/gVF6BefmPv 💸 https://t.co/z1TyGyfujC
Tech Follower @LeafedTech
0 Followers 95 Following
Artificially Intellig... @ArtiIntelligent
236 Followers 2K Following Insanity is doing the same thing over and over and expecting different results...
Aurélien-Morgan @AurelienMorgan_
101 Followers 2K Following Building `pip install retrain-pipelines`, ML-Eng-centric OS DAG engine, WebConsole & transformers/diffusers retrain framework. Wandering around. Mind if I do.
Steffen Bauch @steffenbauch
1K Followers 132 Following software engineer doing network programming, deep packet inspection, #infosec enthusiast, building robots in the night, likes math, #IoT apprentice
Rohit Jayanti @_rjayanti
50 Followers 2K Following Building Geometric Foundation Models for Robot Intelligence 🦾📐 | Graduate Researcher at @RRCLab_IIITH, @iiit_hyderabad
ismail TG @ismailTG3
37 Followers 446 Following ML enthusiast still working on my Blog - https://t.co/P7rgMx61vq…
Draffen @DMerilyn55665
436 Followers 7K Following start from here 🚀 | blockchain enthusiast. #BTC #ETH #BSC #SOL $TRX $BASE $SUI
Kev Grice @kev_grice
190 Followers 2K Following
Supriya Manna (Seekin... @_isupriya
104 Followers 2K Following 21 | AI, Algorithms and their Explanations, Causation and Ethics Opinions are mine.
顾闰东 @4UaZQBsr9r85953
0 Followers 16 Following
Kanu @SleepyBear_6309
78 Followers 666 Following
Yucheng Lu @_yucheng_lu
412 Followers 798 Following Assistant Professor @nyushanghai in ML Systems. Prev @togethercompute.
Maurice Weber @mauriceweberq
148 Followers 621 Following AI Researcher @togethercompute | RedPajama Lead | ML PhD, ETH Zürich
Sohom Ghosh @sohom1ghosh
78 Followers 613 Following Sr. Data Scientist | Researcher @JUFET #NLP #NLProc #FinancialTexts #LLMs #GenAI Likes: Reading, Travelling, Fitness, Treks, Music (Harmonica) Own opinions
屿风 @yufe556
221 Followers 3K Following
Manan Shah @MananSh55455588
18 Followers 67 Following ASE intern @Accenture | Unesco India Africa Hackathon Winner | Smart India Hackathon Winner | 3rd-year Computer Engineering Student | Full Stack Developer
Mateo Mossey @mateo_mossey
1K Followers 8K Following “The cosmos is within us. We are made of star-stuff. We are a way for the universe to know itself.” — Carl Sagan
🌷 @yolfe2020
2 Followers 202 Following
Lukas Schmit @_lukasschmit_
304 Followers 1K Following ML & Ableton enthusiast | Forbes 30u30 | Release house/techno as Lukas Schmit. Release Dubstep/Future bass as Nokturne
Joseph @iamyanp
2K Followers 4K Following Software Developer, bug inventor and passionate scuba diver/swimmer. Avid traveler and explorer of the unknown. focus on #AIGC #LLMs E/acc
skfinport 🇺🇸 @skfinport
100 Followers 6K Following Responsible AI - Ethical | Explainable | Fair | Bias-Free | Secure | Compliant
Zhongkai Zhao @zzk_zhao
66 Followers 287 Following Master of Computing @ NUS SoC MLSys | HPC | LLM | SE4AI
Yufan Song @YufanSong98
192 Followers 519 Following Build Post-Train RL Agent Infra at ByteDance Seed, openhands @allhands_ai
Steven Saito @ssaito
77 Followers 1K Following Interested in ML and robotics. And Japanese and Chinese languages.
Jeremy Howard @jeremyphoward
259K Followers 6K Following 🇦🇺 Co-founder: @AnswerDotAI & @FastDotAI ; Prev: professor @ UQ; Stanford fellow; @kaggle president; @fastmail/@enlitic/etc founder https://t.co/16UBFTX7mo
EmbeddedLLM @EmbeddedLLM
869 Followers 1K Following Your open-source AI ally. We specialize in integrating LLM into your business.
Ivan Fioravanti ᯅ @ivanfioravanti
17K Followers 929 Following Co-founder and CTO of @CoreViewHQ GenAI/LLM addicted, Apple MLX, Microsoft 365, Azure, Kubernetes, Investor in innovation and Mensa member.
Jack Lindsey @Jack_W_Lindsey
6K Followers 237 Following Neuroscience of AI brains @AnthropicAI. Previously neuroscience of real brains @cu_neurotheory.
Vignesh Kothapalli @kvignesh1420
102 Followers 109 Following MS CS, Math and Data Group @NYU_Courant | Deep Learning @Linkedin
Qingquan (QQ) Song @qingquan_song
52 Followers 51 Following MLE @ LinkedIn, CS PhD @ Texas A&M, USTCer
Yanning Chen @momochenonline
536 Followers 794 Following Startup founder, previously ML @twitter @snap @yahoo, Rensselaer and BUPT alumni
Yun Dai @yundaiiiii
84 Followers 149 Following @openai | prev: @windsurf @LinkedIn https://t.co/zYQ2JvaRc5
Marco Mascorro @Mascobot
16K Followers 2K Following Partner @a16z (investor in @cursor_ai, @thinkymachines, @bfl_ml, @WaveFormsAI & more) | Roboticist | Cofounder @Fellow_AI | @MIT 35 under 35 | Opinions my own.
Byron Hsu @hsu_byron
4K Followers 2K Following ML system @xAI | @lmsysorg @liger_kernel @flyteorg @theASFTrends for United States
You might like
