HPC-AI Lab @HPCAILab
HPC-AI Lab @NUSingapore. High Performance Computing, ML Systems, AI Applications (e.g. CV, NLP, Biology) ai.comp.nus.edu.sg Singapore Joined May 2023-
Tweets20
-
Followers148
-
Following13
-
Likes10
Customizing Your LLMs in seconds using prompts🥳! Excited to share our latest work with @HPCAILab, @VITAGroupUT, @k_schuerholt, @YangYou1991, @mmbronstein, @damianborth : Drag-and-Drop LLMs(DnD). 2 features: tuning-free, comparable or even better than full-shot tuning.(🧵1/8)
Representation Alignment (REPA) is NOT ALWAYS helpful for diffusion training!🤷 Sharing latest work w/ @HPCAILab and @VITAGroupUT: "REPA Works Until It Doesn't: Early-Stopped, Holistic Alignment Supercharges Diffusion Training". Acceleration up to 28x w/o performance drop.(🧵1/7)
Congrats to our lab member @lzm_mlsys !
Congrats to our lab member @lzm_mlsys !
🚀 We’re thrilled to introduce DD-Ranking: Rethinking the Evaluation of Dataset Distillation—a unified, user-friendly, and long-term maintained benchmark for dataset distillation (DD)! 📢 Together with 20 institutions worldwide, we’re releasing our Repo, API Documentation, and…
Generating ~200 million parameters in just minutes! 🥳 Excited to share our work with @MTDovent , @heisejiasuo96 , and @YangYou1991: 'Recurrent Diffusion for Large-Scale Parameter Generation' (RPG for short). Example: Obtain customized models using prompts (see below). (🧵1/8)
Training-free Video Enhancement: Achieved 🎉 Nice work with @oahzxl @shaowenqi126301 @VictorKaiWang1 @VITAGroupUT @YangYou1991 et al. Non-trivial enhancement, training-free, and plug-and-play 🥳 Blog: oahzxl.github.io/Enhance_A_Vide… (🧵1/6)
Exciting News from Open-Sora! 🚀 They've just made the ENTIRE suite of their video-generation model open source! Dive into the world of cutting-edge AI with access to model weights, comprehensive training source code, and detailed architecture insights. Start building your dream…
Neural Network Diffusion Diffusion models have achieved remarkable success in image and video generation. In this work, we demonstrate that diffusion models can also generate high-performing neural network parameters. Our approach is simple, utilizing an autoencoder and a…
InfoBatch is accepted as Oral to ICLR'24! 🔥 InfoBatch prunes data on the fly and speedups 20%~40% on img classification, semantic segmentation, MAE, Diffusion, LLM instruction tunning.🧵3 ArXiv: arxiv.org/abs/2307.02047 Blog: zhengzangw.github.io/blogs/infobatch Code: github.com/NUS-HPC-AI-Lab…
I am happy to share that our paper has been accepted by ICLR as an ORAL paper (1.2% acceptance rate). InfoBatch: Lossless Training Speed Up by Unbiased Dynamic Data Pruning arxiv.org/abs/2303.04947 InfoBatch randomly prunes a portion of less informative samples based on the…
📢 Join us for the HPC-AI Lab Public Seminar! 🔗 Registration: forms.gle/4anywqoXtSumHu… 🗓️ Date/Time: 29 Nov. 2023 (Wednesday), 1 PM to 2 PM 📍 Online via Zoom
Time flies! I got my PhD from Berkeley 1218 days ago. My first PhD student is graduating. That is my first achievement :-)
Excited to share our #ICCV2023 paper: Fine-tuning Vision-Language Models without Zero-Shot Transfer Degradation (ZSCL). ZSCL outperforms the pre-trained model on downstream tasks and maintains its zero-shot transferability to other tasks. paper: openaccess.thecvf.com/content/ICCV20… blog:…
Excited to introduce our #ICCV2023 paper Dataset Quantization (DQ). DQ achieves lossless training performances with 2% data keep ratio on language tasks and 60% data keep ratio on vision tasks. Just check out our paper and project: openaccess.thecvf.com/content/ICCV20… github.com/magic-research…
Our work DREAM has been accepted by ICCV-2023 @ICCVConference. We are the first to explore the matching efficiency in dataset distillation and speed up the previous works more than 8 times without performance drop. Check out our DREAM in Github: github.com/lyq312318224/D…
🎉 Exciting news! Our Lab has two papers accepted at ACL 2023! 📚✨ We're thrilled to announce that our CAME optimizer has won the Outstanding Paper award! 🏆 Congratulations to the entire team for their remarkable achievement! 🥳 #ACL2023
I am happy to share that our paper won the Outstanding Paper Award of ACL. We propose CAME to simultaneously achieve two goals: fast convergence as in traditional adaptive methods, and low memory usage as in LLM training. arxiv.org/abs/2307.02047
📢 Join us for the HPC-AI Lab Public Seminar featuring IEEE Fellow Dr. Stan Z. Li! 🌟 🔗 Registration: forms.gle/5bcDLV6B7eX3SK… 🗓️ Date/Time: 27 Jun. 2023 (Tuesday), 10 AM to 11 AM 📍 Venue: LT20, NUS Singapore Don't miss out on this exciting seminar!
📢 Join us for the 1st HPC-AI Lab Public Seminar featuring Dr. Enze XIE from Huawei Noah’s Ark Lab! 🌟 🔗 Registration: forms.gle/G54J9VkvVPYgqg… 🗓️ Date/Time: 14 Jun. 2023 (Wednesday), 1 PM to 2 PM 📍 Venue: Online via Zoom Don't miss out on this exciting seminar!
🔬 Introducing HPC-AI Lab @NUSingapore! We're dedicated to High-Performance Computing (HPC), ML Systems, and AI Applications, including LLM, CV, etc. Stay tuned for exciting discussions with leading scholars - everyone is welcome to join!
Ycrawarral @Ycrawarral3805
0 Followers 211 Following
Arbarku @Arbarku736
0 Followers 209 Following
Yiqi Wang @YiqiWang119050
0 Followers 138 Following
Basit Mustafa @moltar81435
412 Followers 8K Following introverted but willing to discuss sanctuary moon innovation/ai + dsop/ai delivery @ https://t.co/nQ5pf3TzTZ
@Quincy Su @QuincySu76884
0 Followers 13 Following
LEO LI @Real_LCX
632 Followers 2K Following IM GPD-SM (Geopolitical Dynamics - System Model)一个战略推演引擎 (Strategic Deduction Engine)。任务：通过吸收高度复杂的、多领域的输入信息，持续校准其对世界权力运行规律的内部模型，基于模型，对未来做出富有洞察力的、逻辑严谨的推演。
John @imoon2008
4 Followers 2K Following
VITA Group @VITAGroupUT
1K Followers 3K Following VITA Group @UTAustin w/ Prof Atlas Wang | https://t.co/Wi3tJXf1mg Run by VITA students (PI is busy changing diapers😄). Tweets only reflect personal views
jerryliang @Jerryliangch
16 Followers 21 Following Undergraduate student at USTC (graduated) | Intern at @HPCAILab.
Huaizhi Qu @qhz991029
38 Followers 398 Following PhD student, CS@UNC Chapel Hill; Undergraduate, CS@USTC
Jinlong Xue @JinlongXue47894
3 Followers 75 Following MS Student at AI@BUPT | Looking for Ph.D. in 2025 fall
Amanuel Tafese @dufera_ama36621
71 Followers 3K Following #Visual SLAM #3D Reconstruction #Robot perception | Vision
Yin Bo @YinBo0927
0 Followers 21 Following 25 Fall Msc in NUS Interested in Deep Learning, Diffusion Model, VLM and MLLM Seeking 26 Fall/27 Spring PhD position in HK/SG!
Jason Wong @JasonWong2112
1 Followers 29 Following
lawrenceNiu @LawrenceNiu198
11 Followers 242 Following
yufei zhu @yufeiz119
0 Followers 62 Following
heartsoar @heartsoar
22 Followers 309 Following
Doven Tang @MTDovent
15 Followers 20 Following This is Doven from Xidian University. Feel free to contact with me.
Yujie Tu @TuYujie4
0 Followers 13 Following
KeenZ😶🌫️ @0xkeenz
6K Followers 2K Following Crypto Hunter / Trader / DeFi Farmer / Bitcoin Fans / Crypto investor since 2017
Helbert Paat @hellohelbert
36 Followers 634 Following RA @HKUST, previously @HongKongPolyU, researching uncertainty estimation, vision, and ML.
qiuhh @goodluck_233
0 Followers 10 Following
Pranshu Bahadur @PranshuBahadur
159 Followers 780 Following
Xin Jin @Xander_K1ng
16 Followers 202 Following RA: @Westlake_Uni. || Master at Chongqing Technology and Business University. || Intern: @Westlake_Uni
Sunny Sun @HeSun_USTC
23 Followers 268 Following Research in ML/LLM System. Ph.D. candidate in CS@USTC
Yaxin Luo @YaxinLuo999999
29 Followers 490 Following ML PhD in VILA-Lab (https://t.co/nep5559JO3) @MBZUAI.
Muqi Li @MuqiLi1029
4 Followers 292 Following Senior student majoring in Data Science at East China Normal University
Zirui Liu @ziruirayliu
375 Followers 619 Following Assistant Professor of CS @UMNComputerSci | PhD @RiceUniversity
Yin169 @Yin1691
16 Followers 669 Following
Jzg Fan @FanJzg
3 Followers 13 Following
青谷 @sjqapp
4 Followers 365 Following
梁爽 @liangshuan37678
0 Followers 40 Following
huang haofeng @jason_huang03
1 Followers 95 Following
jingyu zhang @jingyu_zha22289
12 Followers 130 Following
Ethan @nonzs86
36 Followers 219 Following
echolliriver @echolliriver
0 Followers 5 Following
Zhaoyang Wang @zhaoywang_CS
64 Followers 266 Following First year CS PhD student at UNC Chapel Hill @unccs. Previously interned at @Microsoft @Weixin_WeChat. Research interests #LLM #NLP #Alignment.
Ziming Liu @lzm_mlsys
97 Followers 55 Following PhD Candidate at SoC,@NUSingapore, advised by @YangYou1991. Working on efficient ML system and algorithms. Past:@MSFTResearch @BytedanceTalk @HPCAITech
Tom Young @tomyoung903
57 Followers 183 Following Research fellow working on large language models @NUS w/ folks such as @XueFz and @YangYou1991
Kai Xu @sdxk163
16 Followers 223 Following
Yiqi Zhang @YiqiZhangV
43 Followers 201 Following Data science PhD candidate at NUS. Main focus: HPC, MLSys, Neuroimaging. Otaku stuffs @ExtremeViscent
Berkeley Lab @BerkeleyLab
92K Followers 2K Following Official account of Lawrence Berkeley National Laboratory (LBNL), a U.S. Department of @ENERGY national lab.
Berkeley AI Research @berkeley_ai
225K Followers 367 Following We're graduate students, postdocs, faculty and scientists at the cutting edge of artificial intelligence research.
MMLab@NTU @MMLabNTU
1K Followers 18 Following Multimedia Laboratory @NTUsg, affiliated with S-Lab. Large Multimodal Models, Computer Vision, Image Processing, Computer Graphics, Deep Learning
Mike Shou @MikeShou1
2K Followers 468 Following Asst Prof at NUS. Forbes 30 under 30 Asia. Previously at Facebook AI and Columbia U. Passionate about video, multi-modal, AI assistant.
Victor.Kai Wang @VictorKaiWang1
667 Followers 616 Following Principal Researcher at Tencent Hunyuan, Prev. Ph.D. student at NUS, focus on parameter generation.
Fuzhao Xue (Frio) @XueFz
5K Followers 679 Following Research Scientist @GoogleDeepmind | Scaling #Gemini | Zero-shot Cooking Learner🧑🍳
Zangwei Zheng @ZangweiZheng
266 Followers 177 Following Ph.D. Candidate @NUSingapore | B.S. @NanjingUnivers1 | Optimizer & Efficient ML | AAAI Distinguished & ACL Outstanding Paper Award Winner
Yang You @YangYou1991
8K Followers 472 Following Presidential Young Professor at @NUSingapore. @Forbes 30 under 30. Ph.D. from @UCBerkeley. Founder and Chairman of @HPCAITechTrends for United States
You might like
