Your friendly neighborhood PhD in Robotics @CMU. Soft robots for Manipulation | Causal Inference | MARL.servo97.github.io Pittsburgh, PAJoined November 2014
Announcing our EXAIT@ICML workshop paper: CURATE!
Have a difficult target task distribution with sparse rewards that you want to train an RL agent to complete? 🤔
We tackle this problem using our curriculum learning algorithm, CURATE. 🎓
Link: openreview.net/forum?id=mAeQu…
1/6
Thrilled to join @virginia_tech as an assistant professor in @VirginiaTech_ME this fall!
At the TEA lab (tealab.ai), we’ll explore hybrid AI systems for efficient and adaptive agents and robots 🤖
Thank you to everyone who has supported me along the way!
It was a dream come true to teach the course I wish existed at the start of my PhD. We built up the algorithmic foundations of modern-day RL, imitation learning, and RLHF, going deeper than the usual "grab bag of tricks". All 25 lectures + 150 pages of notes are now public! 🧵
Say ahoy to 𝚂𝙰𝙸𝙻𝙾𝚁⛵: a new paradigm of *learning to search* from demonstrations, enabling test-time reasoning about how to recover from mistakes w/o any additional human feedback! 𝚂𝙰𝙸𝙻𝙾𝚁 ⛵ out-performs Diffusion Policies trained via behavioral cloning on 5-10x data!
Robots need touch for human-like hands to reach the goal of general manipulation. However, approaches today don’t use tactile sensing or use specific architectures per tactile task.
Can 1 model improve many tactile tasks?
🌟Introducing Sparsh-skin: tinyurl.com/y935wz5c
1/6
🤖We are introducing Grounded Task Axes (GTA) — a zero-shot skill transfer framework that enables robots to perform multi-step manipulation tasks on novel objects by generalizing modular controllers grounded through visual foundation models.
✅ No training, no demo, no…
Excited to share that our paper, "Multi-Robot Motion Planning with Diffusion Models," has been selected for a Spotlight presentation at #ICLR2025!🔦🤖
We scale diffusion planning to dozens of robots *without* multi-robot data by using search.
Project: multi-robot-diffusion.github.io 🧵
Do you think that robot safety is “just collision avoidance”? In the open world, safety is more than collisions and must represent failures like spilling or breaking. Our new latent safety filters detect–and prevent–any policy from violating hard-to-specify constraints! (1/10)
Can 3D scene graphs act as effective online memory for solving EQA tasks in⚡️real-time?
Presenting GraphEQA🤖, a framework for grounding Vision Language Models using multimodal memory for real-time embodied question answering.
I am on the industry job market, and am planning to interview around next March. I am attending @NeurIPSConf, and I hope to meet you there if you are hiring! My website: soyeonm.github.io
Short bio about me:
I am a 5th year PhD student at CMU MLD, working with @rsalakhu…
Excited to finally release our NeurIPS 2024 (spotlight) paper! We introduce Run-Length Tokenization (RLT), a simple way to significantly speed up your vision transformer on video with no loss in performance!
A dream I've had for five years is finally coming true: I'll be co-teaching a course next sem. on the algorithmic foundations of imitation learning / RLHF with my advisors, Drew Bagnell and @zstevenwu! Sign up if you're at CMU (17-740) or follow along at interactive-learning-algos.github.io!
Can robots make pottery🍵? Throwing a pot is a complex manipulation task of continuously deforming clay. We will present RoPotter, a robot system that uses structural priors to learn from demonstrations and make pottery @HumanoidsConf@CMU_Robotics
👇robot-pottery.github.io 1/8🧵
Congratulations to Dr. Shivam Vats (@ShivaamVats ) for successfully completing his Ph.D. thesis on Plan to Learn: Active Robot Learning by Planning! It delves into the kind of meta reasoning problems that we will need to address more and more as robots become ubiquitous.
Thinking about contributing to CoRL? We expect many submissions this year. Help the community in finding which papers are pushing the boundaries. Considering nominating yourself as a reviewer, if experienced in writing robot learning papers: forms.gle/wuzGCD3ZbB3im1…
A huge congratulations to Dr. Tabitha Lee (@TabulaRobot ) for successfully completing her Ph.D. thesis on Causal Robot Learning for Manipulation!
It has been a great journey and key steps to bringing causal reasoning and learning into robotics.
Exciting news! Just as foundation models revolutionized text and image modeling, it's now time for Time Series Data! Introducing MOMENT, a family of Open Time Series Foundation Models, freshly accepted at @icmlconf 2024! 🎉
36 Followers 389 FollowingShare market Bitcoin trading 💸💸👈
If you want to invest money in bitcoin trading, join the telegram channel
https://t.co/1NB9XpUpNm
706 Followers 3K FollowingAI / ML / RL research @Mila_Quebec / @UMontreal, prev. research @Ualberta, @AmiiThinks, @rlai_lab. Open science community lead @Cohere_Labs .
17K Followers 6K FollowingNeurodivergent physics student with a keen interest in multisensory integration and emergent perception. Exploring research on a proposed ‘sixth sense’. Δ
2K Followers 840 FollowingAssistant Professor at @BristolUni, PhD from @UCL, prev. intern in @TikTok & @Microsoft. ✨ Reinforcement Learning, Causality, World Models.
112K Followers 657 FollowingBehavioral engineer. #1 Habit Transformation & Dopamine rewiring program on Twitter. 250+ clients transformed. "No-one does it like Boys at the Phalanx" - Lee.
5K Followers 346 Following📖 Dostoevsky |
Literature | Cinema |
Politically Incorrect |
'Do I contradict myself? Very well then I contradict myself, (I am large, I contain multitudes)'
26K Followers 246 FollowingCEO @ Astera | born lucky
anon feedback: https://t.co/9RtcgMyTHP | https://t.co/buKUN4hYly
I write about agency and related topics via Useful Fictions on S*bst*ck
706 Followers 3K FollowingAI / ML / RL research @Mila_Quebec / @UMontreal, prev. research @Ualberta, @AmiiThinks, @rlai_lab. Open science community lead @Cohere_Labs .
2K Followers 380 FollowingDirector of Robotic Systems @NVIDIA. Isaac Cortex, cobots, geometric methods; PhD CMU, research Max Planck, TTI-C, co-founder Lula Robotics, eng Google, Amazon
2K Followers 840 FollowingAssistant Professor at @BristolUni, PhD from @UCL, prev. intern in @TikTok & @Microsoft. ✨ Reinforcement Learning, Causality, World Models.
1K Followers 105 FollowingAssistant Professor @mldcmu. Formerly: Postdoc @MITEECS, PhD @Berkeley_EECS, Math Undergrad @Princeton. New to Twitter. https://t.co/67bMOAyqK6
63K Followers 2K FollowingResearch Scientist at Google DeepMind (WaveNet, Imagen, Veo). I tweet about deep learning (research + software), music, generative models (personal account).
8K Followers 2K FollowingCTO of the MITRA project @BAIR, UC Berkeley. Research in ancient Asian low resource languages, with focus on machine translation and semantic search.
239K Followers 133 FollowingSmell commentator. Currently teaching at Cambridge. ‘One of those academic types who turn to books as a substitute for social interaction’. 🏳️🌈🦇🌱👃🏻📚
3K Followers 1 FollowingRecording daily paper notes by @chongzitazhang who is interested in robot learning and control, with special focus on legged robots.
///I'm picky///