Ayush Jain @ayushjain1144
RI PhD Student, CMU | MS in Robotics, CMU | B.E. CS, BITS Pilani | 🇮🇳 ayushjain1144.github.io Pittsburgh, PA Joined May 2018-
Tweets138
-
Followers227
-
Following798
-
Likes2K
Previous works on vision-language navigation agents require thousands of demos and an agent for each task/domain. Excited to share our follow-up HELPER-X: the first multi-domain agent (TEACh, ALFRED, Dialfred, Tidying Up) that can achieve SOTA performance with few examples. 1/n
Build what you need and use what you build. This is a core philosophy of my research. It shifts the focus away from publishing “papers” to what really matters — impact. This thread unpacks why I think this is a successful approach to science. 1/10 Or see: perceiving-systems.blog/en/post/build-…
There’s nothing like seeing a robot working at home for yourself. It has to move a variety of unusual objects, like the green cactus plushie in this video, and place them intelligently in a very messy world. So on that note, we're opening up OK Robot to the community! A thread:
3D representations are more critical than what we thought for manipulation. Our work 3D Diffuser Actor marries those with policy diffusion and achieves a new SOTA on both RLBench and CALVIN! 3d-diffuser-actor.github.io 🦾 with Tsung-Wei @TWAdaizai and Katerina @KaterinaFragiad
(re-)read it recently and I wonder if I would ever read a book better than this
"What advice would I give a starting graduate student interested in robot learning? Models! ... Model-free! ... Both!" Chris Atkeson, RSS workshop on Robotics Retrospective 2020
I'll be discussing this work tomorrow at @ml_collective at 1pm EST. Come by to discuss ideas on unifying 2D-3D modalities and scaling 3D learning with the help of 2D data mlcollective.org/dlct/
I'll be discussing this work tomorrow at @ml_collective at 1pm EST. Come by to discuss ideas on unifying 2D-3D modalities and scaling 3D learning with the help of 2D data mlcollective.org/dlct/
@ayushjain1144 @openreviewnet As for bringing down servers. Our community does have this nasty habit 😉
We noticed that self-supervised motion methods have sadly fallen behind supervised SOTA. Also, self-supervising an already-good model tends to make it worse! Our new paper fixes this: we start from SOTA, and use self-supervision to improve it. Not easy! arxiv.org/abs/2401.00850
Sreyas Venkataraman @sreyasv2002
3 Followers 94 FollowingHugo.f @hugo_fxy
42 Followers 3K Following Interested in AI and robotics, Embodied AI, 3D Scene Understanding, Object Manipulation. Computer Vision engineer @ a robotics companyTeresaBenedict @PN3h24I2AMmOX
4 Followers 431 FollowingClaraTony @zaSdmVfMMJiPd56
2 Followers 449 FollowingPhuc Nguyen Duc Anh @phucnda
26 Followers 108 Following I'm currently an AI Resident at @VinAI_ResearchAshwin Kandath @AshwinKandath
128 Followers 150 Following simple living, high thinking | policy, economics and data | @CarnegieMellon | @StStephensClgKludgy @kludgy
2 Followers 69 FollowingRivaMoll @Q9aI0kHu7IkFk7
8 Followers 445 FollowingKallol Saha @_ksaha
34 Followers 292 Following Incoming MSR Student at CMU RI this Fall (2024) Currently RA @ RRC, IIITHRudy Gilman @rgilman33
115 Followers 923 FollowingJayaram Reddy @Jayaram_Robot10
75 Followers 1K Following Masters Student at Robotics research centre @iiit_hyderabad. Interested in robot learning, long horizon planning and RL. Previously undergrad @iitmadrasLaura Liu @lauraqq
23 Followers 500 FollowingQitao Zhao @qitao_zhao
151 Followers 651 Following MSCV @CarnegieMellon. Interested in 3D computer vision.T @telugupbl
21 Followers 608 FollowingClock @Clock_Zh
48 Followers 422 FollowingKenneth Marino @Kenneth_Marino
706 Followers 454 Following Research Scientist at DeepMind, Machine Learning/Computer Vision researcherCMU Robotics Institut.. @CMU_Robotics
16K Followers 172 Following The Robotics Institute at Carnegie Mellon University has been leading the world in integrating robotic technologies into everyday life since 1979.Sinisa Stekovic @stekovic_sinisa
77 Followers 206 Following Trying to understand scenes in 3D @tugraz https://t.co/5RVzEvhJbwChongjie Ye @ychngji6
303 Followers 581 Following CUHK-Shenzhen MPhil Student, supervised by Prof. Xiaoguang Han. My research interests include Multi-view Reconstruction and Understandingfrat brat @frat0brat
434 Followers 5K FollowingBryn Balcombe @BrynBalcombe
427 Followers 4K FollowingRwik Rana @rwik_rana
24 Followers 346 Following incoming PhD @UTCompSci | @uw Robotics | @iitgn undergradliuyong @forrestbing
304 Followers 5K Following I am a researcher in AIGC, Multi-modality and VitrualHuman tech directionAnurag Ghosh @anuragxel
399 Followers 538 Following PhDing @CMU_Robotics. CS @iiit_hyderabad. ex-@MSFTResearch. Trying to bring Science Fiction to Real Life.Poorvi @Poorvi_rh
68 Followers 229 Following CV/Robotics @ Stealth Startup | MS Computer Vision @CMU | CSE @IIT BombayDan Grover @DanGrover
11K Followers 4K Following Product guy, now working on robotics + AI @ @standardbots. Prev. Meta, Tencent.Soham Sankaran @sohamsankaran
1K Followers 3K Following I run PopVax (@PopVaxIndia / https://t.co/tf4JsyJ4jo), an Indian mRNA vaccine co. working on an open-source pan-betacoronavirus booster to preempt new COVID-19 variants.Subhransu Mishra @subhransu_ro
47 Followers 1K Following Working on path, motion and mission planning for aerial robots and previously for small ground robots. Also love robot hardware design. Ph.D. Johns Hopkins.Surabhi Gupta @this_is_surabhi
553 Followers 2K Following prev robotics intern at @getpeppermint | alterok @_buildspace | 20 | electronics engineering undergrad | robotics enthusiastRoboDepot🤖 @RoboDepot
716 Followers 2K Following Your ultimate nexus for robotics, AI, ML, CV, research papers, small/DIY robots and other future tech showcases. Follow to see the robotics revolution!🔔Pierre Nagorny @a1rb4ck
415 Followers 5K Following Machine Learning @artanim_mocap #VR #animation #mocap. Happy with real-life optimization problems. @[email protected]Chris Paxton @chris_j_paxton
8K Followers 2K Following Mostly posting about robots. Embodied AI @hellorobotinc, formerly @AIatMeta, @NVIDIAAI, @zoox. All views my own.Martin Collignon @martincollignon
4K Followers 1K Following On a mission to unf*ck the planet, so mankind can thrive. Co-founder & CEO at @lun_energy , where we're decarbonising homes faster. 📞 +45 42 91 31 10Srujan Deolasee @sruj_d
116 Followers 703 Following MS Robotics @CMU_Robotics ‘25 | CS @bitspilaniindia '23Lei Ke @leike_lk
98 Followers 219 Following Postdoc at CMU @SCSatCMU @mldcmu; Previously at ETH & HKUST @eth_en @cvl_eth.Bhuvan Jhamb @robo2902
43 Followers 858 FollowingMateo Guaman Castro @mateoguaman
251 Followers 353 Following 🤖 · 🚵♂️ · 🎸 · 🇪🇨 PhD student @uwcse working on robot learning. Previously @AirLabCMU at @CMU_Robotics. I like biking long distances and playing the bass.Bhavik Chandna @bhavikchandna
4 Followers 111 Following Senior at @IITGuwahati || Intern @Forcepointsec, @Sydney_Uni, @LivUni || Interested in computer vision (2d/3d), explainability and generative ai.CMU School of Compute.. @SCSatCMU
47K Followers 784 Following The School of Computer Science at @carnegiemellon is one of the world's premier institutions for computer science research and education.Murtaza Dalal @ ICLR .. @mihdalal
672 Followers 386 Following Robotics/AI PhD student @CMU_Robotics | EECS B.S. @UCBerkeley | previously researcher @berkeley_ai | ex-intern @NVIDIAAI, @theteamatxMcNarete @McNaretenaBp
1 Followers 380 FollowingAlexander Swerdlow @alexjswerdlow
16 Followers 201 FollowingShercau @shercau33205
0 Followers 351 FollowingAshwin Kandath @AshwinKandath
128 Followers 150 Following simple living, high thinking | policy, economics and data | @CarnegieMellon | @StStephensClgKenneth Marino @Kenneth_Marino
706 Followers 454 Following Research Scientist at DeepMind, Machine Learning/Computer Vision researcherPoorvi @Poorvi_rh
68 Followers 229 Following CV/Robotics @ Stealth Startup | MS Computer Vision @CMU | CSE @IIT BombayAnurag Ghosh @anuragxel
399 Followers 538 Following PhDing @CMU_Robotics. CS @iiit_hyderabad. ex-@MSFTResearch. Trying to bring Science Fiction to Real Life.Lei Ke @leike_lk
98 Followers 219 Following Postdoc at CMU @SCSatCMU @mldcmu; Previously at ETH & HKUST @eth_en @cvl_eth.Friedrich Nietzsche |.. @QuoteNietzsche
106K Followers 9 Following Quotes by Friedrich Nietzsche | Philosopher | Writer | Poet ✍️ | Follow on IG 👉👉 https://t.co/yJ0J9yiSoxAlexander Swerdlow @alexjswerdlow
16 Followers 201 FollowingPrachi Garg @PrachiG68526104
110 Followers 313 Following Incoming CS Ph.D @UofIllinois | Masters Student @CMU_Robotics @CarnegieMellonAnish Madan @anishmadan23
348 Followers 2K Following MS @CMU_Robotics | Prev: Associate ML Scientist @WadhwaniAI | @IIITDelhi '20Francis Engelmann @FrancisEngelman
785 Followers 344 Following PostDoc @ETH - Visiting Researcher @Google - Fellow @ETH_AI_CenterAhmad Beirami ✈️ .. @abeirami
4K Followers 2K Following Building safe, helpful, and scalable generative AI @Google | ex-{@AIatMeta, @EA, @MIT, @Harvard, @DukeU} | @GeorgiaTech PhD | زن زندگی آزادی | opinions my ownMohit Sharma @m0hitsharma
253 Followers 221 Following PhD student at CMU. Robotics and Machine Learning.Georgia Chalvatzaki @GeorgiaChal
5K Followers 2K Following Professor @CS_TUDarmstadt, @hessian_AI, AI Emmy Noether @dfg_public, co-chair TC @MobileManip & co-chair WiE @ieeerasSarvjeet Ghotra @sarvjeet_ghotra
271 Followers 546 Following PhD at Mila/UdeM | Multi-modal DL | Prev.: Applied Scientist on Turing team at MicrosoftRishabh Agarwal @ ICL.. @agarwl_
6K Followers 554 Following Senior Research Scientist, @GoogleDeepMind, ex-🧠. Agents that make decisions. NeurIPS Best Paper (RLiable). Mila, IIT Bombay.Achleshwar Luthra @luthra_achal
190 Followers 415 Following Music, Coffee & Arxiv | Research Engineer @ Futurewei | CMU | BITS Pilani | Into 3D CV, AI, and anything that makes me curious.Ayça Takmaz @aycatakmaz
339 Followers 397 Following PhD student @ETH Zurich, Student Researcher @GoogleAINikhil Varma Keetha @Nik__V__
868 Followers 918 Following PhD in Robotics @CMU_Robotics @airlabcmu | Making Robots Temporally See the World🤖🌍👀 | Cook👨🍳 Gamer🎮 Movie Buff🎥Ziyang Chen @CzyangChen
115 Followers 238 Following Ph.D. Student at the University of Michigan - Ann ArborMayank Mishra @mmayank74567
143 Followers 321 Following MS in Robotics @ Carnegie Mellon University (@CMU_Robotics) | Previous: Research Assistant @ IISc, Bangalore (@val_iisc) | Robotics | Computer VisionIfigeneia Apostolopou.. @ifaposto
276 Followers 141 FollowingKanchana Ranasinghe @kahnchana
190 Followers 258 Following PhD student | Working on ML & CV | Former Apple Research Intern | Former Meta Research Intern | Google Student ResearcherItihasika | इति.. @itihasika
30K Followers 19 Following A team of award winning storytellers creating books, videos, courses & travel vlogs to help our next gen understand the world better. https://t.co/e2BiGvkQFaSiddharth Joshi @sjoshi804
993 Followers 2K Following @iclr_conf '24 | ML PhD at @UCLA under @baharanm | Data Curation for Efficient & Robust SSL | Prev @Cisco Research, @MicrosoftJagrit Digani @DiganiJagrit
553 Followers 22 Following ML Engineer at Apple Machine Learning ResearchNikos Gkanatsios @nikos_gkanats
27 Followers 63 Following Robotics PhD Student at Carnegie Mellon UniversityNishanth Kumar @nishanthkumar23
1K Followers 687 Following Robotics + AI PhD Student @MIT_LISLab @MIT_CSAIL, and the Boston Dynamics AI Institute. Formerly @brownbigai, @vicariousai and @uber. S.B @BrownUniversity.Ryohei Sasaki @rsasaki0109
5K Followers 147 Following Localization and mapping engineer at MAP IV (TIER IV Group)←Waseda University GNSS/LiDAR/IMU/SLAM/Autonomous Mobile Robotics/Autonomous DrivingViraj Prabhu @virprabh
509 Followers 532 Following Research Scientist at Salesforce AI. Georgia Tech PhD. Interested in all things computer vision / machine learning.Tarun Kalluri (On the.. @tarun_05
521 Followers 2K Following ML/CV PhD Candidate @UCSanDiego. Proud Indian 🇮🇳.Sanjeev Sharma @sanjeevs_iitr
5K Followers 16 Following Founder & CEO, Swaayatt Robot, Deep Eigen 51 Most Imapctful Smart Cities Leaders Award (Global Listing) 2019 Lived & Researched in: India, US, Israel & CanadaThe Struggling Scient.. @TheStrugglingS4
52K Followers 23K Following 🤩Science & PhD Life Podcast 🎙️Episodes 🤣PhD Memes 👕Science inspired Merch 📰PhD related BlogsBhagavad Gita 𑁍 @GitaShlokas
195K Followers 8 Following Daily New Srimad BhagavadGita Shlokas. Spiritual Posts. 🦚Aarush Gupta @c414driu5
162 Followers 273 Following ML @Snap. Prev. Robotics @CMU_Robotics | CS @iitroorkeeYihe Deng @Yihe__Deng
2K Followers 1K Following CS PhD student @UCLA | Prev. Applied Scientist Intern @AWS | LLM, Multi-modal learningSamskrita Bharati @samskritbharati
18K Followers 11 Following Official Twitter Handle of Samskrita BharatiBharath Hariharan @BharathHarihar3
230 Followers 69 Following Assistant Professor @ CS, Cornell University. Computer vision / ML researcherNihal Jain @Nihal_Jain_1
80 Followers 268 Following Applied Scientist, Amazon Q. Working on code generation with LLMs. Prev: ML @CarnegieMellonAndrei Bursuc @abursuc
7K Followers 1K Following Research scientist @valeoai | Teaching @Polytechnique @ENS_ULM | Alumni @upb1818 @Mines_Paris @Inria @ENS_ULMSayan Deb Sarkar @debsarkar_sayan
173 Followers 439 Following MSc CS @ETH | Ex - @Qualcomm_EU XR, @MercedesBenz | Multi-modal Scene UnderstandingNupur Kumari @nupurkmr9
170 Followers 263 Following Grad student @CarnegieMellon RI. Ex- ML researcher @AdobeIndia. Undergrad @IITDelhiJacky Liang @jackyliang42
4K Followers 736 Following Research Scientist @GoogleDeepMind working on foundation models for robotics. PhD @CMU_Robotics @iamlab_cmu. Prev. intern @NVIDIAAI. Writes @Last_Week_in_AIBen Eisner @BenAEisner
294 Followers 174 Following ML/Robotics Researcher. Ph.D. Student in Robotics at CMU. Learning for Manipulation.Im at @iclr_conf this week! Come catch me today, Weds at 11am at the @Apple booth if you want to chat about ML research. I will also be presenting 2 posters: arxiv.org/abs/2310.08587 Weds 4:30pm and arxiv.org/abs/2305.15586 Thu 4:30 pm! Come say hi!
BITS Pilani alumni Sid Mookerji Anuradha & Prashanth Palakurthi, and Chaitanya Kalipatnapu have pledged $1 million each to the BITS Endowment Fund, totaling recent commitments to $3 million. Prashanth Palakurthi, a technology entrepreneur, and Anuradha, his wife, previously…
I saw a meme that said India doesn’t need to elect a prime minister in 2024, it needs to be single for a while to find itself and heal and that has been the best political analysis I’ve read of late
[1/7] A long standing goal in manipulation is to have generalizable agents that can act zero-shot (i.e. work out-of-the-box across generic goals). Our work Track2Act (homangab.github.io/track2act/) achieves this by combining track prediction with a common goal-conditioned policy.
Met people who are taking their *vacations* by coming to @iclr_conf. If research is like that to you, you should feel really good about yourself. ✨ And I feel good about myself because this person is in @ml_collective 🪩☺️
(1/N) How can we get robots to make precise placement predictions when solving rearrangement tasks, just by watching demonstrations? In our ICLR 2024 paper, “Deep SE(3)-Equivariant Geometric Reasoning for Precise Placement Tasks”, we do just that! Paper: arxiv.org/abs/2404.13478
There was a bit of confusing back and forth between myself and @ylecun recently, because in the tweet below, 'it' was referencing DistBelief, but @ylecun thought DistBelief referred to the ICML 2012 "cat detector" paper (icml.cc/2012/papers/73…), not to the training system called…
@deliprao @karpathy @AndrewYNg @JeffDean It was a dead end. It couldn't do supervised ConvNets efficiently.
This is one of the finest victories of an Indian Athlete! Congratulations @manikabatra_TT 🏓🏓
Great victory! India's Table Tennis Star Player Manika Batra knocked out the World No. 2 Chinese Wang Manyu in Round-32 at prestigious #SaudiSmash Well done @manikabatra_TT 🏓🏓
I’ll be at ICLR’24 in Vienna this week! If you are interested in connecting about about our latest Phi3 release (arxiv.org/pdf/2404.14219) and learning more what's next, please feel free to reach out to me on Linkedin or drop by the Microsoft booth.
Like all of you, I also enjoyed seeing myself dance. 😀😀😀 Such creativity in peak poll season is truly a delight! #PollHumour
Posting this video cuz I know that 'THE DICTATOR' is not going to get me arrested for this.
Drop by in 📍Poster Hall B on 🗓️ Wed 8 May 10:45 am onwards and say hi 👋to know more about our two posters 👇
LLMs are capable of high-level planning, but they require pre-trained skills! Our #ICLR2024 paper instead uses LLM guidance to train RL agents from scratch to solve 25+ long-horizon robotics tasks across four benchmarks w/ >85% success rates Paper & code: mihdalal.github.io/planseqlearn
Previous works on vision-language navigation agents require thousands of demos and an agent for each task/domain. Excited to share our follow-up HELPER-X: the first multi-domain agent (TEACh, ALFRED, Dialfred, Tidying Up) that can achieve SOTA performance with few examples. 1/n
Even if your parents have nothing to give you. What you inherit is their music. Their songs. On a cold winter morning, riding pillion, with your hands wrapped around your dad, as he rides his scooter to drop you school, coz you missed the bus, in that moment, the song he hums,…
hmmm hmmm ... What a collection !! How many Kishore Kumar songs ??
A mother gives her daughter an unforgettable moment in her life. A wonderful moment!
My wife graduated her first PhD student last weekend!
We had so much fun celebrating all of our SCI graduates last week! 🎓 We’re so proud of all you accomplished. Welcome to the Pitt alumni family! 💙 #H2P @PittDINS @ISPPitt @PittCompSci
@Parskatt You will run into issues with any rotation representation (e.g., row- vs. column-major for matrices). The important thing is documentation: rotation representation (including memory layout), direction of transformation, definition of coordinate systems (vision vs. graphics), etc.