FRIDA Robot Painter @FridaRobot

A robot painting project from the Bot Intelligence Group at CMU's Robotics Institute. Researchers: @PeteyRobots James McCann @JeanOhCMUBig cs.cmu.edu/~jeanoh/big/ Pittsburgh, PA Joined August 2022

Tweets

48
Followers

194
Following

60
Likes

112

Jean Oh @jeanoh

6 months ago

IEEE RAMagazine welcomes articles for the Special Issue on the Arts and Robotics: ieee-ras.org/publications/r…

0 1 5 165 1

@vernon_luk @jeanoh Check out our website, paper, or code to learn more: website: rewarped.github.io paper: arxiv.org/abs/2412.12089 code: github.com/rewarped/rewar… All of our code, simulation environments & algorithms, is open source and available now: 𝐩𝐢𝐩 𝐢𝐧𝐬𝐭𝐚𝐥𝐥 𝐫𝐞𝐰𝐚𝐫𝐩𝐞𝐝 7/7

1 4 18 1K 9

Eliot Xing @etaoxing

6 months ago

This was a wonderful collaboration over last year with @vernon_luk, @jeanoh. And it would not have been possible without the amazing open source effort by the NVIDIA Warp team. 6/n

1 2 5 956 0

Eliot Xing @etaoxing

6 months ago

We show that SAPO can learn a range of challenging manipulation and locomotion tasks, re-implemented in Rewarped, that involve interaction between rigid bodies, articulations, and deformables. SAPO beats model-free RL (PPO, SAC) as well as prior first-order RL (APG, SHAC). 5/n

1 2 6 858 1

Download Image

Eliot Xing @etaoxing

6 months ago

SAPO (Soft Analytic Policy Optimization): maximum entropy first-order RL algorithm that uses analytic gradients from diff. sim to train a stochastic actor to maximize expected return and entropy. Why MaxEnt RL? Smoother optimization landscapes stabilize first-order RL. 4/n

1 2 6 975 2

Download Image

Eliot Xing @etaoxing

6 months ago

Rewarped: parallel differentiable multiphysics simulation platform that supports simulating various materials beyond just rigid bodies. Another simulator? Re-write tasks in Rewarped and scale first-order RL on tasks involving rigid and soft body interaction. 3/n

1 3 11 1K 1

Download Video

Eliot Xing @etaoxing

6 months ago

Model-free RL is too sample inefficient to scale on slow soft body simulation. Prior first-order RL algorithms work on rigid body locomotion, but fail to solve soft body manipulation. No existing simulator satisfies all: (1) parallel envs (2) differentiable (3) multiphysics. 2/n

1 2 8 1K 1

Eliot Xing @etaoxing

6 months ago

RL is notoriously sample inefficient. How can we scale RL on tasks much slower to simulate than rigid body physics, such as soft bodies? In our #ICLR2025 spotlight, we introduce both a new first-order RL algorithm, SAPO, and differentiable simulation platform, Rewarped. 1/n

8 64 357 32K 214

Download Video

Jean Oh @jeanoh

7 months ago

Happy Valentine's Day from BIG

0 3 10 382 0

Download Video

Yunchao Yao @YaoYunchao

10 months ago

Can soft robots rapidly spin pens like humans?🤔 We’ve shown that soft robot hands can master the dynamic tasks of pen spinning—no hours of GPU training or complex sim-to-real needed! Check out soft-spin.github.io. 🤖✍️ @CMU_Robotics. 1/5🧵

1 8 32 2K 8

Download Video

FRIDA Robot Painter @FridaRobot

11 months ago

Our paper, Robot Synesthesia: a sound and emotion guided robot painter, won the IROS Best Entertainment and Amusement Paper Award! Congrats, Vihaan Misra and Peter Schaldenbrand @PeteyRobots #cmubig #IROS #IROS2024

0 0 5 86 0

Download Image

Peter Schaldenbrand @PeteyRobots

11 months ago

Tune in to see some special footage of @Ken_Goldberg working on his painting robot!

0 2 18 2K 2

Download Video

Peter Schaldenbrand @PeteyRobots

11 months ago

This video was created with @gchenfc @vihaan_misra Lorie Chen @Ken_Goldberg and @JeanOhCmuBIG Presented at @ieee_ras_icra ICRA@40

1 2 5 345 0

Download Image

Peter Schaldenbrand @PeteyRobots

11 months ago

Our ICRA@40 video shows some of the history of robot painting projects, the challenges these roboticists faced, and how they made core contributions to the field of Robotics. It doesn't have to be Robotics for Arts, it can be Arts for Robotics! youtu.be/M3D9cWNf7r0?si…

2 1 15 2K 1

FRIDA Robot Painter @FridaRobot

11 months ago

FRIDA on WPXI Channel 11 news wpxi.com/news/local/mee…

0 0 5 68 0

Peter Schaldenbrand @PeteyRobots

a year ago

Our collaborative painting paper, CoFRIDA, has been nominated for Best Paper on Human-Robot Interaction at #ICRA2024 We're also doing a demo on Thursday 5/16 at the ICRA Expo if you'd like to try it for yourself! pschaldenbrand.github.io/cofrida/ @ieee_ras_icra

4 9 52 4K 9

Download Video

Jean Oh @jeanoh

a year ago

We are thrilled to announce the NeurIPS 2024 Creative AI track! We invite research papers and artworks showcasing innovative work of AI and ML in art, design, and creativity. This year's theme is "Ambiguity." For more information: neurips.cc/Conferences/20… #neurips2024 #CreativeAI

1 4 8 1K 1

Jean Oh @jeanoh

a year ago

FRIDA@Amazon MARS 2024 @PeteyRobots @FridaRobot @UksangYoo

0 3 8 418 0

Download Image

Peter Schaldenbrand @PeteyRobots

2 years ago

@ieee_ras_icra @CMUBigLab @GauravTParmar @junyanz89 @1x @JeanOhCmuBIG A pre-print of our ICRA paper can be read here: arxiv.org/abs/2402.13442 More results on our website: pschaldenbrand.github.io/cofrida/

0 1 1 206 0

Download Video

Peter Schaldenbrand @PeteyRobots

2 years ago

@ieee_ras_icra @CMUBigLab @GauravTParmar @junyanz89 @1x @JeanOhCmuBIG Humans can draw and paint as they'd like. They give language descriptions on how they would like the drawing/painting to look, and the robot figures out how to make that happen.