Matthieu LC @matthieulc

robots and llms / prev built typeless to make doctors happy, acq by @Doctolib matthieulc.com Joined January 2013

Tweets

150
Followers

1K
Following

1K
Likes

970

Matthieu LC @matthieulc

a week ago

Please give this new model a try, it is so so good!

Peter Bakkum @pbbakkum

a week ago

Please give this new model a try, it is so so good!

30 46 416 66K 175

Download Video

7 3 28 5K 4

Matthieu LC @matthieulc

2 months ago

wrapped up the blogpost and code for the shoggoth mini project! will release everything tomorrow 👀

2 0 8 1K 1

Matthieu LC @matthieulc

2 months ago

i've been working on a blogpost about the project these past few days, hopefully released by the end of the week! here's a cute animation of the system design

0 0 25 1K 3

Download Gif

Matthieu LC @matthieulc

2 months ago

just found out the white in human eyes is adaptive as the contrast makes gaze direction obvious, which helps in communicating intent much better than other animals sciencedirect.com/science/articl…

1 0 3 643 0

Matthieu LC @matthieulc

2 months ago

in dexterity tests, shoggoth mini reveals strong passive grasping generalization

4 6 87 11K 7

Download Video

played around with action smoothing due to control instabilities in the PPO policy. see how the raw predicted action diverges as it goes OOD. happy to find that exponential moving average is extremely effective here!

0 0 14 666 0

Download Video

Luke Darlow @LearningLukeD

2 months ago

Learning where to look, learning what to see. Work on Continuous Thought Machines continues to be exciting! As a teaser, take a look at our approach to "Foveated Active Vision". Check it out 👇 (details in the thread) pub.sakana.ai/ctm

18 129 871 61K 533

Download Video

Matthieu LC @matthieulc

2 months ago

approaching the end of v1 here :) worked on some new primitives, and integrating them all together. making the gpt4o realtime api consistent in its use of the primitives was harder than i thought. i will now start writing the blogpost and cleaning the vibecode a bit for…

10 11 162 9K 29

Download Video

Matthieu LC @matthieulc

3 months ago

worked on having gpt4o drive open-loop motor primitives like waving or grabbing from stereo vision. special tokens like <distance: 10cm> get streamed straight into the transcript stream, which gpt4o reacts too. next up is integrating the closed-loop hand tracking. main challenge…

94 163 2K 2.5M 540

Download Video

Mustafa Shukor @MustafaShukor1

3 months ago

The Worldwide @LeRobotHF hackathon is in 2 weeks, and we have been cooking something for you… Introducing SmolVLA, a Vision-Language-Action model with light-weight architecture, pretrained on community datasets, with an asynchronous inference stack, to control robots🧵

6 81 439 83K 294

Download Image

Matthieu LC @matthieulc

3 months ago

sim2real achieved! mini shoggoth can now (slowly) track hands. to what purpose i do not yet know stack is PPO + mujoco + dynamics randomization + yolo11n