Kevin Frans @kvfrans
@berkeley_ai prev mit, read my thoughts: https://t.co/7CZsOTsiH8 kvfrans.com Cambridge, MA Joined August 2013-
Tweets394
-
Followers2K
-
Following420
-
Likes561
Our computer vision textbook is released! Foundations of Computer Vision with Antonio Torralba and Bill Freeman mitpress.mit.edu/9780262048972/… It’s been in the works for >10 years. Covers everything from linear filters and camera optics to diffusion models and radiance fields. 1/4
Gave a lecture on Diffusion Models yesterday with @wilson1yan and @kvfrans youtu.be/DsEDMjdxOv4?si… Thanks to it being Lecture 6 into the semester (rather than Lecture 1), we could even include Sora, Mobile Diffusion, SDXL-Lightning :)
Excited to share LAnguage Reward Modulation for Pretraining Reinforcement Learning! LAMP💡pretrains a language-conditioned agent without human supervision using VLM rewards and unsupervised reinforcement learning w/ @amberxie_ @carlo_sferrazza @younggyoseo @stepjamUK @pabbeel
I explored some simple implementations of generative models. Conclusions: VAE and Diffusion work pretty well, GANs and PixelRNN are tricky. kvfrans.com/a-brief-examin…
Presenting Powderworld at #ICLR2023 today! Check us out at 3:30 in AD10 for the oral talk, and 4:30-6:30 for poster sessions. Since the original release, we've added agent-like elements, 40+ unique RL tasks, and more! w/ @phillip_isola
Presenting Powderworld at #ICLR2023 today! Check us out at 3:30 in AD10 for the oral talk, and 4:30-6:30 for poster sessions. Since the original release, we've added agent-like elements, 40+ unique RL tasks, and more! w/ @phillip_isola https://t.co/7rA0cBtZAK
excited to share I will be starting my PhD this fall at @berkeley_ai advised by @pabbeel ! looking forward to working with some amazing people. and, a giant thanks to all of you who have been supporting me so far :)
Goal-reaching / instruction-following is a major driver of new AI advances (LLM as general task solver, controlled generation). The revolution will not be single-task. Our newest work is all about the *geometric* structure emerging in multi-task RL: tongzhouwang.info/quasimetric_rl 1/n
🧵You have a PyTorch model, an environment, and an RL framework. They should work together but don't. Today, I'm releasing PufferLib, a toolkit that makes them play nice. Initial support for CleanRL and RLlib. pufferai.github.io
AK @_akhaliq
310K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo follow on Hugging Face: https://t.co/q2Qoey80GxJim Fan @DrJimFan
229K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.Eric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0pJulian Togelius @togelius
18K Followers 1K Following AI and games researcher. Associate professor at NYU; director of @NYUGameLab; co-founder of https://t.co/FnakJLkAXW.Sebastian Risi @risi1979
8K Followers 1K Following Professor @ ITU Copenhagen. Co-founder @ https://t.co/EeVHNpBENS. Collective Intelligence | Self-Organizing AI | Artificial Life | Neuroevolution. ERC GROW-AI.Eugene Vinitsky @EugeneVinitsky
13K Followers 2K Following Anti-cynic. Artificial narrow intelligence. Autonomous vehicles, multi-agent learning, and transportation. RS at Apple, Asst. Prof at @nyutandon. He/him.Shane Gu @shaneguML
28K Followers 1K Following Research Scientist & Manager @GoogleDeepMind Tokyo/MTV. ex: @GoogleAI Brain, @OpenAI. (JP: @shanegJP)Lana Sinapayen @sina_lana
4K Followers 1K Following Dead account. Find me on mastodon @[email protected] @sinalana.bsky.socialDanijar Hafner @danijarh
14K Followers 869 Following Building AI that makes autonomous decisions using world models, artificial curiosity, and temporal abstraction @DeepMindAlex Mordvintsev @zzznah
16K Followers 2K Following Mad Scientist, DeepDream creator. Designing Self-Organising Systems and Programmable Artificial Life. https://t.co/rntipHzHW3Phillip Isola @phillip_isola
13K Followers 156 Following Associate Professor in EECS at MIT, trying to understand the science of intelligence.Bert Chan @BertChakovsky
5K Followers 773 Following Artificial life researcher @GoogleDeepMind (formerly Brain). Hongkonger. Neurodiversity is biodiversity.Tim Rocktäschel @_rockt
29K Followers 1K Following Open-Endedness Team Lead @GoogleDeepMind, Professor of AI @AI_UCL, PI @UCL_DARK, @ELLISforEurope Scholar. ex @MetaAI (FAIR), @CompSciOxford. Opinions my own.Justin Pinkney @Buntworthy
10K Followers 1K Following Playing with deep learning, computer vision and generative art. Co-creator of https://t.co/sYtHB9e5Dj, ML Researcher @ MidJourney @[email protected]Jack Clark @jackclarkSF
68K Followers 5K Following @AnthropicAI, ONEAI OECD, co-chair @indexingai, writer @ https://t.co/3vmtHYkaTu Past: @openai, @business @theregister. Neural nets, distributed systems, weird futuresJoshua Achiam ⚗️ @jachiam0
14K Followers 948 Following Human. Trying to make safe alchemy machines. Thinking about humanist alchemism (h/alc ⚗️, maybe). Main author of https://t.co/cKuSh210l1Kenneth Stanley @kenneth0stanley
12K Followers 879 Following Maven: https://t.co/9Fd4Qh4aKt Prev: Team Lead @OpenAI, Uber AI, prof@UCF. NEAT,HyperNEAT,novelty search, POET. Book:Why Greatness Cannot Be PlannedJakob Foerster @j_foerst
14K Followers 820 Following Assoc. Prof in ML @UniofOxford @StAnnesCollege @FLAIR_Ox, dad. Ex: {RS @MetaAI, (A)PM @Google, DivStrat @GS}, ex intern {@GoogleDeepmind, @GoogleBrain, @OpenAI}Janhavee Shinde @SJanhavee
58 Followers 2K FollowingPavel Kolev @pavelkolevbg
55 Followers 227 Following Postdoc @ Max Planck Institute for Intelligent Systems | Reinforcement Learning | Optimization | Information TheorySocratique @_Socratique
18 Followers 69 FollowingPensé FFun @inftyCategory
100 Followers 6K FollowingTomas Reimers @TomasReimers
651 Followers 986 Following Co-founder @withgraphite; prev. frontend frameworks @facebook.✦✦✦ @not_infinite___
35 Followers 346 FollowingPinyao Liu @PinyaoL
29 Followers 195 FollowingHazel13 @Hazel131772970
5 Followers 991 FollowingJovan Sardinha @JovanSardinha
356 Followers 3K Following Machine Learning @Reddit. Ex-@Quora, @UofT 🇨🇦 jovan.sardinha__at__gmail.comPion Star @PionStar99
196 Followers 317 Following a PION STAR. Strange attractor made of strange matter. Reborn after I exploded in a supernova, BUT ULTRA-UNSTABLEKatherine Xu @KateYXu
168 Followers 921 Following @Penn PhD student • @MIT CS '22 🤺 • computer vision + generative AIYohan Frans @YohanFrans19745
0 Followers 2 FollowingJack W @creatiestuff
0 Followers 262 Followingdaniel leo @doubletao
0 Followers 766 Followingyukuan lu @Yukuan_Lu
2 Followers 41 FollowingKris Pan @KrisKPan
47 Followers 406 Following ML Engineer @intel with experience in #NLProc and #MLops. My tweets do not represent my employer.Arif Ahmad @arif_ahmad_py
276 Followers 7K Following All things AI, Computer Science and Circuits! Prev. @GoogleAIRamneet Singh @Ramneet_Singhh
482 Followers 3K Following Visiting Researcher @gatech_scs | Senior Undergraduate in CS at IIT Delhi | Research in PL+ML | Learning Category Theory | Sports + Music + Food (in that order)Sai Prasanna @sai_prasanna
746 Followers 2K Following 🤖 = 42 Following the gradient of interestingness. @saiborg.bsky.socialzy_zhao @zhao_zy44927
35 Followers 62 FollowingCuong (Johnny) Nguyen @johnny_ckmjx
116 Followers 408 Following 🇻🇳 PhD in NLP/HCI at @ICatGT! BS in Computer Science at @GTComputing. Researcher in Social Computing, Social NLP & LLMsSaahith @saahithjanapati
42 Followers 1K FollowingRohit Singh @RohitSi79044113
1 Followers 19 FollowingCharles @JamesSimon16428
0 Followers 182 FollowingMark @Rybchuk
58 Followers 190 Following Undergrad at Berkeley Reasoning enthusiast Information omnivoreGyuBin Lee @gyubin0521
73 Followers 2K FollowingYunshuang_Li @YunshuangL
70 Followers 148 Following Incoming CS PhD@USC | Robotics MS@GRASP Lab, Upenn | BS@Chu Kochen College, Zhejiang Universityfeiyu @BathtubSurfer2
20 Followers 45 Followingdichen @chendi23
25 Followers 121 FollowingRakib Islam @jahin114
176 Followers 778 Following Drug Discovery @MDAndersonNews, Ex-Research Scientist @facebook, PhD from @WSUPullman, worked on Machine Learning, Anomaly detection, @escenic and @samsungZeng Yuwei @pluviophile16
0 Followers 248 FollowingAndrej Karpathy @karpathy
979K Followers 905 Following 🧑🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥Yann LeCun @ylecun
712K Followers 719 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.Google DeepMind @GoogleDeepMind
944K Followers 275 Following We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.Eric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0pJulian Togelius @togelius
18K Followers 1K Following AI and games researcher. Associate professor at NYU; director of @NYUGameLab; co-founder of https://t.co/FnakJLkAXW.Sebastian Risi @risi1979
8K Followers 1K Following Professor @ ITU Copenhagen. Co-founder @ https://t.co/EeVHNpBENS. Collective Intelligence | Self-Organizing AI | Artificial Life | Neuroevolution. ERC GROW-AI.Eugene Vinitsky @EugeneVinitsky
13K Followers 2K Following Anti-cynic. Artificial narrow intelligence. Autonomous vehicles, multi-agent learning, and transportation. RS at Apple, Asst. Prof at @nyutandon. He/him.Shane Gu @shaneguML
28K Followers 1K Following Research Scientist & Manager @GoogleDeepMind Tokyo/MTV. ex: @GoogleAI Brain, @OpenAI. (JP: @shanegJP)Sergey Levine @svlevine
80K Followers 122 Following Associate Professor at UC Berkeley Co-founder, Physical IntelligenceLana Sinapayen @sina_lana
4K Followers 1K Following Dead account. Find me on mastodon @[email protected] @sinalana.bsky.socialDanijar Hafner @danijarh
14K Followers 869 Following Building AI that makes autonomous decisions using world models, artificial curiosity, and temporal abstraction @DeepMindAlex Mordvintsev @zzznah
16K Followers 2K Following Mad Scientist, DeepDream creator. Designing Self-Organising Systems and Programmable Artificial Life. https://t.co/rntipHzHW3Natasha Jaques @natashajaques
25K Followers 1K Following Senior Research Scientist at @GoogleAI and Assistant Professor @uwcse. Social Reinforcement Learning in multi-agent and human-AI interactions. PhD from @MIT.Phillip Isola @phillip_isola
13K Followers 156 Following Associate Professor in EECS at MIT, trying to understand the science of intelligence.Bert Chan @BertChakovsky
5K Followers 773 Following Artificial life researcher @GoogleDeepMind (formerly Brain). Hongkonger. Neurodiversity is biodiversity.Tim Rocktäschel @_rockt
29K Followers 1K Following Open-Endedness Team Lead @GoogleDeepMind, Professor of AI @AI_UCL, PI @UCL_DARK, @ELLISforEurope Scholar. ex @MetaAI (FAIR), @CompSciOxford. Opinions my own.Rivers Have Wings @RiversHaveWings
31K Followers 224 Following AI/generative artist. Writes her own code. Absolute power is a door into dreaming.Bam4d @Bam4d
2K Followers 1K Following AI Scientist at https://t.co/SUcb0CBcb7. PhD in AI. Opinions are streamed 1 token at a time. ex. @MetaAI @modl_aiChuan Wen @ChuanWen15
133 Followers 150 Following PhD student @Tsinghua_IIIS. Visitor @berkeley_ai w/ @pabbeel .Karl Pertsch @KarlPertsch
1K Followers 206 Following Robot Foundation Models @ UC Berkeley & Stanford | Postdoc w/ Sergey Levine & Chelsea Finn | Prev. Intern @ Google Brain, Meta AI | PhD @ USC.Jyothir S V @jyothir_s_v
84 Followers 231 Following Researcher at @NYU under @ylecun. FOSS Contributor, IITian. Musing on AI, Future.Cristina Pinneri @CristinaPinneri
219 Followers 99 Following « And this gray spirit yearning in desire To follow knowledge like a sinking star, Beyond the utmost bound of human thought. »Lerrel Pinto @LerrelPinto
5K Followers 181 Following Assistant Professor of CS @nyuniversity. I like robots!Oier Mees @oier_mees
1K Followers 224 Following Postdoc at @berkeley_ai. PhD @UniFreiburg. Prev. intern @NVIDIAAI. Research on robotics, language, computer vision, MLEllis Brown @_ellisbrown
357 Followers 939 Following CS PhD Student @NYU_Courant | Prev: @CarnegieMellon, https://t.co/EkTzprGc4i, @VanderbiltUZhao-Heng Yin @zhaohengyin
90 Followers 223 Following Computer Science PhD student @UCBerkeley BAIR @Berkeley_AI. Make Robots Work.Younggyo Seo @younggyoseo
588 Followers 584 Following Research Scientist @Dyson Robot Learning Lab / Prev: Ph.D @ KAIST w/@jinwoos0417, Visitor @ UC Berkeley w/@pabbeelStephen James @stepjamUK
4K Followers 177 Following Leading the @Dyson Robot Learning Lab. Postdoc @UCBerkeley w/ @pabbeel. PhD Imperial College London w/ @ajdDavison. AI, Robotics, Machine Learning 🤖Kuan Fang @KuanFang
2K Followers 663 Following Incoming Assistant Professor at Cornell CS (Fall 2024) | Postdoc at UC Berkeley & Researcher at Boston Dynamics AI Institute | Previously PhD at StanfordAmy Lu @amyxlu
2K Followers 1K Following CS PhD student @berkeley_ai, AI for drug discovery @PrescientDesign. Prev: @GoogleAI @insitro @UofT 🇨🇦Alex Nichol @unixpickle
8K Followers 389 Following Code, AI, and 3D printing. Opinions are my own, not my computer's...for now. Husband of @thesamnichol. Co-creator of DALL-E 2. Researcher @openai.Dylan HadfieldMenell @dhadfieldmenell
2K Followers 2K Following Assistant Prof @MITEECS working on value (mis)alignment in AI systems; @[email protected] @[email protected] he/himBoyuan Chen @BoyuanChen0
2K Followers 277 Following PhD student @MIT_CSAIL @MITEECS, Ex @GoogleDeepMind, @berkeley_ai; Doing AI & Robotics. Foundational model for decision making. World models and robotics.Xingyu Lin @Xingyu2017
1K Followers 335 Following Postdoc at @berkeley_ai. PhD from @SCSatCMU. #Learning #RoboticsWilson Yan @wilson1yan
450 Followers 162 Following PhD student @berkeley_ai. Interested in generative modelsAmy Zhang @yayitsamyzhang
4K Followers 387 Following ECE prof. at UT Austin. Works in state abstractions and generalization in RL.Ofir Nachum @ofirnachum
4K Followers 343 Following Research at @OpenAI. Previously at @GoogleAI on the Brain Team. Doing work on #ReinforcementLearning and #MachineLearningJitendra MALIK @JitendraMalikCV
4K Followers 0 FollowingAngjoo Kanazawa @akanazawa
14K Followers 627 Following Assist. Professor at @Berkeley_EECS, @berkeley_ai. KAIR, @nerfstudioteam, advising @WonderDynamics and @LumaLabsAI. she/her.Aviral Kumar @aviral_kumar2
2K Followers 338 Following Research Scientist at Google DeepMind. Incoming Assistant Professor of CS & ML at CMU (Fall 2024). PhD from UC Berkeley.Seyone Chithrananda @SeyoneC
2K Followers 3K Following 🇨🇦 in SF | cs/bioe @ucberkeley, sidequesting @BerkeleyML | learning @doudna_lab | prev: @MSFTResearch, @dyno_txJohn So @johnrso_
363 Followers 380 Following robots @1x_tech, @stanford | prev @berkeley_ai, prez @BerkeleyML, @accel scholarsAnca Dragan @ancadianadragan
8K Followers 178 Following AI safety & alignment at Google DeepMind • associate professor at UC Berkeley EECS • proud mom of an amazing 2yr oldHuazhe Harry Xu @HarryXu12
2K Followers 895 Following Hi, I like reinforcement learning, robots, and video games:) I am an amateur pianist. Assistant Prof at Tsinghua; Postdoc at Stanford; Ph.D. at BerkeleySeohong Park @seohong_park
727 Followers 363 Following Reinforcement Learning | CS Ph.D. Student @berkeley_aiKevin Black @kvablack
373 Followers 73 Following phd @berkeley_ai, deep reinforcement learning + roboticsAdemi Adeniji @AdemiAdeniji
385 Followers 180 Following PhD @UCBerkeley. Prev @NVIDIAAI, @Stanford '21. Reinforcement Learning, Robot Learning, Behavior Foundation Models.Haoyu Xiong @Haoyu_Xiong_
2K Followers 2K Following Grad student researcher @CMU_Robotics/ I work on robotic agents in the real world #robotlearningAlejandro Escontrela @alescontrela
841 Followers 344 Following PhD Student @ UC Berkeley | Formerly Google DeepMindHarry Zhang @HarryZhangOG
422 Followers 298 Following PhD student @MIT Quant Researcher. Prev. @CMU_Robotics @berkeley_aiNicklas Hansen @ncklashansen
2K Followers 590 Following PhD student @UCSanDiego. @nvidia fellow. Prev: @MetaAI, @UCBerkeley, @DTU_Compute, @NTUsg. Interested in reinforcement learning, representations, and robots.Alon Albalak @AlbalakAlon
887 Followers 465 Following CS PhD candidate at @ucsbNLP. Research: Data-centric AI, Efficiency in ML, NLP.Kimin @kimin_le2
1K Followers 330 Following Assistant professor at KAIST. Prev: Research scientist @GoogleAI, Postdoc @berkeley_ai & Ph.D at KAIST.Dibya Ghosh @its_dibya
1K Followers 392 Following I do RL research @UCBerkeley | Previously @ Google Brain MontrealMitsuhiko Nakamoto @mitsuhiko_nm
350 Followers 260 Following PhD student at UC Berkeley @berkeley_aiMichael Nielsen @michael_nielsen
96K Followers 6K Following Searching for the numinous 🇦🇺 🇨🇦, home in 🇺🇸 Research @AsteraInstitute https://t.co/maezekzRUbEva Yi Xie @EvaYiXie
161 Followers 162 Following ug @MIT ‘24 @MIT_CBMM. 🔜 Incoming PhD student in Neuroscience @PrincetonNeuro. Incoming summer intern @AllenInstituteStephanie Fu @xkungfu
438 Followers 185 Following PhD student @berkeley_ai | studying computer vision and intelligence | Previous: B.S. M.Eng, CS + Music @MITa new blog post, because it is Saturday. <Fixing DPO but I have a dinner reservation …> kyunghyuncho.me/a-proper-prefe…
A fun short lecture on parallelization for training large models: youtu.be/Hr2FWHBuNXs by @wilson1yan and @haoliuhl
Our computer vision textbook is released! Foundations of Computer Vision with Antonio Torralba and Bill Freeman mitpress.mit.edu/9780262048972/… It’s been in the works for >10 years. Covers everything from linear filters and camera optics to diffusion models and radiance fields. 1/4
My time visiting Berkeley is coming to an end. Many thanks to Prof. Pieter Abbeel @pabbeel and Xingyu @Xingyu2017 for your guidance. Grateful to every member of RLL; your companionship and friendship are my most precious memories. Wishing you all the best for the future!
Lots of fun discussions about CS, research and life here and back home ❤️
Roamed around SF with @Cinnabar233 today!
Can LLMs ace LeetCode? 😱 Can LLMs repair, execute, and predict test outputs? 😲 🏖️🤖🏋️Introducing LiveCodeBench - holistic - contamination-free - four code tasks - easy, med, hard splits ❌LLMs CANNOT do LeetCode! The best model gets ~6% on LCB-hard 💻livecodebench.github.io
📢📢Excited to introduce our new work LiveCodeBench! 📈 Live evaluations to ensure fairness and reliability 🔍 Holistic evaluations using 4 code-related scenarios 💡Insights from comparing 20+ code models 🚨🚨We use problem release dates to detect and prevent contamination
Very excited to share what our research team at Covariant has been working on: RFM-1, our latest Robotics Foundation Model. Built on top of high-quality multimodal data the Covariant robotics fleet has collected over the years, this project embodies our commitment to pushing the…
Excited to share my recent research, SELFI about RL in UC Berkeley and Toyota Motor North America. Our self-improving RL, SELFI fine-tunes the pre-trained model-based control policy by model-free RL. @shahdhruv_ @KyleStachowicz @ajaysridhar0 and @svlevine
Functional reward encodings (FRE) provide a general way to train universal policies: the policy is conditioned on an embedding of functions and trained on a large randomized distribution of rewards. It can then generalize to new reward functions! kvfrans.com/fre/ Thread👇
FRE is perhaps the most flexible and general way to pre-train diverse policies from unlabeled data. The key idea is very simple: encode the reward *function* itself 🙂 Check out Kevin’s thread!
Functional Reward Encodings (FRE) provide a simple, unsupervised approach to offline zero-shot RL: 1. Learn a robust latent space of reward functions, then 2. Train a generalist agent on *random functions*, such that new tasks naturally map to solutions. kvfrans.com/fre/
How can we train LLM Agents, to learn from their own experience autonomously? Introducing ArCHer, a simple (i.e., small change on top of standard RLHF) and effective way of doing so with multi-turn RL 🧵⬇️ Paper: arxiv.org/abs/2402.19446 Website: yifeizhou02.github.io/archer.io/
Hilbert foundation policies (HILPs) provide a way to train general-purpose policies in an unsupervised way from offline data: analyze a dataset of trajectories, learn a metric space of behaviors, and then solve new tasks in zero- or few-shot! seohong.me/projects/hilp/ A thread 👇
Are game engines world simulators? Given a mesh+texture, a game can render a beautiful depiction of tree bark. But, typically, it doesn't model how the bark came to be in the first place, how the mesh+texture were created. Gen models, in a sense, do. 1/3
Excited to share "Hilbert Representations for Foundation Policies", our new method to pre-train a generalist policy from unlabeled data! Website: seohong.me/projects/hilp/ A thread ↓:
Gave a lecture on Diffusion Models yesterday with @wilson1yan and @kvfrans youtu.be/DsEDMjdxOv4?si… Thanks to it being Lecture 6 into the semester (rather than Lecture 1), we could even include Sora, Mobile Diffusion, SDXL-Lightning :)
Latent space planning. Took me a while to understand why each maze path has two latent paths.
Super honored to have been shortlisted for the George Girault PhD award, the most prestigious recognition for a robotics dissertation in Europe! Congrats to the other finalists too!
HNY! Excited to share SynCLR, that rivals CLIP and Dino v2 but uses pure synthetic data. The interesting part - it can outperform models (e.g. CLIP) directly trained on LAION-2B, which was the dataset used to train SD 1.5 that we used to generate images. arxiv.org/abs/2312.17742
went home after #NeurIPS2023 and entered year 4 of "can stephanie eat 52 pomegranates before going back to school"
year 3: flew back home for winter break today and was met with my annual antioxidant boost of 52 pomegranates for $13