Sergey Kolesnikov @Scitator
Head of AI Research in a fintech company. Decision Making in the Wild. Opinions are my own. scitator.com Joined May 2011-
Tweets589
-
Followers1K
-
Following234
-
Likes2K
1/7 In-context learning (ICL) is poised to revolutionise NLP, but its success hinges on our ability to process long sequences. Recently, @simran_s_arora et al. showcased advancements in Linear Transformers and proposed Based. But what if we could push its boundaries further?
Our first stable release and full paper preprint for XLand-MiniGrid is done, check it out! Compared to the workshop version, we have significantly redesigned the library, multi-GPU baselines and standardized benchmarks with millions of unique tasks. github.com/corl-team/xlan…
In-Context RL for Variable Action Spaces ICRL is a promising direction to build Foundational Decision-Making Models. But adaptation to new action spaces is a problem. We propose Headless Algorithm Distillation (@MishaLaskin) to address it. arxiv.org/abs/2312.13327
Which data-collection strategies enable In-Context Reinforcement Learning? You need either RL training trajectories or supervision with optimal actions. But what if we had a demonstrator policy, could we use it to enable ICRL? We show the answer is yes arxiv.org/abs/2312.12275
🔥 Imagine if you could train Meta-RL agents for 1 TRILLION transitions under 40 hours? We present XLand-MiniGrid — JAX-accelerated meta-reinforcement learning environments inspired by XLand (@FeryalMP) and MiniGrid (@Love2Code). code: github.com/corl-team/xlan…
NetHack is arguably one of the most challenging games for humans and even more for RL algorithms. Maybe, offline RL could help? Time will reveal. To bootstrap the practitioners, we release Katakomba — Tools and Benchmarks for Data-Driven NetHack. github.com/tinkoff-ai/kat…
Interested in offline and offline-to-online RL 🫶? Check out new major release of Clean Offline Reinforcement Learning library: 🤖 Offline: 10 algorithms, 30 datasets benchmarked 🦾 Offline-to-Online: 5 algorithms, 10 datasets benchmarked github.com/tinkoff-ai/CORL
📢 Exciting research from our team! We explored the power of seemingly minor design choices in offline RL by applying them to an established minimalistic baseline developed by @shaneguML. The outcome? Just follow this 🧵
📢 Exciting research from our team! We explored the power of seemingly minor design choices in offline RL by applying them to an established minimalistic baseline developed by @shaneguML. The outcome? Just follow this 🧵
Exciting news: Our paper has been accepted at ICML! Our work focuses on improving the reliability of offline RL algorithms and tackling overfitting through an anti-exploration bonus. And the best part? SAC-RND challenges SOTA results with a single network, no ensembles required!
Optimizing accuracy is not a problem if you are EXACT 🤘
You don't need a TPU cluster to count a budget 🤯 Join our EOP talk (@vladkurenkov) in room 307 in 2 hours! @icmlconf spotlight, #ICML2022
Are you ready for the upcoming ICML spotlight? 🤯 kudos to @vladkurenkov
Are you ready for the upcoming ICML spotlight? 🤯 kudos to @vladkurenkov
If you're at ICLR now, check Generalizable Policy Learning in the Physical World workshop tomorrow. We will present Prompts and Pre-Trained Language Models for Offline Reinforcement Learning and will be happy to share its current improvements. We have some 😉
Check out our blog post for a thorough explanation of how brainchop.org was made and the principles behind its work. With @MMasoud2021 @FarfallaHu @Entodi @Kevin_C_Wang @Scitator #neuroimaging #brainresearch #medicalresearch #MRI #MadeWithTFJS trendscenter.org/in-browser-3d-…
I was experimenting with Self-Supervised Learning recently, so if you are interested in easy to go implementations for Barlow-Twins, BYOL, SimClR, or Supervised contrastive - check out the repo: bit.ly/3H9OgUa Comparison results included!
Long time no see, my friends! I am thrilled to present you with a new year update of the Catalyst - PyTorch high-level API to accelerate your R&D. Bunch of improvements and simplifications, check out updated examples for more: bit.ly/3v4nw53
Interested in Offline RL? We have recently updated our work on Online Evaluation Performance: bit.ly/3rNljZP Open for your questions in the thread!

Jeremy Howard @jeremyphoward
260K Followers 6K Following 🇦🇺 Co-founder: @AnswerDotAI & @FastDotAI ; Prev: professor @ UQ; Stanford fellow; @kaggle president; @fastmail/@enlitic/etc founder https://t.co/16UBFTX7mo
Sanyam Bhutani @bhutanisanyam1
40K Followers 1K Following 👨💻 Working on llama models @AIatMeta | Previously: @h2oai, @weights_biases 🎙 Podcast @ctdsshow 👨🎓 Fellow @fastdotai 🎲 Grandmaster @Kaggle
yobibyte @y0b1byte
23K Followers 2K Following ViTaly, yobibyte, senior RS @ NVIDIA, Reinforcement Learning PhD from @UniofOxford, ex RS at Isomorphic Labs, intern @ MSR Cambridge, DeepMind, Facebook, NVIDIA
Weights & Biases @weights_biases
46K Followers 1K Following The AI developer platform.🛠️ Track and evaluate your LLM applications in real-time with @weave_wb.
Nathan Benaich @nathanbenaich
61K Followers 34K Following solo member of investment staff @airstreet @airstreetpress @stateofaireport @raais
Andrey Lukyanenko @AndLukyane
3K Followers 2K Following Polyglot. Economist. Data Scientist/MLE. Kaggle Kernels 1st Rank, Competition master. Love reading Fantasy books.
Dieter @kagglingdieter
16K Followers 145 Following deep learner @nvidia, PhD mathematics, current rank @kaggle: 1
Qinglin Zhu @qinglin_zhu1
29 Followers 1K Following
ᐱ ᑎ ᑐ ᒋ ᕮ �... @pasnicenco
617 Followers 698 Following
Aslan A. @sayfaslan
9 Followers 944 Following
bolt @bolka228
7 Followers 127 Following
Literate Googgles @LGooggles88006
0 Followers 61 Following
Inna Vakulenko @innvakulenko
1 Followers 43 Following
Fred Hoffman @frederickjrhoff
19 Followers 1K Following
Stanislav Dereka @stdereka
3 Followers 39 Following
Boris Shaposhnikov @borisshapa
42 Followers 59 Following ai alignment research @ ttech phd student @ mipt
Ivan Sedykh @idsedykh
0 Followers 115 Following
Cong Lu @cong_ml
3K Followers 1K Following Research Scientist @GoogleDeepMind on the Open-Endedness Team. Prev: Postdoc @UBC_CS, PhD @UniofOxford.
Linh Le @linhlpv
71 Followers 463 Following PhD student at A2I2 Reinforcement Learning, Adaptation and Generalization
Seohong Park @seohong_park
4K Followers 532 Following Reinforcement learning | CS Ph.D. student @berkeley_ai
Songlin Yang @SonglinYang4
12K Followers 3K Following research @MIT_CSAIL @thinkymachines. work on scalable and principled algorithms in #LLM and #MLSys. in open-sourcing I trust 🐳. she/her/hers
Kun Lei @kunlei15
436 Followers 2K Following Now: CS Ph.D. student at WashU. Pre: RA @Tsinghua_Uni. Research on reinforcement learning algorithms and their real-world applications.
George Thomas @georgethom_s
92 Followers 2K Following Co-founder @clusterfudge. Built AI infra at Google DeepMind, Two Sigma, startups... 👨🏻💻 🧗🏻♂️ 🚵🏻 🎩
Ivan @Plavunchil2003
3 Followers 38 Following
Andrey Vlasov @ahlesen
0 Followers 19 Following
Sofia Lo Cicero @s_lo_cicero
8 Followers 60 Following
Viacheslav Sinii @ummagumm_a
26 Followers 283 Following
Gao Tianci @gao_tianci95
0 Followers 27 Following
Mercy Okanlawon @mercy_mts
157 Followers 446 Following Let's raise financially free people. Let's build solutions with time freedom and unwavering determination. Let's do what we're purposed to do.
Batsi Ziki @BatsiZiki
16 Followers 162 Following A budding Reinforcement Learning empiricist at @UCT_news
ChiiHitsu @Fan80580750
73 Followers 250 Following ●無言フォロー失礼いたしました🙇♂️ ●N1を取得📙 ●真っ白な野良猫を飼う🐈 ●大阪→北京→深セン→上海✈️ ●LLMをトレーニング●おいしい日本料理を作りたい🍣 ●OOR、Aimer、RadWimps、GooseHouse大好き🎵 ●バドミントンが好き🏸 ●ユビート修行中
Shraey @Shraey2023
1 Followers 1K Following Self-learning A.I. | Loves : Science and wisdom literature |
Yakau Bubnou @ybubnou
6 Followers 19 Following
Muhammad Al-Barham @m_albarham
107 Followers 1K Following ML & Mechatronics Engineer, Supporting Arabic language by new technologies 🥰 @chalmersuniv (Chalmers University of Technology)
Укрась прощ... @Mac_Jei
19 Followers 1K Following «Nisi solis nobis scripsimus» / Пишем только для нас самих. 🗣️ 🇷🇺 🇬🇪 🇦🇿 🇹🇷 🇺🇸 🔧 Big Data & AI stuff (DS/DA/DE/DevOps)
Shashank yadav @Shashankya61959
27 Followers 353 Following I'm video transcriber as well as audio and 3d modelling and all.
Sacha Crouzet Schlatt... @sacha_crouzet
639 Followers 2K Following Délégué du canton 5 de la 6ème circonscription des Alpes-Maritimes de l’Avenir Français 06
Sasha Malysheva @aimalysheva
176 Followers 429 Following Cofounder @ Phasing, the first agentic CRO PhD in AI | ex-DeepMind, Google, JetBrains RL scientist rethinking the world with AI agents
. @ProstoDurachok
2 Followers 190 Following
Anton Pomelnikov @AntonPomelniko1
0 Followers 57 Following
DJEFF SOURCE - Davies... @djeffssource
281 Followers 387 Following A full stack Web/Mobile App Developer | Entrepreneur
Balaji Varatharajan @BalajiAI
2K Followers 425 Following ML Nerd. Currently exploring diffusion models.
Qingbao Yu @Qingbao_Yu
53 Followers 632 Following
Sungbae Chun @SungbaeChun1999
1 Followers 22 Following
Arsh Tangri @T_MUFC_A
167 Followers 1K Following MS Robotics (CS) Student @HelpingHandsLab @KhouryCollege @Northeastern | GGMU!!
Christian Schroeder d... @casdewitt
1K Followers 1K Following Research Fellow & Stipendiary Lecturer @UniofOxford @OxfordTVG @St_Catz. Theory+Applications LLM+RL, Multi-Agent/AI Security, Bio, responsible AI governance.
zhushi @zhushi97976315
0 Followers 14 Following
Andrej Karpathy @karpathy
1.4M Followers 1K Following Building @EurekaLabsAI. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets.
AK @_akhaliq
425K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo ,submit papers here: https://t.co/UzmYN5YmrQ
Yann LeCun @ylecun
949K Followers 764 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
François Chollet @fchollet
572K Followers 813 Following Co-founder @ndea. Co-founder @arcprize. Creator of Keras and ARC-AGI. Author of 'Deep Learning with Python'.
Google DeepMind @GoogleDeepMind
1.2M Followers 279 Following We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.
AI at Meta @AIatMeta
712K Followers 288 Following Together with the AI community, we are pushing the boundaries of what’s possible through open science to create a more connected world.
PyTorch @PyTorch
451K Followers 77 Following Tensors and neural networks in Python with strong hardware acceleration. PyTorch is an open source project at the Linux Foundation. #PyTorchFoundation
Jeremy Howard @jeremyphoward
260K Followers 6K Following 🇦🇺 Co-founder: @AnswerDotAI & @FastDotAI ; Prev: professor @ UQ; Stanford fellow; @kaggle president; @fastmail/@enlitic/etc founder https://t.co/16UBFTX7mo
Andrew Ng @AndrewYNg
1.3M Followers 1K Following Co-Founder of Coursera; Stanford CS adjunct faculty. Former head of Baidu AI Group/Google Brain. #ai #machinelearning, #deeplearning #MOOCs
Sergey Levine @svlevine
108K Followers 133 Following Associate Professor at UC Berkeley Co-founder, Physical Intelligence
Jim Fan @DrJimFan
325K Followers 3K Following NVIDIA Director of Robotics & Distinguished Scientist. Co-Lead of GEAR lab. Solving Physical AGI, one motor at a time. Stanford Ph.D. OpenAI's 1st intern.
Soumith Chintala @soumithchintala
250K Followers 1K Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.
Jürgen Schmidhuber @SchmidhuberAI
163K Followers 0 Following Invented principles of meta-learning (1987), GANs (1990), Transformers (1991), very deep learning (1991), etc. Our AI is used many billions of times every day.
yobibyte @y0b1byte
23K Followers 2K Following ViTaly, yobibyte, senior RS @ NVIDIA, Reinforcement Learning PhD from @UniofOxford, ex RS at Isomorphic Labs, intern @ MSR Cambridge, DeepMind, Facebook, NVIDIA
Ferenc Huszár @fhuszar
42K Followers 1K Following Secular Bayesian. Professor of Machine Learning @Cambridge_CL. Talent aficionado at https://t.co/RbJkoLguey Alum of @Twitter, Magic Pony and @Balderton
Richard Socher @RichardSocher
112K Followers 1K Following CEO @youdotcom MP @aixventuresHQ Before: Stanford Adj Prof in AI/NLP, Chief Scientist at Salesforce, MetaMind
Igor Babuschkin @ibab
103K Followers 851 Following Maybe the real ASI was the friends we made along the way. Co-founder @xAI, Research & Engineering
Sungjin Ahn @SungjinAhn_
2K Followers 1K Following Prof@KAIST, Chief Dreamer of Machine Learning & Mind Lab https://t.co/ato9yodtm5 Previously, professor at Rutgers, postdoc at Mila, and PhD at UC Irvine
Gappy (Giuseppe Paleo... @__paleologo
45K Followers 455 Following Curiosity, wonder, quantitative research. Books, read/written. Desire is that which is missing. Evil twin of @yogappygappy. new book: https://t.co/ygOgypsEQ5
the tiny corp @__tinygrad__
59K Followers 133 Following We make tinygrad and sell tinybox, the best perf/$ AI computer. $25k for 4x 5090 in a quiet box. Our mission is to commoditize the petaflop.
George Hotz 🌑 @realGeorgeHotz
300K Followers 204 Following President @comma_ai. Founder @__tinygrad__
Michael Zhang @mzhangio
2K Followers 519 Following cs phd @hazyresearch, @StanfordAILab. robust + reliable LLLMs.
Songlin Yang @SonglinYang4
12K Followers 3K Following research @MIT_CSAIL @thinkymachines. work on scalable and principled algorithms in #LLM and #MLSys. in open-sourcing I trust 🐳. she/her/hers
Abhishek Gupta @abhishekunique7
9K Followers 875 Following Assistant Professor at University of Washington. I like robots, and reinforcement learning. Previously: post-doc at MIT, PhD at Berkeley
Brandon Amos @brandondamos
20K Followers 2K Following research scientist @MetaAI (FAIR) | optimization, machine learning, control, transport | PhD from @SCSatCMU
Jane Wang @janexwang
36K Followers 417 Following Staff research scientist at DeepMind. AI and neuro. Former physicist, current human. https://t.co/5pWOmfuuqu
Jesse Farebrother @JesseFarebro
1K Followers 431 Following Ph.D. student studying AI & decision making at @Mila_Quebec / @McGillU. Currently at @AIatMeta. Previously @GoogleDeepMind, @Google 🧠.
Kun Lei @kunlei15
436 Followers 2K Following Now: CS Ph.D. student at WashU. Pre: RA @Tsinghua_Uni. Research on reinforcement learning algorithms and their real-world applications.
Rafael Rafailov @ Neu... @rm_rafailov
7K Followers 812 Following Ph.D. Student at @StanfordAILab. I work on Foundation Models and Decision Making. Previously @GoogleDeepMind @UCBerkeley
Seohong Park @seohong_park
4K Followers 532 Following Reinforcement learning | CS Ph.D. student @berkeley_ai
Jiaxun Cui 🐿️ @cuijiaxun
678 Followers 761 Following Ph.D. @utlarg @UTAustin 🤘 | Multi-agent Reinforcement Learning | Undergrad SJTU @sjtu1896 | Research Intern FAIR Labs @AIatMeta, Robert Bosch, Tencent AI Labs
Matthew Johnson @SingularMattrix
13K Followers 3K Following Researcher at Google Brain. I work on JAX (https://t.co/UGa5tGfinF).
Kai Arulkumaran @kaixhin
8K Followers 5K Following Researcher, programmer, DJ, transhumanist. @SakanaAILabs @ArayaGlobal; formerly @imperialcollege @MSFTResearch Twitter @AIatMeta @GoogleDeepMind @nnaisense
Linh Le @linhlpv
71 Followers 463 Following PhD student at A2I2 Reinforcement Learning, Adaptation and Generalization
Zhecheng Yuan @fancy_yzc
520 Followers 516 Following PhD @Tsinghua University, IIIS. Interested in reinforcement learning, representation learning, robotics.
Taylor W. Killian @tw_killian
3K Followers 878 Following Senior Research Scientist @MBZUAI, interested in Decision Making & Generalization // @BYU '13; @Harvard '17; @UofT '24
Artem Zholus @artemZholus
422 Followers 522 Following Visiting Researcher @AIatMeta; PhD @Mila_Quebec. Ex: Intern @GoogleDeepMind, Intern @EPFL, @IgluContest, MSc@MIPT; @InSilicoMeds
Cong Lu @cong_ml
3K Followers 1K Following Research Scientist @GoogleDeepMind on the Open-Endedness Team. Prev: Postdoc @UBC_CS, PhD @UniofOxford.
Jacky Liang @jackyliang42
6K Followers 771 Following Research Scientist @GoogleDeepMind working on foundation models for robotics. PhD @CMU_Robotics @iamlab_cmu
Emma Brunskill @EmmaBrunskill
8K Followers 89 Following Associate professor, Computer Science. Stanford. Stanford's Human Centered AI (HAI) Institute. Opinions expressed are my own.
Edward Hughes @edwardfhughes
2K Followers 457 Following #OpenEndedness. Staff Research Engineer @GoogleDeepMind, Visiting Fellow @LSEnews, Advisor @coop_ai, Choral Director @GodwineChoir. Views my own.
Louis Kirsch @LouisKirschAI
2K Followers 780 Following Driving the automation of AI Research. Project Lead & Research Scientist @GoogleDeepMind. PhD @SchmidhuberAI. @UCL, @HPI_DE alumnus. All opinions are my own.
Karim Beguir @kbeguir
7K Followers 186 Following Co-Founder & CEO @instadeepai Entrepreneur passionate about developing the ML community. @Google For Startups Mentor, @DeepIndaba Steering Committee Member
Misha Laskin @MishaLaskin
15K Followers 214 Following Co-founder, CEO at @reflection_ai. Prev: Research @DeepMind. Gemini RL team.
Shalev Lifshitz @Shalev_lif
2K Followers 391 Following do androids dream of electric sheep? @ something new, previously @UofT @VectorInst
Ben Eysenbach @ben_eysenbach
5K Followers 0 Following Prof @ Princeton CS working on AI/ML/RL. 🦋@ https://t.co/hz4KZsv5iO
Yannick Kälber @YannickKae
3K Followers 1K Following Overlay Portfolio Management @ Universal Investment
Animesh Garg @animesh_garg
29K Followers 1K Following Foundation Models for Generalizable Autonomy in Robotics. Assistant Professor in AI Robotics @GeorgiaTech. Prev @nvidia
Danijar Hafner @danijarh
22K Followers 1K Following Building AI that makes autonomous decisions using world models, artificial curiosity, and temporal abstraction @GoogleDeepMind
Clément Canonne (on ... @ccanonne_
37K Followers 66 Following Senior Lecturer @Sydney_Uni. Formerly Postdocs @IBMResearch, @Stanford; PhD @Columbia. Converts ☕ into puns: sometimes theorems. He/him. @ccanonne.bsky.social
Peyman Milanfar @docmilanfar
93K Followers 493 Following Distinguished Scientist at Google. Computational Imaging, Machine Learning, and Vision. Tweets = personal opinions. May change or disappear over time.
Csaba Szepesvari @CsabaSzepesvari
11K Followers 723 Following "If there is not folly in the world, then the world itself is folly. You must understand that mistakes are not always regrets." - Paul Tobin, Bandette🤠
Eugene Vinitsky (@RLC... @EugeneVinitsky
20K Followers 2K Following This is the site where I talk about the attacks on science and immigration. Science is on the other site. Lab website: https://t.co/vrtbcqRyRn
David Stutz @davidstutz92
4K Followers 1K Following Research scientist @DeepMind working on robust and safe AI, previously @maxplanckpress, views my own.
Dan Hendrycks @DanHendrycks
42K Followers 109 Following • Center for AI Safety Director • xAI and Scale AI advisor • GELU/MMLU/MATH/HLE • PhD in AI • Analyzing AI models, companies, policies, and geopolitics
Daily AI Papers @papers_daily
17K Followers 2 Following