Adam Fisch @adamjfisch
Research Scientist @ Google DeepMind | Formerly: PhD @ MIT EECS. people.csail.mit.edu/fisch/ Joined August 2017-
Tweets256
-
Followers1K
-
Following246
-
Likes454
Espresso Systems is hiring! Fueled by a new round of investment led by @a16zcrypto and with angel support from founders and contributing organizations to some of the most forward thinking L2 rollups and infra projects, including @arbitrum @0xPolygon @taikoxyz @Scroll_ZKP…
Espresso Systems is hiring! Fueled by a new round of investment led by @a16zcrypto and with angel support from founders and contributing organizations to some of the most forward thinking L2 rollups and infra projects, including @arbitrum @0xPolygon @taikoxyz @Scroll_ZKP…
If you're at #NeurIPS2023, @nagpalchirag will be presenting this work at the Distribution Shift workshop today!
If you're at #NeurIPS2023, @nagpalchirag will be presenting this work at the Distribution Shift workshop today!
Helping or Herding? Reward Model Ensembles Mitigate but do not Eliminate Reward Hacking paper page: huggingface.co/papers/2312.09… Reward models play a key role in aligning language model applications towards human preferences. However, this setup creates an incentive for the language…
Follow up to Pareto Testing, improved with Bayesian optimization! Led by @BrachaLaufer (now at TAU!), together with Tommi Jaakkola and @BarzilayRegina.
Follow up to Pareto Testing, improved with Bayesian optimization! Led by @BrachaLaufer (now at TAU!), together with Tommi Jaakkola and @BarzilayRegina.
I’m very excited to share our work on Gemini today! Gemini is a family of multimodal models that demonstrate really strong capabilities across the image, audio, video, and text domains. Our most-capable model, Gemini Ultra, advances the state of the art in 30 of 32 benchmarks,…
Go work with Stephen!
We're looking forward to presenting Pix2Act at NeurIPS next week! Details: neurips.cc/virtual/2023/p… Code for this project is also now available at: github.com/google-deepmin…
We're looking forward to presenting Pix2Act at NeurIPS next week! Details: neurips.cc/virtual/2023/p… Code for this project is also now available at: github.com/google-deepmin…
(yet another ?!) conformal prediction tutorial! 🥳 Just published a set of slides introducing conformal prediction (CP), going from Split CP to the original Full CP, starting with regression & generalizing to include classification. More details at conformalpredictionintro.github.io 😀
Scoop: @MIT published @adamjfisch's PhD thesis. Big congrats to Adam, who is one of the top researchers in conformal prediction, including applying conformal prediction to NLP - this is undoubtedly a fascinating and recommended read. You can find this and other PhD and MSc…
📢 Introducing Voyage AI @Voyage_AI_! Founded by a talented team of leading AI researchers and me 🚀🚀. We build state-of-the-art embedding models (e.g., better than OpenAI 😜). We also offer custom models that deliver 🎯+10-20% accuracy gain in your LLM products. 🧵
I just saw indescribable, raw footage of Hamas’ massacre along with 100 other international journalists, provided by Israeli authorities. Here are the notes I took: 1: Hamas terrorist screaming Allah Akhbah as he frantically tries to behead a dead man with a shovel.
Wow. Wow. Wow. Incredible powerful message (incredible speech writing)—to those who stumbled on the wrong path and may ruin their future for not knowing the past. The weight of history
I came to Israel with a single message: You are not alone.
October 7, a sacred Jewish holiday, became the deadliest day for the Jewish people since the Holocaust. It has brought to the surface painful memories and scars left by a millennia of antisemitism and genocide of the Jewish people. Terrorists will not win. Freedom will win.
Excited to share that I've joined MIT as an assistant professor in EECS! I'm thrilled to join many thoughtful, inspiring colleagues. Looking ahead, I'm working to develop statistical principles for AI models so that we can use them for science and reliable automated systems.
Here is our latest work on conformal calibration with ambiguous ground truth: We show how to perform conformal calibration in settings where it is difficult to obtain crisp ground truth labels from disagreeing annotations. More in the thread 🧵. arxiv.org/abs/2307.09302
I'll be moderating an Efficiency in #NLProc Panel at the #SustaiNLP 🌿 workshop at #ACL2023 this Thursday. We have top leaders from Academia and Industry: @DrorRotem, @myleott, @sysnlp, @sarahookr Any questions you would like to ask? Post here or join the panel!
1/n The (great) Distribution-Free, Risk-Controlling Prediction Sets (2021) paper differs from traditional conformal in at least three ways: they use a generic loss, separately control randomness in calibration and test data, and control an "point estimate" expected loss.
Quantifying uncertainty is vital for avoiding consequential model failures, esp. in medical settings. @Varal7 @adamjfisch @TalSchuster @YalaTweets @sohn522 & #JameelClinic PIs Tommi Jaakkola & @BarzilayRegina introduce a new approach for language modeling arxiv.org/abs/2306.10193
Akari Asai @AkariAsai
11K Followers 650 Following Ph.D. student @uwcse & @uwnlp. NLP. IBM Ph.D. fellow (2022-2023). Meta student researcher (2023-) . ☕️ 🐕 🏃♀️🧗♀️🍳Ofir Press @OfirPress
10K Followers 3K Following I build tough benchmarks for LMs and then I get the LMs to solve them. Postdoc @Princeton. PhD from @nlpnoah @UW. Ex-visiting researcher @MetaAI & @MosaicML.MIT CSAIL @MIT_CSAIL
298K Followers 22K Following MIT's Computer Science & Artificial Intelligence Laboratory (CSAIL). Media Inquiries: [email protected]MIT Jameel Clinic for.. @AIHealthMIT
6K Followers 367 Following The epicenter of AI and health at MITSara Hooker @sarahookr
39K Followers 7K Following I lead @CohereForAI. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, @trustworthy_ml. Changing spaces where breakthroughs happen.Bill Yuchen Lin 🤖 @billyuchenlin
6K Followers 2K Following Research @allen_ai. I evaluate (multi-modal) LLMs, build agents, and study the science of LLMs. Previously: @GoogleAI & @MetaAI FAIR @nlp_uscAnastasios Nikolas An.. @ml_angelopoulos
3K Followers 784 Following @Berkeley_EECS Ph.D. with Mike Jordan/Jitendra Malik. Conformal prediction, distribution-free uncertainty quantification, vision/imaging. Former @stanford_ee.Ori Ram @ori__ram
765 Followers 386 Following Research Scientist @GoogleAI, working on #NLProc. Previously: PhD from @TelAvivUni, Research Scientist @AI21LabsValeriy M., PhD, MBA,.. @predict_addict
17K Followers 3K Following PhD in machine learning | conformal prediction | time-series | author of bestselling Practical Guide to Applied Conformal-Prediction https://t.co/ugR9TtXd29Peng Qi @qi2peng2
3K Followers 336 Following #NLProc researcher @ AWS AI (@AmazonScience). Part-time machine learner & linguistics enthusiast. Previously: PhD @stanfordnlp, JD AI. He/him. Opinions my own.Shayne Longpre @ShayneRedford
4K Followers 998 Following PhD @MIT. Prev: @Google Brain, @apple ML, @stanfordnlp. 🇨🇦 Interests: AI/ML/NLP, Data-centric AI, transparency & societal impactKawin Ethayarajh @ethayarajh
3K Followers 727 Following PhD student @StanfordAILab @stanfordnlp Working on machine learning under human incentives.Anneckxhs @anneckxhs
58 Followers 2K Following Don't stop learning. No matter what age Vienna Austria 🇦🇹 London England 🇬🇧香蕉皮 @darcy_Yeah
39 Followers 978 FollowingKhan Bhebhura @Bhebhurakhan
78 Followers 701 Following Passionate nerd🔭 | AI consultant | founder and CEO of CloudyAI the tech startup democratizing access to quality healthcare in Africa using AI 💻Hristo @hristozaykov
245 Followers 2K FollowingChaitanya Malaviya @cmalaviya11
99 Followers 121 Following PhD student at UPenn | currently @GoogleDeepMindAdam Falls @AdamFalls172137
57 Followers 975 FollowingZhi-Quan Feng @ZhiQuanFeng1046
4 Followers 43 FollowingData Science Research.. @ArionDas
360 Followers 2K Following Deep Learning || Research Work on ML, DL || Large Language Models || GANs || RAG || Competitive Programming || Generative AI || Optimization Algorithms || IIITRCassie Cao @CaoCassie3
672 Followers 839 Following Research scientist @carnegielearn | Visiting Researcher @carnegiemellon | PhD @InfoSchoolSheff | #AIED #EduTech #HCI #MWP #LLM #multimodality #gamification$TheMoneyPrinter911$ @TheMoneyPrintrr
1K Followers 5K Following Time is the most valuable asset! Don’t trade time working for usd paper money that they print from thin air. You have been tricked.Xiao Ma @infoxiao
4K Followers 3K Following research @googleai on responsible #ai. llm safety & reasoning. prev: @cornell_tech, @facebook @airbnb. views are mine. sh-i-ow. dr. 👩🎓FANVince @FANVince
79 Followers 1K FollowingGeorge Colclough @LowRankApprox
116 Followers 2K Following “Science is a differential equation. Religion is a boundary condition” — Alan TuringLauren Cabezudo @cabezudo_l14922
57 Followers 3K FollowingIsaac Gibbs @iswgibbs
180 Followers 22 Following @Stanford PhD student in statistics. Working on distribution-free uncertainty quantification, conformal inference.Sangmin Bae @raymin0223
441 Followers 646 Following Ph.D. candidate at @kaist_ai; Efficient NLP, Self-Supervised Learning, Federated Learning, Generative AI, and Multimodal LearningCharles @KrrCharles
97 Followers 424 Following né en 376 ppm, maintenant 424 Étudiant Data Scientist Amoureux des sciences qui dit beaucoup de bêtises mais retweet/like des trucs intéressantsShuzhou Yuan @Shoejoe_
50 Followers 119 Following PhD student @KITKarlsruhe working on NLP, Graph Neural Networks. Formerly @cisLMU.Tuan Vu @VuAhnTuan
318 Followers 1K FollowingRacionalEuSou @RacionalEuSou
3K Followers 3K Following Leia o livro UNIVERSO em DESENCANTO.Ajude ajudar a catequese das crianças pela 🔑 pix [email protected]🤎♥️🤎Prateek Yadav @prateeky2806
2K Followers 2K Following Ph.D. at @unccs Continual Model Adaptation and Composition Previously @MSFTResearch, @AmazonScience, @iitmadras. UG @iiscbangalore. Opinions are my own.Alexander D'Amour (al.. @alexdamour
4K Followers 1K Following Research Scientist at Google Brain. Statistics, Data Science, ML, causality, fairness. Prev at Harvard (PhD), UC Berkeley (VAP). Opinions my own. he/him.Rob Dearborn @RobDearborn
252 Followers 2K Following most excited about building // growth @joinsaturn, tinkererDaniel Kudla @its_LtDan
1K Followers 2K Following in Search of Greatness! Follow me for the best insight into Finance, Investing, and Building Generational Wealth…I’m 100% Polish! Best Spot to Learn+GrowLek’sai @sai_lek_lek
7 Followers 224 Following.₺₺ @bpgtes24
0 Followers 430 FollowingChirag Nagpal @nagpalchirag
1K Followers 713 FollowingPatrick Wayte @PatrickWayte
799 Followers 5K Following Thinking at the intersection of science and technology we can do better, smarter, faster!Qinan Huang @EricQinanHuang
95 Followers 401 Following Undergrad@QuGroup,Hunan University |VisitingUndergrad@houklab,UCLA | FormerVisitingStudent @HartwigGroup,UCBMuhammad Anwar @Muhamma81966391
277 Followers 3K Following Graphs Graphon. DL Researcher at @ProteineaHyewon Jeong @HyewonMandyJ
340 Followers 688 Following Ph.D. Student, @MIT_CSAIL EECS., Medical Doctor (M.D., M.S.) studying Machine Learning for HealthcareZara @zarasphere
162 Followers 436 Following Pullo | CS student • Girl in tech - history and current affairs enthusiast • I refuse to adhere to reality • Disney Girl🧚♀️Ricardo Diaz-Rincon @rdiazrincon
2K Followers 5K Following PhD student @UFNeuroscience leveraging AI for Parkinson’s disease | Prev: @fly_crimson_lab & @UnivalleCol | Afrolatino 🇨🇴Egoitz Aulestia @egoitzaulestia
591 Followers 1K Following Scientific designer. Co-founder, building @NIT_bci. Working in complex systems innovation 🧠🤖📈. Neuroscience + AI + Brain-Computer InterfaceJiashu Xu @JiashuXu2
134 Followers 613 Following First-year graduate student at @Harvard; Undergrad at @USCChris Yao Du @yao53513502
440 Followers 3K Following PhD@HKUST Computer Vision, Medical Image AnalysisYann LeCun @ylecun
711K Followers 718 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K FollowingPercy Liang @percyliang
49K Followers 408 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | PianistAndrej Karpathy @karpathy
979K Followers 904 Following 🧑🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥Akari Asai @AkariAsai
11K Followers 650 Following Ph.D. student @uwcse & @uwnlp. NLP. IBM Ph.D. fellow (2022-2023). Meta student researcher (2023-) . ☕️ 🐕 🏃♀️🧗♀️🍳Kyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).François Chollet @fchollet
470K Followers 770 Following Deep learning @google. Creator of Keras. Author of 'Deep Learning with Python'. Opinions are my own.Christopher Manning @chrmanning
126K Followers 116 Following Director, @StanfordAILab. Assoc. Director, @StanfordHAI. Founder, @stanfordnlp. Prof. CS & Linguistics, @Stanford. IP @aixventureshq. 🇦🇺 Do #NLProc & #AI. 👋Yoav Artzi @yoavartzi
13K Followers 163 Following Research/prof @cs_cornell + @cornell_tech🚡 / https://t.co/9YnWry7yHs / https://t.co/3VmRSyYm2d / asso. faculty director @arxiv / building https://t.co/f9QkzO5kaCGoogle DeepMind @GoogleDeepMind
944K Followers 275 Following We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.Sam Bowman @sleepinyourhat
35K Followers 3K Following AI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.Mike Lewis @ml_perception
6K Followers 227 Following Llama3 pre-training lead. Partially to blame for things like the Cicero Diplomacy bot, BART, RoBERTa, kNN-LM, top-k sampling & Deal Or No Deal.AI at Meta @AIatMeta
532K Followers 255 Following Together with the AI community, we are pushing the boundaries of what’s possible through open science to create a more connected world.MIT Jameel Clinic for.. @AIHealthMIT
6K Followers 367 Following The epicenter of AI and health at MITGraham Neubig @gneubig
31K Followers 586 Following Associate professor at CMU, studying natural language processing and machine learning.Jacob Andreas @jacobandreas
14K Followers 958 Following Teaching computers to read. Assoc. prof @MITEECS / @MIT_CSAIL (he/him). https://t.co/5kCnXHjtlY https://t.co/2A3qF5vdJwDipanjan Das @dipanjand
4K Followers 308 Following Senior Director of Research at @GoogleDeepmind. Working on improving the factuality of LLM generated content.Alexander D'Amour (al.. @alexdamour
4K Followers 1K Following Research Scientist at Google Brain. Statistics, Data Science, ML, causality, fairness. Prev at Harvard (PhD), UC Berkeley (VAP). Opinions my own. he/him.Joshua Leifer @joshualeifer
15K Followers 992 Following TABLETS SHATTERED @DuttonBooks out August 2024. Writing also @nybooks, @guardian, @972Mag & elsewhere. Editorial board @DissentMagStephen Pfohl @stephenpfohl
1K Followers 2K Following Research Scientist at Google. Prev Stanford Biomedical Informatics PhD. Researching #fairness #transparency #causality #healthcare #healthequityIsaac Gibbs @iswgibbs
180 Followers 22 Following @Stanford PhD student in statistics. Working on distribution-free uncertainty quantification, conformal inference.Alicia Curth @AliciaCurth
3K Followers 496 Following PhD student Machine Learning in Cambridge, Statistician at ❤️ In search of statistical intuition for modern ML & simple explanations for complex things 👀Tengyu Ma @tengyuma
25K Followers 512 Following Assistant professor at Stanford; Co-founder of Voyage AI (https://t.co/wpIITHLgF0) ; Working on ML, DL, RL, LLMs, and their theory.Ahmad Beirami @abeirami
4K Followers 2K Following Building safe, helpful, and scalable generative AI @Google | ex-{@AIatMeta, @EA, @MIT, @Harvard, @DukeU} | @GeorgiaTech PhD | زن زندگی آزادی | opinions my ownHexiang (Frank) Hu @Hexiang_Hu
505 Followers 401 Following Research Scientist @GoogleDeepmind | Vision & Language | GeminiTaylan Cemgil @TaylanCemgilML
5K Followers 1K Following Research Scientist at DeepMind London, English and Turkish tweets on Machine Learning, opinions my own.Lily Zhang @lilyhzhang
440 Followers 460 Following PhD student, NYU Center for Data Science/CILVR. Machine learning. Harvard College alum.andrea panizza @unsorsodicorda
2K Followers 334 Following Data Scientist, aerospace engineer, trekking & comics lover, applying #MachineLearning #DeepLearning Statistics to Industrial Applications.Thomas G. Dietterich @tdietterich
50K Followers 505 Following Distinguished Professor (Emeritus), Oregon State Univ.; Former President, Assoc. for the Adv. of Artificial Intelligence; Robust AI & Comput. SustainabilityKevin Patrick Murphy @sirbayes
42K Followers 334 Following Research Scientist at Google Brain / Deepmind. Interested in Bayesian Machine Learning.Arnaud Doucet @ArnaudDoucet1
4K Followers 627 Following Professor at Oxford @OxCSML, @oxfordstats, Professorial fellow at @Hertfordcollege and Senior Staff Research Scientist at @GoogleDeepMind.Bracha Laufer Goldsht.. @BrachaLaufer
64 Followers 189 Following Assistant Professor @TelAvivUni. Former postdoc @MIT_CSAILErez Kaminski @erez_kaminski
230 Followers 877 Following CEO @KetryxHQ. Helping make software safe and reliable. Data enthusiast, football aficionado, and science geek. Prev @Amgen, @WolframResearch and @PPPLabKyle Cranmer @KyleCranmer
16K Followers 3K Following Director Data Science Institute @UWMadison @datascience_uw. EiC @MLSTjournal. Physics, stats/ML/AI, open science. same handle @sigmoid.social and bskyManuel Gomez-Rodrigue.. @autreche
1K Followers 136 Following Human-centric machine learning at the Max Planck Institute for Software Systems.Stephen Ra @stephenrra
3K Followers 494 Following Director & Founding Team @PrescientDesign • @genentech Prev: Head of ML @Pfizer, @Columbia, @CornellUrvashi Khandelwal @ukhndlwl
2K Followers 611 Following Research Scientist @GoogleDeepMind, Stanford CS PhD @stanfordnlpChen Zhao @henryzhao4321
637 Followers 348 Following Assistant Professor NYU Shanghai, Postdoc NYU, PhD @umdclip doing NLP research, bridge playerKawin Ethayarajh @ethayarajh
3K Followers 727 Following PhD student @StanfordAILab @stanfordnlp Working on machine learning under human incentives.Jae Ho Sohn, MD, MS @sohn522
610 Followers 1K Following Assistant Professor @UCSFimaging, Cardiothoracic Radiologist, Big Data in Radiology @UCSF_Ci2, #doglover 🐕Siddharth Garg 🌈 @sg1753
1K Followers 755 Following @NYU assoc. professor; #ML, #cybersecurity, and computer hardware researcher; intrepid explorer; #queer; #immigrant; research group: https://t.co/8M8axn335hJustin Solomon @JustinMSolomon
6K Followers 662 Following Associate prof, MIT EECS/CSAIL 💻🔬🦥🧀🏋️♀️🎼🐈🎻🏳️🌈 he/him/hisSarah Catanzaro @sarahcat21
12K Followers 1K Following “All methods are sacred if they are internally necessary” (GP @amplifypartners, prev @canvasvc; Head of Data @Mattermark; @palantirtech; @c4ads)Ledell Wu @LedellWu
695 Followers 234 Following AI Research Scientist (Generative AI/LLM/Multimodal) Co-founder @CreatifyLab, Past: FAIR @MetaAI, @BAAIBeijing Recipient of ICML 2023 Test-of-Time AwardPatrizio Giovannotti @patpizio
43 Followers 572 Following Data Scientist during the day ☀️ Machine Learning PhD student at night 🌃 @RoyalHolloway.Noah Jones @noahcjones
230 Followers 1K Following Ph.D Candidate @MIT | Affective Computing. Interested in reliable machine learning and multimodal transfer learning for healthcare applications.David Dohan @dmdohan
8K Followers 1K Following reducing perplexity @openai | past: probabilistic programs, proteins, science & reasoning @ google brain 🧠Greg Durrett @gregd_nlp
6K Followers 752 Following CS professor at UT Austin. I do NLP most of the time. he/himPhilip Resnik @psresnik
4K Followers 28 Following MPower Professor; Professor, Linguistics and Institute for Advanced Computer Studies, University of Maryland; Tech Advisor, FiscalNote, Coleridge InitiativeNathan Schneider @complingy
4K Followers 1K Following Computational Linguist and Professional Nerd at Georgetown University he/him pronouns, ALL the prepositions @[email protected] @complingy.bsky.socialRyan David Cotterell @ryandcotterell
9K Followers 1K FollowingAllen Schmaltz @Allen_Schmaltz
368 Followers 809 Following AI/ML @ Reexpress AI (https://t.co/z0yUIZBt1l) | Research: AI:=Introspection+Updatability+Uncertainty (Similarity⧉Distance⧈Magnitude⧇) | Prev: @Harvard @StanfordMaor Ivgi @maorivg
360 Followers 157 Following NLP researcher / Ph.D. candidate at Tel-Aviv UniversityShubhendu Trivedi @_onionesque
7K Followers 850 Following Cultivated Abandon. Twitter interests: Machine learning research, applied mathematics, mathematical miscellany, ML for Physics/Chemistry, books.TL;DR: we develop methods for adding concise & accurate attributions to LLM generated texts. Each generated sentence is paired with highlighted spans from supporting sources so you can easily verify it. Check Aviv's thread and our paper for more details: arxiv.org/abs/2403.17104
🐣Too Long; Didn't Read: Most LLMs cite full documents for support, but they're too long so people don't actually read them. In our new work "Attribute First, then Generate”, we introduce fine-grained attributions, where LLMs are required to highlight only relevant information…
Espresso Systems is hiring! Fueled by a new round of investment led by @a16zcrypto and with angel support from founders and contributing organizations to some of the most forward thinking L2 rollups and infra projects, including @arbitrum @0xPolygon @taikoxyz @Scroll_ZKP…
We’re excited to announce that Espresso Systems has raised a $28 million Series B round led by @a16zcrypto.
U give me: a bunch of unlabeled data. I give u: AI-generated labels. Result: a massive, but biased, val set. We use PPI to correct the bias, giving unbiased evaluations with better precision 🚀 arxiv.org/abs/2403.07008 Experiments on GPT-4 and ResNets, using @lmsysorg :)
What if we could use AI to evaluate AI? 🧐 This would save thousands of human-hours---e.g., on platforms like @lmsysorg. But it introduces bias! Enter AutoEval Done Right: producing unbiased evaluations of models with synthetic data! arxiv.org/abs/2403.07008
My take on the utility of distribution-free uncertainty estimation techniques, especially conformal prediction, in practice: davidstutz.de/QK3V9 Can be seen as a response to @beenwrekt’s articles on the use of prediction intervals.
David Stutz from Deep Mind has written an article “On the Utility of Conformal Prediction Intervals” as a response to a rant by a certain Berkeley professor. #conformalprediction
@Fanghua_Ye @wangly0229 @ml_angelopoulos So, here's what I could find: 1) arxiv.org/abs/2306.10193 from @BarzilayRegina, very nice 2) arxiv.org/abs/2305.19187 very nice too, Zhen Lin @_onionesque 3) arxiv.org/abs/2205.10586 is just binary classification, but the approach is a bit different from usual ICP approach 1/2
Congratulations to @AmosaurusRex for his work on improving the evaluation of long-range models via self-pretraining, getting accepted to #ICLR2024 for oral presentation (top 1.2% of all submissions)!! 👏👏 w/ @JonathanBerant
Excited to share my work with @JonathanBerant @ankgup2! We show pretraining on task data alone suffices to bridge the gap between state space models and transformers on Long Range Arena, leading to a significantly better estimate of model capabilities. arxiv.org/abs/2310.02980 🧵
Big milestone!
🦜🚀LangChain v0.1.0 After a year of development, we've released LangChain v0.1.0 Read the full blog here: blog.langchain.dev/langchain-v0-1… After talking with the users and developers, we released this stable version and focused the library on a few core areas: 👀Observability:…
Have you been compiling reward-KL tradeoffs to compare different alignment methods? Have you been using 𝐛𝐞𝐬𝐭-𝐨𝐟-𝐧 as a baseline? Have you wondered about the analytical formula that claims this formula? 𝐾𝐿 (𝑏𝑒𝑠𝑡-𝑜𝑓-𝑛 || 𝑏𝑎𝑠𝑒) = 𝑙𝑜𝑔(𝑛) - (𝑛-1)/𝑛
If you're at #NeurIPS2023, @nagpalchirag will be presenting this work at the Distribution Shift workshop today!
Helping or Herding? Reward Model Ensembles Mitigate but do not Eliminate Reward Hacking paper page: huggingface.co/papers/2312.09… Reward models play a key role in aligning language model applications towards human preferences. However, this setup creates an incentive for the language…
Feynman also used to do this and people would try to avoid having him on the committee. Though the worst horror story I heard was when Tibshirani pointed out in a defense that some bio student did cross-validation wrong, insisted he re-do it, and all the results vanished. 😱
fun story: terry tao was on both my and my brother's committee. he solved both our dissertation problems before we were done talking, each of us got "wouldn't it have been easier to...outline of entire proof" 🫠
Helping or Herding? Reward Model Ensembles Mitigate but do not Eliminate Reward Hacking paper page: huggingface.co/papers/2312.09… Reward models play a key role in aligning language model applications towards human preferences. However, this setup creates an incentive for the language…
@adamjfisch @BrachaLaufer @BarzilayRegina Love it!
🎉 Gemini 1.0 is officially out! 🎉 Thrilled to have played a small part in this incredible project. The learning has been immense, and I continue to learn new things everyday. Onwards and upwards!
I’m very excited to share our work on Gemini today! Gemini is a family of multimodal models that demonstrate really strong capabilities across the image, audio, video, and text domains. Our most-capable model, Gemini Ultra, advances the state of the art in 30 of 32 benchmarks,…
If you're a prospective PhD student interested in statistics & uncertainty for ML 🤖⁉️, AI for science 🧪, or data with strategic behavior ♟️, I have openings in my group! Consider applying to the MIT EECS PhD program and mention me in your application. gradapply.mit.edu/eecs/apply/log…
We're looking forward to presenting Pix2Act at NeurIPS next week! Details: neurips.cc/virtual/2023/p… Code for this project is also now available at: github.com/google-deepmin…
Excited to present Pix2Act! An agent that can interact with GUIs using the same conceptual interface that humans commonly use — via pixel-based screenshots and generic keyboard and mouse actions -- arxiv.org/abs/2306.00245 (1/4)
Really excited to announce our partnership with Microsoft, a big step in advancing production-grade LLM applications for enterprises on Azure!
LangChain 🤝🏾 Microsoft Today, we’re thrilled to announce our collaboration with @Microsoft @Azure. Our joint customers will enjoy deeper product integrations that live up to our commitment to AI with the enterprise assurances the Azure ecosystem provides. more on the blog and…
(yet another ?!) conformal prediction tutorial! 🥳 Just published a set of slides introducing conformal prediction (CP), going from Split CP to the original Full CP, starting with regression & generalizing to include classification. More details at conformalpredictionintro.github.io 😀
"Bayesian Flow Networks" has 47 pages of main text with over 200 equations 🙃 Maybe this summary is a simpler resource if you want to understand the new generative modeling paradigm: youtube.com/watch?v=hVesuh… :)
New paper: "SEMQA: Semi-Extractive Multi-Source Question Answering" Answers combine extracted spans with free text -> better attributions Amazing colab w. Adam L. @sun_haitian @_j_ai @JonathanBerant @professorwcohen @metzlerd (@GoogleAI,@GoogleDeepMind) arxiv.org/abs/2311.04886