Hussein Hazimeh @hazimeh_h
Data research @OpenAI. @MIT phd hazimeh.com San Francisco, CA Joined October 2015-
Tweets55
-
Followers326
-
Following195
-
Likes619
Today OpenAI announced o3, its next-gen reasoning model. We've worked with OpenAI to test it on ARC-AGI, and we believe it represents a significant breakthrough in getting AI to adapt to novel tasks. It scores 75.7% on the semi-private eval in low-compute mode (for $20 per task…
o3 and o3-mini are my favorite models ever. o3 essentially solves AIME (>90%), GPQA (~90%), ARC-AGI (~90%), and it gets 1/4th of the Frontier Maths. To understand how insane 25% on Frontier Maths is, see this quote by Tim Gowers. The sparks are intensifying ...
Scaling Laws for Downstream Task Performance of Large Language Models Studies how the choice of the pretraining data and its size affect downstream cross-entropy and BLEU score arxiv.org/abs/2402.04177
Very excited to share the paper from my last @GoogleAI internship: Scaling Laws for Downstream Task Performance of LLMs. arxiv.org/pdf/2402.04177… w/ Natalia Ponomareva, @hazimeh_h, Dimitris Paparas, Sergei Vassilvitskii, and @sanmikoyejo 1/6
'LibMTL: A Python Library for Deep Multi-Task Learning', by Baijiong Lin, Yu Zhang. jmlr.org/papers/v24/22-… #mtl #python #libmtl
'L0Learn: A Scalable Package for Sparse Learning using L0 Regularization', by Hussein Hazimeh, Rahul Mazumder, Tim Nonet. jmlr.org/papers/v24/22-… #sparse #regularization #l0learn
A new preprint on ALL-SUM: an ensembled L0Learn method for faster, more accurate polygenetic risk scores(PRSs) using GWAS summary stats. It ensembles L0+L2 regulated PRSs across toning grids. Applied to many UKB phenotypes. Congrats to @Tony_Chen6, @AndrewHaoyu, Rahul Mazumder
A new preprint on ALL-SUM: an ensembled L0Learn method for faster, more accurate polygenetic risk scores(PRSs) using GWAS summary stats. It ensembles L0+L2 regulated PRSs across toning grids. Applied to many UKB phenotypes. Congrats to @Tony_Chen6, @AndrewHaoyu, Rahul Mazumder
Very excited share our preprint on a new method for constructing polygenic risk scores from GWAS summary statistics. Big thanks to my amazing advisors @AndrewHaoyu, Rahul Mazumder (MIT), and @XihongLin for their support on this project. biorxiv.org/content/10.110…
Check out our work on Flexible Modeling and Multitask Learning using Differentiable Tree Ensembles in KDD'22 Paper: dl.acm.org/doi/10.1145/35… Our paper had won Best Student Paper Award in KDD'22 (Research Track).
Great article covering six papers on Mixture of Experts, of which one is ours 🙂 (DSelect-K with @hazimeh_h, @achowdhery, and others): arxiv.org/abs/2106.03760
Great article covering six papers on Mixture of Experts, of which one is ours 🙂 (DSelect-K with @hazimeh_h, @achowdhery, and others): arxiv.org/abs/2106.03760
my article about MoE routing layers is out! I took it down to 6 routing papers:
my article about MoE routing layers is out! I took it down to 6 routing papers: https://t.co/214gtPqjSH
Really excited to share the beta release of #SynthID, a watermarking tool created by @GoogleDeepMind and made available via @googlecloud to help tag and identify AI-generated images
(1/2) I used ML to make Chess more fun in Single-Player. If you: - are an ML practitioner / work in AI, - like chess, math or puzzle games, - enjoy stories abt code, hacks, and setbacks, then this tech story is for you. A deep dive into the ML side of puzzle design.
Check out our work on pruning neural nets! The method leverages several ideas from combinatorial optimization and high-dimensional statistics to enable faster and more accurate pruning Blog: goo.gle/3E12kAc ICML paper: proceedings.mlr.press/v202/benbaki23…
Check out our work on pruning neural nets! The method leverages several ideas from combinatorial optimization and high-dimensional statistics to enable faster and more accurate pruning Blog: goo.gle/3E12kAc ICML paper: proceedings.mlr.press/v202/benbaki23…
New Article: "How to DP-fy ML: A Practical Guide to Machine Learning with Differential Privacy" by Ponomareva, Hazimeh, Kurakin, Xu, Denison, McMahan, Vassilvitskii, Chien, and Thakurta jair.org/index.php/jair…
Today, we discuss the current state of differentially private ML (DP-ML) research with an overview of common techniques for obtaining DP-ML models, engineering challenges, mitigation techniques and current open questions. Learn more ↓ goo.gle/3Iril5k
How easy is it for adversaries to hide image content from classifiers through obfuscations? Our new benchmark allows you to evaluate this! Dataset and evaluation code: github.com/deepmind/image… Paper: arxiv.org/abs/2301.12993. Joint work between @DeepMind, @Google & @GoogleAI 🧵
Training ML models with differential privacy could be challenging. To aid practitioners, we wrote a detailed survey with known best practices of DP-training of ML models: arxiv.org/abs/2303.00654
Mark your calendars! The 2022 MIP Workshop feat. DANniversary, will be held May 23-26, 2022, at DIMACS, Rutgers University. This year MIP will also host a computational competition, to be launched on November 16th. More info at mixedinteger.org/2022/
Elias Khalil @lyeskhalil
2K Followers 2K Following Assistant Professor @UofT & @uoftmie. Formerly postdoc @DS4DM in Montreal and grad student @gtcomputing & @GTCSE. Machine Learning+Discrete Optimization.
Ryan Cory-Wright @RyanCoryWright
791 Followers 497 Following Assistant Professor @ImperialBiz | Prev: Postdoc @IBMResearch PhD @ORCenter @MIT | Optimization+Machine Learning+Renewable Energy | Runner | Kiwi 🇳🇿
Adam Elmachtoub @Adam235711
3K Followers 3K Following Associate Professor of Industrial Engineering and Operations Research @Columbia @CUSEAS @DataSciColumbia / @AmazonScience Visiting Academic
Beste Basciftci @BesteBasciftci
1K Followers 694 Following Assist. Prof. @TippieAnalytics, PhD in operations research @GeorgiaTech, computer & industrial engineer
Jalal Kazempour @JalalKazempour
1K Followers 335 Following Professor at DTU, Denmark. Interested in energy markets and operations research
Mathieu Besançon @matbesancon
2K Followers 2K Following Researcher in math. optimization @inria_grenoble. Applied maths, programming, OSS, energy, higher ed, games. Also on the elephant and blue sky platforms
Jannis Kurtz @JannisK13
469 Followers 271 Following assistant professor @uva_amsterdam | research in integer (robust) optimization and machine learning | scientific views are my own, all others I read somewhere
INFORMS @INFORMS
13K Followers 2K Following INFORMS is the association for those who apply science, math, technology, and analytics to solve the world’s most critical challenges.
Bistra Dilkina @BDilkina
2K Followers 601 Following Associate Professor of CS @USCViterbi. co-Director of USC Center on AI and Society @CAIS_USC. #AI #DiscreteOptimization #ML #MLforOPT #compsust #AIforGood
Omid Gholamzadeh Nasr... @GholamzadehOmid
287 Followers 856 Following #innovating to drive lasting change | SDG4 Network @unesco | Schwarzman Scholar | Co-founder of Aid You/Newhopeu | Diana Awardee 2020 | Speaker | #Techforgood
Samuel Kushnir @samkushnir
25 Followers 51 Following Google | Hardware Software Co-design for Gemini
Itearvev @Itearvev071
28 Followers 613 Following
Rita Fonseca @fonsecarita1
1K Followers 1K Following Talent Acquisition @OpenAI. (Formerly @GoogleMaps) Econ @UCLA
Ronaldo Bauch @BauchRonal81404
21 Followers 2K Following
tamara @tamarajtran
10K Followers 352 Following Exploring human-computer interaction at scale. Built 3x #1 apps. Prev @DukeU
jon doe @jondoe239083
1 Followers 87 Following
Mara Abernathy @AbernathyM60409
46 Followers 3K Following
Tibor Blaho @btibor91
31K Followers 2K Following Lead Engineer at @AIPRMcorp (https://t.co/fepyWfV4kA) and @lrt_co (https://t.co/p7LEvIKduG), building AIPRM for ChatGPT & Claude. Signal @ btibor.91
Codo @Codo9038
11 Followers 475 Following
Sheahou @SheahouSUpTBh
21 Followers 986 Following
Dung Doan @dungdx34
330 Followers 8K Following
陳道亭 @tao904
9 Followers 388 Following
Muni Kumar @sssvmkumar
151 Followers 5K Following
Anirudh Thatipelli @AThatipelli
536 Followers 5K Following PhD-CS @UCFCRCV, MS-CS @UCR_CSE, Former Applied Science Intern at @amazon
Momin Ahmad Khan @MominAhmadKhan1
108 Followers 3K Following PhD Student at @UMass Amherst 🇺🇸, Undergrad @nustseecs 🇵🇰Working on security and privacy of machine learning. Reading | Traveling | Dota2 | Table Tennis
lemma23 @lemma23
1 Followers 858 Following
Changhong Wang @Tsingmoon
35 Followers 164 Following Postdoc researcher @telecomparis. Previous @CNRS @c4dm. Machine learning for audio.
Marcelino Koelpin @koelpin4081
2 Followers 305 Following
Smoutis @SmoutisZrF
57 Followers 4K Following
Hayley @Hayley271633
35 Followers 3K Following
Kate Lin @k8_lin_
121 Followers 275 Following researcher @GoogleAI | prev: @Wellesley @UniOfOxford, @MIT, @MSFTResearch | excited about human and computer intelligence
Eric @ookandaemi48982
74 Followers 7K Following
Emily @Sheexez2tFoW
30 Followers 3K Following
Mona @CheartHW6g8
28 Followers 3K Following
Shirley @Tinetewno0u2o
21 Followers 3K Following
Steetosl @Steetosly5h7R
84 Followers 7K Following
Emily @ThorshorswfUb
29 Followers 3K Following
Thesoyth @ThesoythoUOKw5
39 Followers 4K Following
Nancy @SairturkFDOM6
39 Followers 3K Following
Ali Hariri @haririAli95
86 Followers 201 Following PhD Candidate at @EPFL. Interested in graph representation learning and long-range modeling
Shirley @KarlursmkZjOb
31 Followers 3K Following
Hussein Moussa @husseinmoussa_
128 Followers 320 Following Research Fellow @UChicago | Applied Math, Econ, and Arabic Lit. @aub_lebanon ’23
Phorffoughn @PhorffoughnIoS
57 Followers 5K Following
SherryCarroll @Sp65bcm47w6X41
74 Followers 7K Following
JodieMarner @t95kVnTiHBcHp0
68 Followers 7K Following
Britney @Britney10282172
46 Followers 4K Following
IreneLowell @3MyOxEf3I481rW
9 Followers 1K Following
JoyGosse @VRutV91ha21tS6
77 Followers 7K Following
Rida Abbas @Rida_Abbas_
17 Followers 51 Following 🇱🇧🇮🇹| 21 anni || Studente di Ingegneria Informatica presso il Politecnico di Milano
Elias Khalil @lyeskhalil
2K Followers 2K Following Assistant Professor @UofT & @uoftmie. Formerly postdoc @DS4DM in Montreal and grad student @gtcomputing & @GTCSE. Machine Learning+Discrete Optimization.
Ryan Cory-Wright @RyanCoryWright
791 Followers 497 Following Assistant Professor @ImperialBiz | Prev: Postdoc @IBMResearch PhD @ORCenter @MIT | Optimization+Machine Learning+Renewable Energy | Runner | Kiwi 🇳🇿
Adam Elmachtoub @Adam235711
3K Followers 3K Following Associate Professor of Industrial Engineering and Operations Research @Columbia @CUSEAS @DataSciColumbia / @AmazonScience Visiting Academic
Beste Basciftci @BesteBasciftci
1K Followers 694 Following Assist. Prof. @TippieAnalytics, PhD in operations research @GeorgiaTech, computer & industrial engineer
Jalal Kazempour @JalalKazempour
1K Followers 335 Following Professor at DTU, Denmark. Interested in energy markets and operations research
Sebastien Bubeck @SebastienBubeck
56K Followers 1K Following I work on AI at OpenAI. Former VP AI and Distinguished Scientist at Microsoft.
Mathieu Besançon @matbesancon
2K Followers 2K Following Researcher in math. optimization @inria_grenoble. Applied maths, programming, OSS, energy, higher ed, games. Also on the elephant and blue sky platforms
Jannis Kurtz @JannisK13
469 Followers 271 Following assistant professor @uva_amsterdam | research in integer (robust) optimization and machine learning | scientific views are my own, all others I read somewhere
INFORMS @INFORMS
13K Followers 2K Following INFORMS is the association for those who apply science, math, technology, and analytics to solve the world’s most critical challenges.
Bistra Dilkina @BDilkina
2K Followers 601 Following Associate Professor of CS @USCViterbi. co-Director of USC Center on AI and Society @CAIS_USC. #AI #DiscreteOptimization #ML #MLforOPT #compsust #AIforGood
Jerry Tworek @MillionInt
22K Followers 677 Following Berry farmer @ OpenAI | o3, o1, GPT4, ChatGPT, Codex, Solved Rubik’s cube with robotic hand | cautious AI optimist
Rita Fonseca @fonsecarita1
1K Followers 1K Following Talent Acquisition @OpenAI. (Formerly @GoogleMaps) Econ @UCLA
OpenAI Developers @OpenAIDevs
222K Followers 1 Following Updates for developers building with the OpenAI Platform and API • Service status: https://t.co/kZwnwdYqOS • Support: https://t.co/qCi6M5ESZU
Mark Chen @markchen90
64K Followers 333 Following Chief Research Officer at @OpenAI. Coach for the USA IOI Team.
Kate Lin @k8_lin_
121 Followers 275 Following researcher @GoogleAI | prev: @Wellesley @UniOfOxford, @MIT, @MSFTResearch | excited about human and computer intelligence
OpenAI @OpenAI
4.3M Followers 3 Following OpenAI’s mission is to ensure that artificial general intelligence benefits all of humanity. We’re hiring: https://t.co/dJGr6Lg202
Ali Hariri @haririAli95
86 Followers 201 Following PhD Candidate at @EPFL. Interested in graph representation learning and long-range modeling
Carlos Riquelme @rikelhood
2K Followers 2K Following principal researcher @MicrosoftAI previously @StabilityAI @GoogleBrain @Stanford
Xuekai Zhu @zhu_xuekai
203 Followers 544 Following Ph. D. Candidate @sjtu1896 ｜ ACL 2023 Area Chair Award ｜Language models
Faria Huq | 🦋: far... @FariaHuqOaishi
830 Followers 659 Following PhD Student @SCSatCMU | Agents 🤖 & Interaction📱| Editor at https://t.co/dRePeCbYqe | Prev- @GoogleDeepMind, SGI Fellow'21 @MIT_CSAIL, Tero labs
Igor Carron @IgorCarron
5K Followers 6K Following CEO https://t.co/b9fz6WvhTx @LightOnIO Paris Machine Learning Meetup (8200+) @ParisMLGroup https://t.co/jY1eeMkqJE (10M+ pageviews) @NuitBlog Rocket Scientist
Omar Khattab @lateinteraction
24K Followers 3K Following Asst professor @MIT EECS & CSAIL (@nlp_mit). Author of https://t.co/VgyLxl0oa1 and https://t.co/ZZaSzaRaZ7 (@DSPyOSS). Prev: CS PhD @StanfordNLP. Research @Databricks.
Paul von Chamier, PhD @Paul_VonChamier
451 Followers 6K Following Macroeconomist | Data Scientist | Team Manager
Berivan Isik @BerivanISIK
11K Followers 1K Following Research scientist @GoogleAI. Gemini data & eval | prev: PhD @Stanford @StanfordAILab
Tony @Tony_Chen6
99 Followers 253 Following Postdoc @MGHMedicine / @BroadInstitute || PhD from @HarvardBiostats
Shital Shah @sytelus
13K Followers 11K Following Mostly research and code. If universe is an optimizer, what is its loss function? All opinions are my own.
taesiri @taesiri
854 Followers 5K Following Research Scientist @ EA Sports, VLMs, Evals, All opinions are my own.
Wissam Fawaz @wissam_f
640 Followers 805 Following Software engineering and data science enthusiast #LinkedIn: https://t.co/rz6m68U3lS #GitHub: https://t.co/1w0KUhRFRi
Salar Fattahi @Salar_Fattahi
990 Followers 434 Following Assistant Professor at the University of Michigan @umichioe, previously @UCBerkeley and @Columbia, optimization and machine learning
Elizabeth Adkison @eaadkison
107 Followers 184 Following AI Marketing @ Cisco, former marketing lead @GoogleAI, @GoogleResearch, @GoogleForHealth | mom to 4 | my cup runneth over
Yasuo Yamasaki @yasuoyamasaki
414 Followers 2K Following
Connor Lawless @LawlessOpt
111 Followers 181 Following he/him 🌈 Stanford MS&E Postdoc | Human-Centered AI & OR Prev: @CornellORIE @MSFTResearch, @IBMResearch, @uoftmie
MosbahAouad @AouadMosbah
85 Followers 804 Following Ph.D. Student at the University of Illinois Urbana-Champaign - DEPEND Group | Machine Learning | Artificial Intelligence for Healthcare
Xiaoqian Wang @Xia0qianWang
141 Followers 120 Following Assistant Professor at Chinese Academy of Sciences (CAS). Time series forecasting, Statistical modeling, Distributed computing.
Ammar Mohanna @AmmarYMohanna
400 Followers 380 Following AI & Machine Learning Consultant | PhD in Edge AI | Lecturer @ American University of Beirut
Mahesh Sathiamoorthy @madiator
13K Followers 1K Following RL Environment Curation. Data Curation (e.g. OpenThoughts). Post-training. CEO @bespokelabsai. Ex-GoogleDeepMind.
Aaqib @aaqib_saeed
341 Followers 141 Following
Bhavya Kailkhura @bkailkhu
900 Followers 2K Following Principal Research Scientist spearheading AI security research @Livermore_Lab. Making AI robust & efficient for national security and scientific applications.
Marwa El Halabi @marwaElhalabi
102 Followers 218 Following Visiting Researcher @Mila_Quebec #PalestinianLivesMatter
Elias Frantar @elias_frantar
491 Followers 138 Following Researcher @OpenAI | prev. PhD @ISTAustria and intern @GoogleDeepmind | I also build super fast Lego Rubik's Cube robots.
Randall Balestriero @randall_balestr
4K Followers 220 Following AI Researcher: From theory to practice (and back) Postdoc @MetaAI with @ylecun PhD @RiceUniversity with @rbaraniuk Masters @ENS_Ulm @Paris_Sorbonne
Eli Chien @chien_eli
341 Followers 359 Following Visiting Researcher @Google. Incoming Assistant Professor @ National Taiwan Univ. Prev.: @GeorgiaTech @UofIllinois @Amazon @BellLabs #RegulatableAI
Andreas Terzis @aterzis
1K Followers 513 Following Lead for GDM Security & Privacy Research team Past: Google Brain/Google/JHU CS Dept
Mahesh Chandra Mukkam... @mmahesh873
258 Followers 673 Following IIT Alumni. Phd student in Mathematical Optimization Group, University of Tuebingen #Optimization | #MachineLearning | #AI | Convex, Non-convex Optimization
Andrew Carr 🤸 @andrew_n_carr
23K Followers 4K Following co-founder leading science @getcartwheel co-founder advisor @arcade_ai Past: Codex @OpenAI, Brain @GoogleAI, world ranked Tetris player
Javid Dadashkarimi @JDadashkarimi
2K Followers 1K Following University of Pennsylvania, Yale '23, former developer at Martinos Center/Harvard, medical image analysis 🧠🐷, TBI, deep learning, connectomics (he/him)
Sven Gowal @sgowal
1K Followers 89 Following Robust ML @DeepMind, previously @GoogleAI. @[email protected]
Cyrus Rashtchian @CyrusRashtchian
1K Followers 474 Following Research Scientist @GoogleAI working on LLMs, RAG, Factuality, and Gemini (he/him)Trends for United States
You might like
