Devin @_chotzen
human ai software engineer @codeiumdev, previously @Caltech Honolulu & Mountain View Joined June 2017-
Tweets441
-
Followers105
-
Following318
-
Likes313
make sure to look between caps lock and back tick on your keyboard today
Codeium is featured on Forbes AI 50, a list showcasing promising private AI companies! Join us - we’re looking for exceptional people to accelerate developer productivity with AI 🚀 codeium.com/careers
Codeium is featured on Forbes AI 50, a list showcasing promising private AI companies! Join us - we’re looking for exceptional people to accelerate developer productivity with AI 🚀 codeium.com/careers
Never tell me that your vote doesn't count. Glad mine did in this race. mercurynews.com/2024/04/03/ive…
to paraphrase @headwaysmatter: should we be LEADING IN CLEAN TRANSPORTATION? or RUNNING MORE BUSES AND TRAINS
to paraphrase @headwaysmatter: should we be LEADING IN CLEAN TRANSPORTATION? or RUNNING MORE BUSES AND TRAINS
good morning. Proud as always to be on this team. We're working on a lot of hard problems this year, I'm really excited for what's to come.
good morning. Proud as always to be on this team. We're working on a lot of hard problems this year, I'm really excited for what's to come.
It’s fun to laugh at hyperloop for failing (after burning credulous VC and local govt cash) but there’s an ongoing and much more powerful vaporware product that has infected @CaltransHQ @AirResources as a way for Chevron to maintain natural gas production
It’s fun to laugh at hyperloop for failing (after burning credulous VC and local govt cash) but there’s an ongoing and much more powerful vaporware product that has infected @CaltransHQ @AirResources as a way for Chevron to maintain natural gas production
It's been quite a (half-)year @codeiumdev, so exciting to see how far we've come since we launched. I'm always grateful to work with such capable people, and to build a product that people are using right now. And I'm so excited for what's coming next year.
Yesterday the head of the Hawaiʻi housing emergency proclamation working group resigned after far-right conspiracy theorists, screaming on social media that the government started the Maui fires, went after her loved ones with slanderous lies.
The reality is that our residents are moving away. Hawaii has had seven straight years of population decline. it is long past time to address Hawaii's housing shortage.
1 month until we find out whether Pasadena fooled the state into getting a compliant housing element.
Would your city‘s zoning code & processes allow your favorite buildings to be built today, for reasons other than fire safety/sustainability? If not, something is deeply broken.
Would your city‘s zoning code & processes allow your favorite buildings to be built today, for reasons other than fire safety/sustainability? If not, something is deeply broken.
also constitutional law is just calvinball used to justify whatever the justices’ partisan beliefs are the Supreme Court is a joke, sham institution and it’s about time manchin and Sinema realized that and sign on to expanding the court and impeaching thomas
I'm so happy to see this response from our next Governor of Hawaii @DrJoshGreen. He frames the issue in the correct way: the lack of supply is the problem, not foreign investors or some other magical mechanism for increasing prices. civilbeat.org/2022/06/candid…
California’s “climate” Governor: How it started How it’s going
Prhp1 @mojrad24
16 Followers 4K Following not a bot, Just someone with a strong thirst for knowledge
Rexethash @rexethash69540
6 Followers 548 Following
Josphine Walchak @josph_walc
56 Followers 5K Following
Tueroola @tueroola99926
0 Followers 314 Following
Tegan Cassion @tegan58489
68 Followers 5K Following
Hanna Bosma @hanna31980
64 Followers 5K Following
Phetheg @phetheg58678
0 Followers 123 Following
AdelaMicah @p49CrCeO68X764o
0 Followers 354 Following
Kortonest @kortonest12572
1 Followers 451 Following
McSatese @MSatese88386
1 Followers 351 Following
Veda Luecke @VedaL46629
74 Followers 5K Following
Dorla Meneely @DorlMenee
73 Followers 5K Following
CoralLouie @Ci2a3XVOq2sVPP
0 Followers 444 Following
Harley-rose Carlis @CarlisHarl40537
80 Followers 5K Following
Jude Chalk @JudeChalk86730
79 Followers 5K Following
Isabella 😍 @IsabellaLynn728
6 Followers 688 Following Орen to new eхpеriеnces and reаdу for passiоnate connесtiоns
Kevin Lu @KevinLu05616849
11 Followers 84 Following Eng @Exafunction MIT '18 Only share the pain are truly brotheres
Klara Fromdahl @KlaraF25587
77 Followers 5K Following
Yash Mittal @Yash_471
105 Followers 532 Following design @Codeiumdev | design student @CarnegieMellon
Andy 👨💻 @andyzg3
482 Followers 822 Following I like optimistic thinking, building, writing and running. eng @codeiumdev, former pm & designer, software @uwaterloo
Prem Qu Nair @premqnair
315 Followers 740 Following Currently @codeiumdev. Community member @neo. Formerly perception @nuro.
Codeium @codeiumdev
11K Followers 13 Following 🚀 Unlimited AI-powered autocomplete and chat 🔎 Codebase & doc awareness 💰 100% free, forever. Promise. Power up your code for free today!
Shannon Birge @ShannonBir33401
83 Followers 5K Following
Ben (e/sqlite) @andersonbcdefg
3K Followers 3K Following 🤖 Computer scientist, next-word-prediction enjoyer 📊 Prev. research fellow @ Stanford RegLab 🛠️ bUiLdiNg sOmeThiNg nEw (https://t.co/mdYPZmjSzN - YC S23) 🏳️🌈
Celine Figarsky @FigarCelin
65 Followers 5K Following
Dark Xiaoying @RobinJiaming
550 Followers 196 Following As he died to make all holy, let us live to make all free. Not @iingwen's alt. PFP base illustration by @c_couceiro. 🇺🇸🇹🇼🥑🔰⚡🚆🐗⚫⚪💜
Eilidh Brouillard @eilidh_eili
66 Followers 5K Following
Lael Gilmore @LaGilmor
50 Followers 5K Following
Kourtney Werkhoven @k_werkho
77 Followers 5K Following
Melody Shimanuki @shimanu_melo
43 Followers 5K Following
Catherine Ciesluk @ciesluk13203
82 Followers 5K Following
Brynn Bickerstaff @BrynnBicke41878
56 Followers 5K Following
Kathleen Dejesus @KathleenDe69820
64 Followers 5K Following
Paislie Salotti @PaislieSal36837
42 Followers 5K Following
Sylvie Richemond @RichemSyl
70 Followers 5K Following
Krista Showes @KShowes87879
65 Followers 5K Following
Blondell Mulkhey @BMulkhey16409
102 Followers 5K Following
Gretchen Bargas @BargasGret92458
76 Followers 5K Following
Arletta Vince @vin_arle
31 Followers 5K Following
Amira Hoying @AmiHoyi
33 Followers 5K Following
Teortaxes▶️ @teortaxesTex
8K Followers 1K Following Ours is the age of unaligned utilitarians. Other problems are relatively unimportant, but sometimes I tweet about them anyway. (кто/кого)
Yisong Yue (chairing .. @yisongyue
19K Followers 3K Following Machine Learning @Caltech (@YueLabCaltech). AI for invention at @AsariAILabs. Autonomous Driving at https://t.co/riZHAmvKpZ. Senior Program Chair @iclr_conf.
kache @yacineMTB
54K Followers 3K Following i'm a swe. go to https://t.co/pWRBfY8kn2 - AI image editing IN YOUR BROWSER! follow to watch a self funded founder beat VC backed AI startups with @dingboard_
Nick Frosst @nickfrosst
13K Followers 848 Following cofounder @cohere - singer @goodkidband pfp: @polarfishh_26
Yi Tay @YiTayML
29K Followers 97 Following chief scientist / cofounder @RekaAILabs 🫠 past: research scientist @google brain 🤯 currently learning to be a dad 🍼
Hugh Zhang @ICLR '24 @hughbzhang
2K Followers 567 Following open source ai @scale_AI. co-created @gradientpub.
Luke Evslin @LukeEvslin
540 Followers 640 Following Inexperienced father, canoe paddler, co-owner of Kamanu Composites, Hawai’i State Representative for district 16
Arvind Narayanan @random_walker
119K Followers 413 Following Princeton CS prof. Director @PrincetonCITP. I write about the societal impact of AI, tech ethics, & social media platforms. BOOK: AI Snake Oil. Views mine.
Jonathan Gorard @getjonwithit
12K Followers 17 Following Neither necessary nor sufficient. Math ∩ Physics ∩ Computation @Princeton
Max ⛅ @maxisawesome538
2K Followers 3K Following sup nerds @DbrxMosaicAI @CohereForAI @riversideulti @maxdoesresearch for purely research tweets
Wei Xiong @weixiong_1
256 Followers 195 Following RLHF and Machine Learning Theory. PhD Student @IllinoisCS, @MSFTResearch, @GoogleDeepMind, @USTC
Rafael Rafailov @rm_rafailov
4K Followers 642 Following Ph.D. Student at @StanfordAILab. I work on Foundation Models and Decision Making. Previously @GoogleDeepMind @UCBerkeley
Dwarkesh Patel @dwarkesh_sp
56K Followers 704 Following Being pretrained Host of Dwarkesh Podcast https://t.co/3SXlu7fy6N https://t.co/rEhnfYywXY https://t.co/hQfIWdM1Un
Kevin Lu @KevinLu05616849
11 Followers 84 Following Eng @Exafunction MIT '18 Only share the pain are truly brotheres
Andy 👨💻 @andyzg3
482 Followers 822 Following I like optimistic thinking, building, writing and running. eng @codeiumdev, former pm & designer, software @uwaterloo
Prem Qu Nair @premqnair
315 Followers 740 Following Currently @codeiumdev. Community member @neo. Formerly perception @nuro.
Yash Mittal @Yash_471
105 Followers 532 Following design @Codeiumdev | design student @CarnegieMellon
Gergely Orosz @GergelyOrosz
250K Followers 2K Following Writing @Pragmatic_Eng, the #1 technology newsletter on Substack. Author of @EngGuidebook. Formerly Uber & Skype.
jack morris @jxmnop
11K Followers 777 Following getting my phd in nlp @cornell_tech 🚠 // academic optimist // tweeting from the snack aisle at trader joes
Soumith Chintala @soumithchintala
187K Followers 888 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.
Delip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈
Michael Dell @MichaelDell
694K Followers 4K Following Chairman and CEO Dell Technologies Grateful #PlayNiceButWin https://t.co/3JiGiLPSc4
Jenny Schuetz @jenny_schuetz
17K Followers 4K Following Urban economist @BrookingsMetro. @[email protected]. She/her. https://t.co/G8gIUtm2J7…
Niels Hoven @NielsHoven
20K Followers 2K Following Founded @MentavaInc to support high achieving kids. Seeker of truth, critic of tribalism, lover of ice cream. Tweets about startups, education, and my four kids
Conor Johnston @conorj_SF
1K Followers 872 Following International extreme sports action hero, cannabis retailer, cat gay, FORMER staffer for London Breed.
LegislatureAI @legislature_ai
139 Followers 109 Following We track state and local government legislation in Hawaiʻi and California. Be the first to know about emerging trends, risks, and opportunities. Browse free ⬇️
Tom MacWright @tmcw
15K Followers 2K Following engineer, writer, ‘art’ https://t.co/3SlHb4ZsAQ 🆕 https://t.co/PBTxrklWJ7 🌎 prev developmentseed, mapbox, observablehq, config all tweets are handtyped and lowercase
j⧉nus @repligate
16K Followers 1K Following ⌥ Breach Mystic ⌥ Heisenbergian Harlequin ⌥ Schrodingerian Godflipper ⌥ Rabbit-Hole-As-A-Service (RHAAS)
Nik Shevchenko @kodjima33
6K Followers 612 Following Thiel Fellow, Founder | SF, Looking for cofounders: https://t.co/f0wOnG9iz9 | https://t.co/G7UOPzO3tm
Jeff Wang @jeffwangcrypto
3K Followers 262 Following Biz @Codeiumdev, Host of https://t.co/KnM565OYme + Rich Dad Crypto, GP @RandRCapital, Angel investor (Reserve, Oasis, Algorand, Genopets),AI@ https://t.co/O4prlMPmLQ
Databricks Mosaic Res.. @DbrxMosaicAI
30K Followers 115 Following We remove the barriers to state-of-the-art generative AI model development and make data + AI available to all.
Normal Computing 🧠.. @NormalComputing
2K Followers 78 Following We build AI systems that natively reason, so they can partner with us on our most important problems. Join us https://t.co/BcjWCoI5b8.
Nathan Lambert @natolambert
25K Followers 693 Following Figuring out AI @allen_ai, "rl boi" DM me papers. Writes @interconnectsai, talks @retortai Has phd and some credentials
Jiawei Zhao @jiawzhao
326 Followers 177 Following PhD Candidate @Caltech, Fmr Research Intern @nvidia
Teknium (e/λ) @Teknium1
29K Followers 3K Following Cofounder @NousResearch, prev @StabilityAI Github: https://t.co/LZwHTUFwPq HuggingFace: https://t.co/sN2FFU8PVE Support me on Github Sponsors
Fuzhao Xue @XueFz
4K Followers 544 Following Ph.D. candidate@NUSingapore, Intern of GEAR @NVIDIA | Google PhD Fellow | LLM, Foundation Model Scaling | Ex-@GoogleBrain | Zero-shot Cooking Learner🧑🍳
David Lombardi @LombardiHimself
118K Followers 684 Following SF 49ers coverage @TheAthletic. Contact: [email protected].
Lucas Beyer (bl16) @giffmana
57K Followers 448 Following Researcher (Google DeepMind/Brain in Zürich, ex-RWTH Aachen), Gamer, Hacker, Belgian. Mostly gave up trying mastodon as [email protected]
Jeremy Howard @jeremyphoward
222K Followers 5K Following 🇦🇺 Co-founder: @AnswerDotAI & @FastDotAI ; Hon Professor: @UQSchoolITEE ; Digital Fellow: @Stanford
Yejin Choi @YejinChoinka
19K Followers 330 Following professor at UW, director at AI2, adventurer at heart
Catalyze SV @CatalyzeSV
1K Followers 113 Following Sustainable, equitable & vibrant places for people in #SiliconValley. We do #communityengagement, education & advocacy. Cousin to #YIMBY. #Placemaking #Housing
Horace He @cHHillee
24K Followers 449 Following Working at the intersection of ML and Systems @ PyTorch "My learning style is Horace twitter threads" - @typedfemale
Glad to see folks studying this problem. The paper suggests that (their impl. of) FlashAttention has higher numerical error than baseline. However, FlashAttention in BF16/FP16 will often have *lower* error than baseline if the impl. does internal softmax rescaling in FP32
Meta presents Is Flash Attention Stable? Finds that Flash Attention sees roughly an order of magnitude more numeric deviation as compared to Baseline Attention at BF16 when measured during an isolated forward pass arxiv.org/abs/2405.02803
@robertomasymas @_chotzen perplexity is fine, it's basically just "loss on the pretraining corpus", which may or may not indicate usefulness for downstream tasks that aren't "predict next token of pretraining corpus". also gotchas with measuring it like early token curse (see: arxiv.org/pdf/2012.15832)
the trick the nonprofit sector has played on the world is making people think their competitor is the FOR-profit sector. It’s not. Their competitor is the government and unions
should we outsource job training to nonprofits? NO should we outsource subsidized housing to nonprofits? NO should we outsource public education to nonprofits? NO should we outsource renewable energy to nonprofits? NO just stop
@2wlearning please share how you finally understood RoPE every time i try to read about it my brain fills with white noise
these models really need to be evaluated with something like RULER (github.com/hsiehjackson/R…), needle-in-a-haystack is not sufficient for me to believe that performance doesn't suffer across the long-context window
We’re going back 2 back! 🔥 Introducing the first 1M context window @AIatMeta Llama-3 70B to pair with the our Llama-3 8B model that we launched last week on @huggingface. Our 1M context window 70B model landed a perfect score on NIAH and we’re excited about the results that…
Soon
In the coming weeks, we will begin testing fully autonomous rides — without a human driver— for our employees on San Francisco Peninsula city streets north of San Mateo.
its true. we are working on it :)
“I don’t give a shit about AGI. I want this technology to deliver on the promise it has made. And it has not.” —Nick Frosst, @cohere co-founder
This is why attaching an "affordability mandate" to SB 3202 would have been a bad idea. Subsidized affordable housing is good, but the research is crystal clear that unfunded mandates are harmful and counterproductive.
this report out of UCLA found that for every low income (ELI) unit created with inclusionary zoning (IZ) roughly 5 total units were lost due to the tax on housing. it also concluded rents stabilized without IZ vs with it
🥳Our paper "Iterative Preference Learning from Human Feedback: Bridging Theory and Practice for RLHF under KL-Constraint" is accepted by ICML2024 (also an ORAL presentation at ICLR ME-FoMo workshop)! - Problem formulation: we first formally formulate the RLHF as a…
bullish on more parameters tbh sadly bearish on more vram @ home lmao
Incidentally, what would jumpstart faster slightly denser “missing middle” home construction in Hawaii: * Permitting reform (esp automatic issuance if departments take longer than a few weeks) because now simple “leaky roof fixing” permits take 2+ years * Minimum-lot-size…
truly it has been a whole group effort - so, so proud of EVERYONE who participated in this grueling process and i do mean EVERYONE who spent the time to think, worry, read, write, and testify about our housing issues! THANK YOU FOR CARING 👏🏻👏🏻👏🏻
Many many thanks to @LukeEvslin @stanleypchang @mpopv @sterlinghiga And all the various groups that worked so hard on this: @hiyimby @hawaiisfuture @grassroothawaii @AARPHawaii and anyone else I'm missing.
It happened. The first actual pro-housing #YIMBY statewide bill in Hawaii has passed both houses of the state legislature! What SB3202 does (link to bill in 🧵): 1. Requires counties to authorize rental triplexes (via ADU) on all residential housing lots statewide, with a…
A huge, huge come-from-behind victory in Hawaiʻi. Many fearlessly dedicated people worked tirelessly to make this possible, none more so than House Housing Chair and breakout YIMBY champion @LukeEvslin.
Victory! It's a historic day for the fight against Hawaiʻi's housing crisis. Along with legalizing mixed-use housing in business zones, the state legislature just passed 3 units per lot across all urban zones, unlocking tens of thousands of new housing units! ❤️❤️❤️🏘️🏘️🏘️🎉🎉🎉
Undoubtedly, it is Raffel et al (2020), the T5 paper, which came earlier. You can see the beginnings of supervised instruction/prompting there (see red highlights) and it was the first ever paper to show you can use formulate any task as a text to text task and train multiple…
Stiennon et al. (2020). The first paper I know that used RLHF+PPO to finetune LLMs to follow human instructions (here: specifically summarizing texts). That was even 2 years (!) before InstructGPT. arxiv.org/abs/2009.01325
😡😡😡 fear mongering using attention-grabbing words, same as that monster lot nonsense from earlier this year WHY? because it is a NIMBY tactic to achieve keeping the current system in place, which primarily harms renters and young working people #Honolulu #Oahu
A bill to legalize an additional ADU is on the cusp of passing this week in Hawai‘i and the NIMBYs are getting increasingly panicked. Here’s the Honolulu Council Chair trying to convince people that building more ADUs is gonna make housing… more expensive.
gosh this sounds so familiar FOR SOME REASON yes, looking directly at you #Honolulu #Oahu councilmember NIMBYS especially the ones who are DEMOCRATS 😡😡😡 THREAD - start at the top
@FellateMinion Democratic NIMBYs in the Boston area plus faux-libertarian Republican NIMBYs in NH state government. NH finally passed some modest reforms this year but there were some hilarious quotes from republicans who opposed it
he’s like 14 years old here. if these products were being built by children, that would be a fair defense for them sucking. but they’re built by adult “Apple graduates” (🥁✨🥳🎉).
If @MKBHD decided his initial videos were "barely reviewable" instead of posting and iterating, would he be where he is today? 🤔
The barrier to entry is quite large too. One requires paying $8,100 annually for maintenance and insurance while the other is just $80/month for a HOLO Card monthly pass.
Trends for United States
You might like
