You just need to take a good look at all the older people who didn't get to live the life they wanted, and it will become obvious that the causes are always the same, generation after generation:
The incredibly clever trick that all frontier AI labs use which makes LLMs so fabulously powerful: they barely regularize at all, resulting in models which are massively overfit. This would be a problem, except they’re overfit to the domain of all human cultural knowledge.
I am building a cooking pan. 3 years ago I asked myself, "if I threw budget out the window, and made the best possible pan that won't be ITAR-restricted, what would I do?"
Finally got around to it. Sintered, mirror polished silicon carbide. Single block machined carbon steel.…
first i thought scaling laws originated in OpenAI (2020)
then i thought they came from Baidu (2017)
now i am enlightened:
Scaling Laws were first explored at Bell Labs (1993)
In high school I had a physics class where the teacher had us do the experiments *before* explaining the concepts they were meant to demonstrate, as God intended.
So we measured the temperature of a hot glass of water and a cold block of aluminum of equal mass, then put the…
In high school I had a physics class where the teacher had us do the experiments *before* explaining the concepts they were meant to demonstrate, as God intended.
So we measured the temperature of a hot glass of water and a cold block of aluminum of equal mass, then put the…
“Somni” is the biggest, most ambitious project we have undertaken in 21 years as a band. It involved 74 musicians, 256 lines, 12 cameras, almost 1,000 live audience members, and a whole lot of love and care from everyone involved.
i have no idea how “I look like my parents and my kids look like me” didn’t immediately lead every scientist and general person with a brain to theory of evolution five seconds later. it only takes one more recursive hop, it’s a tree like this all the way up, so tiny
companies like Facebook record every imaginable interaction their users have with the platform. they log each of your clicks and taps. they keep track of how long your gaze lingered on a post, whether you were on the same WiFi as that woman who might be your friend, which…
Hinton ~1983 thought Boltzmann Machines > backprop, but debugged himself out of the infatuation
Boltzmann Machines failed to learn, so he printed out weights, 8 cm thick, and inspected them for weeks
it's the dreaded local minimum
so 1 yr later, in desperation, he tried backprop
Hinton ~1983 thought Boltzmann Machines > backprop, but debugged himself out of the infatuation
Boltzmann Machines failed to learn, so he printed out weights, 8 cm thick, and inspected them for weeks
it's the dreaded local minimum
so 1 yr later, in desperation, he tried backprop https://t.co/kDzpzUWCwq
My first substack post is about my misguided attempt to convince the effective altruism community to become socialists, and how this backfired completely. Link below.
don’t build slot machines
don’t fake humans
don’t hide the messy truths
don’t create black boxes
don’t make people feel stupid
don’t extract value or attention
don’t optimize for vanity metrics
don’t gatekeep knowledge
don’t make tools that divide
don’t sacrifice agency for…
Borges at eighty:
“I think that one should never use words like ‘the best’ or ‘the first,’ since those words carry no conviction and only lead to arguments. Beauty is not something rare. […] For example, I know nothing whatever about Hungarian poetry, and yet I am sure that [+]
To get “out of our heads,” sometimes we have to get fully into our heads first.
Thoughts usually come with both sensory component and conceptual components.
For “overthinkers” the sensation of a thought often feels like a light tingling in their brain.
Or a tightness, pressure…
To get “out of our heads,” sometimes we have to get fully into our heads first.
Thoughts usually come with both sensory component and conceptual components.
For “overthinkers” the sensation of a thought often feels like a light tingling in their brain.
Or a tightness, pressure…
Dopamine from information gathering is a dangerous drug. Your entire life will change the moment you stop looking for more information and start acting on the information you already have. Always get your dopamine from action.
82 Followers 430 FollowingBusiness Development
HR-manager of the @XeonusDex company.
Cryptoinvestor, NFT holder.
ETH | BTC | SOL
Write to DM for promotional offers.
45K Followers 64 FollowingStudent of mind and nature, libertarian, chess player, cancer survivor. @ Keen, UAlberta, Amii, https://t.co/u8za2Kod54, The Royal Society, Turing Award
15K Followers 3K FollowingMemetics science writer / open memetics evangelist. Basically trying to do culture engineering transparently. Does that make sense?
14K Followers 407 FollowingI write essays at https://t.co/Tf2yohMyM1
Right now thinking about writing-as-thinking, relationships, self-cultivation, LLMs
243K Followers 2K FollowingSign up for my new newsletter! (Link below) Also: Co-author of Abundance, host of Plain English, and contributing writer at The Atlantic.
91K Followers 2K Followingillustrator: religion, art, parenting, modern life. comics in highlights tab. you can find everything i do here: https://t.co/uzxC71XMGI
331 Followers 236 FollowingDedicated to the conservation, protection, and greater understanding of the Chagos Archipelago - a unique and precious environment in the Indian Ocean 🌊
6K Followers 339 Followingexploring unanticipated model behaviours, including the emergence of art, personae, and jailbreaking techniques latent in the training data 🌒✍️
6K Followers 245 FollowingHead of Recruiting @OpenAI. Former Head of Preparedness @OpenAI. AI research and engineering at LinkedIn, Meta and Microsoft before that.
10K Followers 798 FollowingThinking about whether AI will destroy the world at https://t.co/pMilDvd4ya. DM or email for media requests. Feedback: https://t.co/zGAm1i7SKH
416K Followers 2K Following@Shopify CEO by day, Dad in evening, hacker at night. Aspiring comprehensivist. (tweets auto delete eventually) retweet=noteworthy share, not endorsement
31K Followers 1K Followingbased postdoctoral researcher in ai. on trial in south korea for writing true things (see highlights). also building japanese language learning app @sottaku_app
19K Followers 143 FollowingI am an Astrobiologist, retired Anesthesiologist and lead The Science of Consciousness conferences at The University of Arizona.
50K Followers 884 FollowingAssistant professor (of mathematics) at the University of Toronto. Algebraic geometry, number theory, forever distracted and confused, etc. He/him.
92K Followers 207 FollowingLMArena: Open Platform for Community-driven AI Benchmarking. Graduated from UC Berkeley / @lmsysorg. We’re hiring: https://t.co/1OkfLq2n0I
4K Followers 861 FollowingMember of Technical Staff at @AnthropicAI. Making Claude more reliable. Matt Levine and Scott Alexander fan. Prev SRE @Google and FDE @PalantirTech.
No recent Favorites. New Favorites will appear here.