Taming Transformers for High-Resolution Image Synthesis github.com/CompVis/taming… impressive work/results! (also fun to see a shoutout and my minGPT code used for the transformer :))
Today we announce a novel, open-source method for text generation tasks (e.g., summarization or sentence fusion), which uses edit operations instead of generating text from scratch, leading to less errors and faster model execution. Read about it below. goo.gle/38XfRXU
"An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling" arxiv.org/abs/1803.01271 good to see more papers on the topic - always start with a CNN before reaching for an RNN. You'll be surprised with how far you can get.
Ants use the rate at which they meet and smell other ants to decide what to do next. A neuron uses the rate at which it is stimulated by other neurons to decide whether to fire. Memory arises from changes in how they connect and stimulate each other. 🐜🧠
aeon.co/ideas/an-ant-c…
1/ This shows how far the field has regressed in its understanding of probability.
It's not a controversial opion, it's the opinion of someone who hasn't understood that a prior over weights in a neural network induces a prior over functions.
1/ This shows how far the field has regressed in its understanding of probability.
It's not a controversial opion, it's the opinion of someone who hasn't understood that a prior over weights in a neural network induces a prior over functions.
Happy to release NN4NLP-concepts! github.com/neulab/nn4nlp-…
It's a typology of important concepts that you should know to implement SOTA NLP models using neural nets: github.com/neulab/nn4nlp-… 1/3
We'll reference this in CMU CS11-747 this year, trying to maximize coverage. 1/3
Happy to release NN4NLP-concepts! github.com/neulab/nn4nlp-…
It's a typology of important concepts that you should know to implement SOTA NLP models using neural nets: github.com/neulab/nn4nlp-… 1/3
We'll reference this in CMU CS11-747 this year, trying to maximize coverage. 1/3 https://t.co/ILFeobZmPM
Ok, people! Are you looking for something to read at the intersection of machine learning and HCI?
Three new papers posted online today that you should check out, all with my amazing colleague/BFF @hannawallach!
Ready? I'm gonna try a thread!
Recent language models like BERT and ERNIE rely on trendy layers based on transformer networks and require lots of compute. Deep learning researcher @Smerity shows these layers and enormous GPUs may not be necessary: bit.ly/2QZXxWV
Consider: millions of years ago our antecedents gave a massive sacrifice of their left hemisphere.
We lost a tremendous amount of short term memory and replaced it with Broca’s, Wernicke & the phonological loop.
But why?
So we can—talk.
Thus chimpanzees can do this—we can’t:
These books shaped my last decade, and since it was my coming-of-age, these books shaped who I am.
I've coerced some of my friends to show me their lists and loved everything I saw. I would love to see your list too :-)
huyenchip.com/2019/12/28/boo…
What does a pruned deep neural network "forget"?
Very excited to share our recent work w Aaron Courville, Yann Dauphin and @DreFrome
weightpruningdamage.github.io
There are now 3 papers that successfully use Self-Supervised Learning for visual feature learning:
MoCo: arxiv.org/abs/1911.05722
PIRL: arxiv.org/abs/1912.01991
And this, below.
All three use some form of Siamese net.
There are now 3 papers that successfully use Self-Supervised Learning for visual feature learning:
MoCo: arxiv.org/abs/1911.05722
PIRL: arxiv.org/abs/1912.01991
And this, below.
All three use some form of Siamese net.
To learn how to design machine learning systems, I find it really helpful to read case studies to see how great teams deal with different deployment requirements and constraints. Here are some of my favorite case studies.
106 Followers 1K FollowingMaine nights, red wine spilling, lingerie slipping. 21, Spanish American and aching for DICK that hits just right. FREE LINK below ⬇️
1K Followers 5K FollowingThe conference is intended for emergency services, LEA, military and manufacturers and experts in the field of autonomous systems and technology.
648 Followers 2K FollowingNimble Engineers, Finding Insights. Helping businesses predict the future - greatly improving business impact through state-of-the-art AI and ML
86K Followers 8K FollowingCompiling in real-time, the race towards AGI.
🗞️ Don't miss my daily top 1% AI analysis newsletter directly to your inbox 👉 https://t.co/6LBxO8215l
146K Followers 32 FollowingMakers of Devin, the first AI software engineer. We are an applied AI lab building end-to-end software agents. Join us: https://t.co/JZDd4Vik4P
16K Followers 454 Following"The Kafka Guy" 🧠
Have worked on Apache Kafka for 6+ years, now I write about it. (& the general data space)
Low-frequency, highly-technical tweets. ✌️
3K Followers 337 FollowingAuthor of Crawl4AI (#1 GitHub Trending). Founder of Kidocode, SE Asia's largest tech & biz school. Leading AI research on synthetic data, AI consultant.
155K Followers 0 FollowingThe free and flexible app for your private thoughts. For help and deeper discussions, join our community: https://t.co/QsDArfFkkv
10K Followers 11 FollowingWe're making personal finance simple, easy and delightful ● https://t.co/AyuXpBpFg1 ● Bugs & requests https://t.co/GRgm8Sb7nv ● A part of @2586labs
165K Followers 579 FollowingYour city. Your neighborhood. Your block. Covered for you by https://t.co/BvHiVasLO8 Follow us on FB: https://t.co/jGJVvOnQIE and Instagram: @toibengaluru
3K Followers 36 FollowingBuilding https://t.co/HQJ6AuzcZU @DrDroidDev
Previously @Accel @IITDelhi
I love biking & hiking. Sometimes write at https://t.co/QuL6Ik5lbN
637K Followers 35 FollowingWe're an AI safety and research company that builds reliable, interpretable, and steerable AI systems. Talk to our AI assistant @claudeai on https://t.co/FhDI3KQh0n.
27K Followers 154 FollowingA citizens' voice for urban India. Fighting for sustainable, accountable, people-first cities. We demand roads, drains, metros, trees, and truth. 🌳🛣️🚇🚰
49K Followers 60 FollowingWe are a SEBI-registered Portfolio Management Service offering long-term wealth-building with effective investment strategies.
More: https://t.co/5bJsJLyLyW
76K Followers 13K FollowingNewsletter exploring AI&ML - AI 101, Agentic Workflow, Business insights. From ML history to AI trends. Led by @kseniase_ Know what you are talking about👇🏼
8K Followers 10 FollowingNews and updates from ShareChat - India’s largest homegrown social media company.
All things trending - @ShareChatTweets
All things joyous - @mojappofficial
391 Followers 829 FollowingRebaca is a niche player in the Telecom and OTT streaming video domain. We focus on Video Delivery & Consumption, 4G/5G software development & Test Automation.
50K Followers 403 Following@AnthropicAI. Prev. @Google Brain/DeepMind, founding team @OpenAI. Computer scientist; inventor of the VAE, Adam optimizer, and other methods. ML PhD.
3K Followers 2K FollowingEach episode of The Thesis Review is a conversation centered around a researcher's PhD thesis, and how their research has evolved since. Hosted by @wellecks.
5.6M Followers 18 FollowingIn the world of Teyvat — where all kinds of elemental powers constantly surge — epic adventures await, fearless Travelers! #GenshinImpact
451K Followers 77 FollowingTensors and neural networks in Python with strong hardware acceleration. PyTorch is an open source project at the Linux Foundation. #PyTorchFoundation