Ph.D. Student @UNCC! 🔬 about dialog systems! Past: Applied Research Intern @Amazon, Research Intern @NvidiaAI, @Walmart and @IITMadrassashank06.github.ioJoined November 2015
We received this heartbreaking email by someone who was falsely accused of using "AI" to generate an essay & got a ZERO on their assignment. How many people's lives are being ruined like this? This should be unacceptable. Are there any journalists investigating stuff like this?
🚨 New work: BlenderBot 3x 🚨
- Public data release & analysis of 6M chat interactions.
- Learns by conversing with people in the real world: training on this data improves BB3 from 85.3% → 94.4% good messages.
paper: arxiv.org/abs/2306.04707
project: parl.ai/projects/bb3x/
Please RT
Are you a *PhD* student conducting research on generative models? Are you excited about #ResponsibleAI aspects of generation? We are looking to host a student researcher/#internship in 2023. Please get in touch via *email*.
P.S. I'll be at #NeurIPS2022 and #emnlp2022
I've been comparing a lot of transformer variants on large models (400M params): Post/Pre-LN, DeepNet, NormFormers, Swin v2, GLU variants, RMSNorm, Sandwich LN, with GELU, Swish, SmeLU…
More than 2,000h of total training time on TPU v3's 😯
Here are my findings 🤓
🚨 New work 🚨
SeeKeR: An open source search-augmented language model
- uses a search engine to stay up-to-date
- hallucinates less & is more topical than GPT2 or GPT3, with less parameters
- applied to dialogue, superior to BlenderBot 2
Read more here: parl.ai/projects/seeker
How do you make a transformer recurrent?
You just turn the transformer 90 degree, and apply it in the lateral direction!
Now, with recurrence, the context size is infinite!
Let's make the recurrence great again with Block-Recurrent Transformers: arxiv.org/abs/2203.07852
How do you make a transformer recurrent?
You just turn the transformer 90 degree, and apply it in the lateral direction!
Now, with recurrence, the context size is infinite!
Let's make the recurrence great again with Block-Recurrent Transformers: arxiv.org/abs/2203.07852 https://t.co/mh1Tg0gVdh
I'm extremely grateful to @StanfordOnline for making my 2021 Natural Language Understanding course videos accessible and available on YouTube. I've created a version of the 2021 course site with direct links to the YouTube videos: web.stanford.edu/class/cs224u/2…
INLG 2022 will be 18-22 July, in Colby College (Waterville, Maine, USA)!
Calls for papers, workshops, etc available at
inlgmeeting.github.io/calls.html
I thought @ReviewAcl was supposed to reduce the workload on the reviewers as well. Assigning 5 papers to be reviewed with 15 days does not help out one bit.
Work on academic Groupthink effect.
"When the number of papers published per year...grows large, citations flow disproportionately to already well-cited papers; the list of most-cited papers ossifies; new papers are ... unlikely to disrupt existing work." pnas.org/content/118/41…
🎁🎁🎁 1M Mega-Giveaway: @mattswider will reach 1 million followers soon. Matt + @techradar are giving away consoles + accessories to celebrate🥳
👉How to enter: mttswdr.co/giveaway
♻️♻️RT this
✅ PS5 bundle
✅ Xbox Series X
✅ Zelda JoyCons
Ends when Matt Swider hits 1M
We're delaying the INLG submission deadline and allowing submission via ACL Rolling Review (@ReviewAcl) as well!
Updated CFP to come, but in the meantime:
15 June submission deadline;
19 July notification; and
12 August camera-ready submissions due.
Please retweet and share :)
How you/we can help --> a thread of threads on useful (live-updating) info/awareness/resources/oxygen/donating/volunteering/calling/service... #CovidIndiaHelp
3K Followers 4K FollowingStaff Research Scientist at Google DeepMind. Former adjunct assistant prof at @NYU_Courant. PhD at @mldcmu. ML for Bio/Chem (Prev. NLP).
All opinions my own.
42 Followers 2K FollowingI have a healthy and lovely daughter. She is always likable. Run a shoe factory. Meeting new people is always a good thing.
#coffee#travel
607 Followers 2K FollowingProfessional audio, voice, sound and music to scale. https://t.co/u5pqxbOgnX is the world's most powerful and scalable audio engine. #generativeai #aiaudio
338 Followers 374 FollowingTech Lead, Post-Training @cohere. PhD in Natural Language Processing @IxaGroup. Also interned at @Apple, @AIatMeta, @CNRS and @nyuniversity.
2K Followers 837 FollowingAI Researcher @CapitalOne AIF. Ex @TechAtBloomberg @BigScienceW @SFResearch @hkust. Working on multilingual and LLM #NLProc. Building @GrassrootsSci
67 Followers 632 FollowingCusqueño | Artificial Intelligence PhD(c) at https://t.co/9MIgcOaeAm - University of Campinas (@unicampoficial) | MSc. at Unicamp | Computer Science at @oficialUNSAAC
335 Followers 1K Followingsenior data scientist developing NLP systems. entry-level dad building apps for my sons that automate my parenting chores. occasionally i build stuff they like.
1K Followers 1K FollowingA central repository for pre-trained adapter modules in transformers! Active maintainers: @clifapt @h_sterz @LeonEnglaender @timo_imhof @PfeiffJo
637K Followers 35 FollowingWe're an AI safety and research company that builds reliable, interpretable, and steerable AI systems. Talk to our AI assistant @claudeai on https://t.co/FhDI3KQh0n.
10K Followers 4K Followingsth new // ex Gemini RL+Inference @GoogleDeepMind // Chat AI @Meta // RL Agents @EA // ML+Information Theory @MIT+@Harvard+@GeorgiaTech // زن زندگی آزادی
46K Followers 1K Following(On mat leave.) Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS.
10K Followers 1K FollowingWaiting on a robot body. All opinions are universal and held by both employers and family. Now a dedicated grok hate account.
Accepting ML/NLP PhD students.
8K Followers 2K FollowingAI research-eneur. Hiring eng: https://t.co/fv5QBjsv90. Was Research Scientist @ Google Brain / DeepMind, language model research. 🇨🇦🇺🇸
8K Followers 894 FollowingAssociate professor at NYU (Courant CS + Center for Data Science) | advisor for @bespokelabsai | large language models and NLP | he/him
3K Followers 4K FollowingStaff Research Scientist at Google DeepMind. Former adjunct assistant prof at @NYU_Courant. PhD at @mldcmu. ML for Bio/Chem (Prev. NLP).
All opinions my own.
15K Followers 50 FollowingEMNLP 2025 - The 2025 Conference on Empirical Methods in Natural Language Processing, 2025
Hashtag: #EMNLP2025
Dates: November 5-9
Submission Deadline: May 19th
2K Followers 95 FollowingI am a computer scientist who works on natural language generation and evaluation, often in healthcare contexts. I teach at Aberdeen University.
10K Followers 1K FollowingAssistant Professor @UBC_CS & @VectorInst working on Natural Language Processing. Book: https://t.co/aBnNW4HaQ3. 🦋: @veredshwartz.bsky.social