Not that many systems handle 6B QPS. 😀
"Bigtable has been in continuous production use at Google for more than 15 years now, processing over 6 billion requests per second at peak and with over 10 exabytes of data under management. "
cloud.google.com/blog/products/…
I view my talk as a chance to exchange ideas w/ students. Some points I raised:
- Be interdisciplinary, à la A. van Leeuwenhoek
- Read papers older than you
- On fast-evolving topics, my students outpace my knowledge
- My last serious coding session? During Obama's 1st term 😑
I view my talk as a chance to exchange ideas w/ students. Some points I raised:
- Be interdisciplinary, à la A. van Leeuwenhoek
- Read papers older than you
- On fast-evolving topics, my students outpace my knowledge
- My last serious coding session? During Obama's 1st term 😑
arxiv.org/abs/2105.04663 GSPMD aka "Sharding is all you need". Foundational work for Giant Models by Yuanzhong Xu et al! *generalized from
GShard backend system
This week we will be presenting three papers at #ICLR2021 each exploring a different aspect of multi-task/multilingual models at scale: (1) modeling (2) optimization and (3) large scale systems.
A statement signed by 150 people incl. Bill T. Jones, Wynton Marsalis, Jennifer Finney Boylan, Noam Chomsky, J.K. Rowling, Margaret Atwood, and Salman Rushdie expresses concern over the illiberal trend intensified by our national reckoning.
harpers.org/a-letter-on-ju…
@timnitGebru@kat_heller I absolutely don't condone anyone being personally attacked on social media. I just haven't seen this in my feed here.
If anyone reading this is part of attacking you or anyone else, I say this to you:
Please stop. Personal attacks have no place in scientific discourse.
Great work by @GoogleAI researchers @lepikhin, HyoukJoong Lee, Yuanzhong Xu, Dehao Chen, Orhan Firat, Yanping Huang, Maxim Krikun, Noam Shazeer, and Zhifeng Chen.
13.5 BLEU point gain is really significant!
Great work by @GoogleAI researchers @lepikhin, HyoukJoong Lee, Yuanzhong Xu, Dehao Chen, Orhan Firat, Yanping Huang, Maxim Krikun, Noam Shazeer, and Zhifeng Chen.
13.5 BLEU point gain is really significant!
67 Followers 353 FollowingInvesting in early stage AI. First partner to @lobehub , @klavis_ai , @LeptonAI (acq NVIDIA) etc. | co-founder of @EvalSysOrg | Views are my own
152 Followers 853 FollowingA language engineer playing with text and audio. Used to be a struggling newbie graduate student working on natural language processing and related stuff...
137 Followers 403 FollowingPh.D @Mila_Quebec| Ex. B.S @FudanUniv Research Intern @Apple @Shanghai AI Lab | Working on Multimodal Learning and Computer Vision
524 Followers 459 FollowingResearch Scientist @ Apple AIML | Prev: PhD@MMLab CUHK, Intern @AIatMeta (FAIR) and @samsungresearch. Working on foundation models.
9K Followers 865 Followingmts @ openai |
cs phd @ 🌁 uc berkeley |
building @vllm_project |
machine learning system |
the real agi is the friends we made along the way
28K Followers 284 FollowingEngineering Fellow at Google, working on the infrastructure powering Google Cloud and Google. Opinions are my own and are worth exactly what you pay for them.
8K Followers 1K FollowingRay and Stephanie Lane Professor of Computational Biology at CMU School of Computer Science @CMUCompBio @SCSatCMU @CarnegieMellon
176K Followers 17K FollowingThe Hoover Institution, within Stanford University, is a public policy research center promoting the principles of individual, economic, and political freedom.
201K Followers 195 FollowingOfficial account of composer Andrew Lloyd Webber. Creator of Phantom, Cats, JCS, Evita & more. Sharing news, milestones, and moments from his career.
1.5M Followers 155 FollowingA behind the scenes look at Anderson Cooper 360°. Watch AC360° M-F at 8pm/ET on @CNN and follow Anderson on twitter: @AndersonCooper.
22K Followers 1K FollowingOfficial account for the Sunnyvale Department of Public Safety. This account is not monitored 24/7. 9-1-1 for emergencies. 408-730-7100 for general inquiries.
2.1M Followers 601 FollowingThe official administration account of Governor Andrew M. Cuomo. This account is archived. For updates from New York State, follow @nygov.
544K Followers 422 FollowingIrvine mom & Consumer Protection Attorney. Former Congresswoman for #CA47. Running to be California's next Governor.
IG: KatiePorterOC
1.1M Followers 96 FollowingMinivan-driving single mom, law professor, consumer advocate 🚙👩🏻🏫 Usually carrying a whiteboard, always bringing the receipts 🧾
146K Followers 122 FollowingOfficial account of 3x Grammy-winning violin soloist Hilary Hahn. Creator of #100daysofpractice. She/her. I was an early blue check.
139K Followers 36 FollowingVancouver, Dec 10-15, 24. https://t.co/ga8aOw6yUO Tweets to this account are not monitored. Please send feedback to [email protected].
79K Followers 275 FollowingStudent of causal inference, human reasoning, and history of ideas, all viewed through the sharp lens of artificial intelligence.
2.2M Followers 2K FollowingNature Portfolio’s high-quality products and services across the life, physical, chemical and applied sciences is dedicated to serving the scientific community.
14K Followers 257 FollowingCo-lead of the GenMedia team working on Veo, Imagen, Genie, Nano Banana (aka Gemini-2.5-Flash-Image-Preview), ...
Research Scientist @ DeepMind
No recent Favorites. New Favorites will appear here.