Qingqing Cao @awk_ai

Research Scientist @apple  AIML, Previously Postdoc @uwnlp & PhD @sbucompsc. Efficient #NLProc, on-device AI, mobile computing. awk.ai Seattle Joined July 2014

Tweets

148
Followers

586
Following

570
Likes

440

Ruoming Pang @ruomingpang

2 months ago

In this report we describe the 2025 Apple Foundation Models ("AFM"). We also introduce the new Foundation Models framework, which gives app developers direct access to the on-device AFM model. machinelearning.apple.com/research/apple…

511 93 458 59K 212

Maxwell Horton @mchorton1991

11 months ago

1/ KV Prediction for Improved Time to First Token Tired of waiting forever for your on-device LLM to begin outputting tokens? I know I am. In our latest preprint, we investigate a method for improving time to first token (TTFT) for on-device models by predicting a model’s KV…

1 1 6 1K 2

Download Image

Bowen Zhao @BowenROIM

a year ago

@awk_ai @HannaHajishirzi Can’t run billion-level LLMs efficiently? Take a look at our work: APT. We are excited to share our #ICML2024 oral paper, “APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference”. Paper: shorturl.at/xabJl

1 4 10 1K 2

Download Image

Qingqing Cao @awk_ai

a year ago

Thank you Akari for the help!

Akari Asai @AkariAsai

a year ago

Thank you Akari for the help!

0 4 17 3K 2

Download Image

0 0 1 493 0

Sachin @sacmehtauw

a year ago

Like OpenELM, CatLIP is also "Open" github.com/apple/corenet

AK @_akhaliq

a year ago

Like OpenELM, CatLIP is also "Open" github.com/apple/corenet

3 78 403 53K 223

Download Image

0 6 15 2K 3

AK @_akhaliq

a year ago

Apple presents OpenELM An Efficient Language Model Family with Open-source Training and Inference Framework The reproducibility and transparency of large language models are crucial for advancing open research, ensuring the trustworthiness of results, and

7 101 564 174K 280

Download Image

Tal Schuster @TalSchuster

2 years ago

I'll be moderating an Efficiency in #NLProc Panel at the #SustaiNLP 🌿 workshop at #ACL2023 this Thursday. We have top leaders from Academia and Industry: @DrorRotem, @myleott, @sysnlp, @sarahookr Any questions you would like to ask? Post here or join the panel!

3 7 25 5K 1

Akari Asai @AkariAsai

2 years ago

Don't miss our #ACL2023 tutorial on Retrieval-based LMs and Applications this Sunday! acl2023-retrieval-lm.github.io with @sewon__min, @ZexuanZhong, @danqi_chen We'll cover everything from architecture design and training to exploring applications and tackling open challenges! [1/2]

6 105 492 90K 145

Download Image

Aditya Kusupati @adityakusupati

2 years ago

Introducing💃AdANNS: A Framework for Adaptive Semantic Search🕺 TL;DR: Up to 90× faster nearest neighbor retrieval and 2× lower memory cost for web-scale search. Applies to vector search at scale & improves all "retrieval" augmented models! arxiv.org/abs/2305.19435 [1/8]

5 90 475 91K 254

Download Image

Artidoro Pagnoni @ArtidoroPagnoni

2 years ago

4-bit QLoRA is here to equalize the playing field for LLM exploration. You can now fine-tune a state-of-the-art 65B chatbot on one GPU in 24h. Paper: arxiv.org/abs/2305.14314 Code and Demo: github.com/artidoro/qlora

Tim Dettmers @Tim_Dettmers

2 years ago

82 921 4K 1.6M 2K

Download Image

6 47 225 81K 103

Marcos Treviso @MarcosTreviso

2 years ago

Looking for valuable insights and carefully curated pointers on efficient NLP research directions? 🔎 Check out our updated survey covering an extensive range of topics in the classic NLP pipeline 🚀: arxiv.org/abs/2209.00099 Product of an amazing collaborative team effort! 🤝

Leon Derczynski ✍🏻 🌞🏠🌲 @LeonDerczynski

2 years ago

6 79 293 36K 141

2 4 25 4K 6

Leon Derczynski ✍🏻 🌞🏠🌲 @LeonDerczynski

3 years ago

How can NLP be more efficient? We can't blindly scale forever. This survey I'm lucky to be part of presents current efficiency research at many stages of the NLP process, and actionable advice to practitioners for making their NLP more efficient. arxiv.org/abs/2209.00099 #nlproc

8 74 295 0 107

Qingqing Cao @awk_ai

3 years ago

I'll be at #NAACL2022 this week, my first ever in-person #nlproc conf since I joined the @uwnlp group at the University of Washington. I'm happy to chat about efficient #nlproc (QA, retrieval, vision-language models, etc.) or postdoc at UW, life in Seattle.