TasksWithCode @TasksWithCode

We spotlight ML researchers & practitioners. High (S) fact: ~50% code contributors to ML paper implementations are practitioners collaborating with researchers authorswithcode.org Joined November 2021

Tweets

684
Followers

478
Following

3K
Likes

74

TasksWithCode @TasksWithCode

a year ago

Jacob Pachocki, (OpenAI's new chief scientist's) paper contributions. authorswithcode.org/researchers/?a…

0 1 2 315 0

TasksWithCode @TasksWithCode

a year ago

We have been running authorswithcode.com service for over a year now. The number of paper authors contributing to machine learining has grown to 433k+ and code authors to 170k+. More features spotlighting researchers to come.

1 0 1 431 1

Download Image

TasksWithCode @TasksWithCode

2 years ago

This approach builds on the recent method of using 3D Gaussians to model scenes, enabling the quick and accurate creation of high-quality 3D images from photos or videos, even for large and complex scenes @xiaolonw's contributions authorswithcode.org/researchers/?a…

Xiaolong Wang @xiaolonw

2 years ago

4 57 297 76K 132

Download Video

0 0 1 675 0

TasksWithCode @TasksWithCode

2 years ago

It has been 10 years since the release of the word2vec paper. Word2vec is arguably the first model (if we can even call it that, considering its simplicity—it consists of just two arrays of vectors) to demonstrate the power of distributed representation learning. The training…

Google AI @GoogleAI

2 years ago

17 108 766 357K 58

Download Image

0 0 3 503 0

TasksWithCode @TasksWithCode

2 years ago

This paper introduces a new objective function for self-supervised learning (SSL) that leverages the geometric properties of manifolds to which input classes are mapped. The focus is on maximizing manifold capacity, which essentially measures the number of object categories that…

Teddy @tedyerxa

2 years ago

2 25 136 37K 70

Download Image

0 1 3 2K 0

TasksWithCode @TasksWithCode

2 years ago

This work shows that Large Language Models (LLMs) aligned with fine-tuning or Reinforcement Learning from Human Feedback (RLHF) are still susceptible to prompt attacks that can reveal the training data memorized by the model. It is a known fact that base models tend to memorize…

0 1 2 496 0

Download Image

TasksWithCode @TasksWithCode

2 years ago

Andrej Karpathy continues to be the few biological agents whose world model is worth sampling from for nuggets of insights on LLMs youtu.be/zjkBMFhNj_g?si…

0 0 0 316 0

TasksWithCode @TasksWithCode

2 years ago

A thoughtful answer to the question - LLMs have been practically exposed to the entire corpus of human knowledge and still have not made connections that have led to a discovery, at least not yet. Eric's contributions to research authorswithcode.org/researchers/?a…

Eric J. Michaud @ericjmichaud_

2 years ago

14 55 828 148K 881

0 0 1 497 0

TasksWithCode @TasksWithCode

2 years ago

For anyone planning to efficiently fine tune a LLM, this article by @rasbt on LoRA could be helpful. He explains with clarity the trade-offs to consider such as choice of quantizing pretrained weights, choice of optimizers (Adam vs SGD), impact of schedulers etc. What is LoRA?…

0 0 5 886 1

TasksWithCode @TasksWithCode

2 years ago

An approach for distributed training of LLM where pretraining is performed in parallel on multiple nodes and can have a large number of training steps (compared to typical Federated averaging). The model parameters are sent to a central server that finds the average change in…

0 0 0 343 0

TasksWithCode @TasksWithCode

2 years ago

This paper explores a combination of approaches to filter the input to a generator to improve RAG performance Zora's (@ZhiruoW) contribution to research. Code is also released (models used FLAN-T5 and LLAMA-2) It suggests a combination of methods to filter irrelevant content…

Zora Wang @ZhiruoW

2 years ago

6 56 284 51K 219

0 0 3 591 1

Download Image

TasksWithCode @TasksWithCode

2 years ago

This unforgiving retrospective analysis on the anniversary of Galactica release, by its first author, @rosstaylor90, sets a high bar for researchers - it underscores the importance of releasing work for feedback and continual improvement, even if it is a work in progress.…

Ross Taylor @rosstaylor90

2 years ago

90 311 3K 960K 746

0 0 1 556 0

TasksWithCode @TasksWithCode

2 years ago

It is worth noting that the Consistency Decoder, which OpenAI open-sourced last week, builds on prior research from late December 2021, also open-sourced by @robrombach and @pess_r. The Consistency Decoder generates images by working on the latent space output of a VQGAN, an…