Filip Pavetić @FPavetic

Joined April 2022

Tweets

32
Followers

51
Following

136
Likes

210

Antoine Yang @AntoineYang2

4 months ago

Thrilled to share our latest advances in video understanding 📽️: Gemini 2.5 Pro is a truly magical model to play with, excelling in traditional video analysis and unlocking new use cases I could not imagine a few months ago🪄 More in 🧵 and @Google blog: developers.googleblog.com/en/gemini-2-5-…

11 51 382 123K 172

Antoine Yang @AntoineYang2

9 months ago

Gemini 2.0 Flash's video understanding is here 🚀 Think: search in videos via timecodes, extract text from moving camera footage, analyze screen recordings in real-time interactions with native audio out 🔊 Come and try it aistudio.google.com 😀 youtu.be/Mot-JEU26GQ?si…

2 11 82 9K 21

Basil Mustafa @_basilM

9 months ago

amazing work from video understanding jesus @AntoineYang2 alongside @MarioLucic_ @FPavetic @skprat and many others! they've been bringing better, faster video reasoning to a whole new level and have so much more in store ✨🚀♊

Antoine Yang @AntoineYang2

9 months ago

2 11 82 9K 21

0 2 20 2K 1

Ibrahim Alabdulmohsin | إبراهيم العبدالمحسن @ibomohsin

9 months ago

Attending #NeurIPS2024? If you're interested in multimodal systems, building inclusive & culturally aware models, and how fractals relate to LLMs, we've 3 posters for you. I look forward to presenting them on behalf of our GDM team @ Zurich & collaborators. Details below (1/4)

2 7 23 2K 5

Lucas Beyer (bl16) @giffmana

2 years ago

🧶PaLI-3 achieves SOTA across many vision-language (and video!) tasks while being 10x smaller than its predecessor PaLI-X. At only 5B parameters, it's also smaller (and stronger) than the concurrent Fuyu-8B model, though sadly we cannot release the model (props to @AdeptAILabs)

9 58 436 123K 211

Download Image

Piotr Padlewski @PiotrPadlewski

2 years ago

TL;DR I was too lazy to keep a fork of MHA, and I was too tired of my exps blowing up due to too high LR. I am still amazed how useful this is even for small models - I can pre-train [Na]-ViT with 1e-2 (previously it blew up at ~5e-3). Try it out!

Basil Mustafa @_basilM

2 years ago

0 5 35 12K 16

1 4 30 20K 12

Download Image

Carlos Riquelme @rikelhood

2 years ago

Sparsity is one of the most promising areas in deep learning (tokens follow different routes in the model). However, these discrete decisions are messy to handle & optimize. Today we introduce Soft-MoE. The idea is simple: Don't route tokens, route linear combinations of them.

4 48 332 48K 151

Download Image

Joan Puigcerver @joapuipe

2 years ago

Introducing Soft MoE! Sparse MoEs are a popular method for increasing the model size without increasing its cost, but they come with several issues. Soft MoEs avoid them and significantly outperform ViT and different Sparse MoEs on image classification. arxiv.org/abs/2308.00951

5 61 245 79K 124

Piotr Padlewski @PiotrPadlewski

2 years ago

I will be at ICML presenting ViT-22B! Feel free to grab me if you want to chat about it.

3 12 61 6K 7

Download Image

Mostafa Dehghani @m__dehghani

2 years ago

NaViT (arxiv.org/abs/2307.06304) sets us free from square boxes and lets us think outside the box! Let creativity flow and go for the natural designs we've always wanted in ViTs. I share a few cool ideas that are made possible with NaViT:

Mostafa Dehghani @m__dehghani

2 years ago

24 10 108 51K 60

Download Image

1 19 105 29K 56

Mostafa Dehghani @m__dehghani

2 years ago

Mostafa Dehghani @m__dehghani

2 years ago

13 149 611 144K 307

Download Image

0 1 3 803 0

Neil Houlsby @neilhoulsby

2 years ago

At CVPR? Three papers from the Google Deepmind (formerly Brain) Vision team in in Berlin/Zürich/Amsterdam (+collaborators) there. If interested in the work or the team, track down the authors!

3 35 146 22K 58

Download Image

Piotr Padlewski @PiotrPadlewski

2 years ago

Quick summary of our recent work on scaling Vision Transformers - solving stability issues, making training more efficient and cool results: ai.googleblog.com/2023/03/scalin…

1 8 32 6K 8

Google AI @GoogleAI

2 years ago

Learn about ViT-22B, the result of our latest work on scaling vision transformers to create the largest dense vision model. With improvements to both the stability and efficiency of training, ViT-22B advances the state of the art on many vision tasks → ai.googleblog.com/2023/03/scalin…

34 130 534 188K 103

Download Gif

Basil Mustafa @_basilM

3 years ago

2️⃣2️⃣🅱️: We trained a 22B parameter ViT model, and scale continues to prove its merit! I want to zero in on an aspect of this which is useful however at all scales: a method for improving training stability in transformers. arxiv.org/abs/2302.05442

4 22 177 39K 63

Andreas Steiner @AndreasPSteiner

3 years ago

Scaling Vision Transformers to 22 billion parameters continues to improve ImageNet and OOD classification. And while ImageNet top1-accuracy seems to saturate short of 91% after fine-tuning, ObjectNet accuracy continues to increase, resulting in better effective robustness.

Mostafa Dehghani @m__dehghani

3 years ago

1 0 13 12K 0

2 5 52 10K 4

Download Image

Mostafa Dehghani @m__dehghani

3 years ago

1/ There is a huge headroom for improving capabilities of our vision models and given the lessons we've learned from LLMs, scaling is a promising bet. We are introducing ViT-22B, the largest vision backbone reported to date: arxiv.org/abs/2302.05442

12 129 789 311K 234

Download Image

Joan Puigcerver @joapuipe

3 years ago

Basil and I will present this work, today at @NeurIPSConf. Join us at 4pm in the 2nd poster session!

Basil Mustafa @_basilM

3 years ago

Basil and I will present this work, today at @NeurIPSConf. Join us at 4pm in the 2nd poster session!

3 39 199 0 53

Download Image

0 4 11 0 7

Basil Mustafa @_basilM

3 years ago

Beep beep! Introducing LIMoE, the Language Image Mixture of Experts: a single model, processing both modalities for contrastive image-text modelling. Cruises straight to 84.1% 0shot ImageNet accuracy without any modality-specific architectures or pre-training. (1/10)

3 39 199 0 53

Download Image

Google AI @GoogleAI

3 years ago

Stop by the Google booth at #ECCV2022 at 3:30 pm today to see a demo presented by Austin Stone, @MJLM3 and @agritsenko about OWL-ViT, a simple and scalable approach for open-vocabulary object detection and image-conditioned detection. Try it yourself at bit.ly/owl-vit-demo.