Idempotent Learned Image Compression with Right-Inverse is accepted by NeurIPS 2023. We identify that invertibility of transform is sufficient but not necessary for idempotence. Instead, it can be relaxed into right-invertibility.
arxiv.org/abs/2207.14524
Learned image compression can be very fast: 145 fps for encoding and 208 fps for decoding on a Tesla T4 GPU for 1080p images. On CPU, the latency of our implementation is comparable with JPEG XL.
If you are interested in the cross-platform decoding of neural codec, you may want to read 'He, D., Yang, Z., Chen, Y., Zhang, Q., Qin, H. and Wang, Y., 2022. Post-training quantization for cross-platform learned image compression. arXiv preprint arXiv:2202.07513'
I think JPEG lossless recompression is important but is ignored currently: Guo, Lina, Xinjie Shi, Dailan He, Yuanyuan Wang, Rui Ma, Hongwei Qin, and Yan Wang. "Practical Learned Lossless JPEG Recompression with Multi-Level Cross-Channel Entropy Model in the DCT Domain." CVPR 2022
I think JPEG lossless recompression is important but is ignored currently: Guo, Lina, Xinjie Shi, Dailan He, Yuanyuan Wang, Rui Ma, Hongwei Qin, and Yan Wang. "Practical Learned Lossless JPEG Recompression with Multi-Level Cross-Channel Entropy Model in the DCT Domain." CVPR 2022
What's the coding theory behind Maxine? It is not only the rate-distortion. Our paper (arxiv.org/abs/2308.08154) propose a theoretical framework for conditional perceptual quality compression, which fits well with Maxine (the landmark as Y, the input GOP as X).
What's the coding theory behind Maxine? It is not only the rate-distortion. Our paper (arxiv.org/abs/2308.08154) propose a theoretical framework for conditional perceptual quality compression, which fits well with Maxine (the landmark as Y, the input GOP as X).
There're few who can deliver both great AI research and charismatic talks. OpenAI Chief Scientist @ilyasut is one of them.
I watched Ilya's lecture at Simons Institute, where he delved into why unsupervised learning works through the lens of compression.
Sharing my notes:
-…
@DrJimFan@ilyasut Given the recent hype of talking about "compression" in mainstream ML, I feel I need to shamelessly advertise our recent survey on neural data compression--a field that has existed for several years: nowpublishers.com/article/Detail…
After a heated debate with @ylecun (don't worry, no researchers were harmed), we need your input! In self-supervised learning, what should you do with the information of the input?🧠
🅰️ Compressing
🅱️ Not compressing
Get your votes in & let's settle this once and for all! 🗳️🎉
Our #ICML2023 workshop proposal "Structured Probabilistic Inference & Generative Modeling" has been accepted 🎉. We can't wait to engage in insightful discussions with experts in probabilistic ML and other areas at the beautiful Hawaii 🌴🏖️.
Check🔍: spigmworkshop.github.io
🎉Exciting news! Our "Neural Compression" workshop proposal has been accepted at #ICML 2023! Join us to explore the latest research developments, including perceptual losses and more compute-efficient models! @BerivanISIK, @YiboYang, @_dsevero, @karen_ullrich, @robamler
What can compression learn from AlphaZero and ChatGPT?
(1) AlphaCodec: Discovering better coding tools/codec with reinforcement learning instead of human efforts
(2) RLHF (reinforcement learning from human feedback) for visual quality optimization
What do you think?
248 Followers 761 FollowingPhD student at the University of Toronto @UofT. Previously, research intern @AIatMeta. Interested in LLM, Info Theory & Sampling. Compression ≠ AI.
294 Followers 1K FollowingProfessor @istecnico, ULisbon and researcher at IT. Multimedia signal processing and machine learning research. Looking for #phdstudents
2K Followers 738 FollowingPlumber for the Internet Pipes. I'm the (co-)designer of Jpegli, Brotli, Butteraugli, JPEG XL, Guetzli, WebP lossless, WOFF2, and Zopfli. Opinions are my own.
897 Followers 1K FollowingCPAL is a new annual research conference focused on the parsimonious, low dimensional structures that prevail in ML, signal processing, optimization, and beyond
22K Followers 1K FollowingBuilding AI that makes autonomous decisions using world models, artificial curiosity, and temporal abstraction @GoogleDeepMind
393 Followers 373 FollowingToward the next level of visual content creation. Ex @runwayml as a Foundational Contributor of Gen-3 alpha, Frames, and Gen-4. Opinions are my own.
2K Followers 501 FollowingChief Scientific Officer at Moonvalley working on visual intelligence. Previously Staff Research Scientist at Deepmind. I got PhD from Max Planck Institute.
38K Followers 166 FollowingProvider of Open Source multimedia for everyone!
Plays everything, Runs everywhere!
VLC, x264, dav1d, libdvdcss, libbluray and soooo many others...
10K Followers 4K Followingsth new // ex Gemini RL+Inference @GoogleDeepMind // Chat AI @Meta // RL Agents @EA // ML+Information Theory @MIT+@Harvard+@GeorgiaTech // زن زندگی آزادی
2K Followers 597 FollowingResearcher in machine learning/reinforcement learning/multi-agent cooperation. @turinginst @KingsCollegeLon Ex at @AI_UCL @UCLCS
2K Followers 655 FollowingResearch Scientist at @RealityLabs. Working on novel-view synthesis etc. Previously @UniofBath, #IVCI @Saar_Uni, #MPI_Informatik, @Inria, @Cambridge_Uni.
40 Followers 17 FollowingWorkshop at the International Symposium on Information Theory (ISIT) 2024. Learned/neural compression, rate-distortion theory, quantization, and more...
4K Followers 92 FollowingPhD, Distinguished Engineer @Sony, Lead Research Scientist/VP of AI Research @SonyAI_global, Head of Creative AI Lab, Former Associate Prof. @tokyotech_jp
53K Followers 4 FollowingThe most advanced AI upscaler & enhancer. Magnific can hallucinate and reimagine as many details as you wish (or none) guided by your own prompt and parameters!
63K Followers 2K FollowingResearch Scientist at Google DeepMind (WaveNet, Imagen, Veo). I tweet about deep learning (research + software), music, generative models (personal account).
1K Followers 1K FollowingAssistant Professor@Peking_University | Postdoc@CMU and ETH Zurich | Visitor@University of Oxford | PhD@UoT | Intern@IIAI and NEU
1K Followers 764 FollowingResearch Scientist at @AIatMeta GenAI, Postdoc at @MIT_CSAIL and PhD from @CarnegieMellon | Prev. @Apple AI/ML @MITIBMLab | Working on LLM post-training
4K Followers 47 FollowingI 👨🔬 a mathematical definition&theory of Artificial General Intelligence 🎥&🎤@ https://t.co/OZsooP92mn 🍀
I now work @GoogleDeepMind 🧠 History:🇩🇪🇨🇭🇦🇺🇬🇧
182K Followers 63 FollowingBuilding new freedoms of imagination for the world through pioneering research and design. Try Dream Machine for free → https://t.co/LmWmA4H803
3.3M Followers 810 FollowingThe industry standard in digital imaging and used by professionals worldwide for design, photography, video editing & more. | For Customer Support: @AdobeCare.
1K Followers 563 FollowingA leader at NAVER AI Lab & Guest Associate Professor at SNU AIIS. @Google PhD Fellow 2017 in Machine Learning. Former Research Intern at @Facebook AI Research.
46K Followers 1K Following(On mat leave.) Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS.
35K Followers 5K FollowingExperienced Data Science Leader | PhD in Machine Learning | 4x Author | Black Belt 🥋 in Time Series | Chief Conformal Prediction Promoter| Mathematician |
6K Followers 696 FollowingRL Scientist @OpenAI. Prev. co-founder @diffeo, acquired by @salesforce // co-authored The Principles of Deep Learning Theory // studied gravity.