Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > Video Encoding > New and alternative video codecs

Reply
 
Thread Tools Search this Thread Display Modes
Old 4th August 2022, 22:42   #1  |  Link
birdie
Artem S. Tashkinov
 
birdie's Avatar
 
Join Date: Dec 2006
Posts: 337
AlphaVC E2E AI codec

Quote:
Recently, learned video compression has drawn lots of attention and show a rapid development trend with promising results. However, the previous works still suffer from some criticial issues and have a performance gap with traditional compression standards in terms of widely used PSNR metric. In this paper, we propose several techniques to effectively improve the performance. First, to address the problem of accumulative error, we introduce a conditional-I-frame as the first frame in the GoP, which stabilizes the reconstructed quality and saves the bit-rate. Second, to efficiently improve the accuracy of inter prediction without increasing the complexity of decoder, we propose a pixel-to-feature motion prediction method at encoder side that helps us to obtain high-quality motion information. Third, we propose a probability-based entropy skipping method, which not only brings performance gain, but also greatly reduces the runtime of entropy coding. With these powerful techniques, this paper proposes AlphaVC, a high-performance and efficient learned video compression scheme. To the best of our knowledge, AlphaVC is the first E2E AI codec that exceeds the latest compression standard VVC on all common test datasets for both PSNR (-28.2% BD-rate saving) and MSSSIM (-52.2% BD-rate saving), and has very fast encoding (0.001x VVC) and decoding (1.69x VVC) speeds.
Paper: https://arxiv.org/abs/2207.14678
birdie is offline   Reply With Quote
Old 5th August 2022, 08:48   #2  |  Link
soresu
Registered User
 
Join Date: May 2005
Location: Swansea, Wales, UK
Posts: 196
Errr... 0.001x VVC is fast encoding?

I'm hoping this is just proof of concept code vs production code they are talking about bcuz that is daaayyuummm slow.
soresu is offline   Reply With Quote
Old 5th August 2022, 22:03   #3  |  Link
Zarxrax
Registered User
 
Join Date: Dec 2001
Posts: 1,219
Quote:
Originally Posted by soresu View Post
Errr... 0.001x VVC is fast encoding?

I'm hoping this is just proof of concept code vs production code they are talking about bcuz that is daaayyuummm slow.
Looking into the paper, it says the encoding speed is 715ms per frame, which I believe works out to about 1.4 fps.
More concerning is decoding speed at 379ms per frame though, which is way below real-time. And this is on a V100 GPU, so way out of consumer range at the moment.
Zarxrax is offline   Reply With Quote
Old 6th August 2022, 10:05   #4  |  Link
ksec
Registered User
 
Join Date: Mar 2020
Posts: 117
Quote:
PSNR (-28.2% BD-rate saving) and MSSSIM (-52.2% BD-rate saving), and has very fast encoding (0.001x VVC) and decoding (1.69x VVC) speeds.
Compared to next version of JCT-VC, which barely managed ~15% of BD Rate saving with hundreds more tools, 50% saving over VTM is quite impressive. It does seems to me that work on next gen Video ( H.267 ? ) is accelerating. Compared to HEVC and VVC during similar time line.
__________________
Previously iwod
ksec is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 18:45.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2024, vBulletin Solutions Inc.