Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > Video Encoding > VP9 and AV1

Reply
 
Thread Tools Search this Thread Display Modes
Old 30th November 2017, 14:32   #361  |  Link
bstrobl
Registered User
 
Join Date: Jun 2016
Posts: 55
Mozilla Blog: https://hacks.mozilla.org/2017/11/da...-of-av1-video/
bstrobl is offline   Reply With Quote
Old 30th November 2017, 22:53   #362  |  Link
mzso
Registered User
 
Join Date: Oct 2009
Posts: 930
Hmmm. It looks like they removed the 1080 videos from the demo page.
mzso is offline   Reply With Quote
Old 1st December 2017, 18:46   #363  |  Link
benwaggoner
Moderator
 
Join Date: Jan 2006
Location: Portland, OR
Posts: 4,738
Quote:
Originally Posted by bstrobl View Post
Hopefully the AV1 update by Jai Krishna will be uploaded soon. For those who are impatient, the slides are here: https://speakerdeck.com/stswe/av1-up...an-from-google
It makes me somewhat nervous that the percentage gains go down the more subjectively correlated the metric used is.

-26.51% for VOD PSNR-Y but only -23.57% for MS-SSIM. And no metrics that include any temporal component. I'd love to see at least VMAF scores, which is the metric most predictive of DMOS that we have today.

The VPx series was always heavily tuned to optimize for PSNR, so its theoretical PSNR always overstated the series' actual perceptual quality. At least since VP6, which had a lot of advanced postprocessing technology that did a good job of hiding artifacts in a lot of ways.
__________________
Ben Waggoner
Principal Video Specialist, Amazon Prime Video

My Compression Book
benwaggoner is offline   Reply With Quote
Old 1st December 2017, 20:35   #364  |  Link
IgorC
Registered User
 
Join Date: Apr 2004
Posts: 1,315
Quote:
Originally Posted by VincAlastor View Post
https://demo.bitmovin.com/public/firefox/av1/

how can i grab this demo stream? I wanna analyse and test this stream outside of firefox.
Quote:
Originally Posted by mzso View Post
Hmmm. It looks like they removed the 1080 videos from the demo page.
Yep.

Also audio is Opus @ 32 kbps. Opus is the best available audio codec right now though 32 kbps is low.

Opus @ 48 kbps has much better quality which makes more sense for 720p streams (and 64-96+ kbps for 1080p)
IgorC is offline   Reply With Quote
Old 4th December 2017, 23:04   #365  |  Link
VincAlastor
Registered User
 
Join Date: Sep 2009
Location: Berlin
Posts: 173
Quote:
Originally Posted by IgorC View Post
Yep.

Also audio is Opus @ 32 kbps. Opus is the best available audio codec right now though 32 kbps is low.

Opus @ 48 kbps has much better quality which makes more sense for 720p streams (and 64-96+ kbps for 1080p)
But it's amazing what audio quality is possible with 32 kbit/s! Thank you IgorC and all other opus audio developers!

I can't wait for upcoming opus 1.3 alpha/beta release!
VincAlastor is offline   Reply With Quote
Old 5th December 2017, 16:41   #366  |  Link
bstrobl
Registered User
 
Join Date: Jun 2016
Posts: 55
Quote:
Originally Posted by benwaggoner View Post
It makes me somewhat nervous that the percentage gains go down the more subjectively correlated the metric used is.

-26.51% for VOD PSNR-Y but only -23.57% for MS-SSIM. And no metrics that include any temporal component. I'd love to see at least VMAF scores, which is the metric most predictive of DMOS that we have today.

The VPx series was always heavily tuned to optimize for PSNR, so its theoretical PSNR always overstated the series' actual perceptual quality. At least since VP6, which had a lot of advanced postprocessing technology that did a good job of hiding artifacts in a lot of ways.
I suppose the good news here is that AV1 has had no form of optimisation beyond the basic stuff done to it yet. Might be able to squeeze out a couple percent more with improved encoders. Right now encoding time is the biggest problem, especially for RTC.
bstrobl is offline   Reply With Quote
Old 7th December 2017, 00:15   #367  |  Link
benwaggoner
Moderator
 
Join Date: Jan 2006
Location: Portland, OR
Posts: 4,738
Quote:
Originally Posted by bstrobl View Post
I suppose the good news here is that AV1 has had no form of optimisation beyond the basic stuff done to it yet. Might be able to squeeze out a couple percent more with improved encoders. Right now encoding time is the biggest problem, especially for RTC.
I'm sure there are massive potential gains that can be squeezed out by real-world encoders. Something like x264 and x265 can run rings around the reference encoders with real-world long form content using real-world parameters, and still be orders of magnitude faster.

It just takes a whole lot of development that's out of scope of defining a bitstream to get those gains. Codec development focused on PSNR @ Constant QP also runs the risk of over optimizing for a design where QP correlates highly with PSNR.
__________________
Ben Waggoner
Principal Video Specialist, Amazon Prime Video

My Compression Book
benwaggoner is offline   Reply With Quote
Old 7th December 2017, 11:51   #368  |  Link
bstrobl
Registered User
 
Join Date: Jun 2016
Posts: 55
Quote:
Originally Posted by benwaggoner View Post
I'm sure there are massive potential gains that can be squeezed out by real-world encoders. Something like x264 and x265 can run rings around the reference encoders with real-world long form content using real-world parameters, and still be orders of magnitude faster.

It just takes a whole lot of development that's out of scope of defining a bitstream to get those gains. Codec development focused on PSNR @ Constant QP also runs the risk of over optimizing for a design where QP correlates highly with PSNR.
Doesn't HEVC do the same thing to an extend? Besides, the VP9 base will still be prominent in AV1 due to limited development time and the desire for reusability of components by chipset manufacturers.

The fact that AV1 does well when compared to x265 with a five year head start is neat, but I won't deny the fact that this was a somewhat rushed development.

My guess is most desirable features and improvements will only come with AV2, when the Alliance have most of the development kinks worked out.
bstrobl is offline   Reply With Quote
Old 10th December 2017, 13:52   #369  |  Link
iwod
Registered User
 
Join Date: Apr 2002
Posts: 756
Quote:
Originally Posted by bstrobl View Post
Doesn't HEVC do the same thing to an extend? Besides, the VP9 base will still be prominent in AV1 due to limited development time and the desire for reusability of components by chipset manufacturers.

The fact that AV1 does well when compared to x265 with a five year head start is neat, but I won't deny the fact that this was a somewhat rushed development.

My guess is most desirable features and improvements will only come with AV2, when the Alliance have most of the development kinks worked out.
I am hoping for the best on AV2. But given how they have communicate, and expecting to have AV2 and AV3 done in next 5 years just shows they have absolutely no idea how real world progress and works.

Then there is the law of diminishing return, a lot of the improvement and progress made in x264 and x265 took years to fine tune. It wasn't long ago x264 was still beating x265 at high bitrate encoding.
iwod is offline   Reply With Quote
Old 10th December 2017, 15:26   #370  |  Link
mzso
Registered User
 
Join Date: Oct 2009
Posts: 930
Quote:
Originally Posted by iwod View Post
I am hoping for the best on AV2. But given how they have communicate, and expecting to have AV2 and AV3 done in next 5 years just shows they have absolutely no idea how real world progress and works.
I don't have high hopes. They'll just probably keep tweaking the same basic concept (dct on blocks) as it's done for decades now.
Quote:
Originally Posted by iwod View Post
Then there is the law of diminishing return, a lot of the improvement and progress made in x264 and x265 took years to fine tune. It wasn't long ago x264 was still beating x265 at high bitrate encoding.
That's why it would make sense to head to a radical new direction. But they won't.
I doubt that there'll be any interest in adopting AV2 if it ever gets finished. By then AV1 will be pretty well optimized and AV2 won't offer any improvement of particular significance.
mzso is offline   Reply With Quote
Old 11th December 2017, 17:56   #371  |  Link
bstrobl
Registered User
 
Join Date: Jun 2016
Posts: 55
Quote:
Originally Posted by mzso View Post
That's why it would make sense to head to a radical new direction. But they won't.
I doubt that there'll be any interest in adopting AV2 if it ever gets finished. By then AV1 will be pretty well optimized and AV2 won't offer any improvement of particular significance.
Nothing wrong with DCT on blocks, worked well for a long time and still does .
It's a bit like squeezing out everything from current microprocessors and other modern technology, eventually you simply reach what is actually possible without going off into ridiculous complexity/cost. Daala is a good codec with a different design, but doesn't have a huge benefit over HEVC/AV1. Same with wavelets.

I doubt the Alliance will release a new codec if they can't make it at least 30% better than AV1. If there is no AV2, we will at least have a solid codec that is royalty free to depend on. Nothing wrong with a long lasting standard when you don't have to replace hardware/software and re-encode everything.
bstrobl is offline   Reply With Quote
Old 11th December 2017, 18:36   #372  |  Link
mzso
Registered User
 
Join Date: Oct 2009
Posts: 930
Quote:
Originally Posted by bstrobl View Post
Nothing wrong with DCT on blocks, worked well for a long time and still does .
It's a bit like squeezing out everything from current microprocessors and other modern technology, eventually you simply reach what is actually possible without going off into ridiculous complexity/cost.
Yeah, it feels like most of the complexity of present codecs is spent on catering to blocks and deblocking.

Quote:
Originally Posted by bstrobl View Post
Daala is a good codec with a different design, but doesn't have a huge benefit over HEVC/AV1. Same with wavelets.
I think alternative approaches are sorely under-researched. Not much effort was put into wavelets, even less into Daala's overlapped transformation before it was dopped.
mzso is offline   Reply With Quote
Old 15th December 2017, 18:30   #373  |  Link
benwaggoner
Moderator
 
Join Date: Jan 2006
Location: Portland, OR
Posts: 4,738
Quote:
Originally Posted by mzso View Post
Yeah, it feels like most of the complexity of present codecs is spent on catering to blocks and deblocking.
Well, they ARE block-based codecs! New codecs are adding LOTS of knobs around block sizes and deblocking modes.


Quote:
I think alternative approaches are sorely under-researched. Not much effort was put into wavelets, even less into Daala's overlapped transformation before it was dopped.
That is one of the challenges with any radically new technology. We have decades and millions of engineer-hours of experience optimizing around DCT-like block-based encoding. Even if a fundamentally new transform had a lot more potential, its initial implementations would have to compete against all the refinement of the current architectures. And it's very hard to estimate how well a basic technology will pan out. Wavelet-based video codecs were "obviously" the future, until actual real-world implementations went splat.

If we started with J2K instead of JPEG, and had all the motion estimation work done based around wavelets, hundreds of PhDs and developers could have found the magic way. And then someone with a crazy block-based codec idea would have run out of funding at just full-pel motion search, and we'd say "yeah, blocks were kind of interesting, but just never proved to be competitive."
__________________
Ben Waggoner
Principal Video Specialist, Amazon Prime Video

My Compression Book

Last edited by benwaggoner; 15th December 2017 at 18:44. Reason: fix quote
benwaggoner is offline   Reply With Quote
Old 19th December 2017, 09:55   #374  |  Link
bstrobl
Registered User
 
Join Date: Jun 2016
Posts: 55
Took a while but here is the Google update on AV1:

https://www.youtube.com/watch?v=sBAH...aqcvb0&index=7
bstrobl is offline   Reply With Quote
Old 19th December 2017, 11:23   #375  |  Link
hajj_3
Registered User
 
Join Date: Mar 2004
Posts: 1,120
Quote:
Originally Posted by bstrobl View Post
Took a while but here is the Google update on AV1:

https://www.youtube.com/watch?v=sBAH...aqcvb0&index=7
The video says that they are currently up to 29% improvement over VP9 and aim to be at ~35% by the bitfreeze in January. That is a welcomed improvement as they say a month or so ago that they were aiming for 30% improvement.
hajj_3 is offline   Reply With Quote
Old 4th January 2018, 22:19   #376  |  Link
hajj_3
Registered User
 
Join Date: Mar 2004
Posts: 1,120
Hell has frozen over...... Apple has quietly joined AOM as a founding member: https://www.cnet.com/news/apple-onli...mpression-av1/

Last edited by hajj_3; 4th January 2018 at 22:22.
hajj_3 is offline   Reply With Quote
Old 4th January 2018, 22:30   #377  |  Link
nevcairiel
Registered Developer
 
Join Date: Mar 2010
Location: Hamburg/Germany
Posts: 10,336
How can you join as a "founding member" this late?
__________________
LAV Filters - open source ffmpeg based media splitter and decoders
nevcairiel is offline   Reply With Quote
Old 4th January 2018, 23:17   #378  |  Link
hajj_3
Registered User
 
Join Date: Mar 2004
Posts: 1,120
Quote:
Originally Posted by nevcairiel View Post
How can you join as a "founding member" this late?
I presume founding members pay more money and probably have more voting rights. AOM obviously wanted Apple to join badly as having a single codec for all future smartphones and tablets would be extremely beneficial for everyone.
hajj_3 is offline   Reply With Quote
Old 5th January 2018, 01:57   #379  |  Link
GTPVHD
Registered User
 
Join Date: Mar 2008
Posts: 175
That's unexpected but welcome news, I'm guessing Apple will have Axx SoCs with fixed function AV1 hardware decoding in the future.

And yes, Hell has frozen over.
GTPVHD is offline   Reply With Quote
Old 5th January 2018, 03:43   #380  |  Link
x265_Project
Guest
 
Posts: n/a
Quote:
Originally Posted by GTPVHD View Post
That's unexpected but welcome news, I'm guessing Apple will have Axx SoCs with fixed function AV1 hardware decoding in the future.
That's not a safe assumption. Supporting a standards organization and adopting the standard in your own products and services are two separate decisions. Companies may have many different motivations for the first decision. But it's low risk. They only make the second, much more expensive decision based on a careful cost/benefit analysis for each product line (or in Apple's case, for each platform). It took Apple 4 1/2 years from the time HEVC was standardized until it announced broad support for HEVC (and AV1 is not yet finalized, as far as I know). Apple joining the Alliance for Open Media may actually end up helping HEVC adoption, as AV1 (or the threat of a major platform owner like Apple actually adopting AV1) provides a strong counter-balancing force to convince HEVC patent holders to avoid unreasonable patent license demands. HEVC doesn't need to be free to all implementers to succeed, but it definitely needs to be reasonable, and the work of the Alliance for Open Media is very helpful to the overall cause of enabling advanced encoding standards at reasonable costs. Only time will tell how it all plays out.
  Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 11:36.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2024, vBulletin Solutions Inc.