Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > Video Encoding > VP9 and AV1

Reply
 
Thread Tools Search this Thread Display Modes
Old 8th October 2023, 14:48   #21  |  Link
Boulder
Pig on the wing
 
Boulder's Avatar
 
Join Date: Mar 2002
Location: Finland
Posts: 5,800
I've now pushed the latest version to the repo. Quite a few small tweaks there, namely the ability to tweak the saturation of the FGS analysis clip and doing tone mapping of HDR sources (using DGHDRtoSDR) and adjustable downscaling in the scene change detection phase for faster processing and increased accuracy. The progress bar also works better now and gives a more accurate estimate of remaining time.

I've put several grain table files in the repo as well if anyone finds them useful.
__________________
And if the band you're in starts playing different tunes
I'll see you on the dark side of the Moon...

Last edited by Boulder; 8th October 2023 at 15:13.
Boulder is offline   Reply With Quote
Old 9th October 2023, 00:31   #22  |  Link
Blue_MiSfit
Derek Prestegard IRL
 
Blue_MiSfit's Avatar
 
Join Date: Nov 2003
Location: Los Angeles
Posts: 5,993
Hmm... comparing those encodes against the reference in the free version of MSU VQMT I see a slight hue shift towards magenta in the AV1 version but not in the HEVC version... Not sure what could be the cause of that.
__________________
These are all my personal statements, not those of my employer :)
Blue_MiSfit is offline   Reply With Quote
Old 9th October 2023, 05:14   #23  |  Link
Boulder
Pig on the wing
 
Boulder's Avatar
 
Join Date: Mar 2002
Location: Finland
Posts: 5,800
Quote:
Originally Posted by Blue_MiSfit View Post
Hmm... comparing those encodes against the reference in the free version of MSU VQMT I see a slight hue shift towards magenta in the AV1 version but not in the HEVC version... Not sure what could be the cause of that.
Yes, I have noticed the same thing myself. I've been trying to find out the reason and I think I've caught it.. if you feed 8-bit input to aomenc (and encode at 10 bits as is recommended), the result gets this shift. If you convert the source to 10 bits before inputting it, the colors look pretty much the same in the encode as in the source.

I need to test this with different cases and try to replicate it with the vanilla aomenc so I can see if the problem's there or in the lavish fork.
__________________
And if the band you're in starts playing different tunes
I'll see you on the dark side of the Moon...
Boulder is offline   Reply With Quote
Old 9th October 2023, 20:13   #24  |  Link
Boulder
Pig on the wing
 
Boulder's Avatar
 
Join Date: Mar 2002
Location: Finland
Posts: 5,800
The hue shift issue occurs when using FGS and 8-bit input, works fine if the source is converted to 10 bits or an FGS table is not used. I didn't check if it applies to 8-bit encodes, as there's really no use doing those.

I've opened a case in the aomedia issue tracker, let's see if anything happens. For the time being, I need to add the conversion step to my tool. I still think that a B/W film grain table is better than one with chroma data included
__________________
And if the band you're in starts playing different tunes
I'll see you on the dark side of the Moon...
Boulder is offline   Reply With Quote
Old 11th October 2023, 22:40   #25  |  Link
benwaggoner
Moderator
 
Join Date: Jan 2006
Location: Portland, OR
Posts: 4,878
Quote:
Originally Posted by Boulder View Post
The hue shift issue occurs when using FGS and 8-bit input, works fine if the source is converted to 10 bits or an FGS table is not used. I didn't check if it applies to 8-bit encodes, as there's really no use doing those.

I've opened a case in the aomedia issue tracker, let's see if anything happens. For the time being, I need to add the conversion step to my tool. I still think that a B/W film grain table is better than one with chroma data included
Hmm, perhaps they're doing some sort of 4x scale factor for chroma instead of using bicubic interpolation or something. A straight multiple would round down chroma value a bit. Inverse dithering with interpolation is a largely untapped approach. Basically it should be like a bicubic, but in depth instead of area.
__________________
Ben Waggoner
Principal Video Specialist, Amazon Prime Video

My Compression Book
benwaggoner is offline   Reply With Quote
Old 28th November 2023, 07:51   #26  |  Link
Boulder
Pig on the wing
 
Boulder's Avatar
 
Join Date: Mar 2002
Location: Finland
Posts: 5,800
I've developed the tool further along the way and the latest change was to add the support for encoding end credits using different Q and --cpu-used.

I think the next bigger step will be adding support for SVT-AV1, there is a huge performance boost incoming and also very interesting development regarding aq-mode 2 and low contrast sources which are often a problem for encoders.
__________________
And if the band you're in starts playing different tunes
I'll see you on the dark side of the Moon...
Boulder is offline   Reply With Quote
Old 5th March 2024, 11:32   #27  |  Link
Boulder
Pig on the wing
 
Boulder's Avatar
 
Join Date: Mar 2002
Location: Finland
Posts: 5,800
A lot more development has been done lately, now the tool supports svt-av1, rav1e and x265. In addition to that, you can create Dolby Vision compatible encodes using svt-av1-psy (https://github.com/gianni-rosato/svt-av1-psy).
More things coming soon, I've been moving the encoder parameters to a preset file and should be able to push that change to the repo during this week.
__________________
And if the band you're in starts playing different tunes
I'll see you on the dark side of the Moon...

Last edited by Boulder; 10th March 2024 at 19:49.
Boulder is offline   Reply With Quote
Old 10th March 2024, 19:49   #28  |  Link
Boulder
Pig on the wing
 
Boulder's Avatar
 
Join Date: Mar 2002
Location: Finland
Posts: 5,800
I was finally able to finish the changes regarding moving settings to a separate preset file.

DoVi for x265 is still pending though, I think I'll get that working next.
__________________
And if the band you're in starts playing different tunes
I'll see you on the dark side of the Moon...
Boulder is offline   Reply With Quote
Old 11th March 2024, 20:40   #29  |  Link
Boulder
Pig on the wing
 
Boulder's Avatar
 
Join Date: Mar 2002
Location: Finland
Posts: 5,800
DoVi for x265 works now, so I think it's time to let the script rest a while unless something interesting pops up. The forthcoming SVT-AV1 v2.0 will include a huge quality boost when the variance boost feature will be included in mainline from the psy mod, so definitely check it out even if you don't use this script
__________________
And if the band you're in starts playing different tunes
I'll see you on the dark side of the Moon...
Boulder is offline   Reply With Quote
Old 12th March 2024, 01:40   #30  |  Link
benwaggoner
Moderator
 
Join Date: Jan 2006
Location: Portland, OR
Posts: 4,878
Quote:
Originally Posted by Boulder View Post
DoVi for x265 works now, so I think it's time to let the script rest a while unless something interesting pops up. The forthcoming SVT-AV1 v2.0 will include a huge quality boost when the variance boost feature will be included in mainline from the psy mod, so definitely check it out even if you don't use this script
In what way is DoVi not supported in x265? Optimization for Y'CtCp? I know x265 certainly has been used for commercial DoVi Profile 5 encoding. And it has full-fledged support for Profile 8.1 (which is just HDR-10 plus metadata from a sidecar file).
__________________
Ben Waggoner
Principal Video Specialist, Amazon Prime Video

My Compression Book
benwaggoner is offline   Reply With Quote
Old 12th March 2024, 05:48   #31  |  Link
Boulder
Pig on the wing
 
Boulder's Avatar
 
Join Date: Mar 2002
Location: Finland
Posts: 5,800
Quote:
Originally Posted by benwaggoner View Post
In what way is DoVi not supported in x265? Optimization for Y'CtCp? I know x265 certainly has been used for commercial DoVi Profile 5 encoding. And it has full-fledged support for Profile 8.1 (which is just HDR-10 plus metadata from a sidecar file).
You can input an RPU file and create DoVi Profile 8.x encodes so yes, dynamic metadata like HDR10+. SVT-AV1(-psy) supports Profile 10 the same way, thanks to quietvoid's patch. As far as I know, there are no internal optimizations other than what PQ sources may have in all cases.

What the script simply does is that it splits the RPU based on the chunks so each chunk to encode gets proper metadata. mkvmerge must be used to concatenate the chunks as it does not remove the data while muxing.
__________________
And if the band you're in starts playing different tunes
I'll see you on the dark side of the Moon...
Boulder is offline   Reply With Quote
Old 15th June 2024, 19:07   #32  |  Link
BlueSwordM
Registered User
 
BlueSwordM's Avatar
 
Join Date: Dec 2021
Location: Canada
Posts: 26
Quote:
Originally Posted by Boulder View Post
You can input an RPU file and create DoVi Profile 8.x encodes so yes, dynamic metadata like HDR10+. SVT-AV1(-psy) supports Profile 10 the same way, thanks to quietvoid's patch. As far as I know, there are no internal optimizations other than what PQ sources may have in all cases.

What the script simply does is that it splits the RPU based on the chunks so each chunk to encode gets proper metadata. mkvmerge must be used to concatenate the chunks as it does not remove the data while muxing.
HDR10+ should also work with svt-av1-psy now, but I haven't tested it on Windows, only Linux.
BlueSwordM is offline   Reply With Quote
Old 25th July 2024, 14:33   #33  |  Link
Boulder
Pig on the wing
 
Boulder's Avatar
 
Join Date: Mar 2002
Location: Finland
Posts: 5,800
Some more development done based on the SSIMULACRA2-based auto-boost feature by trixoniisama (https://github.com/trixoniisama/auto-boost-algorithm). Works on SVT-AV1 and x265.
__________________
And if the band you're in starts playing different tunes
I'll see you on the dark side of the Moon...
Boulder is offline   Reply With Quote
Old 3rd October 2024, 22:49   #34  |  Link
LigH
German doom9/Gleitz SuMo
 
LigH's Avatar
 
Join Date: Oct 2001
Location: Germany, rural Altmark
Posts: 7,103
The media-autobuild suite now supports building Av1an. But there seems to be an issue, it produces no console output for me.
__________________

New German Gleitz board
MediaFire: x264 | x265 | VPx | AOM | Xvid
LigH is offline   Reply With Quote
Old 5th October 2024, 18:03   #35  |  Link
Z2697
Registered User
 
Join Date: Aug 2024
Posts: 71
I don't really understand why av1an chose rust though. A scripting language is enough and maybe more suitable. Considering the VapourSynth requirement of it, Python would be an almost perfect choice.
Z2697 is offline   Reply With Quote
Old 9th October 2024, 15:57   #36  |  Link
Z2697
Registered User
 
Join Date: Aug 2024
Posts: 71
Here's my weird approach, the main goal is to not wait for the scene change detection to complete but do encoding "on the fly", because for quite a long time and forseeable future before x266 is ready, I almost exclusively use x265 for any "serious business" encoding (i.e. probably using some heavy vapoursynth script), I use AV1 for some simple transcoding, thus speed is very important.

https://github.com/Mr-Z-2697/ideal-c...ain/segsaio.py

Maybe you can find it helpful. Not necessarily the "on the fly" thing, the scene change detection should be much faster, and perhaps better.
The mvtools method used by default is running 600+ FPS on my Ryzen 7950X.
Alternatively the deep learning method can be used, the speed of current default model and execution provider (DirectML) is 400+ FPS on RTX 4090 (not full utilized, only draws ~150W).
If you Gfx card is reasonablely new and have free resources during encoding, offloading scene change detection to it can free up some CPU resources for encoder.

Last edited by Z2697; 9th October 2024 at 16:02.
Z2697 is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 22:01.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2024, vBulletin Solutions Inc.