Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > Video Encoding > High Efficiency Video Coding (HEVC)

Reply
 
Thread Tools Search this Thread Display Modes
Old 12th January 2019, 11:47   #21  |  Link
SeeMoreDigital
Life looks better in UHD
 
SeeMoreDigital's Avatar
 
Join Date: Jun 2003
Location: Notts, UK
Posts: 11,380
Quote:
Originally Posted by Selur View Post
Anyone got a link to a HDR-10+ sample file?
I've been trying to obtain some official samples for months but without success.

I now hoping some might shake loose after CES...
__________________
| I've been testing hardware media playback devices and software A/V encoders and decoders since 2001 | My Network Layout & A/V Gear |
SeeMoreDigital is offline   Reply With Quote
Old 12th January 2019, 12:54   #22  |  Link
hajj_3
Registered User
 
Join Date: Mar 2004
Posts: 866
These UHD blurays have HDR10+ on them: https://forum.blu-ray.com/showthread.php?t=300877

You could rip them yourself if you have a specific uhd bluray drive and ripping software. Alternatively you would need to find an uncompressed rip of these online somewhere.
hajj_3 is offline   Reply With Quote
Old 12th January 2019, 13:09   #23  |  Link
Selur
Registered User
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 5,746
@hajj_3: looking for a legally available sample. (uncompressed and untouched, a remux might not work either)
__________________
Hybrid here in the forum, homepage
Selur is offline   Reply With Quote
Old 12th January 2019, 20:48   #24  |  Link
hajj_3
Registered User
 
Join Date: Mar 2004
Posts: 866
I have managed to cut a 24 second 93MB sample of the uncompressed UHD bluray of Robin Hood, pm me if anyone wants a link to download it. Mediainfo detects it as having HDR10 as i think mediainfo can't detect HDR10+ at the moment. Please note that the low bitrate is because there isn't much movement in some of the scene. The full movie has an average video bitrate of 48.3Mb/s.

Code:
Format                                   : Matroska
Format version                           : Version 4
File size                                : 92.3 MiB
Duration                                 : 24 s 952 ms
Overall bit rate mode                    : Variable
Overall bit rate                         : 31.0 Mb/s
Movie name                               : Robin Hood Theatrical 4K
Encoded date                             : UTC 2019-01-12 19:37:28
Writing application                      : mkvmerge v30.1.0 ('Forever And More') 64-bit
Writing library                          : libebml v1.3.6 + libmatroska v1.4.9

Video
ID                                       : 1
Format                                   : HEVC
Format/Info                              : High Efficiency Video Coding
Commercial name                          : HDR10
Format profile                           : Main 10@L5.1@High
Codec ID                                 : V_MPEGH/ISO/HEVC
Duration                                 : 24 s 942 ms
Bit rate                                 : 23.1 Mb/s
Width                                    : 3 840 pixels
Height                                   : 2 160 pixels
Display aspect ratio                     : 16:9
Frame rate mode                          : Constant
Frame rate                               : 23.976 (24000/1001) FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0 (Type 2)
Bit depth                                : 10 bits
Bits/(Pixel*Frame)                       : 0.116
Stream size                              : 68.8 MiB (75%)
Writing library                          : ATEME Titan File 3.8.16 (4.8.16.0)      
Default                                  : Yes
Forced                                   : No
Color range                              : Limited
Color primaries                          : BT.2020
Transfer characteristics                 : PQ
Matrix coefficients                      : BT.2020 non-constant
Mastering display color primaries        : Display P3
Mastering display luminance              : min: 0.0050 cd/m2, max: 1000 cd/m2
Maximum Content Light Level              : 1001 cd/m2
Maximum Frame-Average Light Level        : 328 cd/m2

Audio
ID                                       : 2
Format                                   : DTS XLL
Format/Info                              : Digital Theater Systems
Commercial name                          : DTS-HD Master Audio
Codec ID                                 : A_DTS
Duration                                 : 24 s 950 ms
Bit rate mode                            : Variable
Bit rate                                 : 7 888 kb/s
Channel(s)                               : 8 channels
Channel layout                           : C L R LFE Lb Rb Lss Rss
Sampling rate                            : 48.0 kHz
Frame rate                               : 93.750 FPS (512 SPF)
Bit depth                                : 24 bits
Compression mode                         : Lossless
Delay relative to video                  : 2 ms
Stream size                              : 23.5 MiB (25%)
Title                                    : DTS:X 7.1
Language                                 : English
Default                                  : Yes
Forced                                   : No

Text #1
ID                                       : 3
Format                                   : PGS
Muxing mode                              : zlib
Codec ID                                 : S_HDMV/PGS
Codec ID/Info                            : Picture based subtitle format used on BDs/HD-DVDs
Bit rate                                 : 0 b/s
Count of elements                        : 0
Stream size                              : 0.00 Byte (0%)
Title                                    : English (SDH)
Language                                 : English
Default                                  : No
Forced                                   : No

Text #2
ID                                       : 4
Format                                   : PGS
Muxing mode                              : zlib
Codec ID                                 : S_HDMV/PGS
Codec ID/Info                            : Picture based subtitle format used on BDs/HD-DVDs
Bit rate                                 : 0 b/s
Count of elements                        : 0
Stream size                              : 0.00 Byte (0%)
Title                                    : French
Language                                 : French
Default                                  : No
Forced                                   : No

Text #3
ID                                       : 5
Format                                   : PGS
Muxing mode                              : zlib
Codec ID                                 : S_HDMV/PGS
Codec ID/Info                            : Picture based subtitle format used on BDs/HD-DVDs
Bit rate                                 : 0 b/s
Count of elements                        : 0
Stream size                              : 0.00 Byte (0%)
Title                                    : Japanese
Language                                 : Japanese
Default                                  : No
Forced                                   : No

Text #4
ID                                       : 6
Format                                   : PGS
Muxing mode                              : zlib
Codec ID                                 : S_HDMV/PGS
Codec ID/Info                            : Picture based subtitle format used on BDs/HD-DVDs
Bit rate                                 : 0 b/s
Count of elements                        : 0
Stream size                              : 0.00 Byte (0%)
Title                                    : Portuguese (Brazilian)
Language                                 : Portuguese
Default                                  : No
Forced                                   : No

Text #5
ID                                       : 7
Format                                   : PGS
Muxing mode                              : zlib
Codec ID                                 : S_HDMV/PGS
Codec ID/Info                            : Picture based subtitle format used on BDs/HD-DVDs
Bit rate                                 : 0 b/s
Count of elements                        : 0
Stream size                              : 0.00 Byte (0%)
Title                                    : Spanish (Latin American)
Language                                 : Spanish
Default                                  : No
Forced                                   : No

Menu
00:00:00.000                             : en:Difficult Times
00:00:04.379                             : en:Hard News

Last edited by hajj_3; 14th January 2019 at 01:16.
hajj_3 is offline   Reply With Quote
Old 12th January 2019, 21:09   #25  |  Link
SeeMoreDigital
Life looks better in UHD
 
SeeMoreDigital's Avatar
 
Join Date: Jun 2003
Location: Notts, UK
Posts: 11,380
Quote:
Originally Posted by hajj_3 View Post
I have managed to cut a 24 second sample of the uncompressed UHD bluray of Robin Hood, pm me if anyone wants a link to download it. Mediainfo detects it as having HDR10 as i think mediainfo can't detect HDR10+ at the moment. Please note that the low bitrate is because there isn't much movement in some of the scene. The full movie has an average video bitrate of 48.3Mb/s.
I didn't think that Robin Hood (2018) disc was available until mid Feb. And from what I understand, it should also contain a Dolby Vision meta-data layer.

I'd quite like a link please...
__________________
| I've been testing hardware media playback devices and software A/V encoders and decoders since 2001 | My Network Layout & A/V Gear |

Last edited by SeeMoreDigital; 13th January 2019 at 14:25.
SeeMoreDigital is offline   Reply With Quote
Old 13th January 2019, 14:11   #26  |  Link
mini-moose
Registered User
 
Join Date: Oct 2007
Posts: 369
Quote:
Originally Posted by hajj_3 View Post
I have managed to cut a 24 second 93MB sample of the uncompressed UHD bluray of Robin Hood
Is this not the Robin Hood from 2010? Don't think HDR10+ appeared on UHD discs till end of 2018.
mini-moose is offline   Reply With Quote
Old 13th January 2019, 15:08   #27  |  Link
hajj_3
Registered User
 
Join Date: Mar 2004
Posts: 866
Quote:
Originally Posted by mini-moose View Post
Is this not the Robin Hood from 2010? Don't think HDR10+ appeared on UHD discs till end of 2018.
ahhh, it is from 2010. It was released on uhd bluray around 3-4 months ago. My mistake. Crazy that they made a new film with the same name just 8 years later.
hajj_3 is offline   Reply With Quote
Old 14th January 2019, 01:11   #28  |  Link
hajj_3
Registered User
 
Join Date: Mar 2004
Posts: 866
I have managed to make a 20 second 104MB sample of 'Bad Times at the El Royale' UHD Bluray, which has HDR10+ on, mediainfo detects it as HDR10 but i don't think it that hasn't been updated to detect HDR10+. https://www.blu-ray.com/movies/Bad-T...217590/#Review

PM me if you want a link to the sample to test.

Code:
Format                                   : Matroska
Format version                           : Version 4
File size                                : 104 MiB
Duration                                 : 20 s 2 ms
Overall bit rate mode                    : Variable
Overall bit rate                         : 43.7 Mb/s
Encoded date                             : UTC 2019-01-13 23:46:55
Writing application                      : mkvmerge v30.1.0 ('Forever And More') 64-bit
Writing library                          : libebml v1.3.6 + libmatroska v1.4.9

Video
ID                                       : 1
Format                                   : HEVC
Format/Info                              : High Efficiency Video Coding
Commercial name                          : HDR10
Format profile                           : Main 10@L5.1@High
Codec ID                                 : V_MPEGH/ISO/HEVC
Duration                                 : 19 s 979 ms
Bit rate                                 : 36.4 Mb/s
Width                                    : 3 840 pixels
Height                                   : 2 160 pixels
Display aspect ratio                     : 16:9
Frame rate mode                          : Constant
Frame rate                               : 23.976 (23976/1000) FPS
Original frame rate                      : 23.976 (24000/1001) FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0 (Type 2)
Bit depth                                : 10 bits
Bits/(Pixel*Frame)                       : 0.183
Stream size                              : 86.6 MiB (83%)
Writing library                          : ATEME Titan File 3.9.0 (4.9.0.0)        
Language                                 : English
Default                                  : Yes
Forced                                   : No
Color range                              : Limited
Color primaries                          : BT.2020
Transfer characteristics                 : PQ
Matrix coefficients                      : BT.2020 non-constant
Mastering display color primaries        : Display P3
Mastering display luminance              : min: 0.0050 cd/m2, max: 1000 cd/m2

Audio #1
ID                                       : 2
Format                                   : MLP FBA 16-ch
Format/Info                              : Meridian Lossless Packing FBA with 16-channel presentation
Commercial name                          : Dolby TrueHD with Dolby Atmos
Codec ID                                 : A_TRUEHD
Duration                                 : 19 s 978 ms
Bit rate mode                            : Variable
Bit rate                                 : 6 123 kb/s
Maximum bit rate                         : 8 373 kb/s
Channel(s)                               : 8 channels
Channel layout                           : L R C LFE Ls Rs Lb Rb
Sampling rate                            : 48.0 kHz
Frame rate                               : 1 200.000 FPS (40 SPF)
Compression mode                         : Lossless
Stream size                              : 14.6 MiB (14%)
Language                                 : English
Default                                  : Yes
Forced                                   : No
Number of dynamic objects                : 13
Bed channel count                        : 1 channel
Bed channel configuration                : LFE

Audio #2
ID                                       : 3
Format                                   : AC-3
Format/Info                              : Audio Coding 3
Commercial name                          : Dolby Digital
Codec ID                                 : A_AC3
Duration                                 : 20 s 0 ms
Bit rate mode                            : Constant
Bit rate                                 : 640 kb/s
Channel(s)                               : 6 channels
Channel layout                           : L R C LFE Ls Rs
Sampling rate                            : 48.0 kHz
Frame rate                               : 31.250 FPS (1536 SPF)
Bit depth                                : 16 bits
Compression mode                         : Lossy
Delay relative to video                  : 2 ms
Stream size                              : 1.53 MiB (1%)
Language                                 : English
Service kind                             : Complete Main
Default                                  : No
Forced                                   : No

Audio #3
ID                                       : 4
Format                                   : AC-3
Format/Info                              : Audio Coding 3
Commercial name                          : Dolby Digital
Codec ID                                 : A_AC3
Duration                                 : 20 s 0 ms
Bit rate mode                            : Constant
Bit rate                                 : 448 kb/s
Channel(s)                               : 6 channels
Channel layout                           : L R C LFE Ls Rs
Sampling rate                            : 48.0 kHz
Frame rate                               : 31.250 FPS (1536 SPF)
Bit depth                                : 16 bits
Compression mode                         : Lossy
Delay relative to video                  : 2 ms
Stream size                              : 1.07 MiB (1%)
Language                                 : English
Service kind                             : Complete Main
Default                                  : No
Forced                                   : No

Text #1
ID                                       : 5
Format                                   : PGS
Muxing mode                              : zlib
Codec ID                                 : S_HDMV/PGS
Codec ID/Info                            : Picture based subtitle format used on BDs/HD-DVDs
Duration                                 : 18 s 143 ms
Bit rate                                 : 65.9 kb/s
Count of elements                        : 15
Stream size                              : 146 KiB (0%)
Language                                 : frs
Default                                  : Yes
Forced                                   : No

Text #2
ID                                       : 6
Format                                   : PGS
Muxing mode                              : zlib
Codec ID                                 : S_HDMV/PGS
Codec ID/Info                            : Picture based subtitle format used on BDs/HD-DVDs
Duration                                 : 6 s 548 ms
Bit rate                                 : 76.1 kb/s
Count of elements                        : 4
Stream size                              : 60.8 KiB (0%)
Language                                 : Spanish
Default                                  : No
Forced                                   : No

Text #3
ID                                       : 7
Format                                   : PGS
Muxing mode                              : zlib
Codec ID                                 : S_HDMV/PGS
Codec ID/Info                            : Picture based subtitle format used on BDs/HD-DVDs
Duration                                 : 6 s 548 ms
Bit rate                                 : 60.7 kb/s
Count of elements                        : 4
Stream size                              : 48.5 KiB (0%)
Language                                 : French
Default                                  : No
Forced                                   : No

Text #4
ID                                       : 8
Format                                   : PGS
Muxing mode                              : zlib
Codec ID                                 : S_HDMV/PGS
Codec ID/Info                            : Picture based subtitle format used on BDs/HD-DVDs
Bit rate                                 : 0 b/s
Count of elements                        : 0
Stream size                              : 0.00 Byte (0%)
Language                                 : French
Default                                  : No
Forced                                   : No

Menu
00:00:00.000                             : :CapĂ*tulo 09

Last edited by hajj_3; 15th January 2019 at 17:19.
hajj_3 is offline   Reply With Quote
Old 14th January 2019, 21:17   #29  |  Link
Selur
Registered User
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 5,746
https://patchwork.ffmpeg.org/patch/11674/ -> Nice, seems like someone is working of decoding support for HDR-10+ in ffmpeg.
__________________
Hybrid here in the forum, homepage
Selur is offline   Reply With Quote
Old 14th January 2019, 22:49   #30  |  Link
nevcairiel
Registered Developer
 
Join Date: Mar 2010
Location: Hamburg/Germany
Posts: 9,534
"Decoding" is a bit much. Reading the metadata is trivial. Doing something useful with it, that's the real challenge.
__________________
LAV Filters - open source ffmpeg based media splitter and decoders
nevcairiel is offline   Reply With Quote
Old 15th January 2019, 10:19   #31  |  Link
SeeMoreDigital
Life looks better in UHD
 
SeeMoreDigital's Avatar
 
Join Date: Jun 2003
Location: Notts, UK
Posts: 11,380
Yesterday I transferred hajj_3's 20 second sample to a USB pen-drive and got very different playback results using my LG television and OPPO.

On my LG television, although it does not support HDR+, the sample played and displayed regular HDR (HDR10). Which is as expected.
But on my OPPO, which does support HDR10+, although the sample played, no flavour of HDR (HDR10) was detected at all by the player and sent to the TV.

I also tried de-muxing the streams and re-muxing them to different containers and got the same results...
__________________
| I've been testing hardware media playback devices and software A/V encoders and decoders since 2001 | My Network Layout & A/V Gear |

Last edited by SeeMoreDigital; 15th January 2019 at 15:13.
SeeMoreDigital is offline   Reply With Quote
Old 15th January 2019, 23:00   #32  |  Link
benwaggoner
Moderator
 
Join Date: Jan 2006
Location: Portland, OR
Posts: 2,758
Quote:
Originally Posted by nevcairiel View Post
"Decoding" is a bit much. Reading the metadata is trivial. Doing something useful with it, that's the real challenge.
Although it is easier to do good tone mapping with HDR10+ metadata than without it, as the tone mapper can "look into the future" and read the metadata for future frames and thus can know how much headroom to leave per-shot.
__________________
Ben Waggoner
Principal Video Specialist, Amazon Instant Video

My Compression Book

Amazon Instant Video is hiring! PM me if you're interested.
benwaggoner is offline   Reply With Quote
Old 17th January 2019, 23:54   #33  |  Link
quietvoid
Registered User
 
Join Date: Jan 2019
Posts: 7
Hi, since HDR10+ titles started coming out I've been working on extracting the metadata from them.
For now the only purpose is to generate JSON files that x265 can use when reencoding these sources.

So I've made a tool which does just that, extracts the metadata and creates a compatible JSON file for x265.
It outputs a .log file with the raw bytes of every SEI message as well as a .json file with metadata formatted for HDR10+ LLC (not legacy).
HDR10+ LLC is what most current titles have been formatted like for now.

The tool is available on GitHub here: https://github.com/quietvoid/hdr10plus_parser
HDR10+ samples are available in the assets folder, they're also used for regression tests.

Hopefully this is useful for anyone wanting to retain HDR10+ after reencode as well as developers who have ideas about reusing the metadata on decode
quietvoid is offline   Reply With Quote
Old 18th January 2019, 00:24   #34  |  Link
hajj_3
Registered User
 
Join Date: Mar 2004
Posts: 866
Quote:
Originally Posted by quietvoid View Post
Hi, since HDR10+ titles started coming out I've been working on extracting the metadata from them.
For now the only purpose is to generate JSON files that x265 can use when reencoding these sources.

So I've made a tool which does just that, extracts the metadata and creates a compatible JSON file for x265.
It outputs a .log file with the raw bytes of every SEI message as well as a .json file with metadata formatted for HDR10+ LLC (not legacy).
HDR10+ LLC is what most current titles have been formatted like for now.

The tool is available on GitHub here: https://github.com/quietvoid/hdr10plus_parser
HDR10+ samples are available in the assets folder, they're also used for regression tests.

Hopefully this is useful for anyone wanting to retain HDR10+ after reencode as well as developers who have ideas about reusing the metadata on decode
Nice, hopefully you can work with the mediainfo developer(s) to add detection support to that. Does Mkvtoolnix use a mediainfo dll or do they do their own detection as that can't detect hdr10+ either. Would love to see those add detection support.
hajj_3 is offline   Reply With Quote
Old 18th January 2019, 07:05   #35  |  Link
FranceBB
Broadcast Encoder
 
FranceBB's Avatar
 
Join Date: Nov 2013
Location: Germany
Posts: 481
Quote:
Originally Posted by quietvoid View Post
Hi, since HDR10+ titles started coming out I've been working on extracting the metadata from them.
For now the only purpose is to generate JSON files that x265 can use when reencoding these sources.

So I've made a tool which does just that, extracts the metadata and creates a compatible JSON file for x265.
It outputs a .log file with the raw bytes of every SEI message as well as a .json file with metadata formatted for HDR10+ LLC (not legacy).
HDR10+ LLC is what most current titles have been formatted like for now.

The tool is available on GitHub here: https://github.com/quietvoid/hdr10plus_parser
This is exactly what I was looking for!
Thank you very much indeed; it really comes in handy.
FranceBB is offline   Reply With Quote
Old 18th January 2019, 16:56   #36  |  Link
mini-moose
Registered User
 
Join Date: Oct 2007
Posts: 369
Quote:
Originally Posted by quietvoid View Post
So I've made a tool which does just that, extracts the metadata and creates a compatible JSON file for x265.
Very nice! Thanks for this tool.

Would this only work on an elementary stream (.hevc)?

Also, is it needed to use the --dhdr10-opt switch? I noticed your samples didn't use that.
mini-moose is offline   Reply With Quote
Old 18th January 2019, 17:14   #37  |  Link
quietvoid
Registered User
 
Join Date: Jan 2019
Posts: 7
Quote:
Originally Posted by mini-moose View Post
Very nice! Thanks for this tool.

Would this only work on an elementary stream (.hevc)?

Also, is it needed to use the --dhdr10-opt switch? I noticed your samples didn't use that.
Yes the input has to be raw HEVC.

For the x265 --dhdr10-opt switch, as far as I lnow it breaks the specifications for proper SMPTE 2094-40 metadata. It (doc) states that every frame should have a SEI message for it.
And all the titles I have tested have the same number of metadata messages as frames, you can verify the number of lines in the .log file created.

However the samples are encoded with only metadata for the first frame, and are only useful to verify the metadata stays the same as the source after reencoding.
So essentially to make sure the bytes are interpreted correctly in the JSON.

Last edited by quietvoid; 18th January 2019 at 23:41.
quietvoid is offline   Reply With Quote
Old 18th January 2019, 23:12   #38  |  Link
sneaker_ger
Registered User
 
Join Date: Dec 2002
Posts: 5,203
Quote:
Originally Posted by quietvoid View Post
It states that every frame should have a SEI message for it.
What is "it"? Where can I read "it"?
sneaker_ger is offline   Reply With Quote
Old 18th January 2019, 23:39   #39  |  Link
quietvoid
Registered User
 
Join Date: Jan 2019
Posts: 7
Quote:
Originally Posted by sneaker_ger View Post
What is "it"? Where can I read "it"?
https://www.atsc.org/wp-content/uplo...nt-2094-40.pdf
Specifically this part:
Quote:
The syntax and semantics for payload user_data_registered_itu_t_t35() shall be as specified in [ref
to new Annex described below] section [ref to new Annex, Section 1 described below]. Where
present the corresponding NAL unit type shall be set equal to PREFIX_SEI_NUT.
If a 2094-40 metadata message is present, the following constraints shall apply:
• The 2094-40 metadata message shall be associated with every access unit of the bitstream.
If this message is present, it shall only be present once per access unit

Last edited by quietvoid; 18th January 2019 at 23:41.
quietvoid is offline   Reply With Quote
Old 19th January 2019, 08:07   #40  |  Link
nevcairiel
Registered Developer
 
Join Date: Mar 2010
Location: Hamburg/Germany
Posts: 9,534
To be fair, this is the ATSC broadcast standard, its not the authoritative standard on all 2094-40 usage, and there is no clear indication that for example Blu-ray discs require the same.
__________________
LAV Filters - open source ffmpeg based media splitter and decoders
nevcairiel is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 07:16.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2019, vBulletin Solutions Inc.