TSM2UHD Discussion and Bug Reporting

[jdobbs]

This thread has been created for discussing TSM2UHD, a program to convert TSMUXER BD formatted structures for use on standalone UHD BD players.

What is TSM2UHD?

TSM2UHD stands for "TSMUXER to UHD".

TSMUXER v2.6.12 has the ability to multiplex HEVC streams into a Blu-Ray disc structure. One might assume, then, that if that structure was created from a 2160p (UHD) HEVC file that is compliant with Ultra HD Blu-Ray (UHD-BD) -- it would playback on a UHD player. Unfortunately, however, that isn't the case. When TSMUXER v2.6.12 was created there was still much that hadn't been decided in the UHD-BD standard.

The purpose of this software is to examine the output of TSMUXER v 2.6.12 and make changes that are required in order to make that structure readable and compatible with a standard UHD-BD standalone player.

Latest Version: v1.12 (Feb 25, 2018)
Click this link (http://www.jdobbs.net/freeware/TSM2UHD_V1.12.zip) to download the latest version in a zip file.

How to use the software:

1. Read the software license text in LICENSE.TXT.

2. Create a set of streams (video/audio/subtitles) that is compatible with UHD-BD. This assumes the video is 3840x2160. Be careful with bitrates! An original stream may not work -- as its maximum bitrate could exceed that of a BD-50 or BD-25 disc. I recommend you make sure the total of all streams does not exceed 50Mbs combined for BD-50 (absolutely no more than 64Mbs) and 35Mbs for BD-25.

3. Open TSMUXER v2.6.12 and select those streams (TSMUXER instructions are available elsewhere -- and details are not included here).

4. Using the TSMUXER software, output a BD compatible structure to a folder on your hard drive. Let it complete its task.

5. Run TSM2UHD, and select the folder you created in step 4. Then press the button to start execution.

TSM2UHD will run. It will make changes to these files in the TSMUXER created folder:

Index.bdmv, MovieObject.bdmv, the .mpls file, .clpi file, and .m2ts file.

NOTES:

1. This is beta software. I tested it on my Sony UBP-X800 player and it works. There is a chance there may still be bugs... if you have issues report them here.

2. Bitrates! Remember, An original stream may not work as is -- as its maximum bitrate could exceed that of a BD-50 or BD-25 disc. I recommend you make sure the total of all streams does not exceed 50Mbs combined for BD-50 (absolutely no more than 64Mbs) and 35Mbs for BD-25.

3. The program has to scan the entire M2TS stream making changes to every video start code and all PMT packets. This can take a while (about 30-40 minutes on my system). I have noticed that on my player, it seems to play ok even when these updates aren't done. For that reason I have added a checkbox on the program's form that allows you to skip those updates. I highly recommend keeping it unchecked for compliance... but if you're in a hurry and want to risk it, it's your choice.

4. I wrote this without access to the UHD-BD standard... so keep that in mind. If you run into an issue, report in this thread and I'll see what I can do. Please, don't keep asking for updates... it's freeware and I'll get to it when I have the free time.

[LowDead]

Nice one! Thank you! :D

//LD

[geheim]

Awesome, thank you very much! I'll be doing some tests over the next days and report any issues I may find.

[DenisRodman]

Well done! :thanks:

[iSeries]

Great, so this can be used for movie-only remuxes. Does it retain Dolby Vision?

[LowDead]

I may have come across a bug. Whole movie took only 5min to scan and fix. In the instructions you mention about 30min.. Just to rule out user error, the m2ts box should not be ticked? Will test some more also to rule out bad rip.

//LD

[SeeMoreDigital]

...Does it retain Dolby Vision?Nope...

[jdobbs]

I may have come across a bug. Whole movie took only 5min to scan and fix. In the instructions you mention about 30min.. Just to rule out user error, the m2ts box should not be ticked? Will test some more also to rule out bad rip.

//LDIt should not be ticked.

5 mins? How big is the input M2TS? Just reading a 45GB file (with no changes written) on my system takes about 10 mins.

[jdobbs]

Great, so this can be used for movie-only remuxes. Does it retain Dolby Vision?That would depend on whether TSMUXER handles it. This software doesn't do the muxing, it just corrects type and format flags, version numbers, PMT entries, and start codes in order to make it recognizable by a UHD player.

[DenisRodman]

jdobbs,
Maybe add support for all files.

Can you add conversion support also for files:

- CERTIFICATE\id.bdmv
- BDMV\AUXDATA\sound.bdmv
- BDMV\BDJO\00000.bdjo

[jdobbs]

jdobbs,
Maybe add support for all files.

Can you add conversion support also for files:

- CERTIFICATE\id.bdmv
- BDMV\AUXDATA\sound.bdmv
- BDMV\BDJO\00000.bdjoThey don't exist in a structure created by TSMUXER.

It's not that hard to find and replace those version headers, but could you please explain how you are using this S/W that might need that? I could understand if you are talking about the version of BD-RB I'm working on -- but I don't see how those could exist here.

Are you trying to restructure a full disc by hand and then run this on it? If so -- I'd think the version headers would already be correct for those files.

[DenisRodman]

jdobbs,

I was thinking of trying to remultiplex a regular Blu-ray disc with a menu under the new format of the UHD BD. To do this, I used your program and saw that your program does not correct all files. So I suggested adding support for other files.

[Bandits]

Any chance you can make this work from command line without the gui?

[sneaker_ger]

Does it work with x265 output? You mentioned here (https://forum.doom9.org/showthread.php?t=175042) that you encountered troubles.

[wolflop]

I have created a BD structure with the tsmuxer (UHD mkv). Then edited as specified with the TSMUhdmuxer. Unfortunately, only audio and no picture is playable on the player

[jdobbs]

Any chance you can make this work from command line without the gui?Sure. It may be a little while. though. Definitely after Christmas/New Year.

[jdobbs]

Does it work with x265 output? You mentioned here (https://forum.doom9.org/showthread.php?t=175042) that you encountered troubles.Yes, but...

1. I went back through the mux software I'd created when using the X265 stream and found a difference, with a fix to that I got a picture.

2. It played video then, but had serious "stuttering" issues with all of the examples I'd found. So I went through the entire set of CLI values and discovered that my player wouldn't playback smoothly unless the stream had open gops. I also found that I had to disable b-pyramid. That made no sense to me... but there it was. There were also several other tweaks I had to include to get smooth playback (see below)...

3. I couldn't use "--uhd-bd" because it would force settings that cause stutter. So I manually set it's other parameters

So now I'm at a point at which I'm using this line for recording (of course some things like bitrate can change):

ffmpeg.exe -probesize 100MB -i "\path\to\source.m2ts" -an -r 23.976
-pix_fmt yuv420p10le -f yuv4mpegpipe -strict -1 - | "x265.exe" -
--preset medium --input-depth 10 --output-depth 10 --vbv-bufsize
30000 --vbv-maxrate 35000 --level-idc 51 --bframes 3 --ref 3
--slices 4 --no-b-pyramid --repeat-headers --chromaloc 2 --aud
--hrd --min-keyint 1 --colorprim bt2020 --transfer smpte2084
--colormatrix bt2020nc --max-cll "1000,400" --master-display
"G(13250,34500)B(7500,3000)R(34000,16000)WP(15635,16450)L(10000000,1)"
--fps 23.976 --sar 1:1 --qpfile "\path\to\chapters.CHP" --keyint 24
--bitrate 34653 --y4m --output "output.hevc"

4. But... there is still an issue. I can encode (very slowly) with this line, then use TSMUXER and TSM2UHD to create a structure -- and the output plays back fine on my Sony standalone.

If though, I try to use that structure as input to another encode -- it starts stuttering again on the grandchild copy. That makes me suspicious of the "successful" encode. I think it may have something to do with the FFMPEG line -- because I don't have that problem if I use AVS2YUV the second time... (but I do lose 10 bit/HDR since AVISYNTH is 8 bit).

So I'm not 100% there yet. I'm hoping others will try different things, use TSM2UHD, and report back results on other players -- and maybe some of this will become clearer. Maybe they can also find something in this command line that needs changing too.

It sure would be easier if I had the spec.

[gonca]

Would you consider using Vapoursynth?

[jdobbs]

Would you consider using Vapoursynth?Don't know enough about it to say.

[gonca]

You can use AVS filters and still have full depth (>8 bit) support

[jdobbs]

You can use AVS filters and still have full depth (>8 bit) supportHow does it compare to AVISYNTH+?

[gonca]

Some software, NVEncC is one, doesn't support full depth input from Avisynth and forks (+ included)
In this case Vapoursynth is fully supported, more universal support it appears
It seems to be more actively supported
Only way to determine if AVS+ will do what you need is to try short clips and see
However if you think you will one day support hardware encoding (2x + frame rate encoding for 4k) it might be worth considering

[sneaker_ger]

discovered that my player wouldn't playback smoothly unless the stream had open gops. I also found that I had to disable b-pyramid. That made no sense to me... but there it was.
B-pyramid on x264 also has to be restricted for Blu-ray compatibility so it is not that surprising if the one in x265 is not Blu-ray-compatible. But Open-GOP is really strange...

[LowDead]

It should not be ticked.

5 mins? How big is the input M2TS? Just reading a 45GB file (with no changes written) on my system takes about 10 mins.

yep, 5 mins with the m2ts box unticked. input file just over 20gb. So something isn't right. I would suspect the input file is corrupt. The resulting output burned on dl bd-rw and running in my k8500 everything is working as it should until the first chapter break. There everything freezes for a second and when it comes back theres no sound. Hmm just thought of trying without any chapters to see if that is what it chokes on. I will also try to encode with your settings for ffmpeg to see if it makes any difference.

Merry Christmas and Happy Holidays! :D

//LD

[jdobbs]

yep, 5 mins with the m2ts box unticked. input file just over 20gb. So something isn't right. I would suspect the input file is corrupt. The resulting output burned on dl bd-rw and running in my k8500 everything is working as it should until the first chapter break. There everything freezes for a second and when it comes back theres no sound. Hmm just thought of trying without any chapters to see if that is what it chokes on. I will also try to encode with your settings for ffmpeg to see if it makes any difference.

Merry Christmas and Happy Holidays! :D

//LDIf you could, please let me know how long the encode takes. You could also try changing from "medium" to "superfast" -- that's what I've been using (otherwise I get 1.5fps).

[geheim]

So, it doesn't work for me unfortuanetly. I tried some original streams, made a BD Folder structure with TSMuxer, and then applied TSM2UHD to the Folder. After it finishes I tried Playback with DVD Fab Media Player (which works fine for everything I tried), but Playback gives me heavy stuttering and "jumping". Don't know what I could be making wrong here...

Thanks for your work and merry Christmas!

[SeeMoreDigital]

....but Playback gives me heavy stuttering and "jumping". Don't know what I could be making wrong here..Does the actual '00000.m2ts' stream play okay?

[geheim]

Does the actual '00000.m2ts' stream play okay?

Just tried playing the m2ts directly and while there are lesser Picture Errors, there are still some jumps and stuttering visible during many scenes... Seems like something is still wrong with how files get patched.

[SeeMoreDigital]

Just tried playing the m2ts directly and while there are lesser Picture Errors, there are still some jumps and stuttering visible during many scenes... Seems like something is still wrong with how files get patched.
Sounds more likely to be a TSmuxer GUI muxing issue...

[jdobbs]

So, it doesn't work for me unfortuanetly. I tried some original streams, made a BD Folder structure with TSMuxer, and then applied TSM2UHD to the Folder. After it finishes I tried Playback with DVD Fab Media Player (which works fine for everything I tried), but Playback gives me heavy stuttering and "jumping". Don't know what I could be making wrong here...

Thanks for your work and merry Christmas!I'm assuming this is a burned disc? If so, that's more than likely due to the bitrate exceeding what can be used on a BD-25/50. It needs to be reencoded. The only original streams I found that could be used intact were extras -- probably because they were made purposely to work on multiple formats.

I mentioned the bitrate issue twice in the README:2. Bitrates! Remember, An original stream may not work as is -- as its maximum bitrate could exceed that of a BD-50 or BD-25 disc. I recommend you make sure the total of all streams does not exceed 50Mbs combined for BD-50 (absolutely no more than 64Mbs) and 35Mbs for BD-25. It is very unlikely that the original stream is on a BD-50-- and the allowable bitrate on a BD-100 (for example) is almost twice what a BD-50 can handle.

If it isn't a burned disc... than I'm at a loss. TSM2UHD does nothing, repeat nothing, that could modifies the playback itself. It only sets flags in files so that they are recognizable to a UHD-BD player.

As SeeMoreDigital mentioned, it is more likely to be a TSMUXER issue... which would be a lot harder to fix. If you find out more, let me know.

[geheim]

I'm assuming this is a burned disc? If so, that's more than likely due to the bitrate exceeding what can be used on a BD-25/50. It needs to be reencoded. The only original streams I found that could be used intact were extras -- probably because they were made purposely to work on multiple formats.

I mentioned the bitrate issue twice in the README: It is very unlikely that the original stream is on a BD-50-- and the allowable bitrate on a BD-100 (for example) is almost twice what a BD-50 can handle.

If it isn't a burned disc... than I'm at a loss. TSM2UHD does nothing, repeat nothing, that could modifies the playback itself. It only sets flags in files so that they are recognizable to a UHD-BD player.

As SeeMoreDigital mentioned, it is more likely to be a TSMUXER issue... which would be a lot harder to fix. If you find out more, let me know.

The original stream comes from a UHD66, but I did my tests WITHOUT burning to a BD-R DL. Only played the folder from HDD after modifying with TMS2UHD.
That's why I assumed the bitrate couldn't be the cause of the error. Just for the fun of it I copuld try burning the folder and see what my Sony x800 does with it ;)

I'll re-check my settings in TSMuxer as well, perhaps I did something wrong there. And I'll be checking with some own footage I created myself.

I'll report if I find out anything new of course!

[geheim]

So I did some more tests and I simply can't get it working... Even tried some of my own UHD stuff which definitely doesn't exceed bitrate limits and I'm getting the same picture errors. So I guess I'm really doing something wrong with TSMuxer - but I don't know what to change.
Can you recommend any settings which worked for you?? Perhaps I need to adjust VBV buffer size??

[LowDead]

Ok first test with medium went on for appr. 31 hrs.(112500.65s) on a 20gb 1.40hr movie.
Will start next test run when I get back from work tonight.

6 core Intel i7 980x @3GHz

//LD

[jdobbs]

Ok first test with medium went on for appr. 31 hrs.(112500.65s) on a 20gb 1.40hr movie.
Will start next test run when I get back from work tonight.

6 core Intel i7 980x @3GHz

//LDDid the mux and TSM2UHD produce a working UHD-BD disc?

[LowDead]

Did the mux and TSM2UHD produce a working UHD-BD disc?

Yes it worked as it should. Do you want me to do a superfast run?

//LD

[wolflop]

Did you find out something with the samples I sent you (No Picture on UB 900)?

wolflop

[no-one]

So, it doesn't work for me unfortuanetly. I tried some original streams, made a BD Folder structure with TSMuxer, and then applied TSM2UHD to the Folder. After it finishes I tried Playback with DVD Fab Media Player (which works fine for everything I tried), but Playback gives me heavy stuttering and "jumping". Don't know what I could be making wrong here...

Thanks for your work and merry Christmas!

same promblem, It's stuttering.

pretty sure, it's tsmuxer issue. mpls file has problem.

I try with blade runner uhd.After process tsm2uhd, i check it with bdinfo.

1. movie length is changed
original : 1:57:31.377
result : 1:51:41.486

2. hdr is romoved
original : MPEG-H HEVC Video 0 kbps 2160p / 23.976 fps / 16:9 / Main 10 Profile 5.1 High / 4:2:0 / 10 bits / HDR / BT.2020 /

result : MPEG-H HEVC Video 0 kbps 2160p / 23.976 fps / 16:9 / Main 10 Profile 5.1 High / 4:2:0 / 10 bits / SDR / BT.2020 /

3. i burn into disc and play it on lg up970. It's stuttering, no hdr and video and sound not sync.

[jdobbs]

Please read the README.TXT file. I've now had to repeat this about four times.

You generally CAN'T KEEP AN ORIGINAL STREAM. The original stream is encoded at a bitrate that is TOO HIGH for a BD-25 or BD-50. For example, if the original came from a BD-100, the bitrate can be almost twice as high as a BD-50 can accomodate. You're going to get stuttering, etc, because the spinning of the disc can't keep up with the encode rate.

Everyone -- please don't make me have to explain this again!

I have no idea how HDR can be removed. You're telling me the stream is unchanged from the original --- so I don't see how that is possible. It might be that TSMUXER is removing some indicator, I don't know. Nothing TSM2UHD does removes it.

[ocean]

TSMuxer does not recreate the "extension data" HDR in the mpls playlist file, after mux, this is the missing part that you find in the original, you can find it at the end of the mpls file:

"ExtensionData": [
{
"ID1": 3,
"ID2": 5,
"data_block": [
0,
0,
0,
32,
1,
0,
0,
0,
16,
0,
0,
0,
51,
194,
134,
196,
29,
76,
11,
184,
132,
208,
62,
128,
61,
19,
64,
66,
15,
160,
0,
50,
3,
232,
2,
90
I tried the Blu-ray movie worked with TSMuxer and TSM2UHD on Hdisk, read with PowerDVD 17, the movie is recognized regularly and is fluid, without obviously HDR, for audio desync i think it always depends on an incorrect management of the TSMuxer timeline audio/video and the treatment of Gops i-frames.

[jdobbs]

TSMuxer does not recreate the "extension data" HDR in the mpls playlist file, after mux, this is the missing part that you find in the original, you can find it at the end of the mpls file:

"ExtensionData": [
{
"ID1": 3,
"ID2": 5,
"data_block": [
0,
0,
0,
32,
1,
0,
0,
0,
16,
0,
0,
0,
51,
194,
134,
196,
29,
76,
11,
184,
132,
208,
62,
128,
61,
19,
64,
66,
15,
160,
0,
50,
3,
232,
2,
90
I tried the Blu-ray movie worked with TSMuxer and TSM2UHD on Hdisk, read with PowerDVD 17, the movie is recognized regularly and is fluid, without obviously HDR, for audio desync i think it always depends on an incorrect management of the TSMuxer timeline audio/video and the treatment of Gops i-frames.Well... at least that is something I can add. I already add extension data for 3D in BD-RB. But... the problem is that since it isn't in the folder I need to get the values somehow from the original. If I had a copy of v3.00 of the standard I could have been aware of the extension. Right now I'm just getting my info from dumps. The fact that PowerDVD plays the source probably confirms bitrate as the issue in the stuttering.

[ocean]

Hi jdobbs, for the HDR static metadata extensions you can see the Standard CEA 861.3 and later document, the values should be read from the main file mpls of the movie, to read them I used BD-Tools.

[jdobbs]

Hi jdobbs, for the HDR static metadata extensions you can see the Standard CEA 861.3 and later document, the values should be read from the main file mpls of the movie, to read them I used BD-Tools.The problem is that I only work on the output folder. There is no guarantee that TSM2UHD will even have access to the original MPLS file.

[ocean]

The problem is that I only work on the output folder. There is no guarantee that TSM2UHD will even have access to the original MPLS file.

I understand, for confirmation I replaced the mpls file and clpi with the originals, in the structure created by TSM2UHD, HDR it works.

[frank]

Use ffmpeg 64 bit
--preset faster --ctu 32 --crf 22
-o output.265

It's good and fast.

Don't use
--slices 4 --input-depth 10 --output-depth 10 --level-idc 51
x265 sets it automatically right. level 50 is sufficient for BD bitrates.

Maybe the --slices instruction is the cause of stuttering. ffmpeg had problems with it (lookahead).
I only make mkv and never had problems with --uhd-bd

ffmpeg64.exe -loglevel warning << info or verbose gives more information about decoding

[jdobbs]

Use ffmpeg 64 bit
--preset faster --ctu 32 --crf 22
-o output.265

It's good and fast.

Don't use
--slices 4 --input-depth 10 --output-depth 10 --level-idc 51
x265 sets it automatically right. level 50 is sufficient for BD bitrates.

Maybe the --slices instruction is the cause of stuttering. ffmpeg had problems with it (lookahead).
I only make mkv and never had problems with --uhd-bd

ffmpeg64.exe -loglevel warning << info or verbose gives more information about decodingActually, if I recall correctly, I think I added the "--slices 4" in order to get rid of stuttering.

If you made an MKV it doesn't have to be UHD-BD compliant either... I can tell you that using "--uhd-bd" cause problems on my Sony player because it forces settings that cause stutter.

[A.Fenderson]

I was just doing my semi-annual web search for any free UHD authoring tools and ran across this tool. Of course jdobbs, building on work by the tsMuxeR author(s) of course, is the first person on the internet to get this working at all! :-)

Despite having rushed the test and largely having no idea what I'm doing, I can report success under the following scenario:

Source file info (captured with Sony FDR-AX53 @ 4K/29.97fps):

Format/Info : Advanced Video Codec
Format profile : High@L5.1
Format settings : CABAC / 2 Ref Frames
Format settings, CABAC : Yes
Format settings, RefFrames : 2 frames
Codec ID : avc1
Codec ID/Info : Advanced Video Coding
Duration : 4 min 2 s
Bit rate mode : Variable
Bit rate : 93.7 Mb/s
Maximum bit rate : 100.0 Mb/s
Width : 3 840 pixels
Height : 2 160 pixels
Display aspect ratio : 16:9
Frame rate mode : Constant
Frame rate : 29.970 (30000/1001) FPS

video reencode to h265 was via HandBrake with custom settings:
x265 (w/ AAC audio reencoded from PCM, inside MKV)
no change to resolution, anamorphic: none.
no filters
constant framerate
35000 kbps avg bitrate, 2-pass encode
(ultrafast, fwiw, to get it done sooner)

Remuxed with tsMuxeR 2.6.11 to Blu-ray folder output.

note: at this point I did burn the raw tsMuxeR output to a BD-RE25, which would play with audio and no video on my Xbox One S.

Processed with the TSM2UHD.

Burned final Blu-ray folder structure to BD-RE25 via ImgBurn 2.5.8.0.

Played back flawlessly in my Xbox One S.

One mistake I noticed I made was to leave Handbrake's framerate at 30fps instead of "same as source" or even 29.97 (I was working from an existing template and neglected to change this). The output file shows as 30.0 fps in MediaInfo, yet when played on the XB1S, it shows as 25fps and outputs at 50fps.

In any case, so far as I can tell this is a major breakthrough in home-authoring of UHD BD content, and therefore I am contributing to jdobbs for his initiative in tackling this issue (if he will kindly PM me the email address to which I can send his donation).

:thanks:

[frank]

jdobbs: I think I added the "--slices 4" in order to get rid of stuttering.
x265 sets lslices=8, so all my hardware incl. libreELEC TV-Box play 4k streams flawlessly with HW-decoding.

Unfortunately old TsMuxer was not developed and tested with 4k HEVC...

[A.Fenderson]

I ran another test, again encoding via Handbrake, but this time bumping the bitrate to 50,000 kbps (and keeping source framerate intact), then burning to 50GB BD-RE DL. Source material, as before, is 8-bit (SDR) 4K 4:2:0 output from Sony FDR-AX53.

tsMuxeR didn't detect frame-rate, so set explicitly to 30000/1001 to match source file. Inserted chapter every 1 minute.

Burned the raw remux to BD-RE DL 50GB and attempted to play in XB1S: audio with no video.

Processed tsMuxer's output via TSM2UHD, burned this to BD-RE DL, and attempted to play in my XB1S: overall decent playback, with very occasional stuttering, though any attempt to skip chapters would lock up playback and force me to exit the BD player application entirely. Oddly, the bitrate readout of the XB1S very regularly showed bitrates far in excess of 50 Mbps, sometimes for several seconds at a time. It even hovered in the mid 70s for several seconds once. I don't know whether to chalk these issues up to simply a worthless implementation of bitrate monitor on that system, bad rate control from x265 (highly unlikely), Handbrake not properly passing the rate control parameters off to x265 (also seems unlikely), problems caused by encoding via the Handbrake GUI in the first place without explicitly passing the required parameters to restrict the encode to UHD compatibility, or something else entirely. In any case, to get meaningful results, I'm going to have to quit being lazy with these encodes to ensure the results meet UHD-BD restrictions.

jdobbs: If you will let me know which UHD-BD player(s) you are testing on, I will possibly attempt to purchase a proper standalone player of a different brand and/or model myself so that we can test across as many different players as possible: I've been wanting to get one anyway, and I think it would make for more valuable tests than using the Xbox. Is your Sony player the X800? Also the donation link in your sig doesn't auto-fill your email address.

[LowDead]

@A.Fenderson: Yes, he has the Sony. I have the Samsung UBD-K8500. So any other then for you ;-)

//LD

[jdobbs]

I ran another test, again encoding via Handbrake, but this time bumping the bitrate to 50,000 kbps (and keeping source framerate intact), then burning to 50GB BD-RE DL. Source material, as before, is 8-bit (SDR) 4K 4:2:0 output from Sony FDR-AX53.

tsMuxeR didn't detect frame-rate, so set explicitly to 30000/1001 to match source file. Inserted chapter every 1 minute.

Burned the raw remux to BD-RE DL 50GB and attempted to play in XB1S: audio with no video.

Processed tsMuxer's output via TSM2UHD, burned this to BD-RE DL, and attempted to play in my XB1S: overall decent playback, with very occasional stuttering, though any attempt to skip chapters would lock up playback and force me to exit the BD player application entirely. Oddly, the bitrate readout of the XB1S very regularly showed bitrates far in excess of 50 Mbps, sometimes for several seconds at a time. It even hovered in the mid 70s for several seconds once. I don't know whether to chalk these issues up to simply a worthless implementation of bitrate monitor on that system, bad rate control from x265 (highly unlikely), Handbrake not properly passing the rate control parameters off to x265 (also seems unlikely), problems caused by encoding via the Handbrake GUI in the first place without explicitly passing the required parameters to restrict the encode to UHD compatibility, or something else entirely. In any case, to get meaningful results, I'm going to have to quit being lazy with these encodes to ensure the results meet UHD-BD restrictions.

jdobbs: If you will let me know which UHD-BD player(s) you are testing on, I will possibly attempt to purchase a proper standalone player of a different brand and/or model myself so that we can test across as many different players as possible: I've been wanting to get one anyway, and I think it would make for more valuable tests than using the Xbox. Is your Sony player the X800? Also the donation link in your sig doesn't auto-fill your email address.Just a note... I don't think 29.97fps is legal for 2160p. Below is a table I saw in the v3.1 White Paper that can be downloaded for free. Make sure you are setting the MAXIMUM bitrate to 50Mbs, not the average bitrate.

There may be something extra that is needed in order for 2160p chapter skipping to work that TSMUXER doesn't provide. There's already been a report of an extension for HDR that I didn't know about, so it wouldn't surprise me. I'll have to do some comparisons of the original and TSMUXER files and see what I find.

My UHD-BD player is a Sony UBP-X800.

[A.Fenderson]

OK, thanks for the replies.

I ordered the LG UP870, as it's the cheapest standalone I could find (just over $100 USD here) and a different brand from either LowDead's or jdobbs' machines.

Yeah, I obviously don't know what I'm doing when reencoding, so I'm going to have to put some work into it. I had skimmed through that whitepaper and not even made a mental note of the allowable framerates.

I did find out that I can pass the uhd-bd flag to x265 via Handbrake in the "extra options" field, but I then also realized that 8-bit color is not UHD-BD compatible either:

x265 [error]: uhd-bd: bit depth, chroma subsample, source picture type must be 10, 4:2:0, progressive
So obviously I have lots more research to do to get up to speed on this. If anyone has links for noobs to try to learn x265 CLI and/or downloadable and copyright-free non-HDR 10-bit UHD video clips, that would be appreciated too.

[LowDead]

@jdobbs: Have you tried a 1:1 copy of a movie that fits a bd-50? I have done a couple, and what strikes me is that they play flawlessly. For instance mediainfo report Maximum Overall bit rate: 109 Mb/s for Rise of the planet of the apes. As I don't have bitrate display on the Samsung I have to rely on software.

//LD

[jdobbs]

@jdobbs: Have you tried a 1:1 copy of a movie that fits a bd-50? I have done a couple, and what strikes me is that they play flawlessly. For instance mediainfo report Maximum Overall bit rate: 109 Mb/s for Rise of the planet of the apes. As I don't have bitrate display on the Samsung I have to rely on software.

//LDI have and it doesn't work for me. The bitrate is too high and the playback stutters. I'm guessing the only reason it is working is because you are using a software player. 109Mbs is the maximum bitrate for a BD-100, not a BD-50.

[LowDead]

I have and it doesn't work for me. The bitrate is too high and the playback stutters. I'm guessing the only reason it is working is because you are using a software player. 109Mbs is the maximum bitrate for a BD-100, not a BD-50.

Sorry for not being clear. It works flawlessly on my samsung standalone. Maybe it has a good amount of memory for caching? I have no idea, but it works. I checked the bitrate on my pc.

//LD

[jdobbs]

Sorry for not being clear. It works flawlessly on my samsung standalone. Maybe it has a good amount of memory for caching? I have no idea, but it works. I checked the bitrate on my pc.

//LDMy guess is that you got lucky. I'm assuming that the maximum bitrate increases due to spin speed of the disc. It sounds like your player spins at 4x even with a BD-50.

[ocean]

Tested Rise of the planet of the apes mastered on BD-RE 50GB, with XBOX One X and Samsung UBD-K8500, fluid vision without stuttering, m2ts main 35 GiB, peak bitrate 64 Mb/s, average bitrate 40-45 Mb/s.

[jdobbs]

Tested Rise of the planet of the apes mastered on BD-RE 50GB, with XBOX One X and Samsung UBD-K8500, fluid vision without stuttering, m2ts main 35 GiB, peak bitrate 64 Mb/s, average bitrate 40-45 Mb/s.Thanks for posting.

Just out of curiosity... what command line did you use for reencoding?

[wolflop]

Ive send you samples 3 weeks ago. Did you find something out jdobbs?

[LowDead]

@jdobbs: Would it be possible for you to squeeze in x264 m2ts support also? Have some I wanna test with.

//LD

[jdobbs]

@jdobbs: Would it be possible for you to squeeze in x264 m2ts support also? Have some I wanna test with.

//LDI don't understand what you are asking for?

[LowDead]

To have it accept a x264 encoded stream, but maybe that isn't in UHD specs. I don't know.

//LD

[A.Fenderson]

To have it accept a x264 encoded stream, but maybe that isn't in UHD specs. I don't know.

//LD

It is, but only at 1920x1080 @ either 23.976 or 24.0 fps, 40 Mbps max, High or Main, L 4.1 or 4.0. See page 14 of this white paper(.pdf). (http://www.blu-raydisc.com/assets/Downloadablefile/BD-ROM_Part3_V3.0_WhitePaper_150724.pdf)

[MB2]

I've had success but most of the time, before I can even get it into a folder format, TSMuxer gives me this error:

Reading buffer overflow. Possible container streams are not syncronized. Please, verify stream fps. File name: H:\Batman v Superman Dawn Of Justice (2016) (UHD) (BD100)\BDMV\STREAM\00000.m2ts

Any ideas, suggestions or settings? All I am doing is dropping in the m2ts and creating Blu-ray folder.



The film "Hidden Figures" loses it's HDR for some reason too after running through TSm2UHD

[LowDead]

I've had success but most of the time, before I can even get it into a folder format, TSMuxer gives me this error:

Reading buffer overflow. Possible container streams are not syncronized. Please, verify stream fps. File name: H:\Batman v Superman Dawn Of Justice (2016) (UHD) (BD100)\BDMV\STREAM\00000.m2ts

Any ideas, suggestions or settings? All I am doing is dropping in the m2ts and creating Blu-ray folder.



The film "Hidden Figures" loses it's HDR for some reason too after running through TSm2UHD

Try demuxing the audio and then use the demuxed file as source in tsMuxer.

The reason it looses the HDR is discussed earlier in this thread.

//LD

[jdobbs]

I've found that sometimes an odd PGS can cause that error. Try demuxing the video and audio separately... then try each subtitle until you find the one that is the problem.

[A.Fenderson]

I ripped (via MakeMKV) then demuxed and remuxed (both via tsMuxeR) the main movie file of my copy of BladeRunner 2049. I did not reencode video or audio, as I wanted to make sure all streams were 100% UHD-BD compliant (though I did cut out a couple of foreign language audio tracks). The resulting BD structure was 81 GB, so I burned to a new Sony BD-RE XL 100GB disc using my new Asus BW-16D1HT at the rated maximum of 2x burn speed.

The resulting disc was not recognized as UHD-BD at all in either my LG UP870 UHD-BD player, nor my Xbox One S.

I then ran TSM2UHD on the remux from above, and reburned as above: same results on both players.

I don't have UHD-BD playback ability on my PC, as the requirements are insane, but reading from the same drive that burned it, I can play back the main-movie m2ts file, for what that's worth.

To do further testing, especially on the disc itself, I remuxed a very brief pre-movie m2ts file from a different UHD-BD title, burned it to the same BD-RE XL 100GB disc, and attempted to play it back: raw tsMuxeR output failed to be recognized by either player, as did the TSM2UHD-processed files burned later.

Realizing that the above may point to nothing other than the possibility that (my) UHD-BD players do not play nice with BD-RE XL 100GB discs, I reburned the final TSM2UHD-processed files to a BD-RE DL 50GB disc: it did play on both players, though with stuttering. This was ripped from a 66GB UHD-BD, and the Xbox showed spikes of 100 Mbps, so that is not surprising.

Anyway, I don't yet have any (non rewriteable) BD-R XL 100GB discs to test with, those these may (hopefully will) be readable in my players (and all players generally). I am unaware of any UHD-BDs that have been pressed to 50GB discs, and I am still unsure of how to get 100% UHD-BD compliance when reencoding video, so for now I'm at an impasse as regards contributing to testing.

If anyone is aware of any available UHD-BD releases on 50 GB discs, please let me know.

[MB2]

Hi,

BD50 UHD's

Alien Covenant
Hidden Figures
Boss Baby, The
Captain Underpants - The First Epic Movie
Despicable Me 1 and 2
Lego Batman Movie
Rise Of The Planet Of The Apes
Prometheus
Texas Chainsaw Massacre (1974)
Underworld 5 - Blood Wars
Dark Tower, The
Emoji Movie, The
Fantastic 4 (2015)
Hitman - Agent 47
Keeping Up With The Joneses
Lego Movie, The
Mike and Dave Need Wedding Dates
Peanuts Movie, The
Rough Night
Trolls
Wild
Lego Ninjago Movie, The
Morgan
Sausage Party



Also, BD-RE XL do not work in my Oppo 203 either. BD-R XL do. I sent them some test copies and they updated their firmware.

:)

[A.Fenderson]

I spot-checked a few of those titles against the blu-ray.com and highdefdigest.com listings, and all were stated to be 66GB discs. Where did see them stated to be 50 GB discs?

I did order a 5-pack of BD-R XL 100 GB discs for testing.

[MB2]

I have all those, and they all fit on BD50, untouched with menus etc

Not sure if they actually were on a BD66 as such, but file size is defo under 50gb

:)

[jdobbs]

I ripped (via MakeMKV) then demuxed and remuxed (both via tsMuxeR) the main movie file of my copy of BladeRunner 2049. I did not reencode video or audio, as I wanted to make sure all streams were 100% UHD-BD compliant (though I did cut out a couple of foreign language audio tracks). The resulting BD structure was 81 GB, so I burned to a new Sony BD-RE XL 100GB disc using my new Asus BW-16D1HT at the rated maximum of 2x burn speed.

The resulting disc was not recognized as UHD-BD at all in either my LG UP870 UHD-BD player, nor my Xbox One S.

I then ran TSM2UHD on the remux from above, and reburned as above: same results on both players.

I don't have UHD-BD playback ability on my PC, as the requirements are insane, but reading from the same drive that burned it, I can play back the main-movie m2ts file, for what that's worth.

To do further testing, especially on the disc itself, I remuxed a very brief pre-movie m2ts file from a different UHD-BD title, burned it to the same BD-RE XL 100GB disc, and attempted to play it back: raw tsMuxeR output failed to be recognized by either player, as did the TSM2UHD-processed files burned later.

Realizing that the above may point to nothing other than the possibility that (my) UHD-BD players do not play nice with BD-RE XL 100GB discs, I reburned the final TSM2UHD-processed files to a BD-RE DL 50GB disc: it did play on both players, though with stuttering. This was ripped from a 66GB UHD-BD, and the Xbox showed spikes of 100 Mbps, so that is not surprising.

Anyway, I don't yet have any (non rewriteable) BD-R XL 100GB discs to test with, those these may (hopefully will) be readable in my players (and all players generally). I am unaware of any UHD-BDs that have been pressed to 50GB discs, and I am still unsure of how to get 100% UHD-BD compliance when reencoding video, so for now I'm at an impasse as regards contributing to testing.

If anyone is aware of any available UHD-BD releases on 50 GB discs, please let me know.I also have a BD-XL burner... and could never get my UHD-BD player to recognize it. There's something different in the format, I just don't know what it is. The stuttering is almost certainly caused by the excessive bitrate of the original. As I've said before, I have yet to find anything other than a few extras that would play back properly without reencoding due to bitrate.

[geheim]

As I've said before, I have yet to find anything other than a few extras that would play back properly without reencoding due to bitrate.

I've remuxed Rise of the Planet of the Apes with DVDFab on BD50. No reencoding was done and playback works just fine on my x800. Perhaps you could try that movie for testing purposes.

[jdobbs]

I've remuxed Rise of the Planet of the Apes with DVDFab on BD50. No reencoding was done and playback works just fine on my x800. Perhaps you could try that movie for testing purposes.Interesting...

[A.Fenderson]

Isn't it possible though, that the encode or overall stream bitrate exceeds UHD50 specs, but that particular player is able to spin the disc higher than spec in an attempt to keep up?

[jdobbs]

Isn't it possible though, that the encode or overall stream bitrate exceeds UHD50 specs, but that particular player is able to spin the disc higher than spec in an attempt to keep up?Except... it is the same player I have, and none of the ones I've tried worked.

@geheim

Did DVDFab mux in an ATMOS track with it?

[A.Fenderson]

Except... it is the same player I have, and none of the ones I've tried worked.

Gotcha. Well, be it known that the title in question is part of Amazon's 4K UHD Value Promotion (https://www.amazon.com/b?node=17360628011), meaning it can be had for $16.66 if you're willing to buy two other titles on the list at the same time. Please note all the fine-print at the bottom of the page, however, and also know that you can only use the offer once per account: I've placed one order and attempted a second, but no discount, and when I chatted customer service they quoted me invisible rules that amount to "one offer per customer" though it's not stated on the page.

[rtosco]

Did you find out something with the samples I sent you (No Picture on UB 900)?

wolflop

Same player, same result... No picture, only audio on the Panasonic UB900. It seems we're out of luck.
Thanks for your work jdobbs though!

Roberto

[jdobbs]

Anyone:

I've found another extension related to UHD-BD. It is in the index.bdmv file and is identified by ID1=3, ID2=1. Does anyone have any idea what this extension contains?

As for the extension found in the MPLS file, I thought I'd share that after dumping it out and some investigating, it contains the HDR information for the playlist. It is represented by ID1=3, ID2=5 and holds the HDR specifics including: G, B, R and white point (WP) x/y pairs in units of 0.00002. The Luma (L) min (in units of .0001) and max (as a whole number), the maximum content light level (MaxCLL) and the maximum frame average light level (MaxFALL).

The G,B,R,WP information has been consistent with Display P3 in every example I've seen (where HDR is present).

[jdobbs]

To have it accept a x264 encoded stream, but maybe that isn't in UHD specs. I don't know.

//LDImporting it into a pseudo-BD is fine... but if it is UHD it will have to be reencoded to HEVC before attempting to burn to a BD.

[ocean]

Anyone:

I've found another extension related to UHD-BD. It is in the index.bdmv file and is identified by ID1=3, ID2=1. Does anyone have any idea what this extension contains?


Thanks for information, file index.bdmv "Extension data":

"ExtensionData": [
{
"ID1": 3,
"ID2": 1,
"data_block": [
0,
0,
0,
8,
81,
0,
2,
0,
0,
0,
0,
0
http://i63.tinypic.com/213234g.png

[jdobbs]

I have some good news. The extension (see the reply above from ocean) to the index.bdmv has fixed some issues.

The comments I'd made earlier about always having to reencode because of bitrates doesn't seem to apply now. I've taken several original streams and muxed them directly without reencoding and they appear to work fine when burned to a BD-50 (both RE and R). The cause of the stuttering was apparently caused by the lack of the index.bdmv extension providing the player some needed information.

My thanks to ocean and geheim for helping close another gap on the backup capability of UHD-BD.

I'll release a new version of TSM2UHD with this and a couple other fixes in day or two.

[jdobbs]

I've updated the first post of this thread with a new release of TSM2UHD.

Changes:

- Added MEDIAINFO to the release (zip file) for collection of UHD and HDR information
Note: The version of MediaInfo.exe included with TSM2UHD must
be present in the same folder as TSM2UHD.EXE in order for it to execute.
- Now adds necessary extensions to MPLS and index.bdmv files. This assures greater compliance.
- Several minor changes and updates.
- With this version you may often be able to keep original files intact (when they fit on a BD-50).

[spexman]

All your excellent work and expertise is much appreciated....thanks!

[jdobbs]

I've had success but most of the time, before I can even get it into a folder format, TSMuxer gives me this error:

Reading buffer overflow. Possible container streams are not syncronized. Please, verify stream fps. File name: H:\Batman v Superman Dawn Of Justice (2016) (UHD) (BD100)\BDMV\STREAM\00000.m2ts

Any ideas, suggestions or settings? All I am doing is dropping in the m2ts and creating Blu-ray folder.



The film "Hidden Figures" loses it's HDR for some reason too after running through TSm2UHDJust an additional note on this. Most of the time if you demux the video first, and then demux the audio/subtitles you can get past this error (that's what BD Rebuilder does when it runs into it). Then just remux by combining all the components in TSMUXER. If you have access to the MPLS in a source BD structure, you can also open that with TSMUXER -- and cut and paste the chapter times from the Blu-Ray tab into the same place in the new mux.

[wolflop]

Still the same problem as I already described. Movie burned on a BDXL 100 Rewriteable, played with UB900. No picture, sound is working properly

mediainfo after TM2Uhd 1.1

Allgemein
ID : 1 (0x1)
Vollständiger Name : E:\Datensicherung\UHDRips\AlienCov\BDMV\STREAM\00000.m2ts
Format : BDAV
Format/Info : Blu-ray Video
Dateigröße : 32,0 GiB
Dauer : 2 h 2 min
Modus der Gesamtbitrate : variabel
Gesamte Bitrate : 37,5 Mb/s
maximale Gesamtbitrate : 35,5 Mb/s

Video
ID : 4113 (0x1011)
Menü-ID : 1 (0x1)
Format : HEVC
Format/Info : High Efficiency Video Coding
Format-Profil : Main 10@L5.1@High
Codec-ID : 36
Dauer : 2 h 2 min
Bitrate : 35,3 Mb/s
Breite : 3 840 Pixel
Höhe : 2 160 Pixel
Bildseitenverhältnis : 16:9
Bildwiederholungsrate : 23,976 (24000/1001) FPS
ColorSpace : YUV
ChromaSubsampling/String : 4:2:0 (Type 2)
BitDepth/String : 10 bits
Bits/(Pixel*Frame) : 0.177
Stream-Größe : 30,1 GiB (94%)
verwendete Encoder-Bibliothek : ATEME Titan File 3.8.3 (4.8.3.0)
colour_range : Limited
colour_primaries : BT.2020
transfer_characteristics : PQ
matrix_coefficients : BT.2020 non-constant
MasteringDisplay_ColorPrimaries : R: x=0.680000 y=0.320000, G: x=0.265000 y=0.690000, B: x=0.150000 y=0.060000, White point: x=0.312700 y=0.329000
MasteringDisplay_Luminance : min: 0.0050 cd/m2, max: 1000.0000 cd/m2

Audio
ID : 4352 (0x1100)
Menü-ID : 1 (0x1)
Format : DTS
Format/Info : Digital Theater Systems
Format_Settings_Mode : 16
Format-Einstellungen für Endianess : Big
Codec-ID : 130
Dauer : 2 h 2 min
Bitraten-Modus : konstant
Bitrate : 768 kb/s
Kanäle : 6 Kanäle
Kanal-Positionen : Front: L C R, Side: L R, LFE
Samplingrate : 48,0 kHz
Bildwiederholungsrate : 93,750 FPS (512 SPF)
BitDepth/String : 24 bits
Stream-Größe : 670 MiB (2%)

Text #1
ID : 4608 (0x1200)
Menü-ID : 1 (0x1)
Format : PGS
Codec-ID : 144

Text #2
ID : 4609 (0x1201)
Menü-ID : 1 (0x1)
Format : PGS
Codec-ID : 144
Dauer : 2 h 1 min
Video Verzögerung : 3s 86 ms

[A.Fenderson]

Still the same problem as I already described. Movie burned on a BDXL 100 Rewriteable, played with UB900. No picture, sound is working properly

Unfortunately, as with the early-ish days of Blu-ray, it seems as though playback of consumer writable and rewritable media at the native format capacity (100 GB here) is not a requirement for players to meet the UHD-BD standard. From what I've seen, it's starting to look as though most players will likely support BD-R/RE 25 GB and 50 GB discs, but very few will support BDXL R/RE 100 GB discs. If the remuxed stream will fit on a BD-R/RE 50 GB disc, have you tried that?

[geheim]

Thanks for the new version, jdobbs.
Unfortunately it still doesn't work like expected on my x800. HDR is not recognized, seems there are still some flags missing. Audio is not sync with video, there is a difference of quite a few minutes at the end of the movie. And the video itself plays better than before, but there are still some occasional stutterings.

Hopefully you can figure out what is still missing. If I can help with some additional testing feel free to ask. Thanks for working on this!

[no-one]

Thanks for the new version, jdobbs.
Unfortunately it still doesn't work like expected on my x800. HDR is not recognized, seems there are still some flags missing. Audio is not sync with video, there is a difference of quite a few minutes at the end of the movie. And the video itself plays better than before, but there are still some occasional stutterings.

Hopefully you can figure out what is still missing. If I can help with some additional testing feel free to ask. Thanks for working on this!

Same problem.

And After process tsmuxer, every movie duration is set = 01:53:45:443 in mpls file

[wolflop]

The Ub900 supports 100 GB of Xl BDR discs. If I burn complete untouched discs, they will work fine.

[jdobbs]

Standard BD-XL discs are not formatted in the same way as a UHD BD-100. It just isn't reasonable to expect them to work. For them to do so would be the exception rather than the rule.

[rtosco]

Standard BD-XL discs are not formatted in the same way as a UHD BD-100. It just isn't reasonable to expect them to work. For them to do so would be the exception rather than the rule.

Hi jdobbs, I don't think the video problem on the UB900 is related to BD-100, I'm using BD-RE 50 and still have no picture even with 1.11 program version. The player does not trigger HDR on the TV and only sound is (correctly) played. Maybe something is still missing and/or the Panasonic player is more adherent to UHD specs than other players.
Thanks for keeping improving your piece of SW!

[jdobbs]

Thanks for the new version, jdobbs.
Unfortunately it still doesn't work like expected on my x800. HDR is not recognized, seems there are still some flags missing. Audio is not sync with video, there is a difference of quite a few minutes at the end of the movie. And the video itself plays better than before, but there are still some occasional stutterings.

Hopefully you can figure out what is still missing. If I can help with some additional testing feel free to ask. Thanks for working on this!Well... I have the same player and I am getting no sync issues, no stuttering, etc. What process are you using to create it?

[jdobbs]

Hi jdobbs, I don't think the video problem on the UB900 is related to BD-100, I'm using BD-RE 50 and still have no picture even with 1.11 program version. The player does not trigger HDR on the TV and only sound is (correctly) played. Maybe something is still missing and/or the Panasonic player is more adherent to UHD specs than other players.
Thanks for keeping improving your piece of SW!Can you send me a zip containing everything on the disc except the M2TS file?

[geheim]

Well... I have the same player and I am getting no sync issues, no stuttering, etc. What process are you using to create it?

This time I tested with an MKV file from Inferno with german audio - processed with TSMuxer, using BluRay folder output mode. Then I used TSM2UHD 1.11 on that folder.
The resulting disc folder didn't play at all on Windows using DVDFab Media Player, but I burnt to a Sony BD-RE 50GB to test on my x800 and got the issues described above...

[A.Fenderson]

movie: Argo UHD (66 GB dual layer disc).
ripped via MakeMKV 1.10.10.
demuxed via tsMuxeR 2.6.11.
reumuxed main (only) video (HEVC 4K), DTS core English audio, & 2 English PGS streams via tsMuxer 2.6.11.
burned & verified with ImgBurn 2.5.8.0 to Verbatim BD-R (not -RE) 50 GB disc via Asus BW-16D1HTv3.00
attempted playback in LG UP870: recognized as Blu-ray disc, but playback immediately fails to main system menu.
attempted playback in Xbox One S: playback semi-successful with audio but no video. Xbox bitrate scanner showed as high as ~130 Mbps, which is max allowable bitrate on HTR zone of 66 & 100 GB UHD-BD discs. However, it also reported the stream as 1080p.

ran TSM2UHD v1.11 on above-referenced remux: success with no errors reported.
burned & verified with ImgBurn 2.5.8.0 to Verbatim BD-R (not -RE) 50 GB disc via Asus BW-16D1HTv3.00
attempted playback in LG UP870: playback attempted, audio fine, video displays decode errors every two seconds or more often, largely as bright monochrome blocks throughout the picture.
I noticed there was a pending firmware upgrade for the player, so applied that, but no change in playback results.
attempted playback in Xbox One S: playback is largely OK, with no audio issues and only occasional slight stuttering of the video, but result is actually arguably watchable, just not perfect.

I'm guessing from this test that the Xbox One S may have the ability to spin BD50s at speeds high enough to ensure smooth(ish) playback of videos encoded somewhere above the max bitrate the spec calls for regarding BD50s, but that the LG UP870 isn't quite as successful.

For what it's worth, I'm now burning to BD-RE XL 100 GB, but I don't anticipate that working at all, as neither of my players previously worked with this disc type.

---
edit: neither player will recognize the BD-RE XL 100 GB burn (verified via ImgBurn) of Argo.

[jdobbs]

Thanks for the new version, jdobbs.
Unfortunately it still doesn't work like expected on my x800. HDR is not recognized, seems there are still some flags missing. Audio is not sync with video, there is a difference of quite a few minutes at the end of the movie. And the video itself plays better than before, but there are still some occasional stutterings.

Hopefully you can figure out what is still missing. If I can help with some additional testing feel free to ask. Thanks for working on this!Well... I have the same player and I am getting no sync issues, no stuttering, etc. What process are you using to create it?I stand corrected. I just ran a disc and got the same results you posted. I'd done this disc before... I'm now looking to see what has changed.

[jdobbs]

This time I tested with an MKV file from Inferno with german audio - processed with TSMuxer, using BluRay folder output mode. Then I used TSM2UHD 1.11 on that folder.
The resulting disc folder didn't play at all on Windows using DVDFab Media Player, but I burnt to a Sony BD-RE 50GB to test on my x800 and got the issues described above...I'm not sure about all the details around your post... but it is rare that the video in an MKV is compliant.

[geheim]

I'm not sure about all the details around your post... but it is rare that the video in an MKV is compliant.

It was a remux from an original UHD - so the video inside the MKV was compliant as it was an original hevc stream.

[rtosco]

Can you send me a zip containing everything on the disc except the M2TS file?

I would gladly do, but I can't find your e-mail address I should send the files to. And I'm not able to send private messages either...

Could you please send me a pm?
Thanks,
Roberto

[jdobbs]

I would gladly do, but I can't find your e-mail address I should send the files to. And I'm not able to send private messages either...

Could you please send me a pm?
Thanks,
Roberto I sent you a pm. You can also find the address under HELP in BD Rebuilder.

[ocean]

Thanks for the great work, the mpls file now contains data extensions HDR, something is missing in the clpi file for HDR activation, replacing the original clpi file in the structure created with TSM2UHD, works HDR.

File clpi original:

"ProgramInfo": {
"reserved_for_word_align": 0,
"program_sequence": [
{
"SPN_program_sequence_start": 0,
"program_map_PID": 256,
"reserved01": 0,
"stream_in_ps": [
{
"stream_PID": 4113,
"stream_coding_type": "H.265",
"video_format": "2160p",
"frame_rate": "23.976",
"aspect_ratio": "16:9",
"reserved01": 0,
"cc_flag": 0,
"reserved02": 4608,
"ISRC": {
"country_code": "",
"copyright_holder": "",
"recording_year": "",
"recording_number": ""
},
"reserved03": 0


File clpi after use TSMuxer and TSM2UHD:

"ProgramInfo": {
"reserved_for_word_align": 0,
"program_sequence": [
{
"SPN_program_sequence_start": 0,
"program_map_PID": 256,
"reserved01": 0,
"stream_in_ps": [
{
"stream_PID": 4113,
"stream_coding_type": "H.265",
"video_format": "2160p",
"frame_rate": "23.976",
"aspect_ratio": "16:9",
"reserved01": 0,
"cc_flag": 0,
"reserved02": 0,
"ISRC": {
"country_code": "00",
"copyright_holder": "000",
"recording_year": "00",
"recording_number": "00000"
},
"reserved03": 0

[jdobbs]

@ocean

Thanks... so it appears they've used some of the reserved space to flag something related to HDR... now I have to figure out what the "4608" (0x1200) represents. This sure would be easier if I had the documentation. Oh well, we all have our crosses to bear I guess.

[sneaker_ger]

If you google "m2ts 4608" you find a lot of MediaInfo hits with 4608 being an ID for a PGS track. (Actually, there is one such post on the last page.) Coincidence?

[jdobbs]

If you google "m2ts 4608" you find a lot of MediaInfo hits with 4608 being an ID for a PGS track. (Actually, there is one such post on the last page.) Coincidence?You never know. But I'm was guessing there are two bit-level flags being set there:

decimal
4608

hex
0x1200

binary
0001 0010 0000 0000

[jdobbs]

If you google "m2ts 4608" you find a lot of MediaInfo hits with 4608 being an ID for a PGS track. (Actually, there is one such post on the last page.) Coincidence?But that brings out something interesting.... I just noticed that an M2TS stream I'm examining has a large group of PGS streams that use PID numbers starting at 0x12A0. That's new. The pre-v3.00 standard reserved PIDs 0x1200 - 0x129F for PGS streams (with 0x1220-0x129F being added with the 3D changes)... that has be an indicator that something new is going on.

You'd think "Ahh... new PIDs higher resolution PGS streams." -- but I thought I read in the White Paper I downloaded that the subtitles were still using 1080p PGS streams. I'll have to go back and make sure. Of course subtitles aren't the only thing a PGS stream can be used for...


[Edit] Well... all the HDR streams I've looked at so far use the same settings of 0x1200 -- so at least I can set it to that value for testing. I would guess that one flag says "UHD" and the other says "HDR". But since there's already a format flag that gets set for 2160p and a stream coding type that calls out HEVC, the first one is certainly in question. It would help if I could find an original CLPI for a stream that isn't HDR.

[Edit #2] Ok... I found one that was BT.709 and the new flag info was set to 0x0100. So I'm guessing only the first byte is really in play here. It appears that 0x12 flags BT.2020 and HDR and 0x01 flags BT.709. Still just guessing... but so far every one I've looked at is set to one of those two values.

[ocean]

Exactly, I confirm original PGS "4768" 0x12A0 movie Rise of the Planet of the Apes CLPI, after TSMuxer and TSM2UHD PGS "4608" 0x1200:

Original

"stream_PID": 4768,
"stream_coding_type": "PGS",
"language_code": "jpn",
"reserved01": 0,
"ISRC": {
"country_code": "",
"copyright_holder": "",
"recording_year": "",
"recording_number": ""

after TSMuxer and TSM2UHD


"stream_PID": 4608,
"stream_coding_type": "PGS",
"language_code": "jpn",
"reserved01": 0,
"ISRC": {
"country_code": "00",
"copyright_holder": "000",
"recording_year": "00",
"recording_number": "00000"

edit: My apologize jdobbs, I had reversed the stream.

[isoss]

hoi All,

Is there a version that wil run on a Mac OS X

greatings

isoss

[manson.reznor]

Many thanks Jdobbs for your phenomenal job on Bd Rebuilder and TSM2UHD.


TSM2UHD works fine on a Sony UBP-X700 and the Xbox One S.

I have the same problem than others > no HDR playing.

I don't have the CLPI or playlist files because I use UHD MKV files rip recoded keeping HDR with ripbot264. Then remuxed with TsMuxer bluray structure and "converted" to UHD BD with TSM2UHD.

It is possible to re-create the playlists files from a MKV or modifiy the file after remux ?

When Bd Rebuilder will be "UHD HDR Ready" ?

ps: sorry for my English - I'm French :)

[ed_co]

Please mac version!! ;)

[jdobbs]

Please mac version!! ;)Sorry. I don't do Mac.

[SeeMoreDigital]

Sorry. I don't do Mac.

I've said it before... This forum could really do with a 'like' button :)

[jdobbs]

I've updated the first post of this thread with a new release (v1.12). Changes for this release: - Added support for setting previously unknown flags that show HDR, BT.2020 and BT.709 in
the CLPI file.
- Minor and cosmetic changes.

[ocean]

Thanks jdobbs, now HDR works perfectly.

[manson.reznor]

How HDR works with you ?

I tried with a 2160p HDR mkv file converted to Bluray with TSmuxer > and TSM2UHD

No HDR output on my Xbox One S :confused:

[ocean]

Hi manson.reznor, tested with movie Rise of the Planet of the Apes structure folder, try to convert from folder instead of the container matroska.

[wolflop]

Still not working on UB 900. No Picture. Sound ok. Test with Thor Ragnarok mkv. :confused:

[jdobbs]

Still not working on UB 900. No Picture. Sound ok. Test with Thor Ragnarok mkv. :confused:Did you reencode it? I have yet to find an MKV that was UHD-BD compliant. If yours is, it is the exception.

[wolflop]

Did you reencode it? I have yet to find an MKV that was UHD-BD compliant. If yours is, it is the exception.

no reencode. No Kompression. Mvk is taken form makemkvfile. Then tsremuxxer. Then TSM2Uhd. Movie is playable with pixels in dvdfabplayer 5. In UB 900 ther is no picture, only audio

wolflop

[jdobbs]

no reencode. No Kompression. Mvk is taken form makemkvfile. Then tsremuxxer. Then TSM2Uhd. Movie is playable with pixels in dvdfabplayer 5. In UB 900 ther is no picture, only audio

wolflopWhat source was used for makemkv? Did you create the mkv yourself directly from a ripped blu-ray structure? If not -- then the odds are that it is not compliant.

[wolflop]

yes, source was the original Blu-ray structure. MKv made with makemkv.
Has someone already reported that any uhd works with the Ub 900?

[Attila1971]

I have the trouble to delay the sound. I tried some mkv files.

[no-one]

Output from TSM2UHD 1.12 on LG up970 no HDR
And when I take output from TSM2Uhd to compress uhd25G/50G by dvdfab uhdcopy. There are very mosaic and no detect hdr.

[zamengo]

yes, source was the original Blu-ray structure. MKv made with makemkv.
Has someone already reported that any uhd works with the Ub 900?

same issue here, try with a ten different discs.

[ScorpionStingz]

Just when you thought you'd get out, they pull you back in!

[d3rd3vil]

Great, so this can be used for movie-only remuxes. Does it retain Dolby Vision?

Ofc not, big surprise

[zeropc]

how do you guys even manage to use tsmuxer to remux a uhd?
i get constantly error code -2 -> reading buffer overlow

for me it's currently impossible to get a proper remux with tsmuxer of a uhd :(

[LowDead]

how do you guys even manage to use tsmuxer to remux a uhd?
i get constantly error code -2 -> reading buffer overlow

for me it's currently impossible to get a proper remux with tsmuxer of a uhd :(

Try demux first with mkvextract. Then mux with tsmuxer the separate streams.

//LD

[zeropc]

Try demux first with mkvextract. Then mux with tsmuxer the separate streams.

//LD

thanks for the tip :)

tsm2uhd though is not working for me.

i selected the newly created uhd bdmv folder and clicked start. two hours later and the progress is still at 0%

any idea?

[chin8036]

Hello, thanks for the effort to make this software, I follow the steps in instruction but the output blu-ray folder can't be played on my Sony UBP-X800 player.

I compare the folders, and found that the software only changed mpls, no other files, and it just used about 2 secs, so I thought it's not normal, do you have any advice or what can I do to fix this?

Thanks

[staina]

tsMuxeR do not work with UHD Bluray always ends with error

tsMuxeR finished with error code -2
Reading buffer overflow. Possible container streams are not syncronized. Please, verify stream fps. File name: I:\BDMV\STREAM\00045.m2ts


When will have tsMuxeR full support UHD Bluray and Dolby Vision?

Thank you staina

[jdobbs]

I compare the folders, and found that the software only changed mpls, no other files, and it just used about 2 secs
Something went wrong... the process takes about 20 mins on my system.
tsMuxeR do not work with UHD Bluray always ends with error
I've used TSMUXER on the source from UHD discs many, many times -- and have never gotten an error. The "buffer overflow" error almost always means a corrupt source (or one that hasn't been decrypted). I do always demux first (as LowDead suggested) and use the elementary streams. As for when it will have full support... probably never. But that would be up to the author. He unexpectedly provided 3D support after a long time of not hearing from him, so you never know.

[Lucius Snow]

Thanks jdobbs for your work.

Do you advice to burn the folders on BD-50 in UDF 2.5 or 2.6?

By the way, it would be nice to get a list of compatible / not compatible players models.

[Ch3vr0n]

Afaik UHD requires UDF 2.60, 2.50 is for standard BD's.

[Lucius Snow]

Thanks.

I've just made a BD HDR Rec2020 for testing. It works on my UBP-X7000. However, I don't have any HDR screen so the device displays "SDR" on the OSD. How to know if the HDR flag is present properly using this TSM2UHD tool?

EDIT : The log during the post-compilation process says "HDR collected" so it looks OK. But I have no way to be sure...

[jdobbs]

Afaik UHD requires UDF 2.60, 2.50 is for standard BD's.Really? Is that documented somewhere? I've been using UDF 2.50 and haven't noticed any issues.

[veggav]

Hey nice to find this tool avalible.

I guess all those tutorials to keep blu-ray menus when adding subtitles and audio tracks with tsmuxer will also work with tsm2uhd.
I used to do this a lot with tsmuxer and later with bdfix (which is a lot easier).

I'll give that a try in a few days and test with my OPPO 203 with russian custom firmware to check if I can add some dubs to complete UHD discs and report back.

[Lucius Snow]

Hey nice to find this tool avalible.

I guess all those tutorials to keep blu-ray menus when adding subtitles and audio tracks with tsmuxer will also work with tsm2uhd.
I used to do this a lot with tsmuxer and later with bdfix (which is a lot easier).

I'll give that a try in a few days and test with my OPPO 203 with russian custom firmware to check if I can add some dubs to complete UHD discs and report back.

I'm not sure you can build a Blu-Ray with menus and then replace the streams from H264 to HEVC to change it to Blu-Ray UHD...

[veggav]

I'm not sure you can build a Blu-Ray with menus and then replace the streams from H264 to HEVC to change it to Blu-Ray UHD...

Totally possible.
But as I see how TSM2UHD works you have to

1. demux audio, video and subtitle streams from original disk.
2. Make MKV file with audios and subtitles you want to add.
3. Create UHD BD compilant folder.
4. Change CPLI and playlist files with hex decimal to refer to the same clpi and playlist file the original disk uses.

It's actually quite simple.

TSMuxer used to have a blank spot so you could name your own mpls and clpi files isntead of default 00000 to be 0835 or something.

Maybe this could be added to TSM2UHD since it's just a number to be changed in the output files.

[Lucius Snow]

Totally possible.
But as I see how TSM2UHD works you have to

1. demux audio, video and subtitle streams from original disk.
2. Make MKV file with audios and subtitles you want to add.
3. Create UHD BD compilant folder.
4. Change CPLI and playlist files with hex decimal to refer to the same clpi and playlist file the original disk uses.

It's actually quite simple.

TSMuxer used to have a blank spot so you could name your own mpls and clpi files isntead of default 00000 to be 0835 or something.

Maybe this could be added to TSM2UHD since it's just a number to be changed in the output files.
Thanks for this tutorial but It's not such easy for a newbie like me :)

In step 2 and 3, you make a Blu-Ray HD structure from TSMuxer (from HEVC video stream source) and then patch it with TSM2UHD to make it Blu-Ray UHD compliant. Is that what you mean?

In step 4, you open in a hexadecimal editor the CLPI and MPLS from the Blu-Ray UHD

http://poubellelqt.free.fr/temp/UHD_clpi.jpg
http://poubellelqt.free.fr/temp/UHD_mpls.jpg

And here are the CLPI and MPLS from the Blu-Ray HD I authored. There's only one video stream and one menu, so the video I want to replace refer to 00001.clpi and 0001.mpls.

http://poubellelqt.free.fr/temp/HD_clpi.jpg
http://poubellelqt.free.fr/temp/HD_mpls.jpg

What CLPI and MPLS files should i change? Those from the Blu-Ray UHD ? Which values from the hexadecimal data those should i modify exactly?

How to reintegrate the original menu (from the Blu-Ray HD) to the Blu-Ray UHD structure?

Sorry but I'm a bit lost...

[Lucius Snow]

@jdobbs : Can you confirm this is possible? Thank you.

[UHD 4 Everyone]

So over the past week I've been trying to use a combination of TSM2UHD, TS Muxer, ffmpeg, Adobe Encore, and hex editing to create a UHD Disc with menus (even if the menus are 1080p) I know this is probably next to impossible. But when you're making less than $200K/year being able to purchase Scenarist UHD or KITe UHD is out of the question.

Is there anyway to retain menus from a 1080p disc and replace the streams with a UHD stream?


Here's my workflow:

1. Author disc (with menus) in Encore with 1080p streams but match audio content.
2. Render UHD content into MKV containers in x265 that are UHD compliant.
3. Remux blu-ray folder structure (one per stream, except for menu) in tsmuxer using the mpls files and replace streams with uhd h265 elementary files.
4. Drop in new m2ts files into the stream folder.
5. Drop in new mpls files.
6. Re-create entry point instructions in BDEdit
7. Drop in index.bdmv and movieobject.bdmv files from one of the remuxes.
8. Re-create instructions and references of original index and movieobject files in BDEdit.
9. Run TSM2UHD against the structure.*

* When I go through this workflow, TSM2UHD does not recognize the fact that flags need to be changed in every file. I'm not sure why it's not detecting it but the output looks like this:

========Job Started========
[11:34:16] Scanning source for UHD attributes...
- UHD attributes collected.
- Scan completed.
[11:34:16] Checking/Adjusting MPLS file...
=========Job Ended=========

So at that point I'm obviously missing a flag somewhere. It could have been overwritten when I re-created the instructions in any of the files. Or it could be that there's still an MPEG-2 stream for the menu and TSM2UHD sees it and refuses to run.

And maybe it would help if tsmuxer could remux an m2ts stream that has a PGS.

Any suggestions on what steps to take? Or where did I make a mistake (besides wasting time attempting this haha)?

[jdobbs]

Is there anyway to retain menus from a 1080p disc and replace the streams with a UHD stream?It's not impossible -- but it's not easy either. It's more than just replacing the streams. There has to be extensions and data added/provided in the index.bdmv, MovieObject.bdmv, any associated MPLS and CLPI files. You also have to change the version number of pretty much all files from v2 to v3.

[UHD 4 Everyone]

It's not impossible -- but it's not easy either. It's more than just replacing the streams. There has to be extensions and data added/provided in the index.bdmv, MovieObject.bdmv, any associated MPLS and CLPI files. You also have to change the version number of pretty much all files from v2 to v3.

So I know about the version number change that has to happen (which tsm2uhd should do).

The file I have is an 8-bit converted to 10-bit, so no new color grading just expanding the space so I'm not too worried about the data block in the extension data.

I have decrypted a retail disc I own and I'm looking at that as an example (specifically Rise of the Planet of the Apes).

After that I am looking at the extension data for the mpls files and then correcting the clpi files. And I assume that the exension data on the playlist files with ID1:3 ID2:5 is more HDR info?

I'm going to assume I don't need extension data on my MovieObject.bdmv file as I'm not seeing any on my retail disc.

As far as editing the CLPI's go, I've found the pids in the files via hex editor and bd edit. What addresses need to be changed to signify an HEVC stream?

One last question, are you using anything outside of a hex editor, bd edit, and media info to look at these flies to be able to see what's in them a little more clearly? Because I feel like I'm doing this all wrong haha.

Thanks for your all of your help and your software (seriously), sorry if I seem annoying or anything haha.

[jdobbs]

So I know about the version number change that has to happen (which tsm2uhd should do).

The file I have is an 8-bit converted to 10-bit, so no new color grading just expanding the space so I'm not too worried about the data block in the extension data.

I have decrypted a retail disc I own and I'm looking at that as an example (specifically Rise of the Planet of the Apes).

After that I am looking at the extension data for the mpls files and then correcting the clpi files. And I assume that the exension data on the playlist files with ID1:3 ID2:5 is more HDR info?

I'm going to assume I don't need extension data on my MovieObject.bdmv file as I'm not seeing any on my retail disc.

As far as editing the CLPI's go, I've found the pids in the files via hex editor and bd edit. What addresses need to be changed to signify an HEVC stream?

One last question, are you using anything outside of a hex editor, bd edit, and media info to look at these flies to be able to see what's in them a little more clearly? Because I feel like I'm doing this all wrong haha.

Thanks for your all of your help and your software (seriously), sorry if I seem annoying or anything haha.It's more than just the version. You also have to change the type and format of all references to the stream (type = 0x24, format = 8). The extension you mentioned holds HDR data. In Index.bdmv you set flags as an extension showing "this is a UHD disc". In the CLPI the mux bitrate changes as well as the type/format info (if you encoded with a bitrate higher than a standard BD uses or are using an original stream). The CLPI also has a new entry added to the program_info table. If the source is DolbyVision you also have to add an entry to the subpath table and mux the DolbyVision stream as ID 4117 (TSM2UHD doesn't do that yet). Like I said, it's not easy, and it may take more than a hex editor.

On top of everything else, there are things that have to be changed in the PMT throughout the M2TS -- and I recently discovered that TSMUXER actually hides some of the I-Frames in other frame PES packets which causes terrible sync issues. I thought it only happened on X265 encodes... but it has been reported by others that it may also occur with original streams.

I know what you mean about struggling with the "hunt and peck" method, I had to dump out files and dig around to figure out what many of the values mean.

I suggest you hang on for a few days (or maybe a little more) and use BD-RB to do all the work for you. I'm working on routines to do the M2TS muxing for you, etc.

You're using BDEDIT on UHD discs? Whenever I try it crashes.

[Lucius Snow]

Jdobbs, do you advice not to use TSmuxer at the moment because of this sync issue? Does it occur as a permanent desynchronization during all the playback? I've encoded some medias with x265 and put some patterns / tones during one frame to check the sync. It was ok.

[jdobbs]

Jdobbs, do you advice not to use TSmuxer at the moment because of this sync issue? Does it occur as a permanent desynchronization during all the playback? I've encoded some medias with x265 and put some patterns / tones during one frame to check the sync. It was ok.As I said, I personally haven't experienced the issue on original sources (it was reported by others) -- only reencodes. So I guess it comes down to individual choice.

My plan is to write a replacement for TSMUXER. I've written the module for HEVC muxing and creation of MPLS and CLPI files already so I can fix TSMUXER output in BD-RB -- but I can't predict when the entire project might be completed.

[UHD 4 Everyone]

You're using BDEDIT on UHD discs? Whenever I try it crashes.

Yeah you just have to change the version tag on each file you want to read to v2 and it will read them (albeit/obviously it can be garbled a bit since BD Edit hasn’t been updated in years). Also nothing will be listed for hevc video streams in the mpls and clpi editors.

[Lucius Snow]

As I said, I personally haven't experienced the issue on original sources (it was reported by others) -- only reencodes. So I guess it comes down to individual choice.

My plan is to write a replacement for TSMUXER. I've written the module for HEVC muxing and creation of MPLS and CLPI files already so I can fix TSMUXER output in BD-RB -- but I can't predict when the entire project might be completed.

That's good news, thanks a lot for your work. Which e-mail adress can I use to send you a donation (via Amazon gift)? I've found dvd-rb@dvd-rb.com

Do you know if the HDR metadatas not detected with some LG players is on the way to be fixed? It was mentionned there for example: https://forum.doom9.org/showthread.php?p=1835447#post1835447

[jdobbs]

That's good news, thanks a lot for your work. Which e-mail adress can I use to send you a donation (via Amazon gift)? I've found dvd-rb@dvd-rb.com

Do you know if the HDR metadatas not detected with some LG players is on the way to be fixed? It was mentionned there for example: https://forum.doom9.org/showthread.php?p=1835447#post1835447dvd-rb@jdobbs.net is probably best. Thanks for thinking about me.

Not sure about the LG issue... I can't think of any reason why it wouldn't work. Obviously I must have missed something. Have you tried running MEDIAINFO against the video to make sure the HDR is there?

[Lucius Snow]

dvd-rb@jdobbs.net is probably best. Thanks for thinking about me.

Not sure about the LG issue... I can't think of any reason why it wouldn't work. Obviously I must have missed something. Have you tried running MEDIAINFO against the video to make sure the HDR is there?
Donation done!

I don't have any LG player myself, only the Sony UBP-X700. I was just referring to comments about the LG issue. That's important to me because I'll give some Blu-Ray UHD to some people who may have any kind of brand / model of Blu-Ray UHD standalone player. I'd love a kind of universal compatibility.

I've just made a test on a HDR mastering display, the OSD of the UBP-X700 says it's still SDR. It's odd because the TSM2UHD logs detected the HDR flag.

[jdobbs]

Thought I'd post an update on the BD-RB's UHD-BD processing.

I've completed and tested the HEVC muxing routines and all is well. BD-RB corrects the TSMUXER M2TS for HEVC output and replaces the MPLS and CLPI files (corrupt due to TSMUXERs HEVC muxing issue) with those internally generated by BD-RB. The output works perfectly on my Sony UHD player.

Now I am making modifications to the import routines so they will also correct for TSMUXERs actions. It's not as easy as you may think, since I still need TSMUXER to combine multi-part playlists during import and to mux the other (non-hevc) streams. I've also done research on how BDs handle DolbyVision streams. An extra video track containing the DolbyVision data is muxed as a separate stream into the M2TS file. Since TSMUXER has no awareness of that stream (it thinks it's just another secondary video) I have to go back through my code and make changes so that it can be integrated properly into output. I'm not sure how long that will take -- but I don't expect it to be extensive.

All in all things are moving along -- albeit slowly. I may get a version out for testing in the next few days, but at the latest I'll get it out by EOY.

[SeeMoreDigital]

That's very encouraging work :)

[Lucius Snow]

I've just made a test on a HDR mastering display, the OSD of the UBP-X700 says it's still SDR. It's odd because the TSM2UHD logs detected the HDR flag.
It has finally worked after the firmware upgrade of the player!

EDIT : What I have noticed is that HDR flag appears in the OSD of the Sony player only if Dolby Vision is enabled in the config menu. Why is that?

Here is my logs:

========Job Started========
[15:04:54] Scanning source for UHD attributes...
- UHD and HDR attributes collected.
- Scan completed.
[15:04:54] Checking/Adjusting MPLS file...
- Found HEVC stream...
-- Type marker adjusted to UHD-BD HEVC...
-- Format marker adjusted to 2160p...
-- Version marker adjusted to be 0300...
[15:04:54] Checking/Adjusting CLPI file...
- Found HEVC stream...
-- Type marker adjusted to UHD-BD HEVC...
-- Format marker adjusted to 2160p...
-- Version marker adjusted to be 0300...
[15:04:54] Checking/Adjusting BDMV files...
- Added UHD-BD extension...
- Checked/Updated version in Index file...
- Checked/Updated version in MovieObject file...
[15:04:54] Checking/Adjusting M2TS file...
[15:04:58] TSMUXER TO UHD - SUCCESS
=========Job Ended=========

EDIT2: And the displayed colours are not good at all then. Can you confirm the Sony's OSD should mention "HDR" without Dolby Vision enabled?

EDIT3 : If I take 00000.m2ts file out from the Blu-Ray folder and copy it to a USB key that I plug in, the Sony player detects it as HDR and displays properly the colours. With "Dolby Vision" disabled. So it looks like a TSM2UHD bug during the patch?

[Cesarleeds]

Thought I'd post an update on the BD-RB's UHD-BD processing.

I've completed and tested the HEVC muxing routines and all is well. BD-RB corrects the TSMUXER M2TS for HEVC output and replaces the MPLS and CLPI files (corrupt due to TSMUXERs HEVC muxing issue) with those internally generated by BD-RB. The output works perfectly on my Sony UHD player.

Now I am making modifications to the import routines so they will also correct for TSMUXERs actions. It's not as easy as you may think, since I still need TSMUXER to combine multi-part playlists during import and to mux the other (non-hevc) streams. I've also done research on how BDs handle DolbyVision streams. An extra video track containing the DolbyVision data is muxed as a separate stream into the M2TS file. Since TSMUXER has no awareness of that stream (it thinks it's just another secondary video) I have to go back through my code and make changes so that it can be integrated properly into output. I'm not sure how long that will take -- but I don't expect it to be extensive.

All in all things are moving along -- albeit slowly. I may get a version out for testing in the next few days, but at the latest I'll get it out by EOY.

Hey jdobbs, thanks so much for your work.

I´ve been a long time tsmuxer user, our bluray market in Spain is quite abandoned, so i learnt how to create my own custom blurays which i´ve been doing, as i said, during many years.

The UHD market is even worst, we don´t even get the Disney movies (no Star Wars, no Marvel) or things like John Wick, Valerian or The Fifth Element, so my mind couldn´t stop thinking about custom uhd movies, and that is how i end up here, in this forum and in this thread.

I´ll be looking forward for your tool, and yet again, thanks so much for your work.

[ocean]

Happy holidays to all, the first titles were released with HDR10+, change two bit-level flags in clpi, generally it is 4608, now there is 4736:

"ProgramInfo": {
"reserved_for_word_align": 0,
"program_sequence": [
{
"SPN_program_sequence_start": 0,
"program_map_PID": 256,
"reserved01": 0,
"stream_in_ps": [
{
"stream_PID": 4113,
"stream_coding_type": "H.265",
"video_format": "2160p",
"frame_rate": "23.976",
"aspect_ratio": "16:9",
"reserved01": 0,
"cc_flag": 0,
"reserved02": 4736,
"ISRC": {
"country_code": "",
"copyright_holder": "",
"recording_year": "",
"recording_number": "" ""

decimal
4736

hex
0X1280

binary
0001 0010 1000 0000

and mpls main:

pid": 4113,
"stream_coding_type": "H.265",
"video_format": "2160p",
"frame_rate": "23.976",
"reserved_uhd": 18,
"reserved01": 16384

[jdobbs]

@ocean: Thanks.

[zizux]

First of all thank your work, some of us hope you get the program out as soon as possible so we can use it.
I have a doubt. I use scenarist but when you generate a file that enters a bd50, with some movies there are problems since they have a higher bitrate than what the disc supports and the program doesn´t automatically calculate it.
Could your program do it?


Regards.

[UHD 4 Everyone]

First of all thank your work, some of us hope you get the program out as soon as possible so we can use it.
I have a doubt. I use scenarist but when you generate a file that enters a bd50, with some movies there are problems since they have a higher bitrate than what the disc supports and the program doesn´t automatically calculate it.
Could your program do it?


Regards.

I haven’t used scenarist since I’m not freaking rich. But I believe it takes whatever you give it as far as input media goes. Otherwise, it costs enough that it should be able to control what Bitrate you will render to. JDobbs program does not re-encode. TSM2UHD only parses through streams and modifies certain flags and other info to reflect UHD BD “compliance”

Have you reached out to their support for assistance, you pay enough for the software that you should be able to contact them and they will walk you through it.

[jdobbs]

I haven’t used scenarist since I’m not freaking rich. But I believe it takes whatever you give it as far as input media goes. Otherwise, it costs enough that it should be able to control what Bitrate you will render to. JDobbs program does not re-encode. TSM2UHD only parses through streams and modifies certain flags and other info to reflect UHD BD “compliance”

Have you reached out to their support for assistance, you pay enough for the software that you should be able to contact them and they will walk you through it.There is a 32 bit value in the CLPI file called TS_recording_rate. On the UHD discs I've looked at it is set to 109 Mbps (which is the maximum for a 66GB or 100GB disc). For most standard 50GB (or 25GB) discs used for UHD the maximum should be 64 Mbps (and 48 Mbps when used for non-UHD). It wouldn't surprise me if Scenarist always sets it to 109 (since almost all commercial discs are 66/100GB and Scenarist is used commercially).

TSM2UHD doesn't change that value, since TSMUXER doesn't set it that high. But, now that I think about it, it probably should be set to 64 Mbps since many people who are reencoding might use a higher maximum bitrate than they would on a standard 1080p BD.

If anyone is going to try and change it manually -- please note that the value is actually stored as bytes per second.

[Lucius Snow]

Afaik UHD requires UDF 2.60, 2.50 is for standard BD's.

Some news... Scenarist UHD builds UDF 2.50 image.

[rpareja]

First of all, i apologize for my ignorance.

I've been a BD Rebuilder fan for a long time and just until a couple of weeks ago I am entering the 4K HDR world (new 4K UHD HDR+ TV, new 4K HDMI cables and new 4K A/V Receiver).
Yesterday I read about this program TSM2UHD.

I have some 4K UHD HDR movies with a mkv format and I want to create a blu-ray structure for each one using TSMUXER.
I AM NOT planning to burn them and use a standalone player, but I am thinking of playing the blu-ray folder structure movie using PowerDVD on my 4K laptop and connect it to my A/V Receiver with an 4K HDMI cable to watch them.

When I load the mkv file on TSMUXER, it reports the correct information about resolution, audio, etc. of each track and seems to process everything correctly creating the blu-ray folder structure.

The questions I have are:
1) Does the process of creating the structure using TSMUXER is the correct approach I need?
2) Do I still need to process each movie folder (that were created with tsmuxer) using TSM2UHD?
3) Does TSMUXER loses something (in the video or audio that were used as input) during the process of creating the folder structure or it creates everything as it was?
4) Is this step using TSM2UHD to correct some information is only needed if I plan to burn the movie on a disc and play them in a standalone player?

Thanks for any help,

RPareja

[ocean]

I have some 4K UHD HDR movies with a mkv format and I want to create a blu-ray structure for each one using TSMUXER.
I AM NOT planning to burn them and use a standalone player, but I am thinking of playing the blu-ray folder structure movie using PowerDVD on my 4K laptop and connect it to my A/V Receiver with an 4K HDMI cable to watch them.


Hi rpareja, I do not know the specifications of your laptop, but PowerDVD requires certain features to read Blu-Ray structure 4K HDR, SGX feature etc..:
https://www.cyberlink.com/support/product-faq-content.do?id=19144&prodId=1&prodVerId=1326&CategoryId=-1&keyword=

[rpareja]

Hi rpareja, I do not know the specifications of your laptop, but PowerDVD requires certain features to read Blu-Ray structure 4K HDR, SGX feature etc..:
https://www.cyberlink.com/support/product-faq-content.do?id=19144&prodId=1&prodVerId=1326&CategoryId=-1&keyword=

Thanks Ocean,

There is no problem at all with PowerDVD, because the laptop is an i9 8th Generation Dell with 4k Display and full 4K blu-ray structures are being played fine.

I am just worried about the directory structure generated by TSMUXER.
- Should I run TSM2UDH after processing the mkv file and create the blu-ray structure?
- Or if not planning to burn the results from TSMUXER to a physical disc, I should not worry about running this utility?

Thanks!

[ocean]

- Should I run TSM2UDH after processing the mkv file and create the blu-ray structure?
- Or if not planning to burn the results from TSMUXER to a physical disc, I should not worry about running this utility?

Yes, you need to run TSM2UDH after processing the mkv file, and creating the blu-ray structure, read first post of jdobbs:
http://forum.doom9.org/showthread.php?t=175120

[rpareja]

Thanks again Ocean.

I was trying to be clear about this program and my doubts were precisely because of the comment on the first post (the bold part):

"The purpose of this software is to examine the output of TSMUXER v 2.6.12 and make changes that are required in order to make that structure readable and compatible with a standard UHD-BD standalone player."

I thought that a standalone player was considered to be a physical 4K blu-ray player and that if I never plan to use one, maybe there was no need to run this software.
I don't know if software like PowerDVD, VLC Player, etc. are also considered to be standalone players.

Again, :thanks:

[ocean]

"The purpose of this software is to examine the output of TSMUXER v 2.6.12 and make changes that are required in order to make that structure readable and compatible with a standard UHD-BD standalone player."

Yes, but then if you always read from the first post:
"When TSMUXER v2.6.12 was created there was still much that hadn't been decided in the UHD-BD standard".
This applies to both physical Blu-Ray and folder structure, it is necessary to always use after TSM2UHD, to be compatible with UHD-BD specifications.

I don't know if software like PowerDVD, VLC Player, etc. are also considered to be standalone players.

PowerDVD is the only certified to read Blu-Ray UHD on pc, but there are other software for pc, dvdfab player, MPC-BE also paired with madVR, etc.

[rpareja]

Yes, but then if you always read from the first post:
"When TSMUXER v2.6.12 was created there was still much that hadn't been decided in the UHD-BD standard".
This applies to both physical Blu-Ray and folder structure, it is necessary to always use after TSM2UHD, to be compatible with UHD-BD specifications.



I missed that extremely important part!!!
Now I understand the concept better, thank you very much OCEAN!!

[spexman]

Thread has been quiet for a long time....any progress on a new version to deal with the stutter issues? Thank you!

[Yordan5]

Thread has been quiet for a long time....any progress on a new version to deal with the stutter issues? Thank you!

https://forum.doom9.org/showthread.php?p=1880778#post1880778

[jdobbs]

Thread has been quiet for a long time....any progress on a new version to deal with the stutter issues? Thank you!I'll take a look at transporting the code I wrote for BD Rebuilder into TSM2UHD.

[spexman]

Thank you very much jdobbs...if you could do that and provide me with that new version of TSM2UHD, I will get on experimenting with it and report back, generally, and especially in terms of the sync issues.....much appreciated!

[spexman]

I have been following the BD-RB thread and appreciate all the work you are doing to perfect it....any chance you could post the TSM2UHD current portion? Many thanks!

[jdobbs]

I have been following the BD-RB thread and appreciate all the work you are doing to perfect it....any chance you could post the TSM2UHD current portion? Many thanks!Once I get it working reliably in BD Rebuilder, I'll transport the new code to TSM2UHD.

[spexman]

Fantastic, thank you very much!

[tebasuna51]

@jdobbs

I'm never interested in rebuild DVD's, and is the first time I see this subforum because a link (https://forum.doom9.org/showthread.php?p=1887940#post1887940) in (HD) DVD & Blu-ray authoring subforum.

I see here threads like: TSM2UHD Discussion..., BD Rebuilder... and others related with Blu-ray authoring and tsMuxeR than surprise me.
Maybe we can change the name of this subforum to DVD & BD Rebuilder

[jdobbs]

@jdobbs

I'm never interested in rebuild DVD's, and is the first time I see this subforum because a link (https://forum.doom9.org/showthread.php?p=1887940#post1887940) in (HD) DVD & Blu-ray authoring subforum.

I see here threads like: TSM2UHD Discussion..., BD Rebuilder... and others related with Blu-ray authoring and tsMuxeR than surprise me.
Maybe we can change the name of this subforum to DVD & BD RebuilderThat works for me... but I'm not even sure how to change the title.

[Ch3vr0n]

You're the boss of this section, log into the forum admin side (if you can), or ask your boss to do it for you :-P

Sent from my Pixel 3 XL using Tapatalk

[jdobbs]

Hell... I don't even know who the boss is... I'm just a moderator because Doom9 asked me. So I (semi) moderate.

[tebasuna51]

That works for me... but I'm not even sure how to change the title.

Maybe we need a Admin. Asked in Moderator Chat.

[SeeMoreDigital]

It's probably time to refresh the names of 'all' the forums sub-sections :eek:

[tebasuna51]

Swede change the title, many thanks.

[Ch3vr0n]

Meh B comes before D, should be BD & DVD rebuilder [emoji14]

Sent from my Pixel 3 XL using Tapatalk

[Subbat]

Any chance you can make this work from command line without the gui?

Hi, I am interested too by cli usage. Any chance ?
Thanks.

[SuperFist]

I have never got this software (v1.12) to work when attempting to use the UHD folder within CloneBD (v1.2.4.0).

CloneBD always throws this error...

CloneBD had a slight problem and therefore created a file with analysis information at...

[fits79]

So this is the continue of tsmuxer program?
Or is the new tsmuxer that support truehd e.t.c. the old tsmuxer doesn't???

Please explain what exactly is that?

[SeeMoreDigital]

So this is the continue of tsmuxer program?
Or is the new tsmuxer that support truehd e.t.c. the old tsmuxer doesn't???

Please explain what exactly is that?
Currently, all 'transport' muxing applications require Dolby TrueHD audio streams to also contain an embedded Dolby Digital core (ie: two streams in one).

If you try to import a Dolby TrueHD audio streams without an embedded Dolby Digital core, the stream will be rejected.... It's as simple as that!

Sufficed to say... If you have some Dolby TrueHD audio streams without an embedded Dolby Digital core, they've most likely originated from an .MKV contained 're-muxed' source.

[jdobbs]

Currently, all 'transport' muxing applications require Dolby TrueHD audio streams to also contain an embedded Dolby Digital core (ie: two streams in one). Just to add... that they do it for good reason. It violates the BD standard if there isn't a DD core included.

[tebasuna51]

Of course, but there are a workaround, we can create a valid track with:

eac3to input.thd output.thd+ac3

BTW I don't know if TSM2UHD is needed now with tsMuxeR 2.6.16, now tsMuxeR is Open Source (https://forum.doom9.org/showthread.php?p=1879321) and there are many improvements (https://github.com/justdan96/tsMuxer/blob/master/CHANGELOG.md)

Also there are a future enhancement (https://github.com/justdan96/tsMuxer/issues/270) to improve the thd mux

[jdobbs]

Of course, but there are a workaround, we can create a valid track with:

eac3to input.thd output.thd+ac3

BTW I don't know if TSM2UHD is needed now with tsMuxeR 2.6.16, now tsMuxeR is Open Source (https://forum.doom9.org/showthread.php?p=1879321) and there are many improvements (https://github.com/justdan96/tsMuxer/blob/master/CHANGELOG.md)

Also there are a future enhancement (https://github.com/justdan96/tsMuxer/issues/270) to improve the thd muxExactly. TSM2UHD serves no purpose anymore. It was only created to make the version of TSMUXER that did not support UHD do so. The newer version of TSMUXER makes it obsolete.

[SuperFist]

Of course, but there are a workaround, we can create a valid track with:

eac3to input.thd output.thd+ac3

BTW I don't know if TSM2UHD is needed now with tsMuxeR 2.6.16, now tsMuxeR is Open Source (https://forum.doom9.org/showthread.php?p=1879321) and there are many improvements (https://github.com/justdan96/tsMuxer/blob/master/CHANGELOG.md)

Also there are a future enhancement (https://github.com/justdan96/tsMuxer/issues/270) to improve the thd mux
Exactly. TSM2UHD serves no purpose anymore. It was only created to make the version of TSMUXER that did not support UHD do so. The newer version of TSMUXER makes it obsolete.

Pray tell, where is this unicorn-like tsMuxeR 2.6.16 that I can't seem to find even on Github?

Unless it's basically the latest nightly from here:

https://github.com/justdan96/tsMuxer/releases/tag/nightly-2024-06-06-02-00-53

[tebasuna51]

@SuperFist, use tle latest nightly build, my post is 5 years old.