BD Rebuilder Beta - Bug Reports Only

[jdobbs]

when specifying

MIN_M2TS_SIZE=30 it gets ignored, I understand the default is 100 but anything lower and the new setting gets ignored. It only responds to setting above 100.

trying to blank a bunch of extras that are between 30 and 100mb :(It works. But there are times when it is supposed to be ignored -- for instance when the M2TS is a part of a larger playlist. Then it has to be encoded to match the rest of the playlist's parts.

[jdobbs]

I have managed to figure out cause of failure and why it is failing. In my case I used Region A disc. This is gone be long so bear with me.

[Disc Info]

00042.m2ts contain only 7min and 19 sec from beginning and 00065.m2ts is mvc view for corresponding 00042.m2ts. Normally 3D disc has AVC and MVC view and they are interleaved in ssif folder with file name of avc file. Which allow backwards compatibility with 2D system.

Example 0001.m2ts (AVC) and 0002.m2ts (MVC) will be 0001.ssif with size of 0001 + 0002 combined.

Lego is 3D exclusive and in this case there is no backwards compatibility and will not play in 2D system. Normally disc are backwards compatible, even if they are not as long there is avc stream with full movie, hack like Slysoft Anydvd "simulate 3D display" would work. However in this case it simply doesn't contain full movie avc stream.

Rather it is made of SSIF file, which is not fake or made of two m2ts files commonly found on disc. SSIF file in this case holds actual movie itself and since it only play in 3D, when player plays it is actually reading SSIF file sectors, not interleaved files between two m2ts files normally found in Blu-ray 3D.

Reason why BD-RB can’t back it up is normally when you open disc in BD-RB. It scans all mpls based files and display movie only or all relevant title based on import threshold. In Lego case 00098.mpls tell program movie is 1h 40m and 35 sec which causes it to import, however it imports actual stream from 00042.m2ts and 00065.m2ts which account for size 2,454.44MB seen in BD-RB. Even though program suppose to import full movie but it end up importing 7min and 19 sec segment.

http://s2.postimg.org/jmt4d1qc9/Lego.png

What program need to do in this case is use SSIF file which will successfully import entire movie. Instead of first seven minute and nineteen second and to back it up program will also require telling tsmuxer to use SSIF file for extraction instead of m2ts it normally uses.

Normally if disc is interleaved to create SSIF file, BDMV folder will be close to double the size of movie and in some cases size of disc. However in this case there is not such thing.

http://i57.tinypic.com/jsesyb.pngThanks for the analysis. I can see why it would work, I did a couple of discs that way when I was looking for ways to do a backup without the need for doubling the size and still being able to write to disc with IMGBURN, but I settled on the in-mux method instead. I was (and still am) worried that it may violate the BD standard, although I'll have to check closer to be sure.

I'll see what I can do to make it work. It should just be a matter of demuxing and feeding from the SSIF instead of the two M2TS files.

[HWK]

I'll see what I can do to make it work. It should just be a matter of demuxing and feeding from the SSIF instead of the two M2TS files.

If you need tester to test out new method, I am available :)

[jdobbs]

If you need tester to test out new method, I am available :)The only difficult part is determining which discs need it. You can't just switch the method because there are plenty of MENU and EXTRA items that don't have an SSIF.

[jdobbs]

@jdobbs
My source is a mounted 3D .iso. I encode it in Quick-Play Backup mode.
Everything is ok, but editing the Quick-Play Menu has no effect. The Quick Menu always reverts to DB-RBs defaults.
Is this because the edited titles.inf cannot be written to the mounted drive? If so, is there a possibility to make changes manually e.g. by editing the titles.inf in the \BDMV\Backup\Playlist\titles.inf folder, just before burning the backup to disc?Is there any chance you may have exited and restarted? The problem with the edited changes and an ISO (or a direct read from a BD disc) is that the titles.inf file can't be saved to the source. So the changes are only good for as long as BD-RB is active. If you exit and reenter (or possibly if you run it as a BATCH job, I'll have to check that) the changes are lost.

I'll have to look and see if there is a way I can save it somewhere else for those kinds of sources. The problem is that there are few paths that are guaranteed to remain consistent between runs.

[Sharc]

Is there any chance you may have exited and restarted? The problem with the edited changes and an ISO (or a direct read from a BD disc) is that the titles.inf file can't be saved to the source. So the changes are only good for as long as BD-RB is active. If you exit and reenter (or possibly if you run it as a BATCH job, I'll have to check that) the changes are lost.

I'll have to look and see if there is a way I can save it somewhere else for those kinds of sources. The problem is that there are few paths that are guaranteed to remain consistent between runs.
Definitely no batch job, but now you mention it, I can't exclude that I exited and restartedBD-RB. I'll try again.
I recall that another poster reported the same problem, so finding a way how to save the titles.inf would mean a +1 :)

Edit:
Hmmm..., it seems that even without exiting and restarting the changes done via the Quick-menu editor have no effect.

[HWK]

The only difficult part is determining which discs need it. You can't just switch the method because there are plenty of MENU and EXTRA items that don't have an SSIF.

Jdobbs, you have come long way when it comes to overcoming some of the most difficult sources, try it and you shall succeed.

Just want to take guess would it be possible to add code which tell program after scanning disc and identify main movie use ssif to extract instead of m2ts for feature film. Also I remember Roman telling me when you demux using mpls file in tsmuxer, it will use m2ts file, if both file are present. However if m2ts is absent then it fallback to ssif file and same goes other way around.

[jdobbs]

Jdobbs, you have come long way when it comes to overcoming some of the most difficult sources, try it and you shall succeed.

Just want to take guess would it be possible to add code which tell program after scanning disc and identify main movie use ssif to extract instead of m2ts for feature film. Also I remember Roman telling me when you demux using mpls file in tsmuxer, it will use m2ts file, if both file are present. However if m2ts is absent then it fallback to ssif file and same goes other way around.I'll probably look at the file sizes of the two M2TS files and compare it to the SSIF. If an SSIF exists, and it shows a significant size discrepancy it will go with the SSIF. The downside is that I'm not sure when I will test it. 3D movies are expensive and my donations are exceptionally low, and I've made a rule for myself that I will no longer buy movies for testing with my own money. Losing money on a freeware development project has gotten to be an expensive habit.

[Edit] For those who might offer a free download of their disc -- please don't send me a PM. I appreciate it, but I don't download copyrighted discs.

BD-RB doesn't rely on TSMUXER to make those kinds of choices. I scan the disc myself (mainly so I can collect other important data from the MPLS and CLPI files) and create my own META files (which are then fed to TSMUXER). In fact, the GUI isn't even needed or included in the BD-RB distribution.

[HWK]

I'll probably look at the file sizes of the two M2TS files and compare it to the SSIF. If an SSIF exists, and it shows a significant size discrepancy it will go with the SSIF. The downside is that I'm not sure when I will test it. 3D movies are expensive and my donations are exceptionally low, and I've made a rule for myself that I will no longer buy movies for testing with my own money. Losing money on a development project has gotten to be an expensive habit.



Tell you what if you can add code to check size of avc and mvc size and compare with ssif. Least I can do provide feedback and test for you and let you know if you are on right track or not. If it takes multiple times to run it so be it and I am willing to do it.

[jdobbs]

Tell you what if you can add code to check size of avc and mvc size and compare with ssif. Least I can do provide feedback and test for you and let you know if you are on right track or not. If it takes multiple times to run it so be it and I am willing to do it.Thanks. I'll add the code and send you a test version so you can run it on your disc.

Thanks.

[HWK]

No problem, I would send donation but recent set of events has put me in really tight situation. So I came with another way to help you.

[jdobbs]

No problem, I would send donation but recent sets of events has put me in really tight situation. So I came with another way to help you.I don't expect donations from people who contribute in other ways. I appreciate your support here on the forum.

[HWK]

I wonder if this is why the 3D quality in this movie was not as good as the REAL 3D that played in the theater. I watched this at home after I got it and was completely underwhelmed with what I was seeing. The whole movie was kinda soft and blurry, without the primary colors that popped when I saw it at the theater. I have seriously thought about returning it because I was so unimpressed with the 3D on it, especially because I paid 38 bucks for it.

No it has to do with transfer characteristics or playback environment and it does not affect how disc is authored.

Also want to confirm what is region of your blu-ray.

[gonca]

The 3D issue doesn't affect me but $30 your way to help with the issue

[HWK]

The 3D issue doesn't affect me but $30 your way to help with the issue

Wow, some of our community are made of really nice members :) I am positive Jdobbs appreciate it.

[gonca]

Wow, some of our community are made of really nice members :) I am positive Jdobbs appreciate it.

We're both Toronto people, we do what we can to help.

[HWK]

We're both Toronto people, we do what we can to help.

You got that right!! Do whatever you can provided to stay within limits to help others is my motto :cool:

[gonca]

If an i7 hexacore at 4.4GHz can be of help in testing, let me know.

[jdobbs]

The 3D issue doesn't affect me but $30 your way to help with the issueThat works for me. Much appreciated.

I've ordered the LEGO MOVIE 3D edition from Amazon, and it should be here in 2 days.

Thanks.

[Edit] Hmm... the confirmation message from Amazon says "Prime Two-day shipping" -- and then estimates Friday, July 11th for delivery. Is it me, or does 11-7=2 now? It's been a while since I was in school. I have to admit I haven't been keeping up with "new math".

[HWK]

If an i7 hexacore at 4.4GHz can be of help in testing, let me know.

It is kind of funny that my primary machine is also hexa core (i7 3930K @ 4.5 Ghz and liquid cooled)

[HWK]

That works for me. Much appreciated.

I've ordered the LEGO MOVIE 3D edition from Amazon, and it should be here in 2 days.

Thanks.

[Edit] Hmm... the confirmation message from Amazon says "Prime Two-day shipping" -- and then estimates Friday, July 11th for delivery. Is it me, or does 11-7=2 now? It's been a while since I was in school. I have to admit I haven't been keeping up with "new math".

Do you still want me to test? Either way let me know.

[IVaN_000]

When you refer to it works, are you referring to backup or playback. I am guessing playback but want to confirm.

Yes, sorry, I meant playback. Backup didn't success, I also tried with another software, the one with bad reputation :rolleyes:, with same results.

[gonca]

Glad to be of help

[Edit] Hmm... the confirmation message from Amazon says "Prime Two-day shipping" -- and then estimates Friday, July 11th for delivery. Is it me, or does 11-7=2 now? It's been a while since I was in school. I have to admit I haven't been keeping up with "new math".

Its a binary thing

[jdobbs]

Do you still want me to test? Either way let me know.Yes, if it's alright. I was hoping it would come by Wed so I could test it and release along with a couple of other fixes -- I have to leave town for a few of days on Thurs for a family reunion.

I'll put in a first-attempt at a fix tomorrow and send you a version to test on LEGO. Meanwhile I'll test on some other sources to make sure it doesn't have any unexpected negative effects.

[HWK]

Yes, if it's alright. I was hoping it would come by Wed so I could test it and release along with a couple of other fixes -- I have to leave town for a few of days on Thurs for a family reunion.

I'll put in a first-attempt at a fix tomorrow and send you a version to test on LEGO. Meanwhile I'll test on some other sources to make sure it doesn't have any unexpected negative effects.

Sounds good to me, will wait for program.

[mmick]

It is kind of funny that my primary machine is also hexa core (i7 3930K @ 4.5 Ghz and liquid cooled)

6 (i7) cores, 12 MB cache pumping at 4.5 GHz ??? and unlocked multiplier AFAIK... wow :eek:

In comparison, my little i5-4200U @ 1.6 Ghz (ultrabook) looks VERY pale :(

[HWK]

6 (i7) cores, 12 MB cache pumping at 4.5 GHz ??? and unlocked multiplier AFAIK... wow :eek:



On top of that I build myself.

[andref4]

I have managed to figure out cause of failure and why it is failing. In my case I used Region A disc. This is gone be long so bear with me.

[Disc Info]

00042.m2ts contain only 7min and 19 sec from beginning and 00065.m2ts is mvc view for corresponding 00042.m2ts. Normally 3D disc has AVC and MVC view and they are interleaved in ssif folder with file name of avc file. Which allow backwards compatibility with 2D system.

Example 0001.m2ts (AVC) and 0002.m2ts (MVC) will be 0001.ssif with size of 0001 + 0002 combined.

Lego is 3D exclusive and in this case there is no backwards compatibility and will not play in 2D system. Normally disc are backwards compatible, even if they are not as long there is avc stream with full movie, hack like Slysoft Anydvd "simulate 3D display" would work. However in this case it simply doesn't contain full movie avc stream.

Rather it is made of SSIF file, which is not fake or made of two m2ts files commonly found on disc. SSIF file in this case holds actual movie itself and since it only play in 3D, when player plays it is actually reading SSIF file sectors, not interleaved files between two m2ts files normally found in Blu-ray 3D.

Reason why BD-RB can’t back it up is normally when you open disc in BD-RB. It scans all mpls based files and display movie only or all relevant title based on import threshold. In Lego case 00098.mpls tell program movie is 1h 40m and 35 sec which causes it to import, however it imports actual stream from 00042.m2ts and 00065.m2ts which account for size 2,454.44MB seen in BD-RB. Even though program suppose to import full movie but it end up importing 7min and 19 sec segment.

What program need to do in this case is use SSIF file which will successfully import entire movie. Instead of first seven minute and nineteen second and to back it up program will also require telling tsmuxer to use SSIF file for extraction instead of m2ts it normally uses.

Normally if disc is interleaved to create SSIF file, BDMV folder will be close to double the size of movie and in some cases size of disc. However in this case there is not such thing.



The same Problem has the movie Cloudy with a Chance of Meatballs 2 3D that I wrote here end of May. The only thing that worked at moment for me was a movie only rip.

[jdobbs]

Sounds good to me, will wait for program.Can you check something for me? When BD-RB extracts the audio in movie-only mode it uses the MPLS file for the extraction. Can you try a movie-only encode of LEGO MOVIE and see if the audio is complete? You don't need to reencode, just let the first phase "Extracting A/V streams" complete. The audio files will be in the WORKING PATH folder.

Based on your earlier comments, TSMUXER looks for unequal M2TS/SSIF files and selects the correct stream. I just need to know if TSMUXER makes that choice when an MPLS is used for the demux.

Thanks.

[HWK]

Can you check something for me? When BD-RB extracts the audio in movie-only mode it uses the MPLS file for the extraction. Can you try a movie-only encode of LEGO MOVIE and see if the audio is complete? You don't need to reencode, just let the first phase "Extracting A/V streams" complete. The audio files will be in the WORKING PATH folder.

Based on your earlier comments, TSMUXER looks for unequal M2TS/SSIF files and selects the correct stream. I just need to know if TSMUXER makes that choice when an MPLS is used for the demux.

Thanks.

No, it doesn't. I have attached screenshot to help you assess how BD-RB or tsmuxer will extract with mpls and how it will be done if ssif file is opened. For comparsion I have only included English when doing manually in tsmuxer. This also effect subtitle.

http://i61.tinypic.com/2vn00gi.png

[HWK]

The same Problem has the movie Cloudy with a Chance of Meatballs 2 3D that I wrote here end of May. The only thing that worked at moment for me was a movie only rip.

I have that disc as well, after jdobbs finish with this and if for some reason it still doesn't work. Then I can look into it to see what is different.

[HWK]

Based on your earlier comments, TSMUXER looks for unequal M2TS/SSIF files and selects the correct stream. I just need to know if TSMUXER makes that choice when an MPLS is used for the demux.



If mpls is used and m2ts and ssif exist. Tsmuxer will always give priority to m2ts regardless of what is being done.

[jdobbs]

If mpls is used and m2ts and ssif exist. Tsmuxer will always give priority to m2ts regardless of what is being done.Thanks.

That's going to make it more complicated... ughh. I may not have a test version until next week.

[omegaman7]

I don't recall having a problem with Cloudy 2 3D. But then, all I did was replace the HD audio track, with the 5.1 DVD counterpart :S

[gonca]

On top of that I build myself.
You too, it must be a Toronto thing.
Sorry for the OT

[mmick]

On top of that I build myself.

You too, it must be a Toronto thing.
Sorry for the OT

No, I am Portuguese and I used to do that too, I spent hours and hours (and hundreds of €€€) with it... :D but now I moved out and only ultrabooks are light to travel ;)

Sorry for the OT

back on the subject, yesterday I tested with Frozen 3D:
- Frozen 3D BRay has the main movie devided in several parts, but AFAIK BD Rebuilder detected correctly all of them (today I will test it)

- 3D SBS: very slow encoding, 12 - 14 fps using x264
- 3D MVC: very FAST encoding (as jdobbs said, it will use Quicksync), around 50 - 80 fps :eek:

I will test it today and I´ll give my feedback,

Question: Quicksync has several quality profiles, do you know which is used by FRIM?

TRY 1:
3D MVC BD-5 ISO, DTS 2 AC3 conversion (FRIM_SW_DECODE=0 & FRIM_SW_ENCODE=0): 50-80 fps. RESULT: AVC stream *very* good; MVC stream with encoding errors

TRY 2:
3D MVC BD-5 ISO, DTS 2 AC3 conversion (FRIM_SW_DECODE=0 & FRIM_SW_ENCODE=1): 10-12 fps. RESULT: AVC & MVC streams with some encoding macroblocking (as jdobbs said, frim is not so efficient as x264...)

TRY 3:
3D MVC BD-5 ISO, DTS 2 AC3 conversion (FRIM_SW_DECODE=1 & FRIM_SW_ENCODE=0): 20-22 fps. RESULT: still running, I have no hexacore i7 with 12MB cache :-)

[jdobbs]

Question: Quicksync has several quality profiles, do you know which is used by FRIM?The quality profile is selectable in FRIM. BD-RB will select one based upon your selection under the SETTINGS/ENCODER SETTINGS menu.

I would recommend against using a BD-5 for output (unless it's strictly for testing). 3D video requires much more data than a 2D encode, and a BD-5 just isn't big enough to give decent quality. BD-9 works. But BD-25 is better.

[mmick]

The quality profile is selectable in FRIM. BD-RB will select one based upon your selection under the SETTINGS/ENCODER SETTINGS menu.

I would recommend against using a BD-5 for output

I am just doing it for testing to see better how all methods use the available bitrate, then when I find a suitable method, I´ll fine tune with the bitrate.

About the Quicksync quality, I assume your answer goes to the Intel QSV preset: Ivy Bridge CPUs have 3 QSV presets, Haswell 7 QSV presets (where level 3 for an Ivy Bridge is excelent quality, and on Haswell is very bad... On Haswell must be set to 7).

[jdobbs]

I believe it applies to the levels available via the Intel SDK.Haswell must be set to 7Why?

[mmick]

I believe it applies to the levels available via the Intel SDK.Why?

AFAI heard, after the first tests, at same QSV level Haswell was faster than previous itinerations, but quality was also worse, probably because QSV levels were not the same. If that is true, I have no idea...

http://www.anandtech.com/show/7003/the-haswell-review-intel-core-i74770k-i54560k-tested/8

[jdobbs]

Just a note for clarity: In FRIM u=7 is the fastest setting and u=1 is the highest quality.

[mmick]

Just a note for clarity: In FRIM u=7 is the fastest setting and u=1 is the highest quality.

:D note that I did not mean that 7 (QSV profiles on Haswell) has anything to do with those parameters ;) far from that, that was just a basic info :p

[Sharc]

Just a note for clarity: In FRIM u=7 is the fastest setting and u=1 is the highest quality.
Does AUTO_BIAS=n control the quality of FRIM as well, or is it only for x264?

[jdobbs]

Does AUTO_BIAS=n control the quality of FRIM as well, or is it only for x264?It controls both.

[mmick]

Now I´ve tested everything all over again.

Conditions:

- 3D MVC "Movie-only", BD-9 ISO, DTS 2 AC3 conversion
- test on High, and highest quality
- the final ISO is mounted on DVDFab virtual drive
- played as a normal BD with 3D turned on (over a 3D Samsung 6500 series)


RESULT:

- using FRIM with Encoding hardware acceleration - Quicksync on an Haswell i5 4200u CPU, (SW or HW decode is the same), the main stream seems ok, MVC stream with encoding errors
- the original BD rip (ISO) plays perfect


I was searching and I found someone with same issue with your app using FRIM / QSV, and also previously with MVCenc (another app)
http://forum.doom9.org/showthread.php?t=170315

I got the same corruption as the user "sef" on that website (he post a photo)
http://i59.fastpic.ru/big/2014/0309/c7/a26b942945a0154214b5275650dd1ac7.jpg

"One user has reported pixelation on HW encoding (i7-4770) but the root cause is not clear (can be also HW decoding or muxing processes)"
"Interesting: this explains that garbled output is not related exclusively to MVCenc but Quick Sync HW on your system."

That has something to do with different Intel Hardware! My i5 Haswell produces the same visual issues, despite good bitrate...

[HWK]

It is most likely software, Since I don't have cpu which support quicksync and still see errors in mvc stream, which are not present in avc.
Also if I use external encoder and let bd-rb rebuild stream created by external encoder then there are no error in mvc or avc and playback is smooth, regardless of device.

[worknstiff]

I do 3D all the time using BD Rebuilder on my i7 2600K that's overclocked to 4450 mhz. I see all these people talking about 75fps but on mine it never goes over 16fps doing the pass 1 on MVC. The only time I see 70+ fps is on a 2 pass blue-ray while on pass 1, pass 2 is usually a meager 16-22 fps. I wonder if these errors are occurring because of these exceptionally high frame rates?

[mmick]

I do 3D all the time using BD Rebuilder on my i7 2600K that's overclocked to 4450 mhz. I see all these people talking about 75fps but on mine it never goes over 16fps doing the pass 1 on MVC. [...] I wonder if these errors are occurring because of these exceptionally high frame rates?

Quicksync is a hardware circuit to dec/enc video, almost a fixed function, not a software algorithm running on HW as on Nvidia/AMD.

Your CPU is a Sandy Bridge, the 1st with that tech, which may be stable (and slow). My CPU is an Haswell, the latest Quicksync API LEVEL 1.8 (perhaps Ivy Bridge has issues too), and AFAIK other MVC encoders had issues with the new gen Quicksync. I assume that perhaps it has to do with the API LEVEL / some settings, as I already used some trial versions from commercial apps, and I had zero issues using Quicksync. Funny that my issues (as before people had with MVCenc) are only with the MVC stream (right eye), as the AVC (left eye) is encoded well

With my slow 1.6-2.3 Ghz i5 4200U, I get a lot more fps (and errors lol) than you :-)


EDIT NOTE:
I sucessfully encoded the same movie as 3D MVC "Movie-only", BD-9 ISO, DTS 2 AC3 conversion with BD2AVCHD using Quicksync (MVCenc) and it encoded perfectly in record time! (my CPU averaged 10%, and I got around 50-60 fps using my tiny i5 4200u)

jdobbs: can´t MVCenc be used instead of FRIM?

[jdobbs]

Quicksync is a hardware circuit to dec/enc video, almost a fixed function, not a software algorithm running on HW as on Nvidia/AMD.

Your CPU is a Sandy Bridge, the 1st with that tech, which may be stable (and slow). My CPU is an Haswell, the latest Quicksync API LEVEL 1.8 (perhaps Ivy Bridge has issues too), and AFAIK other MVC encoders had issues with the new gen Quicksync. I assume that perhaps it has to do with the API LEVEL / some settings, as I already used some trial versions from commercial apps, and I had zero issues using Quicksync. Funny that my issues (as before people had with MVCenc) are only with the MVC stream (right eye), as the AVC (left eye) is encoded well

With my slow 1.6-2.3 Ghz i5 4200U, I get a lot more fps (and errors lol) than you :-)


EDIT NOTE:
I sucessfully encoded the same movie as 3D MVC "Movie-only", BD-9 ISO, DTS 2 AC3 conversion with BD2AVCHD using Quicksync (MVCenc) and it encoded perfectly in record time! (my CPU averaged 10%, and I got around 50-60 fps using my tiny i5 4200u)

jdobbs: can´t MVCenc be used instead of FRIM?I'm not sure it is allowed under it's release rules -- and I'm not in a position to download it for a few days. If so I will support it.

Is there a copyright notice and/or release rules included when downloaded?

[HWK]

I'm not sure it is allowed under it's release rules -- and I'm not in a position to download it for a few days. If so I will support it.

Is there a copyright notice and/or release rules included when downloaded?

Jdobbs, this thread may contain answer to your question

http://forum.doom9.org/showthread.php?t=170315 (http://forum.doom9.org/showthread.php?t=170315)

Also just want to ask your opinion about developing your own using Intel® Media SDK 2014. You already do good job coding BD-RB maybe you can give this a try.