Help with BD Rebuilder errors

[bluesnow]

Can anyone help me understand what is going wrong here . . .

When I want to backup a BR movie that has Cinavia I use a 3 step process. First I rip the movie (movie only) to my hard drive using DVDFab with no compression. I then have BD Rebuilder do the compression on that copy to fit it on a BR disc. Finally I use MakeMKV to create another copy for my media player. I've done this many times without a hitch, but this one movie is giving me some grief. During the rip I get no errors, while running BR Rebuilder I get no errors, but when I run MakeMKV I get a slew pit full of them and I believe they are related to BD Rebuilder.

This is the log for BD Rebuilder and the system check:

[02/25/17] Checking System Settings
- BD-Rebuilder v0.50.20
- Windows Version: 6.2 [9200]
- Working Path Free Space: 411.52GB
- AVISYNTH Version: 2.5.8.0, Ok
- LAVFILTERS: Ok
- X264: Ok
- AFTEN: Ok
- FAAC: Ok
- MP4BOX: Ok
- WAVI: Ok
- TSMUXER: Ok
- FRIMEncode: Ok
- FRIMDecode: Ok
[02/25/17] Systems Settings Check complete


----------------------
[02/23/17] BD Rebuilder v0.50.20
[16:11:36] Source: DEEPWATER_HORIZON_UNCOMP_LPCM_00000
- Input BD size: 24.87 GB
- Approximate total content: [01:47:17.472]
- Target BD size: 22.95 GB
- Windows Version: 6.2 [9200]
- MOVIE-ONLY mode enabled
- Quality: High Quality (Default), Two Pass
- Decoding/Frame serving: DirectShow
- Audio Settings: AC3=0 DTS=0 HD=1 Kbs=640
[16:11:36] PHASE ONE, Encoding
- [16:11:36] Processing: VID_00509 (1 of 15)
- [16:11:36] Extracting A/V streams [VID_00509]
- [16:15:15] Reencoding video [VID_00509]
- [16:15:15] Keeping original video (no reencode)
- [16:15:15] Processing audio tracks
- Track 4352 (eng): Reencoding audio to AC3...
- [16:15:52] Processing: VID_00504 (2 of 15)
- [16:15:52] Extracting A/V streams [VID_00504]
- [16:15:59] Reencoding video [VID_00504]
- Source Video: MPEG-4 (AVC), 1920x1080
- Rate/Length: 23.976fps, 658 frames
- Bitrate: 29,740 Kbs
- [16:15:59] Reencoding: VID_00504, Pass 1 of 2
- [16:16:11] Reencoding: VID_00504, Pass 2 of 2
- [16:17:00] Video Encode complete
- [16:17:00] Processing: VID_00513 (3 of 15)
- [16:17:00] Extracting A/V streams [VID_00513]
- [16:17:07] Reencoding video [VID_00513]
- Source Video: MPEG-4 (AVC), 1920x1080
- Rate/Length: 23.976fps, 688 frames
- Bitrate: 34,801 Kbs
- [16:17:07] Reencoding: VID_00513, Pass 1 of 2
- [16:17:21] Reencoding: VID_00513, Pass 2 of 2
- [16:18:16] Video Encode complete
- [16:18:16] Processing: VID_00515 (4 of 15)
- [16:18:16] Extracting A/V streams [VID_00515]
- [16:18:22] Reencoding video [VID_00515]
- Source Video: MPEG-4 (AVC), 1920x1080
- Rate/Length: 23.976fps, 760 frames
- Bitrate: 32,901 Kbs
- [16:18:22] Reencoding: VID_00515, Pass 1 of 2
- [16:18:37] Reencoding: VID_00515, Pass 2 of 2
- [16:19:34] Video Encode complete
- [16:19:34] Processing: VID_00510 (5 of 15)
- [16:19:34] Extracting A/V streams [VID_00510]
- [16:21:19] Reencoding video [VID_00510]
- Source Video: MPEG-4 (AVC), 1920x1080
- Rate/Length: 23.976fps, 33,631 frames
- Bitrate: 32,000 Kbs
- [16:21:19] Reencoding: VID_00510, Pass 1 of 2
- [16:32:25] Reencoding: VID_00510, Pass 2 of 2
- [17:13:01] Video Encode complete
- [17:13:01] Processing: VID_00506 (6 of 15)
- [17:13:01] Extracting A/V streams [VID_00506]
- [17:13:07] Reencoding video [VID_00506]
- Source Video: MPEG-4 (AVC), 1920x1080
- Rate/Length: 23.976fps, 794 frames
- Bitrate: 32,676 Kbs
- [17:13:08] Reencoding: VID_00506, Pass 1 of 2
- [17:13:23] Reencoding: VID_00506, Pass 2 of 2
- [17:14:23] Video Encode complete
- [17:14:23] Processing: VID_00508 (7 of 15)
- [17:14:23] Extracting A/V streams [VID_00508]
- [17:14:30] Reencoding video [VID_00508]
- Source Video: MPEG-4 (AVC), 1920x1080
- Rate/Length: 23.976fps, 1,397 frames
- Bitrate: 32,992 Kbs
- [17:14:30] Reencoding: VID_00508, Pass 1 of 2
- [17:14:58] Reencoding: VID_00508, Pass 2 of 2
- [17:16:46] Video Encode complete
- [17:16:46] Processing: VID_00514 (8 of 15)
- [17:16:46] Extracting A/V streams [VID_00514]
- [17:16:51] Reencoding video [VID_00514]
- Source Video: MPEG-4 (AVC), 1920x1080
- Rate/Length: 23.976fps, 495 frames
- Bitrate: 34,254 Kbs
- [17:16:52] Reencoding: VID_00514, Pass 1 of 2
- [17:17:02] Reencoding: VID_00514, Pass 2 of 2
- [17:17:38] Video Encode complete
- [17:17:38] Processing: VID_00505 (9 of 15)
- [17:17:38] Extracting A/V streams [VID_00505]
- [17:17:46] Reencoding video [VID_00505]
- Source Video: MPEG-4 (AVC), 1920x1080
- Rate/Length: 23.976fps, 1,465 frames
- Bitrate: 35,000 Kbs
- [17:17:46] Reencoding: VID_00505, Pass 1 of 2
- [17:18:16] Reencoding: VID_00505, Pass 2 of 2
- [17:20:05] Video Encode complete
- [17:20:05] Processing: VID_00501 (10 of 15)
- [17:20:05] Extracting A/V streams [VID_00501]
- [17:20:10] Reencoding video [VID_00501]
- Source Video: MPEG-4 (AVC), 1920x1080
- Rate/Length: 23.976fps, 604 frames
- Bitrate: 34,375 Kbs
- [17:20:10] Reencoding: VID_00501, Pass 1 of 2
- [17:20:23] Reencoding: VID_00501, Pass 2 of 2
- [17:21:06] Video Encode complete
- [17:21:06] Processing: VID_00511 (11 of 15)
- [17:21:06] Extracting A/V streams [VID_00511]
- [17:21:13] Reencoding video [VID_00511]
- Source Video: MPEG-4 (AVC), 1920x1080
- Rate/Length: 23.976fps, 961 frames
- Bitrate: 34,102 Kbs
- [17:21:13] Reencoding: VID_00511, Pass 1 of 2
- [17:21:32] Reencoding: VID_00511, Pass 2 of 2
- [17:22:44] Video Encode complete
- [17:22:44] Processing: VID_00512 (12 of 15)
- [17:22:44] Extracting A/V streams [VID_00512]
- [17:22:50] Reencoding video [VID_00512]
- Source Video: MPEG-4 (AVC), 1920x1080
- Rate/Length: 23.976fps, 590 frames
- Bitrate: 32,493 Kbs
- [17:22:50] Reencoding: VID_00512, Pass 1 of 2
- [17:23:02] Reencoding: VID_00512, Pass 2 of 2
- [17:23:46] Video Encode complete
- [17:23:46] Processing: VID_00502 (13 of 15)
- [17:23:46] Extracting A/V streams [VID_00502]
- [17:25:44] Reencoding video [VID_00502]
- Source Video: MPEG-4 (AVC), 1920x1080
- Rate/Length: 23.976fps, 39,948 frames
- Bitrate: 31,033 Kbs
- [17:25:44] Reencoding: VID_00502, Pass 1 of 2
- [17:38:33] Reencoding: VID_00502, Pass 2 of 2
- [18:27:46] Video Encode complete
- [18:27:46] Processing: VID_00507 (14 of 15)
- [18:27:46] Extracting A/V streams [VID_00507]
- [18:27:52] Reencoding video [VID_00507]
- Source Video: MPEG-4 (AVC), 1920x1080
- Rate/Length: 23.976fps, 651 frames
- Bitrate: 30,642 Kbs
- [18:27:52] Reencoding: VID_00507, Pass 1 of 2
- [18:28:05] Reencoding: VID_00507, Pass 2 of 2
- [18:28:53] Video Encode complete
- [18:28:53] Processing: VID_00503 (15 of 15)
- [18:28:53] Extracting A/V streams [VID_00503]
- [18:31:12] Reencoding video [VID_00503]
- Source Video: MPEG-4 (AVC), 1920x1080
- Rate/Length: 23.976fps, 63,573 frames
- Bitrate: 23,722 Kbs
- [18:31:12] Reencoding: VID_00503, Pass 1 of 2
- [18:58:47] Reencoding: VID_00503, Pass 2 of 2
- [20:15:03] Video Encode complete
[20:15:03]PHASE ONE complete
[20:15:03]PHASE TWO - Rebuild Started
- [20:15:03] Rebuilding BD file Structure
[20:21:52] - Encode and Rebuild complete
- WORKFILES folder removed.
[20:21:53] JOB: DEEPWATER_HORIZON_UNCOMP_LPCM finished.

And this is the log from MakeMKV . . .


MakeMKV v1.10.4 win(x64-release) started
Opening files on harddrive at E:/Deep Water Horizon incomp lpcm/DEEPWATER_HORIZON_UNCOMP_LPCM
AACS directory not present, assuming unencrypted disc
File 00000.mpls was added as title #0
Operation successfully completed
Saving 1 titles into directory E:/MKV Files
The source file is corrupt or invalid, attempting to work around
The source file '/BDMV/STREAM/00000.m2ts' is corrupt or invalid at offset 641796096, attempting to work around
The source file is corrupt or invalid, attempting to work around
The source file '/BDMV/STREAM/00000.m2ts' is corrupt or invalid at offset 645390336, attempting to work around
The source file is corrupt or invalid, attempting to work around
The source file '/BDMV/STREAM/00000.m2ts' is corrupt or invalid at offset 648671232, attempting to work around
The source file is corrupt or invalid, attempting to work around
The source file '/BDMV/STREAM/00000.m2ts' is corrupt or invalid at offset 652818432, attempting to work around
The source file is corrupt or invalid, attempting to work around
The source file '/BDMV/STREAM/00000.m2ts' is corrupt or invalid at offset 657297408, attempting to work around
The source file is corrupt or invalid, attempting to work around
The source file '/BDMV/STREAM/00000.m2ts' is corrupt or invalid at offset 661432320, attempting to work around
The source file '/BDMV/STREAM/00000.m2ts' is corrupt or invalid at offset 663312384, attempting to work around
The source file is corrupt or invalid, attempting to work around
AV synchronization issues were found in file 'E:/MKV Files/title00.mkv' (title #1)
AV sync issue in stream 0 at 0:05:39.130 : video frame timecode differs by +41.705ms
AV sync issue in stream 0 at 0:05:39.172 : video frame timecode differs by +83.408ms
AV sync issue in stream 0 at 0:05:39.213 : video frame timecode differs by +125.122ms
AV sync issue in stream 0 at 0:05:39.255 : video frame timecode differs by +166.825ms
AV sync issue in stream 0 at 0:05:39.297 : video frame timecode differs by +208.538ms
AV sync issue in stream 0 at 0:05:39.339 : video frame timecode differs by +250.241ms
AV sync issue in stream 0 at 0:05:39.380 : video frame timecode differs by +291.955ms
AV sync issue in stream 0 at 0:05:39.422 : video frame timecode differs by +333.658ms
AV sync issue in stream 0 at 0:05:39.464 : video frame timecode differs by +375.372ms
AV sync issue in stream 0 at 0:05:39.505 : video frame timecode differs by +417.075ms
AV sync issue in stream 0 at 0:05:39.505 : too many video frames with invalid timecodes, future messages will be suppressed
The source file '/BDMV/STREAM/00000.m2ts' is corrupt or invalid at offset 667557888, attempting to work around
The source file is corrupt or invalid, attempting to work around
The source file '/BDMV/STREAM/00000.m2ts' is corrupt or invalid at offset 672049152, attempting to work around
The source file '/BDMV/STREAM/00000.m2ts' is corrupt or invalid at offset 673677312, attempting to work around
The source file is corrupt or invalid, attempting to work around
The source file '/BDMV/STREAM/00000.m2ts' is corrupt or invalid at offset 676386816, attempting to work around
The source file is corrupt or invalid, attempting to work around
The source file '/BDMV/STREAM/00000.m2ts' is corrupt or invalid at offset 679428096, attempting to work around
The source file is corrupt or invalid, attempting to work around
The source file '/BDMV/STREAM/00000.m2ts' is corrupt or invalid at offset 683581440, attempting to work around
The source file is corrupt or invalid, attempting to work around
Failed to save title 0 to file E:/MKV Files/title00.mkv
0 titles saved, 1 failed

The last 2 lines are because I cancel the operation.

As a comparison test I ran MakeMKV on the uncompressed copy and it works out fine . . .

Opening files on harddrive at E:/Deep Water Horizon
AACS directory not present, assuming unencrypted disc
File 00000.mpls was added as title #0
Operation successfully completed
Saving 1 titles into directory E:/MKV Files
Forced subtitles track #2 turned out to be empty and was removed from output file
Forced subtitles track #3 turned out to be empty and was removed from output file
1 titles saved

Finally I tried using DVDFab to compress the movie to fit a disc (no errors) and then ran MakeMKV on Fab's compressed copy and that also works out fine . . .


Opening files on harddrive at E:/DVDFab Images/MainMovie/DEEPWATER_HORIZON uncomp lpcm
AACS directory not present, assuming unencrypted disc
File 00000.mpls was added as title #0
Operation successfully completed
Saving 1 titles into directory E:/MKV Files
Forced subtitles track #2 turned out to be empty and was removed from output file
Forced subtitles track #3 turned out to be empty and was removed from output file
1 titles saved


Can anyone guess why the compressed copy from BD Rebuilder has the errors while the original umcompressed copy and the copy compressed by Fab work out fine?

[gonca]

Try using BD_RB on the source and leave Cinavia alone for the test
If MakeMkv has no issues then the problem is the Cinavia removal in DVDFab

[bluesnow]

MakeMKV has no issues with the ripped original copy (Cinavia removed) before it's compressed and no issues with the Fab compressed copy either. The errors only appear on the BD Rebuilder compressed version so I doubt the problem could be related to Cinavia removal.

[gonca]

Do you know exactly how DVDFab removes the watermark?
If not, then you don't know if it is related or not

[bluesnow]

Do you know exactly how DVDFab removes the watermark?
If not, then you don't know if it is related or not

Yes, the sound track is replaced with an LPCM track that doesn't have the watermark. BD-RB converts this to AC3 without issues.

[gonca]

It might not be the entire soundtrack, just enough sections to disrupt Cinavia detection. Also, the sections are not LPCM, they are encoded to LPCM to make it appear HD, actually they might re-encode the sections and remainder of original.
If the sections have any kind of millisec gaps within the stream you will get A/V sync warnings
Exactly what you are getting
The problem could be the Cinavia "removal"

[bluesnow]

OK. I understand.

One point though - I've done quite a few movies this way without problems. It takes a while so I'll try using BD-RB on the original disc tomorrow.

[bluesnow]

It might not be the entire soundtrack, just enough sections to disrupt Cinavia detection. Also, the sections are not LPCM, they are encoded to LPCM to make it appear HD, actually they might re-encode the sections and remainder of original.
If the sections have any kind of millisec gaps within the stream you will get A/V sync warnings
Exactly what you are getting
The problem could be the Cinavia "removal"

How would you explain the lack of errors when MakeMKV processes the uncompressed version after cinavia has been removed?

[gonca]

maybe it deals with lpcm differently, i.e. it can't see the errors with a wav file
Maybe it is a false positive, who knows
Just try once without cinavia removal

[jdobbs]

Well, one observation right off the bat:- [16:15:15] Reencoding video [VID_00509]
- [16:15:15] Keeping original video (no reencode)

- [16:15:59] Reencoding: VID_00504, Pass 1 of 2
- [16:16:11] Reencoding: VID_00504, Pass 2 of 2This should never happen. Either all of the source should be encoded or none of it -- but never a mix. I'd have to look at it more closely to see why this could occur. I can't say for sure it is the root of the problem, but I can say it isn't right.

Just as a test, try adding FORCE_ENCODE=1 to the [Options] area of your INI file and see what impact that has.

[gonca]

If bluesnow posts his settings I can do that movie and see if this has something to do with the pre-processing, if you wish.

[bluesnow]

If bluesnow posts his settings I can do that movie and see if this has something to do with the pre-processing, if you wish.

I believe this is how it was set during the trial that created the above log (except the source and output paths) . . .

[Options]
VERSION=0.50.0.20
ENCODER=0
MODE=3
ENCODE_QUALITY=2
ONEPASS_ENCODING=0
AUTO_QUALITY=0
TARGET_SIZE=23500
AUDIO_TO_KEEP=eng;
SUBS_TO_KEEP=eng;
SD_CONVERT=0
OPEN_GOP=0
RESIZE_1080=0
RESIZE_1440=0
RESIZE_720=0
DEINTERLACE=1
SD_TO_1080=0
IGNORE_3D=0
CONVERT_WIDE=0
DTS_REENCODE=0
AC3_REENCODE=0
AC3_640=1
AC3_192=0
KEEP_HD_AUDIO=1
KEEP_HD_LPCM=0
AUDIO_DRC=0
DECODER=0
AVCHD=1
REMOVE_WORKFILES=1
REMOVE_OUTPUT=0
USE_FILTERS=0
BDMV_CERT_ONLY=0
IVTC_PULLDOWN=0
ASSUME_DVD_PAL=0
FRIMSOURCE=0
COMPLETION_BEEP=0
OUTPUT_SBS=0
NEROAAC=0
SUPTITLE=0
PGSTOSRT=0
AUDIO_TRACK_LIMIT=1
SUBTITLE_TRACK_LIMIT=1
CUSTOM_TARGET_SIZE=23500
MOVIEONLY_TYPE=0
ALTCRF=23
ALT_TARGET=1024
ALT_CRF_TARGET=1024
ALTMETHOD=1
ALTAUTOCROP=0
[Paths]
WORKING_PATH=E:\TEST\
SOURCE_PATH=E:\DVDFAB IMAGES\MAINMOVIE\DEEPWATER_HORIZON UNCOMP LPCM\

[bluesnow]

I just finished another test, maybe it means something too. I used the option KEEP_HD_LPCM=1 and re-ran BD-RB. This I presume leaves the LPCM in tact and just compresses the video portion. I got the same errors out of MakeMKV as shown above. This is in contrast to running MakeMKV on the uncompressed video with LPCM where no errors showed.

[gonca]

Well, it failed to encode the first stream on my end as well.
Its now up to jdobbs

[jdobbs]

Can you try FORCE_ENCODE=1 as I suggested? I need to know if that is the root of the issue. Playing with the audio isn't going to do anything for errors that are related to video frames...

[gonca]

FORCE_ENCODE=1 makes it work as it should, it encodes the files

[bluesnow]

Well, it failed to encode the first stream on my end as well.
Its now up to jdobbs

Did you run this on the original disc? Maybe you could now run MakeMKV to see if you get the errors I did.

[bluesnow]

FORCE_ENCODE=1 makes it work as it should, it encodes the files

I'll try this too and then run MakeMKV to see what I get then.

[gonca]

Don't have MakeMKV installed

[bluesnow]

Too bad for me. It doesn't take much to install.

[bluesnow]

I ran BD-RB one more time with FORCE_ENCODE=1 then ran MakeMKV on the result. There were no errors this time, all went as usual. I presume not encoding the first stream is the root cause of the original errors?

[jdobbs]

I ran BD-RB one more time with FORCE_ENCODE=1 then ran MakeMKV on the result. There were no errors this time, all went as usual. I presume not encoding the first stream is the root cause of the original errors?Yes. I'll see if I can pick up a copy of "Deepwater Horizon". Hopefully it will do the same thing for me and I will be able to trace down the reason why the first M2TS didn't encode.

[gonca]

jdobbs

If you want me to run some tests on my copy, I'll be glad to help

[jdobbs]

jdobbs

If you want me to run some tests on my copy, I'll be glad to helpThanks, I appreciate it. But it's really something I have to trace through the code.

[gonca]

Ok
On the plus side, its a decent movie

[jdobbs]

Ok
On the plus side, its a decent movieYeah, pretty good, I saw it at the theater.

[bluesnow]

I ran BD-RB one more time with FORCE_ENCODE=1 then ran MakeMKV on the result. There were no errors this time, all went as usual. I presume not encoding the first stream is the root cause of the original errors?

I have this line in the INI file now. If I leave it there I won't run into this particular problem again, but are there occasions or conditions where I shouldn't have it? When would I not want to re-encode?

[jdobbs]

I have this line in the INI file now. If I leave it there I won't run into this particular problem again, but are there occasions or conditions where I shouldn't have it? When would I not want to re-encode?It's unusual. But sometimes (rarely) you may be targeting a BD-25 -- and the original will fit intact without reencoding. In that case it would be better to disable it, as it's better to keep the original when you can. If you are outputting to ALTERNATE formats you pretty much always encode. I personally leave it on and only disable it (by putting a # in front of the setting and commenting it out) when I think the original may fit with only audio reencoding.

[bluesnow]

Makes sense, thanks.