Problem Encountered with Redistribution

[rcubed]

Hi, (probably @jdobbs)

Thought this might be of interest.

I recently tried re-encoding a DVD with DVD-RB Pro with redistribution specified. I've been using redistribution for a while now with no problems. For this video the process proceeded normally, but HCEnc hung in the redistribution step (Phase I) on segment 24. (see attached processor utilization system is AMD5600+ X2 w 2G ram) This has occurred on two machines and with two different rips as source. :eek: I've tried both HC023 and 022.1 with similar results. The video was preprocessed in VobBlanker to remove unwanted "stuff".

If the video is processed w/o redistribution the process runs to completion w/o problems. Shrink also processes it w/o problems. Loading the video (source to DVD-RB) in PGCEdit produces no error messages.

Changing the % for extras changes the point at which HCEnc hangs processing that segment. Based on two values 10% and 25%, the process hangs earlier with the higher percentage. Processor usage is still high when the hang occurs (see attached utilization). Aborting the encode exits w/o problems. The error occurs on segment 24 of 45 in the main video.

The error is repeatable and I can supply additional information if it will be of help. Currently I'm not sure what to supply. Turning redistribution off seems to cure the problem.

I'll attach the screen shots (Hc022.1 and HC023) at the hang point, utilization at the hang point, as well as the avs, flg, and ecl files from the work folder (after aborting).

And here is the log (the long Phase I prep time listed was due to the hang, I didn't cancel it for quite a while - this was last night's try)

********************** DVD-RB Pro Log *********

[20:58:34] Phase I, PREPARATION started.
- DVD-RB v1.27.3
- AVISYNTH 2.5.7.0
- HC v0.23.0.0 encoder selected
- "Steal Space from Extras" mode (10%) is enabled.
- Source: xxxxxxxxxxxxxxxxxxxxxxxxxx - named removed
- VTS_01: 3,114,439 sectors.
-- Scanning and writing .D2V & .AVS files
-- Processed 290,014 frames.
-- Building .AVS and .ECL files
- VTS_04: 247,997 sectors.
-- Scanning and writing .D2V & .AVS files
-- Processed 23,092 frames.
-- Building .AVS and .ECL files
- Reduction Level for DVD-5: 62.5%
- Overall Bitrate : 3,040/2,432Kbs
- Space for Video : 3,877,034KB
- Redistributing using Base_Q: 41
- Aborted, no REDISTRIBUTION.
- Movie improvement from extra reduction = .8%
- HIGH/LOW/TYPICAL Bitrates: 2,454/2,188/2,432 Kbs
[23:51:52] Phase I, PREPARATION completed in 173 minutes.
Aborted.

******************** end of log ******************

Thanks,

rcubed

[jdobbs]

Can you post the REDISTRIBUTION.TXT file? The only thing I can imagine is that HC is having problems meeting one of the newly calculated bitrates. How long did you let it run in what appeared to be a "hung" state?

[rcubed]

jdobbs,
Thanks for the quick reply.

Can you post the REDISTRIBUTION.TXT file?

I can find no REDISTRIBUTION.* file anywhere on the computer after running the encode and aborting. I just ran another case that did work and there was a REDISTRIBUTION.TXT file produced. Apparently aborting results in no file being produced. I'll try another approach - see following paragraphs.

How long did you let it run in what appeared to be a "hung" state?

Normally the point at which the processor starts working on the segment that hangs is about 10-15 (or less) minutes. In the one case I mentioned I didn't abort it until 173 minutes.

I tried the following: At the point HCEnc "hung" I went into the process window and ended HCEnc. Processing resumed, however, segment 38 also "hung" I ended HCEnc again, and the video ran to completion. I didn't do a screen capture of that segment, but it had hung at 79% I believe it was also at frame 570 (not totally sure). If I would be of help I can rerun and do a screen capture for that segment. Anyway I am including the _REDIST avs and ecl files for segments 24 and 38 copied from the DVD-RB D2AVS folder at the hang point(s) prior to ending HCEnc, plus the DVD-RB log, REDISTRIBUTION.TXT, , plus Rebuilder.ecl and inf files for this case at completion. Hope it helps. I'll keep all the files from the work folder for a while (I've got 1TB of HD space at the moment I don't have it filled up with "crap" :p).

This looks like what we used to refer to as "interesting" - back when I was working and doing hardware debug (the good old days) :eek:

If there is anything else I can supply please let me know.

As always I appreciate the time you take to look at problems. Much thanks :thanks::thanks::thanks:

rcubed

PS
We were getting thunderstorms, fortunately the power didn't do off in the middle of the re-encode so I got the data :) (I'm still mulling over getting an UPC - wife might kill me if I guy another "toy").

[dialysis1]

REDISTRIBUTION.TXT should be in the D2VAVS folder.

[rcubed]

REDISTRIBUTION.TXT should be in the D2VAVS folder.

Dialysis,
Thanks, it will be in the D2VAVS folder unless the process is aborted during the redistribution stage.

My previous post indicated that by ending the HCEnc process when it became hung during the redistribution processing DVD_RB continues to process and goes to completion and the REDISTRIBUTION.TXT file is written to disk as expected.

Apparently it is built internally to DVD-RB (or at least not visible) until it is written to disk following the redistribution phase completion. jdobbs would have to confirm this.

rcubed

[jdobbs]

But, if the REDISTRIBUTION process is aborted -- you should start the PREPARE phase over again. Otherwise you will end up with Rebuilder "thinking" the encode has been redistributed when it has not. The results would be unpredictable. There should never be a time that you have REDISTRIBUTE checked and there is not REDISTRIBUTION.TXT file.

[rcubed]

jdobbs,

But, if the REDISTRIBUTION process is aborted -- you should start the PREPARE phase over again. Otherwise you will end up with Rebuilder "thinking" the encode has been redistributed when it has not. The results would be unpredictable. There should never be a time that you have REDISTRIBUTE checked and there is not REDISTRIBUTION.TXT file.

I was trying to point out in the case (under discussion) where HCEnc hung and prevented the redistribution phase from completing, there was no REDISTRIBUTION.TXT file produced. Aborting terminated DVD-RB with no REDISTRIBUTION.TXT being produced. Apparently it is written to D2VAVS when the phase finishes normally.

For the files I supplied in post 3 the only way I could get a REDISTRIBUTION.TXT file generated to post was to force the HCENC process to terminate using Windows Task Manager. As I mentioned in that post HCEnc hung on two segments.

I was not trying to suggest that a solution to the problem was to do either method. However, disabling redistribution and re-doing the re-encode ran to completion.

Were the files I supplied in post 3 of any use, in light of the fact that I had to terminate HCEnc to get the re-encode to continue? Is there any additional info I can supply?

Thanks, again!!!

Cuber

[jdobbs]

Ok... I misunderstood. I should have noticed the filename in the encode. So it is in the REDISTRIBUTION process that it is hanging, then. I thought it was in the ENCODE phase after redistribution. Can you post the contents of V010024_REDIST.AVS? You have to grab it while the process is hung.

Also, can you try opening the file directly with MS Media Player? That might help point to whether the problem is in AVISYNTH or HC.

[rcubed]

Ok... I misunderstood. I should have noticed the filename in the encode. So it is in the REDISTRIBUTION process that it is hanging, then. I thought it was in the ENCODE phase after redistribution. Can you post the contents of V010024_REDIST.AVS? You have to grab it while the process is hung.

Also, can you try opening the file directly with MS Media Player? That might help point to whether the problem is in AVISYNTH or HC.

jdobbs,


Yes that is correct, the process hangs in the redistribution process.

The files you requested were already in the zip file from post 3.

In that zip archive:

The _REDIST.AVS and _REDIST.ECL files were copied out of the D2VAVS folder at the hang point(s).

The remainder of the files were pulled from the D2VAVS file after DVD-RB had completed, NOTE it was necessary to end the HC process for segs 24 and 38 at the hang point(s) using Windows Task Manager to get DVD-RB to run to completion and get the REDISTRIBUTION.TXT file. I don't know if this will invalidate any of the info.

The V01002400001025.m2v and V01003800002012.m2v files will play in MediaPlayer, Roxio DVDMax 2.0

The V01002400001025.AVS and V01003800002012.AVS files will play in VirtDub w/o problems. (VirtDub 1.7.8 Build 28346).

The V010024_REDIST.AVS and V010038_REDIST.AVS files hang when played in VirtDub at the following frames:

Seg 24 at Frame 524 (0:00:21:855) out of 570 frames
Seg 38 at Frame 479 (0:00:19:978) out of 495 frames

VirtDub for these two cases must be terminated using Windows Task Manager.

From this I would conclude the problem is associated with something related to AviSynth not HC.

Just in case I have included the GSpot PNGs for both the 24 and 38 m2v files.

Thanks again for looking at the problem. If you need any additional information let me know. :thanks:

rcubed

[jdobbs]

The files you requested were already in the zip file from post 3.Ok. I didn't see those the first time I looked.

The V010024_REDIST.AVS and V010038_REDIST.AVS files hang when played in VirtDub at the following frames:

Seg 24 at Frame 524 (0:00:21:855) out of 570 frames
Seg 38 at Frame 479 (0:00:19:978) out of 495 framesExactly why I need to see it... What happens if you uninstall AVISYNTH 2.57 and install AVISYNTH 2.56?

[rcubed]

Ok. I didn't see those the first time I looked.

Exactly why I need to see it... What happens if you uninstall AVISYNTH 2.57 and install AVISYNTH 2.56?

Jdobbs,
I tried AviSynth 2_56 (shows as 2.5.6.0 in DVD-RB log) and 2_58 RC2 (latest on AviSynth site - shows as 2.5.8.0 in the DVD-RB log) with same result.

Hangs in same segments on REDISTRIBUTION step.

The two seg 24 and 38 _REDIST.AVS files hang when played in VirtDub at same points as before. :-(

I used the same procedure to run DVD-RB with the exception that I canceled (aborted) when the process had gotten to Phase II and the 1st two segments had been encoded (just to save time).

Just to be on the safe side I reinstalled DVD-RB Pro and retried with AVISYNTH 2.56 and 2.58 RC2 same result.

Any additional info you would like or something else you want me to try? Again thanks!:thanks:

Cheers,

rcubed

[blutach]

Hi cuber,

To see if its something wrong with the streams, demux and remux with muxman. Muxman is terribly compliant and if the remux works OK, then you have greater confidence in the source.

Also, and I don't know if this has anything to do with it, but that Base Q is very high.

Regards

[rcubed]

Jdobbs,
I tried Les's suggestion demuxed/remuxed the main movie and the remux video result processed w/o problems in DVD-RB with REDISTRIBUTION. (Used DGIndex for demux and MuxMan for remux, I put the chapters into the remux by extracting them from the original files using PGCEdit). Each segment processed w/o any hangs.

There must be something strange about the source which is not obvious. It still seems strange that the movie processed properly w/o REDISTRIBUTION. :confused:

Thanks for taking the time to look at this. Not sure where we go from here. :thanks:

rcubed