how to deal with this HD stream...

[Xayd]

I've got a HD recording that has an interesting set of problems, i'm attempting to encode it to XviD.

1) the source is 29.97 film, so i would assume film with pulldown enabled, dgindex reports it to be 99% film. it has a 2 channel AC3 audio track.

2) the first GOP is open, so AVISynth is a no-go, trying to frameserve this video with either dgindex or dvd2avit3 causes massive video corruption (nothing but green blocks), so i'm trying to demux it and encode with the demuxed video/audio streams as the sources.

The problem is, the demuxed streams play fine and any player properly plays them back with the pulldown enabled for a framerate of 29.97 fps. Virtualdub on the other hand sees it for what it thinks it is, film, and in matching the framerate to 23.976, shortens the duration of the video when I import the demuxed stream to make it roughly 30 minutes shorter than the audio stream.

I also tried ProjectX to demux it, but it choked on the stream entirely and dropped almost every GOP, shortening both streams to less than 5 minutes.

Is there a way around this problem?

[neuron2]

The open GOP should not cause a problem with DGMPGDec. Any corruption you are seeing should be fixable. Please upload a fragment of the stream that shows the problem to my FTP server and tell me the file name here. 50-100MBytes of the start of the stream should be enough.

How did you demux the video?

[Xayd]

I've tried both dgindex and ProjectX to demux it. ProjectX for some reason wanted to drop almost every GOP and resulted in a 5 minute in duration output for each stream. dgindex seems to demux it ok tho.

any variation of dvd2avi gives a warning when opening the video stream (or the transport stream) about the first GOP being open indicating that it "may not be decoded properly".

when i tried to frameserve it with DVD2AVIT3 i was using...


Loadplugin("C:\Program Files\AviSynth 2.5\plugins\undot.dll")
Loadplugin("C:\Program Files\AviSynth 2.5\plugins\mpeg2dec3.dll")
LoadPlugin("C:\Program Files\AviSynth 2.5\plugins\decomb521.dll")
LoadPlugin("C:\Program Files\AviSynth 2.5\plugins\simpleresize.dll")
mpeg2source("C:\tv.d2v")
Telecide(order=1,guide=1,post=0)
FDecimate()
crop(0,0,0,-8)
UnDot()
simpleresize(1280,720)

which resulted in the screen full of green blocks.

there's a 2 minute sample from the beggining going up now, the video is 1920x1080 + the typical 8 grey pixels at the bottom, which is odd in itself since 1080 would suggest that it's interlaced as most HD broadcasts are. should be done uploading in about 45 minutes. the original had 2 audio tracks (german at pid 21, english at 22, video is 20), but both seem to play ok after being demuxed, so i don't think that matters in this problem.

thanks for the reply/help.

[neuron2]

Downloading now...

[neuron2]

I used DGIndex 1.4.0. I made the project with "Honor Pulldown Flags". I then served the video using DGDecode.dll into VirtualDub. Everything worked perfectly. There was no corruption.

Please explain to me how you make the problem occur with DGMPGDec. I'm not interested in debugging DVD2AVIT3.

[GaveUp]

I don't know if this is the same problem Xayd is having, but I've experience a similar green problem a number of times. My guess is there's a buffer problem somewhere that triggers the problems as if you try to scan the 'corrupt' stream it will crash dgindex. I've found, though, that it doesn't seem to be a characteristic of any particular stream. Sure, there are streams that cause the problem to occur more often (like one with corruption at the start), but any stream seems to be able to cause the error. The best/most reliable way I've found to reproduce the bug is to drag/drop a TS into dgindex. More often than not, this will cause the issue to arise.

Also, should note that this isn't a problem that only appears in just DGIndex. I've had it pop up in all the TS capable dvd2avi's.

[neuron2]

Do you see the corruption when doing preview in DGIndex, or only when serving through DGDecode?

I almost always use drag-and-drop, and I've never seen this problem. There's no obvious difference between drag-and-drop and normal file opening that could account for this.

Waiting for a VOB that shows the problem...

[GaveUp]

It's in dgindex. When it occurs if you try to browse the timeline or save the project it will crash. I've never had the problem with vobs, only with TS. Of course, I rarely work with vob's so that could just be luck. Next time I encounter the problem, or get free time, I'll try to track down more info.

[Xayd]

aha!

I didn't know there was a 1.4.0 with these settings, i was using a 1.3 version that came with autogk which does not have these options for honoring and ignoring pulldown flags.

i'll give it another shot with the new version, thanks.

[neuron2]

i was using a 1.3 version that came with autogk which does not have these options for honoring and ignoring pulldown flags. They're just renamed:

honor pulldown flags = None
ignore pulldown flags = Raw
force film = Force FILM

Anyway, I doubt that the field operation is relevant.

[Xayd]

i was posting more about the demuxing issue with the video duration than the corruption issue. since virtualdubmod will take an mpeg 2 file and i only use SimpleResize, telecide and decimate it doesn't really matter to me whether i give virtualdubmod the file directly or frameserve it, those filters exist on both.

but either way what filters did you use on that clip (if you remember), where was I going wrong to cause the nasty corruption?

[neuron2]

i was posting more about the demuxing issue with the video duration than the corruption issue. since virtualdubmod will take an mpeg 2 file and i only use SimpleResize, telecide and decimate it doesn't really matter to me whether i give virtualdubmod the file directly or frameserve it, those filters exist on both. VirtualDubMod does not properly handle pulldown flags. It ignores them! That is why it is better to frameserve using DGDecode. You can also try using VirtualDub MPEG2 because its latest version properly handles pulldown flags. Either way, you'll need to apply IVTC if you want to make progressive output. If possible it's best to use Force Film in DGIndex. With 99% film, force film will work very well. IVTC in VirtualDub is not the greatest.

but either way what filters did you use on that clip (if you remember), where was I going wrong to cause the nasty corruption? I didn't use any filters. You should try that and then add the filters one by one to see if they cause corruption.

[Xayd]

didn't know that about virtualdub, that's my problem with the duration issue then.

i'll give it another try, thanks for the help.

[jk]

I have two issues, and I am hoping that someone (hopefully DG) will be able to help me, at least with the first one.

1) I have a set of .tsp files that I copied to my hard disk from my DishNet DVR-625. Some of these work very well with DGIndex 1.4.0. Some others result in screen full of Green blocks. I have seen a few threads on this forum about Green blocks, but they all pertain to VOB files. Mine is with .tsp files. Here's what I do to reach the Green blocks screen. Filename used is an example.

- I run DGIndex
- From File -> Open, highlight es8014.tsp, and click on Open
- On the File List window, click on OK
- DGIndex program runs for a few seconds, and then a pop-up error message is displayed, that says "WARNING! Opening GOP is not closed. The first few frames may not be decoded correctly."
- I click on the OK button on the error message window, which closes it.
- A couple of seconds later, the DGIndex screen filled with Green blocks, except for a few blocks along the top edge. All menu items are enabled except the "Stream" menu.

This happens with several of my .tsp files. How can I solve this?


2) The second issue is with files that I have successfully demuxed. I have a few .mpa and their corresponding .m2v files that I created through DGIndex. I run these, in pairs, through DVDPatcher (only the .m2v) and IFOEdit (both files, specifying the audio delay), to make short DVD scenes. Upto this point, everything works fine. Now, I also wish to combine VOBs, and make chapters in the combined VOB. (I have successfully made chapters in the uncombined individual VOBs, using CellTimes.txt) The methods that I have used in IFOEdit, to do this, gives me the error "INTERNAL ERROR: additional data required but no free space in input buffer". (I can give the exact steps that I follow, but I believe that this is a known issue, and I am hoping that someone already knows the way around.) When the DVD authoring is finally completed, the it plays without audio except for the part that corresponds to the first of the combined VOBs. I had noticed that the audio delays for the individual VOBs were different. Is that the reason why in the combined video, only the audio that corresponds to the first VOB (first in the set of smaller VOBs that I combined) played, and the rest didn't play?

Thanks in advance.

JK

[neuron2]

@jk

Regarding the files with the green blocks...

1. Can they be played in any other application?
2. Are you sure they are not encrypted?

Cut a piece up to 100MBytes in size, upload it to my server, and then notify me by PM of its filename. I can't help you without a stream sample. Do it fast, because I'm about to release a new version.

[dlight]

I've got a HD recording that has an interesting set of problems, i'm attempting to encode it to XviD.

1) the source is 29.97 film, so i would assume film with pulldown enabled, dgindex reports it to be 99% film. it has a 2 channel AC3 audio track.

2) the first GOP is open, so AVISynth is a no-go, trying to frameserve this video with either dgindex or dvd2avit3 causes massive video corruption (nothing but green blocks), so i'm trying to demux it and encode with the demuxed video/audio streams as the sources.

The problem is, the demuxed streams play fine and any player properly plays them back with the pulldown enabled for a framerate of 29.97 fps. Virtualdub on the other hand sees it for what it thinks it is, film, and in matching the framerate to 23.976, shortens the duration of the video when I import the demuxed stream to make it roughly 30 minutes shorter than the audio stream.

I also tried ProjectX to demux it, but it choked on the stream entirely and dropped almost every GOP, shortening both streams to less than 5 minutes.

Is there a way around this problem?

I see these same things but I end up with gradually out-of-sync audio. I too have tried PX but with no luck. I also tried encoding then re-muxing later with no luck.