DGIndexNV Chokes on Blu-Ray Extracted AVI

[CarlEdman]

I recently ran into problems with DGIndexNV 2046 (64-bit, running on Windows 8.1).

When trying to DGIndex a particular AVI file, DGIndexNV will on load repeatedly report errors of the form "NALU type (0|15|14|23), len <xxx>, ignore NALU, moving on," eventually going to "data partitioning not implemented," then "NALU type 18" errors. Ignoring all these errors and trying to save the project results in DGIndexNV crashing.

This is unlikely to be a DGIndexNV problem (which I've used successfully thousands of times on the same system), but rather a broken AVI. At the same time, the AVI plays just fine (e.g., in PotPlayer) and comes from a widely commercially distributed Blu-Ray I own and wanted to back up to my home server.

Can anyone offer any advice? I'd be happy to share the AVI except that at 30 gigs that may not be practicable.

[Selur]

Can anyone offer any advice?
try ffmpegsource or libavsource instead (even avisource might be an option assuming the right vfw codecs are installed)

[Guest]

DGDecNV does not support AVI files! Use your original bluray files. Why would you transcode them to AVI? And how did you do that anyway?

Frankly, this is sounding like rule 6 material, because your scenario makes no sense.

[CarlEdman]

DGDecNV does not support AVI files! Use your original bluray files. Why would you transcode them to AVI? And how did you do that anyway?

I very much appreciate hearing from the horse's mouth about DGIndex functionality, but in this case is it possible you might be mistaken?

I extract my Blu-Rays using the current version of MakeMKV and then, from the resulting MKVs, I extract the tracks for separate processing using the current version of mkvextract. Video tracks from different of my Blu-Rays end up in various formats, including .264 and .avi. And for all the resulting .avis, including some from the same Blu-Ray, dgindexNV works just admirably.

Frankly, this is sounding like rule 6 material, because your scenario makes no sense.

That's not fair. Nothing I've done or said has anything to do with warez or was even downloaded. :confused:

[Guest]

Video tracks from different of my Blu-Rays end up in various formats, including .264 and .avi. And for all the resulting .avis, including some from the same Blu-Ray, dgindexNV works just admirably. I assure you as the author that DGDecNV does not support AVI files.

That's not fair. Nothing I've done or said has anything to do with warez or was even downloaded. As I said, transcoding first to AVI makes no sense and suggests you only have the AVI material. Why would you put things in an AVI and then try to index that, when you could index the original blu-ray files? How did your stuff "end up" in an AVI? And if you have extracted the ES from an MKV, you can directly index that, or even index the MKV directly; there is simply no reason whatsoever to first put it in an AVI.

[LoRd_MuldeR]

Well, what exactly was the process from the original BD source to the AVI file you have now? How did you end up with an AVI file? :confused:

Did you re-encode the video or just remux the original H.264 streams? In the latter case, use AVI-Mux GUI (http://www.alexander-noe.com/video/amg/#download) to extract the "raw" streams from the AVI file and DGIndexNV should read them fine.

[CarlEdman]

I assure you as the author that DGDecNV does not support AVI files.

I'd attach a dgi file that I just made off an avi that lists the avi file prominently on top and which worked just fine. Unfortunately even zipped it is over 600 kByte, above the 300 kByte attachment limit for the forum.

As I said, transcoding first to AVI makes no sense and suggests you only have the AVI material. Why would you put things in an AVI and then try to index that, when you could index the original blu-ray files? How did your stuff "end up" in an AVI? And if you have extracted the ES from an MKV, you can directly index that, or even index the MKV directly; there is simply no reason whatsoever to first put it in an AVI.

I did not do any transcoding or even re-muxing. My process is very simple and uses only widely available tools: (1) extract the movie files from the Blu-Ray using MakeMKV and (2) extract all of the tracks for separate processing using the current mkvextract. That sometimes results in an avi without any further processing, transcoding, muxing, or other shenanigans on my part.

Also why would I--a paying user of DGIndexNV--post about some warez file here contrary to the forum's rules and under my own real name?

[Guest]

People do goofy stuff all the time, like rename VOBs to MPGs. So maybe DGDecNV can appear to open an AVI. That doesn't mean it is supported and will work fully correctly.

mkvextract will create the output container based on the stream type. The possible bluray stream types never get put into AVI files. So please tell us the process you used specifically to have mkvextract put a bluray stream into an AVI.

[Guest]

I'm wondering if you are specifying the .avi extension with mkvextract and that is ignored, so that what you think is an avi file is really not. From the docs:

"The decision about the output format is based on the track type, not on the extension used for the output file name."

So possibly you made what you think is an avi but it is really an ES. That would explain why DGDecNV can work with it, because DGDecNV ignores the extension and detects the file type. What happens when you load the AVI in VirtualDub? Can you give us a link to one of these AVIs?

[CarlEdman]

I'm wondering if you are specifying the .avi extension with mkvextract and that is ignored, so that what you think is an avi file is really not.

That is quite possible. The home-written script I use to disassemble the mkvs looks at the video codec stated in the output of 'mkvmerge --identify-verbose' to determine the extension it uses for the intermediate video file. It currently maps as follows:

codec == 'V_MPEG2' ==> extension = 'mpg'
codec == 'V_MPEG4/ISO/AVC' ==> extension = '264'
codec == 'V_MS/VFW/FOURCC, WVC1' ==> extension = 'avi'

To be honest, I do not recall how, years ago, I selected that mapping to extension avi; probably it was the MS and VFW in the codec description that led me to guess that. All I can say for sure that both the intermediate files with avi extension have always played correctly in all players I've tried and decoded correctly using dgindexnv.

If that is not the correct extensions with this identified video track codec, I'd happy to change it if somebody can tell me the correct one.

But it remains that, as neuron2 points out, dgindex does not care what extension is used and on this one particular file I recently tried to back up, I get a lot of errors, as described in the original message.

[CarlEdman]

So possibly you made what you think is an avi but it is really an ES. That would explain why DGDecNV can work with it, because DGDecNV ignores the extension and detects the file type. What happens when you load the AVI in VirtualDub?

That is probably it. Those "avi"s do not load in VirtutalDub, claiming an unknown "WVC1" "decompressor", rather than "VFW."

Can you give us a link to one of these AVIs?

I'd be happy to, but the one I have at hand is about 30 gigs which is probably too much for most people. I can give you the mediainfo though (see below).

General
Count : 259
Count of stream of this kind : 1
Kind of stream : General
Kind of stream : General
Stream identifier : 0
Count of video streams : 1
Video_Format_List : VC-1
Video_Format_WithHint_List : VC-1 (Microsoft)
Codecs Video : VC-1
Complete name : Red Cliff () HD pt. 1 T01.avi
File name : Red Cliff () HD pt. 1 T01.avi
File extension : avi
Format : AVI
Format : AVI
Format/Info : Audio Video Interleave
Format/Extensions usually used : avi
Format profile : OpenDML
Codec : AVI
Codec : AVI
Codec/Info : Audio Video Interleave
Codec/Extensions usually used : avi
File size : 30040145608
File size : 28.0 GiB
File size : 28 GiB
File size : 28 GiB
File size : 28.0 GiB
File size : 27.98 GiB
Duration : 8724975
Duration : 2h 25mn
Duration : 2h 25mn 24s 975ms
Duration : 2h 25mn
Duration : 02:25:24.975
Overall bit rate : 27544051
Overall bit rate : 27.5 Mbps
Stream size : 3583517
Stream size : 3.42 MiB (0%)
Stream size : 3 MiB
Stream size : 3.4 MiB
Stream size : 3.42 MiB
Stream size : 3.418 MiB
Stream size : 3.42 MiB (0%)
Proportion of this stream : 0.00012
File creation date : UTC 2013-12-15 07:50:58.364
File creation date (local) : 2013-12-15 02:50:58.364
File last modification date : UTC 2013-12-15 07:55:58.824
File last modification date (loc : 2013-12-15 02:55:58.824
Writing application : mkvextract 6.6.0

Video
Count : 146
Count of stream of this kind : 1
Kind of stream : Video
Kind of stream : Video
Stream identifier : 0
Format : VC-1
Codec ID : WVC1
Codec ID/Hint : Microsoft
Codec : WVC1
Codec : VC-1
Codec/Family : VC-1
Codec/Info : Microsoft
Codec/CC : WVC1
Duration : 8724975
Duration : 2h 25mn
Duration : 2h 25mn 24s 975ms
Duration : 2h 25mn
Duration : 02:25:24.975
Bit rate : 27540766
Bit rate : 27.5 Mbps
Width : 1920
Width : 1 920 pixels
Height : 1080
Height : 1 080 pixels
Pixel aspect ratio : 1.000
Display aspect ratio : 1.778
Display aspect ratio : 16:9
Frame rate : 23.976
Frame rate : 23.976 fps
Frame count : 209190
Resolution : 24
Resolution : 24 bits
Bits/(Pixel*Frame) : 0.554
Stream size : 30036562091
Stream size : 28.0 GiB (100%)
Stream size : 28 GiB
Stream size : 28 GiB
Stream size : 28.0 GiB
Stream size : 27.97 GiB
Stream size : 28.0 GiB (100%)
Proportion of this stream : 0.99988

[Guest]

OK, without an actual file I cannot tell what your "avi" file actually is. So let's speculate as follows:

Most of the time you have had AVC blu-ray stuff and although you specified an avi extension, mkvextract actually made an AVC ES but named as .avi. That is why it works in DGDecNV. But for VC-1 blu-rays, mkvextract really makes an avi file. That avi file won't open in DGDecNV because actual avi files are not supported. And it won't open in VirtualDub because you lack a suitable decompressor for VC-1 in AVI. For these VC-1 files, you can just index the MKV directly using DGIndexNV. Or even demux using DGIndexNV itself if you really need a VC-1 ES.

Any loose ends?

And sorry about the rule 6 confusion. There were some red flags flying but after these clarifications they are explained.

[CarlEdman]

Thanks for the help from people on the forum!:thanks:

I'm still not sure why this one "avi" did not work with dgdecodenv, while all other's I've had (including one from the second half of the same movie with identical mediainfo) did. But thanks to the advice here, I was able to force it to work with FFVideo() as input filter and all is good.

[MeteorRain]

I was able to force it to work with FFVideo() as input filter and all is good.

May I ask why you are so keen on remuxing m2ts (which DGDec loves) into something like AVI (which DGDec never eats).

I hope it's not too hard for you to Start DGDec, open the m2ts file, and create a project file by a single click.:D

[CarlEdman]

May I ask why you are so keen on remuxing m2ts (which DGDec loves) into something like AVI (which DGDec never eats).

I hope it's not too hard for you to Start DGDec, open the m2ts file, and create a project file by a single click.:D

That was a bit of a misunderstanding. I hate avi files and won't touch them with a ten-foot pole unless I have to. I'll use basic streams and mp4 or mkv containers whenever I can.

The files I was talking about had an "avi" extension because that is what the identification suggested, quite likely incorrectly, by the identification of the mkv track.