DGMPGDec 1.4.9 Final

[neuron2]

http://neuron2.net/dgmpgdec/dgmpgdec149.zip

1. Made AC3 parsing more robust by making audio data less likely to erroneously emulate a sync byte. Rare AC3 streams that couldn't be parsed are now handled correctly.

2. Changed the running time line at the bottom of the Parse D2V output so that it now includes fractions of a second.

3. Added additional MPEG syntax error checking to improve the robustness and error recovery. This fixes one reported stream that showed excessive macroblocking on one type of syntax error due to corruption.

4. Fixed an error in random frame access in the presence of RFF flags.

5. Added the PCR for transport streams and the SCR for program streams to the 'Log Timestamps' dump.

6. DGIndex can now automatically set the PIDs on file open for streams that lack PAT/PMT tables. If the PAT/PMT tables are absent, DGIndex falls back to using raw PID detection and sets the first audio and video PIDs seen in the stream.

7. The __aud__ variable in the AVS template now uses the first audio track found instead of the last.

8. 204-byte transport packets are now supported.

9. The info dialog now includes a stream type field.

10. If an exception occurs during processing, a message box pops up and allows the user to choose to continue or to abort.

11. The D2V file version is bumped to 16.

12. The AVS template path now defaults to a file called "template.avs" in the same directory as DGIndex.exe.

13. Fixed a bug in INI file loading that caused some parameters to be read incorrectly.

14. An error popup now appears if the user attempts to execute "Demux Audio Only" when the audio method is set to "Decode AC3 Track to WAV".

15. Fixed a bug in relative path handling that crashed DGIndex when "Load Project" was performed.

16. Revised the track selection interface to be more user friendly.

17. Added support for frame repeats. These are increasingly being found in 720P streams.

18. Added two new fields to the info dialog: number of frame repeats, and number of field repeats.

19. The Correct Field Order option is removed and the field order correction function is now available through the Tools menu.

20. A first attempt has been made to add a progress percentage field to the DGIndex window title bar.

21. When in CLI mode, DGIndex no longer grabs the foreground focus and beeps at the end of a Save Project operation.

22. Fixed a bug in the LumaYV12() filter (part of DGDecode) that could cause a crash in some circumstances.

23. Adding checking for audio file names to not be already open in another application before trying to demux to them.

24. Added a new tool in the Tools menu: Analyze Sync.

25. Revised the indexing code to support the case where an indexed unit (especially packs) might contain more than one I frame. Previously random navigation in DGDecode failed for this rare scenario.

26. Fixed a bug that caused DGIndex to sometimes use 601 colorimetry in the preview window and when doing Save BMP when 709 should have been used. The Info Dialog was correct, however.

27. Added support for M2TS (Blueray Disk MPEG2) files.

28. The reporting of matrix coefficients was off by one GOP so if they changed, one GOP would be reported wrongly. Fixed.

29. Multiple __vid__ and __aud__ per line are now supported in AVS template files.

30. Audio-only demuxing of LPCM audio was fixed.

31. Making a range that cuts from the start failed for some program streams. Fixed.

32. Added support for demuxing LPCM from M2TS (Blu-Ray) files. Note that the raw PCM is demuxed (same as xport.exe). You must use an audio processor, such as sox.exe, to repackage it as you want it (typically as a WAV file). Refer to the DGIndex Users Manual for instructions in that regard (Audio/Output Method section). PID detection and the Info dialog are supported for this new audio type. Thanks to drmpeg for showing the way with xport.exe.

33. Added a warning pop-up to notify the user that a field order transition was detected.

34. Added the __del__ keyword for Avisynth templates for generating the audio delay in DelayAudio(__del__).

[Adub]

Wow, I didn't even realize that I hadn't updated yet, and here you are crunching out another. Rock on, neuron2!

[unskinnyboy]

Thank you. Updating right away!

[neuron2]

My previous fix for random access in the presence of RFF flags was incorrect (and in fact a significant regression). Beta 4 fixes it properly (I hope). Do not use 1.4.9 Beta 3!

http://neuron2.net/dgmpgdec/dgmpgdec149b4.zip

[SeeMoreDigital]

Hi Donald,

I'm embarrassed to say I've missed this thread :o

[saulob]

neuron2, this program Rocks MY WORLD! :D

thanks.

[neuron2]

This version adds the PCR (for transport streams) and SCR (for program streams) to the 'Log Timestamps' dump. The PID detection/setting dialogs now allow for the specification of the PCR PID for transport streams.

http://neuron2.net/dgmpgdec/dgmpgdec149b5.zip

[neuron2]

I'm embarrassed to say I've missed this thread Please provide an unprocessed dump of your brain contents, so that I may properly analyse your pathology.

[SeeMoreDigital]

Please provide an unprocessed dump of your brain contents, so that I may properly analyse your pathology.That would assume I have a brain to process!


Anyways.... Over in Buzzqw's AutoMKV thread a guy called FogBav posted a link to a [7.87MB] TS sample (http://forum.doom9.org/showthread.php?p=906613#post906613) that DGIndex 1.4.8 Final (and 1.4.9B5) can't automatically open...

Will analysing the contents of an erroneous TS stream satisfy you instead?


Cheers

[neuron2]

Over in Buzzqw's AutoMKV thread a guy called FogBav posted a link to a [7.87MB] TS sample (http://forum.doom9.org/showthread.php?p=906613#post906613) that DGIndex 1.4.8 Final (and 1.4.9B5) can't automatically open... The stream has no PAT/PMT tables, which specify the programs and associated PIDs. DGIndex currently looks for the first program in the PAT/PMT to get the PIDs to set automatically. So if there is no PAT/PMT, nothing can happen automatically. I could revise it to fall back to raw PID detection and then use the first video and audio PIDs seen.

I'd be curious to know, however, about the origin of this stream, because PAT/PMT is mandatory in a transport stream.

[SeeMoreDigital]

I'd be curious to know, however, about the origin of this stream, because PAT/PMT is mandatory in a transport stream.Indeed... I thought you'd be interested.

I guess it's over to FogBav ;)

[neuron2]

I've just now implemented and tested the raw PID detection fallback. It opens that stream automatically just fine. It will be in the next beta.

[SeeMoreDigital]

Many thanks... I'll let Buzzqw know. So we can test it within his proposed new build of AutoMKV.


Cheers

[mvdzwaan]

Any chance of a new feature which updates the AC3 info tag while processing ?

The window now shows 2/0 3/2 according to the first ac3 packet, but often this changes from leader to content.

[Inventive Software]

Something missing IMO is the information box with information coming up when you open a D2V file or a file that DGIndex can open, instead of having to play or preview the file to find out the key information, like whether it's interlaced and/or the field order.

[Isochroma]

First I'd like to thank the developer for this excellent tool which I use everyday!

Now on to the real business of this post: using 1.4.9b4 (the bug was not listed on the b5 changelog, so I assume it still exists in b5), I notice that even though it is set to remember to use Low priority, if it is started up and fresh files loaded and indexing is started, priority remains Normal, as observed in the Task Manager. Sometimes this happens and sometimes not.

However, if indexing is stopped and priority is switched to Normal then back to Low, it actually runs at Low. Also, it seems to regularly forget the priority setting when starting up (ie. Normal will be checked even though Low was set last sesssion). So there's definitely some bugs in the priority code.

[neuron2]

So there's definitely some bugs in the priority code. I cannot duplicate any of your reported problems. Please describe an exact sequence of steps that I can use to recreate your issue.

[Isochroma]

Ok, so first I'm using 1.4.9b4, and assuming the changelog is complete, this issue hasn't been addressed so b5 should behave the same way.

First off, the Priority has already been set to Low from a previous run of DGIndex, so the checkmark is already there.

I run DGIndex, File/Open the .TS files, hit OK on the box, and then Save Project. DGIndex start running, then I bring up Task Manager and note the it is running in Normal priority.

So I hit escape to stop the demuxing, and then go Options/Process Priority. Noting that Low is checked I now select High. Then I leave that menu by clicking anywhere else. Then I go back into the menu and select Low.

Then I save the project again, now task manager shows it running in low priority.

[neuron2]

then I bring up Task Manager and note the it is running in Normal priority. How do you note that? Where is it displayed?

[Isochroma]

First, run task manager (Start->Run->taskmgr), then click Processes tab, then if you don't see a Base Pri column, View Menu->Select Columns->check Base Priority then click OK, now you have Priority :)

[neuron2]

I still can't duplicate any of your claims. What OS are you using?

[Isochroma]

XP Pro. The problem is that even though Low priority is shown checked in the menu when DGIndex first loads (remembers previous session setting), it doesn't actually run at low priority unless the setting is reshuffled. I just tested b5 and there are no differences in behaviour.

Ah, I just tested b5 on my other machine and it remembers the priority. So something strange is definitely happening. You could send me a debug version that logs the API call to change process priority, and its result. That way we could figure out what is going wrong. My system is pretty basic, and everything else works fine, so this is probably happening to some fraction of users out there too.

Specifically, we need to know the result of the SetPriorityClass() function, whether it is zero or not. If it's not zero then we need to do a GetLastError() to find out why it is failing.

Alternately, the function call may always be succeeding, but on some systems a quirk in the code prevents priming of the Priority variable from a previous session.

---

OK, next note: I just got the bright idea to use a .bat file to start DGIndex in Low priority:

START "a" /D"C:\Program Files\AviSynth 2.5\plugins" /LOW /B DGIndex.exe

So it starts the app in low, then I do file/open, then I start browsing in the Open window for the files. As soon as I single- or double-click a folder (but not the other items), the priority resets to Normal.

Since the Open window starts with a view to my Desktop, I copied a .ts file to that location and found that just hovering the mouse over a .ts file in the Open window causes a reset to normal. In fact, if All Files is selected to be shown (*.*), hovering over any file except special items (My Computer, My Documents, Recycle Bin, shortcuts), causes the reset.

[neuron2]

Sorry, but I too have XP Pro and I cannot duplicate anything you say; everything behaves just as it should.

Is anyone else experiencing this?

[Isochroma]

It may be necessary to send a special debug version with logging to figure out what's going on.

Also, one minor bug which is probably easily fixable: when Demux Audio Only is selected, the output audio file doesn't contain the DELAY value necessary for remux, thus I always use Save Project instead.

[neuron2]

It may be necessary to send a special debug version with logging to figure out what's going on.I have limited time available. If you are the only person and it happens on only one system, I find it hard to attribute it to DGIndex.

[Isochroma]

Oh well, that's ok - I'll just use Task Manager to manually set the priority. But is it possible to put the DELAY value in the output filename when just demuxing audio?

[neuron2]

If you are just demuxing audio, the video is not examined, so the video PTS is not seen and therefore no delay value is possible. The feature is intended for use with streams that do not have video, in which case, the delay value is meaningless. If there is video, use Save Project as you stated.

[neuron2]

* DGIndex can now automatically set the PIDs on file open for streams that lack PAT/PMT tables. If the PAT/PMT tables are absent, DGIndex falls back to using raw PID detection and sets the first audio and video PIDs seen in the stream.

http://neuron2.net/dgmpgdec/dgmpgdec149b6.zip

[neuron2]

Any chance of a new feature which updates the AC3 info tag while processing ?

The window now shows 2/0 3/2 according to the first ac3 packet, but often this changes from leader to content. I'll see what I can do about it.

[Romario]

neuron2, what about H.264 TS support in your program? Can you do it for 1.50 version?

[SeeMoreDigital]

Patience, patience....

[ChronoCross]

neuron2, what about H.264 TS support in your program? Can you do it for 1.50 version?

wow a third thread where he's actually perfectly emulating KRP

[Isochroma]

Upgrading from b4 to b6 directly, I started indexing a new 1080i .ts and when done found that it was causing my simple .avs to run entirely out of memory (the avs refused to load in vdub with various out-of-memory errors, depending on the filter). For example, tfm() throws a "malloc" error, telecide() has its own message.

So I worried that it could be my system, but decided that since I'd just finished successfully with another 1080i .ts, I'd just re-test it.

So I re-indexed it using b6, taking care to preserve the .d2v from b4. Remember, I always replace all DG files in the plugins folder between version switches, and also re-index the .d2v with identical settings.

I found that the re-indexed previous .ts now no longer worked, throwing the same out of memory error. So I changed to b5, re-indexed, same error.

So I finally changed to b4 and re-indexed, and it works perfectly again!

Some change happened in b5 that broke 1080i .ts indexing, in both FF and IP modes. And I tested this on two different 1080i .ts, one of which was already verified to work with b4.

Also, I tested the newest b6 on the .d2v made by b4, and it decodes just fine in the avs script. So DGIndex is making flawed .d2v files after b4.

[neuron2]

Please diff the two D2Vs (the one that works and the one that doesn't) and tell me the results. If you can't do a diff then provide the two files.

[neuron2]

Find the line in the D2V that lists the PIDs and then delete the third PID value and the comma. Tell me if that fixes it. I may have forget to modify DGDecode to parse that (don't have the source code at work). If so, I'll make a new beta tonight with that repaired.

[Isochroma]

Will do, but I just started an encode so have to wait for it to finish before replacing DG files. Will do asap.

[Isochroma]

Here's the two .D2V files, and I can also make a small section of the .TS for you to test, but I don't remember now which tool you suggested to use for that?

Desperado.FF.D2V.Files.rar (http://isochroma.com/Testfiles/Misc/doom9/Desperado.FF.D2V.Files.rar)

[neuron2]

Here is the fixed version. Note that the D2V file format version is bumped to 14.

http://neuron2.net/dgmpgdec/dgmpgdec149b7.zip

[neuron2]

The window now shows 2/0 3/2 according to the first ac3 packet, but often this changes from leader to content. I need some test streams that have these audio format changes. Can anybody provide me with some for testing this feature? Thank you.

[Isochroma]

It pleases me greatly to report that after testing, b7 appears to function perfectly! Thanks again for the continued excellent development work on this powerful software.

[Egh]

Just a sidenote (checked in 149b7 package):

in DGDecodeManual.html, you have copyright as "2004, 2005"

in DGIndexManual.html, you have copyright as "2004-2006"

Is it intentional or have you just forgot to update the copyright notice ? :)

[neuron2]

Is it intentional or have you just forgot to update the copyright notice? Rhetoric will get you nowhere. Thanks for pointing it out. I think I'll just make it 2004-2050. That's wishful thinking on my part, of course.

[Isochroma]

I guess after the last post I should also point out that the manual "DGIndexManual.html" distributed with b7 is titled "DGIndex v1.4.8", though perhaps this is appropriate since 1.4.9 final has not yet been released.

[neuron2]

It pleases me greatly to report that after testing, b7 appears to function perfectly! Next time I'll actually test things before releasing a beta. :)

Thanks again for the continued excellent development work on this powerful software. Your contribution in testing the betas is also greatly appreciated.

[neuron2]

I guess after the last post I should also point out that the manual "DGIndexManual.html" distributed with b7 is titled "DGIndex v1.4.8", though perhaps this is appropriate since 1.4.9 final has not yet been released. Oh my Darwin, how did I do that? I'll update the ZIP file right away. Thanks!

(The only thing I can think of is that I was hung over this morning from our office Christmas party last night.)

[neuron2]

Any chance of a new feature which updates the AC3 info tag while processing ?

The window now shows 2/0 3/2 according to the first ac3 packet, but often this changes from leader to content.
On the off chance that you missed my post, I need a test stream. I have it coded but I can't release it without testing. Thank you.

[john3voltas]

Hello,
I am waaaay off topic but I just found out that the "demux audio only" can either demux or decode the audio depending on the options you set under "audio>output method>demux(or decode)".
So could you change the option name to "demux/decode audio only" in this next release and update the docs as well?

EDIT: just noticed that this is already beta 7 and soon will be entering RCs.
So at least consider my post to include in your to-do list and since this a very "minor" it can go down to the bottom of the list ;).

TIA and merry xmas to all.

[neuron2]

That's not off topic.

Very interesting. My superifcial code reading confirms what you say. I'll do some testing. If it pans out for all stream types, then I'll follow your suggestion. A new feature for zero work!

Thank you for pointing this out.

[john3voltas]

You're welcome ;).
Cheers

[SeeMoreDigital]

....I just found out that the "demux audio only" can either demux or decode the audio depending on the options you set under "audio>output method>demux(or decode)".
So could you change the option name to "demux/decode audio only" in this next release and update the docs as well?I wonder whether third party encoding tools will be able to make use of this too?!

[john3voltas]

I wonder whether third party encoding tools will be able to make use of this too?!
I've tried Aften inside BeHappy but I think I'm screwing up on something.
Can you try it on your end as well?
TIA
Cheers

[neuron2]

The WAVs that I created with Demux Audio Only do not play and appear to be invalid.

[john3voltas]

I just ran a test.
I extracted an audio stream with "save project" (while the audio output was set to "decode ac3 to wav").
And then I extracted the same audio stream but this time using the "demux audio only" (again while the audio output was set to "decode ac3 to wav").
I got two 6-channels wav files with the exact same size.
Unfortunately I can't play any of them with foobar/mpc or even media player :(.
Does someone know a player that can play extended waves?
Then I compared both files MD5 hashes and SHA1 hashes.
Bummer! They don't match :(.
Exact same size, can't play any of them and the integrity hashes don't match...
Can somebody else run a quick test just to prove that it ain't my setup or hardware?
TIA
Cheers

[john3voltas]

The WAVs that I created with Demux Audio Only do not play and appear to be invalid.
Damn, you were quicker than me :lol:.
Anyway, can you play a decoded 6-channel wave extracted with the "save project"?
I can't either :?
Cheers

EDIT:
Ok, forget it.
You are right, I can play the decoded while saving project 6-channel wav but I can't play the demux audio only 6-channel wav.
But if their size is a perfect match I would bet that you could implement that in a flash.
Of course, when you are done with every other feature/bug that you are currently dealing with.
Thanks a lot.
Cheers

[SeeMoreDigital]

Yep... The same thing happens here...

But although the WAV created using the "Demux Audio Only" method does not play in MediaPlayer Classic and cant be read by GSpot. I was able to feed it into BeLight and generate a working 2Ch AAC, Lame etc encode from it ;)

However, I get the feeling the WAV file is 2Ch not 6Ch

[johnmeyer]

Using 1.4.9 Beta 7.

I decode track 1 to WAV and create d2v. Create the AVI file from d2v. Put resulting WAV and AVI files into Sony Vegas (I've done this in both version 6.0d and 7.0c).

I have now done this with exactly ten different DVDs. These DVDs were ripped using both DVD Decrypter and also, for some, DVD Shrink. I ripped using File mode, and ripped all files.

Problem:

1. During DGIndex decoding, I often get "audio error" message.

2. With 5.1 audio, the resulting WAV file is not the same length as the video (it is almost always shorter). I can time-stretch the audio, but it is not in sync. I have also demuxed to AC-3 and noted the offset, but even offsetting the audio by this amount and then stretching doesn't work.

3. The question, of course, is whether the WAV is the wrong length, the video is the wrong length, or both. I just tried another movie that is 1:35:54 in length, as reported when played in WinDVD. However, the AVI created from the d2v file is 1:36:00, and the WAV is 1:35:59. Thus neither is correct.

4. With two-channel audio, the program seems to work.

[neuron2]

Try it again using IFO mode.

You don't need to time stretch the audio. You might need to offset it.

If you are getting audio errors then your stream is bad and that can cause sync problems. What happens if you decode the AC3 with an external decoder like BeSweet?

[johnmeyer]

--> Try it again using IFO mode.

I'll try that.

--> You don't need to time stretch the audio. You might need to offset it.

Nope. That doesn't work. I can sync at one point in the movie and then it is un-synced later (or earlier).

--> If you are getting audio errors then your stream is bad and that can cause sync problems.

Would I have a bad audio stream from ten different DVDs? I both rent and own DVDs and often put them on DVD+RW discs so I can return the DVD and view the movie at a later time, erasing the movie when I'm finished. As a result, I have temporarily backed up hundreds of movies. No problems at all. The reason I'm using this approach is that I want to do the same thing, except to iPod. If the disc has a 2-channel track, things work fine.

--> What happens if you decode the AC3 with an external decoder like BeSweet?

I'm going to try that in a moment. I just tried to demux to AC3 using this beta version, but it crashes immediately when I choose "demux audio only." If I save the project file, then it is OK. I'm doing that right now and the delay shown in the AC3 file name is 28ms which is about one frame. The audio sync problems are closer to one full second.

EDIT (added this a few minutes later)

OK, I did the IFO rip, and the audio is now exactly the correct length. The video, however, is still too long. Specifically the audio is 01:35:54.29 (the 29 at the end is the number of frames beyond 54 seconds), and the video is 01:36:00.14.

FURTHER EDIT

There are two huge glitches in the audio.

[neuron2]

File mode ripping is fraught with peril due to multiangle stuff, etc.

The slight difference in lengths is not unusual. You should be able to sync them using a proper offset. It's all about PTS timestamps, but I haven't time to discuss it in detail.

I don't know why your audio is showing errors. Are you saying all your DVDs show audio errors?

This is stable code that hasn't been touched in a long time.

Again, try decoding the audio externally to see if there is any difference.

[johnmeyer]

--> I don't know why your audio is showing errors. Are you saying all your DVDs show audio errors?

With the old DVD2AVI I never got audio errors decoding to WAV. With DGIndex (including the 1.4.8 version), I seem to get it on some, but not all DVDs. I can't remember at the moment whether the errors only happen with 5.1 AC3 or whether they happen when decoding stereo as well.

The other error I referred to were brief glitches, which show up on the timeline in Sound Forge or Vegas as a 0dB impulse (i.e., full volume) of approximately 0.037 seconds in duration. This is pretty close to 1/23.976, which is the duration of one frame.

[neuron2]

The AC3 decoding code in DGIndex is the same as the old DVD2AVI. Why don't you try the suspect stream with the old DVD2AVI?

[johnmeyer]

I don't want to take up any more of your time with this. You are nice to try to help, but since no one else is having problems, I am obviously doing something very wrong.

And I sure have tried a LOT of different things.

I just tried using the 1.4.9 Beta 7 version again, this time using the "Honor Flag" instead of "Force Film" for the video (to see if the resulting video length would match what is reported by both DVD Decrypter and WinDVD). After DGIndex was finished, I used VFAPIConv to create the AVI signpost from the D2V file (which is what I always do). However, the resulting video file is identical in length to what I got with forced film (i.e., it was about six seconds longer than it should be). However, with this approach, the decoded WAV file is only about half the length of the movie. It just truncates. Totally useless.

Since my goal in all of this is to create mp4 files for iPod, I'm just going to buy one of the "all in one" tools and do it that way. I will continue to use DGIndex (I've been using it for a long time, and DVD2AVI before it) in order to edit DVDs that I've created, using Vegas (which is totally brain-dead in dealing with MPEG-2 files, even in the latest 7.0c version). I also use Womble MPEG VCR for cuts-only editing (with no recompression), when I can do that.

Anyway, thanks for the help. If I do stumble across a way to make this work, I'll let you know.

[neuron2]

VFAPI has been deprecated for a long time.

You must be doing something wrong because Honor Pulldown versus Force Film does not affect audio decoding/demuxing. If that is really happening, we should try to get to the bottom of it.

[johnmeyer]

--> VFAPI has been deprecated for a long time.

So what should I use instead to convert to AVI? Perhaps this is the reason why the video portion of the process is coming up with the wrong length. I just did another movie which, according to DVD Decrypter and WinDVD, is 2:03:41. This is 7,421 seconds. However, the length on the Vegas timeline is 2:03:48 which is 7,428 seconds. 7,428/7,421 = 1.00094 which is almost exactly 1.001. Thus, it looks like the movie is being converted to 24 fps instead of 23.976. Here's the header from the d2v file created by DGIndex 1.4.9 Beta 7:
DGIndexProjectFile14
4
L:\THE_NOTEBOOK_4X3\VIDEO_TS\VTS_01_1.VOB
L:\THE_NOTEBOOK_4X3\VIDEO_TS\VTS_01_2.VOB
L:\THE_NOTEBOOK_4X3\VIDEO_TS\VTS_01_3.VOB
L:\THE_NOTEBOOK_4X3\VIDEO_TS\VTS_01_4.VOB

Stream_Type=1
MPEG_Type=2
iDCT_Algorithm=6
YUVRGB_Scale=1
Luminance_Filter=0,0
Clipping=0,0,0,0
Aspect_Ratio=4:3
Picture_Size=720x480
Field_Operation=1
Frame_Rate=23976 (24000/1001)
Location=0,0,3,6D573
Thus, according to the header, it is 23.976, but the actual video seems to be timed for 24 fps (although it is reported at 23.976).

So, it looks like VFAPIConv might be the problem, eh? Let me know what I should use instead (as I mentioned above). I'll poke around right now and see if I can find the right thing on my own ...

[Edit - a few minutes later]

OK, I am confused (I confuse easily). I just read the DGIndex readme and it says:The procedure is as follows:

1. Place the files as described above.
2. Run DGIndex and verify that when you pull down
the Help menu the VFAPI Plugin item is checked.
You don't have to check it; it is checked automatically
if the files are placed in the right place. Generate your
D2V project file as usual.
3. Ensure that the VFAPI reader codec is installed.
4. Run the VFAPI Converter, select the D2V
file, and hit OK.
5. Hit Convert to create the "fake" AVI file.This is what I've been doing, so I don't know what you mean when you say VFAPI has been deprecated.

[neuron2]

That is from the DGVfapi help file, not the DGIndex help file.

You should read the quick start guide included in the DGMPGDec package. The preferred path is via Avisynth, not via VFAPI.

[johnmeyer]

--> The preferred path is via Avisynth, not via VFAPI.

I use AVISynth almost every day. Unfortunately, Vegas cannot read AVS files (well, there is a VERY kludgy way via Debugmode's Wax plugin, but it doesn't always work). Vegas doesn't expose its codecs to other programs, so I can't use VirtualDub to read the AVS and then encode to MP4.

[johnmeyer]

OK, one last time. This time I tried to do everything by the book:

1. I rip the DVD ("The Notebook", a movie I own) using DVD Decrypter, in IFO mode.

2. I open the resulting VOB files in DGIndex 1.4.9 Beta 7.

3. I select "Forced Film" in the Video menu.

4. I select "Decode AC3 Track to WAV" and select Track 1 (no other tracks selected). Dynamic Range Control is Normal, Dolby Surround Downmix is Unchecked. 48->44.1 kHz is Off. Normalization is not checked. Track 1 is AC3 six channel (or 5.1, or 3:2, depending on what nomenclature you want to use).

5. Correct Field Order, Use Full Paths, and Use Directdraw Overlay are the only options checked (this is the default, I believe).

I then select Save Project [F4] and save to the d2v file. About ten minutes later I have a d2v and a WAV file.

I then follow the instructions in the readme file in the DGMPGDec package and create this AVISynth script:LoadPlugin("C:\Program Files\Video\dgdecode.dll")
mpeg2source("D:\Notebook_P.d2v")I open this in VirtualDub. In VirtualDub, I then select Audio->Wav Audio ... and select the WAV file created by DGIndex.

The movie plays and I get audio, but it is not synchronized.

So, I go to the beginning of the movie and use the "Delay Audio Track By" setting found under Audio -> Interleaving... to get the audio to be in sync. However, if I then go to any point later in the movie, the audio drifts further out of sync.

If I scroll to the end of the timeline in VirtualDub, the time at the end of the movie shows as 2:03:48, just like it did in Vegas, which is 7 seconds longer than the real length of the movie.

I spend about ten hours a day editing audio and video and most everything works as expected. Thus, while it is possible that my computer is messed up in some way, it sure isn't showing itself with other AVISynth plugins, VirtualDub plugins, Sound Forge, Vegas, or various Nero editing utilities.

Most likely it is cockpit error, which is why I provided such a detailed step-by-step description above. Hopefully someone will step forward to tell me I am an idiot, an epithet I will gladly accept if it will help me finally get this working.

[neuron2]

That looks good.

I would like you to just demux the audio and then convert it with BeSweet. Everything else the same.

If it still does that and you are keen on solving it, I'll give you my address to snail mail an ISO copy of the DVD.

You might also try another ripper, like RipIt4Me.

[neuron2]

Oh, you are not playing back the AVS to assess sync are you? You should do an encode and play that.

[johnmeyer]

--> Oh, you are not playing back the AVS to assess sync are you? You should do an encode and play that.

OK, I encoded ten seconds from the beginning, another ten from the middle, and ten more from near the end of the movie. The sync problems are identical to what I see/hear on the timeline in VirtualDub: Almost synced at the start, but then poorly synced in the middle, and then many seconds out of sync at the end.

I encoded using the MainConcept DV codec, a codec with which I have encoded literally hundreds of different projects over the past five years, and therefore whose idiosyncrasies I am know well.

[DSP8000]

Since my goal in all of this is to create mp4 files for iPod

There are so many ways how to create playable files for your iPod.
As neuron2 suggested, use besweet to do the transcoding for your audio.

Be carefull with the delay settings!!!
If you want you can try makeAVIS in ffdshow & see if that works in Vegas. You're not using the built in x264 encoder in Vegas, are you?

MeGUI will do an excellent job as well.
DVD-RB latest version adds support for mobile(iPod) usage based on ffmpeg. That may be your true one click solution.
Oh, & yes use RipIt4Me for cleaner DVD structure.

Hope this helps.
DSP8000

[SeeMoreDigital]

There are so many ways how to create playable files for your iPod.
As neuron2 suggested, use besweet to do the transcoding for your audio.Indeed...

You may want to look at AutoMKV (http://forum.doom9.org/showthread.php?t=113811)... It's a GUI that uses DGIndex, BeSweet, DelayCut and other apps to generate encodes with MPEG-4 (Part-2/Part10) video and AAC or MP3 audio into MP4 or MKV.

By-the-way, there's an audio application called BeLight (http://forum.doom9.org/showthread.php?t=85566) that can accept 6Ch AC3 streams and convert them into 6Ch AAC streams.... Without the user having to create a 6Ch WAV stream first!


Cheers

[Terranigma]

neuron2. Will you be adding this version over @ your homepage anytime soon? That's where I've been getting DGINDEX from. All This time I had no idea that there was a version 1.4.9 'til now. :)

[ultrabrutal]

I think there is something wrong with DGIndex's demuxing of AC3 tracks.

I have recorded several HD movies via sat running at 1920x1080i @ 25 fps. The TS files work fine and are in sync on PC.
I have tried both stable and beta7 of DGIndex and using the following AVS script:

LoadPlugin("DGDecode.dll")
LoadPlugin("Decomb.dll")
LoadPlugin("ColorMatrix.dll")
mpeg2source("<project>.d2v")
Telecide(guide=2,post=0)
BicubicResize(1280,544)
ColorMatrix(mode="Rec.709->Rec.601")

Using VirtualDubMod and muxing in the AC3 which was demuxed via DGIndex.
I encode to Xvid keeping the AC3 5.1 track intact.

When viewing the encode the movie plays at around three times the speed but audio is fine. Playback on Xbox freezed/goes crazy shortly after start.
When demuxing the AC3 from the encode and then adding it again, the duration of the AC3 is about one third of the movie length. This seems to be the cause of the fastforward playback.

mpeg2repair finds a shitload of problems with the TS.
AC3Fix finds a shitload of problems with the AC3.

When using the AC3Fix'ed AC3 when encoding the encode works fine initially. What happens then is at around 39:30 into the movie, the video fast forwards for about 1 second. Afterwards the audio is out of sync for the rest of the movie. This happens both with one and two passes.
The TS file does not have this problem at 39:30 and is in sync for the duration.

I have spent countless hours on getting this process to work. Now I will try to post here to see if anyone knows the problem or is capable of looking through any logs I can produce. Also willing to share the TS (14.7 gb) if anyone competent will have a look.

Tnx for the help and for a very cool application.

[ultrabrutal]

When demuxing the AC3 from the encode and then adding it again, the duration of the AC3 is about one third of the movie length. This seems to be the cause of the fastforward playback.


oh btw, when playing back the result of the remux the video plays at normal speed but ofcourse the audio stops about one third into the movie.

[jmac698]

I've had similar problems. I just use virtualdub and encode directly now.
Anyhow, neuron2, is it possible for dgindex to return the true 4:2:2 of the video?
I have a case where video is 4:2:2 which is upsized, then encoded to 4:2:0. It is also filmrate. In this case:

R=red, B=blue, M=magenta (red+blue), G=green
original frame, 4:2:2, diagram of 4lines each two pixels:
RR
BB
GG
BB
fields top, bottom:
RR BB
GG BB
4:2:0 of fields:
MM BB
MM BB
deinterlaced again:
MM
BB
MM
BB
Now we have a repeated top field, this is frame 2:
RR RR
GG GG
(an object is moving downwards in this case..)
and 4:2:0 version, frame 2:
MM MM
MM MM

ok that doesn't work... I thought there might be a way to subtract repeated fields to find a higher resolution, obviously upsampling can't be done here without motion estimation..

However, still one could take a >=2x height video, convert to yv12 (point interpolated), resize to 1x, and have proper yuy2 video recovered..

[G_M_C]

Hey neuron2, i've got a question:

I'trying to make a CD out of a Live-music DVD. The music DVD is authored so that every seperate chapter is 1 song. So in the end i hoped to use DGIndex to demux the AC3, but split up in segements relative to the chapter-number.

Is there a way to do this, or might this be a feature the would be interesting to implement ?

[TripleA]

If you use DVD Decrypter's IFO mode to rip the DVD, there is an option to split by chapter. Check under IFO in settings.

I believe even SmartRipper had a similar option, but it's been years since I last used it, may it R.I.P., so I could be mistaken.

[G_M_C]

If you use DVD Decrypter's IFO mode to rip the DVD, there is an option to split by chapter. Check under IFO in settings.

I believe even SmartRipper had a similar option, but it's been years since I last used it, may it R.I.P., so I could be mistaken.

Cool, thx for the tip. I'll give it a tryout this weekend, when i've got the time :)

[Isochroma]

Using both b3 and b7 on two different machines, with two different DVDs (one in a Daemon Tools drive, the other in an LG GSA-H22N, DGIndex closes with an error when using Demux Audio Only from selected DVD VOB files.

DGIndex terminates and on my friend's machine shows no error, while on mine, shows the Error signature window:

AppName: dgindex.exe
AppVer: 1.4.9.7
ModName: ntdll.dll
ModVer: 5.1.2600.2180
Offset: 00001010

In Event Viewer, the Application log contains an error with source DrWatson:

The application, C:\Program Files\AviSynth 2.5\plugins\DGIndex.exe, generated an application error The error occurred on 12/20/2006 @ 17:17:38.890 The exception generated was c0000005 at address 7C901010 (ntdll!RtlEnterCriticalSection)

Using Save Project, the audio is successfully demuxed on both machines; however...

The demuxed audio plays with abnormally high CPU usage in MPC using both MPC's internal decoder and ffdshow's. Also, the soundtrack has clicks every second or so.

Using SmartRipper 2.41, the same track was demuxed successfully and found to contain no clicks.

[neuron2]

Please try it with 1.4.8 and report results.

>my friend's machine shows no error

You're saying everything works fine on that machine?

If you can upload a VOB fragment that shows the problem, that will be best for me to investigate it.

[Tima]

Hi!

I have one vob located in "F:\0\From_sxe\Кооператив Ништяк - Концерт в Тюмени + Иногда они возвращаются\" :) After saving project into the folder "E:\DVD\Pr.sxe_kn_tyumen\" I get files with exactly this content:

project.d2v:
DGIndexProjectFile13
1
F:\0\From_sxe\Кооператив Ништ

project.d2v.bad:
DGIndexProjectFile13
1
F:\0\From_sxe\Кооператив Ништ

project.fix.txt:
D2V Fix Output

Field order transition: 2 -> 0
d00 1 0 1054365696 1 1 92 a2 a2 a2 a2 a2 a2 a2 a2 a2
d00 1 0 1054593024 1 1 90 b0 b0 a0 b0 b0 a0 b0 b0 a0 b0 b0 a0
corrected...
d00 1 0 1054365696 1 1 92 a2 a2 a2 a2 a2 a2 a2 a2 a3
d00 1 0 1054593024 1 1 90 b0 b0 a0 b0 b0 a0 b0 b0 a0 b0 b0 a0


Obviously project.d2v and project.d2v.bad are incomplete :)

[neuron2]

Maybe it's that funny russian text. Can you try with 'normal' text as used in the first part of the path?

[Tima]

Of course, when moving source to "F:\0\From_sxe\kn\", everything is fine. I thing DGIndex just can't properly handle long paths with russian symbols..

Are there any additional tests required?

[neuron2]

Of course, when moving source to "F:\0\From_sxe\kn\", everything is fine. I thing DGIndex just can't properly handle long paths with russian symbols..

Are there any additional tests required? I don't know how to fix it because I can't type that funny stuff.

[Tima]

Well, If copy&paste is not a solution, then there's a rar file with empty dir with this name.. ;)

[Isochroma]

Using b7 to demux a 5.1-channel AC3 (single stream) from a .TS, with the audio output method set to "Decode AC3 Track to WAV", the resultant WAV file is 2-channel only. Note that Dolby Surround Downmix was unchecked.

[neuron2]

From the DGIndex manual:

"Dolby Surround Downmix AC3 supports up to 6 channels but when decoding to WAV only 2 channels (left and right stereo) can be output, so a process of downmixing is applied. This option selects which of two possible methods for downmixing is to be used."

[neuron2]

Well, If copy&paste is not a solution, then there's a rar file with empty dir with this name.. ;) Sorry, but I have no plans to implement Unicode support.

[Tima]

Sorry, but I have no plans to implement Unicode support.

[Is it necessary to implement Unicode in DGIndex for just cyrillic symbols?]

Nevertheless, I have good news on this issue. :)

When creating d2v file (before correcting it!), it treats all paths ok, and produces a valid d2v (I looked at d2v at the middle of the process). But when DGIndex makes corrections, it stops writing new d2v at the first symbol 'я'. Tried with different dirs.
So there's no global Unicode problem, but just an incorrect handling of symbols when correcting fields order.

[Tima]

So, what's with this bug? :) Did you can reproduce it?

[neuron2]

Sorry, it's Christmas Eve. But don't worry, I'll just drop all my holiday plans so I can get right on this for you. :devil:

[Carpo]

such a nice dev inst he to drop everything to help :sly: :)

[Tima]

Sorry, it's Christmas Eve. But don't worry, I'll just drop all my holiday plans so I can get right on this for you. :devil:

Oops, sorry.. in Russia we prefer NY, and I forgot about Christmas! :eek:

Merry Christmas and happy holidays! =)

[went away to congratulate people around :)]

[BitBasher]

The WAVs that I created with Demux Audio Only do not play and appear to be invalid.

Same for me. If it's not working for you either, is this option not functioning correctly? I have yet to get a "good" wave file from the Demux Audio Only option. There may be a program that can read the resulting .WAV file, but the apps I tried (virtualdub, WMP, cdex, etc) all complain the file is invalid.

I'm wondering if this option perhaps isn't writing the RIFF header or something simple like that.

Bit.

[neuron2]

The Demux Audio Only function was designed for demuxing, not decoding. The Audio/Output Method *must not* be set to Decode. I'll add an error popup to prevent the user from trying to decode with this feature.

[jmac698]

I used demux audio only, and save project. The resulting .ac3 were different lengths, by several seconds. I tried decode, and it truncated the file while saying "audio error". Which is the right file?

[Isochroma]

I just noticed a previous post, and wanted to say that WAV supports 6-channels, so it is possible to output 5.1 in WAV format. I've made 5.1 WAVs with BeSweet before, and they play just fine.

[G_M_C]

I am trying to process a source that is supposed to be a 1080i .TS source through the latest beta, but the preview leaves me in doubt.

It looks like the preview-field isnt exactly shure it's interlaced or not; The indicator keeps switching between interlaced/progressive. During this time the FILM-oercentage is slowly lowering; It started with 100% film, but the percentage is slowly gowing down. And to top this off, the frame structure remains at "FRAME" all the time, even when the indicator sais its interlaced.

My guess is that the indicator hovers between approx. 80% progressive / 20% interlaced in some places and 90 / 10 in others, and approx 75% FILM.

What settings do i use now ?

For the preview i used a 1 hour long piece right in the middle of the .TS.

My guess:
The bitrate is approx 15 mbps MPeg2, the framerate is 29,970030 and since i know it was capped from sattelite; My guess is that its ínterlaced NTSC.

[neuron2]

I used demux audio only, and save project. The resulting .ac3 were different lengths, by several seconds. I tried decode, and it truncated the file while saying "audio error". Which is the right file? If there is video in the source, use Save Project. Demux audio only is intended only for sources without video.

I clearly stated several times to not use Demux Audio Only with Decode AC3.

[neuron2]

I just noticed a previous post, and wanted to say that WAV supports 6-channels, so it is possible to output 5.1 in WAV format. I've made 5.1 WAVs with BeSweet before, and they play just fine. Please read the user manual to learn what is possible with DGIndex. I don't have any plans to enhance the audio support.

[neuron2]

It looks like the preview-field isnt exactly shure it's interlaced or not; The indicator keeps switching between interlaced/progressive. This has been discussed to death. You need to read the DGIndex user manual.

During this time the FILM-oercentage is slowly lowering; It started with 100% film, but the percentage is slowly gowing down. And to top this off, the frame structure remains at "FRAME" all the time, even when the indicator sais its interlaced. See above.

My guess is that the indicator hovers between approx. 80% progressive / 20% interlaced in some places and 90 / 10 in others, and approx 75% FILM.

What settings do i use now ? Did you read the user manual?

[Twisted Ladder]

Can I make a request? When using "__aud__" in the template script, it chooses the file name of the last audio track rather than the first. So when using Demux All Tracks, it will pick the commentary or a foreign language instead of the main audio. You may just ask why I don't set it to Demux Tracks and only demux Track 1, but some DVDs do not have any audio in Track 1 and will instead use a different track to store the audio.

[mvdzwaan]

I already got one wish realised but I got another one.

'Choose other avs template' should default to the avisynth plugin dir (or the dir where dgindex is started from)...

please :)

[neuron2]

I have implemented and tested both the suggestions, for which thank you: 1) use first audio track encountered for __aud__, and 2) default AVS template to "template.avs" in the DGIndex executable directory. Next beta is coming soon.

[Zarxrax]

I think I have encountered something that can only be a bug. I can confirm this with both the latest beta and the older 1.4.8, with two different dvds I tried (both of the same tv series).

It has to do with the "use full paths" option. If I turn it off, the d2v files generated will simply not work. If I try to load the d2v file back into dgindex, the window will stay the default size and nothing will appear in it. However, dgindex will use 100% cpu and the progress marker will move very slowly until it reaches the end. When it finally reaches the end, DGIndex will crash.

At first I thought maybe this was because I saved the d2v files to a different folder than the vobs, but I also tried saving into the same folder that the vobs are in, and the problem still occurs. I don't really need to use relative paths though so its not a big deal for me.

[neuron2]

@Zarxrax

Bug confirmed, fixed, and tested. It will be included in the next beta. Thank you for pointing it out.

[neuron2]

http://neuron2.net/dgmpgdec/dgmpgdec149b8.zip

* The __aud__ variable in the AVS template now uses the first audio track found instead of the last.

* 204-byte transport packets are now supported.

* The info dialog now includes a stream type field.

* An error popup now appears if frame repeats are encountered (only field repeats are currently supported).

* If an exception occurs during processing, a message box pops up and allows the user to choose to continue or to abort.

* The D2V file version is bumped to 15.

* The AVS template path now defaults to a file called "template.avs" in the same directory as DGIndex.exe.

* Fixed a bug in INI file loading that caused some parameters to be read incorrectly.

* An error popup now appears if the user attempts to execute "Demux Audio Only" when the audio method is set to "Decode AC3 Track to WAV".

* Fixed a bug in relative path handling that crashed DGIndex when "Load Project" was performed.

[Twisted Ladder]

DGIndex seems to be generating corrupted AC3 streams now...

1.4.8: http://www.evilshare.com/04311004-eef8-1029-b2ec-00a0c993e9d6

1.4.9 Beta 8: http://www.evilshare.com/8b57bea0-eefa-1029-b2ec-00a0c993e9d6

[SeeMoreDigital]

DGIndex seems to be generating corrupted AC3 streams now...I've just used 1.4.9 Beta 8 to de-mux the streams from a couple of .TS and .VOB sources.... The AC3 streams work fine here!

EDIT: By-the-way....

Seeing as though the following "Save Project and Demux Video" option....

http://img156.imageshack.us/img156/4776/dgindexju8.png

....is able to de-mux more than "save" .d2v, .avs and video streams. Would not a different expression be more appropriate?


Cheers

[neuron2]

DGIndex seems to be generating corrupted AC3 streams now...

1.4.8: http://www.evilshare.com/04311004-eef8-1029-b2ec-00a0c993e9d6

1.4.9 Beta 8: http://www.evilshare.com/8b57bea0-eefa-1029-b2ec-00a0c993e9d6
Seeing the demuxed files doesn't help me. I would really appreciate it if you could supply the source file. I also need your settings in DGIndex.

What kind of source stream is it? Are you sure it has no errors?

[neuron2]

Would not a different expression be more appropriate? That function is just Save Project *plus* demuxing of the video. Now, if you wanted to argue about the naming of "Save Project" then you might have a point.

[MacAddict]

I'm having a strange issue with Beta 8 here as well. Just ripped a disc using my normal RipIt4Me method and then I attempted to index it. I'm getting an error about half way through saying "Too many pictures per GOP(>500). Now beta 7 and beta 3 do not give me this error. Seems something changed here...I'll investigate a bit further.

[Twisted Ladder]

http://www.evilshare.com/19ea116c-ef1f-1029-b2ec-00a0c993e9d6

Using the default settings, 1.4.8 and 1.4.9b7 demux a 3.38 MB AC3 file, while 1.4.9b8 demuxes a 3.36 MB AC3 that plays in super-fast-forward mode.

[neuron2]

Thank you very much, Twisted. I'll look at that right away.

MacAddict, you're next, although I suspect it's probably the same problem.

[neuron2]

Silly me. Try this fixed version:

http://neuron2.net/dgmpgdec/dgmpgdec149b9.zip

[MacAddict]

Donald,

Happy to report that beta 9 indexed my 'offending' movie properly. Many thanks for the quick fix and Happy New Year.

Edit- It seems GordianKnot has problems opening up d2v file from beta 9. Not always but 2 out of 4 I tried this evening causes Gknot to error and then crash with a memory reference. Anyone else had this problem? I'm back to beta 7 now and things are back to normal.

[d'Oursse]

That function is just Save Project *plus* demuxing of the video. Now, if you wanted to argue about the naming of "Save Project" then you might have a point.

As the demux audio feature is in the audio submenu, wouldn't it be more logical to put the "demux video" feature be in the video submenu ?

[neuron2]

Edit- It seems GordianKnot has problems opening up d2v file from beta 9. Not always but 2 out of 4 I tried this evening causes Gknot to error and then crash with a memory reference. Anyone else had this problem? I'm back to beta 7 now and things are back to normal. The D2V file format was changed. I am not familiar with GKnot but I guess that it has to be modified to work with the new format.

[neuron2]

As the demux audio feature is in the audio submenu, wouldn't it be more logical to put the "demux video" feature be in the video submenu ? It's an augmentation of Save Project, so I don't want to decouple them.

[d'Oursse]

and what about a check box in the save window ?

[guada2]

Hello neuron2,

I have some questions about the last DGMPGDec 1.4.9 Beta 9:

- .d2v and .d2v.bad I don't see the real different.(size is the same)
- say me what sotfware support this extension (.d2v.bad)
- i saw the post of TIMA:
http://forum.doom9.org/showthread.php?t=116841&page=5,

What do yo think about this:
D2V Fix Output

Field order transition: 2 -> 0
900 5 0 45211648 1 1 92 b2 b2 a2 b2 b2 a2 b2 b2 a2 b2 b2 a2
900 5 0 45713408 1 2 90 b0 a0 b0 a0 b0 a0 b0 a0 b0 a0 b0 a0
corrected...
900 5 0 45211648 1 1 92 b2 b2 a2 b2 b2 a2 b2 b2 a2 b2 b2 a3
900 5 0 45713408 1 2 90 b0 a0 b0 a0 b0 a0 b0 a0 b0 a0 b0 a0

Field order transition: 0 -> 2
900 5 1 269264896 1 5 90 b0 a0 b0 a0 b0 a0
900 5 1 269561856 1 6 92 b2 b2 a2 b2 b2 a2 b2 b2 a2 b2 b2 a2
corrected...
900 5 1 269264896 1 5 90 b0 a0 b0 a0 b0 a1
900 5 1 269561856 1 6 92 b2 b2 a2 b2 b2 a2 b2 b2 a2 b2 b2 a2


:thanks:

[neuron2]

- .d2v and .d2v.bad I don't see the real different.(size is the same) The D2V Fix Output shows you exactly what was changed. If you read the reference manual for DGIndex, you will find an explanation of the D2V file format, which will allow you to interpret the D2V Fix Output.

- say me what sotfware support this extension (.d2v.bad) The manual explains the significance of this file.

- i saw the post of TIMA:
http://forum.doom9.org/showthread.php?t=116841&page=5 This link leads nowhere. What is your point?

What do you think about this I think you encountered two field order transitions, which were corrected.

[guada2]

Thank you very much for your explanations.
I should read the manual. ;)

To soon,I hope.

[baserc]

Many thanks

[Sharro]

Hi Everybody.

Thanks neuron2!! :-)

After 1 year without any encode I'm back!

I was preparing d2v's with beta 9 for a couple of dvd's I wanted to encode to XVID and on 1 of them I got "field order corrected".

To kill my curiosity I played both file's avs on mpc and the .bad looked perfect while the .d2v had jagged lines as if it was interlaced even though all dvd's are PAL progressive.

Unfortunately I had already encoded the dvd's before I tried this, so I decided to look more carefully at the encode and in the scenes with more motion if step frame by frame I get the feeling that I'm looking at a PAL deinterlaced encode (ghosting effect).

My knowledge about DGindex is scarce as I'm on pal region so ... but... is there anything to worry about it and is this information that you need more details about?

Sorry if this as been answered on any other post, believe me I did a search and sorry for my lame explanation of what I see but I miss all the technical jargons.

All the best,

Sharro

[neuron2]

To kill my curiosity I played both file's avs on mpc and the .bad looked perfect while the .d2v had jagged lines as if it was interlaced even though all dvd's are PAL progressive. It's highly strange to think that this check could be triggered by a progressive PAL DVD, which presumably would not have RFF flags.

is this information that you need more details about? Yes! At a minimum post both the D2V files. Better yet, post an unprocessed source fragment that I can use to duplicate your issue.

[Sharro]

...Yes! At a minimum post both the D2V files. Better yet, post an unprocessed source fragment that I can use to duplicate your issue.

I've attached both d2v's, a Prt Scr jpg and fix.txt .

The problem must be within the beggining of the first vob.

I also tried the last vob of the dvd and a small part from the middle of the first vob extracted with chopperxp didn't gave the error... still ... the part from the right beggining of the first vob...BINGO...error

I've sent you the link through PM, download it quickly as I can't keep it there for long.

FYI it also happened with Beta 8

Hope it helps.

All the best,

Sharro

[neuron2]

You PM'ed link is dead. Please use a reliable upload site, such as MegaUpload.

[Sharro]

Not dead...but looks like it's dying.

http://www.megaupload.com/?d=S9EB8MHY

All the best,

Sharro

[neuron2]

It's a pathological video. Because the entire clip (and presumably the whole movie) is progressive, you can ignore field order entirely, and just use the uncorrected D2V file.

The correction introduces a one field phase shift, so if you want to use the "corrected" D2V, you'll need (for example) Telecide(post=0) to align the fields.

For non-progressive video, where the correction would be important to have, the one-field phase shift is insignificant.

I hope that is clear enough for you to understand what is happening. I wish it were simpler but DGIndex wants to produce a clip with a single field order when you set that option, and he doesn't know that the actual content is progressive.

[Sharro]

Neuron2,

Thanks for your reply.

Quote:

"It's highly strange to think that this check could be triggered by a progressive PAL DVD, which presumably would not have RFF flags."

But if Dgindex detects the pal stream couldn't you make it avoid the field order correction ?

All the best,

Sharro

[neuron2]

No, because the stream might not be progressive. And no, DGIndex cannot rely on the pogressive frame flag as it often lies.

[Sharro]

One last suggestion and I'll STFU!! :-)

To avoid confusing the users maybe the "field order corrected" message should mention something about these pathological pal videos.

All the best,

Sharro

[neuron2]

* Revised the track selection interface to be more user friendly.

* Added preliminary support for frame repeats. These are increasingly being found in 720P streams. Now you can process these videos through DGDecode/Avisynth with proper audio/video sync.

http://neuron2.net/dgmpgdec/dgmpgdec149b10.zip

[G_M_C]

Just installed the new b10 over b8. But it seems it has a bug; When i open a m2v with the new beta dgindex freezes completely, i have to kill it thrue the taskmanager to get some control back over my system.

Extra info: Dual xeon, only flashfxp was running at the time.

[neuron2]

I cannot duplicate that. Does it happen with all M2Vs? Please provide a failing stream to allow me to reproduce your problem.

[G_M_C]

I cannot duplicate that. Does it happen with all M2Vs? Please provide a failing stream to allow me to reproduce your problem.

K, ill look into this later on, when i can close flashfxp and are able to restart/reboot.

[Mug Funky]

@ Sharro and Neuron2:

FWIW, often small bits of black are used to allow end chapters to be put into features. this allows you to skip the credits (the minimum chapter length is 15 frames, and you need a chapter at the end to have an end action).

these bits of black can quite easily be in a different field-order to the main feature...

also they can be used to put space between different parts of a program or different episodes, etc.

i'm not sure if this would cause the issue you're having though.

[G_M_C]

I cannot duplicate that. Does it happen with all M2Vs? Please provide a failing stream to allow me to reproduce your problem.

I've done a reboot and installed the b10 in a totally clean directory/environment, and the troubles seem to have gone.

I'm gonna try to replicate the "old situation" later on, to see if i can find out when in actually locked up (i seem to remember the auto-defrag service was doing its thing even that might have had an influence). If i find out why/when/how it happened, i'll report back. In the mean time: Thx for all the efforts you put into this programm :)

[neuron2]

This version now correctly renders the video within DGIndex for streams with frame repeats. Also, Field Operation=Raw is now supported for such streams.

http://neuron2.net/dgmpgdec/dgmpgdec149b11.zip

EDIT: This beta is withdrawn.

[SeeMoreDigital]

Hi Don,

As you may already know there's a few people over in this thread (http://forum.doom9.org/showthread.php?t=120652) experimenting with .EVO file sources.

Anyway, yesterday I thought I'd see how well DGIndex would react with .EVO files containing MPEG-2 video and DolbyDigital+ audio. Sufficed to say there was no problem accessing and de-muxing the MPEG-2 video stream. Not surprisingly though, the audio stream was not detected.

May I ask whether you have any interest in providing support for these new audio stream formats?


Cheers

[PuppZ]

Hi!

The new beta11 behaves strangely.

I use the script below:
mpeg2source("tenchi01.d2v")
TFM(d2v = "tenchi01.d2v") ---> latest TIVTC 1.0 final
UnBlend()
TDecimate(mode = 1)
hqdn3d(2,1.5,6,4.5)

According to DGIndex the source is 95,58% Film 29.97fps interlaced, Frame Struct: Frame. Maybe soft telecined? I set Field Operation to Honor Pulldown Flags, because using Ignore Pulldown without TFM+TDecimate gives the decimated frame count on 29.97fps (video runs faster) and Force Film gives correct frame count at a correct frame rate but leaves some blended frames even after UnBlend. There's no any other option in Field Operation. With Beta10 everything is fine. With Beta11 I get the following TFM error: d2v frame count does not match filter frame count (51843 vs 71841)! With the latest DGIndex in Honor Pulldown Flags mode I get abnormally higher frame count.

[neuron2]

May I ask whether you have any interest in providing support for these new audio stream formats? What's an EVO and where do they come from? What are the audio specs? I don't have time to search through that long thread. Can you point me to a sample clip?

[neuron2]

The new beta11 behaves strangely.
You'll have to demonstrate a problem with just my filters. Remove everything after mpeg2source() and then serve into VirtualDub and get the frame count. Are you claiming that it is different for beta 10 and beta 11? Also compare the D2V files in the two cases. Are they different? You may want to contact tritical about this if you can't demonstrate an issue with just DGIndex/DGDecode.

EDIT: OK, I duplicated the issue. Beta 11 is withdrawn. I'll release beta 12 tonight. Thank you for pointing this out.

[SeeMoreDigital]

What's an EVO and where do they come from? What are the audio specs? I don't have time to search through that long thread. Can you point me to a sample clip?EVO is the designated container for the HD-DVD format.

It's very flexible and capable of storing the following (EOE): -

Audio formats
LPCM (up-to 7.1)
Dolby Digital, Dolby Digital EX, Dolby Digital Plus
DTS, DTS-ES, DTS-EX
MP2 (MPEG-1 Layer-2)
Dolby TrueHD (Lossless)
DTS-HD Base Stream (Lossless)
DTS-HD Extended Stream (Lossless)
MLP (Meridian Lossless Packing)

Video Formats
MPEG-2 Part-2 (High-Def and Std-Def)
MPEG-4 Part-10 (aka: AVC)
VC-1


Drevil_xxl has provided some samples here: -

ftp://mplayerhq.hu/MPlayer/samples/evob/

DELSCENE1.EVO and DELSCENE7.EVO samples appear to contain 720x480 MPEG-2 video and Dolby Digital Plus (http://en.wikipedia.org/wiki/Dolby_Digital_Plus) audio.


Cheers

[neuron2]

How are the decrypted files being obtained? Where are the specs for the EVO container format?

[SeeMoreDigital]

How are the decrypted files being obtained? Where are the specs for the EVO container format?Sorry Don... I can't help you with either of these questions.... I'm useless aren't I?

[neuron2]

One day when the HDDVD-BD war is over I'll buy an HD player and maybe then I'll be motivated to work in this area. Anyway, it looks like they have working demuxing methods.

[neuron2]

The new beta11 behaves strangely. Yes, I have now duplicated it. Beta 11 is withdrawn. Standby for the fixed version.

[neuron2]

* This version now correctly renders the video within DGIndex for streams with frame repeats. Also, Field Operation=Raw is now supported for such streams.

* Added two new fields to the info dialog: number of frame repeats, and number of field repeats.

http://neuron2.net/dgmpgdec/dgmpgdec149b12.zip

[PuppZ]

Works fine. Thanks :-)

[neuron2]

There's a problem with beta 12 and frame repeats. It's erroneously kicking in the field order correction. I included a check for that but it isn't working right. So turn off the Correct Field Order option when your stream has frame repeats. I'll fix that tonight.

[mimage]

I read a few pages back neuron2 said that vfapi has been deprecated, does this mean that it will not be included soon in future releases? Me and a few buddies of mine like to use it still for editing avs in vegas, is this not good? I edited this one music video to evangelion and I always get comments about it with people saying it's the best quality they've ever seen in an eva music video. I don't know any other better method for editing avs files that use d2vs from vobs. So can I get a bit of info on what's going on with that program? Do you prefer MakeAVIS?

[neuron2]

You'll notice, I'm sure, that DGVfapi is there in every new beta release. It will never go away, don't worry. The reason it is "deprecated" is that it forces conversion to RGB and it lacks some of the advanced options of mpeg2source().

You've helped a lot with DGMPGDec in the past; I wouldn't let you down. :)

[mimage]

You'll notice, I'm sure, that DGVfapi is there in every new beta release. It will never go away, don't worry. The reason it is "deprecated" is that it forces conversion to RGB and it lacks some of the advanced options of mpeg2source().

You've helped a lot with DGMPGDec in the past; I wouldn't let you down. :)
Thanks! ^_^

[neuron2]

* The Correct Field Order option is removed and the field order correction function is now available through the Tools menu: Fix D2V. I did this because this correction should not be applied to streams with frame repeats, and trying to prevent it via a code check runs into technical complications.

* A first attempt has been made to add a progress percentage field to the DGIndex window title bar.

* When in CLI mode, DGIndex no longer grabs the foreground focus and beeps at the end of a Save Project operation.

* Fixed a bug in the LumaYV12() filter (part of DGDecode) that could cause a crash in some circumstances.

http://neuron2.net/dgmpgdec/dgmpgdec149b13.zip

[neuron2]

and what about a check box in the save window ? I just don't see minor GUI changes as worth my limited time. Sorry.

[Zarxrax]

Are the frame repeats only found in HD material? If that is the case, couldn't you leave the automatic d2v fixing only for DVDs or standard definition video?

[neuron2]

Any MPEG2 stream can have frame repeats.

[G_M_C]

Hey Neuron2, about my last remark (about the "hanging of DGindex when selecting a .TS). It proved to be a problem in BitDefender. An update of the scanner solved the problem.

But, i might have found somthing else;

I've recently bought myself the DVD of Pink Floyd latest tour; The P.U.L.S.E. DVD (i've been seen that concert/tour, i'm TA+HAT old ;) ). I wanted to make a back-up of the DVD, but fopund out that DGIndex doesnt recognise the 2nd audio-track correctly.

The DVD has 3 audio tracks;
1 - DD AC3 3/2 - 448 kbps
2 - DD AC3 3/2 - 640 kbps
3 - DD AC3 2.0 - ??? kbps

The problem is that DGindex doesnt recoginse the 2nd track as 640, it says it's 448 kbps. DGindex even says ALL tracks are 448 kbps, even the 2.0 track (The DVD-cover and the audio-menu all say it 640, dont know how to check with something else).

Hope you can find out what's up, and succes with the development :)

[neuron2]

The cover could be lying/incorrect. Please provide an unprocessed VOB fragment that can use to duplicate the issue.

[Pashator]

No, it's really 640, I can confirm this. I have original if you need I can provide you with a sample.

[neuron2]

Yes, please provide the VOB fragment as I already asked for above.

[shon3i]

@neuron2, any chance to make dgdecode.dll work on Vista 32bit.

[mvdzwaan]

@neuron2, any chance to make dgdecode.dll work on Vista 32bit.

DGDecode already works on Vista 32bit

[shon3i]

Well, not i my case, every time when i load avs script into virtualdub, megui, or other program, i got error message, dgdecode unable to open d2v file.

I am using, Vista RTM, Avisynth 2.57 and DGIndex 1.4.8 from MeGUI Auto Update.

Did 1.4.9 works?

[mvdzwaan]

Well, not i my case, every time when i load avs script into virtualdub, megui, or other program, i got error message, dgdecode unable to open d2v file.

I am using, Vista RTM, Avisynth 2.57 and DGIndex 1.4.8 from MeGUI Auto Update.

Did 1.4.9 works?

I did have major problems, and have reverted to avisynth 2.56 (directshowsource with wmv file problems). I also had to add a registry setting to get WMP11 to play avs files.

[neuron2]

@neuron2, any chance to make dgdecode.dll work on Vista 32bit. If you can contribute a legal copy of Vista to me, I'll be happy to investigate it.

[shon3i]

If you can contribute a legal copy of Vista to me, I'll be happy to investigate it.
Well, i can give you mu serial number, but you can activate it, because i alredy activate it, but you have 90 days without activation, plus i can give you working crack.

[pinkie_1]

a legal copy of Vista
i can give you working crack
and, finally...
6) No warez, cracks, serials or illegally obtained copyrighted content! Links to content of a questionable nature, asking for, offering, or asking for help/helping to process such content in any way or form is not tolerated.
Is it that hard to read/understand/abide by a simple set of rules ?

[neuron2]

@shon3i

I appreciate your offer but will decline based on rule 6 and my own ethics as a developer.

As an alternative, are you willing to work with me, testing debug builds, etc.? Thank you.

[The Scientist]

If a sample of the VOB file is available I can test. I have Vista x86 latest AVISynth and DGIndex e.t.c., never had any problems with either.

[shon3i]

@shon3i

I appreciate your offer but will decline based on rule 6 and my own ethics as a developer.

As an alternative, are you willing to work with me, testing debug builds, etc.? Thank you.
OK, neuron, i will help you much as i can.

[neuron2]

Well, not i my case, every time when i load avs script into virtualdub, megui, or other program, i got error message, dgdecode unable to open d2v file. Please post a screenshot showing the error. I ask because what you cited does not exist as a string in DGDecode, so I cannot locate the error point in the code.

I assume you have triple checked the obvious stuff, like you typed the path wrong?

[mvdzwaan]

Please also look at my post in the 'Avisynth usage' group about vista and avisynth problems.

I had to perform a registry trick to get my programs to recognize avs files.

[neuron2]

* Adding checking for audio file names to not be already open in another application before trying to demux to them.

* Added a new tool in the Tools menu: Analyze Sync.

* Revised the indexing code to support the case where an indexed unit (especially packs) might contain more than one I frame. Previously random navigation in DGDecode failed for this rare scenario.

* D2V file format is bumped to 16.

http://neuron2.net/dgmpgdec/dgmpgdec149b14.zip

Please give this a good workout because random navigation has changed. There is now a "skip" field in each D2V file data line right after the position field. The DGIndex users manual explains its purpose.

[Terranigma]

Thanks for the Update. :)
I'll be testing Analyze Sync A.S.A.P.

[mrcoolboy15]

Will this program change the stream on an mpg2 file?

[MacAddict]

Analyze Sync looks pretty cool although I haven't put it to work yet. The 'log time stamps' setting doesn't seem to stick after I exit the application and open it back up. Anyone else? Maybe this is normal behavior.

[neuron2]

The 'log time stamps' setting doesn't seem to stick after I exit the application and open it back up. Anyone else? Maybe this is normal behavior. From the users manual:

"Note that this option setting is not stored in the DGIndex INI file."

[MacAddict]

Thanks Donald, sorry for the false alarm. Been awhile since I read the manual, think I'll have a look later this afternoon.

[Wilbert]

A possible bug in 1.4.8 (and probably also in latest beta):

http://forum.doom9.org/showthread.php?p=972296#post972296

When saving a frame to BMP, the colorimetry info is not used. I suspect Rec.601 is used (when converting to BMP) )in the examples in that post (screenshots of HeadBangeR77 in the post above the linked one), but the extension field of the m2v is empty:

http://xasonline.info/headbanger/BlackPearl.m2v

[HeadBangeR77]

I can confirm that with 1.4.8, 1.4.9 beta7 and beta14. Since there was no colorimetry info in the source stream, the DGIndex /DGDecode used to assume ITU-R BT.709, yet now both the preview and saved screen grabs look as if it was Rec.601 (info window showing ITU-R BT.709 though).

@ neuron2:
For me both the preview and the BMPs I've taken look exactly the same. Yet the supposed or real colorimetry is not used. I think that's what Wilbert meant above.

[neuron2]

When saving a frame to BMP, the colorimetry info is not used. The Save BMP code simply outputs the preview screen. There is no additional processing. The two should always be the same. Are you saying that you can demonstrate an instance when they are not?

[neuron2]

I can confirm that with 1.4.8, 1.4.9 beta7 and beta14. Since there was no colorimetry info in the source stream, the DGIndex /DGDecode used to assume ITU-R BT.709, yet now both the preview and saved screen grabs look as if it was Rec.601 (info window showing ITU-R BT.709 though).

@ neuron2:
For me both the preview and the BMPs I've taken look exactly the same. Yet the supposed or real colorimetry is not used. I think that's what Wilbert meant above. I gather you are saying DGIndex 1.4.7 does it the way you expect and 1.4.8 and later do not. Is that correct? If so, please point me to a stream I can use to see that.

I don't see any code difference that could explain it. Are you sure you have the Video/YUV->RGB option set correctly? You can see that toggling it changes the preview colors.

[neuron2]

Save BMP output from 1.4.7 and 1.4.9 for BlackPearl are binary identical.

So, no problem found. Please advise how to duplicate your issue.

[HeadBangeR77]

Save BMP output from 1.4.7 and 1.4.9 for BlackPearl are binary identical.
So, no problem found. Please advise how to duplicate your issue.
Hello,

No, I used to have some ancient version, that I can't recall atm (sorry) - it wasn't 1.4.7 for sure.

To clear the things a bit:
The output with 1.4.8 and 1.4.9 is identical to that without ColorMatrix(mode="Rec.709->Rec.601"), while the stream is supposed to be ITU-R BT.709 (see the screenshots in the thread linked above). It was Wilbert who used to have different results with 1.4.6 - they were identical to those with ColorMatrix. So I can only assume it happened somewhere between 1.4.6 and 1.4.8, because after he had installed 1.4.8 he started to get the same results as I was getting. If you need any additional info, plz let me know. Also, it would be good Wilbert joined this thread again, since it was him who has discovered the difference.

cheers,
HDBR77

[neuron2]

To clear the things a bit:
The output with 1.4.8 and 1.4.9 is identical to that without ColorMatrix(mode="Rec.709->Rec.601"), while the stream is supposed to be ITU-R BT.709 That's not clear.

Output without 709->601 should be 709, which is what you claim the stream specifies. And you're complaining that DGIndex shows it as 709???

Please clarify your clarification. :)

[HeadBangeR77]

Output without 709->601 should be 709, which is what you claim the stream specifies. And you're complaining that DGIndex shows it as 709???
Wilbert, where are you?
:D :D :D

Please clarify your clarification. :)
Sorry, I wasn't precise again. Those conversion matters have caused a lot of mind-boiling recently. ;)
The output I'm getting with DGIndex 1.4.8 & 1.4.9 is identical to (here we go ;)) :
AVSP preview and VDub preview, as well as to sample encodes without ColorMatrix(mode="Rec.709->Rec.601").

Wilbert says the colours are improperly scaled then, and I'm getting the wrong colorimetry (see the thread he has linked). He used to get different results from mine with DGIndex 1.4.6 (as in previews/encodes with the above conversion), and after installing 1.4.8 it's changed.

Neuron2, excuse me if I'm not clear again - I ain't a complete noob, yet I'm new to ColorMatrix, and I'm completely puzzled atm (especially since I'm sure Wilbert must be right as to technical matters, though I like my results better i.e. I find them more naturally looking, at least to my eyes).

cheers,
HDBR77

PS.
Wilbert's screen shots (http://forum.doom9.org/showthread.php?p=971796#post971796) and
... and mine. (http://forum.doom9.org/showthread.php?p=972274#post972274)

PS2. I see some kind of discussion is carrying on in the ColorMatrix thread. I really don't want to cause any more fuss, so unless Wilbert appears to clear the matter, just plz ignore the "issue". ;)

PS3. Hope he has made things much clearer than I did. ;)

[Wilbert]

Save BMP output from 1.4.7 and 1.4.9 for BlackPearl are binary identical.

So, no problem found. Please advise how to duplicate your issue.
I used 1.4.6 and 1.4.8 (dunno about 1.4.7).

The bmp from 1.4.6 looks exactly the same as AviSynth with ConvertToRGB(matrix="Rec709"). The bmp from 1.4.8 looks differently (i think it looks like ConvertToRGB(matrix="Rec601")). Note that DGIndex reports it as Rec.709 in both cases, which is good afaics.

This is what HeadBangeR77 meant, but i simplified it a bit :)

[neuron2]

OK, 1.4.6 versus 1.4.8. I will check it tonight.

[neuron2]

I found the bug. DGIndex is indeed using 601 for its preview and BMP when it should be using 709. But the Info window is OK.

The problem is that he defaults to 601 until he sees an MPEG2 sequence extension and then he changes the default to 709. But he sets the values via setRGBValues() in between those two events and doesn't call setRBGValues() again after the sequence extension() arrives.

I'll fix that and release a new beta later tonight. I'll also check that DGDecode isn't afflicted the same way. I think it isn't but I'll check it to be sure.

Thanks for pointing this out.

[Wilbert]

I'll fix that and release a new beta later tonight. I'll also check that DGDecode isn't afflicted the same way. I think it isn't but I'll check it to be sure.

Thanks for pointing this out.
Thank you very much!

[HeadBangeR77]

Glad it's been cleared. :)
And waiting for a new beta. ;)
cheers,
HDBR77

PS. It's already here - thanks a bunch!

[neuron2]

* Fixed a bug that caused DGIndex to sometimes use 601 colorimetry in the preview window and when doing Save BMP when 709 should have been used. The Info Dialog was correct, however.

* Added support for M2TS (Blueray Disk MPEG2) files.

http://neuron2.net/dgmpgdec/dgmpgdec149b15.zip

[Terranigma]

Wow! Thanks neuron2 :cool:

[neuron2]

* Fixed incorrect audio demuxing for M2TS files. At this time AC3 is known to be good. All other formats are untested but may work.

http://neuron2.net/dgmpgdec/dgmpgdec149b16.zip

[ACrowley]

* Fixed incorrect audio demuxing for M2TS files. At this time AC3 is known to be good. All other formats are untested but may work.

http://neuron2.net/dgmpgdec/dgmpgdec149b16.zip


DTS Tracks are not suppoted on m2ts ?
Dgindex can detect the dts Audio from KingdomOfHeaven m2ts.

And one question :
When i load to m2ts Streams into gdindex, both m2ts which contains the movie in 2 streams, is it safe to create one d2v for encoding ? Are the m2ts joined properly in the d2v ?

I think so, the runtime of the d2v is correct

greets

[neuron2]

DTS Tracks are not suppoted on m2ts ?
Dgindex can detect the dts Audio from KingdomOfHeaven m2ts.
I clearly said anything other than AC3 is untested but may work. I can't test it because I don't have an M2TS stream with DTS. Would you like to provide one?

It is safe to concatenate by loading multiple files if they all have the same properties.

[ACrowley]

ok, heres a sample from Kingdom Of Heaven BlueRay with
DTS HD Audio

http://www.megaupload.com/?d=ICEJJ421

Perhaps the Problemis in the Stream and its not DGindex

[neuron2]

Perhaps the problem is in the Stream and its not DGindex Then before I go wasting time on a possibly bad stream, tell me how you know that m2ts file contains DTS audio and what player can play the audio from that file. Or what demuxer can extract good DTS audio from it.

[ACrowley]

Then before I go wasting time on a possibly bad stream, tell me how you know that m2ts file contains DTS audio and what player can play the audio from that file. Or what demuxer can extract good DTS audio from it.

because its the stream untouched from Blueray and containes DTS HD 1536kbps

[neuron2]

Since you won't answer my questions, I will ignore you.

[guada2]

http://www.megaupload.com/?d=ICEJJ421

Your stream have some errors.
However, i don't found DTS HD file (strange!!!!).

tell me how you know that m2ts file contains DTS audio and what player can play the audio from that file. Or what demuxer can extract good DTS audio from it.

* Perhaps PS3.
*it was interesting to know this demuxer or the ........

[MichalHabart]

Since you won't answer my questions, I will ignore you.

That m2ts file contains DTS-HD because drmpeg utility xport.exe is able to demux DTS-HD and mpv track from it.
I am not able to do the same with dgindex, it can not see any audio stream inside m2ts.

At the moment, there is no other utility/program that can handle DTS-HD streams in m2ts.
Xport can be found here http://www.w6rz.net/xport.zip

[guada2]

Are you sure that xport.exe can import DTS-HD?

Drmpeg could you confirm that, please?

[neuron2]

That m2ts file contains DTS-HD because drmpeg utility xport.exe is able to demux DTS-HD and mpv track from it. I tried that before but it didn't seem to work. Please tell me the exact command line you gave and then what you play the result with to see that it is OK. Thank you.

This is what I got:

-------
E:\Don\Programming\C++\Xport>xport -h sampleDTS.m2ts 1 1 1
xport Transport Stream Demuxer 0.94
program = 1, video channel = 1, audio channel = 1

packets for pid 6929 <0x1b11> = 1, first = 1, last = 1
coded frames = 0, video fields = 0

E:\Don\Programming\C++\Xport>
-------

The resulting video and audio files had length 0.

[MichalHabart]

I tried that before but it didn't seem to work. Please tell me the exact command line you gave and then what you play the result with to see that it is OK. Thank you.

This is what I got:

-------
E:\Don\Programming\C++\Xport>xport -h sampleDTS.m2ts 1 1 1
xport Transport Stream Demuxer 0.94
program = 1, video channel = 1, audio channel = 1

packets for pid 6929 <0x1b11> = 1, first = 1, last = 1
coded frames = 0, video fields = 0

E:\Don\Programming\C++\Xport>
-------

The resulting video and audio files had length 0.

Seems to me that sample provided by ACrowley was broken. I tried it but it has no output. This sample with command "xport -h 1 1 1" demuxes video file and DTS-HD track. Is it enough or should i provide bigger file?
http://rapidshare.com/files/22606202/sample2.m2ts.html

[neuron2]

Thanks, Michal, that's just fine.

Here is beta 17, which can now get the DTS out of that stream. You wouldn't happen to know what the other three mystery PIDs are, would you (1200, 1201, 1202)?

Also, DGIndex was built with Visual Studio 2005 Express, rather than my old standby VC++ 6.0. So let me know if you see anything funny with it. That "dinosaur" crack really got to me. :)

http://neuron2.net/dgmpgdec/dgmpgdec149b17.zip

[yonta]

You wouldn't happen to know what the other three mystery PIDs are, would you (1200, 1201, 1202)?


subtitles, most probably.

[guada2]

Super neuron :)

[MichalHabart]

Thanks, Michal, that's just fine.

Here is beta 17, which can now get the DTS out of that stream. You wouldn't happen to know what the other three mystery PIDs are, would you (1200, 1201, 1202)?

Also, DGIndex was built with Visual Studio 2005 Express, rather than my old standby VC++ 6.0. So let me know if you see anything funny with it. That "dinosaur" crack really got to me. :)

http://neuron2.net/dgmpgdec/dgmpgdec149b17.zip

This is technical specification of that BR disc:

Video Resolution/Codec
1080p/MPEG-2

Aspect Ratio(s)
2.35:1

Audio Formats
English DTS HD Lossless Master Audio 5.1 Surround

Subtitles/Captions
English SDH
English Subtitles
French Subtitles
Spanish Subtitles

Supplements
Theatrical Trailer

So i assume, those PIDs are subtitles. But at the moment, there is nothing that can extract them out :(

Btw, how about adding also support for LPCM in m2ts files? If you want, i can give you sample of such file.

Edit: I just tried newest dgindex but it still can not see DTS track inside m2ts even if it is file i sent you sample from ;(

[SeeMoreDigital]

Edit: I just tried newest dgindex but it still can not see DTS track inside m2ts even if it is file i sent you sample from ;(Are you referring to your "sample 2" or guada2's sample.... If so, DGIndex/DGMPGDec 1.4.9 Beta 17 de-muxed the DTS audio stream of both samples just fine for me :)

[MichalHabart]

Are you referring to your "sample 2" or guada2's sample.... If so, DGIndex/DGMPGDec 1.4.9 Beta 17 de-muxed the DTS audio stream of both samples just fine for me :)

Cool, i did not change anything but now it works :)
Thanks neuron!!
But this will only work when video is MPEG-2. I have also m2ts with AVC (H264) inside. Is there any possibility to demux it also with gdindex? i get only error message that video sequencer not found.

[neuron2]

Btw, how about adding also support for LPCM in m2ts files? If you want, i can give you sample of such file. Yes, I can do that. Please provide a test file.

Is there any possibility to demux it also with DGIndex? No. You'll have to wait for me to complete DGAVCIndex.

[MichalHabart]

Yes, I can do that. Please provide a test file.

No. You'll have to wait for me to complete DGAVCIndex.

At the moment, i don't have such m2ts but i will provide you one as soon as possible.
And for GDAVCIndex, is there any progress?

Edit: I found one m2ts with LPCM inside. Here is sample: http://rapidshare.com/files/22713733/sampleLPCM.m2ts.html

[neuron2]

And for DGAVCIndex, is there any progress? I don't understand your question. It is in development, do you need more details about it?

[MichalHabart]

I don't understand your question. It is in development, do you need more details about it?

I found thread for it so now i know that beta3 is the last one. And i also know the progress at the moment.

[Terranigma]

thanks for the update neuron2. :)

[MichalHabart]

neuron, is there any reason why d2v created by beta17 can not be load into gordian knot? structure changed?

[kbello]

For me works fine, may be you need replace .dll

[Boulder]

Don,

just a quick one to let you know that your website shows beta 14 as the latest one instead of b17.

[Atak_Snajpera]

Neuron2: I will be honest with you . Audio Delay detection is not working at all! Two examples: Casino Royale - Dgindex shows -192ms instead of -272ms. KungFu Hustle -32ms instead of -144ms. Somehow DVD2AVI and VirtualDubMod are able to detect correct value but not Dgindex. As far as I know Dgindex is based on DVD2AVI so I assume You must have broken something in the engine.
You did great job but unfortunately you forgot to fix the most annoying bug.:(

[neuron2]

It's been discussed to death. DGIndex follows the MPEG2 specification to the letter. If some other app to which you are comparing it doesn't, then that is not my problem and, "to be honest", given your attitude, I'm not very interested in helping you to understand why things are the way they are.

[Zep]

would it be worth while to some how double check by comparing time stamps or some other method?

[neuron2]

would it be worth while to some how double check by comparing time stamps or some other method? I don't know what you mean. Do you mean compare between DGIndex and DVD2AVI? I already know why their calculations differ.

And Atak hasn't bothered to give us a VOB that I can use to look at his issue.

[Atak_Snajpera]

I've uploaded 2 samples. Please take a look

Casino Royale
http://www.mediafire.com/?2hwcynfzwhw

Kungfu-Hustle
http://www.mediafire.com/?0z2i21zkzmz

[MichalHabart]

I've uploaded 2 samples. Please take a look

Casino Royale
http://www.mediafire.com/?2hwcynfzwhw

Kungfu-Hustle
http://www.mediafire.com/?0z2i21zkzmz


Casino Royale has H264 as video track, could this be that problem?

[neuron2]

Neither VOB is long enough to contain content that has a clear correlation between a video event and an audio event, so I cannot objectively determine the "correct delay. All I can say is that I am following the MPEG2 spec. If you don't like that, then use something else (or just adjust by 80ms, see below).

Here is the analysis: The first PTS refers to the first access unit in coded order, but because it is IBBP in coded order, the first access unit in coded order (the I frame) is the third frame displayed:

coded: IBB...
display: BBI...

Thus the time of the first display frame must be adjusted by two frame times, which is 80ms in PAL. So:

272 - 80 = 192ms

If you have a different reading of the MPEG2 spec, please enlighten us, with section references. :)

Ask mpucoder about it if you don't believe me.

[Zep]

I don't know what you mean. Do you mean compare between DGIndex and DVD2AVI? I already know why their calculations differ.

And Atak hasn't bothered to give us a VOB that I can use to look at his issue.

Yes i realize you follow the spec so I'm merely wondering if there was something more you could do the make sure the spec check was indeed correct when a source stream is NOT following specs then maybe you could use an alternate method to get offset.

Interestingly enough projectX gets the sync fine on the samples and DGindex does not. projectX must be doing more than just a strict spec check. I think it drops the first GOP then shifts audio alignment to that complete GOP which you then end up with offset = 0 on the demux.

My ultimate DGindex dream :) is someday DGindex could edit out more then just the front and back end then fix sync like projectX does then we get edit->sync fix->d2v and much faster cause it would be a streamlined work flow and it is not slow java! Now that would be so sweet! :D

thanks for all your hard work on DGindex, it really is great!


.

[neuron2]

Interestingly enough projectX gets the sync fine on the samples and DGindex does not. projectX must be doing more than just a strict spec check. I think it drops the first GOP then shifts audio alignment to that complete GOP which you then end up with offset = 0 on the demux. What samples are you referring to? Let's be specific and take one clear sample that has an audio/video event that will allow us to determine the real sync. I'm willing to follow up on a specific case but I'm not going to respond to unsupported claims like you just made.

[neuron2]

Let's be specific and take one clear sample that has an audio/video event that will allow us to determine the real sync. I'm willing to follow up on a specific case... All I'm hearing is crickets.

[Zep]

What samples are you referring to? Let's be specific and take one clear sample that has an audio/video event that will allow us to determine the real sync. I'm willing to follow up on a specific case but I'm not going to respond to unsupported claims like you just made.

Unsupported? I sent you many samples **DIRECTLY TO YOUR FTP SERVER** in the past that showed this very same problem which I talked about on more than one occasion. You even told me in a PM to STOP sending you so many samples as it was your work server or something and had limited space. So i stopped.


What did you learn from all those samples that had the exact same problem we are talking about now???


Anyway, i will start using DGindex again and get you even MORE samples. In the mean time i suggest you simply raw some HDTV streams on your home PC and see for yourself.

Thanks

[Zep]

All I'm hearing is crickets.

You actually replied twice to me before I had the free time to get back in here even once. I hope you enjoy the sound of those crickets. :D

[neuron2]

Please indulge me by providing a stream again that shows the problem and has a clear audio/video event that will allow us to determine the real sync. As I said, I am now willing to follow up on it until we are all satisfied with the result.

[neuron2]

Please indulge me by providing a stream again that shows the problem and has a clear audio/video event that will allow us to determine the real sync. As I said, I am now willing to follow up on it until we are all satisfied with the result. Hearing crickets again...

I suspect the problem may be the need for a clear AV event, such as a door slamming. Without such an event, there is no way to objectively determine the correct delay. Then we're left with "Well, application XYZ says the delay is ABC milliseconds, and DGIndex says it is TUV milliseconds, so DGIndex must be broken."

I repeat again, I'm willing to take a clear case through to completion, if anyone can provide one.

[plokm]

I found what looks like a bug in the templates. If you have two __vid__ placeholders on the same line, only the first one is processed. I didn't check to see if __aud__ is doing the same thing.

[neuron2]

That's right. Why do you have more than one per line? Just curious.

[plokm]

TFM(d2v="__vid__", ovr="__vid__ override.txt", output="__vid__ metrics.txt")

I would prefer to do that when ripping multiple episodes in a series, just so the related files don't all have the same name.

[neuron2]

Fair enough. Thank you for bringing it to my attention. Next beta.

[plokm]

Thanks!

[3ngel]

@neuron2
I dont' know much about avisynth env, but can you tell me if MPEG2Source() works syncronously with avisynth?
In other words, MPEG2Source() render a frame each time avs ask for it?
In this case you can implement a customizable read-ahead (asynch multithreaded) decoding in order to fully use all the cpus power?
In other words while avs is processing frame, MPEG2Source() at the same time read the (customizable) ahead frames?

[neuron2]

@neuron2
I dont' know much about avisynth env, but can you tell me if MPEG2Source() works syncronously with avisynth?
In other words, MPEG2Source() render a frame each time avs ask for it? Yes, MPEG2Source() decodes one frame when Avisynth calls the GetFrame() method.

In this case you can implement a customizable read-ahead (asynch multithreaded) decoding in order to fully use all the cpus power?
In other words while avs is processing frame, MPEG2Source() at the same time read the (customizable) ahead frames? I don't have a lot of time for such work right now, as I am busy with other exciting things.

[3ngel]

Ok :)
Because dual (or more) processors, are becaming more and more common i thought that was a nice idea to gain a little (speed improvements i read are always requested) ;).

[ACrowley]

1.4.9 Beta 17 works fine with DTS( HD) demuxing from m2ts Streams from BluRay. THX

LPCM Audio is not supported at the moment right ?
1.4.9 Beta 17 cant detect LPCM in all my m2ts

[neuron2]

LPCM Audio is not supported at the moment right ? 1.4.9 Beta 17 cant detect LPCM in all my m2ts If you can provide a sample stream, I will try to support it. Do it fast, because I am preparing to release 1.4.9.

[uncertainty]

If you can provide a sample stream, I will try to support it. Do it fast, because I am preparing to release 1.4.9.


I just used your latest beta for a Blu-Ray M2TS file (Stealth) and found it selected the French AC3 track and not English (it used PID 1102 instead of the PID 1100 which was english AC3). Is there anyway to have it allow the user to select which track to use from within the MEGUI frontend?

thanks for a great product btw....once I can get it to where the AC3 track is selectable (within megui) for M2TS it will remove 1 step I have to do now atm, ie demux the mpeg2 stream and AC3 out.

[neuron2]

You'll have to ask the megui guys about that one. My selection mechanism is to set the right PID.

[uncertainty]

You'll have to ask the megui guys about that one. My selection mechanism is to set the right PID.


Thanks , for now I'm just using your program seperately to create the d2v then I start up megui.....this way I can then choose the correct PID...