Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > General > DVD2AVI / DGIndex

Closed Thread
 
Thread Tools Search this Thread Display Modes
Old 31st March 2008, 22:04   #381  |  Link
Guest
Guest
 
Join Date: Jan 2002
Posts: 21,924
If you have a bad transition like:

0->0->2->2

then you can fix it by changing it to this:

0->1->2->2

So a 0 (two fields) got changed to a 1 (three fields). So two such corrections will add two fields, i.e., a frame.

It's obvious that a lot of such fixes can throw off the audio. My contention is that such errors are rare. That's why I keep asking for a stream that shows a lot of the errors. I think that it can only result from some deeper pathology (such as a broken capture card, or dropouts in a transmission due to poor signal, etc.), which is the real thing that needs fixing.

So I'm standing by that position until somebody gives me a real example. If I get one and I agree that something needs to be done, it will be possible to track the added fields and drop frames as needed to keep the AV sync.
Guest is offline  
Old 1st April 2008, 23:18   #382  |  Link
Zep
Registered User
 
Join Date: Jul 2002
Posts: 587
Quote:
Originally Posted by neuron2 View Post
If you have a bad transition like:

0->0->2->2

then you can fix it by changing it to this:

0->1->2->2

So a 0 (two fields) got changed to a 1 (three fields). So two such corrections will add two fields, i.e., a frame.

It's obvious that a lot of such fixes can throw off the audio. My contention is that such errors are rare. That's why I keep asking for a stream that shows a lot of the errors. I think that it can only result from some deeper pathology (such as a broken capture card, or dropouts in a transmission due to poor signal, etc.), which is the real thing that needs fixing.

So I'm standing by that position until somebody gives me a real example. If I get one and I agree that something needs to be done, it will be possible to track the added fields and drop frames as needed to keep the AV sync.
the last cap I saw TONS of this error was a 480i show called joes VS pros. Thousands of them and the fixed d2v made sync go way way off and by what you said above I now see why.

The non fixed one stayed in perfect sync but makes me wonder what was wrong with the video, cause when I watched it, I didn't see anything wrong. So I guess DGindex is matching the wrong fields when I stick to the non fixed one? What is the worst case video wise strangeness I should see from this?

thanks!
Zep is offline  
Old 1st April 2008, 23:27   #383  |  Link
Guest
Guest
 
Join Date: Jan 2002
Posts: 21,924
Quote:
Originally Posted by Zep View Post
The non fixed one stayed in perfect sync but makes me wonder what was wrong with the video
Me too. But if no one ever gives me such a stream, I have no hope of finding out!
Guest is offline  
Old 2nd April 2008, 20:32   #384  |  Link
Zep
Registered User
 
Join Date: Jul 2002
Posts: 587
Quote:
Originally Posted by neuron2 View Post
Me too. But if no one ever gives me such a stream, I have no hope of finding out!
well I am doing some 480i tonight so fingers crossed lol


UPDATE: out of 3 hours of just rawing a 480i channel to see what it showed basically 2 corrections per hour was the average
and looked like the following give or take. (this one was from the 10 PM show)

D2V Fix Output

Field order transition: 2 -> 0
d00 5 0 547373193 0 0 0 92 a2
d00 5 0 547396729 0 0 0 90 a0 a0 a0 a0
corrected...
d00 5 0 547373193 0 0 0 92 a3
d00 5 0 547396729 0 0 0 90 a0 a0 a0 a0

Field order transition: 0 -> 2
d00 5 0 819061264 0 0 0 90 a0
d00 5 0 819076508 0 0 0 92 a2 a2 a2 a2 a2 a2 a2 a2 a2
corrected...
d00 5 0 819061264 0 0 0 90 a1
d00 5 0 819076508 0 0 0 92 a2 a2 a2 a2 a2 a2 a2 a2 a2



that was it for tonight. I will try another channel tomorrow night. Gonna be pure random chance to get one as bad
as that pro's VS joes one but I will keep at it.


thanks

Last edited by Zep; 3rd April 2008 at 06:09.
Zep is offline  
Old 4th April 2008, 16:59   #385  |  Link
plugh
A hollow voice says
 
Join Date: Sep 2006
Posts: 269
I've got one that has me scratching my head...

transport stream file, being processed by RC2.

If I say 'save project' with 'demux all audio' and NO 'log timestamps', at the end dgindex reports bad field transition. When I let it correct it, it shows a SINGLE fix.

If I say 'save project' with 'demux all audio' and ENABLE 'log timestamps', at the end dgindex reports bad field transition. When I let it correct it, well I'm guessing, but it looks like it massages a LOT of the file. (gross metric - .d2v=1300KB, fix.txt=592KB)

Other odd things I've noticed so far:

It is reported as Film ~70%. It does this for pretty much any segment, though the number varies some. As an example, I played a short section; 'Frame type' switched back and forth between Progressive and Interlaced, Playback #=706, Coded #=592, and Field Rpts=228. (706-592=114, 114*2=228), Video Type = Film 76%

mpeg2repair generates error groups every 14 frames(?)
ie "Sequence Frame NN(12-B)" where NN is 28,42,56,...
consisting mostly of 'temporalref gap' and 'unexpected tff/rff flag change'.
At the end it reports,
0 of 273148 video frames found with errors
12 of 333624 audio frames found with errors
0 corrupted video bytes in file
18300.7 seconds of video timestamp gaps

delaycut reports 1533 errors in the dgindex created ac3 file (vs 12 above?) and oftimes has to 'rewind 170 bytes' in order to find a sync word.

Comments?

Last edited by plugh; 4th April 2008 at 17:02.
plugh is offline  
Old 4th April 2008, 18:00   #386  |  Link
Guest
Guest
 
Join Date: Jan 2002
Posts: 21,924
OK, I found the bug that causes the parsing to be different when timestamp logging is enabled.

Were there any other DGIndex issues you are pointing out to me?
Guest is offline  
Old 4th April 2008, 20:29   #387  |  Link
plugh
A hollow voice says
 
Join Date: Sep 2006
Posts: 269
Ah - you replaced your prior reply...
So you don't need the 500MB sample I just finished uploading?
Quote:
Originally Posted by neuron2 View Post
OK, I found the bug that causes the parsing to be different when timestamp logging is enabled.
Does this mean, given my description of the stream, that the 'timestamp enabled' case is the INcorrect case?
Quote:
Were there any other DGIndex issues you are pointing out to me?
I'm not sure. As I indicated, when mpeg2repair parsed the stream it only found 12 bad audio frames. When dgindex extracted the audio, the resulting file was reported as having MANY more than 12 bad frames by delaycut. Further, in many of those cases, it recovered by 'rewinding 170 bytes' to find the ac3 frame sync word. I note the TS packet size is 188 bytes, and wonder if there is a relationship - like hypothetically, did dgindex extract the payload from a ts packet and put it in the ac3 file that it should not have? Or is this perhaps simply related to the parsing error you just fixed?

{Edit:} Hmmm. think I got that backwards. delaycut reports a crc error, then needs to rewind from where it expected to find the next frame; so perhaps dgindex dropped a ts packet, thus producing the crc error and causing delaycut to have to search backwards. hypothetically...{end}

AS AN ASIDE - Based upon your experience, does my description of the video characteristics sound like perhaps this has been subjected to a dgpulldown-ISH process? I note that mpeg2repair reported 273148 frames vs the DGindexed source (with 'honor pulldown flags' selected) reporting 319959.

273148/319959 ~=.85 , 25/30 ~=.83 - Just coincidence? Is that perhaps why mpeg2repair reports 'unexpected tff/rff flag change' all through the file?

Thanks in advance...

Last edited by plugh; 4th April 2008 at 20:43.
plugh is offline  
Old 4th April 2008, 22:40   #388  |  Link
Guest
Guest
 
Join Date: Jan 2002
Posts: 21,924
When you say the DGIndex demuxed audio had more errors, was that with timestamp logging enabled? Is so, then yes, it is caused by the bug I fixed.

I assume MPEG2Repair reports encoded frames, while DGIndex reports displayed frames when honoring pulldown.

If you want to give me the upload link, I'll have a look at it.
Guest is offline  
Old 5th April 2008, 01:45   #389  |  Link
plugh
A hollow voice says
 
Join Date: Sep 2006
Posts: 269
Quote:
Originally Posted by neuron2 View Post
When you say the DGIndex demuxed audio had more errors, was that with timestamp logging enabled? Is so, then yes, it is caused by the bug I fixed.
No. I turned on timestamp in order to try to get additional info about the audio errors (have never used it before, thought it might give PTS for both audio and video frames or some such)

I just went back and tried to recreate my sequence of ops.

--I wanted both the original ac3 5.1 and a decoded stereo mix-down wave--

opened files in dgindex, quick preview.
set audio for 'decode to wave', selected channel 0
made first pass to do the 'prescale decision'
made next pass with Save Project, yeilding .wav and .d2v
made next pass with 'Demux audio only' yeilding .ac3 <=-

Note1: The Save Project gave me a field transition warning;
I said 'doit', the log showed a _single_ correction.
Note2: Neither of the above audio output files indicates the delay to be used in the filename.

Soooo... I made another short, _aborted_ "save project" pass simply to create another ac3 output file WITH the delay value in the name.

Given my uncertainty about the delay issue, My *next* intent was to evaluate the lengths of the .wav and .ac3. Delaycut will report both duration and frame count for the ac3 file. Ran it, fed it the .ac3, and it gave me Many Errors. Uh oh...

ran dgindex again, this time to demux audio via 'Save Project'
Out of curiosity / desperation, I enabled timestamps.
Did the Save, it completed, reported the field transition (again)
I said 'doit' (again), but THIS time the log showed thousands of 'fixes'

'WTF' I said...

Ran mpeg2repair on the ts files to see what IT thought.
It gave me the confusing result of lots of temporalref and rff/tff errors, but the summary at the end seemed to say the files was OK, and only had a very few audio errors.

WTWTWTF!!

To summarize:

1st save project - one field transition error
2nd save project - zillion field transition errors

demux audio, run through delaycut, mega errors

mpeg2repair, zillion messages but summary says video ok, audio has 12 errors.

At which point I posted my question

Now...
Regarding the "<=-" above...

In the process of pulling this narrative together, I discovered:
---taa daa---
"Demux Audio Only" produced my corrupt AC3 file, but
"Save Project" (without 'timestamp' enabled) produces a correct one!

The ts sample can be found here http://www.megaupload.com/?d=Z2VLHXBC

And just to make sure it doesn't get lost in the above narrative,
- neither of the audio output filenames supplied 'Delay'.
plugh is offline  
Old 6th April 2008, 13:52   #390  |  Link
hajj_3
Registered User
 
Join Date: Mar 2004
Posts: 738
problem with a dvd of mine using 1.5.0 RC3:

D2V Fix Output

Field order transition: 0 -> 2
d00 5 0 16384 0 2 1 b0 b0 90 a0
d00 5 0 28672 0 3 1 b2 b2 92 b2 b2 a2 b2 b2 a2 b2 b2 a2
corrected...
d00 5 0 16384 0 2 1 b0 b0 90 a1
d00 5 0 28672 0 3 1 b2 b2 92 b2 b2 a2 b2 b2 a2 b2 b2 a2

Attached is the .d2v, .bad, .ifo

if you need the original files let me know and i'll put them on my 100/100mb ftp server for you.

Last edited by hajj_3; 7th April 2008 at 23:50.
hajj_3 is offline  
Old 6th April 2008, 15:13   #391  |  Link
Guest
Guest
 
Join Date: Jan 2002
Posts: 21,924
What is the problem?
Guest is offline  
Old 6th April 2008, 15:50   #392  |  Link
hajj_3
Registered User
 
Join Date: Mar 2004
Posts: 738
if i click "yes" to fix the .d2v the audio is around 1sec out of sync, if i click no its over 1 sec out of sync. there is no delay on the .ac3 audio either: "VTS_02_1 T80 2_0ch 192Kbps DELAY 0ms.ac3"

Last edited by hajj_3; 6th April 2008 at 18:49.
hajj_3 is offline  
Old 7th April 2008, 02:31   #393  |  Link
Guest
Guest
 
Join Date: Jan 2002
Posts: 21,924
If it's a fixed offset, just correct for it in the usual way. If the transition is at the beginning, try starting your project in by a few GOPs. Without a stream, It's hard to help you. People always ask me if I want the stream and I always say yes.

Last edited by Guest; 7th April 2008 at 02:33.
Guest is offline  
Old 7th April 2008, 20:26   #394  |  Link
RunningSkittle
Skittle
 
RunningSkittle's Avatar
 
Join Date: Mar 2008
Posts: 539
failed :(

DGindex 1.5RC3 fails to open this vob cell.

It fails to load the first cell of the main movie from lethal weapon 1,2 and 3.

media player classic, and virtualdubmod open the file without issues.

http://deep.phpwebhosting.com/~macto.../VTS_01_11.VOB

help!
RunningSkittle is offline  
Old 7th April 2008, 23:28   #395  |  Link
Guest
Guest
 
Join Date: Jan 2002
Posts: 21,924
It's a known problem. Well, *I* knew about it.

I'll release RC4 tonight with the fix. There was a regression in transport stream detection. RC3 thought your stream was a transport stream. Sorry for the inconvenience.
Guest is offline  
Old 8th April 2008, 00:10   #396  |  Link
Guest
Guest
 
Join Date: Jan 2002
Posts: 21,924
@hajj_3

Instead of sending me a PM with a link to a 3.5GB download, and then stopping me in the middle to say forget it, take this other one instead, try answering my questions in the thread.

Start your project in by enough GOPs to get a reasonable delay value in your filename.
Guest is offline  
Old 8th April 2008, 00:17   #397  |  Link
RunningSkittle
Skittle
 
RunningSkittle's Avatar
 
Join Date: Mar 2008
Posts: 539
yay!

Not an inconvenience at all! Im just glad that I wasnt over looking something simple :0
RunningSkittle is offline  
Old 8th April 2008, 01:26   #398  |  Link
Guest
Guest
 
Join Date: Jan 2002
Posts: 21,924
Version 1.5.0 RC4

* Don't check for field order transitions for streams with only frame repeats.

* Use lowest numbered audio ID to expand __aud__ instead of the first audio stream encountered in the source files.

* Fix parsing with log timestamps enabled.

* Correct handling of default matrix coefficients for hints.

* Add option for beeping and focusing when save project finishes.

* Save BMP is now enabled during play/preview.

* Fix regression in transport stream detection.

http://neuron2.net/dgmpgdec/dgmpgdec.html
Guest is offline  
Old 8th April 2008, 01:33   #399  |  Link
morphinapg
ASXGui Developer
 
morphinapg's Avatar
 
Join Date: Sep 2007
Posts: 247
Works great, thanks
morphinapg is offline  
Old 8th April 2008, 03:21   #400  |  Link
Zep
Registered User
 
Join Date: Jul 2002
Posts: 587
Quote:
Originally Posted by neuron2 View Post
* Don't check for field order transitions for streams with only frame repeats.

* Use lowest numbered audio ID to expand __aud__ instead of the first audio stream encountered in the source files.

* Fix parsing with log timestamps enabled.

* Correct handling of default matrix coefficients for hints.

* Add option for beeping and focusing when save project finishes.

* Save BMP is now enabled during play/preview.

* Fix regression in transport stream detection.

http://neuron2.net/dgmpgdec/dgmpgdec.html


awesome! 1 fix and 1 option in this release rock for me. this is the release I have so been waiting for!


thanks!
Zep is offline  
Closed Thread

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 05:45.


Powered by vBulletin® Version 3.8.9
Copyright ©2000 - 2017, vBulletin Solutions, Inc.