DGMPGDec 1.2.0 beta 6 - Page 4

neuron2 · 2nd February 2005, 14:19

Quote:

Originally posted by len0x
I'm just not sure how hints are working

The low order bit of the first 64 bytes of the video itself are stolen and data is written there. It is completely imperceptible. The first word of the data is a magic number. If the receiving filter sees the magic number in those bits, it knows that there will be good data in the second word.

len0x · 2nd February 2005, 14:25

IC. Interesting...
Can debug parameter be added to mpeg2source to produce the same information as info=true does?

marcellus · 2nd February 2005, 14:35

Quote:

Yes, I guess if you successfuly opened the archive everything is fine.

Oh, it's an archive is it? Well it doesn't open with anything I have. What is it?

EDIT: Darn, I keep hitting the edit button instead of the reply button. I need more sleep. Anyway, how do I open this archive?

len0x · 2nd February 2005, 14:40

Also I have an idea for ColorMatrix purposes. Have an auxiliary function that catches hints from mpeg2source and use them in any form feasible (may be like tritical proposed in some cases). Later ColorMatrix can use that info from auxiliary function. So this ensures that Don has to make hints thing working only once and don't change implementation even if another way of parsing frame info is found/suggested. This auxilary function will be a part of ColorMatrix plugin and can be developed totally separate from DGDecode.

neuron2 · 2nd February 2005, 15:34

@marcellus

How do I open a .7z file? Can't you just put the stream there directly?

@len0x

The data has to be put somewhere that the receiving filter can access.

len0x · 2nd February 2005, 16:06

I know, but implementation can be imperfect (i.e. for DVD sources it may be unlikely that different coefficients are used throughout the movie. That's why I asked if info() can be exposed in debug mode so that I can try running some automatic tests to see if we really need frame-by-frame info for ColorMatrix).

tritical · 2nd February 2005, 16:55

Hm, one more thought... with the imbedded hints method you could make a generic wrapper filter that could preserve the hints accross filters that would ordinarily destroy them. One single generic version could not work for all filters, but it would be able to work for any filter that is 1:1 input output, such as resamplers, most denoisers, etc...

Cyberia · 2nd February 2005, 17:05

Quote:

Originally posted by neuron2
How do I open a .7z file?

Type "7" and then "z" into Google, and take the first link.

EDIT: I make no claims as to the quality of the 7z software. (Doesn't work for me)

neuron2 · 2nd February 2005, 17:51

So to save less than 2MB on an upload, marcellus is forcing me to install some SW I don't need or want? Sorry Charley.

Leak · 2nd February 2005, 17:58

Quote:

Originally posted by neuron2
So to save less than 2MB on an upload, marcellus is forcing me to install some SW I don't need or want? Sorry Charley.

Well, both TUGZip and WinRAR have no problems uncompressing 7Zip files, so if you happen to use one of those...

7Zip is an open-source packer providing better compression than zip, which IMHO is great. Yeah, RAR's not bad as well, but it's still proprietary.

np: Ido Gouvrin - Breaking Through The Frequencies (Clicks & Cuts 4)

neuron2 · 2nd February 2005, 18:13

You missed my point. I don't want to install it. He can please upload the uncompressed file. I estimate that it will be 9MB instead of 7MB.

Cyberia · 2nd February 2005, 18:46

Don, I uncompressed both 7z files and uploaded them to your site. Hope that was OK.

gop_499.m2v
long_gop.m2v

neuron2 · 2nd February 2005, 21:35

Sure, no problem.

So his 499 picture GOP makes a line in the D2V that is 1500+ characters long. Would *you* have thought of making your sprintf() temporary buffer that long?

I've fixed it in beta 6, to be released shortly.

Beta 6 also fixes the long-standing decode bug I mentioned. We will be much more error tolerant. It'll still report the error in the info box, because it is a real stream error it turns out, but we won't macroblock the pictures all to hell. It's at least as tolerant as VirtualDub MPEG2 now. Thanks for access to your code, fccHandler!

fccHandler · 2nd February 2005, 22:39

K

neuron2 · 2nd February 2005, 23:16

http://neuron2.net/fixd2v/dgmpgdec120b6.zip

Relative to the brain-dead 1.1.0:

1. Adds demuxing of AAC audio from transport streams.

2. Adds preliminary support for PVA streams.

3. Adds demuxing of video from VOBs (programs streams).
Transport and PVA coming.

4. Fixes crash with long GOPs.

5. Fixes error tolerance on stream video errors.

6. Fixes problem with indexing for some selection operations. (This is a killer for 1.1.0.)

7. Further improvements to the Info dialog.

marcellus · 3rd February 2005, 01:10

Hi Neuron2
I am really sorry, that me compressing with 7-zip a m2v file sounded like I want to make you install anything, I'm not so arogant. I just thought that is a commonly enough spreaded compression, especially in open source world, so it wouldn't be a problem. I was wrong and I appologize for that.

Is true that the obtained compression ratio is only 75-80% but also true is that I'm on a dial-up connection that, beside being expensive, is highly unreliable, so I tried everything to accomplish a successful transfer before anything bad happens to the line (since AFAIK there are no such thing as resumed upload - or there are? -my experience in uploading is next to 0).

I owe Cyberia my gratitude for being so nice to unzip the files. Thank you!

That being said, I downloaded beta 6 and I can confirm that it works flawlesly on my files. Thank you, Neuron2, for taking into acount this rather exotic issue and putting the effort to solve it!
Bye.

TEB · 3rd February 2005, 09:59

@neuron2: Beta6 seems fine but i still get a Video Error 1 and later on a Video Error 2 when previewing the u571.remuxed.ts file..
It seems ok so i shall not nag !

just a tiny FYI!.

I tested some other files now and im getting a: Video error 5, 1, 10.. also from time to time.. are these error codes?

neuron2 · 3rd February 2005, 14:16

Those errors occur due to real errors in your MPEG2 stream. Are you capturing from a bad signal or something?

The numbers are the "Fault_Flag" value:

1: bad block coefficients
2: bad macroblock type
4: bad macroblock address increment
5: bad prediction
10: bad motion code
99: newbie detected

TripleA · 3rd February 2005, 14:53

Quote:

Originally posted by neuron2
So to save less than 2MB on an upload, marcellus is forcing me to install some SW I don't need or want? Sorry Charley.

This point perhaps is not too significant, but having a wrapper would ensure the file's integrity: if the upload/download is broken for whatever unlikely reason, the extraction will fail.

Admittedly the same effect can be achieved with any compression/packaging.

But 7z is actually quite nice, to go a bit OT, in my experience. Best compression I saw, if a bit slow. And has always worked, for me. Please give it another try when you compress something next.

TEB · 3rd February 2005, 14:54

@Neuron2: No thats why im worried... Its transports from our VOD service at work.. And im testing the content i have + DVB satellite streams to make dgindex robust..
It is possible to make a loggingwindow with some summary of the errors he finds? Would be very interesting..
Specially like the 99 one

hits me on the spot !! haha

2nd February 2005, 14:25	#62 \| Link
len0x I'm afraid we've to stop Join Date: Mar 2003 Location: Amongst mad people Posts: 5,402	IC. Interesting... Can debug parameter be added to mpeg2source to produce the same information as info=true does? __________________ Gordian Knot Family: Gordian Knot: website, download Auto Gordian Knot: Website and download, tutorial, FAQ

2nd February 2005, 14:40	#64 \| Link
len0x I'm afraid we've to stop Join Date: Mar 2003 Location: Amongst mad people Posts: 5,402	Also I have an idea for ColorMatrix purposes. Have an auxiliary function that catches hints from mpeg2source and use them in any form feasible (may be like tritical proposed in some cases). Later ColorMatrix can use that info from auxiliary function. So this ensures that Don has to make hints thing working only once and don't change implementation even if another way of parsing frame info is found/suggested. This auxilary function will be a part of ColorMatrix plugin and can be developed totally separate from DGDecode. __________________ Gordian Knot Family: Gordian Knot: website, download Auto Gordian Knot: Website and download, tutorial, FAQ

2nd February 2005, 16:06	#66 \| Link
len0x I'm afraid we've to stop Join Date: Mar 2003 Location: Amongst mad people Posts: 5,402	I know, but implementation can be imperfect (i.e. for DVD sources it may be unlikely that different coefficients are used throughout the movie. That's why I asked if info() can be exposed in debug mode so that I can try running some automatic tests to see if we really need frame-by-frame info for ColorMatrix). __________________ Gordian Knot Family: Gordian Knot: website, download Auto Gordian Knot: Website and download, tutorial, FAQ

2nd February 2005, 18:13	#71 \| Link
neuron2 _ Join Date: Jan 2002 Posts: 16,634	You missed my point. I don't want to install it. He can please upload the uncompressed file. I estimate that it will be 9MB instead of 7MB. Last edited by neuron2; 2nd February 2005 at 18:16.

2nd February 2005, 22:39	#74 \| Link
fccHandler Registered Jedi Join Date: Jan 2003 Location: Georgia, U.S.A. Posts: 734	K __________________ May the FOURCC be with you...

2nd February 2005, 15:34	#65 \| Link
neuron2 _ Join Date: Jan 2002 Posts: 16,634	@marcellus How do I open a .7z file? Can't you just put the stream there directly? @len0x The data has to be put somewhere that the receiving filter can access.

2nd February 2005, 16:55	#67 \| Link
tritical Registered User Join Date: Dec 2003 Location: MO, US Posts: 904	Hm, one more thought... with the imbedded hints method you could make a generic wrapper filter that could preserve the hints accross filters that would ordinarily destroy them. One single generic version could not work for all filters, but it would be able to work for any filter that is 1:1 input output, such as resamplers, most denoisers, etc...

2nd February 2005, 17:51	#69 \| Link
neuron2 _ Join Date: Jan 2002 Posts: 16,634	So to save less than 2MB on an upload, marcellus is forcing me to install some SW I don't need or want? Sorry Charley.

2nd February 2005, 18:46	#72 \| Link
Cyberia Moderator Join Date: Nov 2002 Location: Inside Posts: 718	Don, I uncompressed both 7z files and uploaded them to your site. Hope that was OK. gop_499.m2v long_gop.m2v

2nd February 2005, 21:35	#73 \| Link
neuron2 _ Join Date: Jan 2002 Posts: 16,634	Sure, no problem. So his 499 picture GOP makes a line in the D2V that is 1500+ characters long. Would you have thought of making your sprintf() temporary buffer that long? I've fixed it in beta 6, to be released shortly. Beta 6 also fixes the long-standing decode bug I mentioned. We will be much more error tolerant. It'll still report the error in the info box, because it is a real stream error it turns out, but we won't macroblock the pictures all to hell. It's at least as tolerant as VirtualDub MPEG2 now. Thanks for access to your code, fccHandler!

2nd February 2005, 23:16	#75 \| Link
neuron2 _ Join Date: Jan 2002 Posts: 16,634	1.2.0 beta 6 http://neuron2.net/fixd2v/dgmpgdec120b6.zip Relative to the brain-dead 1.1.0: 1. Adds demuxing of AAC audio from transport streams. 2. Adds preliminary support for PVA streams. 3. Adds demuxing of video from VOBs (programs streams). Transport and PVA coming. 4. Fixes crash with long GOPs. 5. Fixes error tolerance on stream video errors. 6. Fixes problem with indexing for some selection operations. (This is a killer for 1.1.0.) 7. Further improvements to the Info dialog.

3rd February 2005, 01:10	#76 \| Link
marcellus Registered User Join Date: Mar 2004 Posts: 94	Hi Neuron2 I am really sorry, that me compressing with 7-zip a m2v file sounded like I want to make you install anything, I'm not so arogant. I just thought that is a commonly enough spreaded compression, especially in open source world, so it wouldn't be a problem. I was wrong and I appologize for that. Is true that the obtained compression ratio is only 75-80% but also true is that I'm on a dial-up connection that, beside being expensive, is highly unreliable, so I tried everything to accomplish a successful transfer before anything bad happens to the line (since AFAIK there are no such thing as resumed upload - or there are? -my experience in uploading is next to 0). I owe Cyberia my gratitude for being so nice to unzip the files. Thank you! That being said, I downloaded beta 6 and I can confirm that it works flawlesly on my files. Thank you, Neuron2, for taking into acount this rather exotic issue and putting the effort to solve it! Bye.

3rd February 2005, 09:59	#77 \| Link
TEB Registered User Join Date: Feb 2003 Posts: 235	@neuron2: Beta6 seems fine but i still get a Video Error 1 and later on a Video Error 2 when previewing the u571.remuxed.ts file.. It seems ok so i shall not nag ! just a tiny FYI!. I tested some other files now and im getting a: Video error 5, 1, 10.. also from time to time.. are these error codes? Last edited by TEB; 3rd February 2005 at 10:24.

3rd February 2005, 14:16	#78 \| Link
neuron2 _ Join Date: Jan 2002 Posts: 16,634	Those errors occur due to real errors in your MPEG2 stream. Are you capturing from a bad signal or something? The numbers are the "Fault_Flag" value: 1: bad block coefficients 2: bad macroblock type 4: bad macroblock address increment 5: bad prediction 10: bad motion code 99: newbie detected

3rd February 2005, 14:54	#80 \| Link
TEB Registered User Join Date: Feb 2003 Posts: 235	@Neuron2: No thats why im worried... Its transports from our VOD service at work.. And im testing the content i have + DVB satellite streams to make dgindex robust.. It is possible to make a loggingwindow with some summary of the errors he finds? Would be very interesting.. Specially like the 99 one hits me on the spot !! haha

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode