YV12: mpeg2dec, mpeg2dec2 and mpeg3dec developers

[Marc FD]

> I also noticed that there's somenthing in the left border.

yellow dots, right ? might be the know bug of XviD old colorconv.

[Gaia]

Originally posted by Marc FD
> I also noticed that there's somenthing in the left border.

yellow dots, right ? might be the know bug of XviD old colorconv. Not quite sure how to descripe it. Maybe dots maybe somekind of line too...

[Rrrough]

do they also appear when using another compressor (e.g. DivX) ?

[Marc FD]

>Not quite sure how to descripe it. Maybe dots maybe somekind of line too...

a bit this way :

-- normal pixels
xx yellow dots

------
xx----
------
xx----
------

on the left side only.

>do they also appear when using another compressor (e.g. DivX) ?

if i remember well, it's only on decoding, so it's not in the bitstream.
and i think the new color convertions fixed it. but i'm not sure it's been commited to CVS now.

[Rrrough]

f i remember well, it's only on decoding, so it's not in the bitstream. maybe gaia could change the 4cc to divx and use divx decompression or try ffdshow and see if it's still there...

cheers

[Gaia]

Originally posted by Marc FD
>Not quite sure how to descripe it. Maybe dots maybe somekind of line too...

a bit this way :

-- normal pixels
xx yellow dots

------
xx----
------
xx----
------

on the left side only.

>do they also appear when using another compressor (e.g. DivX) ?

if i remember well, it's only on decoding, so it's not in the bitstream.
and i think the new color convertions fixed it. but i'm not sure it's been commited to CVS now. I have to try Divx but yes i quess it's like you descriped them.

[Koepi]

Your description looks exactly like the xvid decoder bug. If isibaar finds some time and is bored (means: has no other interesting features to play with), he'll fix that MMX code. Go to XviD configuration and there to the CPU tab and disable all mmx/sse stuff and you'll see the yellow spots are gone.

Regards,
Koepi

[Marc FD]

if you see it in VDub, i'm pretty sure it's the YV12->RGB32 convertion.
try with DX50 fourcc and see.

@Koepi

could you commit the checkbox in vfw to CVS, i'd like to test it, and i'm a noob to change the interface. thanks.

[Koepi]

Marc,

I'll send you the sources. They are for current CVS, thus already supporting chroma me :) The first test run here looks very promising, but since gruel's a little angry with me I fear I won't release a binary until it proved to work alright here.

Regards,
Koepi

[Marc FD]

just send vfw, i've a 5 min old xvidcore, i guess it's okay (i've the last ME)

but i don't have checkboxes ^^

BTW, i'll apply the patch to test the new color convertions

[Gaia]

Thanks for help. Now only problem is that green line at the bottom.

[Marc FD]

@Koepi

thx.

@Gaia

i think Sh0dan will fix that very fast as always.

[Koepi]

XviD-04112002-1:
- Fresh CVS checkout. GMC improvements.
- New mod. HQ quant type reimplemented.
- Added checkbox for chroma motion estimation (slow but better PSNR).

So now everyone can test it...

Regards,
Koepi

[Rrrough]

@all,

as you can see that there's a lot of changes going on on the XVID-development branch, please make sure when reporting possible avisynth problems/bugs that you test with another codec as well, as there might be some problems/bugs related with these _unstable_ xvid dev builds.
just an idea to make avisynth debugging easier.

cheers

[iago]

@Rrrough and all,

Regarding the green line problem, With all my XviD encodes (including Koepi's 04112002-1 build) and today's AviSynth 2.5 binary too, the green (or sometimes pinkish) line is still there at the bottom. Changing the FourCC to Divx, decoding with ffdshow or DivX 5.02 decoder or using Nic's latest DSF, or disabling XviD optimizations (though I don't know if the green line is the same issue as the yellow dots mentioned) doesn't change a thing.

To make sure I did a test encode with DivX 5.02 as well, and the green line problem persists with DivX 5.02 too (decoded with DivX Decoder - 5.02).

Below is my avs script:

--------------------------------------------------------
LoadPlugin("C:\FILTERS\mpeg2dec3 YV12.dll")
mpeg2source("D:\RIP\RIP.d2v",blend=true,cpu=4,lumoff=-2)
crop(12,8,-12,-8)
BicubicResize(512,288,0,0.75)
--------------------------------------------------------

regards,
iago


edit1: Windows XP - Celeron 900 - ZoomPlayer and MPC

edit2: Tom, it's really nice to hear that you're gonna release UnFilter YV12, though you say it's not in your utmost-priority list! ;)

edit3: Koepi, many thanks for the new toy to play with, which has a lot of new features as well! ;)

edit4: Rewriting the crop parameters in the above script as crop(16,8,-16,-8) and encoding with it doesn't make a difference either.

edit5: I tried with mpeg2source("D:\RIP\RIP.d2v") as well, to check if the problem is related with mpeg2dec3 YV12 parameters, but it does not seem to be related with mpeg2dec3 YV12 either.

[sh0dan]

The thin green line is probably an AviSynth resizer bug I haven't found yet. I'm working on it however :)

Edit: (and it isn't an easy one to find) :angry:

[iago]

@shOdan

Many thanks for your time and effort regarding the "green line" issue. I'm almost sure it will be resolved very soon, since it's under your very investigation! ;)

best regards,
iago

[HarryM]

Originally posted by iago
@shOdan

Many thanks for your time and effort regarding the "green line" issue. I'm almost sure it will be resolved very soon, since it's under your very investigation! ;)

best regards,
iago

You can crop this green line away... :D :D :D

[sh0dan]

Originally posted by iago
Many thanks for your time and effort regarding the "green line" issue. I'm almost sure it will be resolved very soon, since it's under your very investigation! ;)

Got it (almost sure) - One of the more stange bugs I've had. What you can learn from this is: Never use the same variable name for a private class variable and a local function variable. (This bug is a very old one, but it just never showed up until multiple planes were added ;)

You can expect a speedup from this too (wow - a bugfix with a speedup!)

[iago]

@shOdan

Great news that you have pinpointed and solved the problem! And the solution comes with even more speed gain! What can I say?! ;)

thanks a lot for all your great work,
iago

Edit: Tested and confirmed! Green line is history now! ;)

[iago]

@Marc,

I guess lumoff parameter does not work in your "mpeg2dec3 YV12.dll", right? I really would like to be able to use it with YV12 ;).

regards,
iago

[trbarry]

Tom,
That's great news, glad to hear your working on them already. When you say "dot remover", are you speaking about the so called "mosquito noise" we see on DVD sources? I know your mostly into HDTV so maybe I'm off base here.

MaTTeR -

Not off base at all. It is a fairly fast simple deringing median filter designed to remove stray dots. It should somewhat handle ringing and mosquito noise. It may not have as strong an effect as the one I did for Xvid/ffdshow but should be maybe twice as fast.

Some really superficial testing shows it gives maybe a 5-10% compression improvement at Xvid quant=2 for clean (superbit) source without any obvious loss of detail. But this is brand new, experimental, and only for the Avisynth 2.5 alpha testing (SSEMMX only).

I intended this somewhat to be a simple example of a mixed YUY2 and YV12 (no RGB) filter. Anyway, see:

www.trbarry.com/Readme_UnDot.txt and
www.trbarry.com/UnDot.zip (source & dll)

And FWIW, after demuxing HDTV caps are basically just Vobs, YV12/mpeg2 video with ac3 sound except lots more pixels. They can have the same blocking and ringing problems as a DVD and can be IVTC'd and deinterlaced the same. But many of the same tools work and Avisynth/Virtualdub/Xvid is still the way to go. I recommend everybody get a HDTV card for captures if there are any stations where you live. It's like they are broadcasting free 1920x1080i DVD's (but cut for prime time audiences, the "airplane versions").

But because of the huge resolution they are pig slow to process which makes Sh0dans new YV12 support the neatest thing since sliced bread.

Thanks, Sh0dan. ;)

- Tom

[MaTTeR]

Tom,

Thx for the speedy filter. I ran a full 2pass encode last night using latest AVS 2.5 alpha along with Koepi's latest 11-04 dev build. No problems at all and I did gain about 7% in compression. Visually I don't see any loss of detail. While the source isn't SuperBit, it's still one of the cleanest DVD transfers you'll see for an older movie(Romeo is Bleeding). So I guess it's safe to change your readme to indicate it has been tested on AMD Athlons:)

Dual AMD XP 1600s
Win2k w/ SP3
512MB PC2700 DDR

BTW- Many thx for that HDTV info, I had never really paid much attention to it until this weekend I seen a beautiful Fuji HDTV at my local AV store. Unfortunately it was almost $10K but certainly had the best picture I've ever seen. It would be worth me buying HDTV just for the National Geo. HDTV channel thats broadcasted here.

[int 21h]

You all may be interested in checking out:

http://forum.doom9.org/showthread.php?threadid=36768

Its a commandline encoding application specifically for Avisynth written by [Toff], and today I added two pass functionality to it (with XviD in mind). Give it a whirl (It supports YV12).

[Marc FD]

>I guess lumoff parameter does not work in your "mpeg2dec3 YV12.dll",
>right? I really would like to be able to use it with YV12 .

It works, and all other features too, because everything is working in YV12 colorspace.

[iago]

@Marc

The results I get when using lumoff=-96 and no lumoff parameter are the same, which is impossible, since a value of lumoff=-96 should darken out the encode considerably! ;)

To make sure, can you or someone else check that on another machine please?

(mpeg2dec3 YV12.dll - Avs2.5 (4-11-02) - XviD 04112002-1)

regards,
iago

[unplugged]

Originally posted by int 21h
You all may be interested in checking out:

http://forum.doom9.org/showthread.php?threadid=36768

Its a commandline encoding application specifically for Avisynth written by [Toff], and today I added two pass functionality to it (with XviD in mind). Give it a whirl (It supports YV12).
Maybe?

YV12@#]/@€£$"òç!!!

Boys, this AVS2AVI utility really ROCKS !!!

It takes almost NO TIME to setup!!! :D
Very easy to insert in batch files toghether with other stuff + shutdown command ;) and goes up to 40fps with my Athlon 2100+ even with B-Frames at hi-res!!

Love infinitely command-line tools... :p

Thanx TOFF!

Waiting Suiryc for OGG mod ;)

[MaTTeR]

Originally posted by iago
The results I get when using lumoff=-96 and no lumoff parameter are the same, which is impossible, since a value of lumoff=-96 should darken out the encode considerably! ;)

Iago is correct of course, changing the value either direction gives no effect to the encode whatsoever. However, I can confirm that various PP/CPU modes are working. I still never understood what blend=xxxx did so I never play with it:confused:

[ookzDVD]

Hmmm....

I have the same speed of encoding even the "default" or the tricky
"yv12" mode both the same speed with the same script and xvid settings, both about ~17-19fps on my Athlon XP +1700.

I think I'm missing something or it's my bad machine :(

[MaTTeR]

I think I've just ran across a nasty bug but I'm not sure who the culprit is at this time. For whatever reason, encoding with a resolution of 612x332 almost doubles or triples my file size compared to a resolution of 608x332.

Koepi's Dev Xvid build- 04112002 using Chroma motion option with MPEG fixed quantizer of 2. Also using latest AVS 2.5 alpha build dated as 11-04-2002 along with shOdan's hacked VdubMPG2 app.

Sample Script- LoadPlugin("C:\Program Files\AviSynth2\plugins\MPEG2DEC3 YV12.dll")
mpeg2source("D:\test\romeo.d2v")
crop(8,4,704,464)
LanczosResize(604,328)
Limiter()

Replacing the resizer line above with LanczosResize(608,332) gives expected results. Please forgive me if I'm overlooking something very obvious here, it was a very long day at work. Can anyone else reproduce the results though?

Edit-
@ookzDVD,
Can you post your script and XviD build?

Edit2-
@all,
Uhgg...guess I'll try reproducing my file size problem with Divx5 quants now to make sure this isn't an XviD issue.

Update: Moderator, please merge this post with the following Xvid thread. (http://forum.doom9.org/showthread.php?s=&postid=205847#post205847) In fact I was unable to reproduce the problem using Divx 5.02

[ookzDVD]

@MaTTeR,

Here is my script :

LoadPlugin("C:\PROGRA~1\GORDIA~1\mpeg2dec3 yv12.dll")
mpeg2source("C:\Documents and Settings\Administrator\My Documents\murder.d2v",lumoff=-2)
crop(0,0,-2,-2)
LanczosResize(640,352)

[Wilbert]

Last evening I tried Vobsub (which is supposed to work in YV12), but it doesn't work at all in AviSynth 2.5 alpha. I will contact Gabest.

[Chibi Jasmin]

Originally posted by unplugged
Boys, this AVS2AVI utility really ROCKS !!!


And girls? :)

Well, you're right, I also played with it and I love it...avs2.5 + mpeg2dec3 yv12 + avs2avi is fine for yv12... :D

[Marc FD]

>The results I get when using lumoff=-96 and no lumoff parameter are the
>same, which is impossible, since a value of lumoff=-96 should darken out
> the encode considerably!

oups ^^
maybe i've commented the luma filtering with the YV12->YUY2 stuff.
because it's just before.

i'll try to release MPEG2Dec3 beta 7 with YUY2/YV12 choice and cleanded settings.

@Sh0dan :
are filters compiled for avisynth 2.5 compatible with 2.06 if i keep YUY2 colorspace ?

maybe i should wait until YV12 is stable. it's why i said i would stop to code.

BTW, is it possible to try to improve DirectShowSource in avisynth 2.5 ??
*.grf files support and/or sound support would be great. i hate dshow, but i admit it's sometimes a very usefull tool.

Cheers,
MarcFD

[sh0dan]

are filters compiled for avisynth 2.5 compatible with 2.06 if i keep YUY2 colorspace ?

No - and they never will. The internal structures have changed, and some have been added, so a 2.5 filter cannot work with earlier versions.
However a minor set of #ifdefs should make it possible to keep the two versions side by side.

[EDIT!] I've been talking to Gabest regarding VobSub, and he suggested that we should replace "AvisynthPluginInit" for plugins with "AvisynthPluginInit2" for 2.5 plugins. That way there will not be any conflicts at least. I still think you would need to compile two seperate dll's, since it refers directly to the structures of avisynth.h.


maybe i should wait until YV12 is stable. it's why i said i would stop to code.

You're free to wait. YV12 will probably not change much more, since it seems to be working very nice internally, both performancewise and codewise (easy/good enough to use for plugin writers).

There will probably be added a few helper functions to Environmnet Settings in avisynth.h, but nothing major.

BTW, is it possible to try to improve DirectShowSource in avisynth 2.5??
*.grf files support and/or sound support would be great. i hate dshow, but i admit it's sometimes a very usefull tool.

If you know how - yes! VFW and DirectShow was a dark hole for me until recently. I've learned some basics about VFW, but Directshow is still trial and error. I would love to add sound support, and GRF-support, but I have no idea where to start, and I would rather spend the time on finishing up 2.5 instead of beginning on a new project.

[trbarry]

I still also have Divx5 installed which means that even when I send Vdubmpg2 YV12 data I can still see the preview, etc.

But when I set vdub to Fast recompress then it still should be passing the data directly to Xvid as YV12 without conversions, right?

I don't know how I would be able to test that except for speed and I don't know enough about how vdub works to be sure.

And, is that Divx YV12 decompressor even included in the free (non-adware) version of Divx 5?

- Tom

[sh0dan]

Originally posted by trbarry
But when I set vdub to Fast recompress then it still should be passing the data directly to Xvid as YV12 without conversions, right?

Yes

I don't know how I would be able to test that except for speed and I don't know enough about how vdub works to be sure.

The only way I know. You could try the new great "AVS2AVI" - it reports the colorspace used! But it's command-line based, so there is no preview there either.

And, is that Divx YV12 decompressor even included in the free (non-adware) version of Divx 5?

Don't know - anyone?

[HarryM]

Where can I find AVS2AVI utility?

I find on google, I can't find it!

[hakko504]

Originally posted by HarryM
Where can I find AVS2AVI utility? In a threaed in the developers forum here, called Command Line Compressor (http://forum.doom9.org/showthread.php?s=&threadid=36768)

[Rrrough]

And, is that Divx YV12 decompressor even included in the free (non-adware) version of Divx 5? yep. (what an elaborate and thoughtful answer, I know ;) )

[iago]

i'll try to release MPEG2Dec3 beta 7 with YUY2/YV12 choice and cleanded settings.

Marc,

Nice to hear that! I'm really looking forward to it and getting the lumoff parameter back again! ;)

regards,
iago

[ookzDVD]

Yes, I finally could notice some YV12 speed improvement over the
YUY2... it's about 10-15% on my machine... not bad :)

[Koepi]

@MarcFD:

Any progress with mpeg2dec3+yv12 choice / beta7? ;)

@all:

How's vdub-mod coming along? :)=

Best regards,
Koepi

[vlad59]

As it seems there is two thread about Avisynth 2.5, I also post here.

The first beta of Convolution3DYV12 is out you can find it here (http://forum.doom9.org/showthread.php?s=&threadid=36279)

Thnaks in advance for the feedback

[MaTTeR]

Originally posted by vlad59
The first beta of Convolution3DYV12 is out Very cool Vlad. My testing begins in about 9hrs from now:)

BTW- The readme is showing all presets using the same values of- (0, 32, 128, 32, 128, 10, 0).

Edit- First impressions of the speed seem to be pretty good.

LoadPlugin("C:\Program Files\AviSynth2\plugins\MPEG2DEC3_YV12.dll")
mpeg2source("D:\Lost\lost.d2v",iDCT=2,cpu=1,moderate_h=45,moderate_v=65)
crop(8,58,704,368)
UnDot()
Convolution3D(0,2,3,2,3,2.8,0)
LanczosResize(624,264)

Averaging 29FPS with XviD and Chroma motion at Motion Search 6, latest dev build from Koepi. Thx Vlad

[vlad59]

Originally posted by MaTTeR
Very cool Vlad. My testing begins in about 9hrs from now:)

BTW- The readme is showing all presets using the same values of- (0, 32, 128, 32, 128, 10, 0).


Do you mean that the presets don't work anymore ?????

[Rrrough]

@vlad59

thank you very much for your yv12 implementation of convolution3d. will try it asap.

@all

suxen_drol from the xvid-development team developed external colorspace api support, so there is YV12 preview with vdub(mod) and XVID support already committed to CVS. it's supposed to be faster than divx5 too.

cheers

[iago]

@vlas59

Thanks for convolution3d YV12! Gonna try it asap! ;)

@Marc

Any good news on the mpeg2dec3 beta7 side? ;)

regards,
iago

[Marc FD]

>Any progress with mpeg2dec3+yv12 choice / beta7?

it's WE, so i'm gonna work on it.
I've a problem. maintain compatibility with avisynth 2.06 will be a source of bugs and would cost me to much time for packaging,ect..

and you all know i prefer the coding part ^^

so i'm gonna make MPEG2Dec3 beta7 compatible ONLY with Avisynth 2.5. It's beta now, and more users would help to improve stability.

It'll ONLY output in YV12, but i'll add the internal YV12->YUY2 convertion (for debugging, and to keep compatibility with MPEG2Dec. MPEG2Dec3 would still be able to give the same results than MPEG2Dec. (maybe not exactly, because of the ssemmx Motion Compentation)

i need to find a _very_ accurate way of detecting combing on MPEG-2 streams. i think i'll add a pratical-check : search for combing on the frames. if auto-combing check detection work, it would output a field based clip.

so i've some ideas for next versions. i'll try to release MPEG2Dec3 beta7, with bugfixes, and minor changes first. new features would wait for beta 8.

@vlad59

cool ! bravo.

[trbarry]

Marc -

Is source available anywhere for your MPEG2DEC3 YV12?

I guess yours does not handle HDTV streams so I'm going to have to do MPEG2DEC2, but I'm lazy. ;)

- Tom