Log in

View Full Version : Is this Rainbowing ?


Vaper
28th April 2007, 18:27
http://i91.photobucket.com/albums/k304/vaper_01/Rainbow1.jpg

http://i91.photobucket.com/albums/k304/vaper_01/Rainbow2.jpg

http://i91.photobucket.com/albums/k304/vaper_01/Rainbow3.jpg

http://i91.photobucket.com/albums/k304/vaper_01/Rainbow4.jpg

I did a 4 pass CCE encode AVI > MPEG2 with this script, it always seems to appear on flat and usually dark low detail surfaces. It looks like squiggly yellow and red lines that usually disappear when it is paused.

LoadPlugin("C:\Dgindex\DGDecode.dll")
LoadPlugin("C:\Program Files\AviSynth 2.5\plugins\deen.dll")
AVISource("C:\DOCUME~1\Vince\Desktop\25 no sound.avi",audio=false)
LanczosResize(704,320,0,0,588,240)
AddBorders(0,128,0,128)
MipSmooth(preset = "rainbow")
ConvertToYUY2()

any suggestions ?

Pookie
28th April 2007, 18:51
Rainbowing is rapidly fluctuating chroma noise, usually visible at the edge of a line, especially white and black.

Looks like you read an older guide to Avisynth, considering the filters you chose. That particular film was poorly transfered to DVD. I was shocked when I first put the DVD in, good thing it was on sale.

fft3dfilter(sigma=1,degrid=1) was pretty effective at scraping off the top layer of gunk.

if you're getting chroma noise, you can change the above to this:

fft3dfilter(sigma=1,degrid=1,plane=4)

DarkT
28th April 2007, 19:33
I belive the name for that one is "banding"? Please somebody verify - I get that sometimes too, not on such scales though... When I smooth something out a bit too much... I think... Will try that use of fft3d...

wonkey_monkey
28th April 2007, 19:52
All I can see is posterisation, which you'll be hard pushed to get rid of, if it's in your source.

It's odd that you said it disappears on pause - are you using VirtualDub for playback? If so, perhaps it's set to 16-bit overlay. That could also explain why it looks so terrible, and why it looks okay when paused (because vdub stops using overlay).

David

PS You may want to re-read the forum rules, particularly rule 6 - unless the AVI came from a DVD that you already own (which would be odd)

Vaper
29th April 2007, 06:59
Thanks for reply's

I cant see any of it in my source.

David it is VDub playback but i am burning for use on my tv and the same problems appear through the dvd player

i did a search on Posterization and im preety sure that is what it is though.

i will try out the ff3d filter and report back

Vaper
29th April 2007, 10:37
Ok i tried
fft3dfilter(sigma=1,degrid=1,plane=4)

It didnt do anything, could of possibly made it worse

http://i91.photobucket.com/albums/k304/vaper_01/more.jpg

http://i91.photobucket.com/albums/k304/vaper_01/more2.jpg

Leak
29th April 2007, 11:02
You still didn't answer where that AVI comes from :mad: but you might want to try this (http://forum.doom9.org/showthread.php?t=108681)...

np: Hug - Tactic Without Practice (Heroes)

Soulhunter
29th April 2007, 14:00
To me it looks 24 -> 16 bit transformation without dithering... >.>


Bye

Vaper
29th April 2007, 17:30
You still didn't answer where that AVI comes from :mad: but you might want to try this (http://forum.doom9.org/showthread.php?t=108681)...

np: Hug - Tactic Without Practice (Heroes)

Tried it out, no luck

Vaper
29th April 2007, 17:46
To me it looks 24 -> 16 bit transformation without dithering... >.>


ok, is there some kind of way to introduce dithering into my script ?

Pookie
29th April 2007, 18:23
Just go back to your original DVD. Mine has a layer of noise which I was able to remove with fft3dfilter, and I don't have any banding.

Soulhunter
29th April 2007, 19:59
ok, is there some kind of way to introduce dithering into my script ?

If it is what I think you dont have to introduce dithering... You just have to make sure that it doesnt get converted to 16bit colors while playback... Make sure you turn the hardware acceleration of ya graphicscard on and that ya desktop uses 24/32 bit colors... Also make sure that VDub's output color depth is set to 24bit!

How does the source video look in VDub? Screenshots!? How does the source AVS look in VDub? Scrennshots!? Whats the bitrate you use in CCE? Whats the source format and whats used for decoding it?


Bye

Vaper
29th April 2007, 20:40
If it is what I think you dont have to introduce dithering... You just have to make sure that it doesnt get converted to 16bit colors while playback... Make sure you turn the hardware acceleration of ya graphicscard on and that ya desktop uses 24/32 bit colors... Also make sure that VDub's output color depth is set to 24bit!

How does the source video look in VDub? Screenshots!? How does the source AVS look in VDub? Scrennshots!? Whats the bitrate you use in CCE? Whats the source format and whats used for decoding it?


Bye

When i changed Vdubs output to 24bit the banding was gone but if i burn the encoded mpeg2 to dvd and play it on TV the banding is there

here is the source

http://i91.photobucket.com/albums/k304/vaper_01/Source1.jpg

http://i91.photobucket.com/albums/k304/vaper_01/Source2.jpg

http://i91.photobucket.com/albums/k304/vaper_01/Source3.jpg

- Bitrate -
min 2000
avg 4200
max 9200

3-4 Pass VBR

M=3 MN=4
Flat Part Priority 40Intra Block DC = 10
Block scanning Order = ZigZag

I tested out the broadsword filter and it completely fixed it but im not prepared to hang around a week for 1 encode :)

Chainmax
30th April 2007, 02:48
Broadsword filter?

Soulhunter
30th April 2007, 11:34
When i changed Vdubs output to 24bit the banding was gone...

This means it has nothing to do with the source or the filtering, but with the playback/displaying!

...but if i burn the encoded mpeg2 to dvd and play it on TV the banding is there

Makes no sense... Maybe its a different kind of banding? How do you play the DVD on TV? A standalone DVD player, or via the TV out of your graphics card? What TV do you use? One of this new LCD TVs?


Bye

Soulhunter
30th April 2007, 11:43
Broadsword filter?

History lesson:

Originally it was a denoiser from pruned... I was complaining about banding in my sources all the time, and after pruned got ergo proxy which was full of banding as well, he modded Broadsword to a [***** slow] debanding filter which I posted somewhere here at Doom9's... But soon we realized that debanding before encoding makes near like no sense [compression/quantization destroys the dithering again] so there was need for something fast that you can use realtime for post-processing... This way GradFun was born! :]


Bye

Vaper
30th April 2007, 15:58
Makes no sense... Maybe its a different kind of banding? How do you play the DVD on TV? A standalone DVD player, or via the TV out of your graphics card? What TV do you use? One of this new LCD TVs?


Through a dvd player, ive tested it through several dvd players and i get the same result. Should the CCE misc options ( AVI file decoding ) be checked or unchecked ? If i uncheck them it gives me an "unknown format" error.

Im starting to lose patience lol im thinking of swapping to procoder to see if it makes a difference, shouldnt CCE be converting to YV12 ? becsaue it obviously isnt becasue 24 bit is not YV12 am i wrong ?

techreactor
30th April 2007, 18:33
with an Xvid its very difficult to remove those artifacts(since its in the source), you can try using mild DCTfilter() or Blockbuster() and cross your fingers, wishing to get these get removed.

Do not use any sharpeners, it enhanced the artifacts.

Vaper
30th April 2007, 23:58
i tried blockbuster i can see how this would help slight colour banding but in my situation its simply stickytaping a big problem, id say it made a 5% improvement

Soulhunter
1st May 2007, 19:04
Uh, I think I give up... Seems you dont understand what I wrote n what the real the problem is... Either read up n improve ya understanding of things like this or buy the ****** DVD!


Bye

Vaper
1st May 2007, 23:43
Uh, I think I give up... Seems you dont understand what I wrote n what the real the problem is... Either read up n improve ya understanding of things like this or buy the ******* DVD!


Bye

Yes well, unfortunately we cannot adjust DVD player settings like we can in VDUB

Soulhunter
2nd May 2007, 13:53
Ok, lets summarize the situation: You said the problem vanishes in VDub when you set it from 16bit -> 24bit playback, right? This means: The banding you saw in VDub was the result of watching the stuff in 16bit colors... You said you get the same problem when playing the resulting DVD in a DVD, right? Ok, this probably means that you see some other sort of banding [does it really look exactly the same?] than you saw in VDub... Because I cant see how CCE could transform YV12 -> 16bit RGB -> YV12... When you rip the resulting DVD n feed it via DVD2AVI+AVS -> VDub, what do you get? If theres no banding its playback related [probably the display/tv... is it a LCD TV?]. But if there is banding, its CCE/encoding related [caused by the 2nd compression or by some level conversation, dunno...]. No matter, better use the original DVD n make a simple DVD5 transcode via tools like DVD Shrink or so...


Bye