MC noise removal script - Page 3

Terranigma · 25th November 2007, 15:45

Quote:

Originally Posted by DeathAngelBR

The blocking seems to be common among filters using mvanalyse or any mvtools thing.

LSF doesn't cause blocking. If your source has blocks, it'd just pronounce it. Your analysis here is correct though, and this script allows you to avoid it by increasing the overlap value. That's one of the reasons why it was added (Although it'd give you better denoising as well.) Try using a blocksize of 8, and overlapping value of 8/2, or 16 16/2, or 4 4/2. Though if you do decide to do this, expect the processing speed to drop tremendously.

DeathAngelBR · 25th November 2007, 17:05

Quote:

Originally Posted by Terranigma

Try using a blocksize of 8, and overlapping value of 8/2, or 16 16/2, or 4 4/2. Though if you do decide to do this, expect the processing speed to drop tremendously.

That didn't work. There's still a *lot* of blocking and bluring.

Spuds · 25th November 2007, 17:08

@DeathAngelBR -- Thanks for the examples, good stuff to work on, look forward to the video clip link so I can do some checking. I'm curious on the blurred frames if they are like that straight from tfm.tdecimate or not.

On the blocking as Terranigma pointed out you can override the default blocksize and overlap to try and deal with them, but be prepared to board the speed pain train

I do have a couple of script ideas I'd like to try out on them to see if they would be effective or not. I'll get to trying those when I get the clip

Terranigma · 25th November 2007, 17:14

Quote:

Originally Posted by DeathAngelBR

Will post an uncompressed vid as soon as I can.

Well, i'll be waiting for the sample.

DeathAngelBR · 25th November 2007, 20:06

http://www.sendspace.com/file/06xiuy
(134MB)

I don't know how to split it into smaller VOBs, so if any of you knows a software to do this I'm all ears.

Terranigma · 25th November 2007, 21:25

Downloaded and tested on the exact same frame as you did (after forcing film since it's 95% film.)

Original:
http://img405.imageshack.us/img405/683/originalvu9.png

MC_Spuds Default:
http://img233.imageshack.us/img233/6813/mcspudssv7.png

MC_Spuds, my suggestion (mc_spuds(blocksize=8,overlap=8/2)):
http://img233.imageshack.us/img233/694/overlapfv9.png

So it's obvious that you weren't doing what I said correctly.

DeathAngelBR · 25th November 2007, 21:57

Quote:

Originally Posted by Terranigma

Downloaded and tested on the exact same frame as you did (after forcing film since it's 95% film.)

Original:
http://img405.imageshack.us/img405/683/originalvu9.png

MC_Spuds Default:
http://img233.imageshack.us/img233/6813/mcspudssv7.png

MC_Spuds, my suggestion (mc_spuds(blocksize=8,overlap=8/2)):
http://img233.imageshack.us/img233/694/overlapfv9.png

So it's obvious that you weren't doing what I said correctly.

What about the frames 1459 and 1603 that have blocks all over?

Also there's this transition from blury frame to better, sharpened looking frame:

Blury:
http://img441.imageshack.us/img441/350/1313blurmk1.png

NOT blury:
http://img441.imageshack.us/img441/1...4normalva8.png

Terranigma · 25th November 2007, 22:01

Quote:

Originally Posted by DeathAngelBR

What about the frames 1459 and 1603 that have blocks all over?

Well I just tried the one frame.
I deleted your sample, so i'll redownload and try it once more for the other troubled frames.

25th November 2007, 23:17

any idea, why i get error. there is no function "unfilter" when i load my script with avsp

Terranigma · 25th November 2007, 23:18

Quote:

Originally Posted by DeathAngelBR

What about the frames 1459 and 1603 that have blocks all over?

Code:

mc_spuds(blocksize=8,overlap=8/2)

Frame 1459:
http://img223.imageshack.us/img223/7...ame1459zz2.png

Frame 1603:
http://img223.imageshack.us/img223/6...ame1603vi2.png

Quote:

Originally Posted by DeathAngelBR

Also there's this transition from blury frame to better, sharpened looking frame:

Blury:
http://img441.imageshack.us/img441/350/1313blurmk1.png

NOT blury:
http://img441.imageshack.us/img441/1...4normalva8.png

Your concerns about this qualm is a valid one, as I too noticed the transition from sharp to blurry.

mcspuds (Frame 1313):
http://img443.imageshack.us/img443/2...13spudscl2.png

mcspuds (Frame 1314):
http://img142.imageshack.us/img142/6...14spudslc6.png

s.w.t. + linedarken (Frame 1313):
http://img118.imageshack.us/img118/2...13urlsdhc5.png

s.w.t. + linedarken (Frame 1314):
http://img510.imageshack.us/img510/6...14urlsdeg2.png

s.w.t. (Frame 1313):
http://img510.imageshack.us/img510/3...3urlsd2sh5.png

s.w.t. (Frame 1314):
http://img111.imageshack.us/img111/3...4urlsd2ku7.png

DeathAngelBR · 25th November 2007, 23:35

s.w.t stands for...?

Terranigma · 25th November 2007, 23:37

Quote:

Originally Posted by DeathAngelBR

s.w.t stands for...?

something whipped together, but only for testing purposes.

ankurs · 26th November 2007, 11:14

Quote:

Originally Posted by foxyshadis

You're absolutely sure you have no cropping or resizing beforehand? Replace mc_spuds with Info() to verify. If it's the case, post your full script.

oops didnt know no resizing or cropping is not before it required .. well putting it before them i got a different error

and this is what i got with info()

and idea ??

P.S Will post my script shortly ..

Dreassica · 26th November 2007, 12:21

You need Unfilter plugin.

HERE

2Bdecided · 26th November 2007, 14:24

Sometimes the motion compensation seems to "stick" on colours, leaving trails like this...

http://www.david.robinson.org/pics/mcspuds_problem.jpg

source clip:
http://www.david.robinson.org/pics/mcspuds_problem.avi

code for that example:

Code:

directshowsource("mcspuds_problem.avi")
tweak(sat=1.3)
bob()
a=last
converttoyv12(interlaced=false)
b=mc_spuds().ConvertToYUY2()
stackvertical(a,b)

Any suggestions?

(Apart from this, I think the denoising is working very well here)

Cheers,
David.

Didée · 26th November 2007, 14:37

Call MC_Spuds with "chro=true". The script's default is to not use chroma during motion search -- the benefit is speed, the drawback is what you have just shown.

2Bdecided · 26th November 2007, 14:52

That should have been what I was looking for Didée, but it didn't solve it at all.

Cheers,
David.

Terranigma · 26th November 2007, 15:38

Quote:

Originally Posted by 2Bdecided

That should have been what I was looking for Didée, but it didn't solve it at all.

Cheers,
David.

It seems as if the motion search analysis is somewhat flawed with this script. The same thing is visible with the images I posted above; It looks like it's adding things from the previous frame, or the frame ahead. Sorta like the artifacts easily witnessed near scene changes if you use the default thsad value for mvdegrain and dct 1, or if you use an absurd high thsad value such as 2000.

Didée · 26th November 2007, 16:16

Okay, 1st guess was wrong.

2nd guess: Are you using "RepairSSE2.dll"? If so, try this: don't import RepairSSE2, but instead the plain Repair.dll or RepairC.dll.

There have been reports of issues with the filter "TemporalRepair()" in some versions, and IIRC it was related to the ~SSE2 versions.
Sorry I can't test this myself right now: although my CPU supports SSE2, every script that uses RepairSSE2 crashes at latest on the 2nd frame ... O_o

OTOH, using the vanilla Repair.dll, I can *not* reproduce the issue on 2Bdecided's sample. I get a clean result without chroma artefacts. That's indeed a hint that the problem lies with TemporalRepair().

2Bdecided · 26th November 2007, 16:30

That's it Didée! Deleting RepairSSE2.dll and dropping in Repair.dll solves the problem, both in that clip, and in other sections I've seen it in.

Thank you so much for your help. You'll get a credit on my finished video restoration (which will never be finished, never mind watched, but it's fun!)

Cheers,
David.

25th November 2007, 21:25	#46 \| Link
Terranigma Space Reserved Join Date: May 2006 Posts: 953	Downloaded and tested on the exact same frame as you did (after forcing film since it's 95% film.) Original: http://img405.imageshack.us/img405/683/originalvu9.png MC_Spuds Default: http://img233.imageshack.us/img233/6813/mcspudssv7.png MC_Spuds, my suggestion (mc_spuds(blocksize=8,overlap=8/2)): http://img233.imageshack.us/img233/694/overlapfv9.png So it's obvious that you weren't doing what I said correctly. __________________ Kurama Link And Fox Doom10 - It's brighter on the other side

26th November 2007, 14:24	#55 \| Link
2Bdecided Registered User Join Date: Dec 2002 Location: UK Posts: 1,673	Sometimes the motion compensation seems to "stick" on colours, leaving trails like this... http://www.david.robinson.org/pics/mcspuds_problem.jpg source clip: http://www.david.robinson.org/pics/mcspuds_problem.avi code for that example: Code: directshowsource("mcspuds_problem.avi") tweak(sat=1.3) bob() a=last converttoyv12(interlaced=false) b=mc_spuds().ConvertToYUY2() stackvertical(a,b) Any suggestions? (Apart from this, I think the denoising is working very well here) Cheers, David.

26th November 2007, 14:37	#56 \| Link
Didée Registered User Join Date: Apr 2002 Location: Germany Posts: 5,407	Call MC_Spuds with "chro=true". The script's default is to not use chroma during motion search -- the benefit is speed, the drawback is what you have just shown. __________________ - We´re at the beginning of the end of mankind´s childhood - My little flickr gallery. (Yes indeed, I do have hobbies other than digital video!)

26th November 2007, 16:16	#59 \| Link
Didée Registered User Join Date: Apr 2002 Location: Germany Posts: 5,407	Okay, 1st guess was wrong. 2nd guess: Are you using "RepairSSE2.dll"? If so, try this: don't import RepairSSE2, but instead the plain Repair.dll or RepairC.dll. There have been reports of issues with the filter "TemporalRepair()" in some versions, and IIRC it was related to the ~SSE2 versions. Sorry I can't test this myself right now: although my CPU supports SSE2, every script that uses RepairSSE2 crashes at latest on the 2nd frame ... O_o OTOH, using the vanilla Repair.dll, I can not reproduce the issue on 2Bdecided's sample. I get a clean result without chroma artefacts. That's indeed a hint that the problem lies with TemporalRepair(). __________________ - We´re at the beginning of the end of mankind´s childhood - My little flickr gallery. (Yes indeed, I do have hobbies other than digital video!)

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

25th November 2007, 17:08	#43 \| Link
Spuds dumber every day Join Date: Dec 2006 Location: Planet Earth Posts: 154	@DeathAngelBR -- Thanks for the examples, good stuff to work on, look forward to the video clip link so I can do some checking. I'm curious on the blurred frames if they are like that straight from tfm.tdecimate or not. On the blocking as Terranigma pointed out you can override the default blocksize and overlap to try and deal with them, but be prepared to board the speed pain train I do have a couple of script ideas I'd like to try out on them to see if they would be effective or not. I'll get to trying those when I get the clip

25th November 2007, 20:06	#45 \| Link
DeathAngelBR Registered User Join Date: Nov 2006 Location: Brazil Posts: 83	http://www.sendspace.com/file/06xiuy (134MB) I don't know how to split it into smaller VOBs, so if any of you knows a software to do this I'm all ears.

25th November 2007, 23:17	#49 \| Link
Vesi Guest Posts: n/a	any idea, why i get error. there is no function "unfilter" when i load my script with avsp

25th November 2007, 23:35	#51 \| Link
DeathAngelBR Registered User Join Date: Nov 2006 Location: Brazil Posts: 83	s.w.t stands for...?

26th November 2007, 12:21	#54 \| Link
Dreassica Registered User Join Date: May 2002 Posts: 384	You need Unfilter plugin. HERE

26th November 2007, 14:52	#57 \| Link
2Bdecided Registered User Join Date: Dec 2002 Location: UK Posts: 1,673	That should have been what I was looking for Didée, but it didn't solve it at all. Cheers, David.

26th November 2007, 16:30	#60 \| Link
2Bdecided Registered User Join Date: Dec 2002 Location: UK Posts: 1,673	That's it Didée! Deleting RepairSSE2.dll and dropping in Repair.dll solves the problem, both in that clip, and in other sections I've seen it in. Thank you so much for your help. You'll get a credit on my finished video restoration (which will never be finished, never mind watched, but it's fun!) Cheers, David.