Dust - a noise remover

Steady · 12th January 2003, 00:51

Hi all, I have returned from never-never land. I brought some magic dust back with me. Please give it a try.

edit - will keep latest version at the top of the thread.

Guest · 12th January 2003, 04:45

Steady!!!!!!!!!!!!!

Welcome back.

It is GREAT to see you here again.

digitize · 12th January 2003, 05:15

hmmm, i'll give it a try (on a noisey anime source).

Kaiousama · 12th January 2003, 11:20

i can go in my noisy anime crypt to bring up a good beast for your filter.

It's testing time, yuppie !!

Welcome back and many many thanks for the new filter

dividee · 12th January 2003, 11:26

Welcome back, Steady !
It's good to see you. I don't know if you read the forum lately, else you have a lot to catch up!

Steady · 12th January 2003, 14:40

Thanks for the warm welcome all

Yes Dividee - I have been lurking for a few days and I feel liking I am starting over from scratch! Avisynth 2.5 with YV12 looks like a good idea that is long overdue. Convolution3d has taken a lot of the wind out of my sails since I had been comparing Dust to TemporalSmoother

Still dust is quite a bit different. It uses motion compensation for the temporal averaging, that is why it is so slow.(82% of the time is spent on motion search). It is going to get slower before it gets faster. I am looking at alternates to simple bilinear(mmx pavgbw) half pel interpolation. I read an interesting paper on using the phase shift information from an FFT for global motion compensation, a radiacal departure from the usual block matching.

It is fun to have a project to sink my teeth into

FuPP · 13th January 2003, 00:13

Probably a stupid question, but is it an avisynth 2.5 filter, because I only get an exception error trying to use my new toy ?

Regards,
FuPP.

Steady · 13th January 2003, 06:27

No, I am using 2.07 (not up to speed on 2.5 yet). What CPU do you have ? I have only tested it on my AthlonXP. It is possible some CPU specific code crept in. What error are you getting, illegal instruction ?

FuPP · 13th January 2003, 11:49

I'm using avisynth 2.5...

Regards,
FuPP

Steady · 13th January 2003, 13:49

Oops. PMULHRW is 3dnow! only isn't it? I hate to lose that proper rounding.

Steady · 13th January 2003, 15:41

Okay, hopefully this version will run on Intel CPU's.

edit - old version 2 removed - newest version at the top of the thread.

Steady · 14th January 2003, 17:21

Version 3 fixes the conflict with resize, random seeking issue and should fix all the major bugs.

Has anyone actually tried this? It really is quite good. Compressibilty gains of 10-50%

SansGrip · 14th January 2003, 20:42

Quote:

Originally posted by Steady
Has anyone actually tried this? It really is quite good. Compressibilty gains of 10-50%

No, but I'm about to

.

SansGrip · 14th January 2003, 21:04

In a word: fantastic! Here's another one: stunning!

I just tried FaeryDust on a fairly noisy DVD source (Death To Smoochy) and the difference was like night and day. I've honestly never seen that dramatic a result from a denoiser before. I can't wait to try PixieDust on my next capture...

I did notice the scene-change weirdness (occasionally), but didn't spot any motion problems. No ghosting either, of course. Is scene-change detection that hard to add? Can we expect it from v4? Demanding? Me?

It's slow, too, but that's not surprising if you're doing ME. Is it all in iSSE, i.e. is the only possible speed-up an algorithmic change?

Any chance you'll release the source? I'd love to see how this magic happens

.

SansGrip · 14th January 2003, 21:06

Forgot to mention, I did see a tiny bit of detail-loss on very subtle surfaces (a woman's red sweater lost some very gentle shadows, for example). Is a strength parameter out of the question?

Shamballa · 14th January 2003, 21:49

WHAT THE HELL OF THIS FILTER4S O_o i never see that maybe i have alucination i simply perfect he beat all denoiser of all time and the compresability is fabulous >_< please please don't stop the development of goldust ! thx a lot for have see that one time in my life ;_;

MaTTeR · 14th January 2003, 21:52

Initial testing here seems to look very good indeed. Very evil things happen when trying it with AVS 2.5 of course.

Can't wait to see a YV12 version of it though (I'm sure I can speak for iago on this as well :-)). Keep up the great work!

Edit- Oh, I was getting 5-7FPS with Dual Athlon 1600s and 512MB DDR RAM.

iago · 14th January 2003, 22:08

@Matt,

Hehe, I'm back man, though fairly declined and terribly limited after the latest motherboard disaster I had!

Dust! Nice name!
Gonna be tested on U-Turn soon!

regards,
iago

edit - guess it will finish in a fortnight's time on my new system!

SansGrip · 14th January 2003, 22:13

Quote:

Originally posted by MaTTeR
Edit- Oh, I was getting 5-7FPS with Dual Athlon 1600s and 512MB DDR RAM.

Ouch

.

Dali Lama · 14th January 2003, 22:29

Sorry, but may I ask how everyone knows Steady? I see he/she has a low post number and has been away for a long time, but is a moderator? I've been here for a while but have never seen this person.

Well anyways, I will test your filter out once its in YV12 (I hope) ...or until I finish my current encoding (I always love trying new denoisers out)

Anxious,

Dali

12th January 2003, 00:51	#1 \| Link
Steady Registered User Join Date: Oct 2001 Location: Missouri, USA Posts: 65	Dust - a noise remover Hi all, I have returned from never-never land. I brought some magic dust back with me. Please give it a try. edit - will keep latest version at the top of the thread. Last edited by Steady; 24th January 2003 at 05:16.

12th January 2003, 11:20	#4 \| Link
Kaiousama Italian Doom9 Staff Join Date: Apr 2002 Location: Italy Posts: 219	i can go in my noisy anime crypt to bring up a good beast for your filter. It's testing time, yuppie !! Welcome back and many many thanks for the new filter __________________ "All that we see or seem is but a dream within a dream" E.A.Poe

12th January 2003, 11:26	#5 \| Link
dividee Registered User Join Date: Oct 2001 Location: Brussels Posts: 358	Welcome back, Steady ! It's good to see you. I don't know if you read the forum lately, else you have a lot to catch up! __________________ dividee

13th January 2003, 15:41	#11 \| Link
Steady Registered User Join Date: Oct 2001 Location: Missouri, USA Posts: 65	Okay, hopefully this version will run on Intel CPU's. edit - old version 2 removed - newest version at the top of the thread. Last edited by Steady; 14th January 2003 at 17:12.

14th January 2003, 21:04	#14 \| Link
SansGrip Noise is your friend Join Date: Sep 2002 Location: Ontario, Canada Posts: 554	In a word: fantastic! Here's another one: stunning! I just tried FaeryDust on a fairly noisy DVD source (Death To Smoochy) and the difference was like night and day. I've honestly never seen that dramatic a result from a denoiser before. I can't wait to try PixieDust on my next capture... I did notice the scene-change weirdness (occasionally), but didn't spot any motion problems. No ghosting either, of course. Is scene-change detection that hard to add? Can we expect it from v4? Demanding? Me? It's slow, too, but that's not surprising if you're doing ME. Is it all in iSSE, i.e. is the only possible speed-up an algorithmic change? Any chance you'll release the source? I'd love to see how this magic happens . __________________ Regards, SansGrip

12th January 2003, 04:45	#2 \| Link
Guest Guest Join Date: Jan 2002 Posts: 21,901	Steady!!!!!!!!!!!!! Welcome back. It is GREAT to see you here again.

12th January 2003, 05:15	#3 \| Link
digitize Registered User Join Date: Aug 2002 Posts: 142	hmmm, i'll give it a try (on a noisey anime source).

12th January 2003, 14:40	#6 \| Link
Steady Registered User Join Date: Oct 2001 Location: Missouri, USA Posts: 65	Thanks for the warm welcome all Yes Dividee - I have been lurking for a few days and I feel liking I am starting over from scratch! Avisynth 2.5 with YV12 looks like a good idea that is long overdue. Convolution3d has taken a lot of the wind out of my sails since I had been comparing Dust to TemporalSmoother Still dust is quite a bit different. It uses motion compensation for the temporal averaging, that is why it is so slow.(82% of the time is spent on motion search). It is going to get slower before it gets faster. I am looking at alternates to simple bilinear(mmx pavgbw) half pel interpolation. I read an interesting paper on using the phase shift information from an FFT for global motion compensation, a radiacal departure from the usual block matching. It is fun to have a project to sink my teeth into

13th January 2003, 00:13	#7 \| Link
FuPP TotalEclipseOfTheBrain Join Date: Sep 2002 Posts: 347	Probably a stupid question, but is it an avisynth 2.5 filter, because I only get an exception error trying to use my new toy ? Regards, FuPP.

13th January 2003, 06:27	#8 \| Link
Steady Registered User Join Date: Oct 2001 Location: Missouri, USA Posts: 65	No, I am using 2.07 (not up to speed on 2.5 yet). What CPU do you have ? I have only tested it on my AthlonXP. It is possible some CPU specific code crept in. What error are you getting, illegal instruction ?

13th January 2003, 11:49	#9 \| Link
FuPP TotalEclipseOfTheBrain Join Date: Sep 2002 Posts: 347	I'm using avisynth 2.5... Regards, FuPP

13th January 2003, 13:49	#10 \| Link
Steady Registered User Join Date: Oct 2001 Location: Missouri, USA Posts: 65	Oops. PMULHRW is 3dnow! only isn't it? I hate to lose that proper rounding.

14th January 2003, 17:21	#12 \| Link
Steady Registered User Join Date: Oct 2001 Location: Missouri, USA Posts: 65	Version 3 fixes the conflict with resize, random seeking issue and should fix all the major bugs. Has anyone actually tried this? It really is quite good. Compressibilty gains of 10-50%

14th January 2003, 21:06	#15 \| Link
SansGrip Noise is your friend Join Date: Sep 2002 Location: Ontario, Canada Posts: 554	Forgot to mention, I did see a tiny bit of detail-loss on very subtle surfaces (a woman's red sweater lost some very gentle shadows, for example). Is a strength parameter out of the question? __________________ Regards, SansGrip

14th January 2003, 21:49	#16 \| Link
Shamballa Registered User Join Date: Sep 2002 Posts: 8	WHAT THE HELL OF THIS FILTER4S O_o i never see that maybe i have alucination i simply perfect he beat all denoiser of all time and the compresability is fabulous >_< please please don't stop the development of goldust ! thx a lot for have see that one time in my life ;_;

14th January 2003, 21:52	#17 \| Link
MaTTeR AC3 5.1 Addict Join Date: Nov 2001 Location: Big Blue Nation_USA Posts: 2,036	Initial testing here seems to look very good indeed. Very evil things happen when trying it with AVS 2.5 of course. Can't wait to see a YV12 version of it though (I'm sure I can speak for iago on this as well :-)). Keep up the great work! Edit- Oh, I was getting 5-7FPS with Dual Athlon 1600s and 512MB DDR RAM. __________________ Need AC3 & SPDIF setup info? Last edited by MaTTeR; 14th January 2003 at 22:06.

14th January 2003, 22:08	#18 \| Link
iago retired Join Date: Jun 2002 Location: hollywood Posts: 1,013	@Matt, Hehe, I'm back man, though fairly declined and terribly limited after the latest motherboard disaster I had! Dust! Nice name! Gonna be tested on U-Turn soon! regards, iago edit - guess it will finish in a fortnight's time on my new system! Last edited by iago; 14th January 2003 at 22:12.

14th January 2003, 22:29	#20 \| Link
Dali Lama Registered User Join Date: Jan 2002 Posts: 331	Sorry, but may I ask how everyone knows Steady? I see he/she has a low post number and has been away for a long time, but is a moderator? I've been here for a while but have never seen this person. Well anyways, I will test your filter out once its in YV12 (I hope) ...or until I finish my current encoding (I always love trying new denoisers out) Anxious, Dali

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode