Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > Capturing and Editing Video > Avisynth Usage

Reply
 
Thread Tools Search this Thread Display Modes
Old 12th July 2019, 17:08   #1261  |  Link
johnmeyer
Registered User
 
Join Date: Feb 2002
Location: California
Posts: 2,186
Quote:
Originally Posted by bassquake View Post
If anyones interested, I posted a video showing the different stages of post-processing.
Very nice!

What software did you use for dirt removal? If you used RemoveDirtMC, what settings did you use?

All your other steps look really, really good, but I think you might be able to get better dirt removal.

[edit]Here is one of my "before/after" comparisons, using the scripts I've posted. I have it queued up to a section where there is a lot of dirt removal. I'm not doing this to get into a "who's script is better" discussion, but merely to point out that I think you can get better dirt removal:

https://www.youtube.com/watch?v=tBAHzO7rJS0&t=1m6s

and here is that same clip queued up to the point where the amount of dirt removal hits "ludicrous speed:

https://www.youtube.com/watch?v=tBAHzO7rJS0&t=3m51s

Last edited by johnmeyer; 12th July 2019 at 17:14. Reason: added links
johnmeyer is offline   Reply With Quote
Old 12th July 2019, 18:11   #1262  |  Link
bassquake
Registered User
 
Join Date: Jan 2007
Posts: 35
Thanks johnmeyer!

Cheers for a look at dirt removal comparisons.

Yes, was RemoveDirtMC for dirt removal and a smidge of sharpening for the final touch.

I prefer to keep film grain which is why I don't use DeNoise, and kept dirt removal to a setting of 20 for the variable dirt_strength. I guess I could go higher but I like a bit of "character" on the film
bassquake is offline   Reply With Quote
Old 12th July 2019, 19:18   #1263  |  Link
johnmeyer
Registered User
 
Join Date: Feb 2002
Location: California
Posts: 2,186
Quote:
Originally Posted by bassquake View Post
Yes, was RemoveDirtMC for dirt removal and a smidge of sharpening for the final touch.

I prefer to keep film grain which is why I don't use DeNoise, and kept dirt removal to a setting of 20 for the variable dirt_strength. I guess I could go higher but I like a bit of "character" on the film
Hmm ... If you are using the same version of RemoveDirtMC that I use, 20 should have given you a little more dirt removal (it is almost exactly what I use). However, I think the numerical setting interacts with the resolution you use. I do most of my film work at the NTSC SD resolution of 720x480 (non-square pixels). If you are doing your work at 720p or higher resolution, you might need to use a larger value in order to get the same level of dirt removal.

The two big downsides to using larger values of RemoveDirt are the disappearance of objects you want to keep (a thrown ball will almost always disappear, for instance), and the introduction of "gooey" artifacts where objects begin to morph instead of move.
johnmeyer is offline   Reply With Quote
Old 12th July 2019, 19:49   #1264  |  Link
bassquake
Registered User
 
Join Date: Jan 2007
Posts: 35
Quote:
However, I think the numerical setting interacts with the resolution you use.
Probably. I create 1440 x 1080 videos! Looks great on a 55" tv

I might play around with upping settings more, but I do like some of the charm of flawed film!
bassquake is offline   Reply With Quote
Old 12th July 2019, 20:23   #1265  |  Link
johnmeyer
Registered User
 
Join Date: Feb 2002
Location: California
Posts: 2,186
Quote:
Originally Posted by bassquake View Post
... I do like some of the charm of flawed film!
Then why restore it at all? Along these same lines, many people prefer leaving the gate weave (the residual bounce) because that is an inherent quality of movie film, but you've removed that. What's the difference between removing all the gate weave, but only some of the dirt?

I got my start in media restoration by restoring 78 rpm recordings. I heard many of the same arguments back then, that removing the residual hiss and pops took away much of the "life" and "authenticity" of the original medium.

OK, that's a fair criticism, but I do have this to say: listening to restored shellac or vinyl recordings, or watching completely restored film sure is a lot easier on the ears and eyes, and lets you concentrate on the content of the media.
johnmeyer is offline   Reply With Quote
Old 12th July 2019, 21:03   #1266  |  Link
bassquake
Registered User
 
Join Date: Jan 2007
Posts: 35
Some dirt removal is better than none but I don't want to go overboard due to the issues you listed.
bassquake is offline   Reply With Quote
Old 13th July 2019, 09:36   #1267  |  Link
minusthebear
Registered User
 
Join Date: Oct 2018
Posts: 7
Quote:
Originally Posted by SnillorZ View Post
@Bear did you see the earlier posts?

AVS+ Script Unsharpmask function

Warpsharp x64 DLL

Interested to see what your numbers are like on GPU vs CPU processing (based on these scripts)
Thank you! will incorporate this.
minusthebear is offline   Reply With Quote
Old 13th July 2019, 22:48   #1268  |  Link
minusthebear
Registered User
 
Join Date: Oct 2018
Posts: 7
Ok, so here is my mod.

This is a 64-bit GPU enabled version of Fred's filter.

This requires AviSynth+ btw, if you want to use the prefetch enhancements,

If you don't want the prefetch, just comment out that line and you can use AviSynth.

Obviously needs virtualdub64 or another 64 bit program to capture.

You will most likely have to put the FFT3dGPU.dll and fft3dfilter.dll plugins in your system32 folder. If you have 32 bit versions there you will have to rename them with .bak and replace. Can't have both as far as I can tell.

There are 2 versions I created;

1. Fred 64 with MDegrain - This uses a GPU enabled SVPflow motion flow. The rest is 64-bit but CPU.
2. Fred 64 with GPU MDegrain - This utilizes the SPVConvert function to utilize the CPU with the MDegrain denoising filter. However it has artifacting and doesnt work properly. Maybe someone can fix it.

I will be honest, the speed enhancements are marginal at best, unfortunately there are many functions that the GPU is waiting for while the CPU handles them. Especially the AutoAdjust plugin.

However this is 64-bit now, meaning you will not have any issues with Ram overflow etc. The skys the limit, 4k, 8k, whatever you want.

Enjoy.

https://drive.google.com/file/d/1O-A...ew?usp=sharing

Last edited by minusthebear; 14th July 2019 at 03:27.
minusthebear is offline   Reply With Quote
Old 13th July 2019, 23:19   #1269  |  Link
Groucho2004
►◄
 
Groucho2004's Avatar
 
Join Date: Mar 2006
Location: A wretched hive of scum and villainy
Posts: 4,418
Quote:
Originally Posted by minusthebear View Post
You will most likely have to put the FFT3dGPU.dll and fft3dfilter.dll plugins in your system32 folder. If you have 32 bit versions there you will have to rename them with .bak and replace. Can't have both as far as I can tell.
Firstly, these DLLs are plugins and should therefore be in the appropriate plugin directories. Secondly, on 64 bit Windows there are dedicated system directories for DLLs that need to be within the reach of the standard Windows search hierarchy (System32 for 64 bit, SysWoW64 for 32 bit). No renaming necessary/recommended.
__________________
Groucho's Avisynth Stuff

Last edited by Groucho2004; 13th July 2019 at 23:44.
Groucho2004 is offline   Reply With Quote
Old 14th July 2019, 01:55   #1270  |  Link
Natty
Noob
 
Join Date: Mar 2017
Posts: 219
Quote:
Originally Posted by minusthebear View Post
1. Fred 64 with MDegrain - This uses a GPU enabled SVPflow motion flow. The rest is 64-bit but CPU.
can u pls give a basic example?
Natty is offline   Reply With Quote
Old 14th July 2019, 02:58   #1271  |  Link
videoh
Registered User
 
Join Date: Jul 2014
Posts: 841
@minusthebear

You are distributing one of my DLLs without my permission (DGDecodeNV.dll). It is not in the public domain. I demand that you remove it from your distribution. If you do not, I will ask the mods to take appropriate action.
videoh is offline   Reply With Quote
Old 14th July 2019, 03:19   #1272  |  Link
minusthebear
Registered User
 
Join Date: Oct 2018
Posts: 7
Quote:
Originally Posted by videoh View Post
@minusthebear

You are distributing one of my DLLs without my permission (DGDecodeNV.dll). It is not in the public domain. I demand that you remove it from your distribution. If you do not, I will ask the mods to take appropriate action.
Oh shoot, I didnt realize.

Its gone.
minusthebear is offline   Reply With Quote
Old 14th July 2019, 03:28   #1273  |  Link
minusthebear
Registered User
 
Join Date: Oct 2018
Posts: 7
Quote:
Originally Posted by Natty View Post
can u pls give a basic example?
I'm not sure what you mean?

Do you want like a before and after type clip?

The end result is almost identical to the 32-bit FRED version.

This is just using 64-bit and GPU
minusthebear is offline   Reply With Quote
Old 14th July 2019, 04:01   #1274  |  Link
videoh
Registered User
 
Join Date: Jul 2014
Posts: 841
Quote:
Originally Posted by minusthebear View Post
Oh shoot, I didnt realize.

Its gone.
Thank you, Sir.
videoh is offline   Reply With Quote
Old 15th July 2019, 12:46   #1275  |  Link
SnillorZ
Registered User
 
Join Date: Jan 2019
Location: Lake District UK
Posts: 48
Avisynth GPU Script AVSMeter

Quote:
Originally Posted by minusthebear View Post
I'm not sure what you mean?

Do you want like a before and after type clip?

The end result is almost identical to the 32-bit FRED version.

This is just using 64-bit and GPU
Looking to see what your performance numbers are?

e.g. from @Groucho2004's AVSMeter to compare the CPU based script & plugins vs GPU ones

SnillorZ is offline   Reply With Quote
Old 15th July 2019, 13:02   #1276  |  Link
SnillorZ
Registered User
 
Join Date: Jan 2019
Location: Lake District UK
Posts: 48
Quote:
Originally Posted by johnmeyer View Post
Here is one of my "before/after" comparisons, using the scripts I've posted. I have it queued up to a section where there is a lot of dirt removal. I'm not doing this to get into a "who's script is better" discussion, but merely to point out that I think you can get better dirt removal:

https://www.youtube.com/watch?v=tBAHzO7rJS0&t=1m6s
John in this example of yours, there are a lot of vertical lines along with the dirt spots that you've managed to remove in the "after" clip.

Interested to know, was this all achieved with RemoveDirt?

I have some footage with vertical lines (some static, some with frame weave) that I was thinking would need another method for removal, including possibly frame by frame by hand for the "static lines".
SnillorZ is offline   Reply With Quote
Old 15th July 2019, 15:05   #1277  |  Link
johnmeyer
Registered User
 
Join Date: Feb 2002
Location: California
Posts: 2,186
Quote:
Originally Posted by SnillorZ View Post
John in this example of yours, there are a lot of vertical lines along with the dirt spots that you've managed to remove in the "after" clip.

Interested to know, was this all achieved with RemoveDirt?
Amazingly, RemoveDirt can sometimes remove gigantic spots (you'll easily see that in the beach scene) and even a few scratches, but only if the scratches move around a lot. Unfortunately, normal vertical scratches really cannot be removed by any automatic methods because they persist from frame to frame and don't move around much. As a result, automated algorithms really can't tell the difference between a scratch and a normal thin vertical line (fence, wallpaper, etc.). RemoveDirt, and other similar plugins like Despot, rely on the artifact lasting for only a single frame.

About the only way I know of to truly remove film scratches is to do it during transfer using a "wet gate," which involves putting a lubricant on the film, prior to transfer, which fills in the scratch and causes them to almost perfectly disappear. Your transfer equipment has to be able to accommodate wet film, which mine does not, in order to be able to take advantage of this "trick." Also, it involves extra steps, thus making the transfer take longer.

The man who started this thread, "VideoFred," uses a wet gate and has posted about it several times, both in this thread and elsewhere. Do a forum search on "wet gate" and his user name to learn more.

Last edited by johnmeyer; 15th July 2019 at 21:15. Reason: typo ("them" instead of "it")
johnmeyer is offline   Reply With Quote
Old 15th July 2019, 16:28   #1278  |  Link
bassquake
Registered User
 
Join Date: Jan 2007
Posts: 35
Maybe try the DeScratch tool for AVISynth to remove vertical scratches. Haven't tried it myself yet.
bassquake is offline   Reply With Quote
Old 15th July 2019, 17:48   #1279  |  Link
SnillorZ
Registered User
 
Join Date: Jan 2019
Location: Lake District UK
Posts: 48
Avisynth Restore Scratch Removal

Quote:
Originally Posted by johnmeyer View Post
The man who started this thread, "VideoFred," uses a wet gate and has posted about it several times, both in this thread and elsewhere. Do a forum search on "wet gate" and his user name to learn more.
Thanks John, yes I had researched wetgate transfers for emulsion damage. I'll revisit the footage I have to see if the amount that would benefit justify the cost of a rescan with wetgate.

Quote:
Originally Posted by bassquake View Post
Maybe try the DeScratch tool for AVISynth to remove vertical scratches. Haven't tried it myself yet.
Think I had previously stumbled across Fizicks DeScratch plugin, but bypassed it in the pursuit of x64 bit plugins for Fred's/John's scripts. Will take another look and do some (x32 script) testing.
SnillorZ is offline   Reply With Quote
Old 15th July 2019, 19:09   #1280  |  Link
johnmeyer
Registered User
 
Join Date: Feb 2002
Location: California
Posts: 2,186
I was never able to get ANY positive results from Descratch, but you should try it, just to see if you have better luck.
johnmeyer is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 23:48.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2019, vBulletin Solutions Inc.