Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion. Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules. |
5th December 2007, 04:07 | #21 | Link | |
x264 developer
Join Date: Sep 2005
Posts: 8,666
|
Quote:
The quality is quite good overall though if you're not a quality snob. You'd be quite surprised how good x264 is at low bitrates, especially when you've denoised it heavily (thus also reducing the bit cost for highest detail areas). |
|
5th December 2007, 04:08 | #22 | Link | |
Registered User
Join Date: Jul 2002
Posts: 587
|
Quote:
I would love to see a clip of that of the same scenes in my clips. :P |
|
5th December 2007, 04:12 | #23 | Link | |
Registered User
Join Date: Jul 2002
Posts: 587
|
Quote:
My goal was to get rid of a good amount of grain and keep it looking as good as the bluray as much as possible on 1 DVD-R. |
|
5th December 2007, 04:56 | #25 | Link | |
x264aholic
Join Date: Jul 2007
Location: New York
Posts: 1,752
|
Quote:
Wish I had a blu-ray source so I could encode to 720p though. |
|
5th December 2007, 22:47 | #26 | Link | |
Registered User
Join Date: Jul 2002
Posts: 587
|
Quote:
Comparing to the Bluray 95% of detail is still there after my grain removal and is the best balance I could get. i.e. get rid of just enough grain and grain dancing to not annoy me while watching and thus keep most of detail intact to not annoy me on that front as well Last edited by Zep; 5th December 2007 at 22:53. |
|
5th December 2007, 23:01 | #27 | Link | |
Registered User
Join Date: Jul 2002
Posts: 587
|
Quote:
interestingly enough it is not the grain that annoys me. It is the DANCING grain. So I feel you can get rid of a lot of dancing grain and keep detail if you use filters that look for grain dance and only Degrain those areas while leaving the rest alone. Most of the grain for instance is NOT on actors faces and real live stuff. It appears they added in forced grain to all the CGI created stuff like the cool skies. I have been experimenting with a edge/detail finding filters than then mask those areas which I then use so that the grain removal does NOT remove from the masked areas. In fact I'm doing it right now and the results are very impressive. I have been able to turn up grain removal while keeping even more detail than before. This is how I plan to do the final encode for sure. The down side is SUPER SLOW It will take days to encode the final. Last edited by Zep; 6th December 2007 at 00:07. |
|
5th December 2007, 23:27 | #28 | Link | |
x264aholic
Join Date: Jul 2007
Location: New York
Posts: 1,752
|
Quote:
|
|
6th December 2007, 00:20 | #29 | Link |
Registered User
Join Date: Apr 2005
Posts: 1,339
|
Didee's suggestions from previous threads:
Code:
source=last denoised=fft3dfilter(sigma=8,sigma2=8,plane=4,degrid=1) backward_vec2 = MVAnalyse(denoised,isb = true, delta = 2, pel = 2, blksize=16, overlap=8, sharp=1, idx = 1) backward_vec1 = MVAnalyse(denoised,isb = true, delta = 1, pel = 2, blksize=16, overlap=8, sharp=1, idx = 1) forward_vec1 = MVAnalyse(denoised,isb = false, delta = 1, pel = 2, blksize=16, overlap=8, sharp=1, idx = 1) forward_vec2 = MVAnalyse(denoised,isb = false, delta = 2, pel = 2, blksize=16, overlap=8, sharp=1, idx = 1) MVDegrain2(source,backward_vec1,forward_vec1,backward_vec2,forward_vec2,thSAD=800,idx=2) Last edited by Pookie; 6th December 2007 at 00:26. |
6th December 2007, 00:58 | #30 | Link |
Registered User
Join Date: Apr 2002
Location: Germany
Posts: 5,389
|
Similar, but not exactly like that. The prefilter should be able to cut down the grain almost completely. Some loss of detail is nothing to worry about at this stage. Then, thSAD should not be increased, but instead decreased from the default 400.
Using a prefilter together with such a high thSAD is guaranteed to introduce artifacts in areas where MC fails. Alltogether, that suggestion was just an "easy" version of a general methodology. A script allowing for full control over all aspects is ten times as long as that, and quite a bit slower as well.
__________________
- We´re at the beginning of the end of mankind´s childhood - My little flickr gallery. (Yes indeed, I do have hobbies other than digital video!) |
6th December 2007, 01:13 | #31 | Link |
Registered User
Join Date: Apr 2005
Posts: 1,339
|
"Using a prefilter together with such a high thSAD is guaranteed to introduce artifacts in areas where MC fails"
Indeed. You can't tell from the cropped example source file what thSAD values to use because it is only a small segment of wall and sky. It would be nice to see something of detail to determine if the degraining is going to be too strong. |
6th December 2007, 02:33 | #32 | Link | |
x264aholic
Join Date: Jul 2007
Location: New York
Posts: 1,752
|
Quote:
Can you recommend a version that'll work without those problems? |
|
6th December 2007, 17:46 | #33 | Link |
Registered User
Join Date: Apr 2002
Location: Germany
Posts: 5,389
|
@ Sagekilla:
In other words, you mean if the holy grail of noise removal already has been discovered? I fear it has not, yet. @ Zep: Some more thoughts on "dancing" grain. This sort of "dancing" usually isn't a property of the original grain, at least for the most part. Grain in itself usually is a high-frequency distortion only. The "dancing" effect is introduced by lossy DCT-based compressors, where in the lossy compression process some error is introduced into the low-frequency parts, caused mainly by the hi-frequency parts. Something to try: the following script will remove the low-frequency flicker, leaving the high-frequencies intact. Code:
#LoadPlugins: MedianBlur.dll # RemoveGrain.dll # mt_masktools.dll # FluxSmooth.dll AviSource("K:\300_original.avi") o = last f = o.MinBlur(1,2).MinBlur(2,2).RemoveGrain(11,-1) f.FluxSmoothT(7).mt_AddDiff(mt_MakeDiff(o,f,U=2,V=2),U=4,V=4) # eventually, limit the maximum pixel change to +/- 2 : # mt_LutXY(o,last,"x 2 + y < x 2 + x 2 - y > x 2 - y ? ?",U=2,V=2) # to compare: stackvertical(o,last) #interleave(o,last) return(last) #------------------------------------------ # Taken from MCBob.avs: function MinBlur(clip clp, int r, int "uv") { uv = default(uv,3) uv2 = (uv==2) ? 1 : uv rg4 = (uv==3) ? 4 : -1 rg11 = (uv==3) ? 11 : -1 rg20 = (uv==3) ? 20 : -1 medf = (uv==3) ? 1 : -200 RG11D = (r==1) ? mt_makediff(clp,clp.removegrain(11,rg11),U=uv2,V=uv2) \ : (r==2) ? mt_makediff(clp,clp.removegrain(11,rg11).removegrain(20,rg20),U=uv2,V=uv2) \ : mt_makediff(clp,clp.removegrain(11,rg11).removegrain(20,rg20).removegrain(20,rg20),U=uv2,V=uv2) RG4D = (r==1) ? mt_makediff(clp,clp.removegrain(4,rg4),U=uv2,V=uv2) \ : (r==2) ? mt_makediff(clp,clp.medianblur(2,2*medf,2*medf),U=uv2,V=uv2) \ : mt_makediff(clp,clp.medianblur(3,3*medf,3*medf),U=uv2,V=uv2) DD = mt_lutxy(RG11D,RG4D,"x 128 - y 128 - * 0 < 128 x 128 - abs y 128 - abs < x y ? ?",U=uv2,V=uv2) clp.mt_makediff(DD,U=uv,V=uv) return(last) } As a side-effect, there might occur some slight toning-down of shadings when there is motion. One can definetly see it in single-frame comparisons by flipping between original and processed. But one will hardly note that during watching the movie.
__________________
- We´re at the beginning of the end of mankind´s childhood - My little flickr gallery. (Yes indeed, I do have hobbies other than digital video!) Last edited by Didée; 22nd April 2008 at 11:54. Reason: some script bugfixes |
6th December 2007, 22:20 | #34 | Link | |
Registered User
Join Date: Jul 2002
Posts: 587
|
Quote:
download the original clip it is in a link above |
|
6th December 2007, 22:22 | #35 | Link | |
Registered User
Join Date: Jul 2002
Posts: 587
|
Quote:
ok I guess I finally found all the same versions of the plugins you are using. My result was not that good. for me my removal is much better. not only is more grain removed and less dancing grain with what does remain but more detail in mine is retained. however mine runs slower than the above by a fair bit. thanks for the ideas though Last edited by Zep; 7th December 2007 at 10:48. |
|
6th December 2007, 23:21 | #36 | Link |
x264aholic
Join Date: Jul 2007
Location: New York
Posts: 1,752
|
Thanks for the script Didee! It worked much better than any of the other methods before (for me anyway.) I didn't get much of a bitrate reduction, 100-150 kbps at best, but at least the grain isn't jumping around like it used to, and I still get retain some of the "detail," even if some of it is fake from the grain. It may not be the Holy Grail of removing noise/grain, but for 300 it works perfectly.
Edit: I tried it out on my copy of "Knocked Up" as well, and it seemed to do a very nice job of stabilizing the grain so the backgrounds look static for the most part. Last edited by Sagekilla; 6th December 2007 at 23:36. |
7th December 2007, 10:46 | #37 | Link | |
Registered User
Join Date: Jul 2002
Posts: 587
|
Quote:
because it is not really doing much. At least for me it only reduces the amount of grain by a very small amount and what is left is dancing around almost as much. if you want to see a fast and really good grain removal use ffdshow noise removal and turn on Denoise3d but only use the HQ setting and max it out. Very fast and very good. Now mix that with your avi synth script and tweak from there. I think you see better results because you are not coming from the Bluray but are using the lower rez version which has far less grain and most of these plugs are geared to low rez DVD. Removegrain just can't cut it on high rez Bluray source and this is where removegrainHD is better and why it was written. Last edited by Zep; 7th December 2007 at 10:53. |
|
7th December 2007, 16:42 | #39 | Link | ||||
Registered User
Join Date: Apr 2002
Location: Germany
Posts: 5,389
|
Zep, it seems you were expecting the wrong thing from that script...
Quote:
Quote:
If I literally go one step back - so that I hardly can see the hi-freq grain at all anymore - then I still see lots of flickering in the "original", while the lowpass-processed one looks pretty solid. Quote:
Again: That script was in no way meant for grain removal. It was also not meant as script to use for final encoding (although one can do so, if the result happens to be sufficient and pleasant.) It was only showing that one of the major annoyances of very grainy sources, namely the low-frequency flicker - can be tackled with rather simple means. One step further, something in this direction often is very useful for subsequent motioncompensated denoising. If the flicker is left in, it eventually will also disturb the ME engine (making the vectors follow the flicker, causing spatial shifts where in fact there should be none), which will lower the benefit one can get from MC-NR. When the flicker is taken out before the motion search, chances are better to get more clean vectors. Quote:
Random example: Frame 180. The overall difference caused by ... left: my script, right: your 'best.so.far' clip - Or: flip forth-back between these three: my script - original - your 'best.so.far' - - Okay, we didn't see either your latest script or its results, but from what you said it was basically similar to what you showed with 'best.so.far", plus masking of certain areas, allowing for even stronger settings. Now, I doubt that the kinds of negative impacts, as shown above, can be rescued by only a little masking... Get this right: the result of your 'best.so.far' is not bad at all, it's quite good. But there *is* smearing / shifting, and there *is* detail loss. Hence I can't follow your finding that your script "keeps more detail", when mine doesn't loose any to start with. We surely all are interested in seeing the latest script you came up with. However, after years of toying around with very grainy sources in all kinds of even-so-sophisticated ways, I can tell: grain removal on strong-grained sources won't ever be perfect. It's always a "you win here, you lose there" game. Winning without losing is out of reach. --- BTW, what BlureRay is this that we're juggling around with 720p?
__________________
- We´re at the beginning of the end of mankind´s childhood - My little flickr gallery. (Yes indeed, I do have hobbies other than digital video!) |
||||
7th December 2007, 17:15 | #40 | Link | |
*Space Reserved*
Join Date: May 2006
Posts: 953
|
Quote:
|
|
Thread Tools | Search this Thread |
Display Modes | |
|
|