flash3kyuu_deband 1.5.1 / 2.0pre2 with native VapourSynth support [2012-12-03]

[ryrynz]

Gave 2.0pre2 a shot today with 2.6MT and had my media player crash a few times and also an a bluescreen, have gone back to 1.5.1.

[SAPikachu]

Originally Posted by ryrynz

Gave 2.0pre2 a shot today with 2.6MT and had my media player crash a few times and also an a bluescreen, have gone back to 1.5.1.

2.0 is an experimental version so it may have bugs that will crash the player, but in theory it shouldn't be able to cause BSOD... Anyway the core algorithm is not (yet) changed in 2.0, you can stay at 1.5.1 for now. I have been too busy to touch the code recently so it still needs some time for next version...

[ryrynz]

It doesn't appear that 2.0 is the issue, I've been using 1.5.1 in a script with other filters using MT mode 2 and TBH it's always been a little unstable but generally working fine. I've switched to the MSVC build and while it's early days, I haven't had a BSOD yet.

I wonder if there's a compiler option that will attain that same stability as the MSVC build but keep some performance advantage? I assume many won't experience any instability, I think it may depend a little on the filters being used in conjunction along with it in MT mode.

[SAPikachu]

Originally Posted by ryrynz

It doesn't appear that 2.0 is the issue, I've been using 1.5.1 in a script with other filters using MT mode 2 and TBH it's always been a little unstable but generally working fine. I've switched to the MSVC build and while it's early days, I haven't had a BSOD yet.

I wonder if there's a compiler option that will attain that same stability as the MSVC build but keep some performance advantage? I assume many won't experience any instability, I think it may depend a little on the filters being used in conjunction along with it in MT mode.

Well, then it seems that the problem is in your hardware setup. Have you overclocked your CPU? All ICL does is optimize the assembly code so that CPU power can be better utilized. But that will cause your CPU become hotter than when you use the MSVC build. So if your CPU is overclocked it may be the culprit. If not overclocked, can you try limiting your CPU frequency (maybe switch to Power Saver mode) and see if the problem goes away?

[ryrynz]

Everything in the BIOS is stock. No memory errors, ran Lynx for 10 passes all okay, ran Prime95 blend mode with no issues so it's hard to say what's going on but my hardware appears stable.

I'm not fussed anyway, if the MSVC build fixes it then that's fine with me. It could be the smallest of instabilities somewhere in the hardware or maybe it's a conjunction of things that don't like
working together, either way nobody else is having any issues so I won't look into it any further at this point I just wanted to let you know at least it didn't appear to be a code issue with 2.0.

I'll look at it again some months from now when I upgrade to a Haswell based system, that should rule out the hardware at least if it still happens at that point.

[SAPikachu]

OK that's fine. Thanks for reporting anyways.

[turbojet]

ryrynz: What other filters are in the chain? No problem here with any of the f3kdb builds with mtmode2 but finesharp crashed quite often and occasional bsod with mtmode2, mtmode5 worked fine however.

SAPikachu: Do you know if f3kdb can be translated into a pixel shader? There isn't any very effective deband pixel shaders and could use some competition. f3kdb is the most effective debanders I've found. This would let me get ffdshow out of the playback chain.

[SAPikachu]

Originally Posted by turbojet

SAPikachu: Do you know if f3kdb can be translated into a pixel shader? There isn't any very effective deband pixel shaders and could use some competition. f3kdb is the most effective debanders I've found. This would let me get ffdshow out of the playback chain.

It may be possible, but I won't have time to do it in a few months. If someone is willing to write it I can provide some algorithm information though.

[ryrynz]

Originally Posted by turbojet

ryrynz: What other filters are in the chain? No problem here with any of the f3kdb builds with mtmode2 but finesharp crashed quite often and occasional bsod with mtmode2, mtmode5 worked fine however.

Psharpen, Hysteria, Vaguedenoiser, Awarpsharp2 and Flash3kyuu.

I'll look at the ICL build after my hardware update and troubleshoot it then. If the MSVC build does indeed fix it for me (for whatever reason) it I'm happy enough with continuing to use it.
I don't want to invest time trying to figure it out and posting further on it when when nobody else has any issues and it's solved by simply running a different compiled version, I can live with that for now.

A pixel shader would be very cool.

[travolter]

@SAPikachu thanks a lot!!!! the filter is really impressive and a daily use one. Perfect for realtime usage.

[ryrynz]

It definitely is the go to deband filter, I recommend playing with the settings a little to get it perfect to suit your media.

[x265]

Can any of you post the code for loading high-bitdepth avs script into x264tmod?

[SAPikachu]

Originally Posted by x265

Can any of you post the code for loading high-bitdepth avs script into x264tmod?

You need to specify output_mode=2 in parameters of f3kdb, that will make it output data that x264-tMod recognizes, like this:

f3kdb(... , output_mode=2, output_mode=10)

[x265]

Should i use the 10bit build within the FFmpeg folder?

[ryrynz]

Originally Posted by SAPikachu

Well, then it seems that the problem is in your hardware setup.

BIOS setting up improper RAM voltage. Back to ICL, all okay.

[SAPikachu]

Originally Posted by x265

Should i use the 10bit build within the FFmpeg folder?

Any 10bit tMod build should be OK, since they are all built with AVS support.

Originally Posted by ryrynz

BIOS setting up improper RAM voltage. Back to ICL, all okay.

My guess was right.

[x265]

I'm getting this error



AVS Script :

MPEG2Source("C:\Users\Abhijith Nair\Desktop\Death note vol1.d2v", cpu=0)
AnimeIVTC(mode=1, ifade=true, aa=0)
ClipTwo=trim(1918,30688)
ClipFour=trim(32368,32727)
ClipThree=MPEG2Source("C:\Users\Abhijith Nair\Desktop\ED.d2v", cpu=0).AnimeIVTC(mode=1, aa=0, ifade=true)
ClipOne=MPEG2Source("C:\Users\Abhijith Nair\Desktop\OP.d2v", cpu=0).AnimeIVTC(mode=1, aa=0, ifade=true)
AlignedSplice(ClipOne, ClipTwo, ClipThree, ClipFour)
Crop(2, 4, -2, -0)
Dehalo_alpha_mt(ss=3.0)
SMDegrain(lsb=true, refinemotion=true, pel=4, subpixel=3, tr=6, thSAD=300)
LSfmod(defaults="slow", strength=50)
flash3kyuu_deband(range=17, dither_algo=3, input_depth=8, output_depth=10, output_mode=2)

Sample :
http://www.mediafire.com/?y9vqkd98gku7hrs

[SAPikachu]

Originally Posted by x265

I'm getting this error



AVS Script :

Well I made a mistake about any build will work. You should use x86 build.

[x265]

How do i confirm whether i should set tv range =true or false?

[SAPikachu]

Originally Posted by x265

How do i confirm whether i should set tv range =true or false?

You can use Histogram("levels") on your unfiltered source to check whether it is TV range. Be aware, I heard from my friends that some (badly-produced) anime have parts in TV range and parts in full range, so please check as many scene as you can.