New anime filter: mfToon

[mf]

Define "poor".

[mrfil13]

Well has ringing and seems to be overly sharp.

I will try and get a sample up tommorow because my ecplenation is probably not very helpful, plus does cartoon mode help or not.

[mrfil13]

Heres a link for the download of the test sample i did,
http://renault5archive.donnchadh.co.uk/cow.avi

how could i make this better, to me it looks like the lines are to thick and its overly bright, what settings do i need to change to alter these factors

cheers

[lamer_de]

Hi mf, could you please fix this annoying "strength" bug? I hardly ever use full strength linedarkening, unless the source I have to work on is blurred as hell or features chroma ghosting etc. So I can put mftoon only to limited use atm :(

mrfil13: The clip doesn't looks "wrong" to me, but I don't know how it's supposed to look :p
You can thin lines using the warpsharp filter. Brighness adjustment can be done via the levels filter. Use the vdub version of the filter to find the correct values, then enter them in your avs script. However, unless you know that you colours/brightness are off, I wouldn't start fiddling around with it.

CU,
lamer_de

[mf]

Originally posted by lamer_de
Hi mf, could you please fix this annoying "strength" bug? I hardly ever use full strength linedarkening, unless the source I have to work on is blurred as hell or features chroma ghosting etc. So I can put mftoon only to limited use atm :(
You should be able to fix it yourself :D. replace the linemask = line with linemaskpre =, and then add a line linemask = (strength=255) ? linemaskpre : linemaskpre.Levels(0, 1.0, 255, 0, strength), or something like that. Of course you then also have to get rid of that other strength conditional. (I'm not at home atm so I can't really check everything literally) I'll prep mfToon-v0.52 for release later today and I'll incorporate that into it. I just didn't before cause I grew kinda tired of cleaning the script and the other stuff I gotta do before releasing a version of mfToon :rolleyes:.

[zettai]

Is there no other way of using mftoon without that specific warpsharp.dll? It's phenominally bug-ridden - I recall MarcFD taking just the warpsharp code because one of the other parts of the filter kept causing crashes all the time.

[mf]

Originally posted by zettai
Is there no other way of using mftoon without that specific warpsharp.dll? It's phenominally bug-ridden - I recall MarcFD taking just the warpsharp code because one of the other parts of the filter kept causing crashes all the time.
If someone could compile a version that only includes these filters:
Unsharpmask()
XSharpen()
FrameCache()
Then I'd be happy enough.

[zettai]

BTW, the warpsharp.dll pack posted on this site:

http://www.geocities.co.jp/SiliconValley-PaloAlto/2382/

Created Nov '03 184k, is much more stable than the 127k version you have linked to at the start of the thread and doesn't cause any crashing with autoloading so far.

Are you aware of this version? It seems to work fine for me.

[mf]

Originally posted by zettai
BTW, the warpsharp.dll pack posted on this site:

http://www.geocities.co.jp/SiliconValley-PaloAlto/2382/

Created Nov '03 184k, is much more stable than the 127k version you have linked to at the start of the thread and doesn't cause any crashing with autoloading so far.

Are you aware of this version? It seems to work fine for me.
Looks like it's from the same site as I got the original version I have from. So apparently it's been updated in the meantime.

[mrfil13]

Was that to use warpsharp before or after mftoon() or is there a way to do the line thinning using mftoon

Also will it be worth just waiting for .52 with the cartoon edge detection.

[mf]

Originally posted by mrfil13
Also will it be worth just waiting for .52 with the cartoon edge detection.
Only for dark or contrastful anime. The cartoon edge detection (which is multiplied by sobel (or did I use roberts?) because of the weakness of the cartoon edgemask) only (partly) fixes shadow contours (the edges of a shadow fill are detected as a line and get darkened). So if it's never bothered you before I don't think it'll be such a big fix.

[Arrakis_Dune]

Well, I'm just restarting to backup my Dvd's, so some questions here will be somewhat dumb or lamme.. I've been trying to backup Gits into 2 Cd's, with 2 ogg streams (jap, Eng), and the Dvd is interlanced, so I'm using Toms to deinterlace it.. The bitrate reported by Gknot ia around 1911, with a 704*368 pal Anamorphic aspect.. my question is.. What settings should I use.. I don't know if I'm choosing this right.. Size and audio are what I want, because I need extreme quality.. But I'm not sure about filtering and related issues..

Could all you help the newbie here?? Im using Knot latest build, VdubMod included in Gknot, and Avisynth 2.5 :P

PS: The image back there was really cool.. I liked it.. Ohh, I don't mind speed.. I'm more consourned with the final quality :)

Once again Thank you :) [[[]]]

Arrakis_Dune OUT

PS2:

#
# Created with Gordian Knot
#
# http://gknot.doom9.org
#
# PLUGINS
LoadPlugin("C:\PROGRA~1\GORDIA~1\mpeg2dec3.dll")
LoadPlugin("C:\PROGRA~1\GORDIA~1\undot.dll")
LoadPlugin("C:\PROGRA~1\GORDIA~1\TomsMoComp.dll")
#
# SOURCE
mpeg2source("E:\GHOST_IN_THE_SHELL\VIDEO_TS\New Folder\GITS Main.d2v")
#
# CROPPING
crop(6,16,708,540)
#
# DEINTERLACING (1)
#FieldDeinterlace()
#FieldDeinterlace(blend=false)
TomsMoComp(1,5,1)
#
# RESIZING
LanczosResize(704,368)
#
#
Undot()

[mf]

And this is related to mfToon in what way?

[Arrakis_Dune]

Well, I was wondering if I could use your filters to help my backup.. I've read a lot, and they seem to be the ideal ones for the "job".. The only problem Is how to apply them to the rip.. If you could help I would be appreciated :)

[[[]]]

Arrakis_Dune OUT

[mf]

Well, like it says on the top of the thread.
Import("X:\Path\to\avs_stuff\mfToon-v0.51.avs")

[your filters]

mfToon()

[Arrakis_Dune]

Thanks.. I was encoding a tinny bit to fast, without any improvementes to the eye.. So I knew something was wrong.. I was missing

mfToon()

Anyway, on Ghost In The Shell, I must say your filters are the greates.. I've seen major improvments in the image quality and in the lines definition.. Once again, thank you :)

Arrakis_Dune OUT

[Wilbert]

Sorry for the useless interruption. I splitted Arrakis_Dune's post from this thread, because I thought it was totally unrelated.

I guess it was not, since he added it back again.

Sorry for the troubles!

[mf]

Originally posted by Arrakis_Dune
Anyway, on Ghost In The Shell, I must say your filters are the greates.. I've seen major improvments in the image quality and in the lines definition.. Once again, thank you :)
No problem :).

[mf]

And here it is once again!

mfToon-v0.52 (http://mf.creations.nl/avs/functions/mfToon-v0.52.avs)


Have fun :).

[ZoNtO]

Do you have new links to those 3 plugins you need? I can't get the ones in your first post to work at all! Thanks!

[mf]

http://mf.creations.nl/avs/filters/MaskTools142.dll (this is NOT for P4 users! Get the latest version off the "New masktools version" thread!)

http://mf.creations.nl/avs/filters/WarpSharp.dll (DON'T use plugin autoloading, if you do want to, read up in this thread, there is a new [unsupported] version mentioned that shouldn't have autoload problems)

http://mf.creations.nl/avs/filters/aWarpSharp.dll

[ZoNtO]

Thank you my friend, I got this and Dering to work because of all your help. Rock on!

[ssjkakaroto]

edit: nm, i got it working with the latest masktools, but it's strange since i have a p3 so i thought v1.42 would work :p

[mf]

Sneak peek!

I've been playing around from scratch, and suddenly I got this:
http://mf.creations.nl/avs/newmftoon-sneakpeek.png

I'm aware of the full-frame darkening, that's an issue of MaskedMerge. Don't dare asking for it now, it reflects NinjaMice's quote in my sig all too well. I'll give away two secrets though: 1) it uses CoronaEdgeMask, 2) it's slower than current mfToon. :D

Edit: uploaded screenshot without full-frame darkening.

[lamer_de]

so, where's the difference in output besides that it darkens the whole image? I can't spot any signigficant differences
(might be Naruto related though, everytime I see a scene from that anime, I feel like throwing up :p ).

EDIT: Ah, k, it's supposed to look the same ^_^ Maybe you should link to your other thread from this thread aswell. Well, as it's even slower, it's cool that you've found another way to create edge masks, but not really usable.

CU,
lamer_de

[mf]

KEEP LAMER! :devil:

It's not supposed to look the same, there is a difference! Halos are gone (thanks to HQUnfilter), and lines are darkened without creating halos in shadows/dark areas (a known bug of the current mfToon method). This new version only works with coronamask, cause it uses a key aspect of it. So the slow speed really can't be taken away ;). Also, I've thrown in a mix of warp darkening and regular fxToon-type darkening.

[killerhis]

so where is this new version?

*KillerHIS wants the new mfToon version*

:p

[LB]

I think this is just one more of mf's evil attempts in slowing down our already slow render speed :devil:

It's called the slowmedown(). Doesn't do anything to the video, but you'll notice a diff in your speed, for sure. :p

[lamer_de]

KEEP LAMER!
Please stop using such useless statements. While being in Keep may make you loose some braincells, it doesn't mean that everyone in it is a egocentric speed subbing dumbfuck. I am sick of those annoying flames.


It's not supposed to look the same, there is a difference! Halos are gone (thanks to HQUnfilter),
That is hardly a feature of mftoon then ;)

and lines are darkened without creating halos in shadows/dark areas (a known bug of the current mfToon method). This new version only works with coronamask, cause it uses a key aspect of it.

Ah, here's the information. Thanks. However, you will hopefully agree with me that it is next to impossible to detect this feature from 2 screencaps (which don't even feature "shadows/dark areas" [well, maybe the shoulder of that girl]), so I think my question was legit.

CU,
lamer_de

[mf]

Originally posted by lamer_de
Please stop using such useless statements. While being in Keep may make you loose some braincells, it doesn't mean that everyone in it is a egocentric speed subbing dumbfuck. I am sick of those annoying flames.I thought you also saw the smiley. I just like to poke fun at you guys without really meaning it. Ask DeathWolf :).That is hardly a feature of mftoon then ;)Well, you'd be surprised. I'm actually planning to integrate it into mfToon in a way that makes it much more effective (and slow :devil:).Ah, here's the information. Thanks. However, you will hopefully agree with me that it is next to impossible to detect this feature from 2 screencaps (which don't even feature "shadows/dark areas" [well, maybe the shoulder of that girl]), so I think my question was legit.
Want me to include a screenshot of the old mfToon as well? I can indeed see some usefulness in that :). I'll make a screenshot of HQUnfilter+old mfToon, so you can see the clear haloing issue.

Edit: okay, you win :D. I totally picked the wrong screenshot for showing differences. New comparison!

HQUnfilter:

http://mf.creations.nl/avs/newmftoon-sp-hqunfilter.png

mfToon v0.52:

http://mf.creations.nl/avs/newmftoon-sp-mftoon5.png

mfToon v0.6pre1:

http://mf.creations.nl/avs/newmftoon-sp-mftoon6.png

The "kawaii wan-chan" shows halos around his mouth, and Shikamaru's net-shirt is really ruined.

[killerhis]

OK mf sorry to tell you this, but I found something on v0.52 that I dont like... maybe its just me or maybe its know, but fix it asap!

Somehow I get fucked top/bottom edges when I use mftoon. I traced the filter that made those artifacts and it was MFtoon for sure! To see what I mean, check this short clip and look at the bottom/top of the clip, you'll see a small line wich looks like a edge of a fucked source, but the source is as clean as it gets ^_^.

NGE f**ked edges by mftoon :) (http://home.hccnet.nl/h.chourak/test(edge).avi)

If noone else has had this problem before, it could be that I have like a wrong version of a filter loaded. Can someone give me then a link with all filters that are 100% correct?

Keep up the good work mf

[mf]

You're not the first with this problem.
AddPadding-v0.1 (http://mf.creations.nl/avs/functions/AddPadding-v0.1.avs) was made for this purpose. Add padding, apply mfToon, then crop off the padding again.

[killerhis]

heheh I love your fast reply mf ^_^.. good that we are in the same timezone :)

OK I'll give it a try, I was making a samekind of function as we but I'll use this, hopefully it does what I want it to do

and thankz again mf :)


PS: maybe its usefull to integrate it in your mftoon script and speedoptimize it :)

[mf]

Originally posted by killerhis
PS: maybe its usefull to integrate it in your mftoon script and speedoptimize it :)
Integrate that ugly piece of script into mfToon? nevAR! I made that in 30 mins *shiver*

[dapipa]

hi!any progress with mfToon v0.6?i'd just like 2 slow my painfully fast encodes a bit...
:)

[mf]

I've experimented with some EDI, but nothing more. I haven't had my mind on it much either, lately :).

Edit: Even a heavily modified mfToon v0.6pre1 can't face up to the crappiness of cosprayers, MAN I hate that anime :).
http://mf.creations.nl/avs/cosprayers-still-SUCKS.png
The authorer of that broadcast should be executed without blindfold.

[mit_mis]

oh, I don't know why, but I'm getting this error:
Error initializing audio stream decompression:
The requested converion is not possible.

and this is my source:
LoadPlugin("MaskTools142.dll")
LoadPlugin("warpsharp.dll")
LoadPlugin("awarpsharp.dll")
LoadPlugin("Convolution3DYV12.dll")
Import("mfToon-v0.52.avs")
AviSource("C:\sysreset\download\Gekiganger_III.avi")
ConvertToYv12()
ConvertAudioTo16bit()
mfToon()

[Dreassica]

Don't see how thats related to MFtoon in any way.:sly:

[mit_mis]

cause with older versions this error isn't showing... I don't know what to do:(
[edit]: Sorry, it's working now. I just had to delete some files;P
[edit2]: Not working:/ This is the error:
Evaluate: Unrecognized exception. line 113
and this is line 113:
.aWarpSharp(cm=cwarp2, depth=wdepth, blurlevel=wblur, thresh=wthresh)
Some ideas?

[mf]

@mit_mis
No idea. Sorry :(.

@all
Just for fun, I made a commented version of mfToon-v0.52. The script is exactly the same, just there's comments in between. I'm looking forward to reading your comments on my comments :D.

####
##
## Commented version, for your reading pleasure. Needless to say, I should've
## been doing more useful things.
##
##

function mfToon(clip orig, int "twidth", int "theight", int "ssw", int "ssh", int "xstren", \
int "xthresh", bool "cwarp", bool "sharpen", int "strength", float "wdepth", int "wblur", \
float "wthresh", int "drange", float "dboost", int "dlimit", bool "debug", bool "doutput", \
string "dclip", bool "show", int "scolor") {

# normal params

strength = Default(strength, 255) # line darkening strength, 0-255
sharpen = Default(sharpen, true) # sharpening on/off
cwarp = Default(cwarp, true) # chroma warp on/off
cwarp2 = cwarp ? 1 : 0
wdepth = Default(wdepth, 16.0) # warping depth, ?-?
wblur = Default(wblur, 1) # warping blur level, ?-?
wthresh = Default(wthresh, 0.5) # warping threshold, 0.0-1.0
ssw = Default(ssw, 4) # supersample factor horizontally, 0-inf
ssh = Default(ssh, 4) # supersample factor vertically, 0-inf
twidth = Default(twidth, orig.width) # target width (useful for cropping), 0-inf
theight = Default(theight, orig.height) # target height (useful for cropping), 0-inf
show = Default(show, false) # show which lines are being darkened
scolor = Default(scolor, $FF00FF) # which color to show lines in

# advanced params

xstren = Default(xstren, 255) # xsharpening strength, 0-255
xthresh = Default(xthresh, 255) # xsharpening threshold, 0-255

## Where have all the params gone?! - They were useless as of 0.5, but I forgot to clean them.

drange = Default(drange, 64) # detail range, 0-255
dboost = Default(dboost, 1.0) # detail boost, 0.1-10.0
dlimit = Default(dlimit, 30) # detail limiter, 0-255
debug = Default(debug, false) # debug mode on/off
doutput = Default(doutput, true) # print debug info on processed image
dclip = Default(dclip, "rclip1") # which stage of the processing to show

ssw2 = twidth * ssw
ssh2 = theight * ssh
sharpen2 = show ? false : sharpen


## Unsharp mask increases contrast of adjacent picture elements (pels).
## It is the main darkening "engine" for mfToon.
##
orig.Unsharpmask(300, 4, 0)
sharp = last
##
## I don't like white halos, and we don't need them. Only black ones will do.
##
MaskedMerge(sharp, orig.GreyScale(), orig)
sharp1 = last
MaskedMerge(sharp1, orig.GreyScale(), orig)
sharp2 = last

## Funny thing. I don't use this anywhere else in the script. =)
greymask = orig.Greyscale().Invert()

## Don't you just love scripting messes like this?
## Don't try to touch this. Old stuff, and I forgot most of what it /exactly/ does.
## I could've rewritten it, but then the parameters and effect would change. It's best
## to leave it.
##
## Build a "cartoon" mask and amplify it so it actually has an effect on the video.
detailmaskpre0 = orig.EdgeMask(3, 255, 255, 255, "cartoon", Y=3, V=1, U=1) \
.Tweak(0.0, 1.0, drange, 1.0).Levels(60, dboost, 255, 0, 255) \
.Levels(0, dboost, dlimit, 255, 0).GreyScale().Inflate().Deflate().Deflate().Deflate()
##
## Build a "roberts" mask with the same amplification (I can feel the FPS drop already).
## Basically, "cartoon" is too weak by itself.
detailmaskpre1 = orig.EdgeMask(3, 255, 255, 255, "roberts", Y=3, V=1, U=1) \
.Tweak(0.0, 1.0, drange, 1.0).Levels(60, dboost, 255, 0, 255) \
.Levels(0, dboost, dlimit, 255, 0).GreyScale().Inflate()
detailmaskpre2 = YV12Layer(detailmaskpre0, detailmaskpre1, "mul", 255, chroma=false, Y=3, V=1, U=1).Blur(1.0)
##
## Add the two edgemasks together.
YV12Layer(detailmaskpre2, detailmaskpre2, "mul", 255, chroma=false, Y=3, V=1, U=1).Levels(0, 1.0, 190, 0,

255)
ConvertToYV12().Invert().Inflate().Invert()
detailmask = last
##
## Modify the edgemask so only the edges that exist on a dark pixel in "orig" are assumed to be
## cartoon lines. Looks like I could've used my "greymask" here, but I haven't.
white = orig.Binarize(Y=-255,U=-128,V=-128)
linemask1 = MaskedMerge(white.ConvertToYV12(), detailmask, orig.Invert().ConvertToYV12()).Invert()
linemask = (strength == 255) ? linemask1 : linemask1.levels(0, 1.0, 255, 0, strength)

## This is for "show lines" mode. Either use the darkening clip "sharp2", or just an identifying color.
color = BlankClip(orig, color=scolor)
sharp3 = show ? color : sharp2

## Overlay sharp3 over original. If show=true, clip will be greyscale with colored lines, otherwise
## chroma is restored from "orig".
dark = MaskedMerge(orig.Greyscale(), sharp3, linemask, Y=3, U=2, V=2)
darkmerged = dark.MergeChroma(orig)
finaldark = show ? dark : darkmerged

## For our added resize functionality.
semifinal=orig.BicubicResize(twidth, theight, 0, 0.75)

## SSXSharpen and WarpSharp. I'd say it's self-explanatory.
final = dark.BicubicResize(ssw2, ssh2, 0, 0.75).XSharpen(xstren, xthresh) \
.BicubicResize(twidth, theight, 0, 0.75).MergeChroma(semifinal) \
.aWarpSharp(cm=cwarp2, depth=wdepth, blurlevel=wblur, thresh=wthresh)

## Output conditionals. For debug mode and stuff.
rclip1 = sharpen2 ? final : finaldark
Eval("dclip1 = doutput ? "+dclip+" : orig")

## Debug text.
dstring1 = "mfToon v0.52 by mf - Debug mode ;p"
dstring2 = "Pointsized: DisabledxDisabled"
dstring3 = "Bicubicsized: " + String(ssw2) + "x" + String(ssh2)
dstring4 = "Outputsize: " + String(twidth) + "x" + String(theight)
dstring5 = "Debug image: " + dclip
clipstring = sharpen2 ? "final" : "finaldark"
dstring6 = "Output image: " + clipstring

## Overlay debug text over video.
dclip2 = dclip1.Subtitle(dstring1).Subtitle(dstring2, y=33).Subtitle(dstring3, y=48) \
.Subtitle(dstring4, y=63).Subtitle(dstring5, y=78).Subtitle(dstring6, y=93)
## But do we really need to debug?
rclip2 = debug ? dclip2 : rclip1

return rclip2
}

## I'm still waiting to be able to run this realtime on my ffdshow. Bah.

function mfToonLite(clip orig, int "twidth", int "theight", int "strength", int "dstren", int \
"drange", float "dboost", int "dlimit", string "mask") {

# S N I P - the code is gone, it'd make my post too long.

}

[Didée]

Hah, what a script! ;)

As I never touch animee, I never have used mftoon ... and from reading the script, I get headaches. But then, I get them also, when reading some of my own scripts :D

Two things that actualy fell into my eyes:

1. Invert().Inflate().Invert()

Any special reason for this, except for eating more CPU cycles?
Or do you experience this behaves different from a simple "Deflate()"? (Well, I could simply try it, but am too tired for that now.)

2. You are using quite some inflate's & deflate's in the script. Assuming that you apply these to greyscale masks, then these should run faster when you call them with "(Y=3,U=1,V=1)" instead.

Good night

- Didée

[mf]

1) "old stuff" says it all. Looks like a snippet I never noticed and thus never changed. I think a long time ago in a galaxy far far away there was some kind of problem with deflate. Can't remember exactly what anymore though
2) u=3, v=3 is default for inflate and deflate. Passing the argument is a waste of keyboard cycles :D.

[Manao]

Just to correct the small typo of mf : default argument are y=3, u=1 and v=1.

The explanation of the invert.inflate.invert must have been that some times ago, deflate was quite buggy :D

Didee : did you tried the last version of the MaskTools, and did the issue with YV12LUT gone ?

[Didée]

[raping mf's thread]

Manao:
No, didn't check the new version for that issue yet, sorry. Too busy inventing other new ideas ;)
Will report as soon as I checked it.

- Didée

[mit_mis]

Who'll help me?? I want to use it too... but I can't:( and don't know why ;_;
@mf
when will you relese next version??

[Soulhunter]

Originally posted by mit_mis
Who'll help me?? I want to use it too... but I can't:( and don't know why ;_; Have you tried to process your source without the audio... :confused:




@mf

Thus commented version is very nice... :D

Remembers me all this dotty-param-files from various computer games !!!

WeaponID = 01
WeaponName = Shotgun # Boom... What a pleasure !!!
SG_A_range = 10 # Distance to introduce funny FX to heads
SG_B_range = 30 # Hey, its no sniper riffle... Got it ???
SG_damage = 25 # Defeat the super-giant-techno-bot with only 150 hits
Maybe you could add some poem or funny storys also ???

Having a small basic version then & a special EX version also... :cool:


Bye

[mit_mis]

Have you tried to process your source without the audio...
No, but I think, that it'll not help, cause I have problem with the script.
@mf
please help, cause I want to make Gekiganger III, and it's really in poor quality...

[malkion]

this simple script works for me mit_mis. using all the correct dll's of course.

loadplugin("e:\dll\mpeg2dec3dg.dll")
loadplugin("e:\dll\warpsharp.dll")
loadplugin("e:\dll2\masktools.dll")
loadplugin("e:\dll\awarpsharp.dll")
import("e:\dll2\mftoon-v0.52.avs")
setmemorymax(128)
mpeg2source("e:\eko eko azarak\eko.d2v",idct=5)
crop(8,6,-8,-0,align=true).lanczosresize(640,352)
mftoon()

side note, maybe just processing your audio separately and muxing it in later?

[edit]: try grabbing the awarpsharp off of warp enterprise...
[edit2]: i noticed u're missing setmemorymax(), these scripts like it.
[edit3]: now that's not right. lol. mf already stated which masktools to use earlier in this thread. (the one that works, ofcourse, and this depends if u have a p4 or amd)

[mit_mis]

maybe something is wrong with my awarpsharp.dll... can someone tell me which one i've got to have??

[mf]

@mit_mis
Unrecognized exceptions are not my fault! I can't do much about them.
Make sure you have the right filters and avisynth version, and close all programs if the problem persists. That's all I can say to help.