Anime: Anti-aliasing, and filter suggestion help

[Maldark]

I've been encoding for a little while now, but there's still quite a few things that i can't seem to eliminate from my encodes and now i'm asking for your help.

First things first, I'm encoding Anime from dvd, and when I resize the source it produces an ungodly amount of "jaggies" i've tried just about every resize filter to no avail, so now i've been looking at using an anti-aliasing filter but i have no idea how to edit the avs script to use it.

Secondly i'm encoding from a PAL source and have noticed that in panning scenes there seems to be a small jump in frame rate every second or so, and it's really really annoying, is ther anyway to eliminate this?

Thirdly, the source is rather old and appears to jostle about on the screen a little bit, is there a way to eliminate this?

Lastly, should I bother using filters such as warpsharp, since it's a dvd source would this be a waste of time?

Just a little more info, i'm encoding from DVD -> h.264 ~1100Kbps.

This is my curent avs script.

# PLUGINS
LoadPlugin("D:\!Ripping!\GordianKnot\DGMPGDec\DGDecode.dll")
LoadPlugin("D:\!Ripping!\GordianKnot\AviSynthPlugins\KernelDeInt.dll")
LoadPlugin("D:\!Ripping!\GordianKnot\AviSynthPlugins\UnDot.dll")

# SOURCE
mpeg2source("D:\!Raws!\BUBBLEGUM_CRISIS_2040_VOL1\VIDEO_TS\New Folder\VTS_04_1.d2v")

# DEINTERLACING (2)
KernelDeInt(order=1,sharp=true)

# CROPPING
crop(12,2,696,572)

# DENOISING: choose one combination (or none)
Undot()

mergechroma(blur(1.3))

# RESIZING
LanczosResize(696,522)

I'll upload a sample video shortly

EDIT: http://rapidshare.de/files/15694770/sample.mkv.html

[jellysandwich]

It might help if you give a sample of the original, unedited/uncompressed source. Also, the gurus of the avs forum (http://forum.doom9.org/forumdisplay.php?f=33) might be able to help you better.

And welcome to the forums.

js

[Maldark]

http://rapidshare.de/files/15699470/VTS_04_1.demuxed.m2v.html
That's the uncompressed source.

I also did a bit more searching around the forum and added this to the end of my avs seems to have done away with most of the jaggies


before = last
PointResize(width*2, height*2)
ConvertToYUY2()
TurnLeft()
ConvertToYV12()
SangNom()
ConvertToYUY2()
TurnRight()
ConvertToYV12()
SangNom()
Bilinearresize(width/2, height/2)
MergeChroma(before)

[Mug Funky]

i don't currently have the bandwidth to download your sample...

what's the region and title of this disc? if it's region 4 anime i might be able to help as it's probably come through me for something. either way, PAL anime usually means standards-conversion, which is not an ideal source for making x264 backups (because the x264 devs have higher priorities than supporting interlaced encoding, right or wrong). there's only a few exceptions to that rule.

but as far as the aliasing goes, i don't see where that'd come from. i've not yet seen an anime source that has aliasing (though they can be incredibly sharp, and strobing problems can occur sometimes, like in the hatched shading in cromartie high... that never looks good after going through the converter). just a usual lanczos should give you a nice result.

[Maldark]

yeah it's region 4 pal, i'm an aussie. I believe the aliaising is coming from the fact that pal sources have a larger amount of scanlines than ntsc sources, so it's compressed more in the up/down direction. The aliasing really only becomes annoying and really apparent where there's a large panning scene, or when the scene jostles (al la problem #3). I've started to use TomsMoComp and it seems to have eliminated most of that so it's actually not looking too bad atm.

Note: if anyone was wondering about the weird resolution i was using, I was trying to see iff leaving the horizontal res the same so it didn't have to be resized made any difference.

[Maldark]

I solved the motion compensation and and jaggie problem by replacing the interlace filter with sangnom which seems to do an awesome job.

So now the only problem left is the frame rate jump which i believe is caused by the dvd releasers doing a poor ntsc -> pal conversion, any ideas on how to fix this?

[jel]

maldark

i will move this thread to the avisynth usage forum for you.

good luck

j

[Mug Funky]

hmm. which title is this?

btw, tdeint > tomsmocomp. for standards-converted stuff, try make it 50fps progressive using tdeint(1,1,mtnmode=3). you'll find it looks pretty good when you watch it in realtime.

deblending is a possibility, but there's always the possibility that the blender here is blending more than 1 field (it's got a setting called "aperture", which by default is on "normal", but it controls the temporal width of it's filter).

could you name the title? the only things i can think of that would have aliasing would be cromartie high (dense crosshatched lines look to the converter like interlace, so thin horizontals become thick verticals that flicker very fast. usually not noticable unless you rip the disc :)), or maybe the final disc of Azumanga Daioh, as that was done here instead of at ADV (they messed up their encode baaadly. yankies just can't figure PAL out, but bless them for trying :). in the end we got NTSC tapes and converted them ourselves).

...hang on...

zOMG WHY AER YUO RIPPING MY DVDS!!! hehe. just kidding.

the frame rate jump which i believe is caused by the dvd releasers doing a poor ntsc -> pal conversion

i doubt that, but it depends on the title and whether our AV testers picked it up or not. i can't imagine doing a poor conversion unless i'm given a poor master :)

[edit]

hmm, should have read your script for the title... never mind.

tokyo 2040... that's oldschool. way before i was there (like the 2nd Box release madman did, i think, and VHS tapes before that - Eva and tokyo 2040 pretty much financed the whole operation you see taking up half the shelf-space in stores today, and means we've got a virtual monopoly on region 4 anime, except for the titles the big studios nab before we can). those were converted to PAL out of office - back in those days there wasn't a standards-converter here, let alone an NTSC deck. i think they were done at either Comcopy or FATS, not sure (prolly the former), so there was no control over the conversion.

either way, it's not that bad of a job. the original film is a bit shaky, and so the diagonals will alias a bit (3:2 pulldown + shaky film = alias). also there's ghosts around edges from previous frames i'm sure you've noticed. not much can be done about those...

i'd personally like to see this series remastered... the film stock looks good, so a lot could be made of it. the intro is a mess though.