Incredibly challenging hard telecined/progressive project

[pwnsweet]

Hello,

I have a very challenging job to do. I have two versions of the same episode of an anime. One version is progressive but has black crush, the other has no black crush, but is hard telecined with screwed cadence. I want to either:

1) Restore the hard telecined source so that it is as 'clean' as possible, or

2) Somehow utilize the hard telecined source to restore as much detail as possible in the progressive source.

I have made an attempt at 1) and you can find my script and the result in this archive (MEGA 41mb) (https://mega.nz/#!oYAXgQxI!01gjgWpcE2GI8Q1H809EByZaXPWSs8fr4Uom3ikiKO0). Samples of the same scene from both sources are also available in the linked archive. It's not too bad but there are clear artifacts from the usage of interframe(). Regarding 2), is it possible to extract the detail in the hard telecined source via the luma channel and overlay it onto the progressive source? If so, would this produce a better result than what I've managed to achieve so far?

Can any of you wizards produce a more 'visually pleasing' output than what I've managed to do? If so, can you please post your script below?

EDIT: As requested here is the uncompressed original sample (154mb) (https://mega.nz/#!UB40jIJb!o0C-zgl_lipYJh1_CR-5dp6aD3Ry4FL2VFzVWZAMeo4)


http://i68.tinypic.com/264t0rr.jpg http://i67.tinypic.com/v5bitf.jpg

[poisondeathray]

Do you have the original for "hard telecined.avi" ? Surely it didn't come as lagarith or as 720x540 ? The main problem is that it's been resized while still interlaced , in a non interlaced aware fashion

[pwnsweet]

Do you have the original for "hard telecined.avi" ? Surely it didn't come as lagarith or as 720x540 ? The main problem is that it's been resized while still interlaced , in a non interlaced aware fashion

I've provided a link in the OP to what you have requested. Thanks for taking a look at this for me.

[poisondeathray]

I'll take a look at it, but it would be better if you posted the original, original. (ie. pre-vdub .) . e.g. If it was a MPEG2 /DVD , post the .m2v

People usually don't like downloading uncompressed material . And if it is uncompressed media (audio, video, images), forum courtesy usually means compressing it with archival software (e.g. with zip, rar etc..) to reduce the filesize

[pwnsweet]

I'll take a look at it, but it would be better if you posted the original, original. (ie. pre-vdub .) . e.g. If it was a MPEG2 /DVD , post the .m2v

People usually don't like downloading uncompressed material . And if it is uncompressed media (audio, video, images), forum courtesy usually means compressing it with archival software (e.g. with zip, rar etc..) to reduce the filesize

I want to help you in any way that I can. I have the entire vob (5.77gb). I also have the .d2v from when I indexed the vob. Would you like me 7zip the vob and .d2v and upload that?

[poisondeathray]

Just cut a section , large enough with motion, with dgindex, and upload the .m2v. It's not necessary to upload the .d2v

I had a peek at the uncompressed AVI, and if that's any indication it's going to be very difficult. The fields are blended with very few clean fields

[pwnsweet]

it's going to be very difficult. The fields are blended with very few clean fields

yep :(


EDIT: OK, I am super excited right now. I just created a 2:25 sample .m2v for you poinsondeathray. You can find it here (https://mega.nz/#!UB40jIJb!o0C-zgl_lipYJh1_CR-5dp6aD3Ry4FL2VFzVWZAMeo4) (also added to the OP). I opened it in Windows Media Player 12 (the one that comes with Windows 7) and it plays the clip flawlessly. There is absolutely no interlacing visible. When I open the same clip in PotPlayer and avspmod (mpeg2source on the d2v), it's interlaced.

So what's going on here? WMP12 is producing the result that I want, but I don't know how it's doing it and I don't know how to find out.

[poisondeathray]

Ok just to clarify some terms, the new 154MB link is the .m2v - it's not "uncompressed" so you might want to change the label in the first post . It uses MPEG2 compression for DVD . The previous "uncompressed" video from vdub was really uncompressed, because it was decoded (decompressed) from MPEG2, and exported from vdub without compression. The one before that was "losslessly compressed" with lagarith





EDIT: OK, I am super excited right now. I just created a 2:25 sample .m2v for you poinsondeathray. You can find it here (https://mega.nz/#!UB40jIJb!o0C-zgl_lipYJh1_CR-5dp6aD3Ry4FL2VFzVWZAMeo4) (also added to the OP). I opened it in Windows Media Player 12 (the one that comes with Windows 7) and it plays the clip flawlessly. There is absolutely no interlacing visible. When I open the same clip in Potplayer and avspmod (mpeg2source on the d2v), it's interlaced.



When viewing in WMP , it's deinterlacing automatically by default. But the blends will still be there. Other players might require you to manually activate a deinterlacer depending on the file type

But main field blending problem is still there




Something else I've noticed, the d2v of the VOB says 99.71% VIDEO whereas the d2v of the m2v clip provided in this post is 100% VIDEO.

It's probably inconsequential at that high percentage. Usually this means a slight change in the cadence e.g. the main intro titles or credits might be slightly different

[poisondeathray]

Just to be thorough, what was the original source for progressive.avi ? Is it possible some manipulation you did elevated and compressed the black levels ?

[pwnsweet]

When viewing in WMP , it's deinterlacing automatically by default. But the blends will still be there...but main field blending problem is still there


You're right. I when I pause the video I can see the frame blending. That said, it's a a result I would be happy with if I could replicate it in avisynth. Therefore, I suppose the aim of this thread has now changed.

Does anyone know what deinterlacing method WMP12 uses and what the equivalent is in avisynth?

[pwnsweet]

Just to be thorough, what was the original source for progressive.avi ? Is it possible some manipulation you did elevated and compressed the black levels ?

The source was a DVD that had been IVTC'd. To answer your second question, no, the blacks were crushed on the source. In fact, I actually elevated the blacks slightly. The source is worse. Since then, a blu-ray has been released and the blacks are equally crushed.

[kuchikirukia]

Both 60 and 48fps seem to watch reasonably well.

[Sharc]

I think the "hard telecined" source is messy with all the blended fields. For the first half of the clip every 5th field only seems to be intact.
AssumeTFF()
bob()
selectevery(5,3)
changefps(24000,1001)

Instead of changefps() one should interpolate the missing frames. I didn't try further because the pattern changes in the 2nd half of the clip.

Edit:
So for the 1st half of the clip perhaps:
AssumeTFF()
tdeint(mode=1) #or QTGMC()
selectevery(5,3)
#changefps(24000,1001)
interframe(cores=4, gpu=true, newnum=24000, newden=1001, tuning="animation")

[wonkey_monkey]

I think the "hard telecined" source is messy with all the blended fields.

What's worse is that the upper half of each field isn't blended as much as the lower half. It's like there's a soft wipe between a slightly blended upper half and a badly blended lower half.

[kuchikirukia]

Try PeculiarBlend. I've never tried it, having personally found the 60fps/48fps methods look just fine.