Interlace maintenance encoding vs. Progressive VFR encoding

[lunaticmoon]

In the talk which specialized in Anime, the Anime of hybrid material is increasing more recently.

The following two methods can mainly be considered to encode hybrid material smoothly strictly.


A) Interlace maintenance encoding approach:
In the material holding the interlace, it is not careful for especially treating hybrid material. However, the quality of de-interlacer at the time of reproducing this as progressive is asked.

About interlaced encoding, the page of minolta is detailed.
http://www.vrac.iastate.edu/~chadspen/interlace/index.html


B) Progressive VFR (variable frame rate) encoding approach:
The material itself is encoded and saved in the progressive state. In order to treat hybrid material, there is a method of setting to VFR or the method of setting to false VFR (120fps etc.). If the method of thinning out a suitable progressive frame is automatic, it has the problem that processing is difficult.

There is the following about a false VFR (120fps) filter.

1) DEC60() avisynth filter and AVI60.exe
http://www.geocities.co.jp/SiliconValley-Sunnyvale/3109/
http://www.geocities.co.jp/SiliconValley-Sunnyvale/3109/oldtools.html

2) itvfr.auf, vfrout.auo AVIUTL(and avisynth) filter
http://www.tenchi.ne.jp/~yoko/aviutl/vfrout/

3) Auto60.auo AVIUTL filter

No WebPage :(

4) Auto field shift AVIUTL plug-in (AFS)
http://www.geocities.jp/aji_0/


Though it was regrettable, as long as the opinion of people of a forum was heard, by RV10, that it cannot finish treating well made both of the techniques clear.

To an individual, I like the appearance of RV10 at the time of treating Anime. It seems that it becomes impossible however, to solve the present condition of Anime then.

A) won B) in the point of a user's ease of treating.
B) won A) in that it is precisely smooth.

Hybrid material of future Anime tends to increase increasingly. Which do you of this forum choose about this treatment?

Z1) A = Interlace maintenance approach
Z2) B = Progressive VFR encoding approach
Z3) Since trouble is disagreeable, it does not care, even if not smooth.
Z4) I do not treat Anime.
Z5) First of all, it is uninterested.

When it comes to me ... Is it delicate? :confused:

[lunaticmoon]

Automatic field shift plug-in was upgraded to 5.1, while Doom9forum had fallen.

I covered the manual of the attachment over machine translation, and added some proofreading this time.

It seems that different approach from plug-in of other formation of false VFR is used for automatic field shift plug-in.

Now, as for automatic field shift plug-in, the community to which I belong also attracts attention.

Automatic field shift plug-in:
http://www.geocities.jp/aji_0/
Original manual
http://www.geocities.jp/aji_0/afs_guide.html


Automatic field shift interlace release plug-in Guide


1. Introduction

The automatic field shift (afs.auf) is interlace release plug-in for AviUtl. Although operation is checked by AviUtl0.99, 0.98d etc. of reports of operation etc. is obtained also in AviUtl of a former version. This text explains the feature of the automatic field shift, processing, and a function.


2. Feature of Automatic Field Shift

When terrestrial broadcasting is recorded on videotape with PC, the data with which horizontal stripes are contained in the picture with a motion may be created. Such a picture is called interlace picture. The picture containing the horizontal stripes which an interlace (interlace) means that it weaves in by turns, and are obtained on PC videotape recording is the combination of the picture of two sheets.

Terrestrial broadcasting sends the picture which shifted delicately in low resolution every 1/60 seconds. In PC, two sheets are saved combining this picture as a high resolution picture of every 1/30 second one sheet. For this reason, if a difference is in the contents of the combined picture of two sheets, the portion is visible to stripes. In order to distinguish the picture of terrestrial broadcasting, and the picture of PC videotape recording, the picture of 1/30 second unit of the "field" and PC videotape recording is called "frame" for the picture of 1/60 second unit of terrestrial broadcasting.

An automatic field shift shifts the field combination of a frame. (it shifts) It is things and is plug-in which suppresses striped generating. The frame which shifted the field needs to be reproduced to the timing as which the field included in inside was displayed from the first. However, the field cannot reproduce original display timing in the same data form as the video of 1/30 second unit made from PC videotape recording for 1/60 seconds since it was the picture of a unit. If data is saved with output plug-in corresponding to the automatic field shift, video reproducible to original display timing can be created. Moreover, various image processing for removing the horizontal striped pattern which is not lost only in a field shift is carried in the automatic field shift.

Processing of an automatic field shift is close to performing 60fps reading by AviUtl and thinning out automatically one of the frames of even number or odd number. The data created also becomes 60fps accuracy. In 60fps(es)-ization, the image contained in sauce does not need to change processing by 24fps(es) or 30fps(es). An automatic field shift can carry out progressive-izing of the image created for the material of various frame rates in the same processing similarly.


3. Processing of Automatic Field Shift

Two paths are analyzed and a screen is compounded by 3 path eye. (He is what was explained later on and, as for Pass 1-3 of the following, a user does not need to be [ order ] conscious of the processing inside an automatic field shift.)

[Pass1] Field combination is determined.

1) A horizontal striped pattern is detected in each field combination before and behind the present frame.
2) The combination of the field is determined.
3) A result is written in a shared memory so that output plug-in can be referred to.
4) A screen end can be removed from a judgment domain (the width which four directions except is specified with the number of pixels).
5) It is hard to shift the field, so that a shift threshold value is large (it always turns off by 256).
6) Combination of the field is not changed when a field shift is turned OFF.

Setting value related to Pass1: A top, the bottom, the left, the right, a shift threshold value, stripes (shift), field shift

[Pass2] Detailed picture analysis for release

1) A horizontal striped pattern and a motion are detected with the frame of the field combination determined by Pass1.
2) Unevenness of the domain judged to be a striped pattern is accustomed.
3) It moves between the adjoining fields and a judgment is shared.

setting value related to Pass2: stripes (release) and Y -- moving -- C -- moving

[Pass3] Composition of the screen canceled [ interlace ]

1) A screen is compounded by the specified release system.
2) The color for every pixel is calculated with reference to the analysis result of Pass2.
3) Scene change detection (release Lv1) and slanting line compensation (release Lv5) are calculated here.
Setting value related to Pass3: Release Lv, scene change detection (release Lv1)

[Others]

A) Infanticide

Since display timing will become uneven if the field is shifted, it is an input image. A frame with a display period shorter than one frame occurs. Since reproduction of such data is heavy, it is made to the data which is easy to reproduce by thinning out the short frame of a display period. This setup is effective, only when corresponding output plug-in is used, after turning ON the field shift.

B) Smoothing

An automatic field shift determines display timing per field synchronizing with a sauce image. For this reason, the data with which the frame of the sauce 2 field and the frame of the sauce 3 field were intermingled by the display period is created. Although such data is faithful to the display timing of a sauce image, a problem may be in reproduction with PC. In animation reproduction of PC, if control of accuracy cannot be performed for 1/60 seconds or the load of reproduction processing is changed, there are many cases where it becomes impossible to reproduce smoothly. Smoothing equalizes both of display periods in the sauce 2.5 field, when the frame of the display period sauce 2 field and the 3 fields adjoins. The data which can be reproduced comparatively smoothly by this also in the environment which cannot perform exact reproduction is created. This setup is effective, only when corresponding output plug-in is used, after turning ON "a field shift" and "infanticide."

C) Formation of 24fps(es)

At the image which broadcast a movie, animation, etc. on television, it is output frame rate. The data which will be easy to reproduce if it fixes to 1/24 seconds may be able to be created. If this option is turned ON, the display timing of a frame is fixed to one 1.25 times the cycle of sauce. This setup is effective, only when corresponding output plug-in is used, after turning ON "a field shift" and "infanticide." In addition, the error of the �} sauce 2 field arises in the synchronization of an image and a sound by 24fps-ization. It 24-fps(es)-turns partially, and when outputting, the frame just behind 24fps portions may be lost under the influence of with error.

D) The display of a shift judging result

The field combination information on the present frame and the following frame is displayed. When there is a field shift, a red box and the following frame are expressed for the present frame as a blue box. At the time of an output, a display disappears automatically.


4. The example of display timing

example 1)

Sauce 60 field/sec
(Figure)
Automatic field shift Interlace release 30 frame/sec (>X> shifted frame)
(Figure)
Correspondence output plug-in 60 frame/sec (* Null frame)
(Figure)
Infanticide on 60 frame/sec
(Figure)
Smoothing-on 120 frame/sec
(Figure)

example 2)

Sauce 60 field/sec
(Figure)
Interlace release 30 frame/sec
(Figure)
Correspondence output plug-in 60 frame/sec
(Figure)
Infanticide on 60 frame/sec
(Figure)
Smoothing-on 120 frame/sec
(Figure)

The above display timing is calculated by afs_client.h of output plug-in.


5. Striped Release Function of Automatic Field Shift

The image-processing function which removes the horizontal striped pattern which did not disappear only in a field shift is carried in the automatic field shift. A release function can be chosen from 0 to 5 by the release Lv of a setup, and as for Lv0, an afterimage of5 [ release nothing, and / Lv1-Lv5 ] decreases, so that a number is large.

[Release Lv0] With no release

A horizontal striped pattern is not canceled. The new frame together put in the field shift becomes an output as it is.

Setting value related to release Lv0: Nothing

[Release Lv1] Formation of field Mie

The field in front of one more is added to the new frame together put in the field shift as an afterimage, and it is crowded. The striped pattern by motion is completely changed into an afterimage. It becomes a screen near the feeling which watches television with an old cathode-ray tube.

If scene change detection is turned ON, the field in front of one will be added on condition that the following, and it will not be crowded, but will double within a frame.

1) A motion is detected from 75% or more of the all pixel in a judgment domain (it judges with a striped (release) value).
2) The color composition in a judgment domain changes 50% or more.
3) The frame which carried out the field shift does not detect a scene change.

In order to take in the field in front of one, it is the desirable release system which is used in the field shift off.

setting value related to release Lv1: stripes (release) and Y -- moving -- C -- moving -- scene change detection (release Lv1)

[Release Lv2] Striped detection doubleness

A striped pattern is detected within a frame, a striped portion is equalized, and it changes into an afterimage. A movie, animation, etc. have turned to the image with few motions of a field unit.

Setting value related to release Lv2: Stripes (release)

[Release Lv3] Motion detection doubleness

As compared with a front frame, only a portion with the motion (change of a color) equalizes stripes. If it is release Lv2, the stationary horizontal striped pattern equalized can be saved. Please use it to crush the outline of the fine character of the stationary telop, and a still picture with framework, such as animation. Keep in mind that there are side effects, like the omission in release of stripes remains if the setting value of motion detection is raised too much.

setting value related to release Lv3: stripes (release) and Y -- moving -- C -- moving

[Release Lv4] Between motion detection assistant

The portion which had a motion as compared with the front frame is complemented with the picture of the field of the direction which crushes and leaves one of the two's field. As for the portion which required this release, vertical resolution becomes half although an afterimage is lost. It is necessary to set up various kinds of threshold values carefully according to the picture of the object to cancel so that a striped pattern may not be detected in any places other than interchange race stripes to cancel.

setting value related to release Lv4: stripes (release) and Y -- moving -- C -- moving

[[Release Lv5] Slanting line compensation complement

The compensation function of a slanting line is added to the complement of release Lv4. Although slanting edge is complemented smoothly, if a complicated picture is canceled, a noise may occur.

setting value related to release Lv5: stripes (release) and Y -- moving -- C -- moving


6. Updating History

2004/08/07 Automatic field shift ver.5.1 correspondence
2004/08/04 Automatic field shift ver.5.0 correspondence
2004/07/20 Automatic field shift ver.4.6 correspondence
2004/07/19 Automatic field shift ver.4.5a correspondence
Miswritten word correction of a release Lv explanatory note
2004/07/18 Automatic field shift ver.4.5 correspondence
First edition



Please try those interested and be.:)

[Wilbert]

A) Interlace maintenance encoding approach:
In the material holding the interlace, it is not careful for especially treating hybrid material. However, the quality of de-interlacer at the time of reproducing this as progressive is asked.
I don't get it. Why is this better than deinterlacing (during encoding) the hybrid stream?

[SeeMoreDigital]

I'm not a big a Anime fan!

Is there much quality difference/drop tuning interlaced Anime into progressive?


Cheers

[lunaticmoon]

thanks for responses.

@Wilbert

In Anime, in a work stage, a material from the first is a progressive material. It is changed into an interlace material in order to broadcast. So, when we finally view and listen to Anime on PC, there is opinion that it is desirable that it is progressive. Moreover, in the present condition, there is a situation [ de-interlacer / which was prepared like MPEG 2 ] of not being so accurate. I think.

@SeeMoreDigital

Dividing a fps portion which is manually different first, and carrying out progressive-ization is the method of obtaining an most exact and smooth progressive material.
They mainly consist of 24fps, 30fps, and these mixture within the same frame (ex. background=30fps, characters=24fps etc.), and the approach of progressive-izing is different, respectively.It is considered to be impossible with the present technology to distinguish this mechanically automatically.
So, when it is the mixed fps material with which 11fps, 7fps, etc. were mixed, especially progressive-izing is difficult and its interlace maintenance is more advantageous. If de-interlacer at the time of viewing and listening merely compares with the material which turned progressive manually since it was not so exact in the present condition, it may be strictly inferior in respect of smoothness etc.
However, I think that whether it notices actually being viewed and listened or it does not notice have individual difference considerably.

[unmei]

As i watch everything on the PC, keeping anything interlaced makes no sense to me. What i would like to see were user friendly tools for avisynth to identify the original framerate for a section and deinterlace and drop the artificial frames. Then i liked to encode each section with its native rate and glue the parts together. I think this should be feasible and i also have an old version of pamels matroska stream editor which looks like it were close to make the glueing possible.
But i'm a bit lazy on this and therefore don't know the current state of the stream editor or whether there are other tools to accomplish this :( But i think fake VFR within AVI is not the way to go (another ugly hack:p) when we have containers that do support real VFR.

[lunaticmoon]

@unmei

I am also consent in general.

However, even if it calls it fake VFR, 120fps approach completely differs from Decomb Hybrid Mode.
The former decides 24fps or 30fps and has only deceived that opposite portion in doubleness.On the other hand, the latter has united the timing of a frame correctly using NULL frame. Therefore, fps as the whole turns into 120fps which are the least common multiple.

Most exact VFR approach is making rmvb which carved section of manually different fps, encoded it by each fps, and carried out simple combination by rmeditor to the present condition Hybrid Material at the last. I think.

Birth of VirtualDubMKV or MKVUTL is still ? :D

[Wilbert]

In Anime, in a work stage, a material from the first is a progressive material. It is changed into an interlace material in order to broadcast. So, when we finally view and listen to Anime on PC, there is opinion that it is desirable that it is progressive.
So, the 29.97 part is progressive encoded as interlaced. To clarify for unmei, this looks progressive on your pc. But, I don't know anything about anime, so I will just shut up :)

Perhaps, the following is a good alternative

http://forum.doom9.org/showthread.php?s=&threadid=80673

[SeeMoreDigital]

Originally posted by Wilbert
...But, I don't know anything about anime, so I will just shut up :) Me neither!

But for VFR encoding, you could also try the .MP4 container instead of AVI!


Cheers

[lunaticmoon]

Although it said and being remembered, I forgot MP4 container.

Isn't there any reference of the tool of the circumference of MP4 container (mkvtoolnix, graphedit, ... like)? except 3ivx relation.