MSU tool for human perceptual codecs comparison

[DmitriyV2]

I repeat here General discussion announce. Hope our metric will be helpful. :)

Any comments are welcome!

We release MSU Human Perceptual Video Quality tool (http://compression.ru/video/quality_measure/perceptual_video_quality_tool_en.html)!
http://compression.ru/video/quality_measure/perceptual_video_quality_tool_en.html

Main idea:
Freely available tool for near professional visual comparison tests execution.

Metric software contains two programs:
* Task manager (planner and statistics calculation tool)
* Player - tool for experts, that plays test sequences:

with 3 seconds rewind (if allowed in task)
with pause (if allowed in task)
showing one pair several times (for expert stability evaluation)
with final mark

see more options in documentation.

Tool implements blind testing schema - experts won't know, which codec was used for particular video.
Testing of several (3-6) codecs simultaneously is highly recommended (more pairs will produce more qualitative comparison).

Please note: number of experts has essential influence on final results.

ITU-R BT.500 or MSU procedures can be used for final result calculation.

Link to metric page (http://compression.ru/video/quality_measure/perceptual_video_quality_tool_en.html)

Enjoy! :)

[neuron2]

Please follow forum rules, specifically rule 8: do not crosspost. Thank you.
:readrule:

[Wilbert]

I removed the other thread.

[DmitriyV2]

I removed the other thread.
Ok! From first I post to General discussion, but later understand - this was wrong place for such anounce. Thank you!

[fankler]

Hi Dmitriy,
Thanks for your tool. I think it's going to be helpful to me altough i didn't test it yet.
Do you plan to implement avs support? This would make it very easy to do a butterfly test.

[DmitriyV2]

Thanks for your tool. I think it's going to be helpful to me altough i didn't test it yet.
Do you plan to implement avs support? This would make it very easy to do a butterfly test.Yes, it possible. We already support AviSynth in our formal metric tool (http://compression.ru/video/quality_measure/video_measurement_tool_en.html), so it's not so difficult.

[ggab]

indeed, this program is great!

suggestions:

- be able to seek the video in the progress bar (like any player)
- to have an option that u can set display video files names when they are playing. Just to be sure, "compare knowing the truth", just an optional setting (i know that it is not the idea or goal of the program, but for me would be very nice and confortable to know which clip is, in certain tests)
- implement more hot keys (e.g. 10sec forward, backwards)
- be able to stop the test any time, but keeping the previous hits (left or right directional key) choises. Because current version needs to end playback of the whole video.
- no more for today :)

thanks and byes!

[DmitriyV2]

indeed, this program is great!
Thanks!

- be able to seek the video in the progress bar (like any player)
- to have an option that u can set display video files names when they are playing. Just to be sure, "compare knowing the truth", just an optional setting (i know that it is not the idea or goal of the program, but for me would be very nice and confortable to know which clip is, in certain tests)

Looks like another program for non blind test is necessary with dome another functionality. Ok, looks like we will create it.

- implement more hot keys (e.g. 10sec forward, backwards)
- be able to stop the test any time, but keeping the previous hits (left or right directional key) choises. Because current version needs to end playback of the whole video.
Ok, we will think in this direction!

[bond]

i moved it to the general video codecs forum as i think it might fit there more than in the specific avc one!?

also here is where the msu metric tool gets discussed:
http://forum.doom9.org/showthread.php?t=95573