Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion. Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules. |
|
|
Thread Tools | Search this Thread | Display Modes |
16th July 2003, 19:26 | #1 | Link |
Testeur de codecs
Join Date: May 2003
Location: France
Posts: 2,484
|
[TEST] Visual, PSNR, SSIM, VQM tests with RV9, XviD ,DivX, WMV9 ...
Two Towers (Trailer 178 sec)
~~ PSNR, SSIM, VQM Test ~~ Code:
| Codec | P-Process | Settings | Size | PSNR | SSIM | VQM | |------------------|-----------|------------|---------|---------|----------|----------| | Xvid Devapi4 | No | 570 kbps | 640x272 | 40.7359 | 0.961267 | 0.855857 | | Divx Kaukura | No | 570 kbps | 640x272 | 40.9452 | 0.963071 | 0.816827 | | VMV9 | No | 570 kbps | 640x272 | 41.0462 | 0.964233 | 0.810412 | | RV9 | | 570 kbps | 640x272 | 41.2712 | 0.966207 | 0.809199 | |------------------|-----------|------------|---------|---------|----------|----------| | Xvid Devapi4 | No | 715 kbps | 640x272 | 41.7980 | 0.968348 | 0.758332 | | Divx Kaukura | No | 715 kbps | 640x272 | 41.8806 | 0.968601 | 0.742593 | | VMV9 | No | 715 kbps | 640x272 | 42.4004 | 0.970695 | 0.717179 | | RV9 | | 715 kbps | 640x272 | 42.2920 | 0.971928 | 0.723943 | |------------------|-----------|------------|---------|---------|----------|----------| | Xvid Devapi4 | No | 950 kbps | 640x272 | 43.0887 | 0.975330 | 0.655166 | | Divx Kaukura | No | 950 kbps | 640x272 | 43.0920 | 0.974714 | 0.653429 | | VMV9 | No | 950 kbps | 640x272 | 43.5733 | 0.976320 | 0.640811 | | RV9 | | 950 kbps | 640x272 | 42.9970 | 0.975566 | 0.656301 | |------------------|-----------|------------|---------|---------|----------|----------| Download and compare ... no comment is necessary ... ~~ Configurations codecs used ~~ WMV9 Adjustments: Maximum quality + Complex + 2 pass + Force Post Process Mode = 0 RV9 EHQ Adjustments: EHQ 85 + MSL 60 sec + 2 pass XviD Devapi4 Adjustments: Ultra high + h263 + vhq4 + chroma motion + bframe 1/150/75 + 2 pass DivX Pro Kaukuru Adjustments: Bframe + Slowest + Bitrate Modulation "Slow Movie" + 2 Pass ~~ Script AVS ~~ Encodage Code:
source=Mpeg2Source("D:\Mes dossiers\B.A\Les deux tours\azerty.d2v") source=Crop(source,24,88,-24,-72) source=BicubicResize(source,640,272,0,0.6) return source Code:
# --> Video Opening <-- source=AviSource("D:\Mes dossiers\B.A\Les deux tours\Encodage.avs") source=ConvertToYV12(source) video=AviSource("D:\Mes dossiers\B.A\Les deux tours\Kaukura-950.avi") video=ConvertToYV12(video) # --> PSNR analysis <-- CompareYV12(video,source,"","PSNR-Kaukura-950.txt") Code:
# --> Video Opening <-- source=AviSource("D:\Mes dossiers\B.A\Les deux tours\Encodage.avs") source=ConvertToYV12(source) video=AviSource("D:\Mes dossiers\B.A\Les deux tours\Kaukura-950.avi") video=ConvertToYV12(video) # --> PSNR analysis <-- return SSIM(source,video,"SSIM-Kaukura-950.txt") Code:
# --> Video Opening <-- source=AviSource("D:\Mes dossiers\B.A\Les deux tours\Encodage.avs") source=ConvertToYV12(source) video=AviSource("D:\Mes dossiers\B.A\Les deux tours\Kaukura-950.avi") video=ConvertToYV12(video) # --> PSNR analysis <-- return VqmCalc(source,video,"VQM-Kaukura-950.txt") Harry Potter II (Trailer 128 sec) ~~ PSNR, SSIM, VQM Test ~~ Code:
| Codec | P-Process | Settings | Size | PSNR | SSIM | VQM | |---------------|-----------|----------|---------|---------|----------|----------| | DivX SBC | No | 570 kbps | 576*240 | 44.5105 | 0.969443 | 0.745271 | | Xvid Devapi4 | No | 570 kbps | 576*240 | 44.8596 | 0.972988 | 0.696618 | | Divx Manihi | No | 570 kbps | 576*240 | 44.9865 | 0.971749 | 0.685860 | | VMV9 | No | 570 kbps | 576*240 | 45.1909 | 0.974026 | 0.671028 | | RV9 | | 570 kbps | 576*240 | 45.4853 | 0.975972 | 0.672990 | |---------------|-----------|----------|---------|---------|----------|----------| | DivX SBC | No | 715 kbps | 640x272 | 45.0649 | 0.971749 | 0.705900 | | Xvid Devapi4 | No | 715 kbps | 640x272 | 45.5277 | 0.975403 | 0.651688 | | Divx Manihi | No | 715 kbps | 640x272 | 45.6118 | 0.975643 | 0.644280 | | VMV9 | No | 715 kbps | 640x272 | 45.7738 | 0.976034 | 0.630541 | | RV9 | | 715 kbps | 640x272 | 45.9816 | 0.977080 | 0.644326 | |---------------|-----------|----------|---------|---------|----------|----------| | DivX SBC | No | 950 kbps | 720x288 | 45.5201 | 0.975122 | 0.641671 | | Xvid Devapi4 | No | 950 kbps | 720x288 | 46.0449 | 0.978425 | 0.594206 | | Divx Manihi | No | 950 kbps | 720x288 | 46.1166 | 0.978254 | 0.591982 | | VMV9 | No | 950 kbps | 720x288 | 46.2447 | 0.978799 | 0.584267 | | RV9 | | 950 kbps | 720x288 | 46.4354 | 0.978577 | 0.623178 | |---------------|-----------|----------|---------|---------|----------|----------| ~~ Configurations codecs used ~~ WMV9 Adjustments: Maximum quality + Complex + 2 pass RV9 EHQ Adjustments: EHQ 85 + MSL 60 sec + 2 pass XviD Devapi4 Adjustments: Ultra high + h263 + vhq4 + chroma motion + bframe 1/150/75 + 2 pass DivX Pro Manihi Adjustments: Bframe + Slowest + Bitrate Modulation "Slow Movie" + 2 Pass DivX3 SBC ffvfw Adjustments: SADT + chroma motion + 3 Pass ~~ Script AVS ~~ Encodage Code:
source=Mpeg2Source("D:\Mes dossiers\B.A\Harry Potter\azerty.d2v") source=Crop(source,18,76,-18,-76) source=BicubicResize(source,640,272,0,0.6) source=Convolution3D(source,0,3,4,3,4,3,0) source=ConvertToYUY2(source) return source Code:
# --> Video Opening <-- source=Mpeg2Source("D:\Mes dossiers\B.A\Harry Potter\azerty.d2v") source=Crop(source,18,76,-18,-76) source=BicubicResize(source,640,272,0,0.6) source=Convolution3D(source,0,3,4,3,4,3,0) source=ConvertToYUY2(source) video=AviSource("D:\...\Kauehi.avi") video=ConvertToYUY2(video) # --> PSNR analysis <-- Compare(video,source,"","Kauehi.log") Code:
# --> Video Opening <-- source=Mpeg2Source("D:\Mes dossiers\B.A\Harry Potter\azerty.d2v") source=Crop(source,18,76,-18,-76) source=BicubicResize(source,640,272,0,0.6) source=Convolution3D(source,0,3,4,3,4,3,0) source=ConvertToYUY2(source) video=AviSource("D:\...\XviD.avi") video=Trim(video,1,0) video=ConvertToYUY2(video) # --> PSNR analysis <-- Compare(video,source,"","XviD.log") Code:
# --> Video Opening <-- source=Mpeg2Source("D:\Mes dossiers\B.A\Harry Potter\azerty.d2v") source=Crop(source,18,76,-18,-76) source=BicubicResize(source,640,272,0,0.6) source=Convolution3D(source,0,3,4,3,4,3,0) source=DeleteFrame(source,0) source=ConvertToYUY2(source) video=DirectShowSource("D:\...\RV9.rmvb",fps=25) video=ConvertToYUY2(video) # --> PSNR analysis <-- Compare(video,source,"","test.log")
__________________
Le Sagittaire ... ;-) 1- Ateme AVC or x264 2- VP7 or RV10 only for anime 3- XviD, DivX or WMV9 Last edited by Sagittaire; 10th September 2004 at 19:51. |
16th July 2003, 19:36 | #2 | Link |
Registered User
Join Date: Nov 2001
Posts: 9,770
|
interesting results
on my own test with old rv9 (non-ehq) i got values ~36.5 edit: i also got pretty low values with wmv9 vcm ~36.8
__________________
Between the weak and the strong one it is the freedom which oppresses and the law that liberates (Jean Jacques Rousseau) I know, that I know nothing (Socrates) MPEG-4 ASP FAQ | AVC/H.264 FAQ | AAC FAQ | MP4 FAQ | MP4Menu stores DVD Menus in MP4 (guide) Ogg Theora | Ogg Vorbis use WM9 today and get Micro$oft controlling the A/V market tomorrow for free Last edited by bond; 16th July 2003 at 19:44. |
16th July 2003, 19:47 | #3 | Link |
Moderator
Join Date: Oct 2002
Location: Seattle
Posts: 1,584
|
Very interesting!
For any PSNR measurements with RV9, please use the following in codecProperties, to disable the noisyEdgeFilter. The filter works like this: in case there are black or noisy pixels along the edge (from a crop that's slightly off, or capture noise), RV9 will copy real image edge pixels to cover these pixels. This is good for visual results, but oftentimes reduces PSNR compared to the original. <codecProperties type="bag"> ... <noisyEdgeFilter type="bool">false</noisyEdgeFilter> ... </codecProperties>
__________________
This information is provided "AS IS" with no warranties, grants no rights, and reflects my personal opinion. Last edited by karl_lillevold; 16th July 2003 at 20:54. |
16th July 2003, 20:41 | #5 | Link |
Registered User
Join Date: Mar 2002
Posts: 486
|
Great results!!
Watch out though: there is a problem with AviSynth's PSNR measurement as done by Compare(). It measures the PSNR for each individual frame and then calculates the arithmetic mean of the frame PSNRs to get a sequence PSNR. What, you may say, is the problem with taking an average? Taking the mean of the PSNR for every frame only ever gives a reliable result when all frames of the sequence are of similar complexity (approx same motion, texture, brightness etc.). If frames differ a lot, then the mean PSNR becomes squewed. Worse, if a codec has very bad rate control, or something else causes a codec to produce variable quality throughout the sequence, then the mean PSNR as computed by AviSynth's Compare() will actually come out better . What's the solution? The best approach is to compute one PSNR for the whole sequence by treating the sequence as if it was one huge video frame. The PSNR is then a function of the total noise energy in the whole sequence and no nasty averaging effects come into play. I tried to modify AviSynth to work like this, but I couldn't get it to compile. So if anyone knows how to make this change... |
16th July 2003, 20:50 | #6 | Link | |
Registered User
Join Date: May 2002
Location: France/Germany
Posts: 119
|
Quote:
|
|
16th July 2003, 21:22 | #7 | Link |
Registered User
Join Date: Jun 2002
Posts: 243
|
@Sagittaire
I am wondering did you use 2 pass bitrate encoding with Wm9 or 1 pass at 100% quality? How about that slider on image quality? Is it set a 1 space before the first on the left or on default? Can you possibly display the time it took to encode each of those clips with the codecs? Thx |
16th July 2003, 21:39 | #8 | Link |
Testeur de codecs
Join Date: May 2003
Location: France
Posts: 2,484
|
@ Sgt_Strider
640*272 resolution ... average fps ... RV9 EHQ EHQ 80 + MSL 60 5.88 fps XviD Ultra hight + VHQ4 + bframe + chroma ME 7.65 fps DivX Tahanea Slow + bframe 5.42 fps WMV9 Complexe + Quality max 5.09 fps
__________________
Le Sagittaire ... ;-) 1- Ateme AVC or x264 2- VP7 or RV10 only for anime 3- XviD, DivX or WMV9 |
16th July 2003, 23:22 | #9 | Link | |
Guest
Posts: n/a
|
Quote:
Much appreciated. |
|
16th July 2003, 23:35 | #10 | Link |
Registered User
Join Date: Apr 2002
Location: Germany
Posts: 4,926
|
@ Sagittaire
nice compare but your b-frame setting for Koepi was not well chosen 2/150/75/0 would be much better, and also to compare devapi3 vs rv9 is not fair you should better have compared with devapi4 + gmc and trellis quant, 3 warppoint gmc + vhq is working in their now "thx to syskins work" and gives a little psnr boost. i'll post my new Compare in the XviD forum no rv9 was tested yet
__________________
all my compares are riddles so please try to decipher them yourselves :) It is about Time Join the Revolution NOW before it is to Late ! http://forum.doom9.org/showthread.php?t=168004 |
17th July 2003, 00:01 | #12 | Link |
Testeur de codecs
Join Date: May 2003
Location: France
Posts: 2,484
|
@ superdump
Source Bugsan unite-video Code:
xvid koepi 24-06-03, 2pass: 20000ko (650kbps) avisynth 2.52 Mpeg2Dec3 1.08 FFdshow 030103 Athlon XP 2000+ ---avs------avs------avs------avs------avs------avs--- mpeg2source("E:\Ripping\lotrcutted\lotr.d2v",idct=7) Crop(4,80,-4,-80) BicubicResize(640,256,0,0.5) ---avs------avs------avs------avs------avs------avs--- clip1 = mpeg2source("E:\Ripping\lotrcutted\lotr.d2v",idct=7) .Crop(4,80,-4,-80).BicubicResize(640,256,0,0.5).ConvertToYUY2() clip2 = directshowsource("xvid_XX.avi",fps=25).ConvertToYUY2() Compare(clip1,clip2,"YUV","psnr.log") ---avs------avs------avs------avs------avs------avs--- info: altcc-best = "altcc-h-150-100-50" exotic = "mpeg vhq4 bf1 cm cmop altcc-best" pp4 = "ffdshow nic pp4 strength 256" |---------|---------| | K140503 | K240603 | |-----------------------|---------|---------| | default | 41.9028 | 41.8955 | | default pp4 simple | 42.2854 | 42.1851 | | default pp4 walken | - | 42.2744 | | default pp0 walken | - | 41.8940 | |-----------------------|---------|---------| | chroma motion | 41.9698 | 41.9864 | | global motion comp | 41.8826 | 41.8799 | | quarter pixel | 41.5587 | 41.5599 | | lumi masking | 41.8397 | 41.8423 | | chroma optimiser | 41.8964 | 41.9019 | | trellis R-D 0 | 41.8684 | 41.8855 | | mpeg quantization | 42.0297 | 42.0356 | |-----------------------|---------|---------| | VHQ 0 bf -1 | 41.9028 | 41.8955 | | VHQ 1 bf -1 | 42.0766 | 42.0887 | | VHQ 2 bf -1 | 42.1032 | 42.1782 | | VHQ 3 bf -1 | 42.1491 | 42.2292 | | VHQ 4 bf -1 | 42.2199 | 42.3316 | | | | | | VHQ 0 bf 0 | | 41.8946 | | VHQ 1 bf 0 | | 42.1150 | | VHQ 2 bf 0 | | 42.2359 | | VHQ 3 bf 0 | | 42.2522 | | VHQ 4 bf 0 | | 42.3327 | | | | | | VHQ 0 bf 1 | | 42.0270 | | VHQ 1 bf 1 | | 42.2614 | | VHQ 2 bf 1 | | 42.3151 | | VHQ 3 bf 1 | | 42.3338 | | VHQ 4 bf 1 | | 42.4166 | |-----------------------|---------|---------| | bf0 default | 41.9028 | 41.8946 | | bf1 default | 41.8666 | 42.0270 | | bf2 default | 41.7618 | 41.9992 | | bf3 default | 41.7480 | 42.0043 | | bf4 default | 41.7471 | 41.9937 | |-----------------------|---------|---------| | altcc-default | 42.1407 | 42.1330 | | altcc-best | 42.3478 | 42.3417 | |-----------------------|---------|---------| | exotic | 42.6715 | 42.9207 | | exotic pp4 simple | 43.0756 | 43.2172 | | exotic pp4 walken | - | 43.2652 | |-----------------------|---------|---------| Koepi 240603 bframe test: |---------|---------|---------|---------|---------| | 1 - 150 | 1 - 190 | 2 - 150 | 2 - 190 | 3 - 150 | |---------------|---------|---------|---------|---------|---------| | bf thresh -40 | 41.9154 | 41.9148 | 41.9160 | | | | bf thresh -20 | 41.9632 | 41.9542 | 41.9632 | | | | bf thresh 0 | 42.0270 | 42.0494 | 41.9992 | | 42.0043 | | bf thresh 10 | 42.0545 | 42.0750 | 42.0118 | | | | bf thresh 20 | 42.0500 | 42.0745 | 41.9598 | | | | bf thresh 30 | 42.0407 | 42.0689 | 41.9061 | | | | bf thresh 40 | 42.0286 | 42.0655 | 41.8842 | | | | bf thresh 60 | 42.0125 | 42.0318 | 41.8165 | | | | bf thresh 80 | 42.0007 | 42.0225 | 41.7905 | | | | bf thresh 90 | 41.9973 | 42.0103 | 41.7871 | | | |---------------|---------|---------|---------|---------|---------| | bf offset 0 | 41.9844 | | | | | | bf offset 25 | 41.9887 | | | | | | bf offset 50 | 42.0181 | | | | | | bf offset 75 | 42.0270 | 42.0494 | 41.9992 | | 42.0043 | | bf offset 100 | 42.0115 | | | | | | bf offset 125 | 42.0104 | | | | | |---------------|---------|---------|---------|---------|---------|
__________________
Le Sagittaire ... ;-) 1- Ateme AVC or x264 2- VP7 or RV10 only for anime 3- XviD, DivX or WMV9 |
17th July 2003, 00:15 | #13 | Link |
Registered User
Join Date: Apr 2002
Location: Germany
Posts: 4,926
|
@ RadicalEd
pp was off but kauehi simple profile still is better then XviD its true in terms of PSNR or a decoder trick but i doubt that
__________________
all my compares are riddles so please try to decipher them yourselves :) It is about Time Join the Revolution NOW before it is to Late ! http://forum.doom9.org/showthread.php?t=168004 |
17th July 2003, 00:47 | #14 | Link |
Guest
Posts: n/a
|
i think 1/150/75/0 is good (i prefer 1/150/0/10 )
It's a good idea to use trellis for PSNR compare but not chroma optimizer (it might increase video quality but not PSNR ^^ ) A question for PSNR nerd: is there a difference between psnr4avi results and avisynth's compare() ones ? "3 warppoint gmc + vhq is working in their now "thx to syskins work" and gives a little psnr boost." !!!!!! i want it ^^, going to compile the dev-api4 branch Last edited by Sigmatador; 17th July 2003 at 14:26. |
17th July 2003, 02:12 | #15 | Link | |
Registered User
Join Date: Jun 2002
Posts: 243
|
Quote:
|
|
17th July 2003, 08:16 | #16 | Link |
Testeur de codecs
Join Date: May 2003
Location: France
Posts: 2,484
|
WMV9
Adjustments: Maximum quality + Complex + 2 pass PSNR: The WMV9 is really very powerful in this test. It is a codec which "macroblock" practically never and this some is the bitrate. I make edit in principal post Sorry for my english ... ;-)
__________________
Le Sagittaire ... ;-) 1- Ateme AVC or x264 2- VP7 or RV10 only for anime 3- XviD, DivX or WMV9 |
17th July 2003, 10:34 | #17 | Link | |
Registered User
Join Date: Mar 2002
Posts: 486
|
Quote:
I believe Kauehi has configurable postprocessing - could be interesting to see if this improves PSNR. Might need to use DirectShowSource() in AviSynth if the VfW decoder doesn't do PP. |
|
17th July 2003, 12:24 | #18 | Link |
Registered User
Join Date: Mar 2002
Posts: 486
|
An update on AviSynth PSNR averaging: I rewrote part of AviSynth Compare() to create a more reliable sequence PSNR. It's output to the logfile as "Overall PSNR".
I posted my code on the AviSynth development forum here in the hope that the AviSynth guys like what I've done and incorporate it into their next release. |
18th July 2003, 08:06 | #19 | Link | |
Registered User
Join Date: Jun 2002
Posts: 243
|
Quote:
|
|
18th July 2003, 12:05 | #20 | Link |
Testeur de codecs
Join Date: May 2003
Location: France
Posts: 2,484
|
@ Sgt_Strider
Video : 570 Kbps 576x240 Video : 715 Kbps 640x272 Video : 950 Kbps 720x288 Infomrmation in principal thread ........ !?
__________________
Le Sagittaire ... ;-) 1- Ateme AVC or x264 2- VP7 or RV10 only for anime 3- XviD, DivX or WMV9 |
|
|