Compressibility check question

[colordog]

Howdy - I used to use GK constantly a few years back, but haven't worked with it in the last year or so. I just wanted to check: for the compressibility tests, I want to set the Codec Settings to "1-pass", not Multipass, 1st pass, right?

[colordog]

Well, I did a compressibility test for a 700MB file... it came out to 99.1%. I know that's on the high side, but that's ok. After encoding it, it came out to be more than 250MB over 700MB... is this an issue with DivX 6 in GK? Do my logs shed any light?

# Created with Gordian Knot
#
# http://gknot.doom9.org

# PLUGINS
LoadPlugin("C:\PROGRA~1\GORDIA~1\DGMPGDec\DGDecode.dll")
#LoadPlugin("C:\PROGRA~1\GORDIA~1\AviSynthPlugins\decomb.dll")
#LoadPlugin("C:\PROGRA~1\GORDIA~1\AviSynthPlugins\KernelDeInt.dll")
#LoadPlugin("C:\PROGRA~1\GORDIA~1\AviSynthPlugins\dgbob.dll")
LoadPlugin("C:\PROGRA~1\GORDIA~1\AviSynthPlugins\TomsMoComp.dll")
#LoadPlugin("C:\PROGRA~1\GORDIA~1\AviSynthPlugins\VSFilter.dll")
#LoadPlugin("C:\PROGRA~1\GORDIA~1\AviSynthPlugins\SimpleResize.dll")
LoadPlugin("C:\PROGRA~1\GORDIA~1\AviSynthPlugins\FluxSmooth.dll")

# SOURCE
mpeg2source("D:\vobs\redo.d2v", idct=0)

# TRIM
#trim(startframe,endframe)

# IVTC
#Telecide(order=1,guide=1).Decimate()
# or use
#IVTC(44,11,95)
#GreedyHMA(1,0,4,0,0,0,0,0)

# DEINTERLACING (1)
#FieldDeinterlace()
#FieldDeinterlace(blend=false)
TomsMoComp(1,5,1)

# DEINTERLACING (2)
#KernelDeInt(order=1,sharp=true)
# or maybe
#DGBob(order=1,mode=1)

# DEINTERLACING (3) - special requests
#GreedyHMA(1,0,0,0,0,0,0,0)
#Telecide()
#SeparateFields()

# CROPPING
crop(0,0,708,480)

# DENOISING: choose one combination (or none)
# 1) little noise

# RESIZING
LanczosResize(624,464)

# DENOISING: choose one combination (or none)
# 1) little noise
Temporalsoften(2,3,3,mode=2,scenechange=6)
mergechroma(blur(1.3))
FluxSmoothST(5,7)

# BORDERS
#AddBorders(left,top,right,bottom)

# COMPRESSIBILITY CHECK
# !!!!Snip Size now has to be 14 for use in GKnot!
#SelectRangeEvery(280,14)

# FOOL CCEnc
#ResampleAudio(44100)

10/1/2005 11:41:09 PM: Job " 6 - redo.avi" started.

o Transcode source -> MP3: D:\vobs\redo T01 2_0ch 448Kbps DELAY -218ms.ac3
o DivX5-First Pass: D:\vobs\redo.avs
o DivX5 - Pass 2: D:\vobs\redo.avs
o Mux Audio.
End of Job 1 ( 6 - redo.avi).
_______________________________________________________________________________________________________________________

Gordian Knot
Encoding Job Data:

Type: EncD5_All
Container: Audio-Video Interleave (AVI)
Number: 1
Name: 6 - redo.avi
Platform: WinXP (5.1.2600).2

Files:
VirtualDubModExe: C:\PROGRA~1\GORDIA~1\VirtualDubMod\VirtualDubMod.exe
NandubExe: C:\PROGRA~1\GORDIA~1\nandub\Nandub.exe
AviFinal: D:\vobs\redo.avi
AviMovie: D:\vobs\redo_Movie.avi
AviCredits: D:\vobs\redo_Credits.avi
MovieFS: D:\vobs\redo.avs
CreditsFS:
Log : D:\vobs\redo.log
Stats: D:\vobs\redo.stats
Ecf : D:\vobs\redo.ecf

Options:
Quality/DRF: 0
CreditsStart: 0
UseEcf: 1
CreditsIVTC: 0
CreditsAppend: 0
DeleteInterm.: 0
EnforceBitrate: 0
AntiShit: 0

Calculator:
VideoSize: 633359 kbyte.
Audio1Size: 69921 kbyte.
Audio2Size: 0 kbyte.
Overhead: 13519 kbyte.
AviSize: 716800 kbyte (700 mbyte).
FilesSize: 0 kbyte.
TotalSize: 716800 kbyte (700 mbyte).
Interleaving: vbrmp3
Bitrate: 725 k(=1000)Bits/s
Frames: 214581
FPS: 29.970
Duration: 159:20
Quality: 0.084 bits/(pixel*frame).
CompCheck3: 0.000 bits/(pixel*frame).
CompCheck5: 0.084 bits/(pixel*frame).
Resolution: 624 x 464

Audio 1:
Mode: ac3 -> mp3
SourceFile: D:\vobs\redo T01 2_0ch 448Kbps DELAY -218ms.ac3
WavFile: D:\vobs\redo T01 2_0ch 448Kbps DELAY -218ms.wav
Mp3File: D:\vobs\redo T01 2_0ch 448Kbps DELAY -218ms.mp3
OggFile: D:\vobs\redo T01 2_0ch 448Kbps DELAY -218ms.ogg
OggQuality: 0.200
OggLanguage: English
Azid: -c normal
Lame: -h --abr 80
Delay: -218
Interval: 1
Preload: 500
Mux: 1
Recalc: 1
DeleteWav: 1

Audio 2:
none.


11:41:09 PM: Started Transcoding Audio.

11:41:09 PM: Using "BeSweet" to transcode D:\vobs\redo T01 2_0ch 448Kbps DELAY -218ms.ac3
CommandLine: "C:\PROGRA~1\GORDIA~1\BeSweet\BeSweet.exe" -core( -input "D:\vobs\redo T01 2_0ch 448Kbps DELAY -218ms.ac3" -output "D:\vobs\redo T01 2_0ch 448Kbps DELAY -218ms.mp3" -logfile "D:\vobs\redo T01 2_0ch 448Kbps DELAY -218ms.log" ) -ota( -hybridgain ) -azid( -c normal ) -shibatch( --rate 44100 ) -lame( -h --abr 80 )
12:02:32 AM: Finished. Duration: 21 minutes, 18 seconds.

12:02:32 AM: Audio Done.
12:02:32 AM: MP3-File-Size is 65288 kb.
12:02:32 AM: Audio 1, determined: 65288 kb
12:02:32 AM: Audio 1, calc: 69921 kb
12:02:32 AM: New Bitrate for Movie = 730 k(=1000)Bits/s

Adding this script to C:\PROGRA~1\GORDIA~1\VirtualDubMod\LastJob.vcf :

// $job "DivX5 First Pass"
// $input "D:\vobs\redo.avs"
// $output "D:\vobs\redo_Movie_pass_1.avi"
// $state 0
// $start_time 0 0
// $end_time 0 0
// $script

VirtualDub.Open("D:\\vobs\\redo.avs",0,0);
VirtualDub.video.SetDepth(24,24);
VirtualDub.video.SetMode(1);
VirtualDub.video.SetFrameRate(0,1);
VirtualDub.video.SetIVTC(0,0,-1,0);
VirtualDub.video.SetRange(0,0);
VirtualDub.video.SetCompression(0x78766964,0,10000,0);
VirtualDub.video.filters.Clear();
VirtualDub.subset.Delete();
VirtualDub.SaveAVI("D:\\vobs\\redo_Movie_pass_1.avi");
VirtualDub.Close();

// $endjob
//
//--------------------------------------------------
// $done

12:02:33 AM: Started DivX5-First Pass: D:\vobs\redo.avs
4:06:06 AM: Finished DivX5-First Pass: Duration: 4 hours, 3 minutes, 33 seconds.
4:06:06 AM: Trying to open Log-file.
4:06:06 AM: Success: Log-file open.
4:06:06 AM: Encoded: 214581 Frames.
4:06:06 AM: Speed: 14.684 Frames per Second.

Adding this script to C:\PROGRA~1\GORDIA~1\VirtualDubMod\LastJob.vcf :

// $job "DivX5 Second Pass"
// $input "D:\vobs\redo.avs"
// $output "D:\vobs\redo_Movie.avi"
// $state 0
// $start_time 0 0
// $end_time 0 0
// $script

VirtualDub.Open("D:\\vobs\\redo.avs",0,0);
VirtualDub.video.SetDepth(24,24);
VirtualDub.video.SetMode(1);
VirtualDub.video.SetFrameRate(0,1);
VirtualDub.video.SetIVTC(0,0,-1,0);
VirtualDub.video.SetRange(0,0);
VirtualDub.video.SetCompression(0x78766964,0,10000,0);
VirtualDub.video.filters.Clear();
VirtualDub.subset.Delete();
VirtualDub.SaveAVI("D:\\vobs\\redo_Movie.avi");
VirtualDub.Close();

// $endjob
//
//--------------------------------------------------
// $done

4:06:07 AM: Started DivX5 - Pass: 2: D:\vobs\redo.avs
7:57:06 AM: Finished DivX5 - Pass: 2: Duration: 3 hours, 50 minutes, 59 seconds.
7:57:06 AM: Speed: 15.483 Frames per Second.

Adding this script to C:\PROGRA~1\GORDIA~1\VirtualDubMod\LastJob.vcf :

// $job "DivX5 Append"
// $input "D:\vobs\redo_Movie.avi"
// $output "D:\vobs\redo.avi"
// $state 0
// $start_time 0 0
// $end_time 0 0
// $script

VirtualDub.Open("D:\\vobs\\redo_Movie.avi",0,0);
VirtualDub.RemoveInputStreams();
VirtualDub.stream[0].SetSource("D:\\vobs\\redo T01 2_0ch 448Kbps DELAY -218ms.mp3",0x00000202,1);
VirtualDub.stream[0].SetMode(0);
VirtualDub.stream[0].SetInterleave(1,500,1,0,-218);
VirtualDub.stream[0].SetClipMode(1,1);
VirtualDub.stream[0].SetConversion(0,0,0,0,0);
VirtualDub.stream[0].SetVolume();
VirtualDub.stream[0].SetCompression();
VirtualDub.video.SetDepth(24,24);
VirtualDub.video.SetMode(0);
VirtualDub.video.SetFrameRate(0,1);
VirtualDub.video.SetIVTC(0,0,-1,0);
VirtualDub.video.SetRange(0,0);
VirtualDub.video.SetCompression();
VirtualDub.video.filters.Clear();
VirtualDub.subset.Delete();
VirtualDub.SaveAVI("D:\\vobs\\redo.avi");
VirtualDub.Close();

// $endjob
//
//--------------------------------------------------
// $done

7:57:06 AM: Started Muxing Audio.: D:\vobs\redo_Movie.avi
7:58:29 AM: Finished Muxing Audio.: Duration: 1 minute, 23 seconds.

7:58:29 AM: Done.
7:58:29 AM: Movie = D:\vobs\redo.avi
Total Encoding Time: 8 hours, 17 minutes, 20 seconds.
10/2/2005 7:58:29 AM: Job " 6 - redo.avi" finished.
_______________________________________________________________________________________________________________________

[len0x]

First, comp test is done using single pass quant=2. Second divx6 requires some workaround described in doom9's guides...

[colordog]

I did set up DivX 6 settings as described here: http://www.doom9.org/gknot-codecsetup-divx6.htm. That page didn't specifically say what to set for the compression test, which is why I posted the first question above.

So, are you saying for the Compressibility Test, I should set the profile to Unconstrained -> Quality Based -> Quant=2 ?

[colordog]

After doing more tests, I've realized that the compressed movie file size isn't changing at all.

If I set the total file size to 700 MB, the total file size is 961 MB.

If I set the total file size to 1,100 MB, the total file size is 961 MB.

Even though I've used different settings and filters that greatly change the values of the compressibility test, the file size isn't changing. Even shrinking the resolution results in the same file size!

I'm doing a standard two-pass, with the first pass set to "Multipass, 1st pass" and the second at "Multipass, Nth pass".

[jggimi]

Quality: 0.084 bits/(pixel*frame).
CompCheck3: 0.000 bits/(pixel*frame).
CompCheck5: 0.084 bits/(pixel*frame).In this log, you had already maxed out the encoding (100% quality). Do you have the other log?

[colordog]

Sure. again, I set this to 1GB, decreased the resolution, and assembled it was the same 961.

10/3/2005 11:33:52 PM: Job " 6 - redo.avi" started.

o DivX5-First Pass: D:\vobs\redo.avs
o DivX5 - Pass 2: D:\vobs\redo.avs
o Mux Audio.
End of Job 2 ( 6 - redo.avi).
_______________________________________________________________________________________________________________________

Gordian Knot
Encoding Job Data:

Type: EncD5_All
Container: Audio-Video Interleave (AVI)
Number: 2
Name: 6 - redo.avi
Platform: WinXP (5.1.2600).2

Files:
VirtualDubModExe: C:\PROGRA~1\GORDIA~1\VirtualDubMod\VirtualDubMod.exe
NandubExe: C:\PROGRA~1\GORDIA~1\nandub\Nandub.exe
AviFinal: D:\vobs\redo.avi
AviMovie: D:\vobs\redo_Movie.avi
AviCredits: D:\vobs\redo_Credits.avi
MovieFS: D:\vobs\redo.avs
CreditsFS:
Log : D:\vobs\redo.log
Stats: D:\vobs\redo.stats
Ecf : D:\vobs\redo.ecf

Options:
Quality/DRF: 0
CreditsStart: 0
UseEcf: 1
CreditsIVTC: 0
CreditsAppend: 0
DeleteInterm.: 0
EnforceBitrate: 0
AntiShit: 0

Calculator:
VideoSize: 940559 kbyte.
Audio1Size: 69921 kbyte.
Audio2Size: 0 kbyte.
Overhead: 13519 kbyte.
AviSize: 1024000 kbyte (1000 mbyte).
FilesSize: 0 kbyte.
TotalSize: 1024000 kbyte (1000 mbyte).
Interleaving: vbrmp3
Bitrate: 1076 k(=1000)Bits/s
Frames: 214581
FPS: 29.970
Duration: 159:20
Quality: 0.183 bits/(pixel*frame).
CompCheck3: 0.000 bits/(pixel*frame).
CompCheck5: 0.386 bits/(pixel*frame).
Resolution: 512 x 384

Audio 1:
Mode: Just Mux Source File.
SourceFile: D:\vobs\redo T01 2_0ch 448Kbps DELAY -218ms.mp3
WavFile: D:\vobs\redo T01 2_0ch 448Kbps DELAY -218ms.wav
Mp3File: D:\vobs\redo T01 2_0ch 448Kbps DELAY -218ms_1.mp3
OggFile: D:\vobs\redo T01 2_0ch 448Kbps DELAY -218ms.ogg
OggQuality: 0.200
OggLanguage: English
Azid:
Lame:
Delay: -218
Interval: 1
Preload: 500
Mux: 1
Recalc: 1
DeleteWav: 1

Audio 2:
none.

11:33:57 PM: Audio 1, determined: 65288 kb
11:33:57 PM: Audio 1, calc: 69921 kb
11:33:57 PM: New Bitrate for Movie = 1081 k(=1000)Bits/s

Adding this script to C:\PROGRA~1\GORDIA~1\VirtualDubMod\LastJob.vcf :

// $job "DivX5 First Pass"
// $input "D:\vobs\redo.avs"
// $output "D:\vobs\redo_Movie_pass_1.avi"
// $state 0
// $start_time 0 0
// $end_time 0 0
// $script

VirtualDub.Open("D:\\vobs\\redo.avs",0,0);
VirtualDub.video.SetDepth(24,24);
VirtualDub.video.SetMode(1);
VirtualDub.video.SetFrameRate(0,1);
VirtualDub.video.SetIVTC(0,0,-1,0);
VirtualDub.video.SetRange(0,0);
VirtualDub.video.SetCompression(0x78766964,0,10000,0);
VirtualDub.video.filters.Clear();
VirtualDub.subset.Delete();
VirtualDub.SaveAVI("D:\\vobs\\redo_Movie_pass_1.avi");
VirtualDub.Close();

// $endjob
//
//--------------------------------------------------
// $done

11:33:57 PM: Started DivX5-First Pass: D:\vobs\redo.avs
2:49:10 AM: Finished DivX5-First Pass: Duration: 3 hours, 15 minutes, 12 seconds.
2:49:10 AM: Trying to open Log-file.
2:49:10 AM: Success: Log-file open.
2:49:10 AM: Encoded: 214581 Frames.
2:49:10 AM: Speed: 18.320 Frames per Second.

Adding this script to C:\PROGRA~1\GORDIA~1\VirtualDubMod\LastJob.vcf :

// $job "DivX5 Second Pass"
// $input "D:\vobs\redo.avs"
// $output "D:\vobs\redo_Movie.avi"
// $state 0
// $start_time 0 0
// $end_time 0 0
// $script

VirtualDub.Open("D:\\vobs\\redo.avs",0,0);
VirtualDub.video.SetDepth(24,24);
VirtualDub.video.SetMode(1);
VirtualDub.video.SetFrameRate(0,1);
VirtualDub.video.SetIVTC(0,0,-1,0);
VirtualDub.video.SetRange(0,0);
VirtualDub.video.SetCompression(0x78766964,0,10000,0);
VirtualDub.video.filters.Clear();
VirtualDub.subset.Delete();
VirtualDub.SaveAVI("D:\\vobs\\redo_Movie.avi");
VirtualDub.Close();

// $endjob
//
//--------------------------------------------------
// $done

2:49:11 AM: Started DivX5 - Pass: 2: D:\vobs\redo.avs
5:54:58 AM: Finished DivX5 - Pass: 2: Duration: 3 hours, 5 minutes, 47 seconds.
5:54:58 AM: Speed: 19.250 Frames per Second.

Adding this script to C:\PROGRA~1\GORDIA~1\VirtualDubMod\LastJob.vcf :

// $job "DivX5 Append"
// $input "D:\vobs\redo_Movie.avi"
// $output "D:\vobs\redo.avi"
// $state 0
// $start_time 0 0
// $end_time 0 0
// $script

VirtualDub.Open("D:\\vobs\\redo_Movie.avi",0,0);
VirtualDub.RemoveInputStreams();
VirtualDub.stream[0].SetSource("D:\\vobs\\redo T01 2_0ch 448Kbps DELAY -218ms.mp3",0x00000202,1);
VirtualDub.stream[0].SetMode(0);
VirtualDub.stream[0].SetInterleave(1,500,1,0,-218);
VirtualDub.stream[0].SetClipMode(1,1);
VirtualDub.stream[0].SetConversion(0,0,0,0,0);
VirtualDub.stream[0].SetVolume();
VirtualDub.stream[0].SetCompression();
VirtualDub.video.SetDepth(24,24);
VirtualDub.video.SetMode(0);
VirtualDub.video.SetFrameRate(0,1);
VirtualDub.video.SetIVTC(0,0,-1,0);
VirtualDub.video.SetRange(0,0);
VirtualDub.video.SetCompression();
VirtualDub.video.filters.Clear();
VirtualDub.subset.Delete();
VirtualDub.SaveAVI("D:\\vobs\\redo.avi");
VirtualDub.Close();

// $endjob
//
//--------------------------------------------------
// $done

5:54:58 AM: Started Muxing Audio.: D:\vobs\redo_Movie.avi
5:56:24 AM: Finished Muxing Audio.: Duration: 1 minute, 25 seconds.

5:56:24 AM: Done.
5:56:24 AM: Movie = D:\vobs\redo.avi
Total Encoding Time: 6 hours, 22 minutes, 31 seconds.
10/4/2005 5:56:24 AM: Job " 6 - redo.avi" finished.
_______________________________________________________________________________________________________________________

[colordog]

In this log, you had already maxed out the encoding (100% quality). Do you have the other log?
Well... I know that's not accurate... I'm not sure why in that log it's reading 100%. It had to have been well under, and still doesn't explain why it was 250MB too big.