Log in

View Full Version : GKnot 0.33.1 Produces Outrageous File Sizes?

mig81
16th January 2005, 20:57
Hi, a while back I complained how GKnot wouldn't let me make proper MKV XviDs, and nothing came out of it; this time, it's DivX. I've been making pretty precise, 2-CD encodes for the past year. Now, with GKnot 0.33.1, with DivX 5.x, AVI, 1-audtio track -> VBR MP3, 2-CD, NTSC 16:9, the workfiles produced by GKnot are WAY too large.

In the past, I would get the movie without a sound (a little more than a gig) and a movie with the sound (exactly 2-CD size). Now, 40% into the first video encoding pass, I've got a 50 GB "_Movie.avi" file!!! And, what more, my "_secondpass.settings" file claims to take up "-16670289 bytes" (actually 105 KB)!

I just aborted the encode, here is the logfile; what am I doing wrong?

16/01/2005 8:31:47 AM: Job " 1 - 12Df [DivX].avi" started.

o Transcode source -> MP3: F:\Video To Be Processed\12Df\DVD2AVI\12Df [DivX] AC3 T01 3_2ch 384Kbps DELAY 0ms.ac3
o DivX5-First Pass: F:\Video To Be Processed\12Df\AVS\12Df [DivX].avs
o DivX5 - Pass 2: F:\Video To Be Processed\12Df\AVS\12Df [DivX].avs
o Mux Audio.
End of Job 1 ( 1 - 12Df [DivX].avi).
_______________________________________________________________________________________________________________________

Gordian Knot
Encoding Job Data:

Type: EncD5_All
Container: Audio-Video Interleave (AVI)
Number: 1
Name: 1 - 12Df [DivX].avi
Platform: WinXP (5.1.2600).2

Files:
VirtualDubModExe: C:\PROGRA~1\GORDIA~1\VirtualDubMod\VirtualDubMod.exe
NandubExe: C:\PROGRA~1\GORDIA~1\nandub\Nandub.exe
AviFinal: F:\Video To Be Processed\12Df\AVS\12Df [DivX].avi
AviMovie: F:\Video To Be Processed\12Df\AVS\12Df [DivX]_Movie.avi
AviCredits: F:\Video To Be Processed\12Df\AVS\12Df [DivX]_Credits.avi
MovieFS: F:\Video To Be Processed\12Df\AVS\12Df [DivX].avs
CreditsFS:
Log : F:\Video To Be Processed\12Df\AVS\12Df [DivX].log
Stats: F:\Video To Be Processed\12Df\AVS\12Df [DivX].stats
Ecf : F:\Video To Be Processed\12Df\AVS\12Df [DivX].ecf

Options:
Quality/DRF: 0
CreditsStart: 0
UseEcf: 1
CreditsIVTC: 0
CreditsAppend: 0
DeleteInterm.: 0
EnforceBitrate: 0
AntiShit: 0

Calculator:
VideoSize: 1057801 kbyte.
Audio1Size: 364066 kbyte.
Audio2Size: 0 kbyte.
Overhead: 11732 kbyte.
AviSize: 1433600 kbyte (1400 mbyte).
FilesSize: 0 kbyte.
TotalSize: 1433600 kbyte (1400 mbyte).
Interleaving: vbrmp3
Bitrate: 1116 k(=1000)Bits/s
Frames: 186216
FPS: 23.976
Duration: 29:27
Quality: 0.207 bits/(pixel*frame).
CompCheck3: 0.000 bits/(pixel*frame).
CompCheck5: 0.000 bits/(pixel*frame).
Resolution: 640 x 352

Audio 1:
Mode: ac3 -> mp3
SourceFile: F:\Video To Be Processed\12Df\DVD2AVI\12Df [DivX] AC3 T01 3_2ch 384Kbps DELAY 0ms.ac3
WavFile: F:\Video To Be Processed\12Df\DVD2AVI\12Df [DivX] AC3 T01 3_2ch 384Kbps DELAY 0ms.wav
Mp3File: F:\Video To Be Processed\12Df\DVD2AVI\12Df [DivX] AC3 T01 3_2ch 384Kbps DELAY 0ms_1.mp3
OggFile: F:\Video To Be Processed\12Df\DVD2AVI\12Df [DivX] AC3 T01 3_2ch 384Kbps DELAY 0ms.ogg
OggQuality: 0.200
OggLanguage: English
Azid: -L -3db -s stereo -c normal
Lame: --alt-preset 192
Delay: 0
Interval: 1
Preload: 500
Mux: 1
Recalc: 1
DeleteWav: 1

Audio 2:
none.


8:31:47 AM: Started Transcoding Audio.

8:31:47 AM: Using "BeSweet" to transcode F:\Video To Be Processed\12Df\DVD2AVI\12Df [DivX] AC3 T01 3_2ch 384Kbps DELAY 0ms.ac3
CommandLine: "C:\PROGRA~1\GORDIA~1\BeSweet\BeSweet.exe" -core( -input "F:\Video To Be Processed\12Df\DVD2AVI\12Df [DivX] AC3 T01 3_2ch 384Kbps DELAY 0ms.ac3" -output "F:\Video To Be Processed\12Df\DVD2AVI\12Df [DivX] AC3 T01 3_2ch 384Kbps DELAY 0ms_1.mp3" -logfile "F:\Video To Be Processed\12Df\DVD2AVI\12Df [DivX] AC3 T01 3_2ch 384Kbps DELAY 0ms_1.log" ) -ota( -hybridgain ) -azid( -L -3db -s stereo -c normal ) -lame( --alt-preset 192 )
8:54:04 AM: Finished. Duration: 22 minutes, 17 seconds.

8:54:05 AM: Audio Done.
8:54:05 AM: MP3-File-Size is 186150 kb.
8:54:05 AM: Audio 1, determined: 186150 kb
8:54:05 AM: Audio 1, calc: 364066 kb
8:54:05 AM: New Bitrate for Movie = 1304 k(=1000)Bits/s

Adding this script to C:\PROGRA~1\GORDIA~1\VirtualDubMod\LastJob.vcf :

// $job "DivX5 First Pass"
// $input "F:\Video To Be Processed\12Df\AVS\12Df [DivX].avs"
// $output "F:\Video To Be Processed\12Df\AVS\12Df [DivX]_Movie.avi"
// $state 0
// $start_time 0 0
// $end_time 0 0
// $script

VirtualDub.Open("F:\\Video To Be Processed\\12Df\\AVS\\12Df [DivX].avs",0,0);
VirtualDub.video.SetDepth(24,24);
VirtualDub.video.SetMode(1);
VirtualDub.video.SetFrameRate(0,1);
VirtualDub.video.SetIVTC(0,0,-1,0);
VirtualDub.video.SetRange(0,0);
VirtualDub.video.SetCompression(0x78766964,0,10000,0);
VirtualDub.video.filters.Clear();
VirtualDub.subset.Delete();
VirtualDub.SaveAVI("F:\\Video To Be Processed\\12Df\\AVS\\12Df [DivX]_Movie.avi");
VirtualDub.Close();

// $endjob
//
//--------------------------------------------------
// $done

8:54:05 AM: Started DivX5-First Pass: F:\Video To Be Processed\12Df\AVS\12Df [DivX].avs
10:01:00 AM: Finished DivX5-First Pass: Duration: 1 hour, 6 minutes, 55 seconds.
10:01:00 AM: Trying to open Log-file.
10:01:00 AM: Error: Could not open F:\Video To Be Processed\12Df\AVS\vdenc.log
10:01:00 AM: Error: Could not count encoded Frames.
10:01:00 AM: Speed: 0.000 Frames per Second.
10:01:00 AM: WARNING: Number of counted frames differs from settings!
10:01:00 AM: WARNING: Settings: 186216
10:01:00 AM: WARNING: Counted: 0
10:01:00 AM: WARNING: Difference: 186216
10:01:00 AM: Correcting Bitrate...
10:01:00 AM: Original Bitrate = 1304 k(=1000)Bits/s
10:01:00 AM: Error: Correction impossible.
10:01:00 AM: Now encoding at 1304 k(=1000)Bits/s

Adding this script to C:\PROGRA~1\GORDIA~1\VirtualDubMod\LastJob.vcf :

// $job "DivX5 Second Pass"
// $input "F:\Video To Be Processed\12Df\AVS\12Df [DivX].avs"
// $output "F:\Video To Be Processed\12Df\AVS\12Df [DivX]_Movie.avi"
// $state 0
// $start_time 0 0
// $end_time 0 0
// $script

VirtualDub.Open("F:\\Video To Be Processed\\12Df\\AVS\\12Df [DivX].avs",0,0);
VirtualDub.video.SetDepth(24,24);
VirtualDub.video.SetMode(1);
VirtualDub.video.SetFrameRate(0,1);
VirtualDub.video.SetIVTC(0,0,-1,0);
VirtualDub.video.SetRange(0,0);
VirtualDub.video.SetCompression(0x78766964,0,10000,0);
VirtualDub.video.filters.Clear();
VirtualDub.subset.Delete();
VirtualDub.SaveAVI("F:\\Video To Be Processed\\12Df\\AVS\\12Df [DivX]_Movie.avi");
VirtualDub.Close();

// $endjob
//
//--------------------------------------------------
// $done

10:01:00 AM: Started DivX5 - Pass: 2: F:\Video To Be Processed\12Df\AVS\12Df [DivX].avs
10:01:10 AM: Finished DivX5 - Pass: 2: Duration: 9 seconds.
10:01:10 AM: Speed: 0.000 Frames per Second.

Adding this script to C:\PROGRA~1\GORDIA~1\VirtualDubMod\LastJob.vcf :

// $job "DivX5 Append"
// $input "F:\Video To Be Processed\12Df\AVS\12Df [DivX]_Movie.avi"
// $output "F:\Video To Be Processed\12Df\AVS\12Df [DivX].avi"
// $state 0
// $start_time 0 0
// $end_time 0 0
// $script

VirtualDub.Open("F:\\Video To Be Processed\\12Df\\AVS\\12Df [DivX]_Movie.avi",0,0);
VirtualDub.RemoveInputStreams();
VirtualDub.stream[0].SetSource("F:\\Video To Be Processed\\12Df\\DVD2AVI\\12Df [DivX] AC3 T01 3_2ch 384Kbps DELAY 0ms_1.mp3",0x00000202,1);
VirtualDub.stream[0].SetMode(0);
VirtualDub.stream[0].SetInterleave(1,500,1,0,0);
VirtualDub.stream[0].SetClipMode(1,1);
VirtualDub.stream[0].SetConversion(0,0,0,0,0);
VirtualDub.stream[0].SetVolume();
VirtualDub.stream[0].SetCompression();
VirtualDub.video.SetDepth(24,24);
VirtualDub.video.SetMode(0);
VirtualDub.video.SetFrameRate(0,1);
VirtualDub.video.SetIVTC(0,0,-1,0);
VirtualDub.video.SetRange(0,0);
VirtualDub.video.SetCompression();
VirtualDub.video.filters.Clear();
VirtualDub.subset.Delete();
VirtualDub.SaveAVI("F:\\Video To Be Processed\\12Df\\AVS\\12Df [DivX].avi");
VirtualDub.Close();

// $endjob
//
//--------------------------------------------------
// $done

10:01:10 AM: Started Muxing Audio.: F:\Video To Be Processed\12Df\AVS\12Df [DivX]_Movie.avi
10:01:12 AM: Finished Muxing Audio.: Duration: 2 seconds.

10:01:12 AM: Done.
10:01:12 AM: Movie = F:\Video To Be Processed\12Df\AVS\12Df [DivX].avi
Total Encoding Time: 1 hour, 29 minutes, 25 seconds.
16/01/2005 10:01:12 AM: Job " 1 - 12Df [DivX].avi" finished.
_______________________________________________________________________________________________________________________
jggimi
16th January 2005, 23:04
I believe you may want to remove and re-install DivX 5. A 50GB first pass output file doesn't make a lot of sense, since the output is supposed to be a dummy .avi file containing no video.

I saw the following things in your log. An apparent Gknot reporting error, you might double check to see if it is or not, per my notes. A procedural ommission that may cause problems, and certainly prevents you from obtaining the best possible quality for your chosen bitrate. A procedural error in audio bitrate estimation. An error and warnings caused only by your aborting the first pass....what am I doing wrong?

#2: Omitting compressibility testing.
#3: Improperly estimating audio track size.

Here are all 4, in the order found in your log:Frames: 186216
FPS: 23.976
Duration: 29:27186216 frames @ 23.976 is 02:09:27. I think this was a log file reporting error and not associated with any process problem or .d2v file error. You should check by looking in GK's bitrate tab.Quality: 0.207 bits/(pixel*frame).
CompCheck3: 0.000 bits/(pixel*frame).
CompCheck5: 0.000 bits/(pixel*frame).No compressibility test has been run. Under/over size problems are possible when you do not do a compressibility check. But not 50GB oversize. Compression testing is a best practice that should not be ignored. Not only will it mitigate any rate control issues, but it will also allow you to select the best possible resolution for the content you are encoding.Lame: --alt-preset 192
.
.
.
8:54:05 AM: MP3-File-Size is 186150 kb.8:54:05 AM: Audio 1, determined: 186150 kb
8:54:05 AM: Audio 1, calc: 364066 kb
8:54:05 AM: New Bitrate for Movie = 1304 k(=1000)Bits/sYou are encoding 192 kbps, but your initial size estimation of the audio is approximately 384kbps. My guess is that in the Audio A box you are pointing to the .ac3 file in error. Instead, you should select 192kbps as your estimated audio track size. Only point to the .ac3 file if you will "just mux" it rather than transcode to .mp3 format. This misrepresentation will throw off any compressibilty testing -- if you do it -- and throw off any bits/pixels*frames value you might use for selecting your resolution, with or without a test.10:01:00 AM: Trying to open Log-file.
10:01:00 AM: Error: Could not open F:\Video To Be Processed\12Df\AVS\vdenc.log
10:01:00 AM: Error: Could not count encoded Frames.
10:01:00 AM: Speed: 0.000 Frames per Second.
10:01:00 AM: WARNING: Number of counted frames differs from settings!
10:01:00 AM: WARNING: Settings: 186216
10:01:00 AM: WARNING: Counted: 0You have no log file because you aborted the first pass. This is not a problem, since if DivX were working normally, you would have let this continue.
mig81
17th January 2005, 09:16
I can't believe I forgot to do compressibility again. The audio thing makes perfect sense, thanks. As for the size error, I'll definitely do a clean DivX reinstall. Weirdness...at any rate, thanks again! ;)