Way over sized rv9 encodes

[#2]

Hi all.

Can some one let me know what on earth is going on here?


Video Input File Path : D:\DVD\Rips\3cBLue\3CBlue.d2v
Output File Path : D:\DVD\Rips\3cBLue\3CBlue.rmvb
Tempory Directory : D:\DVD\Rips\3cBLue

11:23:52 AM : Start Job !
---------------
Desired Size : 943 MB
Avg. Bitrate : 1406 kbps
Max. Bitrate : 3093 kbps
O.S. : Windows XP 5.1 build 2600 (Service Pack 1)
________________________________________

11:23:52 AM : Start EndCredits Encoding ...
EndCredits Mode : Smoother
ReCalculate Bitrate : ON
EndCredits Frames : 4046
________________________________________

11:31:41 AM : Finish EndCredits Encoding ...
---------------
Encode Duration : 00:07:49.000
Encode avg. FPS : 8.63
Final Size File : 0.7 Mb

11:31:41 AM : Start Movie Encoding ...
________________________________________

2:04:43 AM : Finish Movie Encoding ...
---------------
Encode Duration : 14:33:02.000
Encode avg. FPS : 0.08
Final Size File : 1572.1 Mb
Status Movie Encoding : FINISH
________________________________________

2:04:43 AM : Start Joining Movie + Credits ...
________________________________________

2:08:28 AM : Finish Joining Movie + Credits ...
---------------
Join Duration : 00:03:45.000
Final Size File : 1572.8 Mb
Status Joining : FINISH
________________________________________

Video Stream Log :


PID3696,Informational,Command Line,2004/02/03 11:23:53,10529,Preparing to encode file "D:\DVD\Rips\3cBLue\3CBlue_Credit.avs" to file "D:\DVD\Rips\3cBLue\3CBlue_Credit.rmvb"
PID3696,Informational,SDK Encoding,2004/02/03 11:23:53,15000,Starting encode
,Informational,Statistics,2004/02/03 11:31:40,19000, Total | Audio | Video | Avg | Min | Avg | Min | Pre- |Audience Name
,Informational,Statistics,2004/02/03 11:31:40,19001, kbps | kbps | kbps | FPS | FPS | QI | QI | roll |
,Informational,Statistics,2004/02/03 11:31:40,19004, ad: 31 | n/a | 31 | 25.0 | 23.1@00:00:11 | 31 | 31@00:00:00 | 1 |AutoRV9_Credit
,Informational,Statistics,2004/02/03 11:31:40,19002,Total Bitrate = 31 kbps
PID3696,Informational,Command Line,2004/02/03 11:31:40,10531,Encoding successful!
,Diagnostic,Command Line,2004/02/03 11:31:41,0,"J:\Autorv9\Softs\RP9_LI~1\producer.exe -i D:\DVD\Rips\3cBLue\3CBlue_Movie.avs -o D:\DVD\Rips\3cBLue\3CBlue_Movie.rmvb -ad c:\AutoRV9_Movie.rpad -am music -vm smooth -rs 688x420 -lc e,d" command line being run
PID3884,Diagnostic,File Reader,2004/02/03 11:31:41,8050,--------- Input File Properties from rn-avfile-directshow
PID3884,Diagnostic,File Reader,2004/02/03 11:31:41,8051,Input Filename: D:\DVD\Rips\3cBLue\3CBlue_Movie.avs
PID3884,Diagnostic,File Reader,2004/02/03 11:31:41,8052,File Size: 1KB
PID3884,Diagnostic,File Reader,2004/02/03 11:31:41,8053,Total Duration: 01:31:04.280
PID3884,Diagnostic,File Reader,2004/02/03 11:31:41,8080,Video Track
PID3884,Diagnostic,File Reader,2004/02/03 11:31:41,8081, Dimensions: 628 x 420
PID3884,Diagnostic,File Reader,2004/02/03 11:31:41,8082, Frame Rate: 25.000 FPS
PID3884,Diagnostic,File Reader,2004/02/03 11:31:41,8083, Format: YV12
PID3884,Diagnostic,File Reader,2004/02/03 11:31:41,8084, Duration: 01:31:04.280
PID3884,Diagnostic,File Reader,2004/02/03 11:31:41,8054,--------- End Input File Properties
PID3884,Diagnostic,SDK Encoding,2004/02/03 11:31:41,0,Load Level Headings: Reference Time, Stream Time, Delay, Interval Load, Average Interval Load, Processing Load, Stream Interval, Reference Interval, Accrued Delay, Average Delay, Load Level
PID3884,Diagnostic,SDK Encoding,2004/02/03 11:31:41,0,Using AutoRV9_Movie Audience
PID3884,Diagnostic,SDK Encoding,2004/02/03 11:31:41,0,Using video codec: rv9 (1446000 bps)
PID3884,Diagnostic,Video Codec,2004/02/03 11:31:41,20049,Setting video packet size to 15000
,Diagnostic,SDK Encoding,2004/02/03 20:53:35,0,Load Level Headings: Reference Time, Stream Time, Delay, Interval Load, Average Interval Load, Processing Load, Stream Interval, Reference Interval, Accrued Delay, Average Delay, Load Level
,Diagnostic,File Reader,2004/02/03 20:53:36,8050,--------- Input File Properties from rn-avfile-directshow
,Diagnostic,File Reader,2004/02/03 20:53:36,8051,Input Filename: D:\DVD\Rips\3cBLue\3CBlue_Movie.avs
,Diagnostic,File Reader,2004/02/03 20:53:36,8052,File Size: 1KB
,Diagnostic,File Reader,2004/02/03 20:53:36,8053,Total Duration: 01:31:04.280
,Diagnostic,File Reader,2004/02/03 20:53:36,8080,Video Track
,Diagnostic,File Reader,2004/02/03 20:53:36,8081, Dimensions: 628 x 420
,Diagnostic,File Reader,2004/02/03 20:53:36,8082, Frame Rate: 25.000 FPS
,Diagnostic,File Reader,2004/02/03 20:53:36,8083, Format: YV12
,Diagnostic,File Reader,2004/02/03 20:53:36,8084, Duration: 01:31:04.280
,Diagnostic,File Reader,2004/02/03 20:53:36,8054,--------- End Input File Properties
,Diagnostic,SDK Encoding,2004/02/03 20:53:36,0,Using AutoRV9_Movie Audience
,Diagnostic,SDK Encoding,2004/02/03 20:53:36,0,Using video codec: rv9 (1446000 bps)
,Diagnostic,Video Codec,2004/02/03 20:53:36,20049,Setting video packet size to 15000
,Diagnostic,File Output,2004/02/04 02:04:41,7040,Finished Writing Volume ID 1.
,Diagnostic,File Output,2004/02/04 02:04:41,7042,Finished writing RealMedia File.

Video Avisynth Script :


# PLUGINS
LoadPlugin("J:\Autorv9\SOFTS\AVSFILE\MPEG2DEC3.DLL")
LoadPlugin("J:\Autorv9\SOFTS\AVSFILE\TOMSMOCOMP.DLL")
#
# VIDEO SOURCE
Video=Mpeg2Source("D:\DVD\Rips\3cBLue\3CBlue.d2v")
#
# TRIM MOVIE
Video=Trim(Video,0,136606)
#
# DEINTERLACING (default value : 1,5,0)
Video=TomsMoComp(Video,1,15,1)
#
# CROPPING
Video=Crop(Video,18,66,692,460)
#
# RESIZING
# AnaMorphic Resize (Do not Edit These Values)
# Real Resize Values : Width X Height ( 688 X 420 )
Video=LanczosResize(Video,628,420)
#
# COLOR
Video=Tweak(Video,sat=1.4,cont=1.3,hue=0,bright=3.3)
#
# LIMIT Chroma & Luma Value
Video=Limiter(Video)
#
# FINISH
Return(Video)


Credit Avisynth Script :


# PLUGINS
LoadPlugin("J:\Autorv9\SOFTS\AVSFILE\MPEG2DEC3.DLL")
LoadPlugin("J:\Autorv9\SOFTS\AVSFILE\TOMSMOCOMP.DLL")
#
# VIDEO SOURCE
Video=Mpeg2Source("D:\DVD\Rips\3cBLue\3CBlue.d2v")
#
# TRIM MOVIE
Video=Trim(Video,136607,0)
#
# CROPPING
Video=Crop(Video,18,66,692,460)
#
# RESIZING
# AnaMorphic Resize (Do not Edit These Values)
# Real Resize Values : Width X Height ( 688 X 420 )
Video=BilinearResize(Video,628,420)
#
# SMOOTH
Video=TemporalSoften(Video,2,20,0)
#
# LIMIT Chroma & Luma Value
Video=Limiter(Video)
#
# FINISH
Return(Video)


Movie Audience File .rpad :


<?xml version="1.0"?>
<audience>
<avgBitrate type="uint">1446000</avgBitrate>
<maxBitrate type="uint">3093000</maxBitrate>
<streams>
<videoStream>
<pluginName type="string">rn-videocodec-realvideo</pluginName>
<codecName type="string">rv9</codecName>
<encodingComplexity type="string">very-high</encodingComplexity>
<codecProperties type="bag">
<customPacketSize type="uint">15000</customPacketSize>
</codecProperties>
<encodingType type="string">vbrBitrate</encodingType>
<quality type="uint">1</quality>
<maxStartupLatency type="double">60</maxStartupLatency>
<maxFrameRate type="double">25</maxFrameRate>
<maxKeyFrameInterval type="double">10</maxKeyFrameInterval>
<enableLossProtection type="bool">false</enableLossProtection>
</videoStream>
<audioStream>
<pluginName type="string">rn-audiocodec-realaudio</pluginName>
<codecName type="string">cook</codecName>
<codecFlavor type="uint">23</codecFlavor>
<streamContext type="bag">
<presentationType type="string">audio-video</presentationType>
<audioMode type="string">music</audioMode>
</streamContext>
</audioStream>
</streams>
</audience>

Credits Audience File .rpad :


<?xml version="1.0"?>
<audience>
<avgBitrate type="uint">1</avgBitrate>
<maxBitrate type="uint">1406000</maxBitrate>
<streams>
<videoStream>
<pluginName type="string">rn-videocodec-realvideo</pluginName>
<codecName type="string">rv9</codecName>
<codecProperties type="bag">
<customPacketSize type="uint">15000</customPacketSize>
</codecProperties>
<encodingType type="string">vbrQuality</encodingType>
<quality type="uint">30</quality>
<maxStartupLatency type="double">60</maxStartupLatency>
<maxFrameRate type="double">25</maxFrameRate>
<maxKeyFrameInterval type="double">10</maxKeyFrameInterval>
<enableLossProtection type="bool">false</enableLossProtection>
</videoStream>
<audioStream>
<pluginName type="string">rn-audiocodec-realaudio</pluginName>
<codecName type="string">cook</codecName>
<codecFlavor type="uint">23</codecFlavor>
<streamContext type="bag">
<presentationType type="string">audio-video</presentationType>
<audioMode type="string">music</audioMode>
</streamContext>
</audioStream>
</streams>
</audience>

Join Movie + Credits :


Log File: c:\AutoRV9_Join.log
Input File 1: D:\DVD\Rips\3cBLue\3CBlue_Movie.rmvb
Input File 2: D:\DVD\Rips\3cBLue\3CBlue_Credit.rmvb
Output File: D:\DVD\Rips\3cBLue\3CBlue.rmvb


Processing complete!

Results:
Title:
Author:
Copyright:
Comment:
Allow Recording: On
***********************************************

2:08:28 AM : Finish Job !
---------------
Total Duration : 14:44:36.000


As you can see the requested file size and final size differ by qite a magnitude. :confused: This has happened twice in a row.

The film is 3 Colours Blue, PAL, 4:3, interlaced with partial subtitles.

(Auto Rv9, Producer M8 with 8 -> 7 E.H.Q. notation patch)

Thanks
#2

[Sirber]

Hi

What was the asked filesize?

[Griniaris]

Desired Size : 943 MB
Final Size File : 1572.8 Mb

Don't know what the prob is to be honest...
With a quick look everything seems to be in order. Does this happen with all encodes or this movie only?

[karl_lillevold]

it is easy to verify AutoRV9s estimation:

Total Duration: 01:31:04.280
Using video codec: rv9 (1446000 bps)

that's 91min 4sec = 5464 seconds
5464 * 1446000 bps = 987618000 bytes ~= 941 MB
So the AutoRV9 calculation is good. The RV9/10 rate control is not terribly accurate, but I have never seen anything like this before. Very strange. I would be curious to know what D-C's RM analyzer/Shell extension tells you about the file, i.e. something like:

Maximum bitrate : 1900000 bits/s
Average bitrate : 610031 bits/s
Maximum packet size : 16009 bytes
Average packet size : 1597 bytes
Duration : 7234818 ms ( 02:00:34.818 )
Prebuffering : 7198 ms ( 00:00:07.198 )

[#2]

Thanks For your help team.

Yes this only happens on this film. I usually get a 3Mb over size. But nothing like this. As you can see the bit rates are through the roof.

RMVB Analyser v1.1 (www.dark-angel.does.it)

Information on :
------------------
D:\DVD\Rips\3cBLue\3CBlue.rmvb

Content description :
------------------------
Title : n/a
Author : n/a
Copyright : n/a
Comment : n/a

General file properties :
----------------------------
Maximum bitrate : 3093000 bits/s
Average bitrate : 2327004 bits/s
Maximum packet size : 15011 bytes
Average packet size : 5791 bytes
Duration : 5625441 ms ( 01:33:45.441 )
Prebuffering : 13751 ms ( 00:00:13.751 )
Index section offset : 0x624BF859h
Data section offset : 0x217h
Number of streams : 2

Flags properties :
---------------------
Flags : 9
Download allowed : yes
Record allowed: yes
Perfect play : no

Stream specific information :
----------------------------------
Stream number : 0
Maximum bitrate : 3093000 bits/s
Average bitrate : 2327004 bits/s
Maximum packet size : 15011 bytes
Average packet size : 5791 bytes
Time offset : 0 ms ( 00:00:00.0 )
Prebuffering : 13751 ms ( 00:00:13.751 )
Duration : 5625442 ms ( 01:33:45.442 )
Stream name : Video Stream
MIME type : video/x-pn-realvideo
Video resolution : 688x420
Frame rate : 25 fps

Stream number : 1
Maximum bitrate : 0 bits/s
Average bitrate : 0 bits/s
Maximum packet size : 0 bytes
Average packet size : 0 bytes
Time offset : 0 ms ( 00:00:00.0 )
Prebuffering : 0 ms ( 00:00:00.0 )
Duration : 0 ms ( 00:00:00.0 )
Stream name :
MIME type : logical-fileinfo
Audiences : AutoRV9_Movie;
audioMode : music
Creation Date : 2/3/2004 20:53:36
Generated By : Helix DNA Producer 9.2 for Windows, Build 9.2.0.384
Modification Date : 2/3/2004 20:53:36
videoMode : smooth



Min Bitrate : 6896 Bits/s
Max Bitrate : 8768216 Bits/s
Avg Bitrate : 2346275 Bits/s

PERCENT INFORMATIONS :


Range Number : 10

Bitrate between ( 6896 - 470917 ) : 2.84 %
Bitrate between ( 470917 - 934938 ) : 0 %
Bitrate between ( 934938 - 1398959 ) : 0.98 %
Bitrate between ( 1398959 - 1862980 ) : 22.19 %
Bitrate between ( 1862980 - 2327001 ) : 29.43 %
Bitrate between ( 2327001 - 2791022 ) : 21.14 %
Bitrate between ( 2791022 - 3255043 ) : 11.56 %
Bitrate between ( 3255043 - 3719064 ) : 6.44 %
Bitrate between ( 3719064 - 4183085 ) : 2.9 %
Bitrate between ( 4183085 - 4647106 ) : 1.23 %
Bitrate upper ( 4647106 ) : 1.29 %

[#2]

It seems to be something to do with resizeing and the analysis? With Lanczos the oversize is worst. With simple resize the size is closer but not bang on with bilinea it's in between.(All with two pass vbr) With CBR its ok with two pass vbr the average bit rate is a whole lot higher. Yet with one pass vbr its fine.??(All with a Lanczos resize)

Now this film has partial Eng. Subs. Half go below the picture and half inside the picture. So I don't fully crop the bottom of the frame. It should be about 98 so to see the subs in the encode it needs to be about 50. When I crop to 98 the final file size dose come down but it is still about 30% too big!

This is all rather interesting. Any one got any theorys?

[Griniaris]

This has never happened to me either before...
Obviously something in this specific film confuses rv9's rate control in two passes but I really don't know what that could be.
I have never used the anamorphic resize but I doubt that is causing the prob. Sorry but I can't think of anything else..

[karl_lillevold]

I have only one suggestion, and that is to never use the "Smooth" option. Use "Normal" instead. Smooth will enable half horizontal resolution (or HHR), i.e. the encoder will resample the image to half the size horizontally before encoding. The player will stretch back on playback. How HHR works along with anamorphic, I don't really know.

If it was not for the fact that my work on a completely new 2-pass rate control is already far along, I would have perhaps wanted to investigate more. As it is, the new rate control is much more accurate, at least in all my tests so far. More on this later.

[#2]

I just settled for a one pass vbr encode of this film. Thanks for the input. Pity we don't have a resolved out come. I would love to know what is going on here. If I figure it out I'll let you know.

I'll try this film out on the new rate calculator when you release it Karl.


Thanks for you thoughts.

#2.

Ps When should I use Sharp rather than normal

[Sirber]

Should be included in RealAnime as soon as avalible :D

[#2]

With Rv10 this flim has no oversive problems with 2 pass VBR. Just the usual 3-5mb over.

Nice work Karl : )

Thanks
#2

[karl_lillevold]

Great! And those 3-5 MB is because the AutoRV10 currently does not take into account any container format overhead. When he starts doing that, it will be right on target.