x264 mp4 output borked (rev 295) (mkv fixed)

[stephanV]

No problems with that here...

[Doom9]

(x264 --> mp4) --> mkv = fail

This works like a charm over here, using Sharktooth's 292a build and mkvtoolnix 1.5.6. It sounds more and more like a problem at your end with each test somebody else makes

[MeteorRain]

Hey, did anyone test my sample?

and i met more problems now:

i compressed a lot of avi files, simply using avisource. x264 just compressed about half of the file, and stopped and said successfully compressed but the result file is obviously completely broken.

all jobs failed except only one works.......

see attachment for avs&log

[Sirber]

Originally Posted by Doom9

This works like a charm over here, using Sharktooth's 292a build and mkvtoolnix 1.5.6. It sounds more and more like a problem at your end with each test somebody else makes

Well, I don't get it. I'm using all latest builds and it fails. MPC dies on me.

+ EBML head
+ Segment, size 108949416
|+ Seek head (subentries will be skipped)
|+ EbmlVoid (size: 4027)
|+ Segment information
| + Timecode scale: 1000000
| + Muxing application: libebml v0.7.5 + libmatroska v0.7.7
| + Writing application: mkvmerge v1.5.6 ('Breathe me') built on Sep  7 2005 18:18:22
| + Duration: 1731.512s (00:28:51.512000000)
| + Date: Sat Sep 17 10:39:14 2005 UTC
| + Segment UID: 0xa2 0xd9 0x45 0x6c 0xef 0x5e 0xe8 0x01 0xbb 0x3a 0x2c 0xa9 0xd
9 0xef 0x62 0xc9
|+ Segment tracks
| + A track
|  + Track number: 1
|  + Track UID: 905473676
|  + Track type: video
|  + Default flag: 1
|  + Forced flag: 0
|  + Lacing flag: 0
|  + MinCache: 1
|  + Timecode scale: 1.000000
|  + Max BlockAddition ID: 0
|  + Codec ID: V_MPEG4/ISO/AVC
|  + CodecPrivate, length 38
|  + Default duration: 10.347ms (96.646 fps for a video track)
|  + Language: und
|  + Video track
|   + Pixel width: 704
|   + Pixel height: 400
|   + Display width: 704
|   + Display height: 400
| + A track
|  + Track number: 2
|  + Track UID: 3167492503
|  + Track type: audio
|  + Default flag: 1
|  + Forced flag: 0
|  + Lacing flag: 1
|  + MinCache: 0
|  + Timecode scale: 1.000000
|  + Max BlockAddition ID: 0
|  + Codec ID: A_AAC/MPEG4/LC/SBR
|  + Default duration: 46.440ms (21.533 fps for a video track)
|  + Language: und
|  + Audio track
|   + Sampling frequency: 22050.000000
|   + Channels: 2
|   + Output sampling frequency: 44100.000000
|+ EbmlVoid (size: 1024)
|+ Cluster

[Sirber]

MP4 in MKV, it seems that it's libavcodec.dll that crash.

[stephanV]

@Meteorain:

Yes, it crashes here too in both mplayer (latest CVS) and DirectShow. So it is either a bug in x264 or libav. Of course this raises the question: what settings did you use?(AVS scipt and commandline)

(Don't post them as attachment please)

[movax]

We had reports of borked libavcodec_dec.dll with similar troubles in the last CCCP, solved my going to the latest CVS non-dec version.

@Sirber, I think it has to be something at your end...I just used 292A to complete your (x264 --> mp4) --> mkv test as well.

[Sirber]

Where could I get such a build?

[MeteorRain]

@stephanV

let me just post the avs and log for another sample (meet exact the same problem i bet)

Originally Posted by AVS

avisource("[raw]DearS 01 (DVD 640x480 DivX5.11 QB95 24fps).avi",false)

Originally Posted by Log

Next job job1 is a video job. encoder commandline:
"H:\mp4\x264.exe" --qp 23 --ref 4 --bframes 10 --b-pyramid --nf --weightb --analyse all --8x8dct --ipratio 1.0 --pbratio 1.0 --me umh --progress --no-psnr --output "I:\hd200\disk2\subgroup\DearS\1.mp4" "I:\hd200\disk2\subgroup\DearS\1.avs"
successfully set up video encoder and callbacks for job job1
----------------------------------------------------------------------------------------------------------

Log for job job1

avis [info]: 640x480 @ 23.98 fps (34049 frames)
x264 [info]: using cpu capabilities MMX MMXEXT SSE SSE2 3DNow!
mp4 [info]: initial delay 2000000 (scale 23976023)
This is a CQ job so there's no desired bitrate. Obtained video bitrate: 179.386766222332 kbit/s
----------------------------------------------------------------------------------------------------------

The above is the corrupt sample.



And an OK sample:

Originally Posted by AVS

avisource("[raw]DearS 10 (DVD 640x480 DivX5.11 QB95 24fps).avi",false)

Originally Posted by Log

Next job job10 is a video job. encoder commandline:
"H:\mp4\x264.exe" --qp 23 --ref 4 --bframes 10 --b-pyramid --nf --weightb --analyse all --8x8dct --ipratio 1.0 --pbratio 1.0 --me umh --progress --no-psnr --output "I:\hd200\disk2\subgroup\DearS\10.mp4" "I:\hd200\disk2\subgroup\DearS\10.avs"
successfully set up video encoder and callbacks for job job10
----------------------------------------------------------------------------------------------------------

Log for job job10

avis [info]: 640x480 @ 23.98 fps (34046 frames)
x264 [info]: using cpu capabilities MMX MMXEXT SSE SSE2 3DNow!
mp4 [info]: initial delay 250 (scale 2997)
x264 [info]: slice I:314 Avg QP:23.00 Avg size: 25089
x264 [info]: slice P:15512 Avg QP:23.00 Avg size: 8242
x264 [info]: slice B:18220 Avg QP:23.00 Avg size: 2028
x264 [info]: slice I Avg I4x4:39.8% I8x8:31.4% I16x16:28.7%
x264 [info]: slice P Avg I4x4:3.4% I8x8:3.8% I16x16:4.2% P:32.0% P8x8:6.1% PSKIP:50.4%
x264 [info]: slice B Avg I4x4:0.4% I8x8:0.3% I16x16:0.3% P:10.5% B:2.7% B8x8:1.2% DIRECT:3.6% BSKIP:81.0%
x264 [info]: 8x8 transform intra:32.6% inter:33.4%
x264 [info]: kb/s:972.8

Actual bitrate after encoding without container overhead: -105575.16
This is a CQ job so there's no desired bitrate. Obtained video bitrate: 974.550695947835 kbit/s
----------------------------------------------------------------------------------------------------------

[stephanV]

Well... you're settings are a bit ackward, but that should never cause a crash of course...

Maybe its the combination of many b-frames and b-pyramid that libav doesnt like... do you have the Nero decoder to test? (I guess not)

[Haali]

Looks like the problem is in integer overflow when AVI dwScale is too high (>23 millions in this case).

[stephanV]

Haali is obviously better at guessing than me

http://savefile.com/files/2005757 <--- test file

AVS script:

Avisource("test.avi")
assumefps(3.142)

x264 commandline:

x264 -o test.mp4 test.avs

Resultant mp4 will crash. Resultant mkv will play, but can't be remuxed with MKVmerge and remuxes weird with AMG.

You probably can use any weird non-integer frame rate to emulate the problem (just make sure you use enough frames too).

[movax]

Non-integer framerate...so 23,967 and the other standard rates will bork that test file? /me wonders what went into that file

[stephanV]

it doesnt b0rk the test file, it will probably b0rk any file, the file itself is nothing special.

[movax]

Ahkay, I think I see what you're getting at, x264 output to mp4 borks as a result of AssumeFPS(non-integer) in the input AVS.

[Sirber]

All my files are use "non-integer fps" and are "b0rked", unless I use RAW. I think we are on the path of bug killing

[Doom9]

when AVI dwScale is too high (>23 millions in this case).

but which integer would overflow? the framerate is a double (uint dwRate / uint dwScale). However, a dwScale of 23 million is unusual.. a proper 23.976 fps file has a dwRate of 23976 and a dwScale of 1000, a 29.97 fps one would have 29970 and 1000 respectively.

So it's not so much about non integer FPS streams, but possibly those that have weird dwScale (and dwRate?) values. Here's what I get if I add assumefps(3.142) to a perfectly working 23.976 fps script: dwRate = 13178503, dwScale = 4194304. I'm encoding now to see what the results are (I used that same script without assumefps and successfully created a properly working mp4 and mkv (that can be remuxed) from it))

Those that can debug MeGUI.. open a script, set a breakpoint in AviReader.cs at the line
framerate = (double)streamInfo.dwRate/(double)streamInfo.dwScale;
and check out dwRate and dwScale for clips that don't work.

[stephanV]

Originally Posted by Doom9

but which integer would overflow? the framerate is a double (uint dwRate / uint dwScale). However, a dwScale of 23 million is unusual.. a proper 23.976 fps file has a dwRate of 23976 and a dwScale of 1000, a 29.97 fps one would have 29970 and 1000 respectively.

Not exactly since the right frame rates for NTSC are 30000/1001 and 24000/1001 IIRC. But that doesn't change that it shouldn't use such a weird number if it is using dwScale as scaling factor, but it seems to me it isn't doing that at all.

[Haali]

Originally Posted by Doom9

but which integer would overflow?

x264 calculates frame_number*dwScale in one place

[Doom9]

1001 is used on DVD (probably stems from the fact that film is 24fps and if you do 3:2 pulldown you have to use drop frames so it'll be 29.97) VFW seems to be using the more straightforward values.

Either way, not surprisingly my mp4 ended up being corrupt as well and mkvmerge complained upon importing:

mkvmerge v1.5.6 ('Breathe me') built on Sep 7 2005 18:18:02
'D:\DVDs\KILL_BILL_VOL2\VIDEO_TS\chapter1.mp4': Using the Quicktime/MP4 demultiplexer.
Warning: 'D:\DVDs\KILL_BILL_VOL2\VIDEO_TS\chapter1.mp4' track 1: The AVC video track is missing the 'CTTS' atom for frame timecode offsets. However, AVC/h.264 allows frames to have more than the traditional one (for P frames) or two (for B frames) references to other frames. The timecodes for such frames will be out-of-order, and the 'CTTS' atom is needed for getting the timecodes right. As it is missing the timecodes for this track might be wrong. You should watch the resulting file and make sure that it looks like you expected it to.