Has anyone used X264 to produce a replicated BD title?

[dvdboy]

Re-ran the test with lower buffer / bitrate limits:

[Information] Log
-[Information] Versions
--[NoImage] MeGUI Version : 0.3.1.1053
--[NoImage] OS : Windows XP Professional x86 SP2 (5.1.131072.2600)
--[NoImage] Latest .Net Framework installed
-[Information] Hardware
--[NoImage] CPU : Intel(R) Core(TM)2 CPU 6600 @ 2.40GHz
-[Information] Log for job21 (avs, LAGARITH_YV12.avs -> )
--[Information] [25/08/2009 23:40:37] Started handling job
--[Information] [25/08/2009 23:40:38] Preprocessing
--[Information] [25/08/2009 23:40:38] Encoding started
--[Information] [25/08/2009 23:40:52] Postprocessing
---[Information] Deleting intermediate files
--[Information] [25/08/2009 23:40:52] Job completed
-[Information] Log for job22 (video, LAGARITH_YV12.avs -> )
--[Information] [25/08/2009 23:40:52] Started handling job
--[Information] [25/08/2009 23:40:52] Preprocessing
--[NoImage] Job commandline: "C:\Program Files\megui\tools\x264\x264.exe" --profile high --level 4 --preset fast --pass 1 --bitrate 18000 --stats "F:\WORKING_FILES\LAGARITH_SOURCE\01_small_test.stats" --thread-input --deblock -1:-1 --keyint 24 --min-keyint 2 --b-adapt 2 --direct auto --ref 1 --ipratio 1.1 --pbratio 1.1 --vbv-bufsize 25000 --vbv-maxrate 20000 --qcomp 0.5 --me dia --subme 2 --partitions none --trellis 0 --no-mixed-refs --mvrange 511 --nal-hrd --aud --sar 1:1 --output NUL "F:\WORKING_FILES\LAGARITH_SOURCE\LAGARITH_YV12.avs"
--[Information] [25/08/2009 23:40:52] Encoding started
--[NoImage] Standard output stream
--[NoImage] Standard error stream
---[NoImage] avis [info]: 1920x1080 @ 23.98 fps (193 frames)
---[NoImage] x264 [info]: using SAR=1/1
---[NoImage] x264 [info]: using cpu capabilities: MMX2 SSE2Fast SSSE3 Cache64
---[NoImage] x264 [info]: profile Main, level 4.0
---[NoImage]
---[NoImage] x264 [info]: slice I:11 Avg QP:13.82 size:134121
---[NoImage] x264 [info]: slice P:58 Avg QP:15.17 size:112927
---[NoImage] x264 [info]: slice B:124 Avg QP:16.77 size: 71664
---[NoImage] x264 [info]: consecutive B-frames: 2.7% 6.6% 37.9% 52.7%
---[NoImage] x264 [info]: mb I I16..4: 66.1% 0.0% 33.9%
---[NoImage] x264 [info]: mb P I16..4: 53.1% 0.0% 0.0% P16..4: 29.2% 0.0% 0.0% 0.0% 0.0% skip:17.7%
---[NoImage] x264 [info]: mb B I16..4: 19.5% 0.0% 0.0% B16..8: 28.1% 0.0% 0.0% direct:26.5% skip:25.8% L0:32.8% L1:22.0% BI:45.2%
---[NoImage] x264 [info]: direct mvs spatial:97.6% temporal:2.4%
---[NoImage] x264 [info]: coded y,uvDC,uvAC intra:75.2% 91.2% 79.3% inter:37.0% 43.2% 9.4%
---[NoImage] x264 [info]: kb/s:16807.0
---[NoImage] encoded 193 frames, 5.87 fps, 16807.07 kb/s
--[Information] [25/08/2009 23:41:25] Postprocessing
---[Information] Deleting intermediate files
--[Information] [25/08/2009 23:41:25] Job completed
-[Information] Log for job23 (video, LAGARITH_YV12.avs -> 01_small_test.264)
--[Information] [25/08/2009 23:41:25] Started handling job
--[Information] [25/08/2009 23:41:25] Preprocessing
--[NoImage] Job commandline: "C:\Program Files\megui\tools\x264\x264.exe" --profile high --level 4 --preset fast --pass 3 --bitrate 18000 --stats "F:\WORKING_FILES\LAGARITH_SOURCE\01_small_test.stats" --thread-input --deblock -1:-1 --keyint 24 --min-keyint 2 --b-adapt 2 --direct auto --ref 1 --ipratio 1.1 --pbratio 1.1 --vbv-bufsize 25000 --vbv-maxrate 20000 --qcomp 0.5 --subme 2 --partitions all --trellis 0 --no-mixed-refs --mvrange 511 --nal-hrd --aud --sar 1:1 --aud --output "F:\WORKING_FILES\LAGARITH_SOURCE\01_small_test.264" "F:\WORKING_FILES\LAGARITH_SOURCE\LAGARITH_YV12.avs"
--[Information] [25/08/2009 23:41:25] Encoding started
--[NoImage] Standard output stream
--[NoImage] Standard error stream
---[NoImage] avis [info]: 1920x1080 @ 23.98 fps (193 frames)
---[NoImage] x264 [info]: using SAR=1/1
---[NoImage] x264 [info]: using cpu capabilities: MMX2 SSE2Fast SSSE3 Cache64
---[NoImage] x264 [info]: profile High, level 4.0
---[NoImage]
---[NoImage] x264 [info]: slice I:11 Avg QP:14.06 size:131970
---[NoImage] x264 [info]: slice P:58 Avg QP:15.02 size:127117
---[NoImage] x264 [info]: slice B:124 Avg QP:16.62 size: 76332
---[NoImage] x264 [info]: consecutive B-frames: 2.7% 6.6% 37.9% 52.7%
---[NoImage] x264 [info]: mb I I16..4: 56.3% 19.7% 24.1%
---[NoImage] x264 [info]: mb P I16..4: 29.3% 24.8% 7.6% P16..4: 12.2% 4.4% 3.0% 0.6% 0.5% skip:17.6%
---[NoImage] x264 [info]: mb B I16..4: 19.3% 0.0% 0.0% B16..8: 27.1% 2.5% 2.1% direct:23.4% skip:25.6% L0:31.9% L1:21.4% BI:46.7%
---[NoImage] x264 [info]: 8x8 transform intra:23.4% inter:14.4%
---[NoImage] x264 [info]: direct mvs spatial:83.1% temporal:16.9%
---[NoImage] x264 [info]: coded y,uvDC,uvAC intra:76.6% 91.5% 79.3% inter:35.5% 42.8% 9.8%
---[NoImage] x264 [info]: kb/s:18176.6
---[NoImage] encoded 193 frames, 7.81 fps, 18176.70 kb/s
--[Information] Final statistics
---[NoImage] Video Bitrate Desired: 18000 kbit/s
---[NoImage] Video Bitrate Obtained (approximate): 18176 kbit/s
--[Information] [25/08/2009 23:41:50] Postprocessing
---[Information] Deleting intermediate files
--[Information] [25/08/2009 23:41:50] Job completed
-[Information] Log for job24 (video, LAGARITH_YV12.avs -> 01_small_test.264)
--[Information] [25/08/2009 23:41:50] Started handling job
--[Information] [25/08/2009 23:44:24] Preprocessing
--[NoImage] Job commandline: "C:\Program Files\megui\tools\x264\x264.exe" --profile high --level 4 --preset fast --pass 3 --bitrate 18000 --stats "F:\WORKING_FILES\LAGARITH_SOURCE\01_small_test.stats" --thread-input --deblock -1:-1 --keyint 24 --min-keyint 2 --b-adapt 2 --direct auto --ref 1 --ipratio 1.1 --pbratio 1.1 --vbv-bufsize 25000 --vbv-maxrate 20000 --qcomp 0.5 --subme 2 --partitions all --trellis 0 --no-mixed-refs --mvrange 511 --nal-hrd --aud --sar 1:1 --aud --output "F:\WORKING_FILES\LAGARITH_SOURCE\01_small_test.264" "F:\WORKING_FILES\LAGARITH_SOURCE\LAGARITH_YV12.avs"
--[Information] [25/08/2009 23:44:24] Encoding started
--[NoImage] Standard output stream
--[NoImage] Standard error stream
---[NoImage] avis [info]: 1920x1080 @ 23.98 fps (193 frames)
---[NoImage] x264 [info]: using SAR=1/1
---[NoImage] x264 [info]: using cpu capabilities: MMX2 SSE2Fast SSSE3 Cache64
---[NoImage] x264 [info]: profile High, level 4.0
---[NoImage]
---[NoImage] x264 [info]: slice I:11 Avg QP:14.00 size:132840
---[NoImage] x264 [info]: slice P:58 Avg QP:15.03 size:126955
---[NoImage] x264 [info]: slice B:124 Avg QP:16.61 size: 76602
---[NoImage] x264 [info]: consecutive B-frames: 2.7% 6.6% 37.9% 52.7%
---[NoImage] x264 [info]: mb I I16..4: 56.2% 19.8% 24.0%
---[NoImage] x264 [info]: mb P I16..4: 29.4% 25.0% 7.3% P16..4: 12.2% 4.3% 3.0% 0.6% 0.5% skip:17.7%
---[NoImage] x264 [info]: mb B I16..4: 19.4% 0.0% 0.0% B16..8: 27.2% 2.5% 2.0% direct:23.3% skip:25.5% L0:31.9% L1:21.4% BI:46.6%
---[NoImage] x264 [info]: 8x8 transform intra:23.5% inter:14.3%
---[NoImage] x264 [info]: direct mvs spatial:84.7% temporal:15.3%
---[NoImage] x264 [info]: coded y,uvDC,uvAC intra:76.6% 91.5% 79.4% inter:35.5% 42.8% 9.8%
---[NoImage] x264 [info]: kb/s:18210.2
---[NoImage] encoded 193 frames, 8.15 fps, 18210.22 kb/s
--[Information] Final statistics
---[NoImage] Video Bitrate Desired: 18000 kbit/s
---[NoImage] Video Bitrate Obtained (approximate): 18210 kbit/s
--[Information] [25/08/2009 23:44:48] Postprocessing
---[Information] Deleting intermediate files
----[Information] [25/08/2009 23:44:48] Successfully deleted F:\WORKING_FILES\LAGARITH_SOURCE\01_small_test.stats
--[Information] [25/08/2009 23:44:48] Job completed

Still fails to mux in Scenarist.

What I can't understand is that Ben's file encodes and muxes fine, it's just this test file I'm using - but both are Lagarith. I thknk I need to sort out another test file and see what happens with that...

[Dark Shikari]

Originally Posted by dvdboy

I was ready to report back that it hadn't, when I noticed this:



So does x264 believe the buffer / bitrate limits to be different to what was posted earlier in this thread, or did I misread your earlier post:

The first pass is Main Profile, which has different limits than High. But this doesn't matter; it's only the first pass.

[Biggiesized]

My apologies if this comes off a bit rude, Ben, but if you have access to the source DPX files, why is there such bad banding in the fades in the source you made available to us?

[shon3i]

@dvdboy, maybe you can try encode without --nal-hrd command, but after encode you must use h264info tool to rewrite HRD information. Maybe somewere problem in HRD. Also you can try to decrase/incrase bitrate.

[multimediaman]

Originally Posted by benwaggoner

Feel free .

OK

Match_Point_trailer___ffv1_flac-001.mkv - 981.52MB
md5sum d9697eca0fb548233adff21a7277716e

Match_Point_trailer___ffv1_flac-002.mkv - 773.27MB
md5sum af683b1799e348ebaec5abbfe948edb3

[popper]

Originally Posted by LoRd_MuldeR

Is there an automated way to download all those files? Downloading 38 files by hand isn't fun
Unfortunately the overview page that shows all files doesn't exhibit proper download URL's, so DTA and friends can't help here...

Can't you ask Xiph to put it on their http://media.xiph.org/ server or at least put it on a service like Rapidshare ???

LoRd_MuldeR, you should be able to make and post a small, single self contained working cross platform 'rebol view' script to do this using REBOL PARSE given your background in programing.... for use on any current and future skydrive.live.com files uploaded there.

or potentially any other site URL too for that matter, or even stick it in a local or remote rebol GUI or CGI rebol web server that takes any URL given it, and process it as you wish, if you want to go that far for fun OC.

im not good at scripting but it seems you could open a 'rebol view' shell and type a simple
page: read http://cid-bee3c9ac9541c85b.skydrive.../Match%20Point

typing
print page
will show it in the shell

to get a current updated page locally in the page: (or whatever you want to use) variable
then rebol parse the page for all the
http:// hash .skydrive.live.com/self.aspx/.Public/Match%20Point/Match%20Point%20LAGS%20YV12.7z. Nos URL links into another found: variable

then do another rebol read and parse on each found URL there thats got the
http:// something .blu.livefilestore.com. ..... whatever

and do a binary write save to disk of each 7z in there, as per that short http://musiclessonz.com freehand GUI painting program in section 4. below
see also 6.5 Running Command Line Applications

--------cut and paste inside a rebol view shell to see it work
view center-face layout [
h1 "Paint:"
s: area black 650x350 feel [engage: func [f a e] [
if a = 'over [append s/effect/draw e/offset show s]
if a = 'up [append s/effect/draw 'line]]] effect [draw [line]
]
b: btn "Save Image" [save/png %a.png to-image s alert "Saved 'a.png'"]
btn "Clear" [s/effect/draw: copy [line] show s]
]

----- cut

http://www.rebol.com/view-platforms.html
http://www.nabble.com/How-to-properl...d19448593.html
http://compsci.ca/v3/viewtopic.php?t=17706
http://musiclessonz.com/rebol.html#section-8.9

[LoRd_MuldeR]

Originally Posted by popper

LoRd_MuldeR, you should be able to make and post a cross platform 'rebol view' script to do this using REBOL PARSE given your background in programing.... for use on any current and future skydrive.live.com files uploaded there.

Sure I could write a download script for that purpose. But it's far too much trouble for downloading one sample video. I'm not willing to do that

Especially if the problem can be solved easily by using a better hosting platform.

Thanks to "multimediaman" I'm downloading the clip from http://zshare.net/ in only two pieces and in a much more space-efficient format

[popper]

Originally Posted by LoRd_MuldeR

Sure I could write a download script for that purpose. But it's far too much trouble for downloading one sample video. I'm not willing to do that
Especially if the problem can be solved easily by using a better hosting platform.

Thanks to "multimediaman" I'm downloading the clip from http://zshare.net/ in only two pieces and in a much more space-efficient format

sure, but i thought people might like to at least try it for fun....
as already, theres two clips there on skydrive.live.com that we all want to get and try at some point, there will be several more in time i hope too, thanks to benwaggoner etc, a generic rebol script might be very handy later.

[LoRd_MuldeR]

It's very kind of Benwaggoner to share his footage. But I really hope he will use a different hosting platform next time.

I know he likes to stick with MS solutions, but it's really pain, especially in this case

[Lyris]

Ben actually tried many times to upload to the FTP account I set up, but the transfer kept failing because of a problem on this end. The SkyDrive solution is the one which worked properly, so take from that what you will.

Just so it doesn't get lost in amongst all this The Island trailer discussion, I'll ask again:

Can anyone here share the secrets for encoding compliant Secondary Video streams?

All I have so far is that the frame rate has to match the primary video, and since we're using AVC, the secondary video must be AVC also. And the max bit rate can't go above 8mbps, but this is talking heads stuff in SD resolution, so 2mbps should do it fine...

Can anyone fill me in on the VBV buffer size? Number of B frames? Keyframe interval?

[benwaggoner]

Originally Posted by Biggiesized

My apologies if this comes off a bit rude, Ben, but if you have access to the source DPX files, why is there such bad banding in the fades in the source you made available to us?

Alas, there was banding in the DPX sequence.

DI only sets an upper bound for quality, not a lower bound .

I could probably do a XScaler dithered version as well.

[kolak]

Originally Posted by Lyris

Ben actually tried many times to upload to the FTP account I set up, but the transfer kept failing because of a problem on this end. The SkyDrive solution is the one which worked properly, so take from that what you will.

Just so it doesn't get lost in amongst all this The Island trailer discussion, I'll ask again:

Can anyone here share the secrets for encoding compliant Secondary Video streams?

All I have so far is that the frame rate has to match the primary video, and since we're using AVC, the secondary video must be AVC also. And the max bit rate can't go above 8mbps, but this is talking heads stuff in SD resolution, so 2mbps should do it fine...

Can anyone fill me in on the VBV buffer size? Number of B frames? Keyframe interval?

BD spec book cost 5K$


Andrew

[kolak]

Originally Posted by benwaggoner

Alas, there was banding in the DPX sequence.

DI only sets an upper bound for quality, not a lower bound .

I could probably do a XScaler dithered version as well.

Ben, is XScaler available to buy? I know that it comes with Cinevision PSE, but is there a way to get it seperately?
Did MS ever done multithreaded version?

Andrew

[benwaggoner]

Originally Posted by kolak

Ben, is XScaler available to buy? I know that it comes with Cinevision PSE, but is there a way to get it seperately?
Did MS ever done multithreaded version?

I'll look into it.

The various post houses did their own segmented multithreaded mplementations (so an 8-core machine would simultaneously XScale the source in 8 chunks at once).

[Biggiesized]

Stacey Spears said that XScaler was "made available freely to just about anyone who wanted it" or something along those lines on the AVS Forum. I couldn't tell if this was in reference to studios only however.

It's a pity that the DPX sequence had banding as well. Perhaps they were a bit too aggressive in moving those bits around (12-bit linear should be the minimum DI IMO).

EDIT: If there is one benefit to being a Microsoft employee, it's that you get to play around with sweet tools.

[Biggiesized]

Originally Posted by Lyris

Ben actually tried many times to upload to the FTP account I set up, but the transfer kept failing because of a problem on this end. The SkyDrive solution is the one which worked properly, so take from that what you will.

Just so it doesn't get lost in amongst all this The Island trailer discussion, I'll ask again:

Can anyone here share the secrets for encoding compliant Secondary Video streams?

All I have so far is that the frame rate has to match the primary video, and since we're using AVC, the secondary video must be AVC also. And the max bit rate can't go above 8mbps, but this is talking heads stuff in SD resolution, so 2mbps should do it fine...

Can anyone fill me in on the VBV buffer size? Number of B frames? Keyframe interval?

Don't quote me, but I think VBV can match the Blu-ray spec for primary streams (30000 kbs), but you may want to go to something much lower like 12000 to be safe since your max video data rate is only 8 mbps.

I think the GOP length can be 2 seconds (minimum IDR is 1 frame). I think B frames are limited to 2 and reference frames to 4.

BTW, Lyris I've been unable to register to comment on your website. What gives? Bad CAPTCHA script?

[Lyris]

BTW, Lyris I've been unable to register to comment on your website. What gives? Bad CAPTCHA script?

D'oh - will look into that!

Thanks for the suggestions, I'll try those out and see if I can get Secondary video to mux.

[kolak]

Originally Posted by Biggiesized

Stacey Spears said that XScaler was "made available freely to just about anyone who wanted it" or something along those lines on the AVS Forum. I couldn't tell if this was in reference to studios only however.

It's a pity that the DPX sequence had banding as well. Perhaps they were a bit too aggressive in moving those bits around (12-bit linear should be the minimum DI IMO).

EDIT: If there is one benefit to being a Microsoft employee, it's that you get to play around with sweet tools.

It's rather not available for commercial use. Microsoft was giving for free PEP encoder at NAB, but later licens has expired.

Andew

[shon3i]

Originally Posted by Lyris

Can anyone here share the secrets for encoding compliant Secondary Video streams?

All I have so far is that the frame rate has to match the primary video, and since we're using AVC, the secondary video must be AVC also. And the max bit rate can't go above 8mbps, but this is talking heads stuff in SD resolution, so 2mbps should do it fine...

Can anyone fill me in on the VBV buffer size? Number of B frames? Keyframe interval?

There is no secrets, situation is very clear

Only restrtictions from default are:

for SD (720x576 or 720x480)
Level must be 3.2
vbv maxrate=8000
vbv buffersize=12000 (must be equal to level 3 because max DBP is 3037.5)
max ref frames=6 for 720x480 and 5 for 720x576

for HD (720 or 1080)
level 4.0 or 4.1 (slices are required for 4.1)
vbv maxrate=40000 for Level 4.1, 24000 for level 4.0
vbv buffersize=30000
max ref frames=6 for 720 and 4 for 1080


other things are same as primary video (bframes=3, keyframe interval and etc..)

[Lyris]

Thank you I will see if I can get this to mux successfully when I get home (just got back from a Sony SXRD projector event - the wonders of optics in masking compression artefacts never ceases to amaze me). The idea of secondary video is pretty exciting.