AVCHDCoder - Blu-ray, MKV, M2TS, etc to AVCHD encoder. From input to ISO. Easy to use

[wakebrder]

Originally Posted by twazerty

True-HD will follow. Maybe next release or maybe not

Looks like there are no big bugs introduced in the new version so I am ready to add new features and improve features.

I think the next thing on the list will be:
-BDSup2Sup implementation.
-MP4 input
-Second audio track. (Not all formats just a couple of them: DTS/DTS, DTS/DTS-ES, DTS/AC3 640, DTS/AC3 448, DTS-ES/DTS-ES, DTS-ES/AC3 640, DTS-ES/AC3 448, AC3 640/AC3 640, AC3 640/AC3 448, AC3 448/AC3 448)

Just finished up an encode using DTS-MA with DVD-9 set as the target size. Came out at 7.56 GB. I can live with this!!

Great job!!

[twazerty]

Originally Posted by wakebrder

Just finished up an encode using DTS-MA with DVD-9 set as the target size. Came out at 7.56 GB. I can live with this!!

Great job!!

I tested it as well and was little undersized as well. I added an extra safety barrier but I think it is not necessary. If I remove it the output size will be about 30MB-120MB larger.

[wakebrder]

Originally Posted by twazerty

I tested it as well and was little undersized as well. I added an extra safety barrier but I think it is not necessary. If I remove it the output size will be about 30MB-120MB larger.

Better a little under than over.

Can't wait for True-HD.

[twazerty]

Finally managed to add 64 bit encoding via bipebuf and avs2yuv. For now you have to activate it manually in the settings.

Edit: Spoke too soon. It's about twice as slow and first pass crashes at 80% on several video's.

[twazerty]

I need help with the selection of new x264 profiles.

Since x264 is changed it is time to use new profiles. This time I am adding a third speed. Slow/Fast/Very Fast

But the selection of profiles is hard to choose. I noticed that x264 has build in presets. Maybe we can use those and change them a little bit to get them right for blu-ray?

My suggestion for the Slow preset:
x264.exe --pass 1 --preset medium --bitrate <bitrate> --level 4.1 --stats "movie.stats" --keyint 24 --min-keyint 2 --vbv-bufsize 24000 --vbv-maxrate 24000 --output NUL "movie.avs"
x264.exe --pass 2 --preset slow --bitrate <bitrate> --level 4.1 --stats "movie.stats" --keyint 24 --min-keyint 2 --vbv-bufsize 24000 --vbv-maxrate 24000 --output "output.mkv" "movie.avs"

[turbojet]

My suggestions

slow (slow but helps in high compression situations):
--pass 1 --vbv-bufsize 24000 --vbv-maxrate 24000 --bitrate <bitrate> --level 4.1 --stats "movie.stats" --keyint 24 --min-keyint 2 --ipratio 1.1 --pbratio 1.1 --b-adapt 2
--pass 2 --vbv-bufsize 24000 --vbv-maxrate 24000 --bitrate <bitrate> --level 4.1 --stats "movie.stats" --keyint 24 --min-keyint 2 --subme 9 --me umh --ref 4 --direct auto --b-adapt 2 --trellis 2 --psy-rd 1.0:0.25 --partitions all --ipratio 1.1 --pbratio 1.1

normal (good for typical DVD5/9):
--pass 1 --vbv-bufsize 24000 --vbv-maxrate 24000 --bitrate <bitrate> --level 4.1 --stats "movie.stats" --keyint 24 --min-keyint 2 --ipratio 1.1 --pbratio 1.1
--pass 2 --vbv-bufsize 24000 --vbv-maxrate 24000 --bitrate <bitrate> --level 4.1 --stats "movie.stats" --keyint 24 --min-keyint 2 --me umh --direct auto --psy-rd 1.0:0.25 --ipratio 1.1 --pbratio 1.1

fast (good for BD25 output, fast but efficiency is still considered):
--pass 1 --vbv-bufsize 24000 --vbv-maxrate 24000 --bitrate <bitrate> --level 4.1 --stats "movie.stats" --keyint 24 --min-keyint 2 --ipratio 1.1 --pbratio 1.1
--pass 2 --vbv-bufsize 24000 --vbv-maxrate 24000 --bitrate <bitrate> --level 4.1 --stats "movie.stats" --keyint 24 --min-keyint 2 --preset fast --direct auto --ipratio 1.1 --pbratio 1.1

x264 slow/slower/placebo presets won't work with 1920x1080 because --ref 5+

[twazerty]

Thanx turbojet. I implemented them into AVCHDCoder.

There are some problems. --direct-auto doesn't work for Slow and Medium. Add had to remove it or else encoding doesn't work.

I did some testing and this are the results on a Core i7 920:
59 second sample
-----------Slow--Medium--Fast
Pass 1:----44----44-------44 seconds
Pass 2:----493---176------90 seconds
Total:-----537---220------134 seconds

The slow settings are very slow. No big deal. That is for hardcore users :P. The fast and Medium are to slow. It would be nice if Medium and Fast could be about 20% faster. Else people complain it is slower then usual. when I remove --psy-rd 1.0:0.25 at Medium it doesn't speed up.

Also some other questions. Since the very first release of AVCHDCoder there is a bitrate problem. To be more specific: The max bitrate can get to high. AVCHD can stutter on players because the bitrate is too High.

This is pass 1 of the new Medium profile:
x264.exe --pass 1 --vbv-bufsize <maxBitrate> --vbv-maxrate <maxBitrate> --bitrate <bitrate> --level 4.1 --stats "movie.stats" --keyint 24 --min-keyint 2 --ipratio 1.1 --pbratio 1.1 --sar 1:1 --output NUL "input.avs"

Where:
<bitrate> is the calculated bitrate
<maxBitrate> can be: 18000 for AVCHD on DVD, 40000 for Blu-ray and 24000 for AVCHD at Stick or Custom output size.

Is this correct: --vbv-bufsize <maxBitrate> --vbv-maxrate <maxBitrate> ???

And what does the max bitrate exactly mean (Accordingly to the AVCHD specs). This:
videobitrate+audiobitrate+subtitlesbitrate
or:
videobitrate+audiobitrate+subtitlesbitrate+overhead

Support for second audio stream is almost ready. Only the graphical stuff needs to be fixed.

BTW: I have plans to make AVCHDCalculator cross platform. It is not too hard because it is a small program and that way I can learn something of Mac OS. I think I am going to make another application to generate hundreds of formulas so eventually AVCHDCalculator and AVCHDCoder support more then 2 audiotypes with lots of combinations.

Edit: I am doing a more realistic test right now at it seems the Medium speed is quite fast.

[turbojet]

x264 normal I posted is identical to the current AVCHDcoder output except for for enabling psy-trellis with --psy-rd 1.0:0.25 which is a minimal slowdown (>1% in my tests) while keeping details that are otherwise lost. Also --sar 1:1 is default so it's not really needed in x264 command line.

If --preset fast isn't as fast as you'd like maybe test out --preset veryfast it's about 50% faster but lesser quality. Also --psy-rd 1.0:0.25 can be used with --preset fast since --trellis 1, it won't have any effect with --trellis 0 which is what veryfast uses. Another option to speed up 'fast' is using --preset fast --trellis 0 the speedup won't be as much as veryfast would be but also the quality weren't be affected as much.

Your guess is as good as mine on --vbv-maxrate --vbv-bufsize and AVCHD standards. I've never seen much documentation on either. I haven't noticed and issues on a panasonic BD30 or PS3 with 24000/24000 and RipBot264 has been using it for awhile with no reports that I could see. But that also doesn't include video muxed with HD audio. My suggestion is if you can reproduce the stutter it try 18000/18000. If it still skips try lowering the bufsize to something like 9000 or so. If it still happens try using (18000 - <audio bitrate>) for maxrate/bufsize.

Oh and with slow and normal commands I posted it should be --direct auto instead of --direct-auto. I edited it.

[twazerty]

I added --sar because it is necessary for SD video's.

Now I tested with a 88 minute movie. This are the results:
------------Slow--Medium--Fast
Pass 1:-----53----53-------53 minutes
Pass 2:-----293---126------62 minutes
Total:------346---179------115 minutes
Total:------6-----3---------2 hours

The medium speed is about 30% faster as my previous Slow settings. Now it takes 3 hours instead of 4,5. The gap between Medium and Slow is Huge. It would be nice if we have a setting between Slow and Medium so people can choose better.

Now I am testing 64 bit encoding again. When second pass starts I get a strange error:
2nd pass has more frames than 1st pass (125593 vs 125592)

This is pass 1:
"pipebuf.exe" "avs2yuv.exe" "Fast DVD5 64bit.avs" -raw - : "x264.exe" --pass 1 --vbv-bufsize 24000 --vbv-maxrate 24000 --bitrate 5123 --level 4.1 --stats "movie.stats" --keyint 24 --min-keyint 2 --ipratio 1.1 --pbratio 1.1 --sar 1:1 --output NUL --frames 125593 - 1920x1080 : 4

and this is pass 2:
"pipebuf.exe" "avs2yuv.exe" "Fast DVD5 64bit.avs" -raw - : "x264.exe" --pass 2 --vbv-bufsize 24000 --vbv-maxrate 24000 --bitrate 5123 --level 4.1 --stats "movie.stats" --keyint 24 --min-keyint 2 --preset fast --direct auto --ipratio 1.1 --pbratio 1.1 --sar 1:1 --output "Fast DVD5 64bit.264" --frames 125593 - 1920x1080 : 4

The number of frames is requested from mediainfo:
Frame count : 125593

Is there a solution to bypass this problem?

In the next release --psy-rd 1.0:0.25 will be tweakable.

[wakebrder]

Tried another encode using DTS-MA with DVD-9 set as the target size. Came out around 11 GB. (not so good)

Maybe some more tweaking on the leaving DTS-MA untouched?

Thanks for your hard work!

[twazerty]

Originally Posted by wakebrder

Tried another encode using DTS-MA with DVD-9 set as the target size. Came out around 11 GB. (not so good)

Maybe some more tweaking on the leaving DTS-MA untouched?

Thanks for your hard work!

What bitrate does mediaInfo give for the audio?
What is the filesize of the dts-hd ma file?
What is the duration of the audio? (HH:MM:SS)
And what bitrate is calculated?

Maybe I can find out what is going wrong.

Edit:

Just created a small app that generates formulas for me. Tomorrow morning I have 55 formulas. (110 times muxing)

To create formulas for 3 audiostreams in all combinations is impossible. It will take 10-thousands of muxings. For triple audio I limit it to a couple of formats. When I limit it to 5 formats I still need 1050 formulas. That are 2100 muxes. Approximately 1050*25GB = 25TB of muxing data. Even if I use smaller files it is still 13TB of muxing
But I think I only support 4 formats for triple audio. Still 350 formulas.
Forget the above

[turbojet]

With the slow settings I missed --b-adapt 2 in the first pass, I corrected it in the original post, the first pass will be very slow now but the second pass shouldn't be much slower than normal.

The time difference should be just about nothing between normal that I posted and old AVCHDcoder, are you sure you aren't using --preset medium? It uses --me hex which a considerable effieciency drop over --me umh but it does speed things up a bit. None of the presets are suitable for high quality AVCHD\BD output. The defaults (medium) is sub-par quality and slow is beyond the specs.

There isn't much you can do between normal and slow to improve quality with just a little speed decrease. --b-adapt 2 is what's slowing things way down and bringing a quality boost. --subme 9 --partitions all --me esa is about all you can do.

instead of --frames for avs2yuv try --fps 24000/1001

What I meant by --sar 1:1 being default is if you leave it out it gives a bit-for-bit identical file to if you have it in the command line, just streamlines things a bit.

[wakebrder]

Originally Posted by twazerty

What bitrate does mediaInfo give for the audio?
What is the filesize of the dts-hd ma file?
What is the duration of the audio? (HH:MM:SS)
And what bitrate is calculated?

Maybe I can find out what is going wrong.

Edit:

Just created a small app that generates formulas for me. Tomorrow morning I have 55 formulas. (110 times muxing)

To create formulas for 3 audiostreams in all combinations is impossible. It will take 10-thousands of muxings. For triple audio I limit it to a couple of formats. When I limit it to 5 formats I still need 1050 formulas. That are 2100 muxes. Approximately 1050*25GB = 25TB of muxing data. Even if I use smaller files it is still 13TB of muxing
But I think I only support 4 formats for triple audio. Still 350 formulas.

Just deleted to free up HDD space. I'll save logs & info next time.

[wakebrder]

Just finished a different clip. Also came out to exactly 11 GB. I had delete temp file after encode checked.

Is there any way to copy/paste log text from your program?

Or would the log file be in another location besides the temp folder?

[twazerty]

Originally Posted by wakebrder

Just finished a different clip. Also came out to exactly 11 GB. I had delete temp file after encode checked.

Is there any way to copy/paste log text from your program?

Or would the log file be in another location besides the temp folder?

Ctrl+C to Copy and Ctrl+V to past it here. (Next version get Right Mouse Menu and savings to harddrive)
But without the rest of the information it is useless for this type of problem

Never thought file size could be useful so I add it in the next version too

BTW if you start conversion a second time with the same settings you can get the file sizes. When encoding starts just pause. Get the information I requested and then you can abort the process.

[wakebrder]

Originally Posted by twazerty

Ctrl+C to Copy and Ctrl+V to past it here. (Next version get Right Mouse Menu and savings to harddrive)
But without the rest of the information it is useless for this type of problem

Never thought file size could be useful so I add it in the next version too

BTW if you start conversion a second time with the same settings you can get the file sizes. When encoding starts just pause. Get the information I requested and then you can abort the process.

Here you go:

Edit:
DELETE

[twazerty]

In this case the Log isn't very useful
Bitrate is calculated just before encoding starts. It will also appear in AVCHDCoder and in Log. You stopped too soon

Wait when pass 1 is started, then hit pauze (Not abort!) and then fill in these values:
What bitrate does mediaInfo or tsMuxer give for the audio?
What is the filesize of the dts-hd ma file?
What is the duration of the audio? (HH:MM:SS): 02:14:40
And what bitrate is calculated?

For now it is the only way I can track down the problem. In my next release the above values will also be added to the Log.

[wakebrder]

Originally Posted by twazerty

In this case the Log isn't very useful
Bitrate is calculated just before encoding starts. It will also appear in AVCHDCoder and in Log. You stopped too soon

Wait when pass 1 is started, then hit pauze (Not abort!) and then fill in these values:
What bitrate does mediaInfo or tsMuxer give for the audio?
What is the filesize of the dts-hd ma file?
What is the duration of the audio? (HH:MM:SS): 02:14:40
And what bitrate is calculated?

For now it is the only way I can track down the problem. In my next release the above values will also be added to the Log.

Sorry. One more time:

13:47:06 --------Adding item---------
13:47:06 Source information: D:\Blu-ray\SB\BDMV
13:47:06 Source information: Video: 4113,H264,02:14:40,23.976,1920,1080,p
13:47:06 Source information: Audio: 4352,VBR
13:47:06 Source information: Audio: 4353,320
13:47:06 Source information: Audio: 4354,1536
13:47:06 Source information: Audio: 4355,192
13:47:06 Source information: Subs : 4608,PGS
13:47:06 Source information: Subs : 4609,PGS
13:47:06 Source information: Subs : 4610,PGS
13:47:06 Source information: Subs : 4611,PGS
13:47:06 Source information: Subs : 4612,PGS
13:47:06 Source information: Subs : 4613,PGS
13:47:06 Source information: Subs : 4614,PGS
13:47:06 Source information: Subs : 4615,PGS
13:47:06 Source information: Subs : 4616,PGS
13:47:06 Source information: Subs : 4617,PGS
13:47:06 Source information: Subs : 4618,PGS
13:47:06 Source information: Subs : 4619,PGS
13:47:06 Source information: Subs : 4620,PGS
13:47:06 Source information: Subs : 4621,PGS
13:47:06 Source information: Subs : 4622,PGS
13:47:06 Source information: Subs : 4623,PGS
13:47:06 Source information: Subs : 4624,PGS
13:47:06 Source information: Subs : 4625,PGS
13:47:06 Source information: Subs : 4626,PGS
13:47:06 Source information: Subs : 4627,PGS
13:47:06 Source information: Subs : 4628,PGS
13:47:06 Source information: Subs : 4629,PGS
13:47:06 Source information: Subs : 4630,PGS
13:47:06 Selected: Video: 4113,H264,23.976,1920,1080,p
13:47:06 Selected: Audio: 4352,VBR
13:47:06 Selected: Subs: 4612,PGS
13:47:06 Selected: Subs: 4614,PGS
13:47:06 Selected: Subs: 4615,PGS
13:47:06 Selected: Subs: 4616,PGS
13:47:06 Selected: Subs: 4619,PGS
13:47:06 Selected: Subs: 4625,PGS
13:47:06 Selected: Subs: 4627,PGS
13:47:06 Selected: Subs: 4630,PGS
13:47:06 --------Item added---------
13:47:28 --------Conversion started---------
13:47:29 Creating META file: MUXOPT --no-pcr-on-video-pid --new-audio-pes --demux --vbr --vbv-len=500
13:47:29 Creating META file: A_DTS, "D:\Blu-ray\SB\BDMV\STREAM\00613.m2ts", track=4352, mplsFile=00001
13:47:29 Creating META file: S_HDMV/PGS, "D:\Blu-ray\SB\BDMV\STREAM\00613.m2ts", fps=23.976, track=4612, mplsFile=00001
13:47:29 Creating META file: S_HDMV/PGS, "D:\Blu-ray\SB\BDMV\STREAM\00613.m2ts", fps=23.976, track=4614, mplsFile=00001
13:47:29 Creating META file: S_HDMV/PGS, "D:\Blu-ray\SB\BDMV\STREAM\00613.m2ts", fps=23.976, track=4615, mplsFile=00001
13:47:29 Creating META file: S_HDMV/PGS, "D:\Blu-ray\SB\BDMV\STREAM\00613.m2ts", fps=23.976, track=4616, mplsFile=00001
13:47:29 Creating META file: S_HDMV/PGS, "D:\Blu-ray\SB\BDMV\STREAM\00613.m2ts", fps=23.976, track=4619, mplsFile=00001
13:47:29 Creating META file: S_HDMV/PGS, "D:\Blu-ray\SB\BDMV\STREAM\00613.m2ts", fps=23.976, track=4625, mplsFile=00001
13:47:29 Creating META file: S_HDMV/PGS, "D:\Blu-ray\SB\BDMV\STREAM\00613.m2ts", fps=23.976, track=4627, mplsFile=00001
13:47:29 Creating META file: S_HDMV/PGS, "D:\Blu-ray\SB\BDMV\STREAM\00613.m2ts", fps=23.976, track=4630, mplsFile=00001
13:47:29 Demuxing playlist with TsMuxer: "C:\Program Files\AVCHDCoder\Tools\tsMuxeR_1.10.6\tsMuxeR.exe" "C:\Documents and Settings\Administrator\My Documents\AVCHDCoder\Temp\SB - item 1\SB2.META" "C:\Documents and Settings\Administrator\My Documents\AVCHDCoder\Temp\SB - item 1\"
14:08:22 Calculated bitrate: 7171
14:08:22 Total Subtitles size: 2.63190825E8
14:08:22 Creating AVS file: DirectShowsource("D:\Blu-ray\SB\BDMV\STREAM\00613.m2ts",fps=23.976,audio=false).ConvertToYV12().addborders(0,0,0,0)
14:08:22 Encoding Pass 1: "C:\Program Files\AVCHDCoder\Tools\X264\32bit\x264.exe" --pass 1 --bitrate 7171 --stats "C:\Documents and Settings\Administrator\My Documents\AVCHDCoder\Temp\SB - item 1\SB.stats" --level 4.1 --keyint 24 --min-keyint 2 --bframes 3 --weightb --direct auto --subme 2 --partitions none --ipratio 1.1 --pbratio 1.1 --vbv-bufsize 9000 --vbv-maxrate 24000 --me dia --threads auto --thread-input --sar 1:1 --output NUL "C:\Documents and Settings\Administrator\My Documents\AVCHDCoder\Temp\SB - item 1\SB.avs"

[twazerty]

I See what is going wrong. The first time you tried when conversion succeeded you used a DTS-HD HR audiofile. While I was testing I also used DTS-HD HR 5.1 file. But now you tried a DTS-HD MA 7.1. When a audiofile is DTS-HD MA tsMuxer and MediaInfo doesn't give bitrate. I have to calculate it myself. This will be fixed in next version.

Why does it go wrong:
Now the bitrate will not be subtracted from the total bitrate and you will get a oversized disc.

Edit: Currently I am creating 286 formulas for triple audio.
For double audio I have 66 formulas
For triple audio I have 286 formulas
For single audio I have 15 formulas

Still to come:
39 for double audio
274 for triple audio

Then I have formulas for the following audio formats in every combination with a max of 3 files:
AC3: 192, 224, 256, 320, 384, 448, 512, 576, 640
DTS-ES, DTS, DTS HR 3018
Wav 5.1 and 7.1

If I want to have formulas for every audiotype with 4 files I need your help because that are 2380 formulas. Takes two weeks of non stop muxing and roughly 64TB of muxing data

[wakebrder]

Originally Posted by twazerty

I See what is going wrong. The first time you tried when conversion succeeded you used a DTS-HD HR audiofile. While I was testing I also used DTS-HD HR 5.1 file. But now you tried a DTS-HD MA 7.1. When a audiofile is DTS-HD MA tsMuxer and MediaInfo doesn't give bitrate. I have to calculate it myself. This will be fixed in next version.

Why does it go wrong:
Now the bitrate will not be subtracted from the total bitrate and you will get a oversized disc.

Edit: Currently I am creating 286 formulas for triple audio.
For double audio I have 66 formulas
For triple audio I have 286 formulas
For single audio I have 15 formulas

Still to come:
39 for double audio
274 for triple audio

Then I have formulas for the following audio formats in every combination with a max of 3 files:
AC3: 192, 224, 256, 320, 384, 448, 512, 576, 640
DTS-ES, DTS, DTS HR 3018
Wav 5.1 and 7.1

If I want to have formulas for every audiotype with 4 files I need your help because that are 2380 formulas. Takes two weeks of non stop muxing and roughly 64TB of muxing data

So, you need more log files from DTS-MA & True-HD?

I could help you with that.

FWIW, I'm only interested in keeping 1 audio track. Others might want multiple audio tracks. Is this your goal?