Hybrid: Input -> x264/x265/Xvid/VP8/VP9

[Selur]

atm. x264 defines --tune animation like this:
- animation (psy tuning):
--bframes {+2} --deblock 1:1
--psy-rd 0.4:<unset> --aq-strength 0.6
--ref {Double if >1 else 1} source: x264 --fullhelp
-> you if you apply this multiple times b-frames and ref will increase :)

[ckmox]

@Selur

ah ok thanks so its really the behavior of x264

[VincAlastor]

selur, yesterday i have tested your well designed gui. everything works great. the m2ts output feature is very nice. i don't know how, but could you make it possible to load .avs files with dgmultisource filter, please? furthermore a video preview function for "user friendly" definition of x264 zones were be great too (like staxrip's zone features).
and if somebody could upload a hybrid 64bit hybrid tools folder i will be happy, than i can't find ffmpeg x64 (http://ffmpeg.arrozcru.org/autobuilds/) and the right x64 .exe/.dll files from other tools. so than thank you selur :)

[Selur]

Problem with a 64bit package for Windows is:
1. there's a bug in ffmpeg that hasn't been fixed (see: http://roundup.ffmpeg.org/issue1889) and prevents people form building 64bit ffmpeg builds
2. I have never seen a 64bit mencoder build for windows
and x64 versions for anything other than mencoder/mplayer, ffmpeg and x264 are really not that interesting since all the other tools don't really benefit speed wise from going 64bit

About extended Avisynth Support:
There are three reasons why I haven't added support for DGMultiSource and Avisynth script generation in general.
1. Hybrid is ment to run on Windows and Linux and there's no native stable running Avisynth version for Linux (and I don't like wine).
2. Last time I checked DGMultiSource wasn't free to use. (+ needs wine to run on linux + ffmpeg and mencoder can't be used as input)
3. I got no NVIDA graphiccard atm. (ordered one but it will at least take another week to arrive here :()

About the preview:
Problem there is I haven't found a way to properly use mplayer.exe for frame accurate positioning, especially going back a frame causes problems and the fact that mplayer changed the position output it gives through the command line when it seeks. I would probably have to write my own media player based on the libaries mplayer uses to get a better grip on this.
+ I haven't found a good crossplatform alternative for mplayer for the preview. :( (thought about a gstreamer based solution, but that also would require something like mplayer or ffmpeg in the background to be able to handle all the formats)


=> I'm happy you like Hybrid, but it seems like none of your wishes are probably fulfilled in the near future.
(but they are on my 'would be nice to have as a feature'-list, especially the preview thing since it would allow more comfortable cropping, cutting and setting chapter points)
Sorry.

Cu Selur

[VincAlastor]

thank you anyway. selur, do you know how i could integrate tsmuxer in staxrip? i know all of my wishes to hybrid are integrated in megui x64, but on my win 7 x64 system with .net framework 4 megui don't working right, the encodings are significant slower than with staxrip.

[Selur]

No clue about staxrip never looked at it's sources. Probably best ask stax76 (http://forum.doom9.org/member.php?u=13377) about adding support for it. :)

[Selur]

Hybrid ver.100615

*changed*
- use fractions for framerate for ffmpeg, mencoder, mkvmerge and x264 calls
- clear subtitle queue and subtitle input on source change
- take path of last subtitle input as start

*fixed*
- mkv audio&subtitle set default
- crash when 'Remove' was pressed on an empty subtitle queue
- job list save/load (by using another separator)
- autocrop call: missing " around mplayer path

(you need to enable Misc in the Main-Tab to enable the Misc-Tab)
'Reset Defaults' in Misc-Tab on first start

-> updated links in 1st post

[Selur]

Hybrid ver.100616

*changed*
- added border to preview windows (to add a tooltip)

*fixed*
- collision of .mp4 file creation and mkv Default-Track feature

'Reset Defaults' in Config-Tab on first start

[Selur]

Hybrid ver.100623

*added*
- VP8/webm support (using ivfenc atm. will switch to ffmpeg/mencoder once they both support it svn native and I tested it a bit)

*fixed*
- frame rate scaling with mencoder as decoder and outputframerate > deinterlaced framerate
- auto chapter import from dvd sources
- Xvid encoding
- Xvid encoder progress
- close mplayer when Preview windows was closed manually

*changed*
- moved 'global options' to the front in mkvmerge call
- removed unneeded sox calls
- removed '--no-global-tags' and '--no-track-tags' since mkvmerge only imports tracks without tags in it inside Hybrid

*updated*
- windows 32bit package

'Reset Defaults' in Config-Tab on first start

-> updated links in 1st post

[Riki]

Very cool to see VP8 support :)

A small question is when you put *updated* - windows 32bit package, does that mean the 64bit version is old? I guess I should be grabbing the 32 instead :p

[Selur]

When updating Hybrid (all versions) I sometimes update the 32bit package,...
from the first post:As downloads I will provide the most recent version on it's own (Hybrid -only) and a nearly complete (can't distribute neroaacenc) win32 package.
Since the win32 package normally probably will not include the newest Hybrid version it's adviced to download the newest package, extract it, download the newest 'Hybrid - only' version and extract it in the same folder as the package. (There's no distribution package with an installer for Windows or Linux, since I totally don't have the nerv or time to read up how-to a. create a package for each OS and b. how to maintain it.)
...

Hybrid Win64 package:
A 64bit package for windows would be possible since most of these tools are available as 64bit versions, but I'm not providing one (too much hassle). In general it's not a problem to just replace the 32bit version of one of the tools with it's 64bit conterpart. (I'm developing mainly on 64bit systems, so I replaced most of the 32bit tools)

-> Yes, all 64bit Hybrid versions are old since a new one was released. :)
-> updated links in 1st post

Cu Selur

[Riki]

ahh, I think I understand. So you updated the package. I was thinking you only updated the 32bit .exe file and nothing else.

So I am correct that you also updated the 64bit exe?

[Riki]

Yes, I see my mistake. Sorry for the dumb questions :p

THanks for updating the package, it saves me time searching for other updates :)

[Selur]

"So I am correct that you also updated the 64bit exe? "
Yup :)

[Selur]

Hybrid ver.100624

*added*
- mkv: option to disable "header compression" (some hardware players need this to be disabled)
- Visual aided cropping via 'Crop view'
(enable 'Enable cropping' and 'Crop view', then press 'Preview' to use it; look at the tooltip of the preview to understand how to use it)

*fixed*
- mkv multiplexing

'Reset Defaults' in Config-Tab on first start

-> updated links in 1st post

[Riki]

This isnt a big deal but when I drop multiple avi files in the input hybrid will crash (using the latest 32bit package). Im also using "custom add all" for the audio. If I only do single avi files it works fine.

[Selur]

@Riki: update to the latest binary,... (as far as I remember I fixed that but didn't write it in the changelog :))

[Riki]

oh great, works perfect now :)

[flebber]

Selur when Hybrid detects multiple episodes on a dvd, would it be possible to have it "batch" all episodes into queue once settigs applied. Perhaps just incrementing the output in the muxed title or similar.

[Selur]

"Queue Titles" should do that if you press it,... :)
(just got my new graphic card :D a gtx 470)

[flebber]

"Queue Titles" should do that if you press it,... :)
(just got my new graphic card :D a gtx 470)

http://www.nvidia.com/object/product_geforce_gtx_470_us.html Looks good

[Selur]

Hybrid ver.100703

*added*
- automatically prevent sleep mode on Windows systems (no clue how to do that on linux systems)
- option to start current queue at a specified time (Hybrid needs to be open for this to work)
- "--open-gop none/display/coded" - parameters

*fixed*
- job queue not processed linear
- cutting (piping mencoder decoder calls through ffmpeg for more accurate cutting)
- adjusting output frame rate and output frame count when enabling cut support
- aac audioid when muxing with mkvmerge
- mkvmerge progress indication
- stopping and then removing a job didn't free up a slot in the encoding client
- backup analysis based on ffmpeg
- .sfd support
- .bik input handling (converting bink dct audio to wav now and using mplayer for video analysis)

*changed*
- allow .sup (PGS) subtitle for mkv output

'Reset Defaults' in Config-Tab on first start

-> updated links in 1st post

[ckmox]

thanks for the updates

[flebber]

with your latest version when I press queue titles Hybrid is freezing. The error seems to relate to DXVA compatibility and mod 16. I have selected mod 16 in the crop and resize section of Hybrid. I have an output of 720 x 576.

I have uploaded the debug info for you http://www.mediafire.com/file/znjgvjvftnm/HybridDebugOutput.txt

http://farm5.static.flickr.com/4094/4764063282_53fae6764d.jpg

Edit as an aside you can see in top right corner that video is showing as scan type progressive, however Hybrid reported interalced material and automatically set yadif to on. Mediainfo agrees that it is interalced.

Width : 720 pixels
Height : 576 pixels
Display aspect ratio : 16:9
Frame rate : 25.000 fps
Standard : PAL
Color space : YUV
Chroma subsampling : 4:2:0
Bit depth : 8 bits
Scan type : Interlaced
Scan order : Top Field First
Bits/(Pixel*Frame) : 0.288

[Selur]

I'll try to reproduce it. :)
->
- can't reproduce it with my current development version, check your PM :)
- about the interlacing: can't say anything about it since you enabled the debug output after loading the source, so I don't have the analysis data Hybrid collected.

[flebber]

A little confused. There were 4 full titles in the dvd input and a 5th title short extra.

Hybrid has detected all titles, I pressed queue titles and start but at the end of the encoding I have only ended up with 1 title and 3 title reports. I ended up with output file title 3_1-7. This was the log.

Log Messages
Analysing: C:\Rip\Source\Customize\DVD_VIDEO_S1_D3\VIDEO_TS
analysing dvd structure....
analysing: Title_01 of 5
analysing: Title_02 of 5
analysing: Title_03 of 5
analysing: Title_04 of 5
analysing: Title_05 of 5
Found no AudioIDs for title 05 of 5
Analysing finished.
Added new job with id: 12_23_10_343
Added new job with id: 12_23_12_343
Added new job with id: 12_23_13_921
12_23_10_343_01_audio: mplayer started...
12_23_10_343_02_create: creating C:\DOCUME~1\Family\LOCALS~1\Temp\Title_3_1-7_12_23_10_343_02.qp...
12_23_10_343_03_video: x264 (1 pass) encoding started...
x264 [info]: using SAR=711/500
x264 [info]: using cpu capabilities: MMX2 SSE2Fast FastShuffle SSEMisalign LZCNT
x264 [info]: profile High, level 3.2
x264 [info]: frame I:873 Avg QP:19.85 size: 32202
x264 [info]: frame P:35208 Avg QP:23.01 size: 12206
x264 [info]: frame B:30841 Avg QP:25.24 size: 3690
x264 [info]: consecutive B-frames: 21.4% 45.8% 15.4% 9.8% 5.4% 0.7% 1.5%
x264 [info]: mb I I16..4: 14.1% 72.2% 13.7%
x264 [info]: mb P I16..4: 4.8% 10.3% 1.2% P16..4: 52.3% 16.9% 8.6% 0.0% 0.0% skip: 5.9%
x264 [info]: mb B I16..4: 0.1% 0.4% 0.1% B16..8: 35.3% 5.3% 1.0% direct: 9.1% skip:48.7% L0:33.5% L1:57.4% BI: 9.2%
x264 [info]: 8x8 transform intra:64.3% inter:79.8%
x264 [info]: direct mvs spatial:99.3% temporal:0.7%
x264 [info]: coded y,uvDC,uvAC intra: 61.3% 87.8% 59.3% inter: 25.8% 51.1% 11.2%
x264 [info]: i16 v,h,dc,p: 44% 14% 9% 33%
x264 [info]: i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 18% 6% 6% 8% 12% 16% 10% 14% 10%
x264 [info]: i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 24% 7% 4% 7% 12% 15% 11% 11% 9%
x264 [info]: i8c dc,h,v,p: 38% 19% 26% 17%
x264 [info]: Weighted P-Frames: Y:0.5%
x264 [info]: ref P L0: 63.3% 12.7% 15.0% 4.3% 3.4% 1.3% 0.0%
x264 [info]: ref B L0: 90.1% 8.0% 1.7% 0.2%
x264 [info]: ref B L1: 97.0% 3.0%
x264 [info]: kb/s:1708.42
12_23_10_343_04_cleanUp: "C:\DOCUME~1\Family\LOCALS~1\Temp\Title_3_1-7_12_23_10_343_02.qp"
12_23_10_343_05_muxing: mkvmerge started...
12_23_10_343_06_cleanUp: "C:\DOCUME~1\Family\LOCALS~1\Temp\Title_3_1-7_12_23_10_343_03.264"
12_23_10_343_07_cleanUp: "C:\DOCUME~1\Family\LOCALS~1\Temp\Title_3_1-7_en_aid_128__12_23_10_343_01.ac3"
12_23_12_343_01_audio: mplayer started...
12_23_12_343_02_create: creating C:\DOCUME~1\Family\LOCALS~1\Temp\Title_3_1-7_12_23_12_343_02.qp...
12_23_12_343_03_video: x264 (1 pass) encoding started...
x264 [info]: using SAR=711/500
x264 [info]: using cpu capabilities: MMX2 SSE2Fast FastShuffle SSEMisalign LZCNT
x264 [info]: profile High, level 3.2
x264 [info]: frame I:873 Avg QP:19.85 size: 32202
x264 [info]: frame P:35208 Avg QP:23.01 size: 12206
x264 [info]: frame B:30841 Avg QP:25.24 size: 3690
x264 [info]: consecutive B-frames: 21.4% 45.8% 15.4% 9.8% 5.4% 0.7% 1.5%
x264 [info]: mb I I16..4: 14.1% 72.2% 13.7%
x264 [info]: mb P I16..4: 4.8% 10.3% 1.2% P16..4: 52.3% 16.9% 8.6% 0.0% 0.0% skip: 5.9%
x264 [info]: mb B I16..4: 0.1% 0.4% 0.1% B16..8: 35.3% 5.3% 1.0% direct: 9.1% skip:48.7% L0:33.5% L1:57.4% BI: 9.2%
x264 [info]: 8x8 transform intra:64.3% inter:79.8%
x264 [info]: direct mvs spatial:99.3% temporal:0.7%
x264 [info]: coded y,uvDC,uvAC intra: 61.3% 87.8% 59.3% inter: 25.8% 51.1% 11.2%
x264 [info]: i16 v,h,dc,p: 44% 14% 9% 33%
x264 [info]: i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 18% 6% 6% 8% 12% 16% 10% 14% 10%
x264 [info]: i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 24% 7% 4% 7% 12% 15% 11% 11% 9%
x264 [info]: i8c dc,h,v,p: 38% 19% 26% 17%
x264 [info]: Weighted P-Frames: Y:0.5%
x264 [info]: ref P L0: 63.3% 12.7% 15.0% 4.3% 3.4% 1.3% 0.0%
x264 [info]: ref B L0: 90.1% 8.0% 1.7% 0.2%
x264 [info]: ref B L1: 97.0% 3.0%
x264 [info]: kb/s:1708.42
12_23_12_343_04_cleanUp: "C:\DOCUME~1\Family\LOCALS~1\Temp\Title_3_1-7_12_23_12_343_02.qp"
12_23_12_343_05_muxing: mkvmerge started...
12_23_12_343_06_cleanUp: "C:\DOCUME~1\Family\LOCALS~1\Temp\Title_3_1-7_12_23_12_343_03.264"
12_23_12_343_07_cleanUp: "C:\DOCUME~1\Family\LOCALS~1\Temp\Title_3_1-7_en_aid_128__12_23_12_343_01.ac3"
12_23_13_921_01_audio: mencoder/mplayer started...
C:\DOCUME~1\Family\LOCALS~1\Temp\Title_5_1-7_en_aid_128__12_23_13_921_01.ac3 too small
12_23_13_921_01_audio: Processing aborted,...ERROR: C:\DOCUME~1\Family\LOCALS~1\Temp\Title_5_1-7_en_aid_128__12_23_13_921_01.ac3 is too small!

It actually appears in the log that title_3_1-7 was muxed twice
http://farm5.static.flickr.com/4118/4767609761_c686e116da_b.jpg

[Selur]

log doesn't help me at all :)
Only thing I can tell you is that Hybrid encoded Title 3 (chapter 1-7) Job: 12_23_12_343, started the audio encoding of job 12_23_13_921 but stopped because it had troubles with the audio C:\DOCUME~1\Family\LOCALS~1\Temp\Title_5_1-7_en_aid_128__12_23_13_921_01.ac3 too small.

-> can't tell you what went wrong (see 1st post that I need to reproduce a bug)

[flebber]

How can I help you reproduce it? Its a dvd input for a TV show which features 4 full episodes. Is there a test I can run? Because it loads and encodes okay just not getting the expected 4 files output.

[Selur]

from the first post of this thread:
Important info needed to fix&reproduce bugs:
1. What Hybrid version did you use?(Windows/Linux 32/64bit + versions number)
2. What did happen? If an error message came up what did it exactly say?
3. What did you do to get to the bug? (best thing is a detailed step-by-step guide so that I can reproduce the problem)
4. Debug output would be helpful. (Config->misc settings->create debug file)
5. If possible a small sample file would be great. (upload it somewhere and send me a link via pm)
All these infos might be needed to reproduce the problem and reproduction is needed to find a fix. :)
If you find a bug, I'll try to fix it and send you a hopefully fixed version for testing via pm.
-> Starting Hybrid, activating Debug Ouput, do what you do to create the problem, send me the debug output and I have a bunch of infos to work with. ;)
(if it's just one DVD thats causing the problem it could also be a problem with the way the dvd was ripped <- this was the cause of the last problem related to DVD analysis)

[flebber]

Ah yes realise that in this case though slightly different

1) Used Hybrid version 100703 with DXVA fix.
2) No error messages
3) What I did to get the bug was to load a DVD Input folder with multiple episodes 4 episodes. Then applied x264 config, selected "Generate Output names" and selected "Queue Titles"
4) http://www.mediafire.com/file/uynojexyu13/HybridDebugOutput.txt
5. Will a sample file be useful? The file that did output was fine it is just that there was only 1 output not 4.

[Selur]

Won't need a sample file, but the debug file doesn't include the DVD analysis :( best specify the output before loading the source to be sure where to look for the debug file.
Does Hybrid detect the right length&co for the titles on the DVD?

[flebber]

Here is the HybridDebug with the path specified. http://www.mediafire.com/file/jwyoook14mm/HybridDebugOutput.txt

Edit : I realise that the encoding only started at file 3 because I had the option "On DVD Load - Select Longest File" selected. This meant that Hybrid started from file 3 not file 1 as I expected.

[Selur]

Yup, checked the code: When pressing 'Queue Title' only the titles starting at the current title are queued atm. -> will fix that and start from title 1. :)

Will send you a new version via PM. :)
(Will also probably tomorrow night release a new public version for everyone.)

Cu Selur

[flebber]

Something minor I noticed as well there is no option to select none as X264 tune option. As I am encoding TV I feel I should be using no x264 option as my understanding is that film is for "live action".

[Selur]

Here's how tune (and preset) options work in Hybrid:
You select a tune option and press "Apply"
- current configuration will then be changed according to the tune option
-> so you can apply multiple tune options ;)
For the x264 call (if not disabled) Hybrid minimizes the call by checking which preset/tune bests fits the current settings and then additionally hides the defaults. :)
=> if you didn't 'apply' a tune/preset none is 'active'

Since Hybrid doesn't remember the settings before applying the tune option, there's no way to 'un-apply' the option. :)

Cu Selur

[flebber]

Well the tune will work fine for me then :thanks:

The queue with the new version is actually starting from the middle.

http://farm5.static.flickr.com/4094/4770822817_4374b55f05.jpg

[Selur]

if no job (or subjob of a job) is selected the queue should start with the first job, if a specific job (or subjob of a job) is selected Hybrid will start with that job. :)

Cu Selur

[flebber]

Hi Selur

result for 100707 was 3 output files. 1_1-7, 2_1-7 and 3_1-7. There was no output for 4.

There were 2 reports for 3_1-7 with different suffixes.
Title_3_1-7_23_47_35_718_Reporthttp://www.mediafire.com/file/mnmczdyzwdr/Title_3_1-7_23_47_35_718_Report.txt
Title_3_1-7_23_47_33_875_Report http://www.mediafire.com/file/jymmmmdjrno/Title_3_1-7_23_47_33_875_Report.txt

HybridDebugOutput http://www.mediafire.com/file/tngziofh3tm/HybridDebugOutput.txt


It actually appears that encoding hasn't worked the video is "mangled".
.
http://farm5.static.flickr.com/4077/4772320499_3151b8b350.jpg

[flebber]

I have a seperate Music DVD with multiple songs, so will rip that now and test with Hybrid to see what result occurs :)

[Selur]

Totally strange it's like Hybrid is missing the resolution,.. (will do some additional testing later today and try to reproduce&fix this :))

[flebber]

I encoded two of the songs, this time the only thing different I have done is to press "add to queue" instead of "queue titles".

http://www.mediafire.com/file/onnjqg1guhy/HybridDebugOutput.txt

Edit: The encodes worked

[Selur]

Yeah I know there's something broken, just need some time to track it down. ;)

[Selur]

-> found a bug and I got a 'guess' what happend on your last encode.
You enabled crop (no source loaded and AutoCrop disabled)
-> Hybrid set crop values to 48:48:0:0
You enabled resize (to 720x...)
You loaded the source.
-> since crop was enabled, but AutoCrop not, Hybrid assumed you wanted to take the first 48x48 pixels of your source and resize it to something with 720x... (which ended up as: 720x...)
so what you see are the first 48x48 pixels of your source. :)
No bug in Hybrid there, but I found another small bug, when en-/disabling the gui.
Will send you a fixed version for testing. ;)

Cu Selur

[Selur]

Hybrid ver.100708

*added*
- 2pass audio normalization via sox
- toggle fullscreen option (in preview&co)
- option to set Chapterpoint in a preview window

*changed*
- resampling is now done with sox (instead of mencoder or ffmpeg)
- on 'Queue Titles' start queuing from 0 not from current title
- allowing autogain for raw audio input
- open-gop to newest syntax (using 'normal'&'bluray' instead of 'coded'&'normal')

*fixed*
- autocrop on "Queue Title"
- crash when importing a jobqueue with 'broken' jobs
- accidently always generated chapters when input got none and import chapters was enabled
- dvd input cutting

*updated*
- windows 32bit package

'Reset Defaults' in Config-Tab on first start

-> updated links in 1st post

[Riki]

I found a tiny bug. If you check "Adjust output path to source path" and then save the global profile, it will save the current output path in the global profile. It would be better if that was reset for each new source path.

[Selur]

it will be since you also save the "Adjust output path to source path" setting ;)

[Riki]

I love how fast Hybrid adds new features and support. However its very hard for me to re-create my global profiles everytime a new version comes out. Is there a way to upgrade older profiles? :)

[Selur]

Most of the time, it's probably enough to startup and instead of reset save the current profile, next release will complain about specific parts so one could manually look at these parts an adjust them.
Also save additional Audio&Video Profiles helps since the normally don't change much. ;)

Cu Selur

[Riki]

Thanks for the fast response! Thats a good idea about the audio&video profiles, I will try that. :)

[killerhex]

any chance for FLV input