Hybrid: Input -> x264/x265/Xvid/VP8/VP9

[franzrogar]

First, a "huge" thankyou for this tool. I've been looking for exactly this long time ago. And, btw, great work :-)

I'm using last version and Linux 64bits (ArchLinux) and I've some things I'd like to comment, if you don't mind:

1 - There's a bug with "output filename" having the "hyphen" character in it. Job stops with a "file couldn't be found" because, in Linux, "hyphen" char is used to pipe output to stdout. In my case I was using something like "Movie - Extended version.mkv" and it failed to find "Movie" file (which, of course, didn't existed).

2 - Please, this' a request: if there's a job running or, even, if there's any job in queue, when clicking "exit" button, please, ask first if you want to exit program... Maybe someone clicked it by mistake >.<

3 - For Linux 64 bits, "tsmuxer" and "neroaacenc" are 32-bits only programs. I'd be great to note it somewhere... mainly because some people wants pure 64 bits environments.

4 - There's no linux builds for "avsInfo" and source code is... "tied" to Windows headers. Would it be possible to "port" it to Linux? If not, would it be run using "wine" or ignored by Hybrid?

5 - Would it be possible to add a switch or flag or something else so program don't pop-up "I miss this program" each time it starts? Mainly because if there's no way to add "avsInfo" (as noted before), it'd be painful to see the pop-up always...


And, finally, just to let you know how I'm grateful to you, here's something like a "test": recoding a movie at L3.1 with Avidemux took 23h 32min in my laptop. Using your frontend, recoding at L4.1 took... 5h 12min. Seriously, I don't know what on earth Avidemux does internally... but it's "fired" from my laptop.

Again, THANK YOU VERY MUCH!

[Selur]

regarding 1: should be fixed in the next release (tomorrow evening)
regarding 2: will think about it (since I'm normally not really found of the 'are you sure ...' popups ;))
regarding 3: will add a comment in the first post
regarding 4: will remove it from the dependencies for linux (and also check that wine is used when it's used on linux systems atm)
regarding 5: should be fixed with 4 since I think the 'missing tools'-popup should stay there

regarding a 'test': you could just encode a small part (using e.g. the crop options) for speed testing, not sure how to add it as a feature in a meaningful way

Cu Selur

[Selur]

regarding 4&5: just checked the code and normally avsInfo should only be checked and mentioned as missing on Windows systems,.. (my ubuntu system isn't complaining about a missing avsInfo)

[franzrogar]

True, it doesn't look for avsInfo. I don't know why I added it. Sorry for inconveniencies.... :o

[Selur]

No problem, and as a side note: on linux when avsInfo is called it will be used with a 'wine' in front of it. ;)

[franzrogar]

I've tested last build and found no problem so far :-D

Great work. Congrats! And thank you very much ;-)

[Selur]

Hybrid ver.101011

*cosmectics*
- output container dropdown now showing all possibilities without scrolling
- bug when switching between encoding and filtering in the audio encoding section

*fixed*
- with video passthrough + raw output video files ended up in the temp not the output folder
- prevent the use of internal decoder in x264 when cropTop/Bottom is not a multiple of 4 or cropLeft/Right is not a multiple of 2
- problem with preview directly closing
- accidental closing of Hybrid after minimizing
- ' - ' in output name caused problem with .stats file generation
- using wrong aid on some sources

*changed*
- Windows: calling SetPriority with 'SetPriority -p64 PID' instead of 'SetPriority PID'
- added '--no-interlaced' to x264 calls, wenn internal decoder is used and input is detected as progressive

*added*
- option to 'warn on close'

*updated*
- windows 32bit package (includes a 64bit folder which includes 64bit avsInfo, cuda, FrameCounter,MP4Box, x264 versions)

-> updated links in 1st post

[Selur]

Hybrid ver.101126

*fixed*
- changed x264 qpmin minimum value from 1 to 0
- MP4Box progress
- adjusted VP8 support to use vpxenc instead of old ivfenc
- mkv audio reencode problem
- mono audio detected as stereo
- cropView aspect Ratio calculation (cropSar = inputSar in cropView)
- problem when importing jobs with unicode characters

*cosmetics*
- some renaming in Audio handling dropdown
- rename 'Crop preview' -> 'Crop mode'

*added*
- option to search for forced subtitles in DVDs (these subtitles can be extracted, but preview won't work due to

a mplayer bug)
- Option to export chapters as mkv compatible chapter files in the chapter tab (allows on to use Hybrid for

simple chapter extraction)
- tooltip sidebar: 'Config->Misc settings->Show tooltip sidebar' enables a sidebar which shows the tooltip infos

even when 'show tooltips' is disabled

*changed*
- when inserting chapter points every X minutes the first chapter will be inserted at minute zero not at minute

X
- disabled drag&drop when DVD/Blu-ray input is active

*adjusted*
- dvd subtitle detection

*updated*
- windows 32bit package (includes a 64bit folder which includes 64bit avsInfo, cuda, FrameCounter,MP4Box, x264

versions)

-> updated links in 1st post

Cu Selur

[Music Fan]

Hi Selur,
I have some problems with Hybrid 20101126 (package for Windows 32 bit);
1)the settings I change disappear every time I close the program (MKV in place of mp4 as standard output container). Why isn't it kept in memory ?
2)when I set chapters every x minute in a 4m38s video (short extract for my 1st test), chapters are added on 0, 1, 2 and 3rd minute in place of 1, 2, 3 and 4th minute.
3)I can't edit the timing of these chapters (nothing happens when I try to change the start time)
4)when I click on edit, the chapter is erased !
5)I can't add chapter to those created
6)every time I click on input file or output file, it opens the Hybrid32bit folder. Opening the last folder opened would be more convenient.
7)my standalone Sony player can't play the MKV created by Hybrid (in passthrough mode) though it plays the MKV done by MKVMerge with the same mp4 videos !

Thanks for your work ;)

[Selur]

1.) because you didn't save the settings (Config->Save->All OR Config->Save->GlobalDataModel->Selected)
2.) will fix, should be 0,1,2,3,4
3.-5.) will look into it
6.) it opens the folder specified as default input/output folder (Config->Path settings)
7.) iirc Sony players don't like the header compression for mkv files (Config->Container settings->Mkv Settings->Disable mkv header compression) other than that no clue without a debug log

Cu Selur

[Music Fan]

1.) because you didn't save the settings (Config->Save->All OR Config->Save->GlobalDataModel->Selected)
6.) it opens the folder specified as default input/output folder (Config->Path settings)
7.) iirc Sony players don't like the header compression for mkv files (Config->Container settings->Mkv Settings->Disable mkv header compression) other than that no clue without a debug log

Cu Selur
Thanks for your reactivity ! It works now ;)

2.) will fix, should be 0,1,2,3,4
3.-5.) will look into it
Cool :)

[Selur]

@Music Fan: What sort of Hybrid version do you use? (win32/64, linux32/64) Think I got it fixed and want to send you a Testversion. ;)
@all: Think I messed up with the mencoder build that's in the win32 package, best replace it with a version from: http://sourceforge.net/projects/mplayer-win32/files/
(will update the package once, a new r32649 is posted there; got no time to get my own win32 mencoder build system properly running)

[Music Fan]

@Music Fan: What sort of Hybrid version do you use? (win32/64, linux32/64) Think I got it fixed and want to send you a Testversion. ;)

Hi Selur,
I have some problems with Hybrid 20101126 (package for Windows 32 bit)
;)

Thanks a lot !

[Selur]

Just updated the test download (link is still the same) 1min ago to my current developement build, since I added a small gimmick. (crop resolution is shown in 'Crop View' and 'Avisynth'-Style cropping)

Cu Selur

[Music Fan]

Ok, I got it (I guess you mean the link you sent me in pm).

[Selur]

Here some general description how chapter editing is intended to work in Hybrd:

I. Loading a source
------------------------
a. you load a source without chapters and have the 'If input got no chapters set one every X min' set to the interval you want
-> Hybrid will then add every X minutes a Chapterpoint, naming the chapter Points "Chapter 1", "Chapter 2",...
b. you load a source with chapters and 'Import chapters on input change' is activated
-> Hybrid will import the chapters from the source and name them "Chapter 1", "Chapter 2",...
c. you load a source and no activate non of the automatic chapter adding options, but add a bunch of chapters yourself (see below: Editing a chapter list -> to add an additional entry to the list)

=> this leaves you with a chapterlist with times and names.

2. Editing a chapter list
-------------------------
- to add an additional entry to the list: set a "Start time" (& if you like a "Chapter description"), press 'Add' Hybrid will insert the new entry in the current list according to it's "Start Time"
- to remove all chapter entries from the list: press 'Remove all' -> Hybrid will clear the entries in the chapter list
- to remove a chapter entry from the list: press 'Remove' -> Hybrid will remove the entry
- to edit a chapter entry from the list: press 'Edit' -> Hybrid will remove the entry and load the values from the entry to "Start time" and "Chapter description" so you can edit them and add the modified chapter entry by pressing 'Add'

=> now the chapter list should look like you want it to

Cu Selur

[Music Fan]

To edit we have to press remove, as to remove ? I guess you mean that we have to click on edit to ... edit. ;)

[Music Fan]

I have a problem to add neroAacEnc.exe in the tools : I get this message : "GlobalDataModel doSet->found no field: neroAacEnc".

[Selur]

I guess you mean that we have to click on edit to ... edit.
Yup

I have a problem to add neroAacEnc.exe in the tools : I get this message : "GlobalDataModel doSet->found no field: neroAacEnc".
will fix (small typo)
The error is: "GlobalDataModel doSet->found no field: neroAacenc", should be "neroAacEnc"


-----------------------------

Hybrid rev.101201

*added*
- 'Auto passthrough subtitle on source change'
- 'Extract and Add' (subtitles) button: when pressed currently selected subtitles will be extracted and added to the subtitle queue for the current

video input

*fixed*
- freeze for no audio ids
- typo "neroAacenc"->"neroAacEnc"
- bug that set max chapter time to 0 :/

*changed*
- force mencoder as decoder for ProRes and VC-3 (i.e. DNxHD) input
- tweaked file analysis (if mplayer finds id but no audio info, tsMuxer&mediaInfo will look for them)
- small adjustments to better handle .mov content with mencoder

*adjusted*
- x264 blu-ray vui: bt470bg for <= 720x576, otherwise bt709
- x264 presets (rc-lookahead for fast presets)

*cosmetics*
- showing crop resolution in 'Crop View' and 'Avisynth Style'
- rearranged some options

-> updated links in 1st post

[Music Fan]

Thanks for the update ;)

[chunkylover67]

I'm trying to encode videos to my PSP, but I can't seem to get the right settings so that it's compatible. Can someone tell me them please? It should mainly concern the x264 section of Hybrid.

[Selur]

iirc psp restrictions were something like this:
1. bit rate needs to be <= 768 kBit/s
2. resolution needs to be <= 640×480 (for firmware 5.00 or later)
3. frame rate needs to be <= 30 fps
4. H.264 ProfileLevel needs to be <= Main@2.1
5. max referneces need to be <= 2
6. stereo LC AAC 2-channel audio (<=48kHz) with a datarate <= 128kBit/s
(since I got no psp myself not totally sure about this, but should it should be a good start)

found some additional infos: http://rob.opendot.cl/index.php/useful-stuff/psp-video-guide/

Cu Selur

[chunkylover67]

Well I never encode using bitrate options. I always use constant quantizer or quality, usually some around 20-22. Plus, I've used programs where references frames were 3, and they always worked (Xvid4PSP, Ripbot264). I also tend to get into detail with the x264 options, e.g b-pyramids and motion estimation etc. I'd like some settings for those if possible?

[Selur]

motion estimation has nothing to do with hardware compatibility,...
according to http://spreadsheets.google.com/pub?key=tYGTjNd0dG6P_A9z-YkFzFg&output=html
Main@Level 3 with 3 references should be fine too. :)
there are also some more Infos: http://forum.doom9.org/showthread.php?t=149711

[chunkylover67]

I've tried to use the settings given, however my PSP won't play the video. It says 'video cannot be played'. I've even created a test clip (10 secs long) and have been fondling with the settings for hours. Here's the ones I have now:

http://imgur.com/sLkpc.png

http://imgur.com/TYWcF.png

http://imgur.com/bzyBN.png

http://imgur.com/AmIyO.png

http://imgur.com/j84DD.png

[Selur]

b-frames with weighted references with be a problem, but my guess is that crf 21 produces too high datarates for the psp

[chunkylover67]

The CRF being 21 is no problem. I've encoded videos with it and my PSP played it fine. I unchecked the weighted references and changed my CRF to 22. My PSP still won't play it.

[Selur]

No, clue than. Got no psp so all I can do is refer you to the linked sides from above.

[chunkylover67]

Well thanks for the help anyways.

[chunkylover67]

I've solved the problem. Apparently, b-pyramid was set to 2 instead of none. I changed it back and now it works!

[Selur]

strange, btw. current Hybrid Version is 101201.

[chunkylover67]

Is it possible for Hybrid to remember the output path? It's a tad annoying having to set it each time. Just a suggestion.

[Selur]

Sure, you can set a Default Output path under Conf->Path settings and if you Save the Defaults (GlobalDataModel is enought, but you can also save All), Hybrid will 'remember' your choice. ;)

Cu Selur

[-TiLT-]

Currently I need to do a Xvid/MP3 encode and want to mux to avi later. As Hybrid does not provide avi as output container, I need to calculate the overhead myself. What should be extracted from the video bitrate for later avi muxing?

Edit: Alright, found out myself, its 24 bytes per frame, video and audio.

[Selur]

Alright, found out myself, its 24 bytes per frame, video and audio.
better look here: Overhead of AVI files (http://www.alexander-noe.com/video/amg/en_estimate_overhead.html#overhead_avi)

[-TiLT-]

Yes, much more precisely there. Thanks.
Pain in the ass to calculate. :)

[Selur]

The last days I send some time thinking about adding .avi output support and I nearly finished implementing it until the point where I needed to multiplex all the streams into a file.
Problem is neither mencoder nor ffmpeg allow to split a file while muxing by size.
I wrote some code that would, multiplex multiple audiostreams (with different delays) and a videostream into an .avi and even setting container tags using ffmpeg, but splitting the file in i.e. 700MB parts while muxing isn't possible afaik.
=> so no .avi output support unless I find a small crossplattform tool that allows multiplexing multiple audio streams, with a video stream into an avi, while adding container tags and splitting the output into specified chunks.

Cu Selur

[flebber]

Maybe I am missing the point here, its currently very hot and humid here in oz, but if you can output to mkv then why does it matter if ffmpeg or mencoder can split the file.

You already have a completed encoded mkv use AVI-Mux to re mux the final output to avi output at the end using avi-mux gui.

http://www.alexander-noe.com/video/amg/

[flebber]

See it is hot I forgot to ask are you going to implement DGindexNV.

[Selur]

Maybe I am missing the point here, its currently very hot and humid here in oz, but if you can output to mkv then why does it matter if ffmpeg or mencoder can split the file.

You already have a completed encoded mkv use AVI-Mux to re mux the final output to avi output at the end using avi-mux gui.
1. does avi-mux even run natively under linux? thought is was a windows only tool,...
2. I can output to mkv/mp4/m2ts/webm and now I want to add avi output support and need a way to multiplex to avi add tags and split the avi by size (like I do for mkv/mp4/m2ts/webm)

See it is hot I forgot to ask are you going to implement DGindexNV.
Not sure if I can follow you,.. since Hybrid doesn't create .avs scripts everything regarding DGIndexNV would need to be handled by the user (I don't know if there's a problem with Hybrid and AvisynthScripts that use DGIndexNV, since I don't use DGIndexNV)
Sadly DGIndexNV can't simply used as decoder to output raw yuv, which could then be fed to the encoders.

Cu Selur

[farhang]

In Hybrid32bit I selected 'Embed subtilte in Frame'. After starting the job and tsmuxing was finished, it shoes the error 'Processing aborted,...ERROR: is too small!'.
May you test the 'Embed subtilte in Frame' for a sample movie, please?

Here is the my test LOG:

Log Messages
analysing: C:\Program Files (x86)\Video\Hybrid32bit\1\paeiz.ts
grabbing audio ids ...
found audio ids: 4352
analysing audio streams...
analysing audio streams with tsMuxerR
grabbing video ids for: C:\Program Files (x86)\Video\Hybrid32bit\1\paeiz.ts
video ids found: 4113
analysing video streams...

Audio changed to:
AudioID: 4352
Format: ac3
Bit rate: 384
Channels: 6
Sample rate: 48000
Video delay: -40


Audio changed to:
AudioID: 4352
Format: ac3
Bit rate: 384
Channels: 6
Sample rate: 48000
Video delay: -40

Video changed to:
Format: AVC
Bit rate: 14771
Frame rate: 25.000
Resolution: 1920x1080
Interlacing: top field first
Aspect ratio: 1
Frame count: 5700


Audio changed to:
AudioID: 4352
Format: ac3
Bit rate: 384
Channels: 6
Sample rate: 48000
Video delay: -40


Audio changed to:
AudioID: 4352
Format: ac3
Bit rate: 384
Channels: 6
Sample rate: 48000
Video delay: -40

Analysing finished.
Generating video calls for: C:\temp\2\paeiz.mp4
adding x264 calls for source: 1.
createJobs for C:\temp\2\paeiz.mp4
called with empty tag list
called with empty chapter queue
createJob audio...
createJob video...
create video job for 22_19_36_751
Added new job with id 22_19_36_751
22_19_36_751_01_create: creating C:\temp\tsmuxer_22_19_36_751_01_0.meta...
Lowering priority of process with id: 1168
22_19_36_751_02_audio: tsMuxeR running...
22_19_36_751_03_cleanUp: "C:\temp\tsmuxer_22_19_36_751_01_0.meta"
22_19_36_751_04_rename: renaming ...
22_19_36_751_05_video: x264 (1 pass) encoding started...
Lowering priority of process with id: 5792
Lowering priority of process with id: 5748
raw [info]: 1920x1080p 0:0 @ 25/1 fps (cfr)
x264 [info]: using cpu capabilities: MMX2 SSE2Fast SSSE3 FastShuffle SSE4.1 Cache64
x264 [info]: profile High, level 4.2
C:\temp\paeiz_22_19_36_751_05.264 too small
22_19_36_751_05_video: Processing aborted,...ERROR: is too small!
Job 22_19_36_751 finished!

[Selur]

The Log doesn't help much, it just shows that there was a problem creating the output,..

Wild guesses without knowing anything specific:
1. It might be a bug in the routine when to use the internal x264 decoder, so try if it helps to disable: 'x264->Misc->Adjustments->Use internal decoder if possible'
(Update: routine looks fine here, but could still be mencoder)
2. switch the mencoder.exe with one from http://sourceforge.net/projects/mplayer-win32/files/MPlayer%20and%20MEncoder/revision%2032674/

If this doesn't help:

I will try to reproduce this later.
Important info needed to fix&reproduce bugs:
1. What Hybrid version did you use?(Windows/Linux 32/64bit + versions number)
2. What did happen? If an error message came up what did it exactly say?
3. What did you do to get to the bug? (best thing is a detailed step-by-step guide so that I can reproduce the problem)
4. Debug output would be helpful. (Config->Misc Settings->create debug file)
5. If possible a small sample file would be great. (upload it somewhere and send me a link via pm)
All these infos might be needed to reproduce the problem and reproduction is needed to find a fix.
If you find a bug, I'll try to fix it and send you a hopefully fixed version for testing via pm.
=> I need a debug log.

Cu Selur

[farhang]

Sorry for insufficient log data, and many thanks for your help.
I downloaded the Hybrid32bit 32bit package V. 20101126 from the first topic.
I noticed the above error was from MEncoder.exe, so I replaced it by the one from MeGUI software.

The Hybrid32bit 20101126 downloaded Mencoder.exe info:
File Version: 0.0.9.0
Product Version: Unknown-4.5.0
File Size: 4.31 MB

MeGUI Mencoder.exe info:
File Version: 0.0.9.0
Product Version: Sherpya-SVN-r28311-4.2.5
File Size: 5.31 MB

Now I have no error with this Mencoder.exe and 'Embed subtitle in frame' option goes with success.
Many thanks for your attention.


-------
The Log doesn't help much, it just shows that there was a problem creating the output,..

Wild guesses without knowing anything specific:
1. It might be a bug in the routine when to use the internal x264 decoder, so try if it helps to disable: 'x264->Misc->Adjustments->Use internal decoder if possible'
(Update: routine looks fine here, but could still be mencoder)
2. switch the mencoder.exe with one from http://sourceforge.net/projects/mplayer-win32/files/MPlayer%20and%20MEncoder/revision%2032674/

If this doesn't help:

I will try to reproduce this later.

=> I need a debug log.

Cu Selur

[flebber]

Selur you might want to take a look at Buzzqw's automen. it encodes to .avi and has a linux based version.

[Selur]

will have a look, but isn't it simple a mencoder gui? (afaik mencoder allows you to set a start&end time for a single split and doesn't allow split by size or tagging)
-> checked: automem doesn't support splitting or tagging at all

[Selur]

Hybrid rev.101212

*added*
- Xvid .avi output (no output splitting atm.)
- flac audio encoding

*changed*
- added time to name of output subtitle when extracting from dvd

*fixed*
- allow mod2 height for x264 internal
- subtitle language not correctly changed on title change

*cosmetics*
- .tag.xml.tag.xml -> .tag.xml

-> updated links in 1st post

[Selur]

@all: Don't use the .avi output, it's broken. (see: http://roundup.ffmpeg.org/issue2446)

[Selur]

will probably remove avi support since the 'bug' I posted in the ffmpeg bug tracker (http://roundup.ffmpeg.org/issue2446) was set to 'closed invalid',...

[Selur]

judging from the feedback I got:
If a player does not recognize 5.1 AC3 in avi, you should report this to the
developers of said player, but not here (this makes the issue invalid, since
here, only FFmpeg bug-reports are accepted).
over at http://roundup.ffmpeg.org/issue2446
I created a new bug report for ffplay since it too (like vlc, mplayer, mpc-hc, wmp) doesn't correctly playback the avi(xvid, 5.1 ac3) files multiplexed with ffmpeg.
Reply: "This is not a valid issue." -> I give up

since cehoyos in the http://roundup.ffmpeg.org/issue2446 thread doesn't quite get my problem and I feel incapable of some how make him understand that the muxing of 5.1 ac3 and xvid raw streams into an .avi container is broken in ffmpeg I give up on that front too.
-> if someone thinks he can communicate with cehoyos in a way for him to see the problem he is welcome to help, but atm I'm totally pissed of since I don't see where I went wrong.

-> cehoyos pointed out that ffmpeg muxes ac3 with 'high' bitrates in a way ffplay and all the other players can't properly playback the output .avi
=> seems like .avi output for Hybrid will have to wait until ffmpeg get's fixed. (looking at the list of bugs in the bugtracker this could take a while :()
(bug state is now 'open' so there's at least some hope for this to be fixed in a future ffmpeg release)

Cu Selur

[Selur]

Hybrid rev.110101

*fixed*
- avi (xvid,..) .avi support requires ffmpeg r26167 or later (Thanks to ffmpeg-team for fixing!)
- audio extraction on chapter selection
- typo: itsoffet -> itsoffset

*updated*
- Windows package

-> updated links in 1st post