Hybrid: Input -> x264/x265/Xvid/VP8/VP9

[Selur]

no clue never seen it, probably a small bug related to the current Hybrid version you use + the way x264 posts the rest time,.. -> what x264 version are you using?

[meshaun]

The latest. Updated from the x264.nl

[Selur]

fixed,..

[alter4]

Hi guys,
I definitely cant use x264 zones feature.
It asks me about frames number that I cant bind to time intervals.
Are there any best practices?

[Selur]

I definitely cant use x264 zones feature.
not sure how to help if you definitely can't use the zone feature, works fine here. :)

It asks me about frames number that I cant bind to time intervals.
Are there any best practices?
x264s zone option works with frames:
--zones <zone0>/<zone1>/... Tweak the bitrate of regions of the video
Each zone is of the form
<start frame>,<end frame>,<option>
where <option> is either
q=<integer> (force QP)
or b=<float> (bitrate multiplier) source: x264 --fullhelp
that's why Hybrid wants the user to specify a start and end frame. :)

Assuming your source and target is cfr (constant frame rate): 'frame number'/'frame rate per second' will give you the corresponding time.
startFrame: 100 endFrame: 2000 with a frame rate of 25 fps would then define a 36 second zone 00:00:04 to 00:00:40.
(zones can get tricky if source or target is vfr or frame rate is changed,..)

Are there any best practices?
Only use it if you know what you are doing, normally one should not mess with x264s rate control. ;)

Cu Selur

[meshaun]

Selur,
as an Encoder myself, I thought of asking for a feature that will be useful to most of the Encoders. That is, create a small sample file of the Output.
I got this idea from the thumbnail idea that you've already implemented and so, why not a sample as an output too? Maybe not in all formats but samples in .mkv would do fine.

[Selur]

Hybrid rev. 2012.08.25.1

*fixed*

thumbs: fixed crash if thumb nail creation was active for audio only jobs
subtitle: overwriting font size didn't work
subtitle: ssa subtitle accidently got .srt extension during extraction
subtitle: subtitle language tagging sometimes did not work properly
subtitle: filtering of subtitle queue for Blu-ray
input: handling of mkv files with no frame count/rate/mode info
avisynth: disable MT support if TextSub is used
avisynth: option to disable ffmpegsource single-thread enforcement
avisynth: srt subtitle styling
preview: subtitle style overwriting not always viewable in preview
timecode: if the last time code entry is a zero, it will be removed
analyse: crash when MediaInfo detected 'Original Frame rate'- and no 'Frame rate'-info.
avc: sometimes avcLevel restriction got triggered with input instead of output resolution
job: Blu-ray + 'Queue Titles'
audio: dts-hd channel count 8 / 6 detected as 6 instead of 8
audio: automatically call to5.1 if input has 7.1 channels and output is ac3/dts
x264: crash when enabling 'minimize AVC Level'
x264: crf as zone option
x264: output naming broke if output x264-10bit/9bit was used and output name/folder contained x264 in it.
x264: progress to newest changes in r2204
input: mac build ignoring keyboard input

*added*

subtitle: option to enforce subtitling through mencoder even when avisynth filters are used
joblist: option to get via right-click to the output folder
warning: splitting from avi/mov/raw output is not supported atm.
muxing: option to create a 1min sample file from the middle during mkv creation
cuda: option to specify which gpu is used

*changed*

general: lowered mplayer/mencoder lavdthreads count to a maximum of 8 again
general: disable qaac support if Apple Application Support is not installed (comes with Quicktime and/or iTunes)
avisynth: added option to en-/disable if Hybrid converts .srt subtitles to .ass before embedding
analyse: read analyzer output as utf-8 encoded
analyse: MediaInfo detecteds 'Original Frame rate'- but no 'Frame rate'-info, 'Frame rate' is set to the value of 'Frame rate'
subtitle: copy subtitle to tempPath before using
audio: allow vbr preset 6 when fhgaacenc version >= 20120624
audio: remove qaac if 'Apple Application Support' is not installed
audio: remove fhgaacenc if WinAmp is not installed and the necessary libraries are also not present in the Hybrid folder
audio: added warning when trying to encode 7.1 audio (can't be done with Hybrid since none of it's decoders can handle 7.1 input audio properly)

-> downloads: http://www.selur.de/downloads

Cu Selur

[Selur]

Hybrid rev. 2012.08.29.1

*fixed*

x264: command line import didn't enable 'x264->Main->Restriction Settings->Hardware' when importing '--bluray-compat'
audio: don't do truehd->wav conversion, just because delaycut is enabled
audio: typo/formating when extraction audio with mplayer
decode: making sure ffmpeg also disables subtitles during decoding
preview: avisynth filtering was used in preview even if video was set to 'ignore' or 'passthrough'

*added*

analysis: option to select whether or not Hybrid will use 'Original pixel aspect ratio' or 'Pixel aspect ratio' when both are presented through the MediaInfo-analyzer

*changed*

tools: recheck tool version when the path to the tool was changed manually.

-> downloads: http://www.selur.de/downloads

Cu Selur

[pintcat]

I'm unable to encode an audio stream within an old mpeg1 video. The stream format is mp2 and is supposed to be transcoded to mp3 (the video itself will be converted to xvid in an AVI container), but it is always passed through (reencode is checked of course and lame is ready to go). Do I need a special decoder for mp2? I thought ffmpeg could do the job.

[Selur]

@pintcat: Nope, that's a bug, probably not hard to fix, if you post what flavor of Hybrid (Windows 32/64/2k, Linux 32/64, Mac) you use, I can send you a fixed version later,..

-> can't reproduce the problem here,.. mp2 reencoding works without a problem,... -> no clue what you did, need more details to reproduce (see: http://www.selur.de/support)

[pintcat]

Nothing special: I encoded the video with xvid, using a constant quantizer 3 and the audio with lame 128kbs, keeping the original sample rate (44100Hz). Also tried different settings, but no success. the audio stream was added with 'auto add (first)' and in the audi menu I checked 'Reencode audio stream'.
A debug output is attached. I hope this helps a little. It seems like Hybrid simply ignores the audio settings in this particular case.
I will also send you the video (via pm) so you can see for yourself.

[Selur]

will have to wait till the attachment is approved by a moderator,...

the audio stream was added with 'auto add (first)'
I hope you didn't do the following:
- load your source with audio set to 'ignore'
- set audio to auto add (first) (this adds the audio with the currently configured settings; as default 'passthrough' to the audio queue)
- change audio settings but not the audio queue (this way the settings have changed but the audio queue hasn't)

[Selur]

I did the following:
1. set "Main->Video handling" to "Xvid"
2. set "Main->Audio handling" to "auto add (first)"
3. enabled "Audio->Reencode Audio stream"
4. set "Audio->Audio Encoding Options->Encoding->Audio format" to "mp3"
4. enable "Audio->Audio Encoding Options->Encoding->LAME"
5. enable "Audio->Audio Encoding Options->Encoding->Keep input sample rate
6. load the video
7. enabled "Main->Generate"
8. pressed "Main->Add to Queue"
9. checked the generated job,...
-> everything looks fine, audio gets reencoded, so my guess is: you did change to 'auto add (first)' before, but configured the settings it should use, after loading the source,...

auto add (first): enables the Audio-tab, but automatically adds the first input audio stream from the input file to the audi job queue with the settings defined in the Audio-tab.
side notes:
- You can still add additional audio streams in the Audio-tab.)
- Setting will not adjust to changes regarding the audio format after loading the source!source: the 'audio handling'-tooltip

Cu Selur

[Brazil2]

Hybrid rev. 2012.08.29.1
"/sites/default/files/hybrid_downloads/Hybrid_120829_binary.zip" could not be found.

That's the QT 4.7 32-bit build ;)

[Selur]

fixed -> seem like I forgot to upload it :)

[pintcat]

I hope you didn't do the following:
- load your source with audio set to 'ignore'
- set audio to auto add (first) (this adds the audio with the currently configured settings; as default 'passthrough' to the audio queue)
- change audio settings but not the audio queue (this way the settings have changed but the audio queue hasn't)

Bingo! So in the end all was my fault again :) Now it works as it should.
In the meantime I encountered a few more oddities, but I'll have have to do more testing first and see whether I did something stupid or what else causes the program to fail.
Thanx for the nice support so far!

[Selur]

remember: if you describe in a step-by-step manor what you are doing, it's easier to reproduce and 'fix' if it's a bug. ;)

[pintcat]

Two questions...

1: I'm using my own ffmpeg build. To keep the file size small, I disabled all the additional encoders and some other stuff. Anyway, are there any optional ffmpeg-components that are needed or at least suggested for usage with Hybrid?

2: Regarding the absolute paths for the tools... After adding a tool to the list the complete path is saved (i.e. "/home/usr/hybrid/tools/x264"). I'd prefer a more portable way so I can copy the whole folder to other systems. I tried to change the path to "~/hybrid/tools/x264" in the xml file, but it didn't work. Is there another way to make copying easier?

[Selur]

regarding 1: Hybrid uses ffmpeg a. analyzing (default svn/git should be fine), b. audio/video decoding (default svn/git should be fine, if it can handle your content), c. thumbnail creation (default svn/git should be fine), d. audio encoding (vorbis/libmp3/libfaac/libvo_aacenc/flac support should be added if you want to use it)
regarding 2: on linux&mac Hybrid will look for the tools in the following folders:

next to the hybrid binary
/usr/bin
/usr/sbin
/usr/local/bin
/opt/local/bin
/opt/local/sbin
/usr/X11/bin

If you want a portable version for linux simply copy the tools next to the Hybrid binary and Hybrid should find them. (if users want it I could add an additional option to the misc.ini that would allow to set an additional 'tools'-search path)

Side notes:

tool paths&versions get updated&checked on each start. Hybrid does not support the 'hinting' of an additional 'tools folder' and does not support relative paths.
manually editing one of Hybrids xml files is always a bad idea


Cu Selur

[pintcat]

Hm... Hybrid doesn't seem to make use of ffmpeg as audio encoder. I now compiled ffmpeg with '--enable-libmp3lame --enable-libfaac --enable-libvorbis --enable-libvo_aacenc', put that binary next to my other tools, removed faac, lame and oggenc and restarted Hybrid. ffmpeg was found, the other audio encoders were removed from the list and - voilà - there's no way to use aac, lame or ogg any more. Not really a problem since I still have all the binaries, just tried it out of curiosity.

[Selur]

the 'lame' checkbox get's removed as soon as there's no lame binary available, Hybrid will still use lame for mp3 encoding if ffmpeg supports it.
aac support and vorbis support should not get removed,.. will look into it,..

[pintcat]

They're not removed, but yet they don't work since Hybrid still wants to use the original binaries instead of ffmpeg.

[Selur]

Which binaries did you remove?

[pintcat]

lame, oggenc and all aac encoders (neroaac & faac).

[Selur]

okay, and neither mp3, vorbis nor aac encoding does work?
(at least vorbis should,...)

-> please, create a debug output of the job creation

+ which version of Hybrid do you use (linux 32/64bit)?

[pintcat]

aac support is completely gone, lame 'can't be found by mencoder', so doesn't even add audio encoding to the job list, ogg-vorbis is added, but doesn't work/quits due to the missing oggenc binary. Bug report (pastebin this time ;) ): http://pastebin.com/Lwct8QmV

[Selur]

Ah, found the problem,.. will fix and send you a binary via pm,..

[pintcat]

Nicccce! I'm using the Linux 32bit version for QT4.6.

[meshaun]

New MKVToolnix version got released.

[Selur]

will add it to the next release, other than that nothing more to do for me since none of the command line switches have changed,.. (btw. there's a new mencoder/mplayer build over at http://www.spirton.com/mplayer-mencoder-subjunk-build/ that fixes a few bugs, i.e. one that caused Hybrid to sometimes not detect lpcm audio streams)

Cu Selur

[Selur]

Hybrid rev. 2012.09.09.1

*fixed*

audio: ffmpeg->sox->ffmpeg problem (happend during audio encoding through ffmpeg)
audio: audio pcm vs. wav extension problem
audio: if lame/oggenc/faac were missing, Hybrid didn't always switch to ffmpeg during job creation
avisynth: tresh bei sRestore, had wrong value ranges
avisynth: basic sRestore-Support (remember to update the avisynthExtension)
cut: some cut-support related problems
filter: framecount: didn't adjust frame count due to deinterlacing&co
input: chapter selection vs. start/end time problem
thumb: undid some changes from last time,..
audio: adjusted Hybrid to handle completely silent audio streams (crashed since normalization&autogain didn't work)

*added*

audio: support for fdk-aac, due to license issues this is only useful for people who compile their own ffmpeg version with fdk-aac support
audio: 'dynamic range compression'-option, thanks to tebasuna51 who implemented some profiles for BeHappy which I now integrated into Hybrids sox options.
avisynth: TemporalDegrain as grainHandling option
avisynth: option to move deblocking before the deinterlacing block if an avisynth deinterlacer is used
avisynth: 'Show avisynth script'-button some one can have a look at the avisynth script Hybrid generates.
misc: additional paths to search for tools by specifying 'toolPaths' in the misc.ini

*changed*

audio: communication between sox and ffmpeg will now be done using the sox format (otherwise sox->ffmpeg seems to make problems on some sources)
audio: added '--threading' to qaac calls
audio: by default set 'Multithreading for sox' to be enabled
analyse: ignore mplayer video ids of typ png/mjpeg if input is an mp4/mov file; otherwise cover art get's interpreted as video stream
cut: adjust cut start/end times when chapter selection changed
audio: removed unneeded addional '--multi-threaded' in sox call if multithreading is enabled (cosmetics only)
infos: video 'SpeedUp' value not displayed (cosmetics only)

-> downloads: http://www.selur.de/downloads

Cu Selur

[Selur]

Hybrid rev. 2012.09.21.1

*fixed*

input: handling of wmv input
input: autocrop problem with some sources (cropped to much)
input: dvd subtitle passthrough
crop: crop limits were ignored
crop/resize: Maximize resolution/letterbox problems
filter: 'Scale output fram rate' was not always interpreted properly
decode: ffmpeg crop call used a wrong order (unbelievable how long this bug survived ;))
audio: missing mkvmerge path in Audio-tab, causes an error when a mkv file was opened in the Audio-tab
audio: unwanted audio streams in queue bug
audio: ffmpeg->sox->ffmpeg problem (happend during audio encoding through ffmpeg)
audio: respect downMix&DRC during autogain/normalize analysis
audio: drc + gain/norm
audio: communication between sox and ffmpeg will now be done using the sox format (otherwise sox->ffmpeg seems to make problems on some sources)
audio: trueHD 5.1 extraction problem,...

*added*

audio: opus encoding support (requires opusenc and supports only raw-output)
audio: additional options for the audio 'gain'-option
resize/crop: "Crop/Resize->misc->Misc->Limit resize to crop resolution": restricts the resize resolution to be always less or equal to the input resolution and thus hinders any upscaling
input: option to set a minimum length for DVD titles for Hybrid not to ignore them

*changed*

general: make sure audio/subtitle/chapter queue are emptied whenever 'Input File' is clicked
audio: switching to ffmpegs aac encoder if libvo_aacenc is selected but more than 2 channels are present (libvo_aacenc) seems only to support mono and stereo output
audio: added w64 to the raw audio extensions
audio: multichannel audio will now be exported as a w64 wave file

-> downloads: http://www.selur.de/downloads

side note: I also updated the avisynthExtension.7z

Cu Selur

[pintcat]

Thanx for the update. There's this small glitch at the top left corner of the GUI (Linux Debian 32 bit, QT 4.6)

http://img6.imagebanana.com/img/1m8w1yz8/hybrid.png (http://www.imagebanana.com/)

[Selur]

argh, fixed that, but seems like I never committed it. :) (that's the separate log window that appears if you press F10)
it should be gone if you press F10 and then close the window that appears. :)

[Selur]

Hybrid rev. 2012.10.16.1

*fixed*

audio: if lame/oggenc/faac were missing, Hybrid didn't always switch to ffmpeg during job creation
cosmetics: F10-log showing in left corner on linux&mac systems was broken
video: calculation of maxLevel (4.0 wasn't identified as 4)
avisynth: fft3dgpu needs SetMode(5)
x264: when '--aq-mode 2' was selected '--aq-strength' got ignored,..
job: 'on queue finished' 'call external', allows to specify a command call Hybrid will execute once the queue is finished
config: device root wasn't accepted as valid path
audio: during batch processing audio queue was cleared to early
mkv: option to extract&passthrough attachements
input: auto routines aborted if an raw audio stream was present
input: DivX3.x was falsely detected as MPEG-4 (and it isn't mpeg-4 asp compatible)
input: mp4 vfr handling (mp4fpsmod update)
x264: making sure that only on 32bit systems avisynth scripts can be directly opened through x264

*added*

mkv: options to use '--engage no_simpleblocks' and '--disable-lacing'
crop/resize: option to select old 'autoCrop behavior' and to specify the number sections to be scanned by new behavior
avisynth: option to specifiy order for qtgmc input

*changed*

autocrop: change autocrop calls for some input files
crop/resize: moved AutoCrop options to 'Crop/Resize->Misc'-subtab
preview: added '-nocache' to mplayer call (fixes some avsynch issues with mkv files during preview)
cosmetics: making sure long profile names to not influence the gui width
input: removed *.m4v as raw video extension, since ipod m4v is more frequent than raw mpeg-4 asp streams
thumbnails: resize thumbnail for anamorph output
map MPA2L3 to mp3
changed a lot of internals to better handle non-ANSI based filenames


-> downloads: http://www.selur.de/downloads


Cu Selur

ps.: Mac update will come some later, having some problems building the dependencies,...

[pintcat]

Bug report: Hybrid generates a faulty (or at least incomplete) command line for the XviD encoder. Example:
"/usr/bin/mencoder" -lavdopts threads=4 -ovc xvid -xvidencopts pass=1:turbo:bitrate=1100:profile=dxnhtpal:me_quality=6:quant_type=h263:lumi_mask:min_iquant=1:
max_iquant=31:min_pquant=1:max_pquant=31:min_bquant=1:max_bquant=31:max_key_interval=250:keyframe_boost=10:kfthreshold=1:kfreduction=20:quant_type=h263:lumi_mask:
max_bframes=1:bquant_ratio=150:bquant_offset=100:bf_threshold=0:vhq=4:bvhq=1:curve_compression_high=0:curve_compression_low=0:overflow_control_strength=10:
max_overflow_improvement=10:max_overflow_degradation=10:trellis:noqpel:nogmc:nocartoon:chroma_opt:chroma_me:nointerlacing:par=ext:par_width=1:par_height=1:closed_gop:
nopacked:threads=4 -passlogfile /tmp/test video_10_08_59_961_05.stats -noskip -demuxer lavf -vfm ffmpeg -vf scale=720:336,pp=deringing,scale,format=i420 -sws 2
-forcedsubsonly -nosub -nosound -mc 0 "/media/sda6/home/pintcat/test video" -o /dev/null
...would not work, because the stats file name contains a space and thus cannot be produced/found. It should have to be put in quotes like the the output file name. Of course you can avoid this by not using spaces in file names ;)

[Selur]

will fix, can send you a fixed version if you tell me which linux/mac version you use

[pintcat]

Thanx for that :) I'm still using Linux with QT 4.6

[Selur]

32 or 64bit?

[pintcat]

32bit, forgot to mention.

[Selur]

I'm only logging in remote to my linux machine via ssh, so send me some feedback if the problem is fixed. (send you a link to a hopefully fixed version)

[digitall.h]

Thank you Selur for programming this useful tool. I find it very intuitive, helpful, comprehensive and well done. Congratulations.

I'm on Linux Mint KDE 13.
I have Hybrid 2012.10.16.1 installed (and running right now!).
I installed almost every tool needed by Hybrid, except mkv* tools (I don't plan to use mkv by now), Windows things (avisynth, I hope some day avxsynth...), and few other tools.
The mplayer version installed in Mint is mplayer2.

When I use DVD input, and go to Filtering tab, under Denoise/Sharpen/... I have all filters greyed out but Gradfun.
I cannot activate any filter.
I read that filtering is done by mencoder, so I think this problem is not related to mplayer version (I preferred not to uninstall it since it came with the distro, and I don't know if it will break things).
I read the thread, and searched the forums, and I didn't find any clue.

Can you please give me some suggestion?.

[Selur]

I cannot activate any filter.
probably because mplayer and mencoder are missing, this happens if Hybrid thinks it can only use ffmpeg,..

The mplayer version installed in Mint is mplayer2.
okay,... not sure if mplayer2 supports everything mplayer&mencoder did nowadays, I know it didn't so so half a year ago,..
The MEncoder codebase was thoroughly rotten and has been deleted. A different solution to provide some encoding functionality will be added in a future version.
source: http://www.mplayer2.org/differences/#differences
so there's probably still some stuff missing,..

-> Since mplayer2 and mplayer should be quite different, I see no harm in installing mplayer&mencoder additionally to mplayer2. (you normally should not have to deinstall mplayer2 to use mplayer&mencoder)

Cu Selur

[digitall.h]

Thanx for your fast answer.

probably because mplayer and mencoder are missing, this happens if Hybrid thinks it can only use ffmpeg,..
They both are installed, indeed: mencoder, and mplayer2.

-> Since mplayer2 and mplayer should be quite different, I see no harm in installing mplayer&mencoder additionally to mplayer2. (you normally should not have to deinstall mplayer2 to use mplayer&mencoder)
But when I select mplayer in synaptic, it marks mplayer2 to uninstall it...
I'm afraid about uninstalling mplayer2, will it be advisable?. :confused:


Meanwhile, I finished first encode. And after 6 hours (not bad) it aborted when muxing (MP4Box) with an exitCode1. :eek:
I keep the streams. Audio stream plays well. Chapters look good (don't know if in the right format...) in Kate. Cannot play the *.264 stream in VLC or Xine or Kaffeine, but it opens well in MediaInfo (and seems correct) and in tsMuxerGUI.
Can I get more info about the origin of the error?. And how can I solve it?.

[Selur]

Can I get more info about the origin of the error?. And how can I solve it?.
Sure, if you enable the DebugOutput a DebugOutput file should get created which should contain more infos. Other than that I can't really say much about the problem without more details.

[jouchan]

hi selur..:D
how to change resolution (automatic resize?)?
ex: i have video, 1280x720 (720p) then i want to change to 480p with automatic resize

[Selur]

how to change resolution (automatic resize?)?
ex: i have video, 1280x720 (720p) then i want to change to 480p with automatic resize

enable Crop/Resize->Enable resizing
set target width to 720 by setting to Crop/Resize->Picture Resize->Target resolution->720 (height should be grayed out since "Auto adjust" is set to "Height")
activate letterbox by enabling "Crop/Resize->Add borders to fit size" and setting: "Crop/Resize->Letterbox->Width" to 720 and "Crop/Resize->Letterbox->Height" to 480
make sure, "Crop/Resize->Misc->Keep resize for new source" is enabled (which is the default value)

[digitall.h]

Hi Selur,
I redid the encode, with the same result and exitCode1.

I had enabled Create debug file, level:1, is this what you suggested by with 'enable DebugOutput'?.
Where is the debug file stored?. I cannot find it.

[Selur]

Where is the debug file stored?. I cannot find it.
should be next to your output file

I had enabled Create debug file, level:1, is this what you suggested by with 'enable DebugOutput'?.
depending on what DebugLevel you choose more/less data will be visible normally level 1 or 2 is enough,...

[digitall.h]

I cannot find the debug file! :mad:
I searched in output (where streams are, in /tmp), in /home, in the folder where the DVD files are, in ~/.hybrid,... No debug file.

To get some information I tried the hybrid job command in the command line:
"/usr/bin/MP4Box" -add "/tmp/gand_15_53_21_451_04.264"#video:fps=25:par=16/15:delay=80 -brand avc1 -add "/tmp/gand ms_fr_aid_128__15_53_21_451_02.ac3"#audio -tmp "/tmp" -new "/home/ximo/Gandahar/Gandahar.mp4"
I just put video and audio, and no chapters or subs, to identify the error.
With that code I get the following error:
Error importing /tmp/gand_15_53_21_451_04.264#video:fps=25:par=16/15:delay=80: I/O Error
Does this help?.