Hybrid: Input -> x264/x265/Xvid/VP8/VP9

[Selur]

a. for Xvid the effect of mod8/16/32 is there, but normally not really a problem
b. for x264 it's not really worth mentioning :)

---------------

checked the acceleration setting, I explicitly set it for each spinbox, but for some reason it doesn't work, seems like I added some stuff that interferes with it,.. (-> going bug hunting ;))

[aleacido]

im an italian lazy...press twice a button is just a labor :)
Hi
alex
Ps: im gonna follow development of you excellent sw (im using it with much satisfaction).

[Selur]

press the up/down key on you keyboard, there the acceleration works ;)

[aleacido]

I tried the hybrid sperimental cut video option on a h264 mts (original untouched hdtv stream). first time hibryd showed warning about "cannot cut cause tsmuxer audio limitation", another test just aborted after audio extraction cause risulted a 0 bytes file. Looking at tsmuxer option, i think possible solution is that hybrid creates a cutted non encoded not demuxed temp file via tsmuxer cut option commandline (i tried final m2ts filetype with no problem, could be a conventional temp file like in sox caching) , wich can be only after demuxed always by tsmuxer demux commanline (no more cut option, avoiding tsmuxer bugs) and encoded by hybrid's ffmpeg encoder,(now hybrid try to extract,demux encode and cut at the same time. Just an idea to bypass tsmuxer cut known bug...maybe wrong
included debug file
Hi
Alex
Ps, or is a problem with dec-enc mpa audio files?
i had the idea cause i manually do the same with multiavchd. If i try to cut and encode ,most of times tsmuxer (and multiavchd) crashes, if i first create a cutted avchd without reencoding, and after i encode it, it works.

[Selur]

Personally I normally do the following for cutting, if it's progressive H.264 content:

remux the content to mkv (simple drag&drop the content into mmg, which is part of mkvtoolnix)
try to cut it with MKV Cutter (http://forum.selur.de/topic220-mkv-cutter-tool-to-cut-h264-mkv-files-frame-accurate.html) or Hybrids cut support
if the cutting worked, I remux the content to m2ts/mp4/... with Hybrid
if the cutting doesn't work I look into one of the tools which is explicitly made for cutting content

also a side note about captured HDTV streams: they still might contains errors, which Hybrid can't fix, which is why most people use a software like Cypheros TS-Doctor (http://www.cypheros.de/tsdoctor_e.html) to cut transport streams


for MPEG-2 content, I always run the stream through (simply start, drag&drop the content and press 'Quick Start') and then feed the content to [url=http://www.cuttermaran.de/en/download.aspx]Cuttermaran (]ProjectX[/url) for cutting.



--------------

The problem with the cut option is that tsmuxer simply ignores the start of the cut.
also remember: "please post the HybridDebugOutput.txt to pastebin.org or another side where I can access it" it's kind of a pain to recheck every few hours to see if the attachment got approved by a moderator

to work around the cutting problem with tsMuxeR, Hybrid would need to do two cut the stream two times, which is can't do atm. (it is planned, but I haven't would the time to implement it into Hybrid)
(you would still have problems with streams that Hybrid can't properly decode due to stream errors, which are not uncommon on HDTV captures)

Cu Selur

[Music Fan]

why most people use a software like Cypheros TS-Doctor to cut transport streams for MPEG-2 content, I always run the stream through ProjectX (simply start, drag&drop the content and press 'Quick Start') and then feed the content to Cuttermaran for cutting.
I read (in a message from a guy who tested most of cutting tools) that the best tool to cut interlaced AVC was currently TMPGEnc MPEG Smart Renderer 4, better than TS Doctor and Video ReDo which create some glitches on cut GOP.

[Selur]

good to know. :)

[misagh72]

hi Selur

2-pass good work

2nd pass crashed !!!

raw [info]: 1280x720p 0:0 @ 2997/125 fps (cfr)
x264 [info]: using cpu capabilities: MMX2 SSE2Fast SSSE3 Cache64 SlowShuffle
-> 22_44_58_4410_01_video crashed:main send out an error: QProcess::Crashed
finished after 00:00:00.094 with exitCode -1
-> 22_44_58_4410_01_video crashed:Crash: 1

[Selur]

@misagh72 -> http://forum.selur.de/topic8-infos-needed-to-fixreproduce-bugs.html

[misagh72]

@misagh72 -> http://forum.selur.de/topic8-infos-needed-to-fixreproduce-bugs.html

thanks

[Selur]

a. Report doesn't help me
b. please do not attach stuff here, I always have to wait till a moderator approves the attachment, since rechecking every few minutes/hours is a pain I probably forget about the problem. -> use pastebin.org, upload the stuff somewhere and send me a link or send it to me via email

[Selur]

Okay, got the DebugOutput and judging from the DebugOutput you started the 2nd pass without running the first pass first, or without specifying the stats file, which is why x264 aborts with: "[error]: ratecontrol_init: can't open stats file".
"C:\Users\MISAAGH\AppData\Local\Temp\asdd.stats" doesn't exist.

Cu Selur

[aleacido]

thank you so much for cutting infos.
hi
alex

[digitall.h]

Hi selur,
I'm using Hybrid 2013.04.16.1 Linux 64bit version in a Linux Mint 12 KDE desktop.
I came across two small glitches, that happened in some previous versions, you then fixed them, but they are back again ;)

When I try to encode a BluRay, the temporal files created by TSmuxer (xxxx.mux and xxxx.264) are stored in OUTPUT path and not in TEMP path.
The mencoder call generated by Hybrid targets as input to the output file xxxxx_07.264 and not the input file xxxxx_02.264. If I change this in command, it encodes correctly

I did not attach a debug since I overwrote it and I think the explanation may be enough... or not. :o
Thank you for keep developing this really nice tool :)

[Selur]

Strange, thought at least problem one was fixed,... will look at it.
What mencoder call? Meaning: What to you do?
If I feed Hybrid a Blu-ray all mencoder calls point to .m2ts files.

-> Tried an hour to replicate the problem, but I can't reproduce it. It would help if you could explain (in more detail) what you are doing.

[digitall.h]

I'm sorry you spent an hour because my explanation was incomplete.
What I did was load a BluRay playlist and select the mainmovie mpls.
I selected english subtitle stream and extracted/added it.
I then select x264 as video output, adjusted x264 settings, adjusted cropping, resizing, and filter (hqdn3d with low settings).
I adjusted audio encoding settings and added 2 audio streams.
I added chapters.
I wrote a name for the generated mp4 and added a job.
I start queue and Hybrid run audio demuxing with TSmuxer, and encoding with aften. It then demuxed video and created a qp file. And then it crashed at enciding time, generating an output.264 with 0 bit. I opened DebugOutput, took the mencoder | x264 call generated by Hybrid and run it in terminal: it exited without generating a file or error. I then removed --really-quiet from mencoder Hybrid call, run it again, and mencoder complained there was no xxxx_02.264 file.
The question is the file generated by Hybrid after demuxing video stream and renaming it was called xxxx_07.264 and not xxxx_02.264 When I changed in the call the mencoder input to xxxx_07.264, and run in terminal, it encoded well.

I hope I explained it better now.

[Selur]

Yes, but it would still help to get a DebugOutput. ;) Since that your allow me to see which program paths were taken.

[digitall.h]

selur,
you've got a mail ;)

[Selur]

Strange, nothing in my inbox,..

[digitall.h]

Strange, nothing in my inbox,..

Try again...

[Selur]

got, it will look at it tomorrow morning, on my way to bed atm. ;)

[Selur]

Hybrid rev 2013.05.14.1:

*changed*

avisynth: cleanup, delete DGIndex, DGIndexNV .log files
crop: clear crop-cache when min width/height mult changes
extract: use mencoder/mplayer to extract wav audio from avi
output: file name generation adds _new if output already exists
subtitle: subtitle input changing input folder depending of something was extracted from current source or not
x264: set profile to High4:4:4 and output color space to i444 if lossless encoding is enabled
x264: set output color space to i420 if lossless encoding get's disabled

*added*

audio: option to disable auto delaycut when muxing to mp4
audio: option to choose whether 16bit or 32bit flac files should be created
avisynth: anti-aliasing through EdgeSmoothFast
avisynth: DeGrainMedian
avisynth: Deen + option to denoise before deinterlacing
avisynth: EdgeCleaner
avisynth: toon filter
cosmetics: hide/show columns in Job tab (+Model remembers visibility)
cosmetics: start/end time in Job tab (+Model remembers header order)
filtering: additional suboptions for the ivtc options
jobs: cosmetics, show start/end time in job view
jobs: cosmetics, columns can now be shown/hidden
misc.ini: added support to set global profile through cli and misc.ini
profile: option to save profile under currently selected name
x264: option to minimize AVC level based on mbps (macoblocks per second) and bitrate

*fixed*

audio: delaycut version detection on Win8
audio: output of lame wasn't checked for existence
audio: lame min audio quality value is 0 not 1
analyse: added "--Language=en" to MediaInfo, to make sure it's output is english
avisynth: don't try to use l-smash-source or DgNVDec if AVC High 10 or higher is used
avisynth: TDeint&DGDecNV bobbing not triggering frame rate change calculation
avisynth: DGDecNV, fft3dgpu, tdeint tooltip infos
avisynth: setting of tfms external deinterlacer
calc: fhg + cbr audio size calculation
filter: postprocessing was called before gradfun, needs to be the other way around
input: blu-ray input where multiple files are connected through a playlist
input: dvd title detection problem
input: problem with .mpls with single audio stream
muxing: avi muxing, 1:1 aspect problem
muxing: switched to mencoder as .avi muxer for single audio files, since ffmpeg can't handle audio delays properly, see: avi multiplexing through ffmpeg (http://forum.selur.de/post3080.html)
output: Mpeg-4 asp .avi muxing
tooltips: not showing in tooltip side bar for some tabs
x264: qpmax = 51 + (depth - 8) + 18
x264: command line import did ignore psy settings (trellis, psy-rd)
x264: a bunch of updates didn't make it to the model :/
x264: ignore '--opencl' if rc-lookahead is 0 or curveCompression is 1
x264: command line import did ignore psy settings (trellis, psy-rd)


-> downloads: http://www.selur.de/downloads

Cu Selur

[digitall.h]

Great!!
A new toy to play with. :D
Thank you for the improvements.

BTW, I see you very active in the Vapoursynth thread, doing tests under Linux...
Do you see in the future the possibility to add Vapoursynth to Hybrid, for cropping, filtering,...?
It would be fantastic and I think a great improvement.

Best

[Selur]

Hybrid rev 2013.05.15:

*fixed*

input: grabbing ffmpeg id from m2ts files
input: mbaff accidently identified as progressive
interface: toolTip side bar did not get updates for Main-Tab

*added*

cli: added '-autoAdd' parameter with 'add' and 'addAndStart' as options

*changed*

output: disabled 'Add Titleinfo' and 'Add Chapterinfo' by default (Config->Output->Filename Generation->Output Filename Generation)


-> downloads: http://www.selur.de/downloads

Do you see in the future the possibility to add Vapoursynth to Hybrid, for cropping, filtering,...?
It would be fantastic and I think a great improvement.
probably, but atm. I'm running into a bunch of problems and lacking the time to look into it.

Cu Selur

[Brazil2]

* These are not portable packages unless they contain a special modified misc.ini file.
Could you please give more information about the correct way to do it ?

[Selur]

-> see *hidden* Hybrid options,... (http://forum.selur.de/topic33-hidden-hybrid-options.html) under 'make Hybrid portable (Windows only)'

[Brazil2]

Thanks! :)

[Selur]

Hybrid rev 2013.05.22.1:

*changed*

general: max resolution from 4098x4098 to 8196x8196
ProRes: ProRes encoder names changed on 11th of April 2013 -> adjusting calls
see: http://lists.mplayerhq.hu/pipermail/ffmpeg-cvslog/2013-April/063306.html

*added*

tagging: option to decide whether the first or second language acronym will be used during tagging

*fixed*

audio: fixed rounding error during decimal -> fraction conversion
avisynth: DGDecNV deinterlacing wasn't offered for avc content (typo)
cut: audio cutting on reencode
extract: video extraction preferred ffmpeg instead of mkvextract (which should be the default)
input: auto load audio
internal: threading bug during getToolVersion (linear now)
output: tagging of raw streams that get muxed to m2ts
output: extracting raw streams from m2ts files
output: m2ts language tagging
output: m2ts aspect ratio overwriting on passthrough
output: mp4 muxing with timecodes during passthrough
resize: cosmetics, 'Picture Resize' was inaccessible when 'Convert output to PAR' was enabled


-> downloads: http://www.selur.de/downloads

Cu Selur

[Music Fan]

Thanks for your work.

Hybrid rev 2013.05.15:

*fixed*

input: mbaff accidently identified as progressive

Which filter do you use to open interlaced h264 ?
As you said to me in mp about MKVcutter, ffmpegsource has problems with interlaced h264.

[Selur]

Depends on you general settings, in example if DGDecNV is available that will be used, other than that ffmpegsource2 or L-SlashSource, mbaff normally works paff make problems iirc.

[digitall.h]

Hi selur,
with last Hybrid 2013.05.22.1 Linux 64bit version, when I add a job to queue it complains at audio job generation:
Log Messages
...
Creating jobs for 1 sources,...
-> Creating jobs for source 1,...
-> Generating calls for: /home/ximo/Vídeos/Hybrid/Output/El_vuelo.mp4
createJobs for /home/ximo/Vídeos/Hybrid/Output/El_vuelo.mp4
createJob audio...
found not tag for /media/INTERCAMBIO/TMP/iId_1_aid_128_lang_es_08_30_29_2110_02.ac3, iID :
Audio;Español 5.1;es;/home/ximo/Torrents/El vuelo/VIDEO_TS;128;ac3;6;passthrough;448;;;48000;;es;-80;7975.32;ac3;0;;don't change;;false;;false;3;false;;;;false;true;true;;false;48000;unknown;false;;true;true;false;;1/1;;;;01;None;;;;;;16;;;;false;1;;;;;;;;;;
Added new job with id 08_30_29_2110
...
Hybrid finishes the job, but audio tag is wrong.
Send you a mail with DebugOutput.
Best
;)

[Selur]

will look at it :)

[Selur]

Hybrid rev 2013.06.03.1:

*changed*

avisynth: also adding RequestLinear(..) for DGMPGDec not jsut DGDecNV
avisynth: SalFPS3, resize to mod8 for widht&height if input is not mod8 for width and height
avisynth: use Preroll(100) instead of RequestLinear(rlim=50,clim=50), to lower RAM usage
cosmetics: show location of settings and font folder in the Path-subtab
audio: make sure mencoder/mplayer is used for .ifo input (NOT RECOMMEND)
extract: use ffmpeg for Blu-ray stream extraction if ffmpeg supports libbluray and 'Stream extraction with ffmpeg' is checked
resize: pixel aspect ratio changed on encoder selection
subs: creating 'internal' font folder for fontconfig integration and better hardcoding of subtitles
x264: when importing VBV values via command line import, 'Keep VBV values' automatically gets enabled

*added*

chapter: .txt added to accepted chapter extensions on import
chapter: added support for BSPlayer and SVD chapter format on import
cosmetics: donate button to main-tab
input: option to automatically extract embedded fonts from mkv files to an 'internal' font folder
jobs: option to automatically save the job list whenever a job is finished
muxing: option to always use ffmpeg instead of mencoder for avi muxing
muxing: option to set if the fourcc for mpeg-4 asp content inside an avi container should be XVID or DX50
subtitle: option to select which subtitles streams to process (using multiple languages instead of just one)

*fixed*

audio: cbr mp3 encoding calls
cut: when audio was handled through ffmpeg
extract: file extraction check on mp4 files
extract: tsmuxer subtitle extraction
input: of multiple blu-rays in a row
input: name generation with drag&drop and adjust output to input path
muxing: making sure the chapter have no ms info for tsMuxeR
muxing: use DAR instead of PAR when using '-aspect' with ffmpeg to create an .avi
subtitle: bug causing subtitle passthrough to fail
subtitle: subtitle extraction from transport streams with multiple '.' in their names
x264: switching between 8bit and 10bit didn't reset qpmax properly
x264: High 4:4:4 wasn't properly added to the command line

-> downloads: http://www.selur.de/downloads

Cu Selur

[Music Fan]

Depends on you general settings, in example if DGDecNV is available that will be used, other than that ffmpegsource2 or L-SlashSource, mbaff normally works paff make problems iirc.
L-Smash actually :)
Does it have the same probleme than ffmpegsource with paff ?

[Selur]

Before yes, but I haven't tested the latest version,..
VFR maniac stated:
By the way, does anyone have a PAFF H.264 sample?
I added supporting of H.264 field coded picture handling for LW-Libav part but I haven't tested on any sample containing both frame coded and field coded yet. see: http://forum.doom9.org/showthread.php?p=1630770#post1630770
because I lost my paff samples somewhere :/
-> if you test it please report

[Music Fan]

I analysed a few TS files recorded on several TV channels and for MediaInfo they are all interlaced TFF, I guess it's not PAFF.
But I had problems with these files in MKVCutter, so I guess ffmpegsource (which use libav) has problems with most of interlaced h264 files.
Does L-SMASH also use libav ? If yes, I guess I would have same problems.

[Selur]

L-SMASHSource and LibAvSource both use newer versions of libav than ffmpegsource.
-> so they might work

[digitall.h]

Hi selur,
thank you for a new and improved and fixed Hybrid 2013.06.03.1 version!.

I'm testing this last Linux 64bit version on my Linux Mint KDE 13 system.
First it complains that tsMuxer and DelayCut are missing, but they are installed and path is correct in Hybrid Config/Path tab.
:confused:
Second, when I loaded a DVD source with Russian and Deutsch audio tracks, it showed under Audio tab the audio information greyed out, and it does not allow to add any audio track.
:confused::confused: (probably related to not detecting DelayCut?)
I tried this same source with a previous Hybrid version and it loads the DVD correctly and adds the audio tracks.

Send you DebugOutput.

Best

[Selur]

"/usr/bin/mplayer" -v -msglevel identify=6 -vo null -ao null -frames 0 dvd://1 -dvd-device "/.../Molock Sokurov PQ/VIDEO_TS"
-> Found no AudioIDs for title 01 of 5
"/usr/bin/mplayer" -v -msglevel identify=6 -vo null -ao null -frames 0 dvd://2 -dvd-device "/.../Molock Sokurov PQ/VIDEO_TS"
-> Found the following audio ids:
128
129
"/usr/bin/mplayer" -v -msglevel identify=6 -vo null -ao null -frames 0 dvd://3 -dvd-device "/.../Molock Sokurov PQ/VIDEO_TS"
-> Found the following audio ids:
128
"/usr/bin/mplayer" -v -msglevel identify=6 -vo null -ao null -frames 0 dvd://4 -dvd-device "/.../Molock Sokurov PQ/VIDEO_TS"
->Found the following audio ids:
128
From the looks of it only the first Title has no audio stream
"/usr/bin/mplayer" -v -msglevel identify=6 -vo null -ao null -frames 0 dvd://5 -dvd-device "/.../Molock Sokurov PQ/VIDEO_TS"
-> Found no AudioIDs for title 05 of 5

Selecting another title should fix the problem,..

[digitall.h]

Hi selur,
The information showed seems to be wrong.
According to the info in Hybrid main tab, title 1 has a length of 2:02:56 and 14 chapter, and 2 audio streams (main movie).
Title 2 has no audio stream, 30 min long, and 4 chapters.
Title 3 has 1 audio, 40 min long, and 45 chapters.
Title 4 has no audio, is 7:48 min long and has 5 chapters.

And Hybrid 2013.04.16.1 shows it correctly.
So I don't think it's a problem of wrong selected title.
Tell me how can I help to find the problem.
:)

[Selur]

I have an idea where at least one of the problems is:
a. Hybrid doesn't recognize the format of 'ID_AUDIO_FORMAT=8192' (that I can fix)
b. mplayer reports:
ID_AUDIO_BITRATE=0
ID_AUDIO_RATE=0
ID_AUDIO_NCH=0
for each of the audio streams (that I can't)
-> will create a test version and send you a link by email, if that version doesn't help create a debug output level 8 with it of only the analysis of the dvd.

Will look at the debug output tomorrow. (nearly 1am here already)

[digitall.h]

Thanks a lot, for everything.

Do you think that a DebugOutput generated by the previous Hybrid 2013.04.16.1 version would be of a help?. This version seems to identify and select correctly the streams.

[Selur]

yes, but reset your Hybrid defaults before creating it

[digitall.h]

What Hybrid defaults?, every model?

[Selur]

Yes, Config->Defaults->Reset All

[Selur]

Hybrid rev 2013.06.08.1:

*changed*

audio: cosmetics, move audio profiles out of reencoding box
audio: "Stream extraction with ffmpeg" now also influences audio extraction from Blu-rays if ffmpeg support libbluray
avisynth: use LWLibavVideoSource for interlaced avc if DGSource is not supported
cut: improving cut sync on video passthrough by detecting key frames and only allow cut start at key frames
extract: cut on ffmpeg audio extraction
input: automatically switching to ffmpeg as extractor for audio&video streams from Blu-rays if ffmpeg support libbluray and tsMuxeR generated names would get too long
tools: ffmpeg libbluray detection
tools: ffmpeg version for mac now also comes with libbluray support
tools: check for flac in addition of just flaccl when on non-Windows systems

*added*

fonts: button to delete content (fonts only) of 'custom font folder'

*fixed*

extract: trueHD extraction using tsMuxeR (naming problem; extension needs to be .ac3 not .truehd)
gui: fixed some glitches with drop-down boxes on linux&mac
input: he-aac v2 audio channel count detection
muxing: muxing paff content with mkvmerge or MP4Box
subs: language got lost with tsMuxeR + 'all subtitles'
subs: batch processing
tools: checking of tools with custom path


-> downloads: http://www.selur.de/downloads

Cu Selur

[digitall.h]

Downloaded.
Working great!
:thanks:

[alter4]

I faced small issue, option "warn if config changed is enabled" and option "temp path to output path is enabled" then:
1) Start Hybrid, visually check field "default temp path" is grayed out and blank.
2) Import Blu-ray source from hdd in my case.
3) visually check field "default temp path" is grayed out but not blank (it has the same value as "default output path")
4) Now tries to close Hybrid, it warns about config changes i.e.defaultTempPath is different, but in fact it is not.

Other things work great for me, Thanks for excellent tool!

[Selur]

will look at it -> can't reproduce it :(
What does the warning windows exactly say. (ctrl+c, allows to copy the content)

[alter4]

Created log performing above mentioned actions. Might be it will help https://dl.dropboxusercontent.com/u/7307234/HybridDebugOutput.zip.
The warning window exactly says:
---------------------------
Info
---------------------------
Warning, current profile and default differ:

<HybridData value="F:\temp" name="defaultTempPath"/>
and
<HybridData name="defaultTempPath"/>
differ
---------------------------
OK
---------------------------

I will be unavailable next 2 weeks. Leave for vacation to back country trying to forget computers, сity avenues, Internet... :) So if this information is not enough will provide when return.