Hybrid: Input -> x264/x265/Xvid/VP8/VP9

[Andy o]

Hi, I'm trying out Hybrid, and I have a few questions regarding audio handling.

1. Is there a way to extract the DTS core from a DTS-HD source (blu-ray) without reencoding, and mux it to the output (I'm guessing no but asking just in case)?

2. I'm not sure if I'm doing something wrong on this. AAC encoding is taking a VERY long time. Source is the aforementioned 5.1 DTS-HD movie (about 1h40m worth). This is the relevant bit:
Starting Main@18:33:51.784:
"C:\PROGRA~1\Hybrid\ffmpeg.exe" -y -threads 8 -sample_fmt s32 -f sox -i - -c:a aac -strict -2 -b:a 1280k -ac 6 -ar 48000 "C:\Users\Andy\AppData\Local\Temp\iId_8_aid_4352_lang_eng_DELAY_-43ms_18_21_14_2710_02.aac"

As you can see the audio encoding from dts-aac started at 18:33. It is now 19:03 and it's only at 42%. It seems amazingly slow for audio encoding. I am on a desktop Core i7-4770 8GB 2133 RAM with a GTX 960.

3. Is the encoding being done from the lossless DTS-HD source, or from the DTS core meaning lossy-lossy transcoding?

Thanks for any guidance on this.

[Selur]

regarding 1.: enable "Audio->Misc->Handling->Automatic DTS-HD to DTS" before adding the audio jobs to the queue
regarding 2.: The call looks fine, but it's just the encoding call, without the decoding and filtering. Would need a debug output to say more.
regarding 3.: Probably the DTS-HD stream, but I would need to see a debug output of the processing or at least:
a. the audio extraction call
and
b. the audio decoding call which is used to feed the audio filtering call
to know for sure.
To be clear, I agree that it seems rather long.
(also ffmpeg is probably the worst and slowest aac encoder supported by Hybrid; read *hidden* Hybrid options,... (http://forum.selur.de/topic33-hidden-hybrid-options.html)->Additional aac encoders )
Also, why would you select such a high bitrate 1280k? Seems like a waste; 213 k per Channel, normally a total bitrate of ~320kbit/s for the whole aac stream should be fine.

Cu Selur

[locotus]

Hi Selur, just installed last version, 2015.12.23.1, and seems
that there is a regression in windows vista support.

[Selur]

will look into it,...

[Selur]

From the looks of it seems like I missed to include msvcp100.dll, other than that it seems to work fine, or are you having any other problems?

[locotus]

From the looks of it seems like I missed to include msvcp100.dll, other than that it seems to work fine, or are you having any other problems?

Oh, yes. Is crashing before opening. Giving this message
X265 message:

The procedure entry point GetNumaNodeProcessoMaskEx could not be located in dynamic link library KERNELL32.dll

Then windows report x265.exe stopped working.

And finally Hybrid didn't get to start.

[locotus]

Sorry, miss this one that was behing the other error window:

GetTool version got an emppty output for X265.
The cause maybe that X265 could not be found.
Please redo with debug output....

[Selur]

Ah, I added a x265 version with numa support. -> try whether the x265 version from my GoogleDrive (https://drive.google.com/folderview?id=0B_WxUS1XGCPASUZibG5XZkRfeTg&usp=sharing) resolves that.

[locotus]

Thanks Selur, that file solve the issue.

[DJ-1]

Hi, on some sources i get a video 1st pass crash...

video - x264 (default profile, also does it with crf set )
audio - passthrough all
All other Hybrid setting are default...

1st i used the installer version Hybrid v2015.12.23.1

source (if helpfull.(its a cut of the source as source was 1GB)) - https://www.dropbox.com/s/5e4trzriehasch3/2-4_cut.mpg?dl=0

Debug - https://www.dropbox.com/s/0yhejvo5ipgdyi8/Hybrid%20v2015.12.23.1.txt?dl=0



I also tried the test version you sent a while back, Hybrid v2016.01.17.1

debug - https://www.dropbox.com/s/26df52l0cmehn7d/Hybrid%202016.01.17.1.txt?dl=0

..both debugs show crashed:ERROR: K:\ENCODES\Hybrid\Temp\2-4_cut_15_15_51_8010_07.stats was not created! at start of the 1st pass x264

...also, if i rey x264 crf mode its a different crash.
debug - https://www.dropbox.com/s/uzflb1f25rc8njo/HybridDebugOutput%20%20crf.txt?dl=0
crashed:ERROR: K:\ENCODES\Hybrid\Temp\15_45_12_9610_07.264 is too small! (byteSize: 0byte)


Thanks.

[Selur]

Encoding call looks fine:
"C:\PROGRA~1\Hybrid\mencoder.exe" -lavdopts threads=8 -really-quiet -of rawvideo -o - -ovc raw -vf scale,format=i420 -forcedsubsonly -nosub -nosound -mc 0 "K:\ENCODES\Hybrid\Temp\encodingTempAvisynthSkript_15_15_51_8010.avs" | "C:\PROGRA~1\Hybrid\x264.exe" --preset superfast --pass 1 --bitrate 1500 --profile high --level 4.1 --direct auto --qcomp 0.5 --aq-mode 0 --sar 16:15 --non-deterministic --range tv --stats "K:\ENCODES\Hybrid\Temp\2-4_cut_15_15_51_8010_07.stats" --input-csp i420 --fps 25 --input-res 720x576 --output NUL -
Avisynth script looks fine too:
SetMemoryMax(768)
SetMTMode(2,8) # change MT mode
LoadPlugin("C:\Program Files\Hybrid\avisynthPlugins\LoadDll.dll")
LoadPlugin("C:\Program Files\Hybrid\avisynthPlugins\DGDecode.dll")
LoadPlugin("C:\Program Files\Hybrid\avisynthPlugins\AddGrainC.dll")
LoadPlugin("C:\Program Files\Hybrid\avisynthPlugins\dfttest.dll")
LoadPlugin("C:\Program Files\Hybrid\avisynthPlugins\DirectShowSource.dll")
LoadPlugin("C:\Program Files\Hybrid\avisynthPlugins\EEDI2.dll")
LoadPlugin("C:\Program Files\Hybrid\avisynthPlugins\eedi3.dll")
LoadPlugin("C:\Program Files\Hybrid\avisynthPlugins\FFT3DFilter.dll")
LoadPlugin("C:\Program Files\Hybrid\avisynthPlugins\mt_masktools-26.dll")
LoadPlugin("C:\Program Files\Hybrid\avisynthPlugins\mvtools2.dll")
LoadPlugin("C:\Program Files\Hybrid\avisynthPlugins\nnedi.dll")
LoadPlugin("C:\Program Files\Hybrid\avisynthPlugins\nnedi2.dll")
LoadPlugin("C:\Program Files\Hybrid\avisynthPlugins\nnedi3.dll")
LoadPlugin("C:\Program Files\Hybrid\avisynthPlugins\SSE2Tools.dll")
LoadPlugin("C:\Program Files\Hybrid\avisynthPlugins\TDeint.dll")
LoadPlugin("C:\Program Files\Hybrid\avisynthPlugins\VerticalCleanerSSE2.dll")
LoadPlugin("C:\Program Files\Hybrid\avisynthPlugins\RepairSSE2.dll")
LoadPlugin("C:\Program Files\Hybrid\avisynthPlugins\RemoveGrainSSE2.dll")
LoadCPlugin("C:\Program Files\Hybrid\avisynthPlugins\yadif.dll")
LoadDll("C:\Program Files\Hybrid\avisynthPlugins\fftw3.dll")
LoadDll("C:\Program Files\Hybrid\avisynthPlugins\libfftw3f-3.dll")
Import("C:\Program Files\Hybrid\avisynthPlugins\QTGMC-3.33.avsi")
# loading source: K:\SOURCE\Cuttermaran\2-4_cut.mpg
MPEG2Source(d2v="K:\ENCODES\Hybrid\Temp\15_15_51_8010.d2v")
# deinterlacing
AssumeTFF()
QTGMC(Preset="Fast", ediThreads=4)
SelectEven()
# filtering
return last

Does the avisynth preview work fine? Try if it helps to lower the number of ediThreads.

[DJ-1]

hi, yeah although on defaults i for that `filtering/deinterlace` defaults on Auto..

new test version= both encode fine...
x264 2pass debug - https://www.dropbox.com/s/w5ci9acwof66q9b/2016.02.06.1%20test%20v.HybridDebugOutput%20x264%202pass.txt?dl=0

x264 crf - https://www.dropbox.com/s/dpixdwkmweipn3v/2016.02.06.1%20test%20v.HybridDebugOutput%20x264%20crf.txt?dl=0

on startup it says about disabled avisynth support due to version differences..

[Selur]

on startup it says about disabled avisynth support due to version differences..
That means avisynth and thus QTGMC isn't used.
Did you copy the content of the avisynthPlugins folder into your avisynthPlugins folder?

[DJ-1]

no, didnt do anything with that avisynthplugins folder, its auto created upon install of hybrid, i just hit `reset defaults` when instal hybrid

just tried the older v2015.12.23.1 from the win installer,
it shows avisynth avs preview error "unable to load "....Hybrid/avisynthPlugins/eedi3.dll, module not found.

but eedi3.dll is in there..

[Selur]

Try:
1. deinstall Hybrid completely
2. install Hybrid
3. extract the test version I send you.
other than that, no clue, may be some missing runtime dll

[DJ-1]

Ok...completely uninstalled...re_installed from latest installer. Copied the test version you sent today (deleted the other 1 by mistake).

When launching the test version, Hybrid say avisynth extension detected is older than version expected...
Therefore i get no avisynth stuff listed in filtering/deint.., so i dont get that preview button.

(other option, "filter preview" woeks thoughh)

Sent from my LG-H815 using Tapatalk

[Selur]

Something is off, the Testversion I send you included:
a. a new Hybrid.exe
b. some updates for the avisynthPlugins-folder (one of them an updated version.txt)
-> did you by chance not extract the updates for the avisynthPlugins-folder ?

[DJ-1]

One msg was titled 'wrong os'(it had linux stuff in it, so ignored as i thought it was a mistake msg)... The other msg has only the hybrid binary. I only took the one with the binary.

I'll look at the other msg later and get the other stuff from it

Sent from my LG-H815 using Tapatalk

[Selur]

Now you mixed things up,.. the first one not titled 'wrong os' was a link to a linux version, and the second (titled 'wrong os' <- as note that I messed up with the first pm) one points to the current windows dev version. (just checked)

[DJ-1]

Lol...ok crossed wires, the windows test version i had earlier only had binary, nothing else if i remember right...will check..

Doh!..sorry extracted it on desktop when i got it, must have missed the extra folder[emoji20]

Sent from my LG-H815 using Tapatalk

[DJ-1]

ok, so i copied those few bit into avisynthPlugins folder in hybrid install DIR, i get the same thing of not being able to find eedi3 module...

thanks.

edit: theres a few bits that popup, about preview script valid, colourspace etc..

debug - https://www.dropbox.com/s/o64puj629jiap14/HybridDebugOutput%20avs%20errors.txt?dl=0

[Selur]

Looking at http://avisynth.nl/index.php/Eedi3 eedi3 needs the VS 2013 runtime, but normally the avisynthPlugins folder should contain the required files.
-> try if it helps to install the runtime, may be there is still some file missing.

[DJ-1]

hmmm, just installed both 32bit & 64bit versions of the 2013 Runtime, with exact same results

[DJ-1]

Hi, ok so i got it working now. It was M S Visual C...2012 Update 4 (i had 2012, but not the update 4 ).

just to confirm, same process and source etc.
Latest test version.
success:D
debug - https://www.dropbox.com/s/78y4sij4t42pit8/Success%20HybridDebugOutput.txt?dl=0


in also a debug of me just an avisynth-preview with QTGMC, it works, no eedi3 issues, but does throw up other preview errors..

https://www.dropbox.com/s/w8xovmzcj6uj4zq/preview%20error%20HybridDebugOutput.txt?dl=0

dont know how important they are?

thanks.

[Selur]

That's my mistake, those are not really errors, I accidentally send some output to std error instead of std output, you can exchange avsViewer with the verison from http://forum.selur.de/post11001.html#p11001 to fix that.

[DJ-1]

thanks.

[DJ-1]

Hi, Im looking at using QTGMC at running a test clip to compare results....
I need to resize too, but from what i can tell one of the best ones is either nnedi2 or nnedi3 (primaraly for deinterlacing, but can also do v good resizing upto power of 2).
Can hybrid use those methods to resize?, not listed under the 'crop-resize' tab.

Thansks.


Sent from my LG-H815 using Tapatalk

[Selur]

Special settings regarding Avisynth resizers are listed under: Filtering->Avisynth->Line->Resizer (last option is NNEDI3Resize)

[DJ-1]

Ok, and i assume i need to have 'allways use avisynth'?..these would automatically override any default listed options under the regular 'crop_resize' tab then?

Cheers.

Sent from my LG-H815 using Tapatalk

[Selur]

Yes, if "always use avisynth" is enabled and you enable the Resizer-option, it will always overwrite the resizer selection inside the Crop/Resize-tab.

[Music Fan]

Hi selur,
I have a question from someone who asked me how to join 2 chaptered mp4 files and keep chapters (and eventually change the container to get MKV, which is more common). Yamb and FFmpeg don't seem to be able to do this (or we didn't find how) thus I suggested him to try with Hybrid. But before to install it, he would like to know if Hybrid can do it. And as I don't have any chaptered mp4, I can't test myself.
The only thing he can do is to collect the chapters timecodes with FFmpeg and this command ;
ffmpeg -i input_video -f ffmetadata metadata.txt
And it looks like this ;
[CHAPTER]
TIMEBASE=1/2997
START=0
END=1022098
title=Beginning
[CHAPTER]
TIMEBASE=1/2997
START=1022098
END=1922698
title=Chapter 1
[CHAPTER]
TIMEBASE=1/2997
START=1922698
END=2861697
title=Chapter 2
[CHAPTER]
TIMEBASE=1/2997
START=2861697
END=3800696
title=Chapter 3
[CHAPTER]
TIMEBASE=1/2997
START=3800696
END=4833195
title=Chapter 4

Is there a way to convert it in MKV chapters format (or joining the 2 videos leaving it in mp4) without re-encoding with Hybrid ?
Thanks ;)

[Selur]

Hybrid can remux mp4 to mkv without any problems (and keep the chapters).
Hybrid can't merge two files.
But it's probably easier to use mkvmerge gui directly, iirc. mkvmerges append supports to append input mp4s and keep and append their chapters. (long time since I did something like that, but as far as I remember it should work)

Looking at the chapter format, I think Hybrid doesn't support the timebase parameter in the chapter format. (but if you have an mp4 file with chapters Hybrid can import that and convert it to mkv)

[Selur]

Hybrid rev 2016.02.13.1:

*fixed*

qsvenc: problem reading the features from latest qsvenv properly (Windows only)
timecode: don't set UTF-8 BOM in time code files, for compatibility
handling: frame rate adjustments not always kept during batch processing

*changed*

decode: prefer ffmpeg when output is forced to cfr
cuda: added support for some additional cards

-> downloads: http://www.selur.de/downloads

Cu Selur

Ps.: Dropped, Linux Qt 4.8 support since even my old Ubuntu 12.04 support Qt5 nowadays. If someone needs Qt4 build contact me the forum.

[DJ-1]

Hybrid rev 2016.02.13.1:

*fixed*

qsvenc: problem reading the features from latest qsvenv properly (Windows only)
timecode: don't set UTF-8 BOM in time code files, for compatibility
handling: frame rate adjustments not always kept during batch processing

*changed*

decode: prefer ffmpeg when output is forced to cfr
cuda: added support for some additional cards

-> downloads: http://www.selur.de/downloads

Cu Selur

Ps.: Dropped, Linux Qt 4.8 support since even my old Ubuntu 12.04 support Qt5 nowadays. If someone needs Qt4 build contact me the forum.

`not found` when trying to get the latest Windows installer..

[Selur]

fixed, the typo in the url :)

[DJ-1]

fixed, the typo in the url :)

thanks,
just installed, resetting defaults aswell and i get msg with avisynth prewiew Avisynth preview error: Script error: MDegrain1 does not have a named argument "lsb"

i did try the other avsveiwer you linked me to a few days ago but with the same result.

https://www.dropbox.com/s/ps323wcu4xjkp8x/HybridDebugOutput.txt?dl=0


:thanks:

edit: QTGMC selected when previewing, other avisynth previews seem ok.

[Selur]

Argh, forgot to update the MVTools version, try if using the mvtools version from http://forum.doom9.org/showpost.php?p=1386559&postcount=3 helps.

[DJ-1]

Argh, forgot to update the MVTools version, try if using the mvtools version from http://forum.doom9.org/showpost.php?p=1386559&postcount=3 helps.

yeah i got > MVTools 2.6.0.5 < from that post, copied both the mvtools2 & avstp.dll files into avisynthPlugins DIR and is working ok now..

https://www.dropbox.com/s/ps323wcu4xjkp8x/HybridDebugOutput.txt?dl=0

I do still have the `alternate` avsViewer in place (originally thought may have been that) but i assume you updated that with the installer anyhow..

:thanks:

[Selur]

Yes, the installer should contain the newer avsViewer (I also re-uploaded the installer to make sure it now also contains the 2.6.0.5 mvtools version)

[DJ-1]

:thanks:

[Music Fan]

Hybrid can remux mp4 to mkv without any problems (and keep the chapters).
Hybrid can't merge two files.
But it's probably easier to use mkvmerge gui directly, iirc. mkvmerges append supports to append input mp4s and keep and append their chapters. (long time since I did something like that, but as far as I remember it should work)
Thanks, I transmit the message.

Looking at the chapter format, I think Hybrid doesn't support the timebase parameter in the chapter format. (but if you have an mp4 file with chapters Hybrid can import that and convert it to mkv)
Do you mean that the mp4 chapters won't be kept because of the timebase parameter or they will be kept but without this parameter ?

[Selur]

Not totally sure what will happen since I don't have the importing code inside my head (long time that I wrote it). :)
-> best test what will happen if you load such a chapter file into Hybrid

[Jamaika]

Hi Selur
How you can use the vpxenc? Command not working.

[Selur]

Nope, seems to be broken, reported it to: https://bugs.chromium.org/p/webm/issues/detail?id=1149

[Music Fan]

Thanks Jamaika but I don't understand everything in your post, could you explain a little bit more each command and the utility of this process compared to the use of MKVmerge, as suggest by Selur ?

[Selur]

@Jamaika: uploaded a vpxenc version to my GoogleDrive (https://drive.google.com/folderview?id=0B_WxUS1XGCPASUZibG5XZkRfeTg&usp=sharing) which fixes the issue by not including vp10 to the build.

[Jamaika]

Thanks
Thanks Jamaika but I don't understand everything in your post, could you explain a little bit more each command and the utility of this process compared to the use of MKVmerge, as suggest by Selur ?
File 'ffmetadata' isn't tolerated by mkvmerge. You want to join two mp4 container. Chapters reportedly connect automatically.
MP4box.exe -new -info -dref* -fps __.___** v0.5.2+1228
-add "video_1.h265:group=1" -add "audio_1.aac:group=1"*** -add "subtitle_1.srt:group=1"**** -add "chapter_ogg_1.txt:group=1"****
-catx "video_2.h265:group=2 +audio_2.aac:group=2 +subtitle_2.srt:group=2 +chapter_ogg_2.txt:group=2" -catx "video_3.h265:group=3 +audio_3.aac:group=3 +subtitle_3.srt:group=3 +chapter_ogg_3.txt:group=3" "joinedfile.mp4"

MKVmerge.exe --default-duration 0:__.___p --cues 0:iframes v8.8.0
( video_1.h265 video_2.h265 video_3.h265 )* --aac-is-sbr 0:1 ( audio_1.aac audio_2.aac audio_3.aac )*
( subtitle_1.srt subtitle_2.srt subtitle_3.srt )*** --chapters ( chapter_ogg_1.txt chapter_ogg_2.txt chapter_ogg_3.txt )*** --track-order 0:0,1:0,2:0 -o joinedfile.mkv
* don't copy metadata with all 'add'
** framerate mode is always variable :mad:
*** don't join conteiner ac3
**** bad join subtitles, chapters group and convert to ttxt

* don't merge '+' track video and audio. Your video stalls.
** don't join conteiner ac3
*** bad join subtitles, chapters
PS: Join only containers mp4 & mkv !!!
I don't know how joing files using ffmpeg.

[Music Fan]

Thanks but I still don't really understand your message, and your 2 messages contain different informations, it's quite confusing.
But I guess your last code allows to join mp4 keeping and appending their chapters.

[alter4]

uploaded a vpxenc version to my GoogleDrive (https://drive.google.com/folderview?id=0B_WxUS1XGCPASUZibG5XZkRfeTg&usp=sharing) which fixes the issue by not including vp10 to the build.

IMHO it's good idea to place such links somewhere in the download page near the hybrid download link to allow guys who potentially could face the same issue immediately get cure.

[Selur]

I uploaded a fixed installer without a version update. ;)