Hybrid: Input -> x264/x265/Xvid/VP8/VP9

[den78]

Hi, Selur.
Just got one question. Why doesn't mediainfo show x265 codec information? Everything is fine with x264.

I've sent you a debug just in case.

[sneaker_ger]

Mkv with mkvtoolnix version 11? There was a bug that got fixed in 12.

[Selur]

yup, updating mkvtoolnix should fix it.

[den78]

Yep, that fixed it. Thanks, guys.

[cocobanana69]

Hi Salur,

First I must say nice work about Hybrid video converter.

I’m still favoring the XviD-style ripping (my favorite ripping app was GordianKnot).

Features I’m missing in Hybrid, please add them:

-auto de-delay for delayed audios
-auto converting DVD/Blu-Ray subtitles (if I choose) to text (for ex. to .srt or .sub)
-GTK3 interface version (for Linux)
-Opening image files (iso,nrg,daa etc)
-Different field alignment (1st Main, 2nd Crop/Resize, 3rd Filtering, 4th Video codec options, 5th Audio encoding options, 6th Chapter, 7th Config, 8th Jobs, 9th Logs)
-Multilanguage translations (I need Serbian Cyrillic and Russian)
-MKV tagging panel, for writing MKV tags like studio, year, director, actors, soundtrack info…
-Compressibility check option before encoding with XviD

https://s11.postimg.org/lw1kvx6ub/01_compressibility_check.jpg

-Preview window like in GordianKnot

https://s23.postimg.org/5mi98dw7v/02_preview_panel.jpg

-Bits/pixel with compressibility test panel (like in GordianKnot) (for XviD encoding)

https://s24.postimg.org/pcutm0arp/03_Bits-_Pixels_Panel.jpg

-Resize & aspect ratio panel (like in GordianKnot) with auto near original aspet-ratio resolutions suggestions

https://s21.postimg.org/vm21yl8sn/04_Crop_Resolution.jpg

-Credits encoding options allowing multiple setups (for XviD encoding, for example I want to encode 1st setting of credits starting from frame 136377 to 140200 at quant: 20, then from frame 140201 to 140800 regularly as the rip is, then from frame 140801 to 150744 also at quant: 20 and in greyscale)

https://s21.postimg.org/qnsz6u2h3/05_Credits.jpg

Features I’m missing in ffmpeg & mencoder (and to be ported to Hybrid):
-lanczos3 & lanczos4
-all avisynth filters missing (should be ported)

Audio feautures I’m missing (I also miss thes for music encoding on Linux):
-fraunhofer-like vbr mp3 encoder or lame without psychoacoustic frequencies cut-off and with high-shelf frequencies cutter (customly set) at 16KHz (I already messaged the fre:ac team for such encoder).

And please post the source code.
Thanks,

[Selur]

auto de-delay for delayed audios
Already possible, inside the Audio-tab you can set the audio delay you want for the current stream before adding it to the audio queue,.. (Audio->Main->Audio Source->A/V delay (ms).

auto converting DVD/Blu-Ray subtitles (if I choose) to text (for ex. to .srt or .sub)
Don't know of any decent/stable/reliable and portable way that this could be done cross plattform.
-> won't probably come.
GTK3 interface version (for Linux)
unsure about what is missing there, normally Hybrid should work fine under Gnome,..

Opening image files (iso,nrg,daa etc)
not going to happen

Different field alignment (1st Main, 2nd Crop/Resize, 3rd Filtering, 4th Video codec options, 5th Audio encoding options, 6th Chapter, 7th Config, 8th Jobs, 9th Logs)
won't happen

Multilanguage translations (I need Serbian Cyrillic and Russian)
I don't speak either an I lack the time to translate all the texts.
-> probably won't happen unless I win the lottery

MKV tagging panel, for writing MKV tags like studio, year, director, actors, soundtrack info…
Already possible: Config->Output->Mkv Tags

Compressibility check option before encoding with XviD
I don't believe in compression tests, so that won't happen. :)

Preview window like in GordianKnot
Both the Avisynth and the Vapoursynth Preview windows should be similar.

Resize & aspect ratio panel (like in GordianKnot) with auto near original aspet-ratio resolutions suggestions
Don't like the panel and Hybrid already tries to minimize the any aspect error. -> won't change.

Credits encoding options allowing multiple setups (for XviD encoding, for example I want to encode 1st setting of credits starting from frame 136377 to 140200 at quant: 20, then from frame 140201 to 140800 regularly as the rip is, then from frame 140801 to 150744 also at quant: 20 and in greyscale)
Aside from gray scale, the normal Xvid->Zones control should already cover that.

all avisynth filters missing (should be ported)
Hybrid already supports tons of Avisynth (Filtering->Avisynth) and Vapoursynth (Filtering->Vapoursynth) filters depending of the choice one makes. (tested on Windows and Linux, not on Mac)

Audio feautures I’m missing (I also miss thes for music encoding on Linux):
-fraunhofer-like vbr mp3 encoder or lame without psychoacoustic frequencies cut-off and with high-shelf frequencies cutter (customly set) at 16KHz (I already messaged the fre:ac team for such encoder).
Hybrid atm. only supports ffmpeg and lame for mp3 encoding, since I'm not aware of any other free mp3 encoders on Linux. (about the cutoff, if you can tell me the ffmpeg/lame command line I could add support for it)

Cu Selur

[von Suppé]

In config tab, I always had "Prefer FFmpeg as decoder" checked.

It lately draws my attention that during a recode "ffmpeg_32.exe *32" is taking a lot of CPU and memory resources, having significant effect on the transcoding time. Did something change?

BTW what decoder would Hybrid use if I would uncheck it?

[Selur]

what decoder would Hybrid use if I would uncheck it?
Hybrid uses either: ffmpeg or mencoder or avs2yuv or VSPipe depending on the input and what it deems a good choice. :)

Did something change?
Not really. My guess is you now just use some filter which requires a lot of resources.
(Also I updated qtgmc iirc. so that might influence the ram and cpu usage)

[HeiLi]

Hi, i have been using it for 5-6 weeks hybrid but last 4-5 encode always gives random grey screen like this

http://i.imgur.com/P8UozAd.jpg

How can i fix that?

(Add later debug report)

[Havokdan]

Hi, i have been using it for 5-6 weeks hybrid but last 4-5 encode always gives random grey screen like this

http://i.imgur.com/P8UozAd.jpg

How can i fix that?

(Add later debug report)

This happens to me when I try to use the encoders that use the GPU and the original file is 10 bits.

[HeiLi]

This happens to me when I try to use the encoders that use the GPU and the original file is 10 bits.

I dont use gpu or 10bits encode x264 but last 3-4 encode like this and sometimes encode bluray to x264 7-8 hours sometimes 48 hours i dont understand

[Selur]

Looks like a decoding problem of the source without any details the only thing I can say is that using another decoder might help.
In case the source if vc-1 using a gpu based decoder like FRIM (Avisynth only), DGDecNV (Avisynth&Vapoursynth), DGDecIM (Vapoursynth), might help.
If the source isn't vc-1 any other decoder might help.

[HeiLi]

Looks like a decoding problem of the source without any details the only thing I can say is that using another decoder might help.
In case the source if vc-1 using a gpu based decoder like FRIM (Avisynth only), DGDecNV (Avisynth&Vapoursynth), DGDecIM (Vapoursynth), might help.
If the source isn't vc-1 any other decoder might help.

i dont use gpu decoder always use QTGMC, add debug txt but hybrid so slow encode now sometimes faster

[Selur]

Might also be some ram problem or some problem due to overclocking or heat issues.
I don't need a DebugOutput of the processing. I need a debug output of the file analysis and job creation to know what you are doing.

[HeiLi]

Might also be some ram problem or some problem due to overclocking or heat issues.
I don't need a DebugOutput of the processing. I need a debug output of the file analysis and job creation to know what you are doing.

I have 32 gb ram and xeon e3-1231v3 cpu ?



debug output (http://www8.zippyshare.com/v/HxAjIJEg/file.html)

[Selur]

Encoding call:
"C:\PROGRA~1\Hybrid\ffmpeg_32.exe" -y -loglevel fatal -threads 8 -i "C:\Users\Administrator\AppData\Local\Temp\2\encodingTempSynthSkript_19_58_47_5210.avs" -an -sn -vsync 0 -pix_fmt yuv420p -f rawvideo - | "C:\PROGRA~1\Hybrid\x264.exe" --preset superfast --pass 1 --bitrate 2048 --profile high --level 4.1 --direct auto --qcomp 0.5 --slices 4 --aq-mode 0 --sar 40:33 --non-deterministic --range tv --stats "C:\Users\ADMINI~1\AppData\Local\Temp\2\Lethal_Weapon_2_t01_new_19_58_47_5210_06.stats" --demuxer raw --input-depth 8 --input-res 1280x646 --input-csp i420 --fps 24000/1001 --output NUL -
looks fine, Avisynth script:
SetMemoryMax(1536)
SetMTMode(5,8) # change MT mode
LoadPlugin("C:\PROGRA~1\Hybrid\AVISYN~1\LoadDll.dll")
LoadPlugin("C:\PROGRA~1\Hybrid\AVISYN~1\LSMASHSource.dll")
LoadPlugin("C:\PROGRA~1\Hybrid\AVISYN~1\dfttest.dll")
LoadPlugin("C:\PROGRA~1\Hybrid\AVISYN~1\RgTools.dll")
LoadDll("C:\PROGRA~1\Hybrid\AVISYN~1\fftw3.dll")
# loading source: D:\bd\Lethal_Weapon_2_t01.mkv
# input luminance scale tv
LWLibavVideoSource("D:\bd\Lethal_Weapon_2_t01.mkv",cache=false,stacked=true,format="YUV420P8",repeat=true)
# current resolution: 1920x1080
SetMTMode(2) # change MT mode
# cropping to 1920x800
Crop(0,140,0,-140)
# current resolution: 1920x800
# denoising using dfttest
dfttest()
# grain handling
Removegrain()
# scaling
Spline36Resize(1280,646)
distributor()
return
looks fine, no QTGMC used (source is progressive so no deinterlacing needed).
Videosource is VC-1/WVC1. Disable 'Avisynth->Filtering->Misc->LibavVideoSource instead of FFmpegSource', enabled 'Avisynth->Filtering->Misc->Support FRIM' and check the Avisynth script in Hybrid to see if Hybrid uses FRIM and whether that helps with the decoding problem.
Also if you can reproduce the problem with a small sample, it would help if you can share that sample with me so that I can try whether this also happens here.
You can also try, whether enabling 'Avisynth->Filtering->Misc->Force DirectShowSource' helps. Remember to check the Avisynth Preview, it the preview doesn't work or shows those Problems the encoding will too, so no reason to encode then.
Sadly since you don't have any card in your system that could be used for video decoding, that option is useless.
-> If neither FRIM or DirectShowSource helps the problem might be that no available decoder can handle the source. (sadly there is nothing I can do about that)

Cu Selur

[Music Fan]

Hi Selur,
I'm gonna be a little bit out of topic but as I see that HeiLi has 32 GB ram, I wonder when it could be useful.
I read several times that more than 8 GB ram was rarely useful.
I still have only 4 GB and its usage is always under 100 %, would I earn speed anyway with 8 GB ? I mean for video encoding and to open 3 or 4 applications at the same time, I don't play games.

[HeiLi]

Encoding call:
"C:\PROGRA~1\Hybrid\ffmpeg_32.exe" -y -loglevel fatal -threads 8 -i "C:\Users\Administrator\AppData\Local\Temp\2\encodingTempSynthSkript_19_58_47_5210.avs" -an -sn -vsync 0 -pix_fmt yuv420p -f rawvideo - | "C:\PROGRA~1\Hybrid\x264.exe" --preset superfast --pass 1 --bitrate 2048 --profile high --level 4.1 --direct auto --qcomp 0.5 --slices 4 --aq-mode 0 --sar 40:33 --non-deterministic --range tv --stats "C:\Users\ADMINI~1\AppData\Local\Temp\2\Lethal_Weapon_2_t01_new_19_58_47_5210_06.stats" --demuxer raw --input-depth 8 --input-res 1280x646 --input-csp i420 --fps 24000/1001 --output NUL -
looks fine, Avisynth script:
SetMemoryMax(1536)
SetMTMode(5,8) # change MT mode
LoadPlugin("C:\PROGRA~1\Hybrid\AVISYN~1\LoadDll.dll")
LoadPlugin("C:\PROGRA~1\Hybrid\AVISYN~1\LSMASHSource.dll")
LoadPlugin("C:\PROGRA~1\Hybrid\AVISYN~1\dfttest.dll")
LoadPlugin("C:\PROGRA~1\Hybrid\AVISYN~1\RgTools.dll")
LoadDll("C:\PROGRA~1\Hybrid\AVISYN~1\fftw3.dll")
# loading source: D:\bd\Lethal_Weapon_2_t01.mkv
# input luminance scale tv
LWLibavVideoSource("D:\bd\Lethal_Weapon_2_t01.mkv",cache=false,stacked=true,format="YUV420P8",repeat=true)
# current resolution: 1920x1080
SetMTMode(2) # change MT mode
# cropping to 1920x800
Crop(0,140,0,-140)
# current resolution: 1920x800
# denoising using dfttest
dfttest()
# grain handling
Removegrain()
# scaling
Spline36Resize(1280,646)
distributor()
return
looks fine, no QTGMC used (source is progressive so no deinterlacing needed).
Videosource is VC-1/WVC1. Disable 'Avisynth->Filtering->Misc->LibavVideoSource instead of FFmpegSource', enabled 'Avisynth->Filtering->Misc->Support FRIM' and check the Avisynth script in Hybrid to see if Hybrid uses FRIM and whether that helps with the decoding problem.
Also if you can reproduce the problem with a small sample, it would help if you can share that sample with me so that I can try whether this also happens here.
You can also try, whether enabling 'Avisynth->Filtering->Misc->Force DirectShowSource' helps. Remember to check the Avisynth Preview, it the preview doesn't work or shows those Problems the encoding will too, so no reason to encode then.
Sadly since you don't have any card in your system that could be used for video decoding, that option is useless.
-> If neither FRIM or DirectShowSource helps the problem might be that no available decoder can handle the source. (sadly there is nothing I can do about that)

Cu Selur

Check with avisynth preview there is no problem but hybrid sometimes so slow encoding speed (01-03 fps cpu use %99) but when reboot my pc first encode faster (20-30 fps cpu use %99 ) Why?

[yensteel]

Getting a hang of the interface. I encountered problems though.

I don't know what I'm doing wrong, but every time I tried, no matter qaac, fdk or faac the resulting file always contains two audio, the original and the encoded one. The first files of some of my batches sometimes doesn't even have the encoded version just the original. This occurs in different videos, even though they are from different sources.

I chose auto add (all) (auto add first also same issue)

Audio Encoding options checked
merge audio streams checked (because of 6 channels)

[Selur]

@HeiLi:
Check with avisynth preview there is no problem but hybrid sometimes so slow encoding speed (01-03 fps cpu use %99) but when reboot my pc first encode faster (20-30 fps cpu use %99 ) Why?
Wild guess is that one of the dlls used either directly has some problem with your system or another tool is interfering.

@yensteel: Far too few details to say anything. Create a debug output which shows the problem and I can look into it.
@MusicFan: When you don't use the available RAM adding more will not speed up encoding. (using a RAM drive might help a bit)

[Music Fan]

using a RAM drive might help a bit
I didn't know this ; I see that it simulates a hard drive on a part of the RAM whose available size is therefore reduced, thus I wonder how it may help to gain speed.:confused:

[Selur]

Depending on what you do it helps with remuxing, indexing and general file access. Encoding will probably only gain from it is otherwise your hdd is a bottleneck.
In Avisynth using a higher or lower MemoryMax can also influence the speed of script, but also in general not much.

[Selur]

Hybrid rev 2017.10.03.1:
*fixed*

Avisynth on Linux handling
fixed progress for ffmpeg encoding
Vapoursynth: bunch of typos
general: problem with 'ignore all input time codes'
audio: dts-hd handling
bunch of small bugs (I forgot about)

*changed*

updated dependencies
Switching between Avisynth and Vapoursynth should be possible now (Filtering->Support)
renamed Main- to Base-tab
lot of code refactoring
loosend dgdecnv restrictions
vsedit directly pipes to encoder if possible
x265: updates to newer version
forceCBR tsMuxeR muxing when cbr is used

*added*

Avisynth: FrameRateConverter


-> downloads: http://www.selur.de/downloads

Cu Selur

Ps.: starting Friday I will be on a China tour and probably not online a lot (if at all) so don't be surprised in case I don't react. :)

[Gravitator]

Здравствуйте!
http://i89.fastpic.ru/big/2017/1013/31/a46c1182113fe7ceab08d921572d1131.jpg
I open any x264 and x265 files through AVS preview (did not try on others) :
Tick the info >
1. Click the next frame (or twice) > click the reverse action / previous frame (or twice);
2. Next > previous > next.
- I get a gluck of the discrepancy of the frame number in the program window and the text inside.

[Gravitator]

Is there a plan for adding a frame comparison function?

[alter4]

How can I encode vertical (portrait) video, when I open my video.mp4 from a smartphone in hybrid, it is opened in landscape view and I don't know what to do. Guys could you please help.

[jd17]

Does anyone else face an issue with --hdr-opt in the latest version of Hybrid?

I use Hybrid rev 2017.10.05.1 on a Windows x64 machine.
x265 is stable 2.5+5-0b3ba15 from here: http://www.msystem.waw.pl/x265/
(VS 2017 AVX2)

I added --hdr-opt under "Misc" as custom command line addition, like I used to.
Hybrid also confirms this in the bottom summary of commands.
The result however shows "no-hdr-opt" in MediaInfo", which is also clearly reflected in a higher bitrate.

Can you help me out?

[jd17]

I repeated the test with the x265 that comes with Hybrid rev 2017.10.05.1 (= 2.5+20).
Unfortunately, the issue is still present -> no-hdr-opt. :(

So, I went back to rev 2017.05.06.1 and replaced the integrated x265 with the stable 2.5+5-0b3ba15 again.
Again, I got the same issue! :(

Then I looked at my previous HDR testencodes and saw that I had always used x265 2.5+1-adbcc90bdef3 before.
Unfortunately I deleted that from my HDD, so I downloaded the next best thing, the stable 2.4+13.
Even with that I got no-hdr-opt! :(

As a last resort I used a text compare tool to see what might trigger this and I finally found the root cause.
Somehow, --transfer was set to 2 instead of 16, although I always had the right box checked (smpte-st-2084).
I then entered --transfer 16 manually as custom command line and voila! hdr-opt works again! :)


Is it possible that x265 no longer accepts the string "smpte-st-2084", but only "smpte2084" or the integer 16?

[den78]

Hi, Selur.

Vspipe.exe is crashing here.
https://i.imgur.com/hPCZKOg.png

I've sent you the debug file.

[Selur]

@den78: Won't probably get around to look into it before next week. :( But I got it marked for investigation.
@jd17: Yes, x265 changes the naming of the matrices. Hybrid should allow to select them manually adding a custom addition shouldn't be needed.

[den78]

^ It seems that it can't handle TS (DVB-T2) files properly. It doesn't crash when it's a remuxed MKV, but with it i have A/V sync issues.

Edit:
I remuxed it to mp4 & it can handle it with no issues. But, yeah, nevertheless, please look into it when you have the time. Thanks.
& thank you for vapoursynth. Results are way better with it.

[Selur]

Problem is probably that the transportstream headers are just too broken for the used source filter to handle it properly. (or broken time codes)
-> nothing can do about it

[bob88]

can anybody tell me how to check avisynth version and how to update to latest version? thanks.

[Music Fan]

Simply type
version()
in an avs file & open it in Vdub.
For an update, AVISynth+ is maybe preferable.

edit : sorry, I didn't saw we were in the Hybrid topic, there's maybe another solution to verify the version.

[Selur]

Hybrid does come with the latest Avisynth 32bit MT which is the only version is it tested with so installing another version might cause problems,...

[Selur]

Small question to the Windows users: "Is anyone still using a 32bit Windows installation with Hybrid?"
(Background: Qt isn't providing 32bit Windows builds out of the box through their update routines for MSVC 2017, so I'm thinking about dropping 32bit Windows support.)

Cu Selur

[bob88]

Selur,
Would it be possible to integrate 64bit Avisynth in Hybrid?
I want to use 64bit Mdegrain.

[Selur]

Nope. No plan to support Avisynth 64bit in any way.

[bob88]

why???
its faster. faster is better.

[Selur]

Avisynth 64bit is way unstable doesn't support all the filters Hybrid uses. Avisynth+ 64bit might be an alternative, but I'm more into supporting more Vapoursynth stuff than Avisynth+.
(+ Would be a lot of work, writing code, testing stuff,... )

Cu Selur

[bob88]

Are the currently integrated vapoursynth filters 64bit?

[Selur]

Yes, Hybrid only supports 64bit Vapoursynth.

[bob88]

I just did a few tests with Vapoursynth's degrainers. Compared to Avisynth's 32bit Mdegrain I got the same speeds and the results qualitywise were less satisfying.

[Selur]

So your best bet is either not use Hybrid or find an alternative to MDegrain which runs under Vapoursynth that I could support in Hybrid, since I don't plan to support Avisynth 64bit. (or stick with the 32bit Avisynth version)

Cu Selur

[bob88]

how about this SMDegrain?
https://forum.doom9.org/showthread.php?t=166582

[Selur]

Already comes with Hybrid, but isn't used other than in QTGMC atm. .
Looking just at the parameter list:
SMDegrain(input, tr=2, thSAD=300, thSADC=None, RefineMotion=False, contrasharp=None, CClip=None, interlaced=False, tff=None, plane=4, Globals=0, pel=None, subpixel=2, prefilter=-1, mfilter=None, blksize=None, overlap=None, search=4, truemotion=None, MVglobal=None, dct=0, limit=255, limitc=None, thSCD1=None, thSCD2=130, chroma=True, hpad=None, vpad=None, Str=1., Amp=0.0625)
Adding support for it will take me a while. (lot of tooltips&documentation)
-> will look into it, hopefully I get it done during the next week

[bob88]

ok Im super noob so I dont know what QTGMC is but Ill be waiting with anticipation for your update.
Thank you!

[alter4]

How can I encode vertical (portrait) video, when I open my video.mp4 from a smartphone in hybrid, it is opened in landscape view and I don't know what to do. Guys could you please help.

Sorry to repeat, Could anybody suggest something?

[Selur]

@alter4: You could use 'Crop/Resize->Misc->Misc->Rotate output' to rotate the video. :)

Cu Selur

[Vesdaris]

Hey Selur

I've been experimenting with nvenc hevc encoding and I always keep getting crashes

Could you check the log, please?

https://pastebin.com/ZKBSpsxL

I suppose Im doing something wrong here..I dunno

Thank you