Hybrid: Input -> x264/x265/Xvid/VP8/VP9

[DJ-1]

ok, what I`ll do is import all the mpls then flick throught the titles n see wich 1 looks ok (by running time) in Hybrid.....theres lot at 7secs running time i think

[Selur]

I tried using CMD to call the line you put up, but i have no clue what I`m doing in CMD
1. select text in the code-block from the post, press CTRL + C (to copy the text)
2. open a new teminal e.g. by entering cmd in your windows start menu search box and press enter (this should open a terminal/console window)
3. right click with your mouse inside the window and select 'paste'
4. hit enter to execute the command
5. right click on the terminal window, select 'Select All'
6. right click again (this will copy the text)
7. create a new post and post the content in a 'code'-block

.theres lot at 7secs running time i think
and Hybrid has an option to filter out titles below x minutes,...

Which of the debug links contained the analysis?

Cu Selur

[DJ-1]

1. select text in the code-block from the post, press CTRL + C (to copy the text)
2. open a new teminal e.g. by entering cmd in your windows start menu search box and press enter (this should open a terminal/console window)
3. right click with your mouse inside the window and select 'paste'
4. hit enter to execute the command
5. right click on the terminal window, select 'Select All'
6. right click again (this will copy the text)
7. create a new post and post the content in a 'code'-block


and Hybrid has an option to filter out titles below x minutes,...

Which of the debug links contained the analysis?

Cu Selur

yeah, did that...just get lots of `invalid command` type of stuff.

as for the short duration mpls files, i was thinking maybe its 1 of them disguised as a short `forgettable` mpls

[Selur]

just get lots of `invalid command` type of stuff.
call looks fine to me,...

as for the short duration mpls files, i was thinking maybe its 1 of them disguised as a short `forgettable` mpls
that may be, but I don't know of a fast way to determine if that is the case :)
From my point of view the Blu-ray is just broken, probably due to some copy protection,...

Cu Selur

[DJ-1]

Microsoft Windows [Version 6.1.7601]
Copyright (c) 2009 Microsoft Corporation. All rights reserved.

C:\Windows\system32>dj-1
'dj-1' is not recognized as an internal or external command,
operable program or batch file.

C:\Windows\system32>DJ-1
'DJ-1' is not recognized as an internal or external command,
operable program or batch file.

C:\Windows\system32>"C:\Program Files\Hybrid\mencoder.exe" -lavdopts threads=4 -
really-quiet -of rawvideo -o - -ovc raw -noskip -demuxer lavf -vfm ffmpeg -vf sc
ale,format=i420 -forcedsubsonly -nosub -nosound -mc 0 "C:\Users\DJ-1\Desktop\_18
_12_34_191_09.264" | "C:\Program Files\Hybrid\x264.exe" --pass 1 --bitrate 1500
--profile high --level 4.1 --direct auto --sync-lookahead 15 --weightp 1 --aq-mo
de 0 --stats "C:\Users\DJ-1\AppData\Local\Temp\18_12_34_191_13.stats" --fps 2400
0/1001 --input-res 1920x1080 --output NUL -
raw [info]: 1920x1080p 0:0 @ 24000/1001 fps (cfr)
x264 [info]: using cpu capabilities: MMX2 SSE2Fast SSSE3 Cache64
x264 [info]: profile Main, level 4.1
x264 [info]: final ratefactor: 28.03


C:\Windows\system32>dj-1

[Selur]

no clue where you got all the 'dj-1's from, but from the looks of it the encoding doesn't even start.
Since you wrote that the input file exists I have no clue where the problem is, but it probably fixes itself if you find the right mpls file.
Alternatively if there's only one large-m2ts file in you STREAM folder you can simple select that through the normal file mode.

[DJ-1]

ok thanks, at first i was thinking i was meant to be logged in as my user acc name or something.... anyhow, like i said, crap with all things CMD LOL.

yeah I`ll probably go the `file mode` route.

thanks for your help.

[pintcat]

Small bug in x264 command line generator: If I choose "specific filesize/bitrate (2nd pass)" the command line still says "--pass 1" and "--slow-firstpass" and perhaps other things that are first pass related.

[Selur]

argh, will look into it :)

[DJ-1]

Hi, currently I'm looking to find a nice way to deal with interlace material from DVD source.. I've do e a few tests with the default methods in 'filtering'. So i got the extra avisynth. Zip & now I have a few more options. The QTGMC looks good but I need to re about what I'm doing so I started a new thread.
I got a response querying the app (hybrid) being able to do certain things:


"Can it tell the difference between hard and soft telecine and know what to do with each? Can it spot fieldblending and know to unblend rather than blindly deinterlace (I'd bet money it can't)? Can it spot true hybrid material? If it's anything like the Handbrake analyzer, don't trust it. Nothing beats your eyes for analyzing video.

But maybe it really is a great tool as I've never even heard of it, much less used it."

Does hybrid do any of the above?
Thanks.

Sent from my Galaxy S II using tapatalk

[Selur]

I suspect this refers to the analyzing Method in Hybrid. :)

Does hybrid do any of the above?
Definitely not! Like manono, I agree with the statement: "Nothing beats your eyes for analyzing video."
Can't really tell if the analyze method Hybrid uses is anything like Handbrake, since I never looked at the method Handbrake uses.
If your material is screwed up one or the other way the analyzer can't show you magically how to properly handle your material. :)
(if you need to use restore24, some deblending or whatever,..)

Cu Selur

[DJ-1]

Thought so.... As was mention in my other thread... "nothing can tell better than doing it by eye". Wich is what I was doing, just wondered if there were a better way.

Currently looking at the avi synth filtering options. Is there a way to 'split a frame down the middle" (vertically). Or have an option in "filter preview" & "avi synth preview" to toggle between that & separate frames side by side (as current) ... It may give a better representation of the before/after if it's possible?

Cheers.

Sent from my Galaxy S II using tapatalk

[Selur]

'split a frame down the middle" (vertically).
isn't this just cropping it to half it's width?

Or have an option in "filter preview" & "avi synth preview" to toggle between that & separate frames side by side (as current) ... It may give a better representation of the before/after if it's possible?
I think it's possible for both, but not so funny to implement, may be I find some time to look at it on sunday,..

[DJ-1]

Ok cool... Am getting a few avs preview Exe errors... ( currently on 2.5.8 32bit).
Is avisynth 2.6 Mt (64bit) ok with hybrid?
Cheers

[Selur]

I got no clue what you are doing. :)
a. are you using an Avisynth script as input? (better try avisynth 2.6 - haven't used 2.58 for quite some time,... if you use 64bit make sure you use the 64bit avsInfo)
b. are you using the Avisynth extension? (than it normally uses it own 32bit Avisynth MT and will not work with the 64bit version, so don't exchange it!)
c. don't combine AvisynthInput and the Avisynth extension,...
d. I strongly advice not to use Avisynth 64bit (no matter if it's 2.5x or 2.6 with or without MT), from my point of view Avisynth 64bit isn't stable enough to use.
other than that: can't help if you don't provide useful infos,..

Cu Selur

[digitall.h]

Hi selur,
I'm trying to encode an interlaced black&white film from back 1952.
I loaded the source, analysed it and hybrid said it's interlaced. I assumed it's TFF, and as deinterlacer I selected mcdeint, yadif=1, order=1, quantizer=10, framestep=2.
I did not understand the Framestep parameter. I guess that the deinterlacer separates fields, and then discards some fields to keep framerate. As I'm with 25fps, I selected to keep 1 field every 2 (... right?).
It's cropped to 696x568, and detected as 16x15 input PAR.

I submitted the job, but it crashed at the beginning of the x264 encoding.
I send you the log.
Thanx

[Selur]

call looks fine:
yadif=1,mcdeint=2:1:10,framestep=2,crop=696:568:10:2,hqdn3d=2:1:3:1,scale,format=i420
here's the explanation form the mplayer manual for the deinterlacing settings:
yadif=[mode[:field_dominance]]
Yet another deinterlacing filter
<mode>
0: Output 1 frame for each frame.
1: Output 1 frame for each field.
2: Like 0 but skips spatial interlacing check.
3: Like 1 but skips spatial interlacing check.
<field_dominance> (DEPRECATED)
Operates like tfields.
NOTE: This option will possibly be removed in a future
version. Use -field-dominance instead. source: http://www.mplayerhq.hu/DOCS/man/en/mplayer.1.txt

mcdeint=[mode[:parity[:qp]]]
Motion compensating deinterlacer. It needs one field per frame
as input and must thus be used together with tfields=1 or
yadif=1/3 or equivalent.
<mode>
0: fast
1: medium
2: slow, iterative motion estimation
3: extra slow, like 2 plus multiple reference frames
<parity>
0 or 1 selects which field to use (note: no autodetec�
tion yet!).
<qp>
Higher values should result in a smoother motion vector
field but less optimal individual vectors. source: http://www.mplayerhq.hu/DOCS/man/en/mplayer.1.txt

regarding framestep:
framestep=I|[i]step
Renders only every nth frame or every intra frame (keyframe).

If you call the filter with I (uppercase) as the parameter, then
only keyframes are rendered. For DVDs it generally means one in
every 15/12 frames (IBBPBBPBBPBBPBB), for AVI it means every
scene change or every keyint value (see -lavcopts keyint= value
if you use MEncoder to encode the video).

When a keyframe is found, an 'I!' string followed by a newline
character is printed, leaving the current line of MPlayer/MEn�
coder output on the screen, because it contains the time (in
seconds) and frame number of the keyframe (You can use this in�
formation to split the AVI.).

If you call the filter with a numeric parameter 'step' then only
one in every 'step' frames is rendered.

If you put an 'i' (lowercase) before the number then an 'I!' is
printed (like the I parameter).

If you give only the i then nothing is done to the frames, only
I! is printed. source: http://www.mplayerhq.hu/DOCS/man/en/mplayer.1.txt

so yadif creates one frame per field, mcdeint makes additional deinterlacing and framestep throws every second frame away, so the input and output frame rate will be the same.

the whole thing looks fine, here the complete encoding call:
"/usr/bin/mencoder" -ovc raw -noskip -field-dominance 1 -vf yadif=1,mcdeint=2:1:10,framestep=2,crop=696:568:10:2,hqdn3d=2:1:3:1,scale,format=i420 -forcedsubsonly -nosub -nosound -mc 0 -really-quiet -of rawvideo -o - -dvd-device "/home/ximo/VIVIR_kurosawa/VIDEO_TS" dvd://1 | "/usr/bin/x264" --preset veryslow --tune film --crf 18 --profile high --level 4.1 --aq-mode 2 --vbv-maxrate 62500 --vbv-bufsize 78125 --sar 16:15 --fps 25 --input-res 696x568 --output "/tmp/Vivir_kurosawa_09_56_34_441_05.264" -
Problem is for some reason mencoder crashes while decoding the content,...
This might be due to mcdeint (some older versions of mplayer/mencoder often crashed with mcdeint, but all newer versions seemed to be fine).

Tested a DVD and a three interlaced vob samples, and had no problem with the deinterlacing.

-> what happens if you call:
"/usr/bin/mencoder" -ovc raw -noskip -field-dominance 1 -vf yadif=1,mcdeint=2:1:10,framestep=2,crop=696:568:10:2,hqdn3d=2:1:3:1,scale,format=i420 -forcedsubsonly -nosub -nosound -mc 0 -of rawvideo -o /dev/nul -dvd-device "/home/ximo/VIVIR_kurosawa/VIDEO_TS" dvd://1 this is just the decoder call, piping the output to /dev/nul and writing some output if error&co occur.

Cu Selur

[digitall.h]

There's probably something wrong with the command:
MEncoder SVN-r34707-4.6 (C) 2000-2012 MPlayer Team
libdvdread: Using libdvdcss version 1.2.12 for DVD access
libdvdread: Couldn't find device name.
There are 2 titles on this DVD.
There are 1 angles in this DVD title.
audio stream: 0 format: ac3 (stereo) language: es aid: 128.
audio stream: 1 format: ac3 (stereo) language: ja aid: 129.
number of audio channels on disk: 2.
subtitle ( sid ): 0 language: es
number of subtitles on disk: 1

success: format: 2 data: 0x35000 - 0xbf714000
MPEG-PS file format detected.
VIDEO: MPEG2 720x576 (aspect 2) 25.000 fps 3220.4 kbps (402.6 kbyte/s)
[V] filefmt:2 fourcc:0x10000002 size:720x576 fps:25.000 ftime:=0.0400
File not found: '/dev/nul'
Failed to open /dev/nul.
Cannot open output file '/dev/nul'.

Exiting...

[Selur]

-> needs to be /dev/null

[digitall.h]

Now it's more informative:
MEncoder SVN-r34707-4.6 (C) 2000-2012 MPlayer Team
libdvdread: Using libdvdcss version 1.2.12 for DVD access
libdvdread: Couldn't find device name.
There are 2 titles on this DVD.
There are 1 angles in this DVD title.
audio stream: 0 format: ac3 (stereo) language: es aid: 128.
audio stream: 1 format: ac3 (stereo) language: ja aid: 129.
number of audio channels on disk: 2.
subtitle ( sid ): 0 language: es
number of subtitles on disk: 1

success: format: 2 data: 0x35000 - 0xbf714000
MPEG-PS file format detected.
VIDEO: MPEG2 720x576 (aspect 2) 25.000 fps 3220.4 kbps (402.6 kbyte/s)
[V] filefmt:2 fourcc:0x10000002 size:720x576 fps:25.000 ftime:=0.0400
Opening video filter: [expand osd=1]
Expand: -1 x -1, -1 ; -1, osd: 1, aspect: 0.000000, round: 1
Opening video filter: [format fmt=i420]
Opening video filter: [scale]
Opening video filter: [hqdn3d=2:1:3:1]
Opening video filter: [crop w=696 h=568 x=10 y=2]
Crop: 696 x 568, 10 ; 2
Opening video filter: [framestep=2]
Opening video filter: [mcdeint=2:1:10]
libavcodec version 54.0.0 (internal)
Opening video filter: [yadif=1]
==========================================================================
Opening video decoder: [ffmpeg] FFmpeg's libavcodec codec family
Selected video codec: [ffmpeg2] vfm: ffmpeg (FFmpeg MPEG-2)
==========================================================================
Unsupported PixelFormat 61
Unsupported PixelFormat 53
Unsupported PixelFormat 81
Movie-Aspect is 1.33:1 - prescaling to correct movie aspect.
Violación de segmento (`core' generado)

A problem with input PAR?.
I did a full encode selecting yadif as deinterlacer, with no errors.
:confused:

[Selur]

A problem with input PAR?.
Nope, PAR has nothing to do with the problem,...

I did a full encode selecting yadif as deinterlacer, with no errors.
Like I wrote before, probably a bug in mcdeint.
"MEncoder SVN-r34707-4.6" -> it might if you update your mencoder/mplayer current revision should be somewhere around r35600
(https://bugs.archlinux.org/task/28843 sound similar to your problem so updating really could help,..)

Cu Selur

[digitall.h]

I'm using in my sources the ppa you recommended, from:
https://launchpad.net/~motumedia/+archive/mplayer-daily (~motumedia)

They say it should be svn34750, far from 35600...:(

[Selur]

Seems like it's time for a new repository, their last update was 2012-02-21,.... which is far away from daily. ;)
http://www.andrews-corner.org/mplayer.html might be interesting. (guide how to build mplayer)

Cu Selur

[DJ-1]

hi, I got the 32bit package earlier, along with the test version u linked (with the different UI). I wasnt sure if using 64bit Hybrid + 32bit avisynth (Version 2.6) complicated things, so i got 32bit Hybrid to hopefully simplfy it.

I also have the avisynth extension pack extracted to the Program file DIR

My Source is a DVD (PAL) with 1 title, 1 PGC, 1 angle (as `avisynth DVD mode` needs that).

what i did was:

1:Open Hybrid, turn on the Debug file feature.
2:Apply DJ Deint GLOBAL profile.
3:main tab, open the source DVD folder, let it anylise it.
4:x264 tab, Apply the DJ Deintx264 profile.
5:filtering-->de-interlace tab.
6:QTGMC (Avisynth) is already active + `forced deinterlace` already set also, so i hit `avisynth preview` and it scans, then get a few errors. 1 mentioning the eedi3.dll not being to be loaded. (the .dll is in there i checked)
7:hit add to queue, run queue... to get a debug file

screenshots:https://www.dropbox.com/s/fpm3k6lwicor774/error%20pics.rar

debug: https://www.dropbox.com/sh/7le3ytvy0r9wxdr/Q1SMGww9ex/HybridDebugOutput.txt

profiles: https://www.dropbox.com/s/sjvbh5ltanzh11w/profiles.rar

Ive also tried this with avisynth 2.58, same result.... so i`m not sure if its a profile problem, a global setting problem or something else, if i set it to `preview` with a normal de-interlace method set, its fine, only get the issue if Avisynth based methods are set.

thanks.

[Selur]

Ive also tried this with avisynth 2.58, same result....
1. you do not need to install avisynth if you use the avisynth extension,... (the extension comes with it's own avisynth.dll)
2. do not exchange the avisynth.dll in the Hybrid folder

-> will look at the debugoutput&co

[DJ-1]

Ok... The only thing I put in the Hybrid DIR was the contents of the avisynth pack from ur website

Sent from my Galaxy S II using tapatalk

[Selur]

Loading eedi3 works fine here, problem might be related to: http://forum.doom9.org/showthread.php?t=159958
-> try if it helps if you copy (not move!) msvcp100.dll and msvcr100.dll into the avisynth plugins folder.
if it does, I'll modify Hybrid to automatically load these dlls from the Hybrid folder.
(send you a link, to a version that autoloads the dlls when QTGMC is used, for testing)

[DJ-1]

hi, ok...i copied both the msvcp100.dll & msvcr100.dll to the avisynthPlugins DIR
however, i did notice the avisynth pack i got from ur site already has both of those file there already, BUT, the msvcr100.dll =753KB and msvcp100.dll =412KB), .... in the 32bit Hybrid i got on here it has a msvcr100.dll = 756KB, I`m assuming there`s a difference between them. (other .dll is same size).

anyhow, after copying them into the DIR, i also got the updates from the thread you linked me to, installed the update. Uninstalled avisynth, as you said it isnt needed as Hybrid got its own .dll for it.

Got the test version you sent me, tried both the test version and the previous test version and exact same result. Exact same process.

It sees the eedi3.dll ok, but cant load it....

[Selur]

"and exact same result. " -> did the avisynth script change?
(Filtering->Avisynth->Show current Avisynth script)

it should look similar to:
SetMemoryMax(768)
SetMTMode(5,8)
LoadPlugin("G:\Hybrid\avisynthPlugins\ffms2.dll")
LoadPlugin("G:\Hybrid\avisynthPlugins\LoadDll.dll")
LoadPlugin("G:\Hybrid\avisynthPlugins\AddGrainC.dll")
LoadPlugin("G:\Hybrid\avisynthPlugins\dfttest.dll")
LoadPlugin("G:\Hybrid\avisynthPlugins\DirectShowSource.dll")
LoadPlugin("G:\Hybrid\avisynthPlugins\EEDI2.dll")
LoadPlugin("G:\Hybrid\avisynthPlugins\eedi3.dll")
LoadPlugin("G:\Hybrid\avisynthPlugins\FFT3DFilter.dll")
LoadPlugin("G:\Hybrid\avisynthPlugins\mt_masktools-26.dll")
LoadPlugin("G:\Hybrid\avisynthPlugins\mvtools2.dll")
LoadPlugin("G:\Hybrid\avisynthPlugins\nnedi.dll")
LoadPlugin("G:\Hybrid\avisynthPlugins\nnedi2.dll")
LoadPlugin("G:\Hybrid\avisynthPlugins\nnedi3.dll")
LoadPlugin("G:\Hybrid\avisynthPlugins\RemoveGrainSSE2.dll")
LoadPlugin("G:\Hybrid\avisynthPlugins\RepairSSE2.dll")
LoadPlugin("G:\Hybrid\avisynthPlugins\SSE2Tools.dll")
LoadPlugin("G:\Hybrid\avisynthPlugins\TDeint.dll")
LoadPlugin("G:\Hybrid\avisynthPlugins\VerticalCleanerSSE2.dll")
LoadCPlugin("G:\Hybrid\avisynthPlugins\yadif.dll")
LoadDll("G:\Hybrid\msvcr100.dll") # this one is new
LoadDll("G:\Hybrid\msvcp100.dll") # this one is new
LoadDll("G:\Hybrid\avisynthPlugins\libfftw3f-3.dll")
LoadDll("G:\Hybrid\avisynthPlugins\fftw3.dll")
Import("G:/Hybrid\avisynthPlugins\QTGMC-3.33.avsi")
FFVideoSource("H:\TESTCL~1\test.avi",cachefile="H:\Temp\214379433avi_deb1536f480475f7d593219aa1afd74c_41.ffindex",threads=1)
SetMTMode(2)
ConvertToYv12(interlaced=true, matrix="PC.709")
QTGMC(Preset="Placebo")
SelectEven()
distributor()
return(last)

you can also try if it helps to replace the eedi3.dll with the one from http://web.missouri.edu/~kes25c/ the one currently used if from one of the qtgmc packs (http://forum.doom9.org/showthread.php?t=156028).

Cu Selur

Ps.: also check your RAM usage QTGMC placebo will require a bunch of RAM combined with other filters this might be a problem,...

i got on here it has a msvcr100.dll = 756KB, I`m assuming there`s a difference between them.
might be, my be just different compilers with different options used,.. :)

[DJ-1]

screen of current scipt
https://www.dropbox.com/s/43rk7kbzk9wjwow/avi%20scripinuse.jpg

ok i`ll look into the RAM thing, and the other eedi3

[Selur]

Script looks like I would have expected it to look. (btw. you can copy the content of such popups with with ctr+c)
Strange thing is Avisynth Preview works fine for me with QTGMC(placebo) :/

[DJ-1]

err ok, just tried the other eedi3.dll from the other source, plus i changed it to use QTGMC Super fast (assume thats less RAM hungry)...same thing.

I look at my Task manager window, Physical Memory, Total, free Etc.

free varies a bit at around 300MB to 750MB, but does often go down to zero whilest DGDecode scans before trying to preview,....i assume then it swithches over to the pagefile?

I`ll look into getting some more RAM.

I got 4GB at the moment.

[Selur]

err ok, just ried the other eedi3.dll from the other source, plus i changed it to use QTGMC Super fast (assume thats less RAM hungry)...same thing.
Okay, than RAM definitely is not the problem. Since for anything but placebo QTGMC doesn't use eedi3.dll.

So it really is a problem with loading eedi3. (DOH, like the error said,...)
Problem is I have no clue what 'error 0x36b1' really indicates for avisynth. :(

[digitall.h]

Hi selur :)
I run Hybrid in Linux Mint KDE.
I did an encode, without subtitles, since I just wanted forced subs that where mixed with the rest of subs. So I extracted sub stream with Hybrid, converted them to a srt sub file with Avidemux, and selected the ones I want to keep in Kate.
There may be an easier way, but... :o

I then re-open Hybrid to mux the new subtitle stream. I open the mp4 I first encoded, passthrough video and audio, load chapters, and add srt subtitle.

When I run the job, it crashes at muxing time. When I run the code in command-line, it shows the error:
Option --sub-charset unknown. Please check usage

I send you the Debug, the srt file and the ttxt file that Hybrid creates, even I think the problem arrives even before the muxing, since MP4Box seems to complain about the --sub-charset switch.

[Selur]

definitely a bug in Hybrid, --sub-charset is an option of mkvmerge :) (seems like I broke it during the last refactoring)
-> will look at it :)

[digitall.h]

Thank you
:thanks:

Any comment on the way I'm remuxing a subtitle stream?. Easier or more logical way in Linux?.
[Probably a bit OFF-topic...]

[Selur]

1. you can keep the idx/sub subtitles, if your decoder software support them (mp4box and Hybrid do), no need to convert to .srt
2. sometimes enabling 'Config->Automation->On Load->Search hidden forced subttiles on DVD' also helps. (if mplayer can find the forced subs and identify them as a single stream)
3. Other than that if you need srt subtitles there's no way around 1st extracting and than OCRing the subtitles and avidemux should be fine.

Cu Selur

[Bleck]

I just installed your Hybrid software, installed over it the 64 bit addons, and when I Run it, it says "No CUDA capable video cards found. -> removing CUDA based encoding support." I have nvidia geforce 560 full cuda and opencl capable...

[Selur]

Other users with Geforce 560 cards also complained (http://forum.selur.de/topic221-no-cuda-capable-video-cards-found-removing-cuda-based-encoding.html)
Problem is no one cared to send me the infos I needed (see: http://forum.selur.de/post2503.html#p2503) to fix the issue. :)

Cu Selur

[Bleck]

Other users with Geforce 560 cards also complained (http://forum.selur.de/topic221-no-cuda-capable-video-cards-found-removing-cuda-based-encoding.html)
Problem is no one cared to send me the infos I needed (see: http://forum.selur.de/post2503.html#p2503) to fix the issue. :)

Cu Selur

Well, I will try my best to get the error fixed. Here is my log as you said: http://tny.cz/1ae6c5df

And proof about my GPU:

http://gpuz.techpowerup.com/12/12/22/8ue.png

[Selur]

I just installed your Hybrid software, installed over it the 64 bit addons
If you installed Hybrid through the installer you already have the 64bit addons. :) -> people always overlook the second par of 'Hybrid Windows Packages: (not needed if the installer is used)' :D

Will send you a link to test version which should detect GeForce GTX 560 als CUDA capable shortly :)
->Please report back if the CUDA encoder works on your gpu, otherwise I'll remove the GeForce GTX 560 again from the list of compatible cards again. :)

[Bleck]

Im just now testing your build. Does cuda works with all the provided codecs? bcause i cant see the option to enable / disable.

[Selur]

No, the cuda support is only needed/used for the "CUDA H.264" encoder which is basically a small wrapper around the nvenc library provided by NVIDA with through their CUDA SDK.
Hybrid has no other means to use your CUDA graphic card. (sadly there's no free cuda video decoder that can output the decoded video stream to stdout, this way one could feed other encoders with it.)

Cu Selur

[Bleck]

Now the program loads without any message about CUDA errors. But I have some problems here.

No 10-bit option:

http://s10.postimage.org/cva0kl6bt/problem1.png

Only one colorspace:

http://s10.postimage.org/qequqakax/problem2.png

I can't choose 10 and 11 subme (I always use 11):

http://s10.postimage.org/d0dru9dmx/problem3.png

[Selur]

No 10-bit option && Only one colorspace
Look at x264->Main->Restriction Settings and select an AVC Profile which supports other color spaces and precision, e.g. High10 or Unrestricted.
Unlike other GUIs Hybrid does not start with AVC Profiles set to unrestricted.

I can't choose 10 and 11 subme (I always use 11):
either apply a preset that support it (x264->Main->Restriction Settings->Preset)
or make sure
1. x264->Quantization->Advanced Quantization Settings->Adaptive quantization is not set to 'disabled'
2. x264->Quantization->Advanced Quantization Settings->Trellis is set to always
both are required to use subme 10 and 11, see:
-m, --subme <integer> Subpixel motion estimation and mode decision [7]
- 0: fullpel only (not recommended)
- 1: SAD mode decision, one qpel iteration
- 2: SATD mode decision
- 3-5: Progressively more qpel
- 6: RD mode decision for I/P-frames
- 7: RD mode decision for all frames
- 8: RD refinement for I/P-frames
- 9: RD refinement for all frames
- 10: QP-RD - requires trellis=2, aq-mode>0
- 11: Full RD: disable all early terminations source: x264 --fullhelp

Cu Selur

Ps.: please test the CUDA H.264 encoder so I can know if you card is supported or not,...

[Bleck]

Oh sorry, I forgot that. Trellis was @ 0 lol... Well, then, all is running fine, and the program is nice! Thanks you for the support.
edit: How can I test your CUDA encoder? As i said, there is no reference about it anywhere. (Log, commandline, status...). The program start without error alerts anyway.

[Selur]

Well, then, all is running fine, and the program is nice!
Does the CUDA H.264 encoder work? (please try to reencode a small sample with it)

[Bleck]

I will encode a sample and try to find any changes on encoding speed / log messages that tell me CUDA is working / running.

[Selur]

If the encoding doesn't crash when started it is working, but normally x264s superfast&ultrafast presets are faster and look better on modern PCs.

[Bleck]

I was unable to encode. The x264 crashed without reason. My log:

Log Messages
grabbing tool versions,..
finished grabbing tool versions,..
Finished initialization,...
Filtering input files,..
-> finished filtering input files
analyzing: hl2 2012-12-21 13-20-26-93.avi
grabbing audio ids...
-> audio ids found: 1
analyzing audio streams...
grabbing video ids for: hl2 2012-12-21 13-20-26-93.avi
-> video ids found: 0
analyzing video streams...
starting auto routines for container number: 1
-> finished auto routines for 1.
Input is completely analyzed,...
Filtering input files,..
-> finished filtering input files
analyzing: Untitled.avi
grabbing audio ids...
-> audio ids found: 1
analyzing audio streams...
grabbing video ids for: Untitled.avi
-> video ids found: 0
analyzing video streams...
starting auto routines for container number: 1
-> finished auto routines for 1.
Input is completely analyzed,...
There's no profile C:\Users\Developer\AppData\Roaming\hybrid\profiles\audio\.xml
Creating job for source 1 and title: 1,...
-> Creating jobs for source 1,...
-> Generating calls for: C:\Users\Developer\Desktop\Untitled_Title_1.mp4
createJobs for C:\Users\Developer\Desktop\Untitled_Title_1.mp4
Added new job with id 16_11_43_6110
Creating job for source 1 and title: 1,...
-> Creating jobs for source 1,...
-> Generating calls for: C:\Users\Developer\Desktop\Untitled_Title_1.mp4
createJobs for C:\Users\Developer\Desktop\Untitled_Title_1.mp4
createJob audio...
Added new job with id 16_12_21_5510
ffmpeg started...
Starting Main@16:12:23.302:
"C:\Program Files\Hybrid\ffmpeg.exe" -y -threads 8 -i "C:\Users\Developer\Desktop\Untitled.avi" -vn -ac 2 -ar 48000 -acodec pcm_s16le -f mov "C:\Users\Developer\Desktop\iId_1_aid_1_DELAY_-43ms_16_12_21_5510_01.mov"
finished after 00:01:43.819
finished...

Created C:\Users\Developer\Desktop\iId_1_aid_1_DELAY_-43ms_16_12_21_5510_01.mov (32.5496 MB)
Faac started...
Starting Main@16:14:07.359:
"C:\Program Files\Hybrid\faac.exe" -b 112 -c 48000 -w -o "C:\Users\Developer\Desktop\_iId_1_aid_1_DELAY_-43ms_16_12_21_5510_02.aac" -
finished after 00:00:10.577
finished...

deleted C:\Users\Developer\Desktop\iId_1_aid_1_DELAY_-43ms_16_12_21_5510_01.mov
x264 (1st pass bitrate) processing started...
Starting Main@16:14:17.952:
"C:\Program Files\Hybrid\x264.exe" --demuxer auto --input-csp 4:2:2 --no-interlaced --output-csp i420 --pass 1 --bitrate 3072 --profile high --ref 1 --no-mixed-refs --keyint 250 --min-keyint 0 --scenecut 40 --bframes 8 --b-bias 0 --b-pyramid normal --direct auto --b-adapt 2 --ratetol 2 --cplxblur 20 --qcomp 0.6 --mbtree --rc-lookahead 60 --qblur 0.5 --ipratio 1.4 --pbratio 1.3 --chroma-qp-offset 0 --qpmin 0 --qpmax 69 --qpstep 4 --partitions none --no-8x8dct --8x8dct --no-dct-decimate --me dia --mvrange 512 --subme 2 --cabac --trellis 0 --weightp 2 --aq-mode 2 --aq-strength 1 --nr 0 --deadzone-inter 21 --deadzone-intra 11 --cqm flat --threads auto --sar 1:1 --deblock 0:0 --stats "C:\Users\Developer\Desktop\16_12_21_5510_04.stats" --fps 25 --output NUL "C:\Users\Developer\Desktop\Untitled.avi"
-> 16_12_21_5510_04_video crashed:main send out an error: QProcess::Crashed
main send out an error: QProcess::Crashed
finished after 00:02:57.368 with exitCode -1073741819
Crash: 1

This can be related to my other crashes: http://forum.doom9.org/showthread.php?t=166743
I really need alternative to the Sony Packed YUV codec... x264 seems to hate it.