Hybrid: Input -> x264/x265/Xvid/VP8/VP9

[Selur]

I will compile a Hybrid 32bit Linux Qt 4.6 build and send you a link,..

[digitall.h]

Thank you for the link to the Linux64 testing version (I was looking in Google Drive...)
...And, Yes!, autocrop is back again! :D
I will do a more complete test tomorrow (I have a long encoding ongoing :o)

Did you change many things apart from putting back resizing?

[Selur]

Did you change many things apart from putting back resizing?
'putting back resizing' -> ehhmm,.. what? I didn't change anything related to resizing,... (last few changes were all audio related)

[digitall.h]

'putting back resizing' -> ehhmm,.. what? I didn't change anything related to resizing,... (last few changes were all audio related)

Well selur, I meant cropping, cos' I had a version previous to:

Argh, found two problems:
1st the new crop mode I added, didn't work for dvd input (does now)
2nd 'only I-frames' wasn't enabled as default :/

;)

[Selur]

Ah, okay, 'resizing' totally confused me. :)

[flebber]

I got a link to a Linux 64bit test version yesterday. Couldn't run it since I still use a 32bit Debian Squeeze system. Then I fired up a live CD with a 64bit Debian SID and even then it refused to run and complained about my "outdated" glibc version (it demands on 2.14, but the current version in the Debian repo is 2.13 for SID and 2.11.3 for Squeeze). No luck so far testing your test version, but I'm pretty sure you fixed the issue with the time entry :D

You should virtualizing to test. VirtualBox is the easiest to setup and use.

[digitall.h]

With last testing version,
so long (2 full encodes)
so good :)

I don't know if it's something wrong in my settings, but Hybrid always leaves subtitle files in output folder (even if I enable "Delete subtitle..."), and an audio stream in /tmp folder.
Nothing serious, just suggesting to make it even better (if possible?)

[Selur]

Reset the Hybrid defaults, use a small example, write down the steps you use and along with the guide how to reproduce the problem send me a debug output of the process.
Otherwise I would have to start testing here like a monkey what might have been the settings&co you might have used and for that I really don't have the time.

Cu Selur

[digitall.h]

selur, if I made a generic explanation of the process it's because it happened in every encoding I have done with Hybrid, with all testing versions. I didn't pretend you started encoding like a monkey... :o, of course. I will do a small test, a step by step, and send the debug.

I wanted to ask a question, sorry me if too obvious or already answered before. Is Hybrid aware of angles, in DVD mode?. Can we select a specific angle?. Can we encode all angles, and then select later just one of them when playing?. I suppose the answer to this last question is No.

[Selur]

Is Hybrid aware of angles, in DVD mode?. Can we select a specific angle?
If the selected title of a DVD has an additional angle, there is an additional Box behind the 'Title'-Selection, which allows you to select the angle.
Note/Warning: Encoding a specific angle will only work if you are not using the avisynth extension. The extension is normally is turned off for dvd input unless 'Config->Internals->Handling->Avisynth for DVD input' is enabled. (because DGIndex/DGDecode can neither select a PGC nor an angle)

Can we encode all angles, and then select later just one of them when playing?. I suppose the answer to this last question is No.
Yes, you are right. Hybrid does not support encoding multiple angles and them join them to some mkv which uses "ordered chapters".

Cu Selur

[digitall.h]

Yes, I loaded the DVD folder with angles, and it shows the number of the angle to be selected, and context info when you put the mouse on the number telling that this is for selecting the angle.
When in Crop/Resize you press on Preview, the preview shows the selected angle, useful to decide what angle to encode!.

Related to the leaving an audio stream in /temp question, I will run a full encode tonight and send you the Debug. Some previous information, all my encodes are from DVD folder source, and I always passthrough the spanish audio track. The demuxed audio track, with a name finishing in *_01.ac3, that is then converted to *_02.ac3 after being adjusted in DelayCut, that *_01.ac3 track is the one left undeleted in /temp.
Hybrid says it deletes some *_01.ac3.log.
Don't know if this is of any help.

[Selur]

When in Crop/Resize you press on Preview, the preview shows the selected angle, good to decide wh ....
What?

[digitall.h]

I believe I accidentally pressed enter key when writing my post.
Now it's complete.

[Selur]

Ah, okay, will look at it tomorrow evening and report back, in regards to the undeleted files, it's probably a small mistake and easy to fix.

Cu Selur

[digitall.h]

selur, I did a full encode, DVD folder mode, to send you a Debug to show the problem with remaining files after finishing encode.
But I came across a new problem, and send you the Debug to give you more info.
The step-by-step is selected DVD folder - browse to DVD folder - select custom in audio - select my profile in x264 tab (in my profile I just changed preset to veryslow and film, and create QP) - in audio tab select passthroug spanish audio and add it - in main tab select add english sub

And here comes the problem. It happened some times before, I try to add a subtitle stream, and Hybrid flash a fraction os a second and adds a strem with a very small *.idx and 0bytes *.sub
I created in avidemux a subtitle file, idx and sub, and in Hybrid I loaded this idx file without a problem (it refused to load the sub file, but loaded well the idx).
When Hybrid finished encode and tried to mux, it crashed MP4Box. When I run it in command-line, it complains about the subs stream.

My questions:
What am I doing wrong when adding sub stream?. This is not the first time it happened.
Do you know other way to obtain the subs from a DVD folder, to be added manually to Hybrid?. I wonder about a solution for Linux ecosystem.

A final doubt, I muxed in command line the streams, discarding the faulty sub stream, and it muxed well. But audio is really out of sync.

Thank you for your support

[Selur]

The step-by-step is selected DVD folder - browse to DVD folder - select custom in audio - select my profile in x264 tab (in my profile I just changed preset to veryslow and film, and create QP) - in audio tab select passthroug spanish audio and add it - in main tab select add english sub
that's not what the debug output says you did. :/
Seems like I can't really use the debugOutput you send, since you changed some stuff and some of the names do not match.
So I got no clue where which files came from,.. i might be able to figure it out if I real the 110518 lines of debug output one by one, but frankly that would cost far to much time.
-> delete old debut output files, create a new one and don't edit it!

What am I doing wrong when adding sub stream?. This is not the first time it happened.
I don't even know what you are doing,... since your descriptions does not match the debut output you send me.

I created in avidemux a subtitle file, idx and sub, and in Hybrid I loaded this idx file without a problem (it refused to load the sub file, but loaded well the idx).
That's normal. Hybrid needs a .idx and a .sub file to use a subtitle file, so if you point Hybrid to the .idx file it will automatically use the .sub file that belong to the idx file,... (based on the name)

A final doubt, I muxed in command line the streams, discarding the faulty sub stream, and it muxed well. But audio is really out of sync.
That's probably because the dvd you fed Hybrid with is not properly flagged.
Hybrid detects a 29.976 stream but since it's not flagged as telecine it uses yadif to deinterlace, which is definitly wrong in your case. "deinterlacer->ivtc - filmdint->filmdint" should be selected instead of yadif to handle telecine material.

btw. looking at the dvd it seems like there are multiple titles that could be the main movie title + a look of dummy titles:
ID_DVD_TITLE_1_LENGTH=0.500
ID_DVD_TITLE_2_LENGTH=11.000
ID_DVD_TITLE_92_LENGTH=0.500
ID_DVD_TITLE_98_LENGTH=0.500
ID_DVD_TITLE_3_LENGTH=0.500
ID_DVD_TITLE_6_LENGTH=5610.333 <- might be the main movie
ID_DVD_TITLE_23_LENGTH=5644.667 <- might be the main movie
ID_DVD_TITLE_39_LENGTH=5644.667 <- might be the main movie
ID_DVD_TITLE_4_LENGTH=0.500
ID_DVD_TITLE_5_LENGTH=0.500
ID_DVD_TITLE_7_LENGTH=0.500
ID_DVD_TITLE_91_LENGTH=33.100
ID_DVD_TITLE_90_LENGTH=16.533
ID_DVD_TITLE_96_LENGTH=179.967
ID_DVD_TITLE_97_LENGTH=0.500
ID_DVD_TITLE_88_LENGTH=18.600
ID_DVD_TITLE_89_LENGTH=5.500
ID_DVD_TITLE_8_LENGTH=0.500
ID_DVD_TITLE_73_LENGTH=417.000
ID_DVD_TITLE_9_LENGTH=0.500
ID_DVD_TITLE_10_LENGTH=0.500
ID_DVD_TITLE_11_LENGTH=0.500
ID_DVD_TITLE_52_LENGTH=408.533
ID_DVD_TITLE_83_LENGTH=10.500
ID_DVD_TITLE_12_LENGTH=0.500
.....
ID_DVD_TITLE_99_LENGTH=0.500
ID_DVD_TITLE_85_LENGTH=255.266
ID_DVD_TITLE_86_LENGTH=456.467
ID_DVD_TITLE_87_LENGTH=215.700



If you create a new debug output file with the new version (otherwise I can't help you at all), enable the debug output creation 'after' the loading of the DVD.


Cu Selur

Ps.: btw. you could try makemkv for Linux (http://www.makemkv.com/forum2/viewtopic.php?f=3&t=224) to create a mkv file of the content you want converted and then feed that mkv to Hybrid,...

[digitall.h]

OK, as I told you I edited the Debug since it was the same for 3 consecutive encodes, to make it lighter (it was much longer than 110518 lines!). I may redo the job and send you the debug. First I will try to add the subs, that are 0 byte long, and send you this debug.
Related to the multiple titles that could be the main movie, could it be the angles?. Because it happens that there are 3 angles, and 3 long titles... But I don't really know if it works this way.
In total there are 99 titles :scared:, indeed.

Ps.: btw. you could try makemkv for Linux (http://www.makemkv.com/forum2/viewtopic.php?f=3&t=224) to create a mkv file of the content you want converted and then feed that mkv to Hybrid,...
What would be the purpose of this?. I suppose you make this advice to put in mkv just those streams I need, but this can already be done in Hybrid. Do you think that makemkv will select better streams than Hybrid?. Because creating intermediate files implies needing more HDD space...

[Selur]

First I will try to add the subs, that are 0 byte long,
don't!!! if the file it 0byte nothing is in it,..

Related to the multiple titles that could be the main movie, could it be the angles?
no angles are additionally,...

What would be the purpose of this?. I suppose you make this advice to put in mkv just those streams I need, but this can already be done in Hybrid. Do you think that makemkv will select better streams than Hybrid?. Because creating intermediate files implies needing more HDD space...
makemkv can also rip DVDs probably more proper than the tool you use atm. -> take you DVD and rip it with makeMkv :)

Create the debug file like I wrote with ONE encoder not multiple! If the analysis of the dvd is left out, the debug file should be a lot shorter.
Also remember to set the deinterlacer properly,... Hybrid might also be able to detect the interlacing properly if you trigger it's interlacing analysis.

Cu Selur

Ps.: going to bed now 1am again,.. will look at this tomorrow if I get a proper debug output.

[digitall.h]

Don't worry, I'm not suggesting I will add 0 byte subs ;)
I probably explained it bad. I meant I will add all subs, that from my previous experience with this source, when extracted by Hybrid are 0 byte long.

I did not understand your statement about angles. You say that they are additionally... Do you mean that titles has nothing to do with angles?
I'm asking this because from my Windows times, when I backed up a DVD with DVDshrink, different angles were in different titles. When I see 3 titles with similar length, and there are 3 angles, I think they may be the angles. :confused:

Thank you for your suggestion to use interlacing analysis. This is exactly what I used in the test (I'm not used to interlaced sources, and I prefer some automation for this matter), but I see that the Debug was a mess.

I now understand your recommendation about makemkv, to rip DVD better.

Good dreams, see you tomorrow! ;)

[pintcat]

One small question: I was fiddling with the advanced settings for the x264 encoder aiming at producing a BluRay compatible video. There is one option which I couldn't find, generating the "--bluray-compat" parameter. I've read about this parameter being suggested if not necessary to encode BluRay friendly material. Did I just miss it or is it maybe unimportant?

[Selur]

in the main page of x264 there is anoption to enable hardware blu-ray compatibility,...which enables all settings taht are necessary for lity,...compatibility (no neeed for advanced options)

[digitall.h]

Selur,
I suppose you already know, but just in case... you've got an email ;)

[pintcat]

in the main page of x264 there is anoption to enable hardware blu-ray compatibility,...which enables all settings taht are necessary for lity,...compatibility (no neeed for advanced options)

Thanx, found it. Actually quite obvious... :o

[Selur]

I suppose you already know, but just in case... you've got an email
I replied :)

[Selur]

Hybrid rev. 2012.11.23.1

*fixed*

audio: extraction of ac3 audio from .mpg is broken in mencoder (for at least a year!) -> Hybrid now uses mplayer instead of mencoder for the extraction of audio from .mpg files
audio: handling of 7.1 thd audio
audio: mkv strecth handling '.. to speed change' was broken
audio: mkv stretch handling coding in name
audio: normalize did not take remix into account
crop: crop resolution was not updated properly in 'Avisynth'-Crop style
cosmetics: on KDE based systems QTimeEdit wasn't initialized with 'hh:mm:ss' format
filter: autocrop for dvd input
input: dvd selection start&end time got mixed up which could cause Hybrid to always encode/passthrough the whole stream
muxing: progress indication while muxing with ffmpeg
subtitle: adding subtitle from dvd to mp4
subtitle: subtitle were not deleted even if 'delete subtitle after muxing' was enabled for mp4 output
tags: tagging was broken due to file naming changes
x264: tune->animation could trigger Hybrid to enable b-frames in base profile

*changed*

audio: dts-hd core extraction now also supported for mkv content
file: language and delay extraction from file name
filter: lower stretch stream tolerance

*added*

audio: sox 'pitch' option as 'change pitch by'
dependency: Hybrid now also uses FLVExtractCL cpp to extract flv timecodes infos
output: name generation got a new option 'use chapter name'

*removed*

audio: gain sub options, after some testing anything besides '-nb' is really useless, so switching to '-nb' and removing the option



-> downloads: http://www.selur.de/downloads

Cu Selur

[digitall.h]

It looks good, selur!
:D

[pintcat]

Nice, thanx for the update. Is the FLVExtractCL tool you're talking about the one from Moitah (http://moitah.net/)?

[Selur]

Yes, I compiled static cpp version (from TheProphet, which crashes on audio extraction, but I use it only for timecode extraction) to avoid the .Net dependency for Windows and Linux here (http://forum.selur.de/topic217-flvextract-c-by-moitahtheprophet-static-build.html). (I also compiled a Mac version but since the mac version is package-only, I didn't upload it to the forum.)
I also added a link to the versions in the dependencies for Ubuntu (http://forum.selur.de/topic124-hybriddependencies-for-ubuntu.html) list.

Cu Selur

[DJ-1]

Hi, I keep getting a FIX ME(7) error, but dont know what it wants fixing???.
The log shows something about not being able to rename audio track, but I`ve also set it to `Ignore audio` and get the same FIX ME(7) error.

cheers.

Log
https://www.dropbox.com/s/obhmfvi9hvjhgk0/Hybrid%20Log.txt

[Selur]

Yes, I know what it wants fixing problem is that is is a scenario I expected to happen, but since I can't really reproduce the problem, since nobody who ever complained about it cared to post a DebugOutput. :)
-> post a DebugOutput if you want this fixed. (as a side note there are 20 of these, so if you encounter them, give me a debugOutput or at least dell me exactly what you are doing,..)

[DJ-1]

Ok, I'll get a debug output a bit later.... Not @ home atm

Sent from my Galaxy S II using tapatalk

[Selur]

That would be nice :)

[DJ-1]

ok, enabled the debug output and did the same as before....(note, I`m using the standard Global settings so to make sure i haven`t in-advertantly changed a setting i shouldn`t have...)

debug: https://www.dropbox.com/s/50ahetlz591bl2g/HybridDebugOutput.txt

i noticed that in jpeg 1 the selected title is 02:37:00 & when it finished anylising it shows as 00:01:10(070) duration.

Images: title 1 http://db.tt/GKouXTGS
Title 1a http://db.tt/beiJkktC

[Selur]

Thanks, busy atm. but will look at it tomorrow morning and report back :)

[DJ-1]

ok thanks :), i have more to add, I`m just re-creating it now:D

[DJ-1]

ok, All i did was...using the standard Global settings, i added a Blu Ray input source (Playlist folder) told it to `passthrough audio, apply a basic x264 profile (wich works fine on other source material), and hit `add to queue`..FIX ME(7) error. Hit encode anyways and it says something about not being able to name the audio track.

It did the same thing with selecting `Ignore Audio` also.... same result.

[DJ-1]

ok, thanks for the test version...i just did the exact same thing with it, i dont get any FIX ME error, but it does abort shortly after starting the queue.

thanks.

debug: https://www.dropbox.com/s/50ahetlz591bl2g/HybridDebugOutput.txt

P.S: as in the ealier jpegs i put up it still doesn`t seem to be detecting the running time of that title correctly.

[Selur]

as in the ealier jpegs i put up it still doesn`t seem to be detecting the running time of that title correctly.
No clue what you are speaking of,...
---
Argh I could one time reproduce the problem, but not a second time,..

btw. Chapter selection: 1-153 is this okay(?), seems a bit like you are loading some sort of dummy track,....


ok, All i did was...using the standard Global settings, i added a Blu Ray input source (Playlist folder) told it to `passthrough audio, apply a basic x264 profile (wich works fine on other source material), and hit `add to queue`..FIX ME(7) error. Hit encode anyways and it says something about not being able to name the audio track.

It did the same thing with selecting `Ignore Audio` also.... same result.
-> Please create a step-by-step guide I can follow starting from a reset Hybrid (Config->Defaults->Reset all Models).

Cu Selur

Ps.: Don't attach stuff to the posts here,.. I can't look at them until a moderator looks into this thread and approves them,... and until then I probably have forgotten about the attachment. (also don't attach stuff to old posts, that I will most definitely miss,..)

[DJ-1]

1: Launch Hybrid (leaving hybrid default global settings applied)

2: config tab?internals_enable debug file creation

3: main tab, and tick Blu ray input box, browse to my `playlist folder` for blu Ray input.(on my server on the LAN)

4: Selected longest title.
https://www.dropbox.com/s/nhrk9sx3gtp503r/Title%201.jpg

5: hit ok, & then let hybrid anylise the source.

6: 1 title.. With 153 chapters ( showing duratio of 00:00:00:000 to 00:00:00:070 )
https://www.dropbox.com/s/2pqflr251us3xmp/Title%201a.jpg

7: check the audio handling to 'passthrough all'

8: check the video handling to 'x264' (Default x264 profile)

9: manualy set a output filename on the Desktop

10: hit 'add to queue'... (no fix me error now)

11: hit 'start queue'.

It aborts shortly afterwards.

debug output: https://www.dropbox.com/s/50ahetlz591bl2g/HybridDebugOutput.txt

[Selur]

Okay, I know why the process crashes, but no clue what is going wrong with the title selection. Works for all the Blu-rays I got here. :(
-> will send you a build that hopefully fixes the crash to figure out why the selection is off, I need a DebugOutput of the analysis of the source.

[DJ-1]

i just tried the Latest Beta of Vidcoder, input the same Blu Ray source, title 66 (2:01.30). i cannot see a title with that number on the list when importing the playlist folder in Hybrid.

Question, Vidcoder uses the STREAM folder for Blu Ray sources, whereas your applicaton uses the Playlist folder.....Is there any particular pros/cons to using either DIR as the source?,

cheers.

[DJ-1]

Okay, I know why the process crashes, but no clue what is going wrong with the title selection. Works for all the Blu-rays I got here. :(
-> will send you a build that hopefully fixes the crash to figure out why the selection is off, I need a DebugOutput of the analysis of the source.

ok, is the Debug i sent u no good? (in post 1139)...or is it different debug? how do i get the source analysis debug?

cheers

[Selur]

afaik the PLAYLIST folder is the play to look for to get the playlist infos, no clue if or how vidcoder does it if it only looks at the STREAM folder, which only includes the m2ts files. (normally you need to know which m2ts files belong in which order together,...)

ok, is the Debug i sent u no good? (in post 1139)...or is it different debug? how do i get the source analysis debug?
No that debug is no got to know much about the source, since it starts after the source is loaded.
To learn about the source I need a debug output that starts before the source is loaded,...

Cu Selur

Ps.: you can check if Hybrid messes something up during analysing 00022.mpls by feeding it yourself to MediaInfo,..

[DJ-1]

err ok, just tried the new test version, exact same steps, aborts, `stats not created`
debug: https://www.dropbox.com/s/50ahetlz591bl2g/HybridDebugOutput.txt

P.S: just looking into getting the other analysis thing now...

[Selur]

[qutoe]err ok, just tried the new test version, exact same steps, aborts, `stats not created`[/quote]
last debut aborted because it couldn't rename a file,...

about 'stats not created':
1. What happens if you call:
"C:\Program Files\Hybrid\mencoder.exe" -lavdopts threads=4 -really-quiet -of rawvideo -o - -ovc raw -noskip -demuxer lavf -vfm ffmpeg -vf scale,format=i420 -forcedsubsonly -nosub -nosound -mc 0 "C:\Users\DJ-1\Desktop\_18_12_34_191_09.264" | "C:\Program Files\Hybrid\x264.exe" --pass 1 --bitrate 1500 --profile high --level 4.1 --direct auto --sync-lookahead 15 --weightp 1 --aq-mode 0 --stats "C:\Users\DJ-1\AppData\Local\Temp\18_12_34_191_13.stats" --fps 24000/1001 --input-res 1920x1080 --output NUL -
in a console window?
2. Does C:\Users\DJ-1\Desktop\_18_12_34_191_09.264 exist?

[Selur]

btw. you are not using the latest version I uploaded you used '2012.11.23.1' to create the debug, but I send you a link to '2012.11.26.1'

[DJ-1]

ok, not sure if did the right thing or not LOL...
but i opened that .mpls with mediainfo and exported it as .txt from mediainfo.
hope thats ok:D

https://www.dropbox.com/s/bayt1wxnwk8i3k1/00020%20mpls.txt

P.S: yes i got a .h264 file on the desktop....

gonna check the cmd now

[Selur]

[qutoe]yes i got a .h264 file on the desktop....[/quote]
Than something was preventing Hybrid from renaming the file,.. (misconfigured Firewall?)

I see the problem with the mpls file: (which probably is a broken dummy :/)
general section says:
Duration : 2h 37mn
Video section mentions 150 streams each 1mn 2s -> seems like MediaInfo is reporting the combined length instead of the length of the longest streams as length,..
-> I wouldn't use this mpls for encoding :)

[DJ-1]

btw. you are not using the latest version I uploaded you used '2012.11.23.1' to create the debug, but I send you a link to '2012.11.26.1'

oops, not sure how that happened,
still got `stats not created`

debug: https://www.dropbox.com/s/3482c8li5qbcap1/HybridDebugOutput%202012%2011%2026%201.txt

I tried using CMD to call the line you put up, but i have no clue what I`m doing in CMD :eek

[Selur]

still got `stats not created`
Try the command lines, but I wouldn't be surprised if x264 aborts since the source m2ts file is broken, since the mpls file is a fake :)