Hybrid: Input -> x264/x265/Xvid/VP8/VP9

[Selur]

decoder: libav (through ffmpeg or mencoder/mplayer)
encoder for ac3: libav (through ffmpeg) or aften depending on the settings
encoder for dts: dcaenc
Nope, since dcaenc only supports 16 and 32 bits per sample
Yes, it can. Depending if you select Encoding or Filtering you can set "Audio Encoding Options" or the "Audio Filtering", both are applied to the output.
Normally Hybrid does the following steps during reecoding:

Extract raw audio from input
Decode audio to raw audio and feed it to sox
Filter audio with sox and feed the output to the encoder
Encode the audio with the encoder

(+ potentially some renaming calls here and there)
big vs. little endian -> http://en.wikipedia.org/wiki/Endianness


Cu Selur

[Music Fan]

Thanks.
I don't understand anything to big vs. little endian, how to choose ?

[Selur]

Normally it depends on what you need. They are basically just two representations of the same thing.

[Music Fan]

I need to open it in an audio editor.

[Selur]

Then use the format the audio editor supports,... (probably doesn't matter)

[Music Fan]

Ok, I will test both with a short extract.

[Music Fan]

Hybrid don't want to create the job, here is a part of the message I get : "empty audio queue while audio handling! = ignore" which is not true, audio is set on custom and video on ignore (I opened a dts file).

And the extension added is MKV, can't we export in wave ?

[Music Fan]

Something else : when I put my mouse on the arrow on the right of audio (in main tab), I see a subtitle info window instead of audio (but the good info window opens when mouse on audio, I mean the text on the left).

[digitall.h]

Hi selur, hi all,
I'm sorry to add confusion to the thread with another question...

I'm trying to create a mp4 from a DVD I authored some time ago.
Using last Hybrid Linux 64bit version from Aug 4th.
Hybrid identifies correctly tracks, selects the correct one. I passthrough video (mpeg2) and audio (mp2), add subtitle, chapters, tags, and when I add the job Hybrid hangs at "Running through delaycut" step. I see in log several Time 00:00:01.332; Frame#= 52. Uncomplete frame...SKIPPED
Time 00:00:01.358; Frame#= 53. Unsynchronized frame...SKIPPED 152 bytes. Found new synch word
so I decide to avoid the delaycut analysis (I know the audio track are OK) and in Config>Input I select "Ignore delay from input" but Hybrid keeps generating the delaycut step in the job. I also tried deselecting "Use delaycut to fix delays" and "Fix positive delay through ffmpeg" with no effect, Hybrid adds always the delaycut step and hangs at that step.

How can I force Hybrid to avoid the delaycut step?.

Send you Debug. Thanks

[Selur]

If you send me an email, at least also send a link to the topic it refers to. :)
Like I wrote in my answer email: disabling "Audio->Misc->Handling->Auto fix for mp4" should help

[Music Fan]

Have you seen my questions posted on August 13 ?

[Selur]

No missed that, sorry. :)

And the extension added is MKV, can't we export in wave ?
sure you can extract to wav.

Set .raw as output extension and if the input is not already wav/pcm, set pcm as audio format.

[Music Fan]

Ok, and what about this ?
Hybrid don't want to create the job, here is a part of the message I get : "empty audio queue while audio handling! = ignore" which is not true, audio is set on custom and video on ignore (I opened a dts file).

[Selur]

Just setting the audio to custom doesn't add anything to the audio queue.
So, if you have an empty audio queue and audio handling is not set to ignore, Hybrid will warn you about that, since it assumes that you did want to put something in the audio queue. :)

[Music Fan]

Ok, I forgot it didn't work like video, we also have to add to queue in audio tab, now it's ok.;)
But there is another problem : Hybrid is blocked on 0 % for the "extracting audio as pcm/wav using ffmpeg" operation (state is started). I chose pcm 24bit little endian for output (my dts is in 48/24).
Anyway, that's not very important for me because I found yesterday how to decode dts with eac3to, but this could be important for others ...

[Selur]

Does not freeze or does it just not show the progress?
DebugOutput?

[Music Fan]

Seems freezed, file is not created and next operation is still waiting while it should be done for a few minutes (the file is very short, it's just to test dts decoding with Hybrid).
Do I have to close Hybrid or I copy the debug file when Hybrid is running and blocked on 0 % ?
Where do I put this debug file ?
I chose level 3.

[Selur]

> Where do I put this debug file ?
upload it to pastebin or similar

> Do I have to close Hybrid or I copy the debug file when Hybrid is running and blocked on 0 % ?
you don't have to close Hybrid

> Seems freezed
taskmanager should show if ffmpeg/mencoder/... is still active

[Music Fan]

ffmpeg yes, but I don't see mencoder.
Here is the file ;
http://pastebin.ca/2432224

[Selur]

normally either ffmpeg, mencoder or mplayer is used for decoding of raw audio, so you should only see one. ;)

helperCall: "C:\Program Files\Hybrid\ffmpeg.exe" -y -analyzeduration 100M -probesize 100M -threads 4 -v -10 -i "H:\eng.dts" -ac 6 -f sox -
mainCall: "C:\Program Files\Hybrid\sox.exe" --multi-threaded --temp "P:\Temp" --buffer 524288 -S -t sox - --endian little -b 24 -t w64 ".w64"
-> output name isn't set properly

[Music Fan]

I typed your helperCall, I see a lot of weird signs in the dos window, not text, and it makes crash the dos window, I can't stop it, even with the task manager.:o

output name isn't set properly
You mean by Hybrid or me ?

[digitall.h]

If you send me an email, at least also send a link to the topic it refers to. :)
Like I wrote in my answer email: disabling "Audio->Misc->Handling->Auto fix for mp4" should help
I'm sorry, silly me. I thought it would be obvious, my post, my mail,...
But of course you try to fix several reports while you develop, so it is easier if we identify ourselves. :o:o

I'll try "Auto fix for mp4" in my next encode.
Thanx

[Selur]

@Music Fan: by Hybrid
"I typed your helperCall, I" -> LOL ;) the output of the helper call is normally piped to the main call, its the decoded audio :D

@digitall.h: main problem was, that I didn't get an email notification since forum was down ;)

[bejita7]

Hi, I'm using Hybrid for Windows rev 2013.08.04.1 with Avisynth Extension 2013.07.29 and I have problem with encoding from interlaced .ts file. Encoding gets aborted with error message "file.264 is too small" (.264 file in Temp dir is 0 bytes size).

here's video file and debug:
http://www.sendspace.com/filegroup/fkJhw35M%2BwB%2BCpQsWA7B8w

[Selur]

a. Does the avisynth preview work?
b. Did you enable: Config->Input Decoding->Prefer FFmpeg?

[bejita7]

a. Didn't work first time after install, but works now
b. I enabled Prefer FFmpeg now, but no difference, still the same error

[Selur]

I found the problem, will send you a fix in a few minutes. :)

[bejita7]

Wow, quick support :D

[bejita7]

Your fix worked, but now I'm getting warning message "GlobalDataModel get ->found no field 32bitffmpeg2" before encoding.
New debug if you need: http://www.sendspace.com/file/iysxe4

[Selur]

Sorry, my bad, I was changing some stuff will and made a typo ;)
will send you a new version

[bejita7]

Now everything is ok, thanks for help :)

[bejita7]

Another question, regarding audio delay. Hybrid detects audio delay in .ts file correctly, howewer audio in encoded video is slightly desynced. I tried passthrough and reencode, also tried delaycut but it's no go.
Debug: https://dl.dropboxusercontent.com/u/19663801/HybridDebugOutput.zip

Maybe I'm imagining things, but compare TS with encoded mkv, look at piano keys :D
TS: https://dl.dropboxusercontent.com/u/19663801/rosenstrauss.ts
MKV: https://dl.dropboxusercontent.com/u/19663801/rosenstrauss_encoded.mkv

[Selur]

Busy atm. will look at it tomorrow, in general I normally trust the delays Hybrid uses (you can see the detailed calls and delays it uses in the Job-tab if you disable 'Minimize job command lines'. :)
Desync might be due to some broken frames/headers or non constant time codes in the ts.
You can try if it helps to first, remux the ts to mkv with mkvmerge (this will keep the timecodes) and enable Config->Automation->On Load->Always extract timecodes from mp4/mkv/flv files.

[bejita7]

Oh, you don't have to hurry, this is low priority question :)
Btw, I remuxed ts with mkvmerge, loaded mkv to Hybrid, and it now says that video is VFR...and it looks weird
http://i.imgur.com/2OOoRK1.png
when I encode this, the output file plays at super speed xD

[Selur]

What happens with the mkv file is:

MediaInfo reports:
Frame rate mode : Variable
Original frame rate : 29.970 fps
but no length info for the video stream, Hyrid then assumes there is something wrong and analyses the mkv with ffmpeg which reports:
Stream #0:0: Video: h264 (Main), yuv420p, 1440x1080 [SAR 4:3 DAR 16:9], 59.94 fps, 59.94 tbr, 1k tbn, 59.94 tbc (default)
so Hybrid assumes the video is:
59.94 interlaced vfr video (interlaced + vfr = evil combination)
then you selected ivtc and end up with the preview :)

Why did you enabled IVTC? From the look of it the content is normal interlaced not telecine.
(Hybrid should not have enabled IVTC, but show " Detected interlaced Material with 29,../59,.. fps, but didn't detect the material to be telecine." in the log)

Also there seems to be a problem with the time code on remuxing.
Problem is that the input is interlaced and the time codes are on a per field basis. Hybrid not takes the time codes of the input an attached them to the output which is frame based, so the time codes don't match and you end up with wrong speed for the output. :/
Tried a few settings, and the best output was: http://www.embedupload.com/?d=1HOQBYCQSD
Which I got by using the avisynthExtension (QTGMC as deinterlacer and LibavVideoSource as Input filter)
-> I'm not sure how to tackle this problem better in Hybrid, so personally I would try to run the transportstream through a tool like videoredo or DVR-Studio which are ment to cut and fix transportstreams (which hopefully will output a cfr stream) before trying to reencode it.

[Music Fan]

To remux correctly interlaced AVC from ts to mkv (I mean to avoid VFR), first demux the TS with TSMuxer, then load elementary streams in MKVmerge and specify the good fps (50i, 60i or 60000/1001i).
Then verify with MediaInfo, it should be seen as CFR, as the original TS.
Then load it in Hybrid.

[bejita7]

@Selur: I didn't enable IVTC manually, just clicked magnifier icon in Filtering tab and it changed to IVTC after autoanalysis. Should I not use this?
@Music Fan: thanks, mkv works normally if I mux it that way.
But I did something different: I fixed ts file with QuickStreamFix in videoredo (it found errors), loaded fixed ts into Hybrid, deinterlaced with Yadif-fast and encoded. Output file is 29.970 fps CFR and it's perfectly synced.

[Music Fan]

Is the using of QuickStreamFix in Videoredo the only difference compared to your encoding that played at super speed ?
If yes, it means that Videoredo probably does a better job than TSDoctor because the TS files I repaired with TSDoctor are detected as VFR when remuxed in MKV if not demuxed first with TSmuxer.
Could you please load in MKVmerge a TS repaired with Videoredo (without demuxing it) and see if it's detected as VFR or CFR by MediaInfo ?
Thanks !

[Music Fan]

Is the using QuickStreamFix in Videoredo the only difference compared to your encoding that played at super speed ?
If yes, it means that Videoredo probably does a better job than TSDoctor because the TS files I repaired with TSDoctor are detected as CFR when remuxed in MKV if not demuxed first with TSmuxer.
Could you please load in MKVmerge a TS repaired with Videoredo (without demuxing it) and see if it's detected as VFR or CFR by MediaInfo ?
Thanks !

[Music Fan]

Is the using QuickStreamFix in Videoredo the only difference compared to your encoding that played at super speed ?
If yes, it means that Videoredo probably does a better job than TSDoctor because the TS files I repaired with TSDoctor are detected as CFR when remuxed in MKV if not demuxed first with TSmuxer.
Could you please load in MKVmerge a TS repaired with Videoredo (without demuxing it) and see if it's detected as VFR or CFR by MediaInfo ?
Thanks !

[Selur]

@bejita7: That's strange, the analysis of the sample always return interlaced and not telecine for me, but happy you managed to get the file working properly by repairing it.

[DJ-1]

hi, this may be possible in Hybrid, but not got program to hand at the moment to check..

Example: source file with dts-ma audio
some devices dont play nice with dts - ma / even dts core.

if i want to process the audio so that i produce 2 output audio streams (under different audio profiles) is there a way of automating that or would it be manually added 2nd track under audio tab each time?

eg: i would end up with 1st audio streams high quality, 2nd audio stream (same audio source) of a different profile for compatibility of older playback devices.

thanks.

Sent from my HTC One using tapatalk

[Selur]

you could enable: Audio->Misc->Handling->Add passhtrough for reencode (before)
this way, whenever you add a reencode of a stream Hybrid should also add the original stream to the AudioQueue

[Music Fan]

I'm sorry for my triple post above, I didn't see this when I posted this message.

[Selur]

Hybrid rev 2013.09.01.1:
*changed*

analyse: adjusted analyse to when tsMuxeR is not resent or can't be used
audio: only handle ac3, dts and wav audio with delaycut (too many problems with mp1/mp2/mp3 compatible audio)
automation: when extracting all subtitles, extract them all in one go for m2ts and mkv
jobs: joining audio extraction calls into one if possible (downside: more temporal space is required, upside: audio extraction is faster)
x264: disable profiles below High10, if bit depth is not 8

*added*

avisynth: InterFrame, RGBAdjust, Camcorder Chroma Denoise (requires avisynthExtension update)
jobs: option to change the priority of a running/stopped/paused job (->of all it's subjobs). (not recommend)
mac: keyboard input was not captured properly
misc: option to enable ssl mail/irc communication and added field inside the gui to set the mail/irc settings
misc: option to minimize job calls; this will combine extraction calls for mkvextract, ffmpeg and tsMuxeR (sadly I haven't found a way to extract multiple streams with mencoder or mplayer) if possible
tools: warning regarding fonts if some fonts are present on Mac OS X

*fixed*

avisynth: handling avisynth input with ffmpeg
audio: trueHD -> ac3 extraction when ffmpeg was used on Windows
input: switching between mpls files caused problems
input: mpeg file extension not properly detected due to typo
input: chapter selection for DVD and Blu-ray
input: DVD + 'auto add (first)' did sometimes not work properly
filter: deinterlacing wasn't always deactivated when both forced and auto deinterlacing were disabled (and the input scan type was detected as interlaced or telecine)
model: inconsistent model state in combination with cut support
mux: avi -> avi video passthrough
preview: Blu-ray preview on Mac OS X
subtitle: input dialog did not filter the files by extension
subtitle: subtitle names where of if the name contained multiple '.'s
tagging: problems with audio tagging on structure generation
tools: MediaInfo wasn't detected properly on Linux
vp8/9: arnrMaxFrames was limited to 25 instead of 15 ;)
x264: mediaInfo import, qmin was ignored due to typo
x264: command line imported could crash when vbv-maxrate or vbv-maxbuffer was used
x264: minimize CL missed some settings it could hide


-> downloads: http://www.selur.de/downloads

Cu Selur

[digitall.h]

Hybrid rev 2013.09.01.1:
...
I missed that!.
10 days late :o
I'll download and test.
I keep having the Hybrid not extracting 2 subtitle tracks problem.
I'll try and see if 09.01.1 corrects it.

:thanks:

[Selur]

do that without any further infos I couldn't have done anything anyways. :)

[digitall.h]

do that without any further infos I couldn't have done anything anyways. :)
... 'joking was me' (Joda would have said) ... of course :cool:.

I will generate a Debug with current version (probably a more formal comment :) )

And again
:thanks:

[digitall.h]

Hi selur,
I sent you a mail explaining a problem I'm finding when testing last Hybrid Linux64 version.
When I crate and run a job Hybrid starts extracting audio track with mplayer, but never ends.

Thank you for your support :)

[Selur]

Got the email and send you a reply.