LAV Filters - DirectShow Media Splitter and Decoders

[nevcairiel]

I used the split command to split the M2TS to smaller chunks of 15MB and tried to play one of them (not the first chunk), and the AC3 track works and ffprobe recognizes it as having 5.1 channels.
But then I played the first splitted chunk, and no AC3 track. Only the following chunks play with the AC3 on it.

The AC3 stream does show for me, but it doesn't play. It doesn't show with the MPC-HC splitter either. If you play the full file, do the first ~20 seconds actually have audio on that ac3 stream?
It doesn't seem to demux any packages for that stream.

I think thats actually the problem. The MPEG-TS demuxer is limited to reading a certain amount of bytes (5.000.000 to be exact, just short of 5MB), and if it doesn't find all the codec information in that time, well, it'll just show like this.

[CruNcher]

Hmm it neither works in Graphstudio connection brakes File Source (Async)->Lav Splitter for *.mov doesn't seem to work

Yep works only via Lav Splitter Source :(

[nevcairiel]

Yes, when turning off bitstreaming and decoding the TrueHD audio, it doesn't happen and all is smooth. I'm using an ATI 5770 w/11.4 preview drivers, and the Realtek 2.55 HDMI driver.

I couldn't reproduce the problem yet -- are you using ReClock, or the default renderer? (I was using ReClock)

Edit:
Removing ReClock seems to show some timing differences, i'll check it out.

[Kurtnoise]

Nev i don't get *.mov to be parsed via File Source Async (Lav Splitter) it always fallsback to the MPC Mp4 Splitter (low merrit) *.mp4 *.ts *.m2ts *.avi *.mkv works (tested so far)
worksforme...

[CruNcher]

worksforme...

Big ouch then XP ? with the official build ?

Here is what happens for me (im tapping in the dark)

http://img848.imageshack.us/img848/2470/ouchj.png

[Kurtnoise]

Se7en 64bits - build from the current tree, compiled 10 mins ago...

[nevcairiel]

Big ouch then XP ? with the official build ?

Here is what happens for me (im tapping in the dark)


Yeah, because the splitter cares what OS its running on, oh wait.

More likely you managed to turn mp4 in the settings off. :P

[hoborg]

MOVs working for me too.

[CruNcher]

Yeah, because the splitter cares what OS its running on, oh wait.

More likely you managed to turn mp4 in the settings off. :P

I posted that *.mp4 works fine didn't i only *.mov fails so far for me but seeing more reports that it works fine for others makes me very nervous indeed ;)
And sorry but i learned to take everything into account as crazy as it might sound when debugging stuff ;)

Though failing also the connection in Direct Graph Connection Mode that is hardly explainable (as virtually nothing 3rd party can influence from outside the connection) :(

[Andy o]

I couldn't reproduce the problem yet -- are you using ReClock, or the default renderer? (I was using ReClock)

Edit:
Removing ReClock seems to show some timing differences, i'll check it out.

I wasn't using ReClock and I haven't changed the audio renderer. I tried with ReClock, and it got fixed.

[VipZ]

Yes, when turning off bitstreaming and decoding the TrueHD audio, it doesn't happen and all is smooth. I'm using an ATI 5770 w/11.4 preview drivers, and the Realtek 2.55 HDMI driver.

Out of interest, have you tried the ATI HDMI drivers? I thought they where the best to use now days. Correct me if I am wrong here though :)

I have no issues bitstreaming anything that I come across over default direct sound renderer.

[Andy o]

I'm using madVR though. With EVR-CP, you have to disable time frame correction (i.e. not the default settings) to reproduce a similar problem. Also, it only happens with mkvs with TrueHD audio created with makemkv. I remuxed with mkvmerge and there was no issue.

Re: the ATI driver, it's probably better if you use TMT5 which I understand doesn't support the Realtek one. But the Realtek has some advantages to me, and I don't use TMT5. For one, you don't have to disable sounds on Media Center (or alternatively, set your Windows mixer to stereo). Also, after pausing/seeking/jumping, sound is much quicker to resume with Realtek than with ATI, when you're bitstreaming.

[VipZ]

Hmm, I think I should try the RealTek drivers out.

[nevcairiel]

I found the root cause of these issues, MakeMKV uses a way to timestamp and pack the frames thats really flaky, in combination with TrueHDs really small frame size (0.8333ms), the timestamps get confused all the time, at least the way ffmpeg reads them.
Sadly, i could not hear/see a really big difference. The only thing i saw was the EVR-CP stats graph go all funny on me.

Anyhow, here is a build with a potential fix, which should not break anything else *crosses-fingers*

http://files.1f0.de/lavf/LAVFilters-0.24-6-g308e2fe.zip

I should really get a new mkv demuxer, stumbling around ffmpeg bugs/short-comings all the time..

Now i have watched my mkv of the ghostbusters bluray nearly twice while debugging, leaving it running while coding... :p

PS:
I still recommend using ReClock, even when bitstreaming. :)
Even when not using its main feature of adapting the audio to the video, its still a good audio renderer. :D

[SamuriHL]

It must only affect the realtek driver cause I don't have any issues with the AMD driver. I also don't have reclock installed anymore cause it breaks TMT5. Good times.

[nevcairiel]

You know, you can install ReClock without making it overwrite the TMT audio driver, yes? :)

[Andy o]

I tried the new ATI driver (11.4 is out since yesterday), which is the same as the one in 11.4 preview, and it was the same. It's weird that I'm in a minority that's having issues that others aren't having (the trouble with HAM decoding comes to mind too. Only reason that comes to mind is my hardware somehow. Chipset is old-ish (G35), and this mobo has always given me trouble (though unrelated, like sleep issues).

[SamuriHL]

You know, you can install ReClock without making it overwrite the TMT audio driver, yes? :)

Of course I know that. :) However, it's also not of much value to me since I bitstream all my audio. Kinda difficult for ReClock to do its magic when you tie its hands like that. :)

[nevcairiel]

I tried the new ATI driver (11.4 is out since yesterday), which is the same as the one in 11.4 preview, and it was the same. It's weird that I'm in a minority that's having issues that others aren't having (the trouble with HAM decoding comes to mind too. Only reason that comes to mind is my hardware somehow. Chipset is old-ish (G35), and this mobo has always given me trouble (though unrelated, like sleep issues).

Pssh, go try the new version of LAV Splitter and see if it works. :P

http://files.1f0.de/lavf/LAVFilters-0.24-6-g308e2fe.zip

[SamuriHL]

I tried the new ATI driver (11.4 is out since yesterday), which is the same as the one in 11.4 preview, and it was the same. It's weird that I'm in a minority that's having issues that others aren't having (the trouble with HAM decoding comes to mind too. Only reason that comes to mind is my hardware somehow. Chipset is old-ish (G35), and this mobo has always given me trouble (though unrelated, like sleep issues).

Damn, it's out now? Guess I need to get updating. I've been using the preview on my main HTPC. I never installed it on my laptop as this thing is REALLY picky. Don't feel bad about HAM issues. Since I switched to using MC16 I can't get HAM mode to work on my main HTPC without a nasty green line that someone in the madVR thread reported. I traced it back to using ffdshow raw for subtitles. Pity. Good thing that machine doesn't need GPU decoding. :) As for the TrueHD issue, it may be that I get it, too, but, didn't notice? Nev said he didn't hear a difference. I haven't watched too many TrueHD MKV's but I know I've tested at least one or two.

[Andy o]

http://files.1f0.de/lavf/LAVFilters-0.24-6-g308e2fe.zip

I should really get a new mkv demuxer, stumbling around ffmpeg bugs/short-comings all the time..

Now i have watched my mkv of the ghostbusters bluray nearly twice while debugging, leaving it running while coding... :p

PS:
I still recommend using ReClock, even when bitstreaming. :)
Even when not using its main feature of adapting the audio to the video, its still a good audio renderer. :D

Thanks nev, that fixed it. I also always use ReClock, but I always take it out of the equation when testing stuff. I had forgotten to enable it again when I stumbled on this.

[SamuriHL]

Hey Nev, quick question....when you release an official build...does it then make sense to up the version in GIT since all changes after the official release will be in the next official release? So that you're building up the next release with all the changes? Sorry if I'm not making sense. I just think since all fixes since the official release are technically for the next version it makes sense to bump it up in source.

[Andy o]

Of course I know that. :) However, it's also not of much value to me since I bitstream all my audio. Kinda difficult for ReClock to do its magic when you tie its hands like that. :)

To add what nev pointed out above, ReClock has saved us from some bugs, even when bitstreaming. IIRC ReClock re-enables bitstreaming with TMT3 and the Realtek driver, as well.

BTW, what about LPCM files?

[nevcairiel]

Hey Nev, quick question....when you release an official build...does it then make sense to up the version in GIT since all changes after the official release will be in the next official release? So that you're building up the next release with all the changes? Sorry if I'm not making sense. I just think since all fixes since the official release are technically for the next version it makes sense to bump it up in source.

You mean the version number shown in the dialog?
Git itself really doesnt have a version, the numbers in these file names are basically constructed like this:

0.24-6-g308e2fe

last tag (0.24), number of commits since then (6), hash tag of the latest commit (308e2fe).



BTW, what about LPCM files?
Whats with LPCM?
They should behave like any file that you actually decoded .. as they are just PCM in some special format. LAV Audio can "decode" all of them losslessly into a PCM format the renderer understands.

[SamuriHL]

To add what nev pointed out above, ReClock has saved us from some bugs, even when bitstreaming. IIRC ReClock re-enables bitstreaming with TMT3 and the Realtek driver, as well.

Oh no question. I agree there are some benefits to it even when bitstreaming in some environments. My filter chain is already complex enough without adding to it, however. :D I may revisit that again now that I finally have everything working properly in MC16.

[SamuriHL]

You mean the version number shown in the dialog?
Git itself really doesnt have a version, the numbers in these file names are basically constructed like this:

0.24-6-g308e2fe

last tag (0.24), number of commits since then (6), hash tag of the latest commit (308e2fe).


Yea, I mean the version number as in 0.24. Since all changes you're making are going into 0.25 doesn't it make sense to bump that up to the next version once you release an official build? I understand the # of commits and hash tag and agree that rocks. Just wondering about the actual build number. It's a very minor point. :) Just wondering if it made sense to bump it up after a release.

[SamuriHL]

I think he's asking me about LPCM and ReClock. Yes, that's one of the major benefits and why I wanted to use it with TMT. That forces exclusive mode. With LAVF we don't need to worry about that as it already can "bitstream" PCM anyway depending on the audio decoder you use.

[Andy o]

Damn, it's out now? Guess I need to get updating. I've been using the preview on my main HTPC. I never installed it on my laptop as this thing is REALLY picky. Don't feel bad about HAM issues. Since I switched to using MC16 I can't get HAM mode to work on my main HTPC without a nasty green line that someone in the madVR thread reported. I traced it back to using ffdshow raw for subtitles. Pity. Good thing that machine doesn't need GPU decoding. :) As for the TrueHD issue, it may be that I get it, too, but, didn't notice? Nev said he didn't hear a difference. I haven't watched too many TrueHD MKV's but I know I've tested at least one or two.
It's not "hear" though. It's dropped frames or stuttery video. And it happens with TrueHD mkvs muxed with makemkv (at least up to 1.6.7).

I got the green line when testing with PotPlayer, but the trouble I had was the dropped frames. I reported that newer madVR versions didn't have this problem in the new exclusive mode, but just barely. I can still see the buffers drop dangerously, and have to up them to at least 6. Also in windowed mode it's still a mess, and also with content higher rate 1080/24p (59i, 30p).

I like HAM cause it saves my system around 10~15W. Not a lot money-wise, but I'm a stickler for efficiency :) It's mainly cause when using HAM, clocks get fixed to UVD settings (400/900 for the 5770) and voltage to lowest. When not using HAM my clocks are normal, and voltage increases too to the max.

[Andy o]

I think he's asking me about LPCM and ReClock. Yes, that's one of the major benefits and why I wanted to use it with TMT. That forces exclusive mode. With LAVF we don't need to worry about that as it already can "bitstream" PCM anyway depending on the audio decoder you use.

It can force exclusive mode, as well? Are you talking about the LAV audio decoder?

[SamuriHL]

It's not "hear" though. It's dropped frames or stuttery video. And it happens with TrueHD mkvs muxed with makemkv (at least up to 1.6.7).


I think you know I do all my MKV's with MakeMKV and can honestly say I've not run into this problem. That is very odd.


I got the green line when testing with PotPlayer, but the trouble I had was the dropped frames. I reported that newer madVR versions didn't have this problem in the new exclusive mode, but just barely. I can still see the buffers drop dangerously, and have to up them to at least 6. Also in windowed mode it's still a mess, and also with content higher rate 1080/24p (59i, 30p).


Fortunately (?!??!) my main HTPC where I want to use HAM mode doesn't have refresh rate, uhhh, issues. I get 60. That's it. :D The green line started when I switched to MC16 and unfortunately if I want subs I have to use the ffdshow raw video filter. Turning off HAM mode works fine.


I like HAM cause it saves my system around 10~15W. Not a lot money-wise, but I'm a stickler for efficiency :) It's mainly cause when using HAM, clocks get fixed to UVD settings (400/900 for the 5770) and voltage to lowest. When not using HAM my clocks are normal, and voltage increases too to the max.

Yea, I'm with you on that one. Given that I have a 5870 cranking in there, I'd much prefer it to handle the decoding vs my quad core. Still, it works without HAM so for now I'll be doing that until I can figure out a way to get rid of the green line.

[SamuriHL]

It can force exclusive mode, as well? Are you talking about the LAV audio decoder?

I don't know what the LAVF Audio Decoder does. I don't use it because I prefer bitstreaming. However, I know it won't downsample the audio, obviously. Nev, does it use exclusive mode? The reason we're asking is cause this helps with channel mapping IMMENSELY. By using exclusive mode, the receiver will switch the channels automagically from 5.1 to 7.1, etc.

[Andy o]

Ah, I'm confused... you said this:
With LAVF we don't need to worry about that as it already can "bitstream" PCM anyway depending on the audio decoder you use.
I took it as 'LAVF' being able to do exclusive mode without ReClock. The Realtek driver has some trouble with ReClock and exclusive mode. Even though that doesn't bother me as much, it would be nice if I could try another angle.

[SamuriHL]

Oh, no, sorry, I'm using ffdshow to bitstream. My bad for the confusion. I'm using LAVF Splitter to split it but that has no bearing on PCM in my configuration.

(That's what I meant by audio decoder)

[SamuriHL]

And I'm wrong about ffdshow. :mad: It's not using exclusive mode when playing PCM!! I thought it was. I'm testing it now on a 5.1 LPCM track and receiver is still showing 7.1. Yuck.

[nevcairiel]

I don't know what the LAVF Audio Decoder does. I don't use it because I prefer bitstreaming. However, I know it won't downsample the audio, obviously. Nev, does it use exclusive mode? The reason we're asking is cause this helps with channel mapping IMMENSELY. By using exclusive mode, the receiver will switch the channels automagically from 5.1 to 7.1, etc.

Thats nothing a decoder would do. Thats all the renderers doing, and ReClock is the only reliable WASAPI (=exclusive) renderer i know.
But even when using WASAPI, it doesn't magically switch output configurations - ReClock has an option to do this for you ("Set matching speaker configuration")

[SamuriHL]

Thats nothing a decoder would do. Thats all the renderers doing, and ReClock is the only reliable WASAPI (=exclusive) renderer i know.
But even when using WASAPI, it doesn't magically switch output configurations - ReClock has an option to do this for you.

I hate my life. :) I guess I'm going to have to add ReClock back into my configuration. Man oh man this filter chain is getting complicated. :)

[Andy o]

Thats all the renderers doingI was gonna say, but you did first and I wasn't 100% sure.

But even when using WASAPI, it doesn't magically switch output configurations - ReClock has an option to do this for you ("Set matching speaker configuration")

That option is redundant when using exclusive mode though. That option used to work with previous (Realtek only, IIRC) drivers for DirectSound output, but since the bitstream-capable drivers, both ATI and Realtek (and Nvidia) don't work, so that option is mostly superfluous right now. Don't know if it's the PAP or what, but James didn't show much hope that it could be fixed.

I would be happier if I could switch channels automatically while using DirectSound, though.

[SamuriHL]

Yup, exclusive mode is equivalent to "bitstreaming" PCM. So however many channels it contains, the receiver deals with it rather than the windows audio settings. In any case, I added ReClock back in, set it to ONLY be used in MC16, and indeed it works. I get PCM "bitstreaming" now. The 5.1 movie I was testing indeed shows 5.1 on the receiver. Hurray.

[hoborg]

Hi.
I hit some LAVF audio decoder issue, but i have no idea if the problem is on MPEG-2 demultiplexer or on LAVF side.
The situation - i use GB-PVR on my HTPC as PVR and my older recordings are in .MPG format. GB-PVR have build in usage of "MPEG-2 Demultiplexer" for MPG files. The problem is that when i try to seek, sound stop to work.
It can be easily reproduced in Graphstudio: here is the video sample (https://rapidshare.com/files/459487112/interlaced.zip))
http://www.volny.cz/hoborg/demultiplexer.png
It is working fine when LAVF splitter is in use...

[nevcairiel]

Does it work when you use another audio decoder?

[hoborg]

Does it work when you use another audio decoder?

Yes, FFDshow audio decoder (libavcodec) work just fine

[CruNcher]

I might have found a explanation for my problem could somebody show his properties window of quartz when he has File Source Async loaded with a .mov file :)

http://img715.imageshack.us/img715/5018/ouch3.png

Something looks wrong :(


PS: Fixed it adding back Media Type {E436EB83-524F-11CE-9F53-0020AF0BA770} now it opens again geez i wonder what did this change :(

[BelowSky]

I've 2 question about LAV filters future:
1- Any plans for integrating a subtitle filter in it?
2- More importantly, ignoring the special case LAV CUVID, is there any chance for a "LAV Video Decoder"?

Sorry to ask these questions, but your LAV splitter and audio decoder is so freaking awesome to the point that I couldn't resist the urge to ask about a video decoder with the same level of quality. So, excuse me please :)

Edit: Uh... and maybe put the answers of these questions in FAQs so people don't ask the same question again and again.

[SamuriHL]

1) Subtitles are already handled by LAVF Splitter. The video decoder and renderer are responsible for playing them.
2) Nev will have to answer that one, but, that's where 1) would belong, if he were to create one.

[Andy o]

ffdshow and mpc hc sub renderers have some bugs with some PGS subs though, I for one wouldn't mind an alternative sub renderer.

[SamuriHL]

It also doesn't work with vobsub from EVO's. So yea, I would like a separate sub renderer myself.

[Andy o]

Nev, I'm having another weird problem. The .24 official release works fine, and also the MPC-HC splitter, but not the latest build that you posted above. I have an old mkv with a DTS (legacy) track. This track is not played (no sound, but LAVF splitter does show it in MPC-HC filters dropdown menu). If I remux it with mkvmerge 4.7.0 it does work. It was muxed with an older version. Here is the ffprobe log:

ffprobe version git-N-29373-g1da254b, Copyright (c) 2007-2011 the FFmpeg developers
built on Apr 26 2011 02:28:38 with gcc 4.5.0 20100414 (Fedora MinGW 4.5.0-1.fc14)
configuration: --prefix=/var/www/users/research/ffmpeg/snapshots/build --arch=x86 --target-os=ming
w32 --cross-prefix=i686-pc-mingw32- --cc='ccache i686-pc-mingw32-gcc' --enable-w32threads --enable-m
emalign-hack --enable-runtime-cpudetect --enable-cross-compile --enable-static --disable-shared --ex
tra-libs='-lws2_32 -lwinmm' --extra-cflags='--static -I/var/www/users/research/ffmpeg/snapshots/buil
d/include' --extra-ldflags='-static -L/var/www/users/research/ffmpeg/snapshots/build/lib' --enable-b
zlib --enable-zlib --enable-gpl --enable-version3 --enable-nonfree --enable-libx264 --enable-libspee
x --enable-libtheora --enable-libvorbis --enable-libfaac --enable-libxvid --enable-libopencore-amrnb
--enable-libopencore-amrwb --enable-libmp3lame --enable-libvpx --disable-decoder=libvpx
libavutil 51. 0. 0 / 51. 0. 0
libavcodec 53. 1. 0 / 53. 1. 0
libavformat 53. 0. 3 / 53. 0. 3
libavdevice 53. 0. 0 / 53. 0. 0
libavfilter 2. 0. 0 / 2. 0. 0
libswscale 0. 13. 0 / 0. 13. 0
[NULL @ 0x32c80] Format matroska,webm probed with size=2048 and score=100
st:0 removing common factor 1000000 from timebase
st:1 removing common factor 1000000 from timebase
st:2 removing common factor 1000000 from timebase
st:3 removing common factor 1000000 from timebase
[h264 @ 0x3ad10] Unsupported bit depth: 0
[h264 @ 0x3ad10] no picture
[dca @ 0x1764f80] Stream with high frequencies VQ coding
[h264 @ 0x3ad10] no picture
[matroska,webm @ 0x32c80] max_analyze_duration reached
[matroska,webm @ 0x32c80] Estimating duration from bitrate, this may be inaccurate
Input #0, matroska,webm, from 'time.mkv':
Duration: 01:38:24.42, start: 0.000000, bitrate: 1536 kb/s
Stream #0.0(jpn), 121, 1/1000: Video: h264 (High), yuv420p, 1920x1080, 1001/48000, PAR 1:1 DAR 1
6:9, 23.98 fps, 23.98 tbr, 1k tbn, 47.95 tbc (default)
Stream #0.1(jpn), 502, 1/1000: Audio: dca (DTS), 48000 Hz, 5.1, s16, 1536 kb/s (default)
Metadata:
title : DTS 5.1 (1536kbps)
Stream #0.2(eng), 0, 1/1000: Subtitle: ass (default)
Stream #0.3(eng), 0, 1/1000: Subtitle: [0][0][0][0] / 0x0000
Stream #0.4, 0, 1/90000: Attachment: [0][0][0][0] / 0x0000
Metadata:
filename : absci.ttf
Stream #0.5, 0, 1/90000: Attachment: [0][0][0][0] / 0x0000
Metadata:
filename : Ace.ttf
Stream #0.6, 0, 1/90000: Attachment: [0][0][0][0] / 0x0000
Metadata:
filename : Agenda-MediumItalic.ttf
Stream #0.7, 0, 1/90000: Attachment: [0][0][0][0] / 0x0000
Metadata:
filename : Goulong.ttf
Stream #0.8, 0, 1/90000: Attachment: [0][0][0][0] / 0x0000
Metadata:
filename : linkin.ttf
Unsupported codec with id 94210 for input stream 3
Unsupported codec with id 98304 for input stream 4
Unsupported codec with id 98304 for input stream 5
Unsupported codec with id 98304 for input stream 6
Unsupported codec with id 98304 for input stream 7
Unsupported codec with id 98304 for input stream 8

[nevcairiel]

Nev, I'm having another weird problem. The .24 official release works fine, and also the MPC-HC splitter, but not the latest build that you posted above. I have an old mkv with a DTS (legacy) track. This track is not played (no sound, but LAVF splitter does show it in MPC-HC filters dropdown menu). If I remux it with mkvmerge 4.7.0 it does work. It was muxed with an older version.

Did i mention that MakeMKV sucks?

In any case, my change was so simple, it really shouldn't have hurt anything *cry* .. although, one thing i didn't think about..

I'll produce a new build, lets see if something useful happens.


1- Any plans for integrating a subtitle filter in it?

No.
Subtitles in the video decoder have quite some disadvantages - they should be applied after rendering, like EVR or madVR do it now in MPC-HC.
Plus, i really don't use subtitles..


2- More importantly, ignoring the special case LAV CUVID, is there any chance for a "LAV Video Decoder"?

Yes.

[nevcairiel]

I'll produce a new build, lets see if something useful happens.


@Andy O:
Can you try this? It should still work perfectly with the TrueHD files, and hopefully fix all other cases that got broken.

http://www.mediafire.com/?5l6gwxv3l7mf8v7

[nevcairiel]

Yes, FFDshow audio decoder (libavcodec) work just fine

I think i fixed it. LAV Audio was basically receiving one sample that contained half of the previous audio frame, and half of the next. Because it failed to decode this sample, it threw it away completely - of course the next one would be missing its first half again too, and so it never managed to decode again.

I'll have to further test my fix, but it looks good so far.