LAV Filters - DirectShow Media Splitter and Decoders

[Sebastiii]

Thank you too :)

[Kurtnoise]

Hi,

The Solveig Matroska muxer requires another subtype for EAC3 streams...If you're interested w/ the discussion, look at this post (http://forum.doom9.org/showthread.php?p=1449681#post1449681). Here is a patch (http://pastie.org/1250869) I used.


Anyway, thanks for your work. :)

[n3w813]

LAVFSplitter 0.10
- Added more MOV/MP4 byte markers
- Added support for multichannel PCM tracks
- Added support for DVD LPCM tracks
- Added support for usign the ArcSoft HD decoder for DTS and TrueHD tracks
- Send the proper media type for TrueHD instead of trying to connect with AC-3
- Improved H264 frame rate detection
- Improved FLAC support
- Fix loading of files with unicode characters in their names
- Fixed timestamping issues that caused certain videos to play too fast
- Fixed M-JPEG media type
- Fixed corruption with MPEG-4 ASP (DivX/Xvid) when using the Xvid decoder

Download: 32-bit (http://files.1f0.de/lavf/LAVFSplitter-0.10.zip) & 64-bit (http://files.1f0.de/lavf/LAVFSplitter-0.10-x64.zip)

Its been quite a while, and most of those fixes have been in the repository for a long time, so i wanted to get it out before it starts to go bad!

In any case, i hope to have some more time again soon, and can work on new features.

This is GREAT!!!

LAVSplitter + Arcsoft HD Decoder + Reclock WASPI = undownsampled THD/DTS-HD/LPCM decoding to PCM :D

THANKS!!!!

[nevcairiel]

Hi,

The Solveig Matroska muxer requires another subtype for EAC3 streams...If you're interested w/ the discussion, look at this post (http://forum.doom9.org/showthread.php?p=1449681#post1449681). Here is a patch (http://pastie.org/1250869) I used.


Anyway, thanks for your work. :)

Yeah, i know that most other (de)muxers just use the AC3 subtype for EAC3. The EAC3 subtype seems to be a "custom" subtype shared by MPC-HC and ffdshow, doesn't seem to be a standard subtype defined my MS.

I do wonder however, if there are decoders that understand AC3, but not EAC3, where this would cause problems.

[Matching_Mole]

This is GREAT!!!

LAVSplitter + Arcsoft HD Decoder + Reclock WASPI = undownsampled THD/DTS-HD/LPCM decoding to PCM :D

THANKS!!!!

Wich version of Arcsoft HD decoder do you use because for myself the version that I tested in the past down sampled THD and DTS-HD.

[nevcairiel]

I actually didn't have any THD or DTS-HD with more then 48000Hz to test, but i did at least get full 24-bit and 7.1 channels in my tests. Using the latest decoder from TMT3.185

[Gser]

It does just show plain DTS as the media type but I guess that's normal for DTS-HD? ps. thx for fixing TrueHD.

[nevcairiel]

Yes, thats normal.

[bjd]

Unmolested 24bit DTSHD/True HD was available on TMT 2.x.121-> 2.x.126 before being downgraded to 16bit in TMT 2.x.128.

All subsequent versions only pumped out 16bit up until 3.x.185 which when registered in direct show using shard's custom checkactivate.dll method outputs 24bit.

On another point, I am not entirely sure the TMT 2.x.121-> 2.x.126 audiohd filter recognises media type {00002001-0000-0010-8000-00AA00389B71}, but someone else will confirm this as I have 3.x.185 now on my system.

Anyway what I will say is hats off to the people behind this splitter as it is a significant improvement on any others out there especially given the nifty codec re-negotiation when an audio stream is changed as this means we don't have to rely on one audio codec to decode all BD audio streams and can use the most suitable one for each audio stream. It has also stopped me having to mess about hacking media codes to get the Arcsoft codec to work with MPC-HC -excellent work guys.

[whurlston]

This is GREAT!!!

LAVSplitter + Arcsoft HD Decoder + Reclock WASPI = undownsampled THD/DTS-HD/LPCM decoding to PCM :D

THANKS!!!!

LPCM works for you with the ArcSoft HD decoder? It doesn't connect for me. I've modified the LAVS source to get it to connect but I don't get audio. Still working on that.

[BatKnight]

nevcairiel,

I uninstalled 0.9 and then overwrited the files with 0.10 and then run the install.bat to register the 0.10 files. (This is the same procedure I've done with all your past versions)

The thing is, with 0.10 when I open a MKV file with H264 content the video doesn't start playing. I have to click on the seek bar for MPC-HC to start playing the movie.

This doesn't not happen on MKV with VC-1 content, neither it happens on AVI with xvid.
And this also doesn't happen if I go back to 0.9.

I am using the latest ffdshow and the latest MPC-HC. This happens with and without Reclock. And FYI I am using ffdshow to decode the x264 content and ffdshow to decode the audio, too. This happens on EVR Custom and EVR Sync.

Could it be a regression on 0.10? Because you state on the changelog that you improved H264 frame rate detection and could this have messed up something?

Bat

[nevcairiel]

I dont think that change caused it. Its only supposed to change 23.976 movies that mistakenly got detected as 24.000
I can however not reproduce it. I've been using that version for quite a while already on my HTPC, and everything worked fine so far =(

Does it happen on all MKVs with H264? Or just some?
Does it happen with other containers? H264 in MPEG-TS?
Can you maybe cook up a small sample that has the problem for you?

[v0lt]

@nevcairiel

patch for support 'sowt' and little-endian "in24", "in32", "fl32", "fl64" in the mov files.
(also fixed a problem with the PCM-audio in MKV)
Method 2 "remake":
...\src\Demuxers\LAVFAudioHelper.cpp
...
CMediaType CLAVFAudioHelper::initAudioType(CodecID codecId, unsigned int &codecTag)
{
...
case CODEC_ID_PCM_DVD:
mediaType.subtype = MEDIASUBTYPE_DVD_LPCM_AUDIO;
break;
+ // support for little-endian int: 'sowt', 'in24', 'in32'
+ case CODEC_ID_PCM_S16LE:
+ case CODEC_ID_PCM_S24LE:
+ case CODEC_ID_PCM_S32LE:
+ if (codecTag == MKTAG('s', 'o', 'w', 't') ||
+ codecTag == MKTAG('i', 'n', '2', '4') ||
+ codecTag == MKTAG('i', 'n', '3', '2')) {
+ codecTag = WAVE_FORMAT_PCM;
+ mediaType.subtype = MEDIASUBTYPE_PCM;
+ }
+ break;
+ // support for little-endian float: 'fl32', 'fl64'
+ // PCMfloat64 does not work, may be not supported by system.
+ case CODEC_ID_PCM_F32LE:
+ case CODEC_ID_PCM_F64LE:
+ if (codecTag == MKTAG('f', 'l', '3', '2') ||
+ codecTag == MKTAG('f', 'l', '6', '4')) {
+ codecTag = WAVE_FORMAT_IEEE_FLOAT;
+ mediaType.subtype = MEDIASUBTYPE_IEEE_FLOAT;
+ }
+ break;
}
return mediaType;
}

WAVEFORMATEX *CLAVFAudioHelper::CreateWVFMTEX(const AVStream *avstream, ULONG *size) {
...
wvfmt->nBlockAlign = (WORD)((wvfmt->nChannels * wvfmt->wBitsPerSample) / 8);
}
}

+ //fix the error when nAvgBytesPerSec = 0 for WAVE_FORMAT_PCM and WAVE_FORMAT_IEEE_FLOAT
+ if (wvfmt->nAvgBytesPerSec==0 && (wvfmt->wFormatTag==WAVE_FORMAT_PCM || wvfmt->wFormatTag==WAVE_FORMAT_IEEE_FLOAT))
+ wvfmt->nAvgBytesPerSec = wvfmt->nSamplesPerSec * wvfmt->nBlockAlign;

if (avstream->codec->extradata_size > 0) {
wvfmt->cbSize = avstream->codec->extradata_size;
memcpy((BYTE *)wvfmt + sizeof(WAVEFORMATEX), avstream->codec->extradata, avstream->codec->extradata_size);
}
...

test build (http://www.mediafire.com/?enccycznnksltl3) with this patch

[BatKnight]

I dont think that change caused it. Its only supposed to change 23.976 movies that mistakenly got detected as 24.000
I can however not reproduce it. I've been using that version for quite a while already on my HTPC, and everything worked fine so far =(

Does it happen on all MKVs with H264? Or just some?
Does it happen with other containers? H264 in MPEG-TS?
Can you maybe cook up a small sample that has the problem for you?
M2TS and TS seem to always work fine. AVI also works.
The problem is with MKV. And not only with x264, I have at least one with VC-1 that doesn't work, and other that do, on MKV.

One thing that might help you is that, when I open the movie, MPC-HC starts but the timer is stopped at 00:00:00 and doesn't play the movie. AND, I've noticed that mpc-hc.exe is using 100% of CPU and the Memory used is rising, and rising, and rising. I guess you have a memory leak somewhere, because I've just tested all these faulty videos with 0.9 and all work fine.

Nuno

PS: I tried to cut a sample, but all the samples I've done are not faulty, and work fine. I guess mkvmerge does something that bypasses your memory leak. I could provide you a log or something. Just let me know how to generate one that contains the info you need.

[nevcairiel]

Guess i'll have to test my movie library for possible failures. I've yet to find one =/

One thing you can try though, use the .ax from 0.10, and the av* dlls from 0.9, and see if it makes any difference. Maybe its a problem with the updated ffmpeg, who knows. (I hope that works, and ffmpeg didn't change their ABI)

There are only maybe 2 potential changes i would pin this problem on, everything else is just media type changes..
If i cannot reproduce it on my end, i'll prepare a bunch of test builds later.

[BatKnight]

Guess i'll have to test my movie library for possible failures. I've yet to find one =/

One thing you can try though, use the .ax from 0.10, and the av* dlls from 0.9, and see if it makes any difference. Maybe its a problem with the updated ffmpeg, who knows. (I hope that works, and ffmpeg didn't change their ABI)

There are only maybe 2 potential changes i would pin this problem on, everything else is just media type changes..
If i cannot reproduce it on my end, i'll prepare a bunch of test builds later.
OK, I am committed to help you on this. I will test your suggestions later in the evening and let you know the results.

One other thing. Are you able to implement on your splitter something that allows scene selecting, like for movies with alternate endings on the MKV (ordered chapters, I guess)?

Nuno

[nevcairiel]

Its planned to be implemented, but its a rather complicated feature. =/

[v0lt]

nevcairiel
What is the name of a function that works with audio data (buffer, blocks)?

[nevcairiel]

I honestly have no idea what you're asking.

[v0lt]

I want to change the audio before sending the decoder. Where can I do this in code?
Understand?

[BatKnight]

Guess i'll have to test my movie library for possible failures. I've yet to find one =/

One thing you can try though, use the .ax from 0.10, and the av* dlls from 0.9, and see if it makes any difference. Maybe its a problem with the updated ffmpeg, who knows. (I hope that works, and ffmpeg didn't change their ABI)

There are only maybe 2 potential changes i would pin this problem on, everything else is just media type changes..
If i cannot reproduce it on my end, i'll prepare a bunch of test builds later.
So here's the result:

0.9 DLLs + 0.10 ax = MPC-HC crashes
0.10 DLLs + 0.9 ax = MPC-HC crashes

0.9 DLLs + 0.9 ax = MPC-HC always starts playing.
0.10 DLLs + 0.10 ax = MPC-HC leaks memory and CPU is 100% on the mpc-hc.exe process, and only plays if I click on the seek bar

Is there some kind of a log I can generate? Like a debug mode or something?

Nuno

[nevcairiel]

I figured the old dlls might crash, too bad.

I prepared two test builds, the first is plain 0.10 with the old ffmpeg, without crashing.
The second has one change reverted that in my opinion is the only change since 0.9 that could've caused this, at all.

First: http://files.1f0.de/lavf/LAVFSplitter-0.10-test-oldffmpeg.zip
Second: http://files.1f0.de/lavf/LAVFSplitter-0.10-test-2.zip

The bad thing is, if the second fixes it, then i really need a file that causes the problem to reproduce it. I've tested a whole load of my mkvs, and all play fine =/
If neither of these help, i'll add some debug logging. I currently don't have any debug file generation setup, it only outputs into a debugger...

[zicoz]

I don't seem to get any subtitles using LAVFSplitter, is this not implemented uet? I'm using Mediaportal and it's subtitle engine is based on MPC-HCs if I'm not mistaken.

[BatKnight]

I figured the old dlls might crash, too bad.

I prepared two test builds, the first is plain 0.10 with the old ffmpeg, without crashing.
The second has one change reverted that in my opinion is the only change since 0.9 that could've caused this, at all.

First: http://files.1f0.de/lavf/LAVFSplitter-0.10-test-oldffmpeg.zip
Second: http://files.1f0.de/lavf/LAVFSplitter-0.10-test-2.zip

The bad thing is, if the second fixes it, then i really need a file that causes the problem to reproduce it. I've tested a whole load of my mkvs, and all play fine =/
If neither of these help, i'll add some debug logging. I currently don't have any debug file generation setup, it only outputs into a debugger...
The first one doesn't work. Memory leak and my QuadCore show 25% CPU on MPC-HC.
The second one works! LAVFSplitter-0.10-test-2.zip plays fine, like 0.9

But it's not only bad news. I've found what's causing the problem.
This problem only happens with movies with AC3 tracks and only when using ffdshow audio decoder with jitter correction disabled.

I had to test multiple combinations and found out that only happened when ffdshow audio decoder was being used. I then uninstalled it and reverted it to defaults and it worked. So it had to be the configuration I was using, and after a few checks I nailed it down to the jitter correction.
If it's enabled (ffdshow's default is enabled) then it works. If it's disabled then it does what I reported.

I don't know if this helps you, but please test a few MKV movies with AC3 and with ffdshow's jitter correction disabled, to see if you can reproduce it.

[nevcairiel]

Thanks, i'll turn jitter correction off, and see what happens. Hopefully i can reproduce it, then i can fix it :)

Thanks for helping to track this down!

[nevcairiel]

On second thought, maybe report this to ffdshow as well, might as well be a bug in their code that i just exposed, considering it works with the option on and with other filters..

I'll look at it still, however.

[v0lt]

nevcairiel, you roll back the code? (0.10-6 -> 0.10-3)

[nevcairiel]

I moved it into a branch because its not ready for use yet.

(I know, i know, bad things happen when you change history in your git repository, but i reserve that right on my own repo)

[nevcairiel]

Good news everyone!

ffmpeg added support for AAC LATM, and i went ahead and fixed it in LAVFSplitter right away.
I don't think ffdshow can play it yet, but i do get proper sound with the MONOGRAM AAC Decoder.

This makes this the only splitter that can play AAC LATM in MPEG-TS, as far as i know, anyway.

[v0lt]

Everything is fine. I was not able to compile those versions. :)

[nevcairiel]

I don't know if this helps you, but please test a few MKV movies with AC3 and with ffdshow's jitter correction disabled, to see if you can reproduce it.

So, this worked.
I could reproduce the issue perfectly.

I also encountered some other issues, like, with jitter correction off, i dont get audio from some AAC tracks.

Is there any reason you have this off anyway? =)

The memory leak is obviously in ffdshow somewhere, but i'll go and see if i can make it play nice again from my side now.

[nevcairiel]

So i tried fixing this.
I didn't find any way to do this, that wouldn't break other files again. The change that originally broke this was a rather significant bug fix. :/
This is one of the drawbacks trying to be a multi-format splitter, every format has its quirks, and i guess this might be one of those cases. (Or its just a bug in ffdshow)

I would suggest bringing this up with ffdshow, maybe they can fix it. Or just turning on the option =)
The fact that it only breaks with ffdshow, and only when that option is turned off, does make me think that its something on their side.
In addition, you're like the only one reporting the problem, so i figure, not many people turn off the option.

I'll keep looking into it for a while, maybe i'll come up with a brilliant solution, but i really strongly suggest to talk to a ffdshow developer, or get one to contact me that is willing to fix this.

[Ger]

Good news everyone!

ffmpeg added support for AAC LATM, and i went ahead and fixed it in LAVFSplitter right away.
I don't think ffdshow can play it yet, but i do get proper sound with the MONOGRAM AAC Decoder.

This makes this the only splitter that can play AAC LATM in MPEG-TS, as far as i know, anyway.

Great news. :thanks:

[Sebastiii]

Thanks Nevcairiel for all work you do :)

[nevcairiel]

LAVFSplitter 0.11
- Smart stream pre-selection based on language, flags and quality
- Properties page for configuration (languages, stream selection logic)
- Added support for AAC LATM (single stream)
- Changed the "No Subtitles" pin to a more "friendly" Media Type
- Fixed a crash with certain AAC tracks

Download: 32-bit (http://files.1f0.de/lavf/LAVFSplitter-0.11.zip) & 64-bit (http://files.1f0.de/lavf/LAVFSplitter-0.11-x64.zip)

Like mentioned earlier, i only got AAC LATM to work with the MONOGRAM AAC Decoder. If you know for a fact that another decoder out there supports AAC LATM, and LAVFSplitter does not work with it, please say so.

Stream selection!
Its finally finished. First, you will need to re-register the splitter for the properties page to show up, or you will not be able to configure it.

Some implementation details.
First, check language codes.
If none or more then one matched, check the "default" flag.
If no "default" flag is found, pick the stream with the highest quality (quality for audio is only based on number of channels and codec. More channels = more good; losless formats (TrueHD, flac, PCM) > DTS > AC3/AAC > *)

Subtitles have no quality check, they do however have some extra logic for forced streams in there. According to the MKV spec, forced streams should always play, so i might add an option later to create a always-on pin for those, instead of putting them on the normal subtitle pin.

Note that the default and forced flags are not really set in many containers, in fact, i only know that MKV has them, not sure about any others.
Anyway, i'm sure the logic might need tweaking on some edges, so please report your expierence!

PS:
The problem with some files not starting to play and eating up memory is still there. We were able to pin point the issue to AC3 audio tracks, in conjunction with ffdshow, but only when the Jitter Correction option in ffdshow was off (default is on). So if some files are not starting for you, turn that option in ffdshow on!

[Jeffster]

Hi Nevcairiel,

First thanks for releasing a new version so quickly with AAC LATM audio support.

I tried playing some .ts capture files in MPC-HC and they worked OK, including the audio (using the monogram AAC decoder), which is a first! :)

It's not all good news though. I noticed while checking which filters were being used and the filter properties, in the Pin Info for the video decoder it said 50 fps (should be 25 fps). I thought that was odd but didn't think much more of it initially because the file played normally and checking the ffdshow properties while playing it said Movie FPS: 25.000.

But when I opened the .ts file via AviSynth using DirectShowSource and looked at the File Info it said 50 fps and the video portion played at twice normal speed. :confused:

Anyway I suspect the LATM/HE-AAC audio may somehow be the reason for the movie fps confusion because if I demux the .ts file and remux the video (H264) with a "regular" AAC file or an MP3 instead then the video fps is reported correctly as 25 fps.

[v0lt]

LAVFSplitter 0.11 crashes on some matroska files.
sample (http://www.mediafire.com/?g3rh19m32g8gy9d)

[nevcairiel]

LAVFSplitter 0.11 crashes on some matroska files.
sample (http://www.mediafire.com/?g3rh19m32g8gy9d)

No it doesn't. Works fine here.

The file comes with AAC audio. There was a crash in there before. Completly recompile your ffmpeg, if you're using a custom build, or use my build.
Unless its the same issue as detailed at the end of the post with no configured languages.

But when I opened the .ts file via AviSynth using DirectShowSource and looked at the File Info it said 50 fps and the video portion played at twice normal speed. :confused:

I actually saw that with one of my samples as well. I didn't try in AviSynth though, so i didn't see it breaking.
Initially i suspected it was because the file was interlaced (50fps interlaced, gives 25 fps progressive), i'll investigate some.


I was also notified about a crash which happens when you do not configure any languages, and open a file with subtitles.
I fixed this internally, but until i push out a new version later today, hopefully, just set a language. ;)

[v0lt]

Completly recompile your ffmpeg, if you're using a custom build, or use my build.

I used your library from the LAVFSplitter-0.11.zip

MPC-HC 1.4.2714.0 (MSVC 2008 SP1), Win7 x86.

[nevcairiel]

I guess then it is the subtitle thing i talked about. Configure some languages and turn on "only matching", or set subtitle mode to "No Subtitles" temporarily. I'll release a new version soon.

[v0lt]

Yes, the problem is due to the subtitles.

[Jeffster]

I actually saw that with one of my samples as well. I didn't try in AviSynth though, so i didn't see it breaking.
Initially i suspected it was because the file was interlaced (50fps interlaced, gives 25 fps progressive), i'll investigate some.

Thanks, they're just regular 25 fps interlaced... I know what you mean though, a couple of stations used to broadcast in 720p @ 50 fps but they don't any more.

It seems I spoke too soon unfortunately. I've had a chance to test some more .ts files now and found that some of them can't connect to an audio filter. :(

The only difference I can see is the files that work are all SD files (576i) and the files that don't work are HD files (1080i) but I can't imagine why that would make a difference. Here's a sample (http://www.mediafire.com/?clidyaj82u48jar) of one that doesn't work if you want to try it.

[Ger]

More LATM feedback:

My recordings from Norwegian DVB-T play fine with LAVFSplitter 0.11 and Monogram AAC decoder. Both SD and HD samples tested (only stereo so far).

However, the 5.1 track in this sample from Danish DVB-T (http://install.team-mediaportal.com/ts/The_Gift_-_DR_HD_-_2009-12-23.ts) has a lot of noise. The stereo track in the same sample sounds OK though. I use "Mix to stereo" in the Monogram settings.

The stereo and 5.1 tracks both sound fine in DVBViewer + Monogram AAC decoder (same mix to stereo setting).

[BelowSky]

Please nevcairiel, use InnoSetup with your files. It will makes end users' life a whole lot easier.
xhmikosr has it, but he is not always up-to-date.
http://xhmikosr.1f0.de/index.php

Thank you.

[nevcairiel]

Unzipping and hitting install.bat is so complicated? Really? :)

[hoborg]

Some 0.11 issues: (tested in Graphstudio using FFDShow)

This sample (http://hobring.esero.net/saf/lavf/bugs0.11/video(crash).zip) will crash Graphstudio (not sure if extension should be .avi or .divx)

This FLAC sample (http://hobring.esero.net/saf/lavf/bugs0.11/flac.zip) wont play - graph is created correctly, but playback wont start

This FLV sample (http://hobring.esero.net/saf/lavf/bugs0.11/flv.wrongspeed.flv) is playing at wrong speed

This MPG sample (http://hobring.esero.net/saf/lavf/bugs0.11/mpg.coruption.mpg) have coruptions on begining
This MPG sample (http://hobring.esero.net/saf/lavf/bugs0.11/mpg.mpeg-1-not_working.mpg) wont play (gray screen)

[andyvt]

Unzipping and hitting install.bat is so complicated? Really? :)

Getting the correct VC++ runtime installed can be complicated over the life of a project as different versions get released. If you use a setup project in VS, the additional effort is minimal and it can package the right runtime in the MSI and register the filter.

[BelowSky]

Unzipping and hitting install.bat is so complicated? Really? :)

Yes it is :)
Delete LAVFSplitter old folder.
Open new LAVFSplitter.zip with Winzip.
Extract and then go the extracted folder.
Run install.bat.......ERROR....... What?
Search the internet for that error, ReadMe.... etc
OK, I get it, I need to run it privileged mode.
Oh, another error... What now?
Again, search the internet for that error, ReadMe.... etc
OK, it needs VC++v10 runtimes. Do I have them installed?
Check Add/Remove manager... No nothing like that in there.
Search the Internet for that runtime.

Compare that with InnoSetup:
LAVFSplitterSetup -> Next -> Next -> Done.

which translates to:
Autorun in privileged mode -> auto download and install VC++v10 runtimes when not there -> Just update LAVFSplitter if it already installed. -> Done

[nevcairiel]

This MPG sample (http://hobring.esero.net/saf/lavf/bugs0.11/mpg.coruption.mpg) have coruptions on begining
This MPG sample (http://hobring.esero.net/saf/lavf/bugs0.11/mpg.mpeg-1-not_working.mpg) wont play (gray screen)

The issue only seems to happen with ffdshow in libavcodec mode for MPEG1/2. Switch it to libmpeg2 or use the MPC-HC internal filters, and it works flawlessly.

I'll try to fix it anyway.

[hoborg]

The issue only seems to happen with ffdshow in libavcodec mode for MPEG1/2. Switch it to libmpeg2 or use the MPC-HC internal filters, and it works flawlessly.

I'll try to fix it anyway.

You are right, thanks.

EDIT:

If i try to seek with libmpeg2, MPC-HC/Graphstudio will crash/freeze :/
Libavcodec are working fine, no freeze durning seek.