LAV Filters - DirectShow Media Splitter and Decoders

[cyberbeing]

A couple years ago I remuxed one segment to fix a missing font attachment, but I had just updated MKVToolNix and forgot to disable header removal compression. But since it worked in Haali, at that time I didn't think it was worth re-muxing, re-creating my xdelta patches, and uploading everything again [Effort].

[nevcairiel]

It'll be fixed, wasn't all that much trouble. It just didn't occur to me that it might be different.

[zerowalker]

What about the Lagarith bug?
Is it fixable by you, or is it in the hands of someone else?

Thanks:)

[cyberbeing]

Found another Ordered Chapter + Segment Linking set which causes corruption (http://imageshack.us/a/img405/1760/ordchapunknwncorruptlav.png) in LAV Splitter, but not Haali Spiltter or MPlayer2.

Not sure what's wrong with this one. Sent you a sample via PM.

One was muxed with MKVToolNix 2.9.8 and encoded with x264 r1376.
The other was muxed with MKVToolNix 2.7.0 and encoded with x264 r1240.
Encoding settings that matter look identical. Remuxing doesn't fix it.

[nevcairiel]

Looks like different stream parameters, i'm working on fixing this by re-initing the decoder on segment switches, i'll see if that fixes that sample as well.

Thanks for testing and the samples!

[robpdotcom]

What is supported?
- Ordered Chapters within one segment/file (as created by xin1generator (https://code.google.com/p/xin1generator/) for example)
- Ordered Chapters with linked segments (both in separate files, and multiple segments in the same file)
- File Linking (Prev/NextUID in the MKV headers, as created by mkvmerge's "split" feature)

Big Thanks!

I can finally get rid of Haali and ffdshow (ffdshow was still needed because of the way Haali handles TrueHD).

You can bet I'll be testing this extensively.

:thanks:

EDIT: Found a limitation. When playing linked files, you cannot navigate through the chapters. For instance, 3 files are linked, and each file has it's own chapters, they are not shown in MPC's with Navigate>Jump To. I'll provide a sample if needed.

[cyberbeing]

Found another problem sample which breaks subtitle styles when using LAV Splitter + Ordered Chapters + Segment Linking.

I'm assuming this case is caused by LAV Splitter failing to load the font attachments. Each file works properly only when played individually.

[Sample sent via PM]

[nevcairiel]

I'll provide a sample if needed.

Please do!

Found another problem sample which breaks subtitle styles when using LAV Splitter + Ordered Chapters + Segment Linking.

I'm assuming this case is caused by LAV Splitter failing to load the font attachments. Each file works properly only when played individually.


It indeed only loads the fonts from the first segment, i'll make it load fonts from all segments instead. Thanks for the sample.

[robpdotcom]

I'll have to get the sample when I get home from work tonight. If you are interested, it's easy to create:

Just link a few files via the Segment UID, and create a chapter at the start of each file. With Haali, you can navigate through these chapters.

[nevcairiel]

You mean the PrevUID/NextUID linking, without ordered chapters, right?

[cyberbeing]

Found yet another Ordered Chapters + Segment Linking sample where LAV Splitter produces corrupted video, as well as has the subtitle style issue of the previous sample.

[Sample sent via PM]

Going to hold off testing this any more until you commit fixes for the issues up to this point. A few of these are likely being caused by the same underlying problem.

[robpdotcom]

You mean the PrevUID/NextUID linking, without ordered chapters, right?


Yes. Just ordinary chapters.

[nevcairiel]

Found another problem sample which breaks subtitle styles when using LAV Splitter + Ordered Chapters + Segment Linking.

It wasn't caused by the fonts, it happens because MPC-HCs subtitle renderer is garbage (and i assume VSFilter equally so). It doesn't accept dynamically changing the style when switching between segments.

Haali works "by accident", because it initially sends the style of the main segment, which seems to work for the OP/ED as well, but LAV sends the right style at the right time, but the subtitle renderer doesn't care. I haven't found a way to make the ISR accept a style change without stopping the filter graph (which you would notice during playback, so its a no-no).

In a perfect world, this should be fixed in the subtitle renderer(s), but like thats going to happen....

[JEEB]

Haali works "by accident", because it initially sends the style of the main segment, which seems to work for the OP/ED as well, but LAV sends the right style at the right time, but the subtitle renderer doesn't care. I haven't found a way to make the ISR accept a style change without stopping the filter graph (which you would notice during playback, so its a no-no).

In a perfect world, this should be fixed in the subtitle renderer(s), but like thats going to happen....
It is pretty much general knowledge around the circles that ever made segment linked files with ASS subtitles that the styles (extradata) have to match between segments. Thus I wouldn't think that Haali level of support is problematic until the subtitle renderer(s) gets fixed (if ever).

[nevcairiel]

It is pretty much general knowledge around the circles that ever made segment linked files with ASS subtitles that the styles (extradata) have to match between segments. Thus I wouldn't think that Haali level of support is problematic until the subtitle renderer(s) gets fixed (if ever).

But they don't match, the OP/ED have simpler styles (which work for them), and the main episode has a more complex style, which appens to work for the OP/ED as well. Oh well, i made some changes to try to extract the style from the main segment, wonder how well that will work.

[nevcairiel]

Ok here is a new set of test builds:

32-bit: http://files.1f0.de/lavf/LAVFilters-0.55.3-64-gb873b9c.zip
64-bit: http://files.1f0.de/lavf/LAVFilters-0.55.3-64-gb873b9c-x64.zip

It mostly fixes corruption when linking segments which are not 100% compatible encodes, and tries to solve the subtitle style issue.

Additionally, i threw in a fix for the chapters when using linked files.

Let the testing resume? :D

[Nevilne]

These don't seem to work (3mb, readme in archive):

http://ompldr.org/vaHhweQ/testclips_linking.zip

[sneaker_ger]

It simply doesn't work with the .mka extension, it seems.

[nevcairiel]

Indeed, it currently only searches for mkv files when looking for segments, i'll extend it to include mka as well.

[cyberbeing]

In a perfect world, this should be fixed in the subtitle renderer(s), but like thats going to happen....
I've passed it on to the xy-VSFilter dev, though as JEEB mentioned, this is one of many known quirks with the creation of Ordered Chapters + Segment Linking which people have been working around for years. Essentially all Audio/Video/Subtitles track properties needed be kept mostly identical between segments, with the main segment including everything important loaded once at the beginning, so dynamic changes weren't needed mid-stream.

Was lifting this limitation entirely something you originally had planned for LAV Splitter?

[nevcairiel]

Was lifting this limitation entirely something you originally had planned for LAV Splitter?

Not really, no. I was just kinda hoping there wouldn't be hacks like this needed, and i could just go with a straight-forward implementation, and update the style as it becomes relevant.

Another thing unrelated to matroska features was me hoping to get seamless subtitle stream switching working, but i guess if i can't change format on-the-fly, i can forget about that.

[robpdotcom]

One more limitation:

When there are multiple editions, but the editions are not ordered, you cannot select editions.

Instead of uploading a clip, I just pasted a chapter file as an example - if you'd prefer a clip, I will provide one.

<?xml version="1.0"?>
<!-- <!DOCTYPE Chapters SYSTEM "matroskachapters.dtd"> -->
<Chapters>
<EditionEntry>
<EditionFlagHidden>0</EditionFlagHidden>
<EditionFlagDefault>0</EditionFlagDefault>
<EditionUID>2695343834530026418</EditionUID>
<ChapterAtom>
<ChapterDisplay>
<ChapterString>(unnamed)</ChapterString>
<ChapterLanguage>und</ChapterLanguage>
</ChapterDisplay>
<ChapterUID>14953471256282455466</ChapterUID>
<ChapterTimeStart>00:00:00.000000000</ChapterTimeStart>
<ChapterFlagHidden>0</ChapterFlagHidden>
<ChapterFlagEnabled>1</ChapterFlagEnabled>
</ChapterAtom>
<ChapterAtom>
<ChapterDisplay>
<ChapterString>(unnamed)</ChapterString>
<ChapterLanguage>und</ChapterLanguage>
</ChapterDisplay>
<ChapterUID>13489633897824555953</ChapterUID>
<ChapterTimeStart>00:02:00.000000000</ChapterTimeStart>
<ChapterFlagHidden>0</ChapterFlagHidden>
<ChapterFlagEnabled>1</ChapterFlagEnabled>
</ChapterAtom>
</EditionEntry>
<EditionEntry>
<EditionFlagHidden>0</EditionFlagHidden>
<EditionFlagDefault>0</EditionFlagDefault>
<EditionUID>8262496293820407208</EditionUID>
<ChapterAtom>
<ChapterDisplay>
<ChapterString>(unnamed)</ChapterString>
<ChapterLanguage>und</ChapterLanguage>
</ChapterDisplay>
<ChapterUID>14520086522949683345</ChapterUID>
<ChapterTimeStart>00:00:00.000000000</ChapterTimeStart>
<ChapterFlagHidden>0</ChapterFlagHidden>
<ChapterFlagEnabled>1</ChapterFlagEnabled>
</ChapterAtom>
<ChapterAtom>
<ChapterDisplay>
<ChapterString>(unnamed)</ChapterString>
<ChapterLanguage>und</ChapterLanguage>
</ChapterDisplay>
<ChapterUID>815724855595233447</ChapterUID>
<ChapterTimeStart>00:05:00.000000000</ChapterTimeStart>
<ChapterFlagHidden>0</ChapterFlagHidden>
<ChapterFlagEnabled>1</ChapterFlagEnabled>
</ChapterAtom>
</EditionEntry>
</Chapters>

[nevcairiel]

When there are multiple editions, but the editions are not ordered, you cannot select editions.

What good would that be? just different chapters? Playback will be the same - seems relatively pointless.

It would actually be fairly complicated to try to support this, so i'm not sure i want to.

[DarkSpace]

What good would that be? just different chapters? Playback will be the same - seems relatively pointless.
I don't think it would be pointless. Say you've got the DVD and the Blu-Ray version of a film, and their chapter points differ. If you want to keep both chapter points in one file so you can select the chapter points you want at playback, this feature will be useful.
Another example is wanting to keep a Blu-Ray's original chapter points while making a customized set of chapters the Default Edition.

EDIT:
It would actually be fairly complicated to try to support this, so i'm not sure i want to.
Wow, I wouldn't have thought that. In that case, it may be relatively worthless, indeed (though I still hope it'll become a low-priority feature for someone who knows how to do this to work on).

[nevcairiel]

Its only complicated because i didn't plan for this to be possible when writing ordered chapter support.
I suppose i can look into it and see if i can redesign some parts.

One limitation i'm going to stick with though - as soon as there is one ordered edition, all non-ordered editions will be inaccessible.

[DarkSpace]

I suppose i can look into it and see if i can redesign some parts.
Thank you for your time and dedication on this, even when I myself didn't consider it a big priority.
One limitation i'm going to stick with though - as soon as there is one ordered edition, all non-ordered editions will be inaccessible.
I see. I suppose it wouldn't be too complicated to turn unordered Editions into Ordered Editions, so I don't see a problem with that, but may I still ask why?

[nevcairiel]

I see. I suppose it wouldn't be too complicated to turn unordered Editions into Ordered Editions, so I don't see a problem with that, but may I still ask why?

Because switching between the two modes would rather odd, and many files have one non-ordered edition in them in the first slot which is used by players which don't support editions - do you want that to show up? Haali doesn't show it at least.

Besides, i don't think it would make much sense to mix the two concepts, and i'm always looking to keep complexity down. ;)

[dukey]

nevcairiel,
How can I get dxva with dslibbluray ? Other people get dxva .. but on my dev machine it doesn't work. Not even copy back seems to work. Cuda mode works fine though.
http://i.imgur.com/ZqnWJWh.png
I can attach other decoders and they work fine in dxva mode, coreavc, etc.

[robpdotcom]

What good would that be? just different chapters? Playback will be the same - seems relatively pointless.

lol I had a feeling you'd ask that. I mostly agree, but I found it didn't work, so I posted it.

Here's what I have used it for, just for an example:

I ripped a season of BluRay's from a TV series. On the Bluray, the first two chapters of each episode where the recap of the previous episode, followed by the opening credits. I created a second edition without the first two chapters, so you could more easily jump to the beginning of the episode. I set this edition as the default, with the original chapters as the second edition, just to preserve them.

As someone else said, though, it's not difficult to turn the editions into ordered chapters, so it's fairly easy to work around.

One limitation i'm going to stick with though - as soon as there is one ordered edition, all non-ordered editions will be inaccessible.

I agree with that.

[nevcairiel]

As someone else said, though, it's not difficult to turn the editions into ordered chapters, so it's fairly easy to work around.


As long as i only offer them when no ordered editions are available, it should be possible to do without too much complexity.

[STaRGaZeR]

nev, I have finished the Fraps repeating frame patch, works fine now. It was a stupid mistake. However I keep getting these random avutil crashes I told you a while ago, seems to happen mostly on RGB files. Here's the summary of the MPC-HC dump file:


Dump Summary
------------
Dump File: mpc-hc.exe.1.6.6.6745.dmp : C:\Program Files (x86)\Media Player Classic - Home Cinema\mpc-hc.exe.1.6.6.6745.dmp
Last Write Time: 31/03/2013 15:12:39
Process Name: mpc-hc.exe : C:\Program Files (x86)\Media Player Classic - Home Cinema\mpc-hc.exe
Process Architecture: x86
Exception Code: 0xC0000005
Exception Information: The thread tried to read from or write to a virtual address for which it does not have the appropriate access.
Heap Information: Not Present

Fraps file: http://www.mediafire.com/view/?rur1r8dkb2urrfc
MPC-HC dump file: http://www.mediafire.com/?epa178ez8cog5h5

[msoltyspl]

Because switching between the two modes would rather odd, and many files have one non-ordered edition in them in the first slot which is used by players which don't support editions - do you want that to show up? Haali doesn't show it at least.

Besides, i don't think it would make much sense to mix the two concepts, and i'm always looking to keep complexity down. ;)

A good while ago I was muxing picture dramas (7 pieces) of one anime into single file and provided two editions - one with unordered chapters just to mark the beginnings and another with ordered chapters to skip OP/ED pairs of each - so it could be watched in one go without them. Both are "viable" choices (similar case scenario to robpdotcom's one). Borderline excuse but still ;)

For the record - Haali still allows selection through filter properties.

[DarkSpace]

Because switching between the two modes would rather odd, and many files have one non-ordered edition in them in the first slot which is used by players which don't support editions - do you want that to show up? Haali doesn't show it at least.
Well, I believed that both Edition types show up in the Splitter Menu. Aside from that, this is the first time I've heard of having a non-Ordered Edition for Players that don't support Ordered Chapters.

Besides, i don't think it would make much sense to mix the two concepts, and i'm always looking to keep complexity down. ;)
I don't have a problem with keeping the complexity down in itself, but I do see a use for a mix between Ordered and non-Ordered Chapters. Say you've got a Blu-Ray that holds both the Theatrical and the Director's Cut of a movie and the Director's Cut doesn't reorder or remove content from the Theatrical version, but simply adds new scenes. In that case, a sensible approach would be to store the Theatrical Cut as Ordered Edition and the Director's Cut as a "normal" Edition.
I'm not saying that it's complicated to turn the "normal" Edition into an Ordered Edition (that's not the problem, at least for me), I'm just saying that your approach might end up breaking some files that have already been created (personally, I don't have such files yet, but I suppose I would have some if I had remuxed more discs already).

[wanezhiling]

http://www.sendspace.com/file/h8fsrc

crash when dtsdecoderdll.dll (1.1.0.8) exists.:)

[nevcairiel]

ok ok, i did some cleanup in the code, and managed to make switching between ordered and non-ordered work without all that much effort.
Only one limitation left now - you don't get multiple editions if playing linked files (Prev/NextUID-style linking), because i use a "fake" ordered edition internally to link the files, so i don't need a bunch of extra code for those. Doubtful i feel like re-writing this part as well.

[nevcairiel]

.. and the corresponding test build:

32-bit: http://files.1f0.de/lavf/LAVFilters-0.55.3-66-gb805ded.zip
64-bit: http://files.1f0.de/lavf/LAVFilters-0.55.3-66-gb805ded-x64.zip

Like i mentioned above, it should now be possible to handle ordered and non-ordered editions in the same file - with only one limitation - this does not work when files are linked (normal file-linking without ordered chapters)
Additionally, the edition selection is now only shown if there is actually more than one (visible) entry.

[DarkSpace]

ok ok, i did some cleanup in the code, and managed to make switching between ordered and non-ordered work without all that much effort.
Once again, thank you very much for all your effort.
Only one limitation left now - you don't get multiple editions if playing linked files (Prev/NextUID-style linking), because i use a "fake" ordered edition internally to link the files, so i don't need a bunch of extra code for those. Doubtful i feel like re-writing this part as well.
To be honest, I have no idea if this was ever supported at all. After all, if no Edition is marked as Default, which Edition should each Segment play? What if one Segment has two Editions and another only one? ...
Also, this "fake" Ordered Edition sounds like an elegant solution to me, and the only thing that worries me is if you use the Default Edition in Prev/Next UID linked files if one is present (though you probably do).

[nevcairiel]

the only thing that worries me is if you use the Default Edition in Prev/Next UID linked files if one is present (though you probably do).

I double-checked and actually found a typo that may have caused it to use the first edition in the file instead of the default, i'll fix it for any future builds.

[DarkSpace]

I double-checked and actually found a typo that may have caused it to use the first edition in the file instead of the default, i'll fix it for any future builds.
Impressive. And all in a day's work.
To be honest, I wouldn't have expected there to be a mistake, I just mentioned the Default Edition stuff to be sure (though, I did say that you would have it implemented already... I couldn't really know that there would be a typo), so it's very nice to see that my comment helped nonetheless!

[nevcairiel]

I'm slowly reviewing all the code that was created over the last week, so i would've hopefully found it no matter what... :p

[06_taro]

Nev, thank you for your efforts on mkv editions.

There are two things I would like to suggest:

1. According to the explanation from Steve Lhomme (http://lists.matroska.org/pipermail/matroska-devel/2013-March/004425.html) (notes added by Mosu (http://matroska.org/technical/specs/chapters/chapters/index.html#flags) in the same mailing-list thread seems different from this, I'm not sure whose is the final decision but both are different from what LAVF currently does), if I understand it correctly, when:
a. one edition is Hidden, then all the inside chapters should not be shown in the user interface;
b. one chapter is Hidden but the nested sub-chapters are not, those sub-chapters should still be visible;
c. one chapter is NOT Enabled, then all the nested sub-chapters should be skipped in the track control;
d. one chapter is Enabled but some of the nested sub-chapters are not, then only those enabled sub-chapters should be used in the virtual timeline, while other sub-chapters should still be skipped.

Currently LAV's matroskadec_haali does b and c correctly, but fail to behaviour in this way for a and d. a can be done by adding a global check for one edition whether the level=-1 chapter entry (edition) is hidden when processing chapters, or simply double check vt->chapter->Hidden || edition->Hidden, but for d, current checking of only the level=0 chapters (edition->Children[x]) might need to be changed into a recursive way.




2. According to matroska's chapter specs (http://matroska.org/technical/specs/chapters/index.html), ChapterAtom element has a sub element called ChapterTrack, in which one can use ChapterTrackNumber to specify the track UID on which the chapter is supposed to be applied. I'm not quite clear about this, but it seems if this element is present, those tracks whose UIDs are not listed in the ChapterTrackNumber should be deselected. If so, the edition/chapter should be able to control which tracks are used, and by switching editions (if all the chapters in each edition have the same value for this element) one can automatically switch tracks. This might be quite useful if several editions uses some same tracks, but have some other different tracks.

For example, if one edition uses different audio (like audio commentary) with the same video, and the virtual timeline is different from the main edition, say, missing 3min in the middle, with normal track switch we need to pad those 3min with blank audio, and will be able to access those blank if we switch to this track, while by using ordered chapter, we can still access to the blank by switch to the main(long) edition but choose the short audio track. If we force the main edition only apply to video and main audio so that commentary track is not accessible in this edition, while the second edition only apply to video and commentary audio so that main track is not accessibly in the second edition, we can avoid the access to the unintended track/edition-group.

Another example is if two menus in different version of discs uses exactly the same audio but different videos, and one loops for 3 times and the other one loops for 4 times, we can simply use edition-1 for video-1 and audio with 3 loops, and edition-2 for video-2 and the same audio with 4 loops, and one would never get video-1 with 4-loop or video-2 with 3-loop combinations.

It is also a replacement of Haali's trackset feature to control track group combinations in different editions, which is not in matroska specs and one should avoid to use.

[nevcairiel]

a. one edition is Hidden, then all the inside chapters should not be shown in the user interface;


This should be properly handled. If a whole edition is set as Hidden, it'll be unavailable completely, and as such you also won't get its chapters (because you can't switch to the edition)
The virtual timeline contains chapters, not editions, so the check there is correct.


d. one chapter is Enabled but some of the nested sub-chapters are not, then only those enabled sub-chapters should be used in the virtual timeline, while other sub-chapters should still be skipped.

Enabled is never really used because control tracks are not used, so it doesn't make sense.
In any case, Chapters which are not marked Enabled are already skipped in the virtual timeline (sub chapters are not relevant for building the virtual timeline, at least thats how i interpreted the spec, not that the spec really talks about this at all), however i don't think they are being skipped when creating the chapter-display structure, so it could be added there.

Also, why not simply remove a chapter from the one edition, instead of setting it to disabled? That would really only make sense if there was a mechanism to enable it again.


2. According to matroska's chapter specs (http://matroska.org/technical/specs/chapters/index.html), ChapterAtom element has a sub element called ChapterTrack, in which one can use ChapterTrackNumber to specify the track UID on which the chapter is supposed to be applied. I'm not quite clear about this, but it seems if this element is present, those tracks whose UIDs are not listed in the ChapterTrackNumber should be deselected. If so, the edition/chapter should be able to control which tracks are used, and by switching editions (if all the chapters in each edition have the same value for this element) one can automatically switch tracks. This might be quite useful if several editions uses some same tracks, but have some other different tracks

I'm aware of its presence, however support for this is not a high priority, mostly because i doubt any files exist.

[chano22000]

Hello,

My currrent iGPU (nforce 730i / Geforce 9300) does only bistream standard definition audio because it does not support PAP.

Q : if I switch to a recent video card (Geforce GTX 650 w/ CUDA or maybe Radeon 7750) to power madVR, will I get HD audio bitstreaming or not because of any Windows XP limitations ?

Thanks for you feedback.

[nevcairiel]

Windows XP does not support HD bitstreaming.

[chano22000]

Windows XP does not support HD bitstreaming.

Thanks nevcairiel. I had in mind that boards like the Asus Xonar were able to bitsream HD audio under windows XP and was hoping that HDMI audio on video boards would now do the same.

Thanks a lot for your work and reactiveness !

[VipZ]

Hi Nev,

There seems to be a bug within LAV's libbluray.

Whenever this is used within a VS2012 x64 application on Windows 8 it will crash the application.

MPC-BE/HC and GraphStudio Next VS2012 x64 builds all crash with LAV when opening a bdmv or mpls file.

Both your 0.55.3 official VS2010 build and my VS2012 builds crash.

Dump file if it would help, http://www.mediafire.com/?h6k5jnbx0sa25i6

[nevcairiel]

I neither have Windows 8 nor any player build with VS2012 (and a VS2012 MPC-HC on Windows 7 doesn't crash, at least). Patches welcome.

[dukey]

Hi nev,
with copy back mode
If you go h264 -> vc1 -> h264
Copy back seems to disappear and it drops back to software decoding. Is this by design ?

Edit:
Actually my bad I think last mode was mpeg2 which my card doesn't seem to support

[nevcairiel]

There seems to be a bug within LAV's libbluray.

Whenever this is used within a VS2012 x64 application on Windows 8 it will crash the application.

Try with latest Git, it was the only problem i could find without an actual test system.

[VipZ]

Try with latest Git, it was the only problem i could find without an actual test system.

Thanks it's all good now :)