LAV Filters - DirectShow Media Splitter and Decoders

[robpdotcom]

Do you only have the problem if the file is .m2ts? Do mkv files work fine?

[dead_screem]

I'm not talking about actually decoding the subtitles, all i planned was take the subtitle data, and output it untouched to the subtitle renderer (if any) - and if no-one wants it, just discard it.

Is there any reason why you can't have LAV's MPEG-2 Decoder handle them as DVD subpictures properly instead of relying on an external filter like dvobsub? especially if ffmpeg already supports it?

[Midzuki]

Is there any reason why you can't have LAV's MPEG-2 Decoder handle them as DVD subpictures properly instead of relying on an external filter like dvobsub? especially if ffmpeg already supports it?

The FFmpeg source-code for dealing with DVD subtitle pictures is not good-enough yet:

http://forum.doom9.org/showthread.php?p=1431125#post1431125

http://forum.doom9.org/showthread.php?p=1431370#post1431370

[nevcairiel]

Is there any reason why you can't have LAV's MPEG-2 Decoder handle them as DVD subpictures properly instead of relying on an external filter like dvobsub? especially if ffmpeg already supports it?

It certainly could, however is that really wanted?
I guess the quality argument isn't really valid, since DVD subs are ugly no matter what. Being a bit blurry would probably do them some good. :p

Regarding the ffmpeg issues, it would be a perfect opportunity to just fix them, wouldn't it. :)
PS: What you linked seems to refer to ffdshow, which does not use ffmpegs renderer, AFAIK.

The real issue is that the MPC-HC ISR and DirectVobSub don't natively support DVD Subpictures, even though its the same format as VobSub, just without the configuration header. When you force-feed it to them, it'll just be terribly ugly, because it doesn't have a default palette to get colors from.

Another option would be to just do what the MSDN thinks you should do, and render the subtitles, and output them as AYUV or ARGB32, which the renderer then should blend on the image. Sadly, this is only supported by EVR/VMR, and madVR lacks that functionality.

[madshi]

Another option would be to just do what the MSDN thinks you should do, and render the subtitles, and output them as AYUV or ARGB32, which the renderer then should blend on the image. Sadly, this is only supported by EVR/VMR, and madVR lacks that functionality.
That's on my to do list. Was already requested by the J.River MC16 developers. Of course I don't know when I'll find the time to implement that.

[nevcairiel]

I'll just go with piping the subtitles through the filter first, and see how it goes. Other options can be explored at a later time.

[SeeMoreDigital]

Do you only have the problem if the file is .m2ts? Do mkv files work fine?
The same thing happens with .MKV contained files...

I'm off to work now so I'll have to try GraphEdit when I get back....

[dead_screem]

It certainly could, however is that really wanted?yes. that way you can always be sure it'll work, assuming you implement it right. no worrying about external filter or renderer support.

Another option would be to just do what the MSDN thinks you should do, and render the subtitles, and output them as AYUV or ARGB32, which the renderer then should blend on the image. Sadly, this is only supported by EVR/VMR, and madVR lacks that functionality.
ummm, no. that's only for dvd line 21 cc or other things.
msdn says the dvd decoder should handle and mix video and subpicture together and output one video pin and another cc out pin for line 21 decoder 2, which needs vmr/emr. (or line 21 decoder which uses overlay)
http://msdn.microsoft.com/en-us/library/windows/desktop/dd388593(v=VS.85).aspx

I'll just go with piping the subtitles through the filter first, and see how it goes. Other options can be explored at a later time.well if it works, assuming the dvd navigator will not refuse like that. not exactly the best way to do it imo.

[nevcairiel]

yes. that way you can always be sure it'll work, assuming you implement it right. no worrying about external filter or renderer support.
I would however prefer not to start adding subtitle rendering, which is why i would prefer to just delegate rendering to a dedicated subtitle renderer.


ummm, no. that's only for dvd line 21 cc or other things.
msdn says the dvd decoder should handle and mix video and subpicture together and output one video pin and another cc out pin for line 21 decoder 2, which needs vmr/emr. (or line 21 decoder which uses overlay)
http://msdn.microsoft.com/en-us/library/windows/desktop/dd388593(v=VS.85).aspx

That article is rather old, probably from the times of VMR7/Overlay mixer, where the new option to alpha-blend streams in the renderer was not available.
MS's own MPEG-2 decoder will render the subtitles into a ARGB or AYUV plane, and send those to EVR - allowing a higher quality and more efficient blending done in the GPU.

[dead_screem]

That article is rather old, probably from the times of VMR7/Overlay mixer, where the new option to alpha-blend streams in the renderer was not available.
MS's own MPEG-2 decoder will render the subtitles into a ARGB or AYUV plane, and send those to EVR - allowing a higher quality and more efficient blending done in the GPU.

actually it's from xp/vista era vmr9/evr. there is an article about vista dvd enhancements, but nothing about vobsubs that way. is that method new to win7?

[nevcairiel]

Its not from Vista, or it would at least have mentioned the EVR, which was the new default renderer there, all it talks about is VMR and Overlay, which means XP.
MS's own MPEG-2 decoder also did not exist on XP, you needed a third-party decoder back then AFAIK, so its pretty clear that they didn't really care to add a smart way to handle subtitles.

[dead_screem]

Its not from Vista, or it would at least have mentioned the EVR, which was the new default renderer there, all it talks about is VMR and Overlay, which means XP.

http://msdn.microsoft.com/en-us/library/windows/desktop/dd388614(v=VS.85).aspx pageabout vista specifics.

http://msdn.microsoft.com/en-us/library/windows/desktop/dd318241(v=VS.85).aspx page about building the graph which mentions Overlay, VMR-7, VMR-9 and EVR.

so yes, it pertains to vista as well.

[nevcairiel]

All that means is that the one page was updated after Vista release, that does not mean the first page was written with Vista in mind.

In any case, if i ever add rendering of the dvd subpictures, it'll most likely not be soon.
I don't believe the decoder painting onto the video image is a good solution, ever.

[madshi]

What need is there for discussion if Microsoft's own MPEG2 decoder clearly outputs an additional ARGB/AYUV pin for DVD subpictures? That pretty much tells us what Microsoft thinks is the best way to go. End of story.

[Midzuki]

PS: What you linked seems to refer to ffdshow, which does not use ffmpegs renderer, AFAIK.


So, my guess is, the MPC-HC filters, libavcodec, ffplay, mplayer, and libmpeg2, they all do share a lot of "garbage source-code" :rolleyes: :D

[Superb]

The Microsoft DTV-DVD Decoder only outputs the AYUV/ARGB stream if it decodes using DXVA.*
On other cases (software decoding) it renders the subtitles to the frame itself.
But you guys should take into account the fact that MPC-HC doesn't create an input pin for AYUV/ARGB on its EVR/EVR-CP! That's why I cannot watch DVDs w/ subtitles there.
One would have to fix the pins creation if you want to go the AYUV/ARGB way. This issue was reported a LONG time ago on MPC-HC's trac. Can't find the ticket now... :/
EDIT: I think that fixing it requires adding a call to IEVRFilterConfig::SetNumberOfStreams

* I might be mistaken and it always outputs when connected to DXVA-enabled renderer (like EVR), which in turn also activates the MPEG-2 DXVA decoding on my machine.

[nevcairiel]

So, my guess is, the MPC-HC filters, libavcodec, ffplay, mplayer, and libmpeg2, they all do share a lot of "garbage source-code" :rolleyes: :D

Just because there is one bug with those half-D1 discs doesn't make everything garbage, the avcodec decoder (which is also in use by ffplay) looks pretty clean (code-wise), and fixing such bugs would surely be possible.
If you can, share a sample of those files, so that i can try to avoid the bug when i work on it.

MPC-HCs and ffdshows probably are just garbage, though. =)

[SeeMoreDigital]

Please do me a favor and give it a go with GraphStudio or GraphEdit this time:

File Source (async) > Lav Splitter > Lav Video > EVR
> Lav Audio > Def. D.Sound

And pls. tell me the result.
Hmmm... I can't get GraphStudio to connect to either of the following audio filters :eek:

http://img840.imageshack.us/img840/4986/graphstudio.png


This is crazy!

[nevcairiel]

You didn't activate bitstreaming which your hardware does not support?
Thats really the only reason the connection would completely fail.

[Midzuki]

Come on, Nevcairiel, I didn't say (and I didn't mean) they are 100% garbage, I said (and meant) they still contain many lines of copied-n-pasted b0rked code.

As for the "killer samples" --- it's pretty trivial to create some of them with your favorite DVD-authoring freeware :)

[nevcairiel]

Come on, Nevcairiel, I didn't say (and I didn't mean) they are 100% garbage, I said (and meant) they still contain many lines of copied-n-pasted b0rked code

Its more likely just some feature not implemented.

As for the "killer samples" --- it's pretty trivial to create some of them with your favorite DVD-authoring freeware
Sure i could do that, but then someone that cares could also try to help out, which might actually make me fix the problem, otherwise i might just ignore it :p

[Midzuki]

OK, you win. :rolleyes:

[SeeMoreDigital]

You didn't activate bitstreaming which your hardware does not support?
Thats really the only reason the connection would completely fail.

If you are referring to my posts, I can confirm I have been able to use your filters to bit-stream HD audio to my Onkyo amp... which also supports HD audio!

After further tests, I've found I can't even get "std-def" AC3 and DTS audio to connect to LAV audio...

[Gleb Egorych]

nevcairiel,

During testing 0.39.15 I found the hang bug had returned (can be reproduced by holding S key in Zoom Player). Release 0.39 seems to be OK.

[Pat357]

Hmmm... I can't get GraphStudio to connect to either of the following audio filters :eek:
To go back to your problem with LAV-splitter not being used to open .m2ts & .mkv files, can you please check the following keys in your registry :
[HKEY_CLASSES_ROOT\Wow6432Node\Media Type\Extensions\.m2ts]
"Source Filter"="{B98D13E7-55DB-4385-A33D-09FD1BA26338}"
and
[HKEY_CLASSES_ROOT\Wow6432Node\Media Type\Extensions\.mkv]
"Source Filter"="{B98D13E7-55DB-4385-A33D-09FD1BA26338}"

The value "Source Filter={B98D13E7-55DB-4385-A33D-09FD1BA26338} means that lav-splitter-(source) will be used to open .m2ts / mkv files.
If there is another value at this keys, just reinstall the LAV-filters and make sure these types are checked during installation.
IIRC, these values are only written to the registry when installing, not when you check/uncheck these in the Lav-splitter settings tab after installation.

[SeeMoreDigital]

Well would you "Adam and Eve" it...

After de-installing "LAV", re-booting, re-installing "LAV" and re-booting... I'm now able to bit-stream HD audio to my amplifier again :)

Computers eh?

[nevcairiel]

During testing 0.39.15 I found the hang bug had returned (can be reproduced by holding S key in Zoom Player). Release 0.39 seems to be OK.

Should hopefully be fixed again.

-----------------------------

Some news from the DVD front:
Accepting and just eating up the subtitles seems to do the job, DVDs play fine now. Did need some trickery though, but all in all, its playing the dvds just fine. It is lacking the interactive menu overlays of course, and subtitles won't show.

Considering the subtitles are used to render the button overlays as well, i'm kinda partial to the idea of drawing them directly onto the frames, in case no renderer accepts the AYUV/ARGB pictures. Forwarding the still encoded subtitles wouldn't work in this case.

[Pat357]

Well would you "Adam and Eve" it...

After de-installing "LAV", re-booting, re-installing "LAV" and re-booting... I'm now able to bit-stream HD audio to my amplifier again :)
Computers eh?
I guess something messed up your Lav-filters....
Did you install some other multi-media package or other codes after the last time you installed Lav-filters using the installer ?
Does Lav-splitter now get used when you open .m2ts / .mkv files ?

note : uninstalling Lav-filters probably was not needed, just reinstall over the existing installation should have done the trick, as long as you use the installer.

[SeeMoreDigital]

I guess something messed up your Lav-filters....
Did you install some other multi-media package or other codes after the last time you installed Lav-filters using the installer ?
Just the latest version of DVDFab Decrypter.


Does Lav-splitter now get used when you open .m2ts / .mkv files ?No...

[rica]

Hmmm... I can't get GraphStudio to connect to either of the following audio filters :eek:

http://img840.imageshack.us/img840/4986/graphstudio.png


This is crazy!

Yes it is, this is why i asked you to use GraphStuff to test.
The weird thing is why we do see speakers instead of blabla AVR in your case?
Checkout my listed audio renderers. Do you see any "speakers" statement? Are you sure Onkyo AVR (or whatsoever you have?) is selected by default on your playback devices? Or just speakers?

http://img21.imageshack.us/img21/7864/59105027.png (http://imageshack.us/photo/my-images/21/59105027.png/)


Not sure your AVR is connected to your PC properly or recognized properly by your PC.

The last test you should do to be sure, pls try this and forget bitstreaming for a while:

http://img208.imageshack.us/img208/2675/51597263.png (http://imageshack.us/photo/my-images/208/51597263.png/)

And last question: why don't you get rid of those Realtek drivers?

_ _

[rica]

If you are referring to my posts, I can confirm I have been able to use your filters to bit-stream HD audio to my Onkyo amp... which also supports HD audio!

After further tests, I've found I can't even get "std-def" AC3 and DTS audio to connect to LAV audio...

Pls tell us what your problem is?

After i've explored this post i'm not able to make any comment since i understood nothing?
You are able to use lavfilters to bitsream HD audio?
But you can not bitstream SD audio?
But what "even" means here???
I should understand normally "i can not bitsream HD even SD audio".... or what???

What is yor HW? Dunno?
How you connected your unknown AVR to your PC? Dunno?
What is your problem really? Dunno?

[nevcairiel]

You should learn to read, he said his problem was already fixed.

[SeeMoreDigital]

Yes my issue has been fixed.

Many, many thanks to everyone who kindly offered help and their suggestions. It's much appreciated.

Thank-you again...

[Aleksoid1978]

Hi Nevcairiel. LAV Video 0.39 have trouble with playback this sample in Software mode(with CUVID play fine)
http://www.multiupload.com/ZGDZFMT4Q0
play with ~43fps and micro jitter.

0.38 and 0.37 play fine.

[nevcairiel]

LAV Video 0.39 have trouble with playback this sample in Software mode(with CUVID play fine)
http://www.multiupload.com/ZGDZFMT4Q0
play with ~43fps and micro jitter.


No change in my code would cause this, seems like a ffmpeg regression, if it is indeed a bug. It doesn't say its failing to decode, it just doesn't give any frames back.
I'll try to look into it, but reporting it to them is a good idea no matter what.

Edit: I found the offending commit, its http://git.videolan.org/?p=ffmpeg.git;a=commitdiff;h=ea2bb12e3e47baa0f8d50ef68be678f425c7e4cf if anyone cares. :p

[STaRGaZeR]

Another bug report here. This file (SFD, MPEG-1 + ADX) fails to decode smoothly if splitted with LAV Splitter. MPC's internal splitter plays it fine. Screenshots and file:

http://i42.tinypic.com/esnmut_th.png (http://i42.tinypic.com/esnmut.png) http://i43.tinypic.com/zn4n0o_th.png (http://i43.tinypic.com/zn4n0o.png)
LAV Splitter ---------------- MPC's internal

http://www.mediafire.com/?tur04krbed4fdc4

[nevcairiel]

This file (SFD, MPEG-1 + ADX) fails to decode smoothly if splitted with LAV Splitter. MPC's internal splitter plays it fine.

Fixed locally, thanks for reporting!

[mylle]

Im going to put in my new GT430 (instead of ATI 5770) today.

Should i just dl the latest driver from Nvidia or is there a preferred driver?

regards
Jacob

[nevcairiel]

Latest are usually fine.

[STaRGaZeR]

Fixed locally, thanks for reporting!

No prob, thanks for fixing it :)

[joe42]

This VC1 clip (from Bleak House) fails to play from MPC-HC when using the LAV Video decoder (also fails with MadVR video decoder). It plays fine with the WMVideo Decoder DMO.

http://www.mediafire.com/?njfncwonawz6pea

[nevcairiel]

This VC1 clip (from Bleak House) fails to play from MPC-HC when using the LAV Video decoder (also fails with MadVR video decoder). It plays fine with the WMVideo Decoder DMO.

http://www.mediafire.com/?njfncwonawz6pea

Without looking at the file, i guess its interlaced, and thus not supported.

Edit:
After looking at the file, i'm sure its interlaced.
Use the MS decoder. ;)

[Gser]

I'm curious as to what IDCT LAV video uses to decode MPEG2?

[nevcairiel]

I'm curious as to what IDCT LAV video uses to decode MPEG2?

Whatever is ffmpegs default IDCT, something they call "simple IDCT"

[zerowalker]

I can´t play raw x264 files, it just shows a black screen;O
Maybe it´s not supposed to work,. but it said fixed playback in the latest changelog, so sorry if it´s not about that;O

[joe42]

Without looking at the file, i guess its interlaced, and thus not supported.

Edit:
After looking at the file, i'm sure its interlaced.
Use the MS decoder. ;)

Do you mean the WMVideo Decoder DMO?

Is there a way to set the LAV decoder to only decode non-interlaced VC-1?

Because otherwise it seems kind of useless to include VC-1 decoding at all, since it messes up the filter preferences.

To clarify, if I put LAV Video decoder at the top of the filter list in MPC-HC, so it gets used for anything it can do, then WMVideo Decoder DMO beneath it in the filter list, is there any way that I can set things up so LAV Video decoder handles non-interlaced VC-1, but it automatically lets WMVideo Decoder DMO handle interlaced VC-1?

[jmone]

No - it is either On or Off for VC-1 decoding & I thought it was off by default in LAVVideo. Another choice is that if you have a nvidia card you can enable CUVID Mode as it handles VC-1(i) perfectly fine. FYI - there were some post a few weeks ago about the addition on VC-1(i) support in libavcodec....

[joe42]

FYI - there were some post a few weeks ago about the addition on VC-1(i) support in libavcodec....

Where was this post? I searched this thread and did not see it. Do you mean it was in a libavcodec thread?

[jmone]

Here you go .. no idea if there has been any progress on this code.

I revert all VC-1 patches because the new VC-1i decoding crashes more then it decodes anything, and if it decodes anything its only a corrupted mess - and on top of that, even introduced artifacts in previously working progressive samples.

[chaddawkins]

@nevcairiel or anyone with the knowledge to do this because i don't

this may help with thumbnail shell extension:
http://blogs.msdn.com/b/codefx/archive/2010/11/07/writing-windows-shell-extension-with-net-framework-4-c-vb-net-part-3-thumbnail-handler.aspx
http://msdn.microsoft.com/en-us/library/windows/desktop/bb774614(v=VS.85).aspx
http://msdn.microsoft.com/en-us/library/windows/desktop/bb774618(v=VS.85).aspx

i would give it a go if i knew anything about .NET Framework 4 (C#, VB.NET)
i think this may be what icaros is???