LAV Filters - DirectShow Media Splitter and Decoders

[JEEB]

How are you signing the installer? Did you buy a certificate or generate one yourself?
I'm interested in the procedure, I want to sign ZP's EXEs as well and would like to understand the options.
As nev said, generally it's all about buying a certificate from an issuer that is trusted by Microsoft. Seems like the SumatraPDF developer lately bought himself one as well, you can read how he handled it here (http://blog.kowalczyk.info/article/lh6f/Buying-a-certificate-for-signing-windows-applica.html).

[madshi]

I'm using GlobalSign. Relatively affordable and allows driver signing, too. Most other certificate providers don't support driver signing.

[nevcairiel]

I used K Software as well (like the SumatraPDF guy), who resell for Comodo. Was affordable, and i don't need driver signing (they offer a separate driver certificate if one wants that)
Their root certificate is present in Windows since Windows 2000 or something, so i'm fine with that.

The weirdest part was calling their call center in the US to verify my phone number. That guy on the other end had the weirdest accent.

[Blight]

nev:
I have some issues with the new image loading code:

1. I'm aware that DirectShow can't show full-resolution 4000x3000 images, at least not on most hardware, but you seem to be scaling it under 2000 pixels (4000x3000 image to 1440x1080) and I believe directshow can handle 2000x2000 on all hardware.
2. You're not respecting EXIF orientation flags for image rotation, here's more info:
http://sylvana.net/jpegcrop/exif_orientation.html

[nevcairiel]

1. I'm aware that DirectShow can't show full-resolution 4000x3000 images, at least not on most hardware, but you seem to be scaling it under 2000 pixels (4000x3000 image to 1440x1080) and I believe directshow can handle 2000x2000 on all hardware.

I do not change the size of the images at all.


2. You're not respecting EXIF orientation flags for image rotation, here's more info:
http://sylvana.net/jpegcrop/exif_orientation.html
You're holding it wrong. :)
For that matter, a decoder is a decoder, not a image rotator.

DirectShow is not the right platform to use for primary image decoding tasks, i mostly only added it to be easily able to use it to run test patterns. Its also not complete yet, like i mentioned in the release notes it lacks 16-bit RGB output, and i also want to make it repeat the frames, instead of just sending it once.

[Blight]

nev:
Directshow is reporting this size.
When I was working with DCoder to help create his image source filter, we encountered problems in directshow with images larger than 2000x2000, this is why I brought this up.
I'm guessing the difference here is that the DCoder filter outputs RGB RAW 32bit while LAV outputs motion jpeg.

The image is being reported at a lower resolution by directshow, not sure where in the graph the extra resolution is reduced.

As far as rotation, it's part of the JPEG specification, people take pictures on the side and their camera's sensors (usually a phone) detects when they shoot side-ways and puts an orientation flag into the jpeg header.
If you'd like I can post my (not very optimized) code that handles the rotations. It's in Delphi, but if it helps, I'll be happy to post the source.

[owlsroost]

If people prefer, i can turn native dxva off for DVD decoding, so that it automatically falls back to software, and you don't happen to suffer from missing subtitles.

That would be nice to have as an option :)

Tony

[Pat357]

PS:
I already have a resizer.

You aren't talking about "swscale", are you ? :p

spanish is 7.1 while english is only 5.1, so it prefers that.
Wouldn't the LAV-spitter menu show 7.1 DTS-HD MA also as 5.1 ?

It seems that currently DTS-HD HRA will be chosen over DTS-HD MA if both are 7.1 and in the same language...

[petran79]

petran79


Try to disable Potplayer VPP.
CTRL+F->Filter->Condition: Disable
http://i45.tinypic.com/13zwz0m.png

Apparently this will solve the issue.

it already is disabled or LAV decoder would not appear at all

problem lies that it detects the video correctly and LAV is launched to decode it, just the color format appears incorrectly, specifically for this 4:4:4 video. Not so in MPC

[wanezhiling]

it already is disabled or LAV decoder would not appear at all

problem lies that it detects the video correctly and LAV is launched to decode it, just the color format appears incorrectly, specifically for this 4:4:4 video. Not so in MPC

http://i.imgur.com/79w0W.png
No problem.

Initialize your PotPlayer, and just disable PotPlayer VPP, dont change others, should work.

[kasper93]

@nevcairiel:
Please add ability to register LAV as source filter for newly added images formats and maybe http :) It can be disabled by default in instaler, but if someone want then he should be able to enable it.

Right now it's impossible to use LAV for .jpg's without register changes. It will use Generate Still Video filter, at least on XP, can't test on other right now.

[nevcairiel]

Like i explained earlier, its not meant for mainstream usage, but only as a tool for testing.

[dukey]

nev:
Directshow is reporting this size.
When I was working with DCoder to help create his image source filter, we encountered problems in directshow with images larger than 2000x2000, this is why I brought this up.


I've seen similar problems. The issue is probably to do with the renderer. You are probably trying to send images larger than it's maximum supported texture size. For older hardware that would be 2048x2048.

[egur]

Great release!
How did you tackle the menu issues with QS in dvd playback?

[nevcairiel]

Great release!
How did you tackle the menu issues with QS in dvd playback?

There were no real menu issues, i just had to EndOfStream the decoder on still-frames, but i have to do that on basically all decoders.

Had to do some fixings though:
http://git.1f0.de/gitweb?p=qsdecoder.git;a=commitdiff;h=3541fe0b83a1fb707e5e7d975eda8325d49c9a72

[nevcairiel]

Hi nev, thanks for the new version. I have packaged up the menu files for Star Wars Episode III, its ~700MB though :O They still seem to have the issues moving between the big menus, ie player seeming to freeze up, but it eventually gets out of it and moves on. Let me know and I can try to find somewhere that'll let me upload the menus, might take a month on my broadband connection though :D

Try this version, it should solve it, or so i hope!

x86: http://files.1f0.de/lavf/LAVFilters-0.53-2-g9362184.zip
x64: http://files.1f0.de/lavf/LAVFilters-0.53-2-g9362184-x64.zip

[Pat357]

@nevcairiel:
Right now it's impossible to use LAV for .jpg's without register changes. It will use Generate Still Video filter, at least on XP, can't test on other right now.
It works just fine for me without any registering : just drop the .jpg ..png, .bmp on the MPC-HC window !

[egur]

There were no real menu issues, i just had to EndOfStream the decoder on still-frames, but i have to do that on basically all decoders.

Had to do some fixings though:
http://git.1f0.de/gitweb?p=qsdecoder.git;a=commitdiff;h=3541fe0b83a1fb707e5e7d975eda8325d49c9a72

Committed the change along with many others (removed MT code to quickly enable future features). See R72.

[mark0077]

Try this version, it should solve it, or so i hope!

x86: http://files.1f0.de/lavf/LAVFilters-0.53-2-g9362184.zip
x64: http://files.1f0.de/lavf/LAVFilters-0.53-2-g9362184-x64.zip

Yeah that makes a HUGE difference. Thanks!! Theres still some parts of the menu navigation that it stutters compared to other mpeg2 decoders. Heres details incase its an easy fix for those areas too.

In SW Episode III again, following this sequence.

Open Main Menu
Click Language Selection
Language Selection animation starts
(I think theres 3 or 4 different language selection screens, this is most noticible on the one where Obi-Wan Kenobi is on the creature running, being fought by the guy on a bike)
2 seconds later, the Subtitles / Highlightable menus begin to fade in
-> In LAV Video -> The ongoing animation stutters for maybe 0.5 seconds as the highlightable menus fade in
-> In ffdshow Video -> No noticible slowdown in animation when menus fade in
-> On hardware player -> No noticible slowdown in animation when menus fade in

Other than the slight menu glitches like above, below are the only other slight issues I have noticed when trying this particular DVD.

LAV Mpeg2 Software Decoder
- 23 minutes 18 seconds into PAL version of SW Episode III - Blockyness / Image corruption seen around obi-wans head for about 0.5 seconds
- Maybe NVidia hardware decoder does something to mask them or should software decoder do this also?

LAV Mpeg2 CUVID Decoder
- Video jumping on regular intervals, maybe twice per second, only when using avisynth in ffdshow though (reported before)

ffdshow Mpeg2 Decoder
- None of the above

[AndreaMG]

@mark0077
LAV Mpeg2 CUVID Decoder
- Video jumping on regular intervals, maybe twice per second, only when using avisynth in ffdshow though (reported before)

I encountered this issue as well: Lavvideo+SVP it's no no:( The problem (at least for me) is partially solved if threads in SVP are set from auto to 8, but during chapter changes the video begins to constantly jump for A LOT of seconds. Using Cyberlink video decoder everything seems fine during chapter changes

[AndreaMG]

EDIT: Actually got it working perfectly by changing the ffdshow avisynth buffer sizes. I have always used 0/15 and its never caused problems, Changing to 0/9 somehow works perfectly now. Any idea whats specific to LAV that makes 0/15, even 0/10 go crazy :D
In my case the problem is related to the thread number (video jumps evrey second or so) and is not solved by manually changing buffer back/ahead:angry:

[petran79]

Initialize your PotPlayer, and just disable PotPlayer VPP, dont change others, should work.

filters are alreadyndisabled.
that sort of problem occured in previous versions of LAV too, eg 10-bit videos would appear as 8-bit videos with all decoders selected, not only in Potplayer. I had to select only the 10-bit decoders for it to appear correctly.
I hadnt enabled any ffdshow raw filter.

this seems to have been solved for the most part. except this video.

dont know if it has also to do with Haali Media Splitter or MadVR. should I use LAV splitter?

[aufkrawall]

Thanks for your DVD fixings, nev.
Really much appreciated.

Hmm, I wanted to ask something once..
Can't recall it yet, will come back on it later. :D

[nevcairiel]

heres still some parts of the menu navigation that it stutters compared to other mpeg2 decoders. Heres details incase its an easy fix for those areas too.

Other than the slight menu glitches like above, below are the only other slight issues I have noticed when trying this particular DVD.


Try this:

http://files.1f0.de/lavf/LAVFilters-0.53-4-gc98dd17.zip

In a perfect world, it should fix the menu stutters as well as the occasional image corruption.

Note that this build will most likely not work flawlessly with QuickSync in DVD menus, i need to change some things there to make it work again. But any avcodec based decoders (Software, DXVA) or cuvid should work fine.

Regarding AviSynth, its possible that the high decode delay of the CUVID decoder is just too much for DVD playback plus AviSynth. CUVID has to buffer quite a few frames to be efficient at decoding, and the DVD Navigator is known to not deliver too much data in advance, so if you need a bunch of frames in the decoder for buffering, and AviSynth needs more frames buffered, they might just not arrive at the renderer in time for display. Can't really change how the CUVID decoder works, but since mpeg2 is so cheap, might as well stick to software.

[Skibicki]

Without A Paddle DVD is getting stuck on the title menu.
- go to title menu
- hit scene selection
The title screen image will be frozen but when the mouse is moved a finger pointer appears when hovering over the spots where scene numbers would be.
sample - http://www.mediafire.com/download.php?7t38szk15s6oub8

[mark0077]

Try this:

http://files.1f0.de/lavf/LAVFilters-0.53-4-gc98dd17.zip

In a perfect world, it should fix the menu stutters as well as the occasional image corruption.

Note that this build will most likely not work flawlessly with QuickSync in DVD menus, i need to change some things there to make it work again. But any avcodec based decoders (Software, DXVA) or cuvid should work fine.

Regarding AviSynth, its possible that the high decode delay of the CUVID decoder is just too much for DVD playback plus AviSynth. CUVID has to buffer quite a few frames to be efficient at decoding, and the DVD Navigator is known to not deliver too much data in advance, so if you need a bunch of frames in the decoder for buffering, and AviSynth needs more frames buffered, they might just not arrive at the renderer in time for display. Can't really change how the CUVID decoder works, but since mpeg2 is so cheap, might as well stick to software.

Excellent! That build fixes the menu stutters.
AND
Software mpeg2 in LAV now doesn't show corruption at the point I mentioned. (curious, was that an ffmpeg issue?)
AND
Software mpeg2 in LAV and avisynth work perfectly together.

Thanks very much, DVD's are beginning to become pretty much perfect now. My only issues with DVD's and LAV/madVR are probably madVR related (positioning of mouse doesn't match exactly to menu items for some aspect ratios, and edges of highlights on some menu items looks sort of white / aliased)

EDIT: I think the only time I get stutters / madVR frame drops in DVD menus is when a for example, main animated menu is left running, and after the animation ends, it restarts. madVR drops a bunch of frames at this point so the restart of the animation can jerk for half a second maybe. I have madVR's (delay playback) options enabled so usually don't see any frame drops even at the start of movies, or after seeking. I'm not sure if the restart of these animation sequences is supposed to send something to retrigger things like madVR's delay playback logic? These are such small things, I'm just pointing them out as you seem on a roll of improvements today and its great to see it getting so close to perfection :D

[JarrettH]

Are there any pluses or minuses between using avcodec or cuvid strictly for MPEG2 decoding in LAV Video? Exact same thing quality wise?

[dansrfe]

Out of curiosity, what would would be required of the decoder to facilitate 3D video playback? Reconstruction of the right eye stream? Also what would the renderer need to do?

[nevcairiel]

Are there any pluses or minuses between using avcodec or cuvid strictly for MPEG2 decoding in LAV Video? Exact same thing quality wise?

The quality is the same on all decoders. The only difference is where the decoding is done, in the CPU or the GPU.

Personally i would question the usefulness of hardware decoding SD MPEG-2, my PC can probably decode it at the same CPU usage that you would get from using CUVID. :p

Out of curiosity, what would would be required of the decoder to facilitate 3D video playback? Reconstruction of the right eye stream? Also what would the renderer need to do?

That depends on what kind of 3D content you're referring to. Blu-rays, you need a decoder for H.264 MVC, and you need some kind of standard how to communicate those two images to the renderer.
The renderer then needs to figure out how to send the two images to the screen. HDMI 1.4 3D is the best choice, but since AMD, NVIDIA and Intel each have their own APIs to handle 3D, one would have to write special code for all of them. - Or just send it as (Half-)SBS, Checkerboard, or some other way that hurts image resolution, hoping the TV can figure it out.

[Joniii]

This BD doesn't work with LAV filters. It plays fine with LAV on MPC-HC but fails to play on WMP or WMC, it also reports playtime as 1200 minutes or so. It works fine with ffdshow and WMP/WMC. Dunno if it's a LAV problem or LAV+VSfilter, it has PGS subtitles. Out of my 100+ remuxes i've ripped to my HTPC, this is the only one that doesn't work on LAV.

Dark Shadows sample (50Mb) (http://sdrv.ms/Q61lmZ)

I gave up on this but encountered another remux with the same problem. I checked all my remuxes and 3 out of 100+ had this problem. I checked those remuxes on eac3to and what's common in those is 16 bits DTS Master Audio. All other remuxes have 24 bits DTS Master Audio and those work fine.

Anyone have any ideas what might cause this?


H:\eac3to>eac3to E:\REMUX\DANCES_WITH_WOLVES_DIRECTORS_CUT\DANCES_WITH_WOLVES_DI
RECTORS_CUT.mkv
MKV, 1 video track, 1 audio track, 3:56:39, 24p /1.001
1: h264/AVC, 1080p24 /1.001
2: DTS Master Audio, 7.1 channels, 16 bits, 48kHz
(core: DTS, 5.1 channels, 16 bits, 1509kbps, 48kHz)

H:\eac3to>eac3to E:\REMUX\DARK_SHADOWS\DARK_SHADOWS.mkv
MKV, 1 video track, 1 audio track, 1 subtitle track, 0:00:19, 24p /1.001
1: h264/AVC, 1080p24 /1.001 (16:9)
2: DTS Master Audio, 5.1 channels, 16 bits, 48kHz
(core: DTS, 5.1 channels, 16 bits, 1509kbps, 48kHz)
3: Subtitle (PGS), Finnish


MPC-HC
LAV Splitter (mkv) -> LAV Audio (DTS MA 16bits, outputting core 16bits) -> SPDIF | OK

WMP/WMC
LAV Splitter (mkv) -> LAV Audio (DTS MA 16bits, outputting core 16bits) -> SPDIF | PLAYBACK FAIL
LAV Splitter (m2ts) -> LAV Audio (DTS MA 16bits, outputting core 16bits) -> SPDIF |OK
LAV Splitter (mkv) -> LAV Audio (DTS MA 24bits, outputting core 24bits) -> SPDIF | OK
LAV Splitter (mkv) -> LAV Audio (DTS 16bits) -> SPDIF | OK

I tested with 16-bit 5.1 DTS-MA and it plays fine so the problem is only with 16-bit 7.1 DTS-MA files with 16-bit 5.1 DTS core. Also I don't know if it's the splitter that causes the video to hang, because if I add a AC3 file in that sample and set it default it still hangs if there is 16-bit 7.1 DTS-MA in container present.

Dunno maybe this happens only with systems on SPDIF and receiver that doesn't support Blu-ray audio formats, but only when using LAV + WMP/WMC. Other splitters and codecs + WMP/WMC plays these files fine.

[nevcairiel]

Without A Paddle DVD is getting stuck on the title menu.
- go to title menu
- hit scene selection
The title screen image will be frozen but when the mouse is moved a finger pointer appears when hovering over the spots where scene numbers would be.
sample - http://www.mediafire.com/download.php?7t38szk15s6oub8

Your sample seems to still be encrypted, please decrypt it before uploading.
Please always test that your sample works and shows the problem before uploading it, it helps to cut down on my time trying to figure things out.

[Prinz]

HDMI 1.4 3D is the best choice, but since AMD, NVIDIA and Intel each have their own APIs to handle 3D, one would have to write special code for all of them.

I hoped that this problem would be gone since the new DirectX 11.1 has an API for stereoscopic displays.

[madshi]

But DirectX 11.1 only supports win8, as far as I know? It's not reasonable to skip win7 support.

[Prinz]

At the moment yes. It's still not clear if and when it comes to Win7.

But I fear that Microsoft wants to force people to buy there Win8.

[madshi]

http://social.msdn.microsoft.com/Forums/en/parallelcppnative/thread/774a19a5-4bf4-42dd-bee7-4cf2a74bfdb6

at this point there is no plan for DirectX 11.1 to be made available on Windows 7

[Prinz]

Yes, but at the release of Win8 in Okt. many publications asked Microsoft for a statement, but MS refused a statement, if and when DirectX 11.1 is released for Win 7. Why would these do that, if it's not planned? So there is still hope.

[nevcairiel]

Here is another DVD build:

http://files.1f0.de/lavf/LAVFilters-0.53-14-g04051b3.zip

I fixed QuickSync again, and it should now work similar to Software/DXVA or CUVID.
Additionally, i also found a potential reason for the small glitch on a looping menu, so maybe it helps.
And last but not least, i tried to slightly reduce the decode latency of CUVID and DXVA2-CB when decoding DVDs, it may help with jerky playback using those modes. But i couldn't reproduce such problems.

[Blight]

nev:
Does ffmpeg supports decoding H.264 MVC?
If yes, why not support SBS 3D until Madshi gets around to support full-res 3D over HDMI?
I wonder if it's possible to write an abstraction layer that will support all 3 popular 3D graphic adapter hardware.
One dev that was looking into it said the nvidia solution is rather straight-forward, not sure about AMD or Intel.

[nevcairiel]

Does ffmpeg supports decoding H.264 MVC?
It does not.

[ddjmagic]

Thanks for the new release :)

[mark0077]

Here is another DVD build:

http://files.1f0.de/lavf/LAVFilters-0.53-14-g04051b3.zip

I fixed QuickSync again, and it should now work similar to Software/DXVA or CUVID.
Additionally, i also found a potential reason for the small glitch on a looping menu, so maybe it helps.
And last but not least, i tried to slightly reduce the decode latency of CUVID and DXVA2-CB when decoding DVDs, it may help with jerky playback using those modes. But i couldn't reproduce such problems.

Thanks Nev. Those changes sort of helped get CUVID + stop jerking when using avisynth on my system anyways, but it still jerks from time to time. Software mpeg2 mode works that little bit better still with avisynth so I'll personally stick with that.

Regarding looping menus, it seems better definitely, I still often see the madVR queues give a blip when the menu begins a loop. Sometimes this results in a frame drop of 2 - 8 frames usually. Not the end of the world. I see the git commit that helped this say "Avoid a full-blown decoder reset on Flush when playing a DVD". I'm just wondering is there anything else like this thats happening other than the decoder reset, that can cause the blip / madVR queue drop.

[petran79]

see for yourselves regarding the output problem

All filters enabled

http://www.abload.de/img/rgb0bk5l.jpg (http://www.abload.de/image.php?img=rgb0bk5l.jpg)

I disable RGB

http://www.abload.de/img/norgb2ukp7.jpg (http://www.abload.de/image.php?img=norgb2ukp7.jpg)

I disable 8-bit

http://www.abload.de/img/noyuvqrjd4.jpg (http://www.abload.de/image.php?img=noyuvqrjd4.jpg)

I disable 16-bit

http://www.abload.de/img/no16bitxujce.jpg (http://www.abload.de/image.php?img=no16bitxujce.jpg)

and finally, image appears correctly!

http://www.abload.de/img/correctq0kax.jpg (http://www.abload.de/image.php?img=correctq0kax.jpg)

[cyberbeing]

@petran79

Judging by your screenshots, you probably have both xy-VSFilter (DirectVobSub) as well as PotPlayer's Internal Subtitle Renderer enabled at the same time. You should uncheck "Show Subtitles" in Pot Player's settings to disable the ISR if you are using xy-VSFilter. xy-VSFilter doesn't support 10-bit 4:4:4, so LAV Video will output dithered RGB32 (or AYUV in the next xy-VSFilter stable release) by default on such videos.

[zqever]

How can I see the bitrate when I use LAV with MPC-HC?https://lh4.googleusercontent.com/-JIsuXWjT6uw/UJxhkI6QyeI/AAAAAAAAAB0/hVA3Ftr4hqQ/s243/1.png

[nevcairiel]

How can I see the bitrate when I use LAV with MPC-HC?https://lh4.googleusercontent.com/-JIsuXWjT6uw/UJxhkI6QyeI/AAAAAAAAAB0/hVA3Ftr4hqQ/s243/1.png

You cannot, its not supported.

[nevcairiel]

I'm just wondering is there anything else like this thats happening other than the decoder reset, that can cause the blip / madVR queue drop.

Well the decoder is flushed when the DVD Navigator tells us to flush. This means that a frame or two might be dropped inside the decoder which had not been delivered yet. I can't avoid this flush, because if its not done on eg. a seek, it will result in image corruption. And i don't know why the flush is triggered .. a seek, a looping menu..

I can briefly look over the events at the loop again, but not sure i can improve it much.

[Skibicki]

Your sample seems to still be encrypted, please decrypt it before uploading.
Please always test that your sample works and shows the problem before uploading it, it helps to cut down on my time trying to figure things out. I apologize for the file trouble. What do i need to check encryption on menu samples?

testing
MPC-HC
- open folder of menu files > paramount videos plays and stops > navigate menu is greyed out
- play again>pick 'title menu' from navigate menu>title is displayed
-click 'scene selection' > title screen image is frozen>move mouse around> cursor changes to hand in some spots>click and scenes will play
http://i.imgur.com/HLYHC.jpg

[nevcairiel]

If you copied those menu files to some other place, off the disc, they should stop working, because its still encrypted. At least they don't work for me.
I tried manually decryption the VOB files, it worked for the paramount trailer, but not for the smaller files, so the menu still wouldn't work properly

[Skibicki]

If you copied those menu files to some other place, off the disc, they should stop working, because its still encrypted. At least they don't work for me. I have a new set copied with DVDFab Decrypter, now I need to check for encryption.

edit: The menu files all work except scene selection.

[Skibicki]

I tried manually decryption the VOB files, it worked for the paramount trailer, but not for the smaller files, so the menu still wouldn't work properly ...also tested in VLC. Navigation worked. Remember you need to navigate to the title menu (alt+t) before the paramount trailer ends or it will just stop.
http://www.mediafire.com/download.php?xal1wd95k5va4dr