LAV Filters - DirectShow Media Splitter and Decoders

[Damien147]

Since my post here I checked some movies and videos with nothing wrong happening by using D3D11.Maybe it just happened.All good for now.

[Balling]

Originally Posted by dbezerra

Very interested in the Dolby Vision feature. Any render that supports it yet?

Mpv supports it.

[sebas_led]

Hi Nev!

First, thanks for LAV, it's a great piece of software.

Second, I have a couple of .mp4 files that LAV splitter (even version 0.76) dont recognize the video stream, only the audio stream (I've used GraphStudioNext to confirm).
VLC and Windows Media Player 12 play the files with autio and video, but the first 6-10 seconds the image it's freezed, so probably the file it's corrupted.

MediaInfo recognizes them as 'MPEG 4 visual'. Here are the details:
General
Complete name : C:\sebas\analize\ASSASIN_-_AURA.mp4
Format : MPEG-4
Format profile : Base Media
Codec ID : isom (isom/iso2/mp41)
File size : 27.5 MiB
Duration : 3 min 13 s
Overall bit rate mode : Constant
Overall bit rate : 1 194 kb/s
Writing application : Lavf58.28.100

Video
ID : 1
Format : MPEG-4 Visual
Format profile : Simple@L1
Format settings, BVOP : No
Format settings, QPel : No
Format settings, GMC : No warppoints
Format settings, Matrix : Default (H.263)
Codec ID : mp4v-20
Duration : 3 min 5 s
Bit rate mode : Constant
Bit rate : 1 104 kb/s
Width : 640 pixels
Height : 480 pixels
Display aspect ratio : 2.40:1
Original display aspect ratio : 2.40:1
Frame rate mode : Constant
Frame rate : 23.976 (24000/1001) FPS
Color space : YUV
Chroma subsampling : 4:2:0
Bit depth : 8 bits
Scan type : Progressive
Compression mode : Lossy
Bits/(Pixel*Frame) : 0.150
Stream size : 24.4 MiB (89%)
Title : ISO Media file produced by Google Inc. Created on: 05/03/2019.
Writing library : Lavc58.53.100

Audio
ID : 2
Format : AAC LC
Format/Info : Advanced Audio Codec Low Complexity
Codec ID : mp4a-40-2
Duration : 3 min 13 s
Bit rate mode : Constant
Bit rate : 129 kb/s
Channel(s) : 2 channels
Channel layout : L R
Sampling rate : 44.1 kHz
Frame rate : 43.066 FPS (1024 SPF)
Compression mode : Lossy
Stream size : 2.96 MiB (11%)
Title : ISO Media file produced by Google Inc. Created on: 05/03/2019.
Default : Yes
Alternate group : 1

and the other one:
General
Complete name : C:\sebas\analize\REIK_FT_OZUNA_WISIN_-_ME_NIEGO.mp4
Format : MPEG-4
Format profile : Base Media
Codec ID : isom (isom/iso2/mp41)
File size : 33.2 MiB
Duration : 3 min 39 s
Overall bit rate mode : Constant
Overall bit rate : 1 270 kb/s
Writing application : Lavf55.34.101

Video
ID : 1
Format : MPEG-4 Visual
Format profile : Simple@L1
Format settings, BVOP : No
Format settings, QPel : No
Format settings, GMC : No warppoints
Format settings, Matrix : Default (H.263)
Codec ID : mp4v-20
Duration : 3 min 27 s
Bit rate mode : Constant
Bit rate : 1 200 kb/s
Width : 640 pixels
Height : 480 pixels
Display aspect ratio : 16:9
Frame rate mode : Constant
Frame rate : 23.976 (24000/1001) FPS
Color space : YUV
Chroma subsampling : 4:2:0
Bit depth : 8 bits
Scan type : Progressive
Compression mode : Lossy
Bits/(Pixel*Frame) : 0.163
Stream size : 29.7 MiB (90%)
Writing library : Lavc55.52.102

Audio
ID : 2
Format : AAC LC
Format/Info : Advanced Audio Codec Low Complexity
Codec ID : mp4a-40-2
Duration : 3 min 39 s
Bit rate mode : Constant
Bit rate : 128 kb/s
Channel(s) : 2 channels
Channel layout : L R
Sampling rate : 44.1 kHz
Frame rate : 43.066 FPS (1024 SPF)
Compression mode : Lossy
Stream size : 3.35 MiB (10%)
Default : Yes
Alternate group : 1

For reference, i've uploaded the files here:
http://www.solidynepro.us/sebas/ASSASIN_-_AURA.mp4
http://www.solidynepro.us/sebas/REIK...-_ME_NIEGO.mp4

Can you confirm that the files are damaged or it's just a mpeg4 sub-format currently not recognized?
Thanks in advance

Sebastian Ledesma

[clsid]

First file hangs for 7 seconds because the audio track is 7 seconds longer than the video track. So the file is somewhat 'broken'.

Second file needs increased analyzeduration, otherwise it fails due to unknown resolution. So that file is also a bit broken. You can make it playable by remuxing it with MkvToolNix.

[sebas_led]

Originally Posted by clsid

First file hangs for 7 seconds because the audio track is 7 seconds longer than the video track. So the file is somewhat 'broken'.

Second file needs increased analyzeduration, otherwise it fails due to unknown resolution. So that file is also a bit broken. You can make it playable by remuxing it with MkvToolNix.

Thanks!
I'm learning how to use MkvToolNix to repair those files.

[bananenmann]

Hi,
MPC-HC is my favourite Mediaplayer and I love all it's features - especially in combination with MadVR. But I have one Problem, which remains even with the latest Version I've just installed:
If I have a *.MKV Video-File with a lot different audio-tracks the media player doesn't offer me to choose between all of them in the Audio Track selection:

For example I have some Movies with Dolby Digital Plus, Dolby Digital, Dolby True HD PLUS one DTS-HD MA Track (I muxed that together with MKVToolnix from different Sources). In my Example all the Dolby Tracks are shown, but the DTS-HD MA Track dissapeared. I did nothin wrong with MKVToolnix - I use this tool for many years. I've just selected ONE Audio Track as default etc.). VLC Player or PowerDVD show all Audio Tracks and I can choose between all of them and all are played without problem. I'm not sure, but I think it's maybe a Problem with the Lav Splitter?!



Here the Mediainfo Output of the Video:

General
Unique ID                                : 20034899356123229208554096159581207675 (0xF1294CD792C45C1FE323C8F5C9EFC7B)
Complete name                            : W:\NVIDIA_SHIELD\BLURAY\FILME\Guardians of the Galaxy 2\Guardians of the Galaxy Vol.2 (2017).mkv
Format                                   : Matroska
Format version                           : Version 4
File size                                : 27.5 GiB
Duration                                 : 2 h 15 min
Overall bit rate mode                    : Variable
Overall bit rate                         : 29.0 Mb/s
Encoded date                             : UTC 2022-02-09 16:37:11
Writing application                      : mkvmerge v65.0.0 ('Too Much') 64-bit
Writing library                          : libebml v1.4.2 + libmatroska v1.6.4

Video
ID                                       : 1
Format                                   : HEVC
Format/Info                              : High Efficiency Video Coding
Format profile                           : Main 10@L5@High
HDR format                               : Dolby Vision, Version 1.0, dvhe.08.06, BL+RPU, HDR10 compatible / SMPTE ST 2086, HDR10 compatible
Codec ID                                 : V_MPEGH/ISO/HEVC
Duration                                 : 2 h 15 min
Bit rate                                 : 16.6 Mb/s
Width                                    : 3 840 pixels
Height                                   : 2 160 pixels
Display aspect ratio                     : 16:9
Frame rate mode                          : Constant
Frame rate                               : 23.976 (24000/1001) FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Bit depth                                : 10 bits
Bits/(Pixel*Frame)                       : 0.083
Stream size                              : 15.7 GiB (57%)
Language                                 : German
Default                                  : Yes
Forced                                   : No
Color range                              : Limited
Color primaries                          : BT.2020
Transfer characteristics                 : PQ
Matrix coefficients                      : BT.2020 non-constant
Mastering display color primaries        : Display P3
Mastering display luminance              : min: 0.0050 cd/m2, max: 4000 cd/m2

Audio #1
ID                                       : 2
Format                                   : E-AC-3
Format/Info                              : Enhanced AC-3
Commercial name                          : Dolby Digital Plus
Format profile                           : Blu-ray Disc
Codec ID                                 : A_EAC3
Duration                                 : 2 h 15 min
Bit rate mode                            : Constant
Bit rate                                 : 1 024 kb/s
Channel(s)                               : 8 channels
Channel layout                           : L R C LFE Ls Rs Lb Rb
Sampling rate                            : 48.0 kHz
Frame rate                               : 31.250 FPS (1536 SPF)
Compression mode                         : Lossy
Delay relative to video                  : 21 ms
Stream size                              : 994 MiB (4%)
Title                                    : Deutsch Dolby Digital Plus 7.1 (UHD Blu-ray)
Language                                 : German
Service kind                             : Complete Main
Default                                  : Yes
Forced                                   : No

Audio #2
ID                                       : 3
Format                                   : DTS XLL
Format/Info                              : Digital Theater Systems
Commercial name                          : DTS-HD Master Audio
Codec ID                                 : A_DTS
Duration                                 : 2 h 15 min
Bit rate mode                            : Variable
Bit rate                                 : 2 538 kb/s
Channel(s)                               : 8 channels
Channel layout                           : C L R LFE Lb Rb Lss Rss
Sampling rate                            : 48.0 kHz
Frame rate                               : 93.750 FPS (512 SPF)
Bit depth                                : 16 bits
Compression mode                         : Lossless
Delay relative to video                  : 5 ms
Stream size                              : 2.41 GiB (9%)
Title                                    : DTS-HD MA 7.1  (by Asterixi)
Language                                 : German
Default                                  : No
Forced                                   : No

Audio #3
ID                                       : 4
Format                                   : AC-3
Format/Info                              : Audio Coding 3
Commercial name                          : Dolby Digital
Codec ID                                 : A_AC3
Duration                                 : 2 h 15 min
Bit rate mode                            : Constant
Bit rate                                 : 576 kb/s
Channel(s)                               : 6 channels
Channel layout                           : L R C LFE Ls Rs
Sampling rate                            : 48.0 kHz
Frame rate                               : 31.250 FPS (1536 SPF)
Compression mode                         : Lossy
Stream size                              : 559 MiB (2%)
Title                                    : Deutsch Dolby Digital 5.1 (UHD Blu-ray)
Language                                 : German
Service kind                             : Complete Main
Default                                  : No
Forced                                   : No

Audio #4
ID                                       : 5
Format                                   : MLP FBA 16-ch
Format/Info                              : Meridian Lossless Packing FBA with 16-channel presentation
Commercial name                          : Dolby TrueHD with Dolby Atmos
Codec ID                                 : A_TRUEHD
Duration                                 : 2 h 15 min
Bit rate mode                            : Variable
Bit rate                                 : 7 509 kb/s
Maximum bit rate                         : 11.3 Mb/s
Channel(s)                               : 8 channels
Channel layout                           : L R C LFE Ls Rs Lb Rb
Sampling rate                            : 48.0 kHz
Frame rate                               : 1 200.000 FPS (40 SPF)
Compression mode                         : Lossless
Stream size                              : 7.12 GiB (26%)
Title                                    : English TrueHD Atmos 7.1 (UHD Blu-ray)
Language                                 : English
Default                                  : No
Forced                                   : No
Number of dynamic objects                : 13
Bed channel count                        : 1 channel
Bed channel configuration                : LFE

Audio #5
ID                                       : 6
Format                                   : AC-3
Format/Info                              : Audio Coding 3
Commercial name                          : Dolby Digital
Codec ID                                 : A_AC3
Duration                                 : 2 h 15 min
Bit rate mode                            : Constant
Bit rate                                 : 640 kb/s
Channel(s)                               : 6 channels
Channel layout                           : L R C LFE Ls Rs
Sampling rate                            : 48.0 kHz
Frame rate                               : 31.250 FPS (1536 SPF)
Compression mode                         : Lossy
Stream size                              : 621 MiB (2%)
Title                                    : English Dolby Digital 5.1 (UHD Blu-ray)
Language                                 : English
Service kind                             : Complete Main
Default                                  : No
Forced                                   : No

Text #1
ID                                       : 7
Format                                   : UTF-8
Codec ID                                 : S_TEXT/UTF8
Codec ID/Info                            : UTF-8 Plain Text
Duration                                 : 2 h 6 min
Bit rate                                 : 0 b/s
Count of elements                        : 6
Stream size                              : 73.0 Bytes (0%)
Title                                    : Deutsch Forced (SRT)
Language                                 : German
Default                                  : Yes
Forced                                   : Yes

Text #2
ID                                       : 8
Format                                   : VobSub
Codec ID                                 : S_VOBSUB
Codec ID/Info                            : Picture based subtitle format used on DVDs
Duration                                 : 2 h 6 min
Bit rate                                 : 16 b/s
Count of elements                        : 6
Stream size                              : 15.6 KiB (0%)
Title                                    : Deutsch Forced (VobSub)
Language                                 : German
Default                                  : No
Forced                                   : Yes

Text #3
ID                                       : 9
Format                                   : PGS
Codec ID                                 : S_HDMV/PGS
Codec ID/Info                            : Picture based subtitle format used on BDs/HD-DVDs
Duration                                 : 2 h 6 min
Bit rate                                 : 64 b/s
Count of elements                        : 12
Stream size                              : 60.2 KiB (0%)
Title                                    : Deutsch Forced (PGS)
Language                                 : German
Default                                  : No
Forced                                   : Yes

Text #4
ID                                       : 10
Format                                   : VobSub
Codec ID                                 : S_VOBSUB
Codec ID/Info                            : Picture based subtitle format used on DVDs
Duration                                 : 2 h 14 min
Bit rate                                 : 7 729 b/s
Count of elements                        : 1535
Stream size                              : 7.45 MiB (0%)
Title                                    : Deutsch (VobSub)
Language                                 : German
Default                                  : No
Forced                                   : No

Text #5
ID                                       : 11
Format                                   : PGS
Codec ID                                 : S_HDMV/PGS
Codec ID/Info                            : Picture based subtitle format used on BDs/HD-DVDs
Duration                                 : 2 h 14 min
Bit rate                                 : 38.5 kb/s
Count of elements                        : 3070
Stream size                              : 37.1 MiB (0%)
Title                                    : Deutsch (PGS)
Language                                 : German
Default                                  : No
Forced                                   : No

Text #6
ID                                       : 12
Format                                   : VobSub
Codec ID                                 : S_VOBSUB
Codec ID/Info                            : Picture based subtitle format used on DVDs
Duration                                 : 2 h 14 min
Bit rate                                 : 8 871 b/s
Count of elements                        : 1973
Stream size                              : 8.56 MiB (0%)
Title                                    : English SDH (VobSub)
Language                                 : English
Default                                  : No
Forced                                   : No

Text #7
ID                                       : 13
Format                                   : PGS
Codec ID                                 : S_HDMV/PGS
Codec ID/Info                            : Picture based subtitle format used on BDs/HD-DVDs
Duration                                 : 2 h 14 min
Bit rate                                 : 44.4 kb/s
Count of elements                        : 3946
Stream size                              : 42.8 MiB (0%)
Title                                    : English SDH (PGS)
Language                                 : English
Default                                  : No
Forced                                   : No

Menu
00:00:00.000                             : en:King Cobra & Giant Sea Monkey
00:09:54.375                             : en:Golden Morons
00:15:08.314                             : en:Space Chase
00:22:12.279                             : en:Not From Missouri
00:32:31.898                             : en:Deepest, Darkest, Secrets
00:36:50.323                             : en:Berhert Ambush
00:42:27.368                             : en:Finding Meaning
00:48:01.660                             : en:Taserface
00:53:17.101                             : en:Celestial Catch
00:58:44.136                             : en:Let's Agree To Never Discuss This
01:05:50.436                             : en:Eclector Escape
01:11:10.631                             : en:Sibling Rivalry
01:18:41.790                             : en:Eternity
01:23:53.518                             : en:Two Of A Kind
01:30:22.949                             : en:Inflated Ego
01:39:34.375                             : en:What A Day
01:47:04.408                             : en:From The Heart
01:54:19.801                             : en:A Father's Sacrifice
01:58:51.906                             : en:The Colors Of Ogord
02:07:11.656                             : en:End Credits

[Sunspark]

Originally Posted by bananenmann

In my Example all the Dolby Tracks are shown, but the DTS-HD MA Track dissapeared.

In the LAV Audio Decoder options, do you have DTS-HD checked in the bitstreaming section?

[nevcairiel]

The only reason any audio track wouldn't be shown from a MKV file would be if its marked as Hidden. You should make sure that is not the case. If you muxed it yourself, you may have accidentally applied that flag.

[bananenmann]

Yes. All Formats are checked for Bitstreaming. I already posted this in the MPC-HC Thread, but I was told, that this is an error of the LAV-Splitter. And that seems to be right: I forced MPC-HC to use Haali Media Splitter instead and suddenly ALL of my Audio Tracks appeared in the Audio Selection. Unfortunately Haali Media Splitter is too old for HEVC so I had no picture - only Sound. So this was just a Test to proove that nothing had gone wrong while Muxing. This Problem doesn't encounter with just one Video file - it encounters on all Videos with a lot of Audio Tracks with that different kind like my example.

Someone told me, that this might be because MKVToolnix changed the kind how tracks should be marked. So I marked ALL Audio Tracks as "Default" and tried to mux it again: But no effect: There are still missing some Audio Tracks...

[bananenmann]

@nevcairiel
No, there is nothing marked as hidden. And as I said it's not only one File causing this Problems.

hmmm, I now muxed it with TS-Muxer (Nightly) to a *.mts File and now ALL Tracks are recognized by LAV-Splitter?! So there is a Problem with LAV-Splitter and MKV-Files or there is a BUG in MKVToolnix.... or there is something in MKVToolnix which I can't see?! But I'm not a Newbie with that tool. I use it for many many years?!

[nevcairiel]

Use the Header Editor in mkvmerge on your existing file, and check the missing track for "Track enabled". If its present and set to "No", then the audio will be skipped.
Nothing in your screenshot shows anything regarding that, you even selected the wrong track if DTS-HD is supposed to be missing.

Its the only reasonable explanation for a MKV audio track to not show - because thats what the MKV spec says should happen. Otherwise the only thing I can tell you is that I need a sample.

[bananenmann]

No, the last Picture was another Video File. In that File I tried to set the DTS-HD Audio Track as the first and default track - as you can see it in my MKVToolnix Picture. MPC-HC offers me the DTS-HD Track as the default one (as it should be), then the second one: Dolby Digital Plus 7.1 Track is missing and the True-HD and the normal Dolby Digital Track are visible again.... My first Post was a different file: There I put the 7.1 Dolby Digital Plus Track as the default first track and the DTS-HD track as the second track. It seems that always the second Track is missing. There the DTS-HD Track was missing.

But you are Right, I did a mistake: I always thought that in the bottom window there has to be a green checkmark for the Element to be copied with. I didn't see that each track has to be separately aktivated in the right window (I don't mean "Standard Track" and even not "Forced Track" - but as you said the Track on it's own has to be enabled there as well. In my last Picture all elements have a green checkmark, but you can see that in the right window the 7.1 Dolby Ditgital Plus Track is NOT enabled. And that is exatly the one Audio Track which is missing in that file while playing it with MPC-HC.

A little bit confusing, because I always have ALL tracks in the right window disabled - only the default and forced tracks are enabled ... and everything worked. I could always choose between all tracks (Audio and Subtitle). But since I have such a lot Audio Tracks (more than two) in one file this behaviour happened. So sorry for disturbing you - it was my fault. Maybe it would be better in MKVToolnix when a copied, but disabled track is tried to be muxed in a MKV - that there is a warning Message or a red checkmark or something like this.

Have a nice evening

[nevcairiel]

LAV Filters 0.76.1

LAV Splitter
- Changed: When requesting a HTTP URL, the URL itself is send as a referrer to increase compatibility
- Fixed: The priority of "Default" subtitle tracks in MKV files was wrong when a forced track was present

LAV Video
- Changed: Improved color reporting for DVD menus/subtitles
- Fixed: D3D11 surface clearing did not work properly on Intel GPUs

Download: Installer (both x86/x64) -- Zips: 32-bit & 64-bit

If you missed 0.76, the release notes are here

Only a collection of small fixed on top of 0.76, before I dive into some bigger changes and these won't get out for quite a while.

[clsid]

Thanks!

Can you reveal anything about those changes that you are planning?

[ryrynz]

Yeah.. I miss those MadVR and LAV big dev periods. Plz share

[wojak]

Originally Posted by nevcairiel

LAV Filters 0.76.1

LAV Splitter
- Changed: When requesting a HTTP URL, the URL itself is send as a referrer to increase compatibility
- Fixed: The priority of "Default" subtitle tracks in MKV files was wrong when a forced track was present

LAV Video
- Changed: Improved color reporting for DVD menus/subtitles
- Fixed: D3D11 surface clearing did not work properly on Intel GPUs

Download: Installer (both x86/x64) -- Zips: 32-bit & 64-bit

If you missed 0.76, the release notes are here

Only a collection of small fixed on top of 0.76, before I dive into some bigger changes and these won't get out for quite a while.

Hi, @nevcairiel

I have a problem with bitstreaming DTSWAV files (in MPCHC).
The passthrough option for DTS in WAV files just does not work. It works in avi, m2ts and other video files but not in wav. There is no sound at all. The music palys only if I check "fallback to PCM" option.

Here is my discussion with clsid2 on github on that topic:
https://github.com/clsid2/mpc-hc/issues/1555

[tiben20]

Just a heads up for those who are interested. I managed to add direct3d 12 hardware decoding in lavfilters.
https://github.com/tiben20/LAVFilters
I based my work on the fork Steve Lhomme did on vlc.
So far most of h264,hevc, vp9, vc1 codecs works.
Of course since there is no d3d12 directshow renderer at the moment its kinda useless. I started today a fork to add d3d12 rendering in the mpc videorenderer from the mpc-be team.

I only did this because i love contributing to the open source community. I don't think the d3d11 hardware acceleration will be beat in a near future but at least its a first step into direct3d 12

[huhn]

i can't wait. maybe something in d3d12 works with amd cards!

[clsid]

Afaik the D3D12 stuff is basically just same as D3D11 but with a somewhat simplified API. So don't get your expectations up to high.

I suggest testing if your AMD issues also occur with the Movies&TV player from Windows.

[kasper93]

Originally Posted by huhn

i can't wait. maybe something in d3d12 works with amd cards!

Wait a sec... What is not working on AMD cards?

Originally Posted by tiben20

Of course since there is no d3d12 directshow renderer at the moment its kinda useless.

If you implement cpu copyback (which is trivial to plug into old code) or D3D11/D3D12 interop so you can send surface to say madVR it will work fine at least as experimental decoder.

Anyway I don't think there is any gain of using D3D12 at this moment. It is just an API on top of the same hardware decoder. Maybe adding video processing (like deinterlacing) to LAV would be more fun?