LAV Filters - DirectShow Media Splitter and Decoders

[Thunderbolt8]

its working now with 1.1.0.8. thanks! :)

[filler56789]

Yeah, about time! :D

[Boltron]

Merry Christmas.

Santa Nevcairiel, my Christmas wish is for a way to display the LAV Audio Input/Output details as shown on the Status properties on the screen much like madVR displays stats when ^J is hit.

I use JRiver with LAV and madVR. This would be an awesome addition.

Thanks and all the best for the New Year!

[nevcairiel]

How would the audio decoder ever show stuff on screen? Just look at the status panel, that's what its for.

If a player wanted to, it could access this information and show it on screen, but LAV will never do that.

[Boltron]

I know the player needs to perform the display but it all starts by making the info available to the player. So my first stop was to see if LAV can provide the details by perhaps an API call. Does this already exist?

Thanks.

[arestarh]

nevcairiel
Can you confirm that in .mkv sample below lav splitter doesn't detect subtitles at all?
Mkvinfo and mediainfo reported that two subtitle .srt strteams presented...
Sample:
http://nekaka.com/d/orXLPiFTUv
or
http://sendfile.su/1065583

[cyberbeing]

nevcairiel
Can you confirm that in .mkv sample below lav splitter doesn't detect subtitles at all?

This occurs in LAVFilters because "Track FlagEnabled" is set to false. Which is defined as 'Set if the track is usable.' in the MKV spec. You can fix this with either MKVToolNix Header Editor, or by demuxing the subtitles and muxing them in again.

How much LAV's literal interpretation of this flag makes sense to the end-user is somewhat debatable though, since why would you mux a subtitle track which could never be displayed during playback? The real question is how this flag was originally set, was it user error or something else? Which mkvmerge version was the original untrimmed version of that video muxed with?

Granted, Haali Splitter still makes such tracks available even when that flag is set. If this encode was originally muxed way back in early April 2011 when the Blu-ray was released, Haali was probably the only thing it was ever tested on. Though I suspect this is a somewhat more recent behavior in LAV Filters as a result of him refactoring, so if this was an older encode it may have even worked with LAV way back then.

[arestarh]

cyberbeing
Thanks for pointing me out.
I think this was user error.

[Blight]

Nev:
I got this MKV+VC1 clip that causes an access violation in ntdll.dll when trying to remove the 'LAV Video Decoder' filter from the graph.
It doesn't always throw the error, perhaps some sort of race condition? Hardware acceleration is set to 'none'.

Switching the video decoder to Microsoft's DMO and the error isn't triggered anymore.

Here's the clip:
http://zoomplayer.com/t/vc1ar_anamorphic.zip

[filler56789]

......
Here's the clip:
http://zoomplayer.com/t/vc1ar_anamorphic.mkv

The server returns:

404 - File or directory not found.

[Blight]

filler:
I fixed the link, server didn't have MKV listed as a valid extension to serve.
http://zoomplayer.com/t/vc1ar_anamorphic.zip

[nevcairiel]

Nev:
I got this MKV+VC1 clip that causes an access violation in ntdll.dll when trying to remove the 'LAV Video Decoder' filter from the graph.
It doesn't always throw the error, perhaps some sort of race condition? Hardware acceleration is set to 'none'.

Switching the video decoder to Microsoft's DMO and the error isn't triggered anymore.

Here's the clip:
http://zoomplayer.com/t/vc1ar_anamorphic.zip

I cannot make it crash. Any more details?

[Blight]

nev:
I can't recreate it anymore. You can ignore for now until I manage to find a more reliable way to recreate it.

[Nachbar]

nevcariel:

When I open the index.bdmv of a blu ray, lav splitter will incorrectly report all streams as English. However if I navigate and find the m2ts file it will report the streams as the correct language. I would prefer if it detected the languages correctly for the .bdmv file since it also contains chapter marks and it is a file that is on all blu ray discs which I can set windows to autoplay from.

Here are a few screenshots:

from bdmv: http://i.imgur.com/33DGRtp.jpg
from .m2ts: http://i.imgur.com/dO34Efk.jpg

[nevcairiel]

Screenshots are not helpful. If i cannot reproduce a problem, then I cannot fix it.

[aufkrawall]

Is it decoder or x265 bug that makes I444 HEVC look destroyed?
Sample: http://www67.zippyshare.com/v/39922457/file.html
Happens also with 8 bit.

It also seems that colormatrix flagging of x265 isn't working, but with this sample assumed BT.709 is right.

[marsovac]

What is the proper way to select a subtitle stream when there are more then one stream per language?

SetAdvancedSubtitleConfig() doesn't seem to support this, at least from what I read on the 1f0.de docs.

Is there a way to select the subtitle stream by index (and during playback)?

http://s29.postimg.org/s74ezug1z/subs.png

In this case I always get the Styled ASS.

Thanks

[nevcairiel]

Is there a way to select the subtitle stream by index (and during playback)?

IAMStreamSelect on MSDN (http://msdn.microsoft.com/en-us/library/windows/desktop/dd319793%28v=vs.85%29.aspx)

[marsovac]

IAMStreamSelect on MSDN (http://msdn.microsoft.com/en-us/library/windows/desktop/dd319793%28v=vs.85%29.aspx)

Yes I ultimately made it with IAMStreamSelect, thanks.

[nevcairiel]

Is it decoder or x265 bug that makes I444 HEVC look destroyed?
Sample: http://www67.zippyshare.com/v/39922457/file.html
Happens also with 8 bit.

I wouldn't know. Both could be broken, or only one, without another reference point its hard to say anything.

[Nachbar]

I apologize nevcairiel. I guess this one movie that I tried was having the problem not displaying the languages correctly with the index.bdmv file (it displays correctly with the .m2ts file minus chapters). When I tried a different movie it was fine. The movie that was having the problem is Evangelion 2.22 with ISBN of 1-4210-2287-7 in case you have it. If there's something you'd like me to look at with it just let me know.

[nevcairiel]

If you could upload all the files from the BDMV folder except the STREAM subfolder, that might help to debug it. It should only be a few MBs.

[Nachbar]

Thanks nevcairiel. Here it is: http://www.mediafire.com/download/aa113nrnocbwvsv/Eva_1.11_BDMV.zip

[aufkrawall]

I wouldn't know. Both could be broken, or only one, without another reference point its hard to say anything.
I also tried newest x265 build I could get (12-29 from here: http://builds.x265.eu/), no difference.

Maybe I should try it in the HEVC section if devs are reading there.

[Plutotype]

Happy New year to everyone.

Will be LAVaudio ready to properly decode and map DTS:X, Dolby Atmos and AURO 3D streams using the usual LPCM/Reclock workflow?

[nevcairiel]

Those formats are not supported, and if they are ever supported (which is somewhat doubtful), it'll be a very long time.

[DragonQ]

Does anyone else use LAV Audio's delay feature? If so, does it work correctly for you?

I ask because I'm getting "sync drift" when watching long videos. For example, at the start of a 45 minute video the sync will be correct, but by about half way through the audio/video sync is noticeably out. If I disable LAV Audio's delay feature and instead apply the same audio delay on my AVR, it's fine for the entire duration of the video. It's not just a single file either, I've noticed this on everything I've watched today (5 or 6 episodes of TV shows, all of which are 1080p/24 with DTS or AC3 sound).

[Nachbar]

DragonQ: I haven't used it recently but back when I did use it I had to use it for a video that had its audio out of sync by five seconds and lasted forty-five minutes long. It worked fine for me.

[DragonQ]

5 seconds is a huge sync difference. My standard delay is 90 ms and by the time the episode is nearly over, the audio is probably 100 ms too early (hard to measure). I thought that maybe the "Auto A/V Sync correction" option was causing the audio delay to disappear but disabling that caused much worse sync problems.

[Nachbar]

I meant the video itself had a 5 second difference between audio and video to begin with. I corrected it (-5000ms) with the same option you described and played it.

I remember seeing a BBC audio sync video on youtube. You could try taking that video and extending it out to an hour and see how far it is off then.

Also if you are using it with reclock, try without it. Conversely if you aren't using reclock give it a try.

[DragonQ]

I do have some sync videos, which is how I came up with the +90 ms figure to begin with. I wasn't able to find a 23.976 fps one though, only 29.97 and 25 fps.

[LigH]

Such a large difference can happen when someone tries to convert e.g. a VOB file like it was authored on DVD, without extracting the main movie PGC, which would have removed a leading-in trailer in a different PGC that shofted the beginning of audio streams.

[ocyl]

I'm getting weird behavior with mpc-hc and lav now and then. It's pretty rare, so I can't seem to reproduce it. Sometimes, jumping to next chapter in an mkv results in loss of audio. Jumping back to the start of the chapter "revives" it again. Any idea what could be causing this?
I have experienced similar loss of audio during seeking (doesn't have to be a chapter jump) from time to time, too. Reseeking would bring audio back.I have seen it happen a few times too. Only with AAC audio. It is pretty rare though.I've experienced this too. Also with AAC. Not sure about other formats.
Its really impossible to reproduce this problem reliably, and as such impossible to fix it reliably as well. How do I know its fixed and not just not happening at the moment.
In any case, I applied some changes to how AAC is handled after a seek, maybe we get lucky. Assuming its actually in LAV Audio, and not in LAV Splitter.

I am sorry to report that I have continued to experience the same issue with AAC tracks, and tonight with an AC3 track, as well.

LAV Version: 0.63.0.29

File Info
Type: Matroska
Video: MPEG4 Video (H264) 1024x576 23.976fps [V: English [eng] (h264 high 10 L5.0, yuv420p10le, 1024x576) [default]]
Audio: Dolby AC3 48000Hz stereo 224kbps [A: ac3, 48000 Hz, stereo, 224 kb/s [default]]
Subtitle: Advanced SubStation Alpha [S: ass [default]]
Subtitle: UTF-8 [S: No subtitles]

Instead of reseeking right away (to restore audio), I kept the video running tonight and something interesting happened about two minutes later. The video froze, but the audio started to come back intermittently. This went on for about a minute and then audio was fully back on. Another half minute passed and then video resumed on its own, in sync with audio.

nevcairiel, I don't know if the above description provides any additional clue on where the issue may be. Please let me know if there is anything that you would like me to try (e.g. changing any particular setting).

[Soukyuu]

I can confirm it's still happening here as well.

[colinhunt]

I'd appreciate some help with video and audio freezing when skipping directly to any part - except for the very start - of a HEVC MP4 file. Player is latest stable version of MPC-HC, and I'm running LAV version 0.63. Same issue affects also MPC-BE which is set to use LAV. Noticed the same problem with VLC, just now.

File was encoded on MeGUI and muxing (HEVC + AC3) was done using MeGUI's internal MP4 muxer.

update: issue not limited to MP4; same thing happens with MKV, muxed with latest mkvtoolnix.

Any recommendations?

[ocyl]

I am sorry to report that I have continued to experience the same issue with AAC tracks, and tonight with an AC3 track, as well.

LAV Version: 0.63.0.29

File Info
Type: Matroska
Video: MPEG4 Video (H264) 1024x576 23.976fps [V: English [eng] (h264 high 10 L5.0, yuv420p10le, 1024x576) [default]]
Audio: Dolby AC3 48000Hz stereo 224kbps [A: ac3, 48000 Hz, stereo, 224 kb/s [default]]
Subtitle: Advanced SubStation Alpha [S: ass [default]]
Subtitle: UTF-8 [S: No subtitles]

Instead of reseeking right away (to restore audio), I kept the video running tonight and something interesting happened about two minutes later. The video froze, but the audio started to come back intermittently. This went on for about a minute and then audio was fully back on. Another half minute passed and then video resumed on its own, in sync with audio.

nevcairiel, I don't know if the above description provides any additional clue on where the issue may be. Please let me know if there is anything that you would like me to try (e.g. changing any particular setting).
I can confirm it's still happening here as well.

It happened to me again today, this time with an AAC track.

File Info
Type: Matroska
Video: MPEG4 Video (H264) 1280x720 23.81fps [V: h264 high L4.0, yuv420p, 1280x720 [default,forced]]
Audio: AAC 44100Hz stereo [A: aac lc, 44100 Hz, stereo [default,forced]]
Subtitle: Advanced SubStation Alpha [S: ass [default,forced]]
Subtitle: UTF-8 [S: No subtitles]

Turn of Events

Video and audio were playing fine.
I used the "Jump Backward (medium)" key in MPC-HC to go back five seconds in time. The "Fast seek (on keyframe)" option had been unchecked.
Audio output disappeared upon reseeking, and video playback continued. This went on for about a minute.
Video output froze, but the audio portion that was supposed to have been played back in the past minute was played. This went on for about two minutes, during which audio output continued but video frame remained static.
Video and audio resumed and were in sync. MPC-HC stats showed that no frame had been dropped.

Unfortunately, I was not able to reproduce the issue afterwards.

[nevcairiel]

LAV Filters has official nightly builds now:
http://files.1f0.de/lavf/nightly/

The builds are started every night at 01:30 CET, so they are "true" nightly builds (one every night) and there won't be a single build for every change during the day. However, I may increase the number of builds if I ever see a reason for it.

This should make test versions of LAV more accessible to everyone, instead of relying on third-parties who may even provide modified builds only, which can make tracking down issues much harder.
The first nightly was build last night after successful testing of my scripts, and will continue from now on.

All my builds are digitally signed with a new certificate now, using a SHA256 hash. Note that these certificates cannot be validated on Windows XP, but official support for XP has ceased anyway, and anyone still using it should be urged to upgrade.

[filler56789]

LAV Filters has official nightly builds now:
http://files.1f0.de/lavf/nightly/

:goodpost: and :thanks: :thanks: :thanks:

[nevcairiel]

Turn of Events

Video and audio were playing fine.
I used the "Jump Backward (medium)" key in MPC-HC to go back five seconds in time. The "Fast seek (on keyframe)" option had been unchecked.
Audio output disappeared upon reseeking, and video playback continued. This went on for about a minute.
Video output froze, but the audio portion that was supposed to have been played back in the past minute was played. This went on for about two minutes, during which audio output continued but video frame remained static.
Video and audio resumed and were in sync. MPC-HC stats showed that no frame had been dropped.

Unfortunately, I was not able to reproduce the issue afterwards.

Interesting, at least this rules out the audio decoder actually failing to decode the audio for some reason (which was the assumption i was working on before).

However, it makes it even more of a mystery.

Which Audio Renderer are you using? DirectSound? WaveOut? ReClock?

[Warlock]

LAV Filters has official nightly builds now:
http://files.1f0.de/lavf/nightly/


Awesome! Great! :goodpost:

PS: Nevcairiel , dxva-cb are having problems with vgas nvidia GTX 970/980? I'm asking for the reason I have enough presentation glitches with the 970. If I enable Cuvid , the problem disappears . I'm using the latest driver available. In a 720p video with dxva-cb enabled, is alternating between 10 ~ 15ms , with cuvid , the rate is below 2ms . I'm using madVR with the following settings :

artifact removal : default - high / high - strength
scaling :
chroma - jinc3
image doubling - luma always 64 neurons
image upscaling - jinc3
image downscaling - cm AR / LL enabled
rendering settings default , only changed dithering for ED2 and trade quality with all the options disabled .

What do you think is causing this increased presentation glitches ?

[wanezhiling]

LAV Filters has official nightly builds now:
http://files.1f0.de/lavf/nightly/
Thanks, that's really wonderful.:D

Hmm.. only installer? not .bat version? :o

[nevcairiel]

Hmm.. only installer? not .bat version? :o

Installer is the recommended way to install it. Extra choices just confuse people! :)

[mood]

LAV Filters has official nightly builds now:
http://files.1f0.de/lavf/nightly/



:thanks::thanks::thanks:

[STaRGaZeR]

If I enable Cuvid , the problem disappears . I'm using the latest driver available. In a 720p video with dxva-cb enabled, is alternating between 10 ~ 15ms , with cuvid , the rate is below 2ms .

It seems Cuvid forces a higher P-State, this causes higher GPU and memory frequencies, that result in lower rendering times.

[ocyl]

Interesting, at least this rules out the audio decoder actually failing to decode the audio for some reason (which was the assumption i was working on before).

However, it makes it even more of a mystery.

Which Audio Renderer are you using? DirectSound? WaveOut? ReClock?
I am using DirectSound.

Turn of Events

Video and audio were playing fine.
I used the "Jump Backward (medium)" key in MPC-HC to go back five seconds in time. The "Fast seek (on keyframe)" option had been unchecked.
Audio output disappeared upon reseeking, and video playback continued. This went on for about a minute.
Video output froze, but the audio portion that was supposed to have been played back in the past minute was played. This went on for about two minutes, during which audio output continued but video frame remained static.
Video and audio resumed and were in sync. MPC-HC stats showed that no frame had been dropped.


I noticed something else today. In MPC-HC's statistics panel, there are three buffers: [0], [1], and [2]. When audio disappeared upon reseeking, buffer [0] would start dropping towards 0/0. Once video froze and audio came out, buffer [0] would begin to be replenished while buffer [1] would start dropping towards 0/0. The two buffers would more or less return to normal levels when video and audio were in sync again. Buffer [2] is always 0/0 for me.

[nevcairiel]

Yes it looks like that for some reason audio is not being delivered to the audio renderer properly .. its stuck somewhere. Maybe in the renderer? How it manages to resume eventually is as much of a mystery.
Buffer 0 is video, which you said would continue playing, but because the audio buffer is exceeding its size limit, the video buffer isn't being filled anymore. Buffer 2 is subtitles, its normal for that to be empty.

I may provide a build with extra logging, I'll have to think about the problem a bit.

[mindbomb]

new intel broadwell gpu's apparently have vp9 hardware decode

[fagoatse]

new intel broadwell gpu's apparently have vp9 hardware decode

Speaking of which, supposedly AMD's Carrizo APUs can hardware decode h265 4k vidoes. Which means that they've either updated UVD or it's some kind of hybrid decoding(opencl).

[James Freeman]

@nevcairiel

I just read that there were some speed improvements of CPU HEVC decoding in the past few days.
Will this be implemented into LAV Filters?

[clsid]

Where did you read that? You probably misunderstood or confused things with a different decoder.