LAV Filters - DirectShow Media Splitter and Decoders

[SamuriHL]

Ffdshow has the same issue. Its just a display issue only.

[mark0077]

Hi, still enjoying your splitter, but have 1 question about it, 1 question about your video decoder.

Is it possible for your splitter to cause audio / video desync. Comparing your splitter to the internal m2ts splitter, watching The Dark Knight blu-ray, m2ts file, I'm getting fairly bad audio / video desync with your splitter sometimes, and sometimes after a period of time, which doesn't seem to happen with the internal mpc-hc splitter. The track is true-hd

Regarding your video decoder, have you had time to add any sort of buffering you once spoke about that may allow the likes of myself to use it over ffmpeg-mt. You may remember I was having dropped frames with your decoder vs ffmpeg-mt and you said it might be possible to improve with some form of buffering by the decoder.

[jmone]

I think i figured it out. It actually happened because TrueHD has so small samples (for the 48kHz file i had, 40 samples in one audio frame, thats 0.833333ms (going on periodically)).
Due to that periodic number, i couldn't accurately store those numbers in an integer, so eventually the error would sum up, and the value would slowly drift apart, one millisecond at a time.

Now, i changed it to store those numbers in a double precision floating point - which reduces integer precision from 64-bit to 52-bit (still big enough for around ~20 years of timestamps), but gives me the ability to store a timestamp like 0.8333ms much more accurately.

Nevcairiel - As promised, I just finished testing the TrueHD sync issue using Ver 0.23 (LAVFilters-0.23-11-g5d50f7c) and I can confirm that the lip sync is now fixed! :)
Aslo - I don't know that the LAV splitter/decoder has any impact on this bug posted at JR's Beta Forum - http://yabb.jriver.com/interact/index.php?topic=62996.msg425890;topicseen#msg425890

mark0077 - this was an issue for me as well in Ver 0.22 and earlier

[jmone]

Nevcairiel - There is an issue with True-HD decoding pulsing/stuttering in and out with LAVAudio and FFDSHOW (but not Arcsoft Audio HD Decoder) when used in conjunction with JRivers MC DSP EQ Plugin. More details: http://yabb.jriver.com/interact/index.php?topic=62996.msg425890#msg425890 and comments from Matt start here http://yabb.jriver.com/interact/index.php?topic=63692.msg425901#msg425901

[Hypernova]

I do plan to work on this sometime soon, as its a feature i would like to be able to use (also a challenge to get it working). At the latest, i want it ready when the new LOTR BluRay sets come out - the movies are split on two discs each, and my goal is to combine them in one flawless MKV, with theatrical and extended in one file. :) Normally i would just keep them on the disc, but with being split on two discs .. rather combine them! :)

This means i want to support editions/ordered chapters, what will not be supported right away is external segment linking - that is chapters in external files. I do not know when/how/if that will ever be worked on, it adds a whole extra layer of complexity - and i think its silly to begin with.

Since this is a rather big undertaking - i basically have to rewrite the MKV demuxer completly, or even a new one - i cannot guarantee anything.
Personally, i'm even doubtful that i can make it work in that given timespan.. but we'll see!

Maybe i can also join those two discs in one BluRay structure ..mmm..wonder if that works with some of the free BD authoring tools .. mmm.

Kind of late but this sounds great! I don't know much about the topic though, so could you tell me, is what you planned to do going to work with those fansubs OP/ED linking? That's the only time I need order chaptered. :thanks:

[nevcairiel]

Is it possible for your splitter to cause audio / video desync. Comparing your splitter to the internal m2ts splitter, watching The Dark Knight blu-ray, m2ts file, I'm getting fairly bad audio / video desync with your splitter sometimes, and sometimes after a period of time, which doesn't seem to happen with the internal mpc-hc splitter. The track is true-hd

Were you using only the splitter, or my audio decoder as well? There was a bug in earlier versions that caused TrueHD sync to drift in the decoder, but that was fixed in 0.23 - i've since only had confirmations that its fixed now.


Regarding your video decoder, have you had time to add any sort of buffering you once spoke about that may allow the likes of myself to use it over ffmpeg-mt. You may remember I was having dropped frames with your decoder vs ffmpeg-mt and you said it might be possible to improve with some form of buffering by the decoder.

Did you try 0.4? There have been alot of improvements since you first talked about this.

[nlnl]

nevcairiel

Thanks for .23!

Can not play dts hd ma audio in mkv http://www.multiupload.com/FJ7YOCNC6M (MPC+LAV splitter+ffdshow (bitstream)+Madvr), but Haali plays it fine.

[nevcairiel]

Can not play dts hd ma audio in mkv http://www.multiupload.com/FJ7YOCNC6M (MPC+LAV splitter+ffdshow (bitstream)+Madvr), but Haali plays it fine.

Plays just fine for me, using LAV Splitter, ffdshow and ReClock for bitstreaming - on my NVIDIA GTS 450.

[nlnl]

Plays just fine for me, using LAV Splitter, ffdshow and ReClock for bitstreaming - on my NVIDIA GTS 450.
Thanks!
I have 5750+W7+default audio renderer

[nevcairiel]

I could never get bitstreaming working right with the default renderer..

[nevcairiel]

Nevcairiel - There is an issue with True-HD decoding pulsing/stuttering in and out with LAVAudio and FFDSHOW (but not Arcsoft Audio HD Decoder) when used in conjunction with JRivers MC DSP EQ Plugin. More details: http://yabb.jriver.com/interact/index.php?topic=62996.msg425890#msg425890 and comments from Matt start here http://yabb.jriver.com/interact/index.php?topic=63692.msg425901#msg425901

I produced a test build which could either fix it, or at least rule one problem out - see your testing thread.

[jmone]

Thanks - first tests look good and it is working on my main PC (need to test on the HTPC when we finish watching a Blu!) :)

[CruNcher]

please add this subtype to the lav audio decoder nev {AACE71A1-8259-4250-8583-49613AF31C93}

[nevcairiel]

please add this subtype to the lav audio decoder nev {AACE71A1-8259-4250-8583-49613AF31C93}

Why ?
Also, not enough information. A subtype alone is meaningless.

[jmone]

Thanks - first tests look good and it is working on my main PC (need to test on the HTPC when we finish watching a Blu!) :)

I can confirm that the fix works on both my PC and the HTPC with TrueHD played from both a MKV and off a Blu-ray disk - Thanks!

[clsid]

The dlls can be made a bit smaller by adding this to the configure script:
--disable-decoder=aasc \
--disable-decoder=amv \
--disable-decoder=anm \
--disable-decoder=ansi \
--disable-decoder=asv1 \
--disable-decoder=asv2 \
--disable-decoder=aura \
--disable-decoder=aura2 \
--disable-decoder=avs \
--disable-decoder=bethsoftvid \
--disable-decoder=bfi \
--disable-decoder=bink \
--disable-decoder=bmp \
--disable-decoder=c93 \
--disable-decoder=cavs \
--disable-decoder=cdgraphics \
--disable-decoder=cinepak \
--disable-decoder=cljr \
--disable-decoder=cscd \
--disable-decoder=cyuv \
--disable-decoder=dfa \
--disable-decoder=dnxhd \
--disable-decoder=dpx \
--disable-decoder=dsicinvideo \
--disable-decoder=dvvideo \
--disable-decoder=dxa \
--disable-decoder=eacmv \
--disable-decoder=eamad \
--disable-decoder=eatgq \
--disable-decoder=eatgv \
--disable-decoder=eatqi \
--disable-decoder=eightbps \
--disable-decoder=eightsvx_exp \
--disable-decoder=eightsvx_fib \
--disable-decoder=escape124 \
--disable-decoder=ffv1 \
--disable-decoder=ffvhuff \
--disable-decoder=flashsv \
--disable-decoder=flic \
--disable-decoder=flv \
--disable-decoder=fourxm \
--disable-decoder=fraps \
--disable-decoder=frwu \
--disable-decoder=gif \
--disable-decoder=h261 \
--disable-decoder=h263 \
--disable-decoder=h263i \
--disable-decoder=h264 \
--disable-decoder=huffyuv \
--disable-decoder=idcin \
--disable-decoder=iff_byterun1 \
--disable-decoder=iff_ilbm \
--disable-decoder=indeo2 \
--disable-decoder=indeo3 \
--disable-decoder=indeo5 \
--disable-decoder=interplay_video \
--disable-decoder=jpegls \
--disable-decoder=jv \
--disable-decoder=kgv1 \
--disable-decoder=kmvc \
--disable-decoder=lagarith \
--disable-decoder=loco \
--disable-decoder=mdec \
--disable-decoder=mimic \
--disable-decoder=mjpeg \
--disable-decoder=mjpegb \
--disable-decoder=mmvideo \
--disable-decoder=motionpixels \
--disable-decoder=mpeg1video \
--disable-decoder=mpeg2video \
--disable-decoder=mpeg4 \
--disable-decoder=mpegvideo \
--disable-decoder=msmpeg4v1 \
--disable-decoder=msmpeg4v2 \
--disable-decoder=msmpeg4v3 \
--disable-decoder=msrle \
--disable-decoder=msvideo1 \
--disable-decoder=mszh \
--disable-decoder=nuv \
--disable-decoder=pam \
--disable-decoder=pbm \
--disable-decoder=pcx \
--disable-decoder=pgm \
--disable-decoder=pgmyuv \
--disable-decoder=pictor \
--disable-decoder=png \
--disable-decoder=ppm \
--disable-decoder=ptx \
--disable-decoder=qdraw \
--disable-decoder=qpeg \
--disable-decoder=qtrle \
--disable-decoder=r10k \
--disable-decoder=r210 \
--disable-decoder=rl2 \
--disable-decoder=roq \
--disable-decoder=rpza \
--disable-decoder=rv10 \
--disable-decoder=rv20 \
--disable-decoder=rv30 \
--disable-decoder=rv40 \
--disable-decoder=sgi \
--disable-decoder=smacker \
--disable-decoder=smc \
--disable-decoder=snow \
--disable-decoder=sp5x \
--disable-decoder=sunrast \
--disable-decoder=svq1 \
--disable-decoder=svq3 \
--disable-decoder=targa \
--disable-decoder=theora \
--disable-decoder=thp \
--disable-decoder=tiertexseqvideo \
--disable-decoder=tiff \
--disable-decoder=tmv \
--disable-decoder=truemotion1 \
--disable-decoder=truemotion2 \
--disable-decoder=tscc \
--disable-decoder=txd \
--disable-decoder=ulti \
--disable-decoder=v210 \
--disable-decoder=v210x \
--disable-decoder=vb \
--disable-decoder=vc1 \
--disable-decoder=vcr1 \
--disable-decoder=vmdvideo \
--disable-decoder=vmnc \
--disable-decoder=vp3 \
--disable-decoder=vp5 \
--disable-decoder=vp6 \
--disable-decoder=vp6a \
--disable-decoder=vp6f \
--disable-decoder=vp8 \
--disable-decoder=vqa \
--disable-decoder=wmv1 \
--disable-decoder=wmv2 \
--disable-decoder=wmv3 \
--disable-decoder=wnv1 \
--disable-decoder=xan_wc3 \
--disable-decoder=xan_wc4 \
--disable-decoder=xl \
--disable-decoder=yop \
--disable-decoder=zlib \
--disable-decoder=zmbv \
--disable-decoder=ass \
--disable-decoder=dvbsub \
--disable-decoder=dvdsub \
--disable-decoder=pgssub \
--disable-decoder=srt \
--disable-decoder=xsub \
--disable-demuxer=applehttp \
--disable-demuxer=ffm \
--disable-demuxer=ffmetadata \
--disable-demuxer=mpegtsraw \
--disable-demuxer=spdif \
--disable-demuxer=tty \
--disable-demuxer=vc1test \
--disable-demuxer=yuv4mpegpipe \
This disables all video decoders, subtitle stuff, and unused demuxers.
Does the splitter need the video parsers from libavcodec? If not, those could be disabled as well.

[nevcairiel]

The dlls can be made a bit smaller by adding this to the configure script:
[...]
This disables all video decoders, subtitle stuff, and unused demuxers.
Does the splitter need the video parsers from libavcodec? If not, those could be disabled as well.

The decoders are needed to gather the full set of information from the files, disabling them will break codec detection in many containers that do not contain 100% complete header informations.
Personally, i also don't care much about saving a few kb's of space. (also, video decoders will be used by the video decoder sooner or later)

And yes, the video parsers are used as well.

I could probably disable those demuxers that are never used, but meh.

[Budtz]

Hey Guys

I have just switched to this splitter. I have looked through this tread but i am having trouble forming af clear picture of what the diffenrence/improvemnts there are compared to Haali's splitter. One difference seems to be that subtitles loads by default wich is nice. Also i am not sure what ecactly a splitter does. Is the only function that it makes it possible to switch between different sound and suptitle tracks? And should i only enable the splitter for mkv-files and use mpc-hc's splitters for other files

Kind Regards

[VipZ]

Nev, Regarding Issue #33.

I have also been noticing this recently up to the latest build posted here. When I open the file, the 1st few frames subtitles don't display but if I had to click stop and then play or seek to the beginning the subtitles play correctly.

[nevcairiel]

Nev, Regarding Issue #33.

I have also been noticing this recently up to the latest build posted here. When I open the file, the 1st few frames subtitles don't display but if I had to click stop and then play or seek to the beginning the subtitles play correctly.

Yeah i can reproduce it just fine, i just don't know why =)

[CruNcher]

Here is some TS compare (*.ts only not *.m2ts) i stopped comparing vs Cyberlinks Demuxer as their is no match yet :(

MPC-HC TS Splitter
---------------------
+ Stream switching works (depending on Decoder instant (Fast Stream switch) switching possible (Cyberlink Mpeg-2), most Decoder on next Keyframe switching)
+ No sync issues with some ADTS muxed streams (Hauppauge HDPVR)
- Latm fails (gets detected as Mpeg-1 Audio)
- some VC-1 TS fail (Video gets detected as Audio Stream)

Lav TS Splitter
-----------------
- No Stream switching
-+ Sync issues with ADTS muxed streams (Hauppauge HDPVR) (though Video Stream Parsing can be disabled that fixes it other "broken" streams anyways stopped working that where affected by this setting)
+ Latm works
+ More VC-1 TS work (doesn't get detected as Audio Stream)

[VipZ]

Yeah i can reproduce it just fine, i just don't know why =)

This may be bad idea :) , but what about on opening a file, do a seek to the beginning?

[nevcairiel]

- No Stream switching


Eh? You can switch between streams just perfectly.

[nevcairiel]

This may be bad idea :) , but what about on opening a file, do a seek to the beginning?

I decided to fix it properly instead. How is that for an idea? :)
From what i could see, it should've only ever affected SSA/ASS subs, yea?

Anyway, i dug into ffmpeg and removed the broken code in the mkv demuxer there.

[VipZ]

I decided to fix it properly instead. How is that for an idea? :)
From what i could see, it should've only ever affected SSA/ASS subs, yea?

Anyway, i dug into ffmpeg and removed the broken code in the mkv demuxer there.

That's always better :)

Thanks

[nevcairiel]

LAV Filters 0.24

General
- Big ffmpeg update! Libraries have been renamed (version increase)

LAV Splitter
- Obviously wrong frame rates will no longer be reported to the decoder
- Improved mpeg2 playback
- Improved dynamic media type changes
- Fix the first few frames of ASS/SSA subtitles in Matroska
- Fix an issue with the display of some codec names
- Add proper subtypes for little-endian PCM
- Fix subtypes for QT PCM

LAV Audio
- Support processing of 64-bit double output from the decoders
- PCM data will be buffered before its send to the renderer/post processor


Download: Installer (both x86/x64) (http://files.1f0.de/lavf/LAVFilters-0.24.exe) -- Zips: 32-bit (http://files.1f0.de/lavf/LAVFilters-0.24.zip) & 64-bit (http://files.1f0.de/lavf/LAVFilters-0.24-x64.zip)

No comments today, my food is about done and i'm hungry!

[CruNcher]

Eh? You can switch between streams just perfectly.

Huh in Hillary.0000.ts neither in multiplex.ts the other Video Streams are shown in the list, i don't mean normal Audio stream switching, crazily the Video Switching works indeed for *.m2ts though i not have a full *.m2ts stream with multiple different streams (lower SD res documentary stream) to test that only streams where another stream is indicated and their it switches to black (obviously) but for .ts (Satellite stuff) their is no switching support or i must be blind MPC-HC splitter has that support but it works so so (very decoder dependent) ;)

Also already 2 *.m2ts streams by now cause a crash in Cyberlinks Decoder (264dsse3) with Lav Splitter (0.23)

[fastplayer]

LAV Filters 0.24
The progress you make from release to release is just :eek:
:thanks:

[SamuriHL]

The progress you make from release to release is just :eek:
:thanks:

It really is most impressive!

[nevcairiel]

Huh in Hillary.0000.ts neither in multiplex.ts the other Video Streams are shown in the list, i don't mean normal Audio stream switching, crazily the Video Switching works indeed for *.m2ts though i not have a full *.m2ts stream with multiple different streams

You're talking about DVB files with multiple programs. Thats program switching, not stream switching. Blu-rays have different streams, of the same movie. DVB files have different programs, which different sets of streams, but not related to each other.


Also already 2 *.m2ts streams by now cause a crash in Cyberlinks Decoder (264dsse3) with Lav Splitter (0.23)

I figured out whats causing it, and am doing it on purpose on as many files as i can find, just for you! :p

[VipZ]

I also have a MPEG-TS file with multiple video/audio streams, one with 1080i MPEG2/AC3 and the 2nd set at 480i MPEG2/AC3

MPC does switch perfectly on this TS, but does get the duration wrong. LAV cant switch either video or audio, but gets the duration right

Personally this didn't bug me much due to LAV selecting the 1080i and playing it perfectly.

If you want me to try get a sample of this let me know, no idea how easy on dual video TS files this is though?

Here is the MPC splitters breakdown on stream's http://www.mediafire.com/i/?e3yo957a040rkhf

LAV Filters 0.24

Thanks for the new version :)

[nevcairiel]

The MPC-HC splitter just ignores programs, and shows streams of all programs. But thats rather silly, as with programs, you basically need/want to switch video, audio and subs at the same time, and not every stream separately (how much fun is video from program 2 with audio from program 1...?)

[VipZ]

The MPC-HC splitter just ignores programs, and shows streams of all programs. But thats rather silly, as with programs, you basically need/want to switch video, audio and subs at the same time, and not every stream separately (how much fun is video from program 2 with audio from program 1...?)

True, as long as it plays the HD program, I am happy :)

[nevcairiel]

True, as long as it plays the HD program, I am happy :)

It actually plays the first program in the file, just consider yourself lucky. :D

[Sebastiii]

The progress you make from release to release is just :eek:
:thanks:

+1
Really Great ;)
Thank you again.

[totya]

Hi!

I'm uses this splitter, because MPC-HC built in splitter don't like my avi files with x264 codec (lossless).

But this splitter new versions too not good.

0.20 OK, http://img202.imageshack.us/i/1goode.png/
0.21 0.22 no video
0.23 0.24 picture is bad, http://img199.imageshack.us/i/0bad.png/

See pictures with full size.

Sample video:
http://www.multiupload.com/NMJBU9ZVC7

[CruNcher]

Nev with the latest ffplay from Libav http://forum.doom9.org/showpost.php?p=1494637&postcount=1739 <- works fine with the one from ffmpeg it fails using http://research.m1stereo.tv/ffmpeg/snapshots/?C=M;O=D
The fail from ffmpeg though seems to be in this case a decoder failing maybe though also his build compilation, but at least the parsing works in both cases so your splitter is bugged since 0.23 and 0.24 with this stream now (black screen issue).

[nevcairiel]

0.20 OK, http://img202.imageshack.us/i/1goode.png/
0.21 0.22 no video
0.23 0.24 picture is bad, http://img199.imageshack.us/i/0bad.png/


Your "bad" image looks alot sharper, and you think thats bad? I would call your "good" as bad.

[totya]

Your "bad" image looks alot sharper, and you think thats bad? I would call your "good" as bad.

Hi!

I know, this is sharp, but ugly with real nature video. This is only show what is the different. Version 0.20 (or few lower version what I see) play correcty this file, similar play with VLC and other media players (without LAVF).

[nevcairiel]

The splitter has no influence how the decoded video looks. If the decoder is making it sharper, thats the decoder doing it.

[totya]

The splitter has no influence how the decoded video looks. If the decoder is making it sharper, thats the decoder doing it.

Hi!

This is not really true, I only install/uninstall your filter, and I see different. See yourself with sample video, if you want, with MPC-HC.

[nevcairiel]

Thats still the decoders doing. Its responsible for parsing the data i give to it, if it interprets different forms of data differently - there isn't much to do.

I tested with CoreAVC, as it seems to be the only H264 decoder i have that can decode H264 Lossless, and the sample video looks just fine to me, as sharp as a desktop recording should be.
That said, i had to fix something to get H264 in AVI to work at all with CoreAVC. :)

Maybe it helps you, check the link to the new version at the bottom of this post.


also another test broke with the newer versions now nev that was (indirectly) related to the Video Stream Parsing sync issue :(

http://www.mediafire.com/?iye63xy9l5lmbq9 (black screen with new version, like as Video Stream Parsing is disabled in 0.22)

I fixed playback of that file. Its still a broken non-spec-compliant file, but at least it'll play again. Didn't test sync, as i prefer listening to my music. :p

Just throw this on top of 0.24; http://files.1f0.de/lavf/LAVSplitter-0.24-2-gcb45165.zip

[CruNcher]

I guess it wont play without Video Parsing enabled ;) ? so it will probably break the sync HDPVR playback then again, nice to see @ least that it doesn't influence any Mpeg-2 streams anymore in terms of sync issues :D

[kieranrk]

The sample here does not decode with lavcaudio: http://forum.doom9.org/showthread.php?p=1495512#post1495512

This is possibly because of the MPEG-4 ancillary data it has.

[nevcairiel]

I guess it wont play without Video Parsing enabled ;) ? so it will probably break the sync HDPVR playback then again :D
No idea, i dont test without parsing enabled.

[pankov]

nev,
if I'm not asking too much, would you add shortcuts for LAVSplitter and LAVAudio configuration in the Start Menu folder?
I've been playing around with the settings and a few times I had to start Graph Studio to open the properties page ( I could have done it through ZoomPlayers options also) to be able to change some settings - like re-enable the demuxing of some formats

[nevcairiel]

The sample here does not decode with lavcaudio: http://forum.doom9.org/showthread.php?p=1495512#post1495512

This is possibly because of the MPEG-4 ancillary data it has.

The file plays just fine. However, its AAC in LATM format, which will only work if you're using LAV Splitter as well.

There is no real standard how to transfer AAC LATM over DirectShow, so i do it how ffmpeg gives me the data, i pre-parse the data in the splitter (assembling of full frames, mostly), and do the actual LATM decoding in the decoder.

The MPC-HC internal MPEG Splitter does not support LATM at all, neither does any other widely used splitter. Only some special DVB Source filters support it, and possible the TS splitter in Media Portal.

Anyhow, use LAV Splitter with LAV Audio, and that file plays just peachy.


nev,
if I'm not asking too much, would you add shortcuts for LAVSplitter and LAVAudio configuration in the Start Menu folder?
I've been playing around with the settings and a few times I had to start Graph Studio to open the properties page ( I could have done it through ZoomPlayers options also) to be able to change some settings - like re-enable the demuxing of some formats
Its not that easy, sadly. I'll have to look up how to spawn a properties page without an actual player that usually does that job. I'll get to it eventually..

[CruNcher]

The sample here does not decode with lavcaudio: http://forum.doom9.org/showthread.php?p=1495512#post1495512

This is possibly because of the MPEG-4 ancillary data it has.

What Sattelite Recording App/Hardware transmuxes @ record into BDAV *.m2ts ?

[kieranrk]

The file plays just fine. However, its AAC in LATM format, which will only work if you're using LAV Splitter as well.

There is no real standard how to transfer AAC LATM over DirectShow, so i do it how ffmpeg gives me the data, i pre-parse the data in the splitter (assembling of full frames, mostly), and do the actual LATM decoding in the decoder.

The MPC-HC internal MPEG Splitter does not support LATM at all, neither does any other widely used splitter. Only some special DVB Source filters support it, and possible the TS splitter in Media Portal.

Anyhow, use LAV Splitter with LAV Audio, and that file plays just peachy.


Ah, never mind. It was some mainconcept thing causing the issue.

[nevcairiel]

What Sattelite Recording App/Hardware transmuxes @ record into BDAV *.m2ts ?

According to the original poster, "Panasonic Freeview HD recorder", which seem to be able to record HD TV onto Blu-rays.