LAV Filters - DirectShow Media Splitter and Decoders

[XPC]

May be you could take a look to the debug output I attached to the issue. It could give us an idea on what is happening.

If you want, I can do the debugging, but I would need some support.

[doskabouter]

Hi,

I was just experimenting a bit (seems that I still have some SAF parts installed) with LAV and h264 video, and I get a lot of framedrops using LAV.

When I choose ffdshow, the video is playing smoothly, so hardware is definitely capable of displaying it.

Screenshots of different config/movie in mediaportal here:
ftp://dump@88.159.164.124/LAV/LAV Experiments.zip

Os is vista32, AMD Athlon 4850e with onboard Radeon HD 3200.

Video:
Video
ID : 1
Format : AVC
Format/Info : Advanced Video Codec
Format profile : High@L4.0
Format settings, CABAC : Yes
Format settings, ReFrames : 4 frames
Muxing mode : Container profile=Unknown@4.0
Codec ID : V_MPEG4/ISO/AVC
Duration : 1h 48mn
Bit rate : 8 515 Kbps
Nominal bit rate : 8 968 Kbps
Width : 1 920 pixels
Height : 1 080 pixels
Display aspect ratio : 16/9
Frame rate : 23.976 fps
Resolution : 24 bits
Colorimetry : 4:2:0
Scan type : Progressive
Bits/(Pixel*Frame) : 0.171
Writing library : x264 core 94 r1583 7608d73
Encoding settings : cabac=1 / ref=4 / deblock=1:0:0 / analyse=0x3:0x113 / me=umh / subme=7 / psy=1 / psy_rd=1.00:0.20 / mixed_ref=1 / me_range=16 / chroma_me=1 / trellis=1 / 8x8dct=1 / cqm=0 / deadzone=21,11 / fast_pskip=1 / chroma_qp_offset=-3 / threads=12 / sliced_threads=0 / nr=0 / decimate=1 / interlaced=0 / constrained_intra=0 / bframes=3 / b_pyramid=2 / b_adapt=1 / b_bias=0 / direct=3 / weightb=1 / weightp=0 / keyint=250 / keyint_min=25 / scenecut=40 / intra_refresh=0 / rc_lookahead=40 / rc=2pass / mbtree=1 / bitrate=8968 / ratetol=1.0 / qcomp=0.60 / qpmin=10 / qpmax=51 / qpstep=4 / cplxblur=20.0 / qblur=0.5 / ip_ratio=1.40 / aq=1:1.00
Language : English


Can you take a look at it, or do you need more info?

[itsonlyjustincase]

Hi guys,

I have worked a lot and understood a lot. But that i don't manage to get it :

Left part of the screen is the 2 videos playing at the sametime and being mixed (that is why there is only 1 output windows)

I had enabled the lav tray icon. As you can see the DXVA2 native is choosen. You can see that it is not in use. It is written "avcodec".

But on the right part is the same video launched with MPC-HC forced with lav (same configuration with DXVA2 native). And that time it's being used well and i can confirm it with GPU-Z graph which shows that the video engine load increases only when i start the video with MPC-HC

My goal would be to ensure my application is using DXVA2

File used is 720p H264 AAC (taken from youtube)

[itsonlyjustincase]

My Serato Video app is OpenGL perhaps it's the reason ? Is there any LAV Filters OpenGL version ?

[Konrad Klar]

@itsonlyjustincase
Try DXVA2 (copy-back). Native requires a compatible renderer (not sure what Serato Video app is exactly doing).

[itsonlyjustincase]

Originally Posted by Konrad Klar

@itsonlyjustincase
Try DXVA2 (copy-back). Native requires a compatible renderer (not sure what Serato Video app is exactly doing).

The thing i don't understand is why it's not the lav video decoder that manages the hardware acceleration :s.

I want to use DXVA2 native because i have the best video engine load with it and my GPU is the most used with that setting so my CPU is relaxed the most and allow me to mix in better condition and as well record my mix with 3rd part soft like msi after burner.

Here is a kind of stress test with 6 H264 720p videos loaded at the same time with MPC-HC using LAV and the different settings :

[itsonlyjustincase]

Same test with 12 videos loaded at the same time (still H264 720p)
In the order of the screeshot :
-CUVID
-DXVA2CB
-DXVA2N

[itsonlyjustincase]

In case of some would be curious i also did the test with Intel Quicksync as my asus UX32VD has also intel HD 4000. In that case i forced MPC-HC to use the intel GPU. I couldn't do anything more as the CPU was 100% :

[Konrad Klar]

If the codec is used for playback (i.e. video is not decoded faster than in its supposed FPS) what a virtue in higher GPU load?

Native decodes frames to the graphics card memory and passes them directly to the renderer.
Copy-back and CUVID use more CPU time just because they copy frames from GPU to main memory and back, but they do not require compatible renderer and allow for processing a frames before sending them to renderer.

[itsonlyjustincase]

Originally Posted by Konrad Klar

If the codec is used for playback (i.e. video is not decoded faster than in its supposed FPS) what a virtue in higher GPU load?

Native decodes frames to the graphics card memory and passes them directly to the renderer.
Copy-back and CUVID use more CPU time just because they copy frames from GPU to main memory and back, but they do not require compatible renderer and allow for processing a frames before sending them to renderer.

Yes I understand but it is just that visually with the 6 vids for example and dxva2 native, it was playing fluid. It was not the case with CUVID. And the major point is that my my Serato Video software, when I play 1 video the fps is around 40 (the pipe fps) then drops to 20fps with two videos loaded at the same time so it's not fluid anymore (less than 25-30 fps). If i had msi after burner recording with vfw x264 recording optimized to its best performance settings (fast decode, zero latency, etc...) it drops to something like 10 fps and this even if the CPU and GPU are OK :s (yes so freaking weird :s). That is why i thought perhaps using dxva2 native it would stress the GPU a bit more cause i don't understand why it's slow regarding the fact the CPU is around 60% of load, the GPU around 40%, the video engine around 30%, the RAM around 50%, I have a samsung 830 SSD on which the msi afterburner output file is being copied and the output don't manage to stay at a reasonnable 30 fps :s. I thought of a bottleneck in a first time but everything seems normal

[itsonlyjustincase]

It would be awesome to have lav using CUVID+QUICKSYNC at the same time to decode

[itsonlyjustincase]

Or option to force framerate

[Asmodian]

Please! smaller screen shots.

Originally Posted by itsonlyjustincase

The thing i don't understand is why it's not the lav video decoder that manages the hardware acceleration :s.

LAV does manage the hardware acceleration but to leave the video frame in the GPU's memory you need a renderer that knows how to deal with it. If your renderer doesn't you need copy back.

Originally Posted by itsonlyjustincase

It would be awesome to have lav using CUVID+QUICKSYNC at the same time to decode

HUH? no it wouldn't, that doesn't even make sense. Or do you mean for different videos? Mulitple instances of LAV running at the same time some using CUVID and some using Quicksync?

This is about trying to play multiple videos all at the same time? None of the hardware acceleration options have good support for multiple streams at once as far as I understand it. This is why you start getting dropped frames even with both the GPU and CPU at less than 100%. It isn't something LAV can influence.

[itsonlyjustincase]

Originally Posted by Asmodian

Please! smaller screen shots.



LAV does manage the hardware acceleration but to leave the video frame in the GPU's memory you need a renderer that knows how to deal with it. If your renderer doesn't you need copy back.



HUH? no it wouldn't, that doesn't even make sense. Or do you mean for different videos? Mulitple instances of LAV running at the same time some using CUVID and some using Quicksync?

This is about trying to play multiple videos all at the same time? None of the hardware acceleration options have good support for multiple streams at once as far as I understand it. This is why you start getting dropped frames even with both the GPU and CPU at less than 100%. It isn't something LAV can influence.

Sorry for the XL screenshots.

Do you agree that using CPU+GPU to encode or decode videos does make sense to have better performance ? That's what the good video application do nowadays to have better conversion times etc...

So why using CPU+GPU+GPU wouldn't make sense ? It's just about being able to take power from everywhere to avoid bottleneck of one of the elements. It's like an application which uses all the cores of your CPU will work with better performance than one using only a single core.

But analyzing all of this just make me realize that i should just admin that it's the Serato Video software (www.serato.com) which was developped like shit. I can open 6 videos using 6 lav instance at the same time and playing fluid, but 2 with the Serato app can't well :s. The rendering from what i understand is crappy.

I just hopped i could be able to find a solution thanks to a kind of magical video codec

[Mercury_22]

Latest versions of LAV DXVA2 (native) are crashing when trying to play Blu-ray menus with MediaPortal and DSLibBluray there are also black screens instead of video for some menu videos too (this one tested only in DSLibBluray)

Everything it's playing fine with LAV DXVA2 (native) "official" version (from the first page)

P.S. With CB the only problem in all version are the black screens in the menu

[moliko]

I have a issue with the Dolby Pro Logic II.
Enable Mixing is set to 5.1.
Matrix Encoding: Dolby Pro Logic II
Setttings: Don´t mix Stereo sources unchecked
The Output shows 6 Channels but its plays only Stereo.

Is it possible in future version to get LFE Crossover (Bass Redirection) and a Profil Manager for Lav Audio ?

Thanks for your work

[nevcairiel]

Originally Posted by moliko

I have a issue with the Dolby Pro Logic II.
Enable Mixing is set to 5.1.
Matrix Encoding: Dolby Pro Logic II
Setttings: Don´t mix Stereo sources unchecked
The Output shows 6 Channels but its plays only Stereo.

DPLII is only for downmixing, so that a DPLII-compatible receiver can reconstruct a 5.1 signal (useful in case you only have a stereo SPDIF link to your receiver, for example)
LAV does not do any upmixing right now, because proper upmixing requires a lot of filtering, and simple upmixing sounds terrible for movies.

Originally Posted by moliko

Is it possible in future version to get LFE Crossover (Bass Redirection) and a Profil Manager for Lav Audio ?

LFE crossover will most likely not happen, and its doubtful a profile manager will ever be added, because it goes against my design goal of simple configuration, and focusing the effort on perfect playback instead, not post-processing.

[wanezhiling]

http://www.sendspace.com/file/h18xmn
jitter in sw/dxva mode, cuvid is fine.

latest lav s + lav v

[nevcairiel]

Originally Posted by wanezhiling

http://www.sendspace.com/file/h18xmn
jitter in sw/dxva mode, cuvid is fine.

latest lav s + lav v

Ah fun another ffmpeg bug from the recent changes. Its fixed locally, will push when i'm back home.

[wanezhiling]

a question: sw and 2 dxva modes are based on ffmpeg? cuvid and qs are independent? am i right?