BlueskyFRC: AMD and Intel GPU-assisted frame interpolation

[tobindac]

Bluesky Frame Rate Converter is a DirectShow filter. It uses the AMD Fluid Motion Video hardware feature. This is an unofficial thread.

Download and official Information page: http://bluesky23.yukishigure.com/en/BlueskyFRC.html

Limitations:

The AMD Driver only supports 24FPS(5/2x rate) and 30FPS(2x rate)
That in extension means it only produces up to 60FPS
Notice that it does not work with 25FPS video files


Speculation:

Either the driver or/and hardware can not support other modes or a driver or/and hardware upgrade in the future might remove some of the frame rate limitations


Instructions:

Install
Enable Fluid Motion Video on AMD graphics settings (custom settings)
Use the filter in a player, e.g. steps for MPC-HC: http://bluesky23.yukishigure.com/en/bfrc/howto/mpc.html


Requirements:

A relatively new AMD or Intel GPU with some exceptions, see main URL for details


Initial impressions/Comparison to SVP:

I found it more low latency than SVP in the fluidity of playback, but it is limited in terms of max FPS because a monitor might run on higher horizontal refresh than 60Hz. SVP does give the impression that it looks better in certain scenes though. The main problem detected to date with BlueskyFRC is that 25FPS video sources do not seem to be supported at all by the AMD driver.
The method is extremely responsive. The video comes up at 60FPS *(if it's supported) immediately and transparently. It doesn't appear to produce bugs or quirks with seeking either.
The CPU load remains apparently unaffected proving it is almost entirely an GPU-assisted method

[Milardo]

Is there anything similar that would work with a nvidia gpu, or does nvidia have anything like this?

[cork_OS]

Is there anything similar that would work with a nvidia gpu, or does nvidia have anything like this?
DmitriRender (paid), SVP (CPU hungry).

[huhn]

Limitations:

The AMD Driver only supports 24FPS(5/2x rate) and 30FPS(2x rate)
That in extension means it only produces up to 60FPS
Notice that it does not work with 25FPS video files


most of this should be "fixable" with a "dirty" hack. by lying about the true refreshrate.

pretending 24p/25p is 30p and let it double it should work.

it can do 24 5/2 interpoaltion so maybe it is possible to get 120 hz with even more hacks out of it.

[tobindac]

most of this should be "fixable" with a "dirty" hack. by lying about the true refreshrate.

pretending 24p/25p is 30p and let it double it should work.

it can do 24 5/2 interpoaltion so maybe it is possible to get 120 hz with even more hacks out of it.
I was wondering if the problem is that it's hardware-limited, that even if AMD themselves would want to do it they couldn't unless they made it slower (and complex) with software interpolation, but that's only speculation on my part.

[huhn]

they can do 30hz -> 60hz so the "hardware" is more than fast enough to do 24hz -> 48hz and 25hz -> 50hz.

the problem is at the moment AMD can only aim at 60 hz nothig else.
casual PC user rarely change the refresh rate if ever.

AMD doesn't have a refreshrate option in there current driver.

[tobindac]

they can do 30hz -> 60hz so the "hardware" is more than fast enough to do 24hz -> 48hz and 25hz -> 50hz.

the problem is at the moment AMD can only aim at 60 hz nothig else.
casual PC user rarely change the refresh rate if ever.

AMD doesn't have a refreshrate option in there current driver.
It's fast enough for sure in theory, but I wonder if Fluid Motion parts of the chip are so hardcoded that they themselves can't do it, unless the hardware itself is updated.

[ajp_anton]

What. There's no difference between the frames in 25 and 30 fps. The piece of software that initially reads the file only needs to lie about the fps.
edit: though it could be problematic for real-time playback, in case the hardware expects the frames to arrive at a certain speed. Don't know what happens if the decoder is too slow (a possibility in real life) and feeds a 30fps clip at 25fps to the interpolator. Or at 24fps, does it switch to 5/2 then?

[huhn]

well it is pretty hard to test.

bluesky is blocking or rejecting ffdshow raw.
the output of bluesky is not supported in avisynth with a grf directshow import. it is always NV12 which is not supported in avisynth directshow grf import.

but it can render frames at a much higher speed.
using madVR with 128 frames decoder queue it create 128 frames way below a sec and is instantly filling the queue.

[tobindac]

This filter doesn't seem to do that much on its own. I wouldn't be surprised if it's mainly a raw stream feeder to the GPU driver of some sort. I haven't dealt at all with DirectShow ever though so I wouldn't know how to look but I would not be surprised if an experienced DirectShow coder could replicate this filter fully and then some within days at most.

PS. A huge advantage of this method is that the CPU is left almost entirely unused, unlike SVP which needs an extreme CPU contribution, even on GPU mode.

[Starks]

If this was better documented, maybe I could get it to work. I'm not sure if my GCN 1.0 laptop is supported. Fluid Motion is enabled in Crimson, but I can't get the filter to load with any player.

Edit: Got it to work. Don't use Auto for mode selection.

[MS-DOS]

Does it even work? Most options are greyed out (http://i2.imageban.ru/out/2017/02/11/481cbd3ca4431feed0e412f4a64ec89f.png), MPC doesn't load it either.

[huhn]

looks like the program can't find your AMD GPU.

[Alessio1989]

Hi, anyone was able to run BlueskyFRC with 25p videos? Q_Q

[tobindac]

Hi, anyone was able to run BlueskyFRC with 25p videos? Q_Q
The author reports that the GPU driver itself does not support it. I speculate that this is all tied to hardware capability. The method is extremely snappy/responsive/fast so I would not be surprised if there is little to none being done on user space for this to work.

[tobindac]

Version 2.7.1 (03/25/2017)

Fixed incorrect frame issue when running Zero-Copy Mode
Fixed screen rotation issue when using PotPlayer
Minor changes and fixes


Version 2.7.0 (02/27/2017)

Improved rate detection processing
Fixed image corruption issue when enabling DXVA decode


PS. I'm getting an issue that if I fiddle with options after a clean install, it doesn't work anymore and it needs a clean reinstallation, I have informed the author (or tried to).

Update: PPS. He claims he has fixed it: http://bluesky23.yukishigure.com/bfrc/BlueskyFRC.zip [unreleased 2.7.2 version]

[TheElix]

It doesn't load in the filter chain whatever I do on my AMD HD 7990.
(registered the filter, initialized AFM support, set up an external filter in MPC-HC as preferred etc.)

[huhn]

did you try it with a disabled GPU?

[TheElix]

Yes. Except dropped frames nothing's changed - the filter isn't loading in the chain.

[tobindac]

New update seems to be up

https://i.imgur.com/vlislnw.png

[Mykola]

Has anybody heard anything about video features in Vega?

[strumf666]

Bluesky works with Vega and I like the picture it gives.

[Polopretress]

Hi !
I have some information that HDR is not managed anymore by Bluesky since the update of the ATI driver done just after Windows 10 ver1803 update (April update).
To keep HDR content, it is necessary to stay with old revision of the ATI driver. (< revision 18.4.1)

Do you confirm ?
TY

[BerndFfm]

Yesterday i tested Bluesky FRC !

I tested 3 different AMD Cards : RX580, RX590, RX5700XT.

I tested the following AMD Driver :
Non-WHQL-Win10-64Bit-Radeon-Software-Crimson-ReLive-17.9.1-Sep7.exe
non-whql-win10-64bit-radeon-software-crimson-relive-17.9.2-sep21.exe
Win10-64Bit-Radeon-Software-Adrenalin-Edition-17.12.2-Dec19.exe
Win10-64Bit-Radeon-Software-Adrenalin-Edition-18.1.1-Jan18.exe
win10-64bit-radeon-software-adrenalin-edition-18.2.1-feb7.exe
Win10-64Bit-Radeon-Software-Adrenalin-Edition-18.3.3-March18.exe
Win10-64Bit-Radeon-Software-Adrenalin-Edition-18.3.4-March23.exe
win10-radeon-software-adrenalin-2020-edition-19.12.2-dec12.exe

I tested the following Blusky versions : BlueskyFRC_2.15.3_Setup.exe and BlueskyFRC_2.8.2_Setup.exe.

On 2 different computer. None of the installations work with BT.2020.

With REC.709 it was a great picture ! I never saw "Art of Flight" Chapter 2 so fluid and so sharp !

I would be happy to find a solution.

Greetings Bernd

PS.: My FI test scenes : http://download.seven-c.de/files/uhd/fi/

[Polopretress]

The combinaison that works on HDR movie is:
- AMD drivers : 18.3.4 (it does not work with 18.4.x)
- bluesky FRC : 2.12.3 but not above.
- madvr+lav in 64 bits.
- No 5700XT Radeon.

[bofex]

Hello!
Does anybody know something about support of intel GPU with FRC?
Since V2.2 or something like that support for Haswell or newer GPU was added...
But it seems not working on a Skylake GPU... or are there some special requirements?

:thanks: