Automatic white balance with RGBAdapt plugin

[Bernardd]

Thanks StainlessS

I think add lines like below to export in text file the computed datas.

enregistre = true

Fmb= "%7.3f %5.3f %5.3f" +
\ " %5.3f %5.3f %5.3f %s\n" +

\ "%7.3f %5.3f %5.3f" +
\ " %5.3f %5.3f %5.3f %s\n" +

\ "%7.3f %5.3f %5.3f" +
\ " %5.3f %5.3f %5.3f %s"

E=RT_String(Fmb,
\ red_bias, red_gain, red_cont,
\ red_rpow, red_spow, r_spmid, r_pord,

\ grn_bias, grn_gain,grn_cont,
\ grn_rpow,grn_spow, g_spmid, g_pord,

\ blu_bias,blu_gain,blu_cont,
\ blu_rpow,blu_spow, b_spmid, b_pord)
if (enregistre) {RT_WriteFile("F:\Travail sur Videos\RGBAdapt.txt",string(E))}

The text file is like this sample :
-114.959 1.255 1.439 0.291 1.037 0.418 False
30.556 1.221 1.380 1.516 0.985 0.621 False
70.043 1.541 1.930 1.828 0.979 0.599 False

If RGBAdapt_graffer soft can load this datas and use them like args, it is more easy to refine the output process by looking the color channels curves.

I am not hurry, you are the master of time.

Thanks

Bernard

[Bernardd]

Hello,

Bellow, a new script. The aim is always the same : get a better result than ColorYUV(autowhite = true).
This new version is in accordance with Stainlesss nice and smart redaction to have compatibility with Avisynth x32 and Avisynth+ x64 and the suitable plugins.
This script use only maximum, minimum, maximum - minimum difference, average color channel values.
This script is more sober. Now, they are no more my experimental factors to ponderate and adapt gain, contrast, bias and gamma corrections.
In fact, the script is less automatic, if you are lucky, the full automatic ouput should be good for you, but it is possible you must tune some process.
In the previous scripts, automatic gain and contrast were sometimes too much.
In this script, gain and contrast calculation is new. If necessary, one manual tune has been also add to decrease automatic gain and contrast.

This script applies a automatic gain and contrast, compute the datas of the clip with this gain and contrast, then applies a gray world theory corrections with bias and gamma process based on the computed datas.
By default, for gray world theory, half of job is made with bias and the other half is made with gamma (rpow and spow). One manual tune has been add to tune bias gamma process actions mix.

Like in previous scripts, you can desable automatic gain, contrast, bias, rpow and spow. You can choose the best combination of process for your videos.

For fast tune, the script can display four screens :
1- one with original clip, ColorYUV(autowhite = true) clip, overlay of automatic default mode but without gain on left and without contrast on right and selected output.
This screen is to better result than ColorYUV(autowhite = true) assement,
to tune gain and contrast, (gain desable, or contrast desable, or the both, or perhaps decreased automatic gain and contrast)
2- one screen with automatic default mode with 50 % of bias use and 50% of gamma use, output with 25 % of bias use and 75% of gamma use, ouput with 75 % of bias use and 25% of gamma use and selected output.
This screen is to adjust action percentage of bias process versus gamma process.

3- one screen with selected output default spmid, selected output with half decrease automatic spmid, selected mode output with half increase automatic spmid, and selected output with your spmid tune.
this screen is to adjust spmid correction (you have to change color channel spmid args of RGBAdapt plugin).

4- one screen with selected output without refine, selected output with invariant red refine and or RGBAdapt plugin args mod, selected output with invariant green refine and or RGBAdapt plugin args mod,and selected output with invariant blue refine and or RGBAdapt plugin args mod.
This screen is to adjust refine args. You can change this args and see if it is good or no for one color channel.

In finish, you can also refine the automatic output with whole RGBAdapt plugin args. These RGBAdapt plugin args tunes are added to automatic tunes.

The script release zip file content two avs files, one for the functions, the secund for the client.
Decription of args are also in documentation file joint in zip file.

The script here https://www.dropbox.com/s/8liexi6r1abnfr0/RGBAdapt%20AWB%20Process.7z?dl=0

Bernard

[Bernardd]

Ok, henryperu77, a avs script demo with your video.
You have to upload these files and to add their paths on your computer.

This script make only white balance for you. For color saturation, or tone adjust try to use Tweak (internal avisynth function).


Import ("C:\................\RGBAdapt_Awb_Process v 2019 juil 32 64 bits function.avs")
LoadPlugin("C:\.............\GRunT101\GRunT.dll")
LoadPlugin("C:\.............\GScript_11\GScript.dll")
LoadPlugin("C:\.............\RgbAdapt_25&26_x86_x64_dll_v0.05_20190301\Avisynth+_x86\RgbAdapt_x86.dll")
LoadPlugin("C:\.............\RT_Stats_25&26_dll_v2.00Beta11_20170910\Avisynth26\RT_Stats26.dll")

LoadPlugin("C:\.............\ffms2-2.20-icl\x86\ffms2.dll")
FFVideoSource("C:\..........\beatles-film.mp4")

AWB_Func(matrix="Rec601",show_scrutinized=false,x=0.14,y=0.04,w=0.14,h=0.04,threshold=0.1,show_info=false,
\ gain = true, cont = true, g_c_decrease = 1.0, bias = true, rpow = true, spow = true, gamma_bias_mix = 0.5)


https://i.postimg.cc/McBkGh30/beatles.png (https://postimg.cc/McBkGh30)

[henryperu77]

Ok, henryperu77, a avs script demo with your video.
You have to upload these files and to add their paths on your computer.

This script make only white balance for you. For color saturation, or tone adjust try to use Tweak (internal avisynth function).



https://i.postimg.cc/McBkGh30/beatles.png (https://postimg.cc/McBkGh30)

hi thank you
please could you check starting Frame 5784, the color change like crazy...

[Bernardd]

This script is not full automatic. Some scenes need a different tune.

Thus you can try this with no Grey world theory bias process.

AWB_Func(matrix="Rec601",show_scrutinized=false,x=0.14,y=0.04,w=0.14,h=0.04,threshold=0.1,show_info=false,
\ gain = true, cont = true, g_c_decrease = 1.0, bias = false, rpow = true, spow = true, gamma_bias_mix = 0.5)

[henryperu77]

This script is not full automatic. Some scenes need a different tune.

Thus you can try this with no Grey world theory bias process.

the problem is still the same scenes, the color change frame to frame...

[henryperu77]

this is sample

https://drive.google.com/open?id=1jN_LO2MsfuNKwMhlYrMh2I0R8KikjKop

[Bernardd]

It is extreme pixels problem when pixel max and min values are extracted. You can try to increase threshold arg, like this

AWB_Func(matrix="Rec601",show_scrutinized=false,x=0.14,y=0.04,w=0.14,h=0.04,threshold=0.5,show_info=false,
\ gain = true, cont = true, g_c_decrease = 1.0, bias = false, rpow = true, spow = true, gamma_bias_mix = 0.5)

But, i have not found a good tune for whole clip.

The solution is not use of gain and contrast, like below.

AWB_Func(matrix="Rec601",show_scrutinized=false,x=0.14,y=0.04,w=0.14,h=0.04,threshold=0.1,show_info=false,
\ gain = false, cont = false, g_c_decrease = 1.0, bias = false, rpow = true, spow = true, gamma_bias_mix = 0.5)

[henryperu77]

but the colors are awful , i cant fix it with colormill

[Bernardd]

Hello,

A new version, more smart, more automatic.

This script brings the RGBAdapt plugin an automatic mode to achieve the white balance.

The default white balance results from the combination of gain, contrast, average, gamma (rpow) and gamma correction with S (spow) curve on each color channel.

The correction in agreement with the gray-world theory results from the combined action of a correction of bias and a correction of rpow, the second treating the part not taken into account by the first one. The script calculates for each image the proportion of work done by each process. Finally a spow correction (S curve) is added.

The data used to calculate these corrections, ie the average, maximum and minimum values ​​of the color channels, do not allow a continuous description of the histogram curve of the three basic colors, so they are not sufficient to choose the inflection point of the S curve. By default, the script proposes for each channel, an inflection centered on its average value. For a little disturbed movie, this solution may be satisfactory, but in general, you will need to adjust the spmid of each channel by watching the movie.

Default automatic mode result for Lena in center, with red_spmid = 0.20 green_spmid = 0.20 and blue_spmid = 0.70 on right.

https://i.postimg.cc/zvz1q1ZC/Lena2.png

The script here in attachment
and here https://www.dropbox.com/s/j6ahq37enoo8z1b/rgbadapt_awb_process%2032%2064%20bits%20v%202019%20aug.7z?dl=0

Bernard

[Bernardd]

Hello,

I propose you the last of my script to perform an automatic white balance with the RGBAdapt plugin from Stainless.
Compared to the one, two years old, the use is easier, because there is no more adjustment to adjust the strength of the automatic treatments.
In fact, only five boolean args to enable or not an automatic treatment.

These automatic treatments are:
- adaptation of the input data,
- gain correction,
- contrast correction,
- a bias correction,
- a gamma correction (rpow),
- a gamma correction with curve inflection (spow).

By default, these automatic treatments are activated, they give, in my opinion, an acceptable result for a majority of films with not too disturbed colors.

For films with very disturbed colors, automations provide a white balance approach, which often requires adjustment, but not necessarily.

An adjustment of the inflection point of the gamma curve (spmid), an adjustment of the gain and / or of the contrast, etc ...
These adjustments are made by tuning the native parameters of the RGBAdapt plugin.

So I recommend using AvsPmod to make these adjustments.

You can find the script by following this DropBox link https://www.dropbox.com/s/vhfdt33c4g7t91d/RGBAdapt_AWB_Process%2032%2064%20bits%20v%202021%20sept.zip?dl=0 and attachment.

Bernard

[lewyturn]

Display at the top of the screen: scriptclip: function did not return a video clip (was the undefined value)

[Bernardd]

Sorry, i can not understand the problem without read your function call script. Can you publish this call script.

[coolgit]

What happened to the "Finally, the script adjusts the color temperature. This adjustment can be done automatically or manually." from your first post.

I am currently using ShiftCCT function from https://forum.doom9.org/showthread.php?p=1632812#post1632812

I was wondering if this can be written into your script as a function? Just prefer all in one package (avsi file) that's all.

[Bernardd]

I apologize, the script version in post 1 is a bad fork of my search of an automatic white balance function. The color adjustment was too simple, same value adjustement on red and blu channel with opposit sign and no change for the green channel.

Now, i have released in top post number 61, my last script version.
In this version no more color temperature adjustment, only some automatic actions to be enabled or desabled. To refine the result, the script use only RGBAdapt plugin args.

[Boulder]

Sorry, i can not understand the problem without read your function call script. Can you publish this call script.

I'm seeing the same here, I was just about to test this function for some old VHS transfer cleanup.

Just a basic script like this, after these, copy-pasted the default parameters and function call from the call script in the package.
video=FFVideoSource("video.avi")
audio=FFAudioSource("video.avi")
AudioDub(video,audio)
Crop(26,4,-16,-16)

[Bernardd]

Sorry, i cannot reproduce problem.

I have download my script from my dropbox, i have unzipped le file.
With AvspMod, i have open the file RGBAdapt_Awb_Process v 2021 sept 32 64 bits call.avs

Lines 6 to 11, I have written the path of my video source and paths of my personnal location of plugins. In end, i have written the path of unzipped file RGBAdapt_Awb_Process v 2021 sept 32 64 bits function.avs

With only this amend, the script run with default args.

I have tried an video source like you :
video=FFVideoSource("video.avi")
audio=FFAudioSource("video.avi")
AudioDub(video,audio)
Crop(26,4,-16,-16)
The script run well.

[Boulder]

Have you tried opening the script in any other app, like VirtualDub2? Also, do you use the 32-bit or 64-bit version? I'm on the latest 64-bit Avisynth+. I also tried copy-pasting the whole content of the example script and just used the video loading part from mine, but no luck.

[Bernardd]

Yes after adaptation with my source, plugin, function script paths, i have launched virtualdub2. Its run.

I use Avisynth+ 3.7.0 (r3382, 3.7, x86_64).

To morrow, i shall try to find back my old 32 bits version on my computer.

[Boulder]

Yes after adaptation with my source, plugin, function script paths, i have launched virtualdub2. Its run.

I use Avisynth+ 3.7.0 (r3382, 3.7, x86_64).

To morrow, i shall try to find back my old 32 bits version on my computer.

I'm using the one from this post: https://forum.doom9.org/showthread.php?p=1961264#post1961264

I'll try removing GScript from the plugins folder when my next encode finishes and stops locking the dll file.
EDIT: Removing GScript worked, no more errors.

[Bernardd]

Thanks Boulder.
I am happy that you have found the pb.
With years, we have often old plugins in the avisynth plugins folder. AVS+ have not need Gscript plugin. But i don't know, why AVS+ bug when this plugin exist.
Well done.

[guest]

Display at the top of the screen: scriptclip: function did not return a video clip (was the undefined value)

I'm getting the same error...

Here's my script (I don't really know what I'm doing)

LoadPlugin("%AVISYNTHPLUGINS%\GRunT\grunt.dll")
LoadPlugin("%AVISYNTHPLUGINS%\GScript_32_64\GScript_26_64.dll")
LoadPlugin("%AVISYNTHPLUGINS%\RgbAdapt\RgbAdapt_x64.dll")
LoadPlugin("%AVISYNTHPLUGINS%\RT_Stats\RT_Stats_x64.dll")
Import("%AVISYNTHPLUGINS%\scripts\extras\RGBAdapt_Awb.avs")
video=RGBAdapt_AWB_Process(video)

This a typical script / call for RipBot264.

[kedautinh12]

I'm getting the same error...

Here's my script (I don't really know what I'm doing)

LoadPlugin("%AVISYNTHPLUGINS%\GRunT\grunt.dll")
LoadPlugin("%AVISYNTHPLUGINS%\GScript_32_64\GScript_26_64.dll")
LoadPlugin("%AVISYNTHPLUGINS%\RgbAdapt\RgbAdapt_x64.dll")
LoadPlugin("%AVISYNTHPLUGINS%\RT_Stats\RT_Stats_x64.dll")
Import("%AVISYNTHPLUGINS%\scripts\extras\RGBAdapt_Awb.avs")
video=RGBAdapt_AWB_Process(video)

This a typical script / call for RipBot264.

You need delete LoadPlugin(GScript.dll) cause avs+ don't need gscript

[guest]

You need delete LoadPlugin(GScript.dll) cause avs+ don't need gscript

Your 1,000th post :)

You seem to be able to find where ever I am :)

OK, did that, the error msg has gone, but now the preview flickers, and is generally a bit of a mess.

Is there some fine tuning to be done to that script ??

Oh, and thanks.

[Bernardd]

Can you post a piece of your video ?

[guest]

Can you post a piece of your video ?

Hi Bernardd,

I have been able to capture the "blinking & flashing" with my phone.

So what I am using in RipBot264, which has a "preview" option to check the script & filters you've added, which by default opens the video into MPC-HC.

So this only seems to do this for a few seconds (you will see it settle down), but like I said, this is ONLY a preview, if you move the slider to a new position, it does it again, but if you let it play, it seems to be fine.

I am yet to do a proper encode, it may not be a problem, I will let you know.

Here's the "sample" you requested:-

https://www.mediafire.com/file/rskh22ej7jwbxi8/VID_20220304_130802.mkv/file

My script is shown in post #73, without GScript.

[guest]

Can you post a piece of your video ?

And here is a short encoded clip, and it's way worse :(

https://www.mediafire.com/file/3d1b1sf0u0c2pez/1080p_awb_test.mkv/file

[Bernardd]

Hi TDS,
The two samples have not the same source.

What is your problem, color balance on whole video or only on "blinking & flashing" frames ?

I understand this samples are the plugin treated output, can you send piece of input video ?

[guest]

Hi TDS,
The two samples have not the same source.

What is your problem, color balance on whole video or only on "blinking & flashing" frames ?

I understand this samples are the plugin treated output, can you send piece of input video ?

Correct they aren't, and the awd test file was restricted by Mediafire for copyright breach, so I deleted that :(

Yes, I'm concerned about the blinking & flashing, I'm sure with adjustments to the script, the color balance can be altered (if I knew how to do that, that is)

OK, I will find some untreated video, but I have to ask, haven't you got some video to test with ??

Thanks

[kedautinh12]

You can use ggdrive replace :D

[Bernardd]

My script is not temporal, it works on one frame at each time. Thus the untreated blinking & flashing" frames are specific. I want to see why they are different of the other. Whitout source, i have no idea. Whith my samples, i have not found this problem.

[guest]

My script is not temporal, it works on one frame at each time. Thus the untreated blinking & flashing" frames are specific. I want to see why they are different of the other. Whitout source, i have no idea. Whith my samples, i have not found this problem.

OK, I have found some untreated footage, same as other sample, but this time I've compressed it with 7z to "trick" Mediafire.

Maybe you can use this to figure out what is happening :)

https://www.mediafire.com/file/1lj7mamwfv4wm4s/untreated+video.7z/file

[Bernardd]

Sorry, I can'nt reproduce your dysfunction with your sample. I can'nt help you.

[guest]

Sorry, I can't reproduce your dysfunction with your sample. I can't help you.

OK, well that's unfortunate, I wonder what is causing it then, I will have to do some more testing, this end, and let you know.

Would it be some script / call error or missing command ??

Thanks

[kedautinh12]

I think you need say more detail and focus to your error. Don't say waste info without relate thread to developer

[guest]

I think you need say more detail and focus to your error. Don't say waste info without relate thread to developer

I really don't know what more I can say or provide for evidence that this has these problems (for me), and if Bernardd can't reproduce your dysfunction, then that's it.

No one has suggested any changes to my script / call....I have no idea what to change !!

[guest]

Sorry, I can'nt reproduce your dysfunction with your sample. I can'nt help you.

Could you please let me know what app you use to test or run these scripts ??

If you can't reproduce the problem, maybe I need to use what you use.

I use RipBot264, and the "preview" function is either AVSMeter, or MPC-HC.

[StainlessS]

Try AvsPMod or (my favourite) VirtualDub2 [has AVS Script Editor in tools menu].

[guest]

Try AvsPMod or (my favourite) VirtualDub2 [has AVS Script Editor in tools menu].

Thanks StainlessS, I don't have much luck with VD2, but I'll give it a try.

Probably because I don't use much at all....

Are there any other AWB scripts out there ???

Congrats on over 10,000 posts :)

[Bernardd]

Hello,

I use AvsPmod to write script. To encode, i use VD2 or FFMPEG with AvsPmod, Tools, Script Encoder (CLI).
I have down loaded RipBot, i have not use his preview, but i have encoded with succes your piece of video.

I use FFmpegSource to read the untreated source.

[guest]

Hello,

I use AvsPmod to write script. To encode, i use VD2 or FFMPEG with AvsPmod, Tools, Script Encoder (CLI).
I have down loaded RipBot, i have not use his preview, but i have encoded with succes your piece of video.

I use FFmpegSource to read the untreated source.

Hi Bernardd,

I'm curious that you have successfully encoded my source with RipBot!!

Would you be able to provide the script you used ?? 'cause if you can do it, why can't I !!!

I know I run a very modified version of RipBot, but if you used the "vanilla" version off that forum, maybe that's the difference.

Please let me know :)

Regards

[Bernardd]

Hi TDS
I have downloaded RipBot and run it with this script.

LoadPlugin("C:\...\GRunT-v1.02\x64\grunt.dll")
LoadPlugin("C:\...\RgbAdapt_25&26_x86_x64_dll_v0.05_20190303\Avisynth+_x64\RgbAdapt_x64.dll")
LoadPlugin("C:\...\RT_Stats_25&26_x86_x64_dll_v2.00Beta13_20201229\Avisynth26_x64\RT_Stats_x64.dll")

Import("C:\...\RGBAdapt_Awb_Process v 2021 sept 32 64 bits function.avs")

LoadPlugin("C:\...\ffms2-2.40-msvc\x64\ffms2.dll")
ffms2("C:\...\untreated video\untreated video.mkv")
AWB_Func()


Nothing else.

The same script run well with VD2.

[guest]

Hi TDS
I have downloaded RipBot and run it with this script.

LoadPlugin("C:\...\GRunT-v1.02\x64\grunt.dll")
LoadPlugin("C:\...\RgbAdapt_25&26_x86_x64_dll_v0.05_20190303\Avisynth+_x64\RgbAdapt_x64.dll")
LoadPlugin("C:\...\RT_Stats_25&26_x86_x64_dll_v2.00Beta13_20201229\Avisynth26_x64\RT_Stats_x64.dll")

Import("C:\...\RGBAdapt_Awb_Process v 2021 sept 32 64 bits function.avs")

LoadPlugin("C:\...\ffms2-2.40-msvc\x64\ffms2.dll")
ffms2("C:\...\untreated video\untreated video.mkv")
AWB_Func()

Nothing else.

The same script run well with VD2.

Hello again,

Well, all I can say is there is something REALLY strange going on here !!

With my mediocre knowledge of RipBot, there is no way that that script will work (at least where I know where the scripts are located).

But I think I know enough about how scripts have to be written to work in RipBot.

One thing I did notice that was different / extra, was ffm2.dll, but including that didn't change anything.

With a few mods, the script runs fine with AVSMeter, but the MPC-HC preview is no good, it's trying to balance the white, but the whole video is just junk !!!

Such a shame :(

[poisondeathray]

Works ok for me in MPCHC, avspmod

@TDS - Check your avisynth version, plugin versions, the usual suspects. Use avsinfotool to help debug

[Reel.Deel]

Works ok for me in MPCHC, avspmod

Same here and VDub2.

LoadPlugin("RgbAdapt_x64.dll", "grunt.dll") # other plugins were already in the autoload folder
Import("RGBAdapt_Awb_Process v 2021 sept 32 64 bits function.avs")

FFVideoSource("untreated video.mkv")
Crop(0,140,0,-140)
AWB_Func()


Produces correct results.

[guest]

Works ok for me in MPCHC, avspmod

@TDS - Check your avisynth version, plugin versions, the usual suspects. Use avsinfotool to help debug

I'm running 3.7.2 test 12, and the latest required plugin's !!

Clearly RipBot processes things differently to AVSpmod (which I don't use).

But let's get something clear here...you must have download the "untreated video.mkv"....there is NOTHING wrong with that !!!

It was for Bernardd to test his AWB script with, as I have blinking & flashing issues...

[guest]

Same here and VDub2.

LoadPlugin("RgbAdapt_x64.dll", "grunt.dll") # other plugins were already in the autoload folder
Import("RGBAdapt_Awb_Process v 2021 sept 32 64 bits function.avs")

FFVideoSource("untreated video.mkv")
Crop(0,140,0,-140)
AWB_Func()


Produces correct results.

Fair enough, but read my reply to "pdr".

And that script will not work in RipBot, I'm 99.99% sure of it !!!

[Reel.Deel]

But let's get something clear here...you must have download the "untreated video.mkv"....there is NOTHING wrong with that !!!

It was for Bernardd to test his AWB script with, as I have blinking & flashing issues...

So what are you saying here? That you have no issues with "untreated video.mkv" and AWB_Func() ?

Fair enough, but read my reply to "pdr".

And that script will not work in RipBot, I'm 99.99% sure of it !!!

It's just an AviSynth script. I have no experience with RipBot but it seems odd that it supports AviSynth and you can't use an avs script. And much more odd that it would process things differently than avs since ripbot is just a frontend for avs (and other tools)...

[poisondeathray]

I used same script as Bernardd, but with lsmash (it doesn't matter, I tried ffms2 too). The AWB is applied correctly to "untreated video.mkv" as expected, but there is no "flashing" as seen in "VID_20220304_130802.mkv" .

MPCHC , avspmod, I tested ripbot and it's ok too. This problem has nothing to do with ripbot. Avisynth is just a frameserver

[Reel.Deel]

I just downloaded RipBot, loaded the same script that I posted above and it works like it is supposed to. I even encoded the video and there are no problems.

Now deleting RipBot lol