Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > Capturing and Editing Video > VapourSynth

Reply
 
Thread Tools Search this Thread Display Modes
Old 1st September 2018, 08:44   #1  |  Link
ChaosKing
Registered User
 
Join Date: Dec 2005
Location: Germany
Posts: 770
VSDB - A VapourSynth Database

*BETA- work in progress*


I'm creating a database for vapoursynth to make our lives easier. The main issue with VS is that there is no complete list of what's ported and what's not.
I know there's http://www.vapoursynth.com/doc/pluginlist.html but it's not good enough.

Did You know that there are at least 9 dehalo functions ported to VS?
Well with VSDB you can now find out easily

It also acts as a web gui for VSRepo (ideally all plugins will be available via vsrepo someday)


The main "problems" what I have now is this:
- categorize all plugins (need help!). I used the categories from vsrepo and http://www.vapoursynth.com/doc/pluginlist.html for now, but it's a bit limited (or most would go into "others"). I added a Collection category for scripts like havsfunc or muvsfunc. A less extreme version of http://avisynth.nl/index.php/External_filters would be nice, suggestions?

Current categories:
  • Anti-aliasing
  • Collection
  • Color/Levels manipulation
  • Dehaloing
  • Deinterlacing
  • Denoising
  • Dot Crawl and Rainbows
  • Inverse Telecine
  • Line Darkening
  • Other
  • Resizing and Format Conversion
  • Scripts
  • Sharpening
  • Source/Output
  • Subtitles
  • unknown

- All functions inside a "Collection" are shown as a separate item in the table. They are just copies of a "Collection entry" with name, description and category replaced (for now). I don't know how to represent them better. Should I remove the other columns for them (Version, Links) since they are redundant now?


What features would you like? What data or relations are important? Maybe I'm missing something.

Update

New url is: http://vsdb.top (.top domain was cheap lol)
If you want to add or edit a plugin go to http://vsdb.top/dashboard
login/pw vsdbhelper@vsdb.top and vsdbhelper as the pw

Github: https://github.com/theChaosCoder/vsdb
Json export https://github.com/theChaosCoder/vsdb-json

Todo:
- Add some statistics
- auto fetch new vsrepo updates
- some styles are still old
- export to json files on github (as a backup and to keep track of what changed)
__________________
Search and denoise

Last edited by ChaosKing; 27th September 2018 at 17:53.
ChaosKing is offline   Reply With Quote
Old 1st September 2018, 16:01   #2  |  Link
fAy01
Registered User
 
Join Date: Jun 2010
Posts: 65
That's nice. Thank you. Could you possibly add release date for each plugin/script/etc as well?
fAy01 is offline   Reply With Quote
Old 1st September 2018, 17:00   #3  |  Link
Myrsloik
Professional Code Monkey
 
Myrsloik's Avatar
 
Join Date: Jun 2003
Location: Ikea Chair
Posts: 1,897
Quote:
Originally Posted by fAy01 View Post
That's nice. Thank you. Could you possibly add release date for each plugin/script/etc as well?
That's not stored in the VSRepo package files yet. I'm going to add it the in next few days.
__________________
VapourSynth - proving that scripting languages and video processing isn't dead yet
Myrsloik is online now   Reply With Quote
Old 1st September 2018, 19:00   #4  |  Link
fAy01
Registered User
 
Join Date: Jun 2010
Posts: 65
Quote:
Originally Posted by Myrsloik View Post
That's not stored in the VSRepo package files yet. I'm going to add it the in next few days.
fAy01 is offline   Reply With Quote
Old 1st September 2018, 23:20   #5  |  Link
ChaosKing
Registered User
 
Join Date: Dec 2005
Location: Germany
Posts: 770
Alpha2
Check out the dropdown infos.
__________________
Search and denoise
ChaosKing is offline   Reply With Quote
Old 2nd September 2018, 00:28   #6  |  Link
lansing
Registered User
 
Join Date: Sep 2006
Posts: 1,110
Are the plugin listing read from a database or files or just hardcoded?

I don't like the auto stretching table width when maximize, makes it hard to read with a big block of empty space in between.

Also in the pagination, it doesn't go back to the top when I click on next page.
lansing is offline   Reply With Quote
Old 2nd September 2018, 01:01   #7  |  Link
ChaosKing
Registered User
 
Join Date: Dec 2005
Location: Germany
Posts: 770
I have a mysql db, but in this case it's harcoded (generated by my script). I'm using https://datatables.net
__________________
Search and denoise
ChaosKing is offline   Reply With Quote
Old 2nd September 2018, 17:52   #8  |  Link
poisondeathray
Registered User
 
Join Date: Sep 2007
Posts: 3,793
Maybe add another category dealing with color/levels manipulation - so things like tweak(adjust.py) , gradcurve, smoothlevels, maybe even timecube, etc... (I'm sure there are many more) could probably be organized under that category.
poisondeathray is offline   Reply With Quote
Old 2nd September 2018, 18:52   #9  |  Link
Myrsloik
Professional Code Monkey
 
Myrsloik's Avatar
 
Join Date: Jun 2003
Location: Ikea Chair
Posts: 1,897
Quote:
Originally Posted by poisondeathray View Post
Maybe add another category dealing with color/levels manipulation - so things like tweak(adjust.py) , gradcurve, smoothlevels, maybe even timecube, etc... (I'm sure there are many more) could probably be organized under that category.
I'll add that category to VSRepo too. Makes sense.
__________________
VapourSynth - proving that scripting languages and video processing isn't dead yet
Myrsloik is online now   Reply With Quote
Old 2nd September 2018, 22:52   #10  |  Link
fAy01
Registered User
 
Join Date: Jun 2010
Posts: 65
Would you consider listing color formats supported by the plugins/scripts/etc in your database? Similar to avs: http://avisynth.nl/index.php/External_filters
It is very helpful for working with different color formats.
fAy01 is offline   Reply With Quote
Old 3rd September 2018, 01:02   #11  |  Link
ChaosKing
Registered User
 
Join Date: Dec 2005
Location: Germany
Posts: 770
Is this relevant in VS? Different formats usually *just* works in VS (ok, plugins often without rgb support).
I would include such information if someone will provide it or knows an easy way to get it programmatically.

I think bitsPerSample(8bit, 16, 32) is a more interessting value then colorFamily. (at least for me)
__________________
Search and denoise
ChaosKing is offline   Reply With Quote
Old 3rd September 2018, 22:36   #12  |  Link
ChaosKing
Registered User
 
Join Date: Dec 2005
Location: Germany
Posts: 770
I added a bit depth column with values like: 8 int, 8-16 int / 32 float

And I got an idea. I should be able to get all supported bit depth and color space values by just a simple try and catch block. Will try it tomorrow.

For example LSFmod (with float support) from hnwvsfunc throws an exception with 16 bit float bcs it is using std.Minimum and it only supports clips with 8..16 bits integer per sample or float.

//Edit
@Myrsloik I think the docs are not up to date or am I reading this wrong?
http://www.vapoursynth.com/doc/funct...ml#std.Minimum
Quote:
Clip to process. It must have integer sample type, and bit depth between 8 and 16. If there are any frames with float samples or bit depth greater than 16, an error will be returned.
But this works...
clip = mvf.Depth(clip, 32, sample=1)
clip = hnwvsfunc.LSFmod(clip)
__________________
Search and denoise

Last edited by ChaosKing; 3rd September 2018 at 22:51.
ChaosKing is offline   Reply With Quote
Old 4th September 2018, 03:47   #13  |  Link
Wolfberry
Helenium(Easter)
 
Wolfberry's Avatar
 
Join Date: Aug 2017
Location: Hsinchu, Taiwan
Posts: 99
Quote:
Originally Posted by ChaosKing View Post
//Edit
@Myrsloik I think the docs are not up to date or am I reading this wrong?
http://www.vapoursynth.com/doc/funct...ml#std.Minimum
@ChaosKing I am aware of the documentation is outdated, so I made a pull request 2 weeks ago and it's merged.

The doc on vapoursynth.com is created using Sphinx, and it should be updated once R45 is out.

And very few filter support half precision, so when talking about float support I mean single precision (32-bit float)
__________________
Monochrome Anomaly

Last edited by Wolfberry; 4th September 2018 at 03:57.
Wolfberry is offline   Reply With Quote
Old 4th September 2018, 12:39   #14  |  Link
ChaosKing
Registered User
 
Join Date: Dec 2005
Location: Germany
Posts: 770
ahh ok thx for the info

My automation attempt kinda works for simple plugins, others have different parameter dependencies and my automation fails. I guess it's better to do this by hand even it this take some time (helpers are very welcome!)
I also added a colorspace column now.
//Edit
How should the color space formats be represented. YV12 vs YUV420 ? or just YUV, GRAY, RGB

The next step would be a web backed so people can edit the stuff.
__________________
Search and denoise

Last edited by ChaosKing; 4th September 2018 at 13:12.
ChaosKing is offline   Reply With Quote
Old 4th September 2018, 15:49   #15  |  Link
fAy01
Registered User
 
Join Date: Jun 2010
Posts: 65
Quote:
Originally Posted by ChaosKing View Post
ahh ok thx for the info

My automation attempt kinda works for simple plugins, others have different parameter dependencies and my automation fails. I guess it's better to do this by hand even it this take some time (helpers are very welcome!)
I also added a colorspace column now.
//Edit
How should the color space formats be represented. YV12 vs YUV420 ? or just YUV, GRAY, RGB

The next step would be a web backed so people can edit the stuff.
YUV420 <-- this.
fAy01 is offline   Reply With Quote
Old 4th September 2018, 18:07   #16  |  Link
ChaosKing
Registered User
 
Join Date: Dec 2005
Location: Germany
Posts: 770
So basically we take this list then http://www.vapoursynth.com/doc/pytho...rmat-constants
What about YCbCr and YCgCo, is there also a YCgCo420, YCgCo422, YCgCo444 etc representation?
__________________
Search and denoise
ChaosKing is offline   Reply With Quote
Old 4th September 2018, 19:19   #17  |  Link
ChaosKing
Registered User
 
Join Date: Dec 2005
Location: Germany
Posts: 770
So currently this is how it would look like:
Code:
nnedi3
   color space:  GRAY, YUV4XX, RGB
   bit depth: 8-16 int
SangNom
   color space:  GRAY, YUV4XX, RGB
   bit depth: 8-16 int / 32 float
or is this better
Code:
nnedi3
   supported formats:  GRAY8, GRAY10, GRAY12, GRAY16, YUV420P8, YUV422P8, YUV444P8, ... YUV444P16, RGB24, ... RGB48
SangNom
   supported formats:  GRAY8, GRAY10, GRAY12, GRAY16, YUV420P8, YUV422P8, ... YUV444P8, ... YUV444P16, YUV444PS32, RGB24, ... RGB48, RGBS
or
Code:
nnedi3
   supported formats:  GRAY8-16, YUV4XXP8-16, RGB24-48
SangNom
   supported formats:  GRAY8-16, GRAYS, YUV4XXP8-16, YUV4XXPS32, RGB24-48, RGBS
__________________
Search and denoise

Last edited by ChaosKing; 4th September 2018 at 19:39.
ChaosKing is offline   Reply With Quote
Old 5th September 2018, 18:39   #18  |  Link
fAy01
Registered User
 
Join Date: Jun 2010
Posts: 65
Quote:
Originally Posted by ChaosKing View Post
Code:
nnedi3
   supported formats:  GRAY8, GRAY10, GRAY12, GRAY16, YUV420P8, YUV422P8, YUV444P8, ... YUV444P16, RGB24, ... RGB48
SangNom
   supported formats:  GRAY8, GRAY10, GRAY12, GRAY16, YUV420P8, YUV422P8, ... YUV444P8, ... YUV444P16, YUV444PS32, RGB24, ... RGB48, RGBS
This one.

What about YCbCr and YCgCo, is there also a YCgCo420, YCgCo422, YCgCo444 etc representation? <-- unsure.
fAy01 is offline   Reply With Quote
Old 5th September 2018, 18:48   #19  |  Link
ChaosKing
Registered User
 
Join Date: Dec 2005
Location: Germany
Posts: 770
Really? Wasn't expecting that since the lists will be very long like this.

I wanted to list ALL formats but were too lazy hence the ... But maybe GRAY8-GRAY16 will be better?
__________________
Search and denoise

Last edited by ChaosKing; 5th September 2018 at 18:57.
ChaosKing is offline   Reply With Quote
Old 5th September 2018, 18:54   #20  |  Link
Myrsloik
Professional Code Monkey
 
Myrsloik's Avatar
 
Join Date: Jun 2003
Location: Ikea Chair
Posts: 1,897
Quote:
Originally Posted by fAy01 View Post
This one.

What about YCbCr and YCgCo, is there also a YCgCo420, YCgCo422, YCgCo444 etc representation? <-- unsure.
That's insane. Many filters have support for 4*10*5*5 = 1000 formats.

The maximum number is 4*25*5*5 = 2500. Blankclip, crop and addborders support that. Even if you ignore subsampling you still end up with 40+ regularly.
__________________
VapourSynth - proving that scripting languages and video processing isn't dead yet
Myrsloik is online now   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 21:00.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2019, vBulletin Solutions Inc.