Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > Video Encoding > MPEG-4 Encoder GUIs

Reply
 
Thread Tools Search this Thread Display Modes
Old 11th January 2020, 19:39   #3581  |  Link
Havokdan
Registered User
 
Havokdan's Avatar
 
Join Date: Apr 2009
Location: Gurupi, Tocantins, Brasil
Posts: 201
Quote:
Originally Posted by Selur View Post
Hmm, looking at what tags Hybrid supports (for the main containers):
  • Container tags:
    • Name
    • Genre
    • Comments
    • Copyright
    • Cover
  • Stream tags:
    • Title
    • Language
and the tags Kodi allows (https://kodi.wiki/view/NFO_files/Movies#nfo_Tags)
I don't see anything for Copyright in the movie info and the Cover info would probably best match to the 'thumb' info, but to be useful Hybrid would need to download stuff (not likely to happen).

I see the following mapping:
Container->Name <=> movie->title
Container->Genre <=> movie->genre
Container->Comments <=> movie->plot
and
for audio streams:
Stream->Title <=> movie->fileinfo->streamdetails->audio->language
There is no language for video streams.

Since normally at least the audio language tags are usually properly flagged in the files itself, the only real gain from this would be to import the container tags.
(Importing the audio language could also be done, but probably not worth the trouble.)

-> don't really think that it importing the container tags is worth the effort, but if you find a few other users which think this is a nice feature I can probably write some code for it.

Cu Selur

Ps.: for mkv output adding a 'import for nfo' under 'Config->Output->MKV Tags' might be more useful, since there would be a bigger overlap of the kodi-NFO data and the mkv tags.
Ok, thanks
Havokdan is offline   Reply With Quote
Old 12th January 2020, 10:41   #3582  |  Link
Selur
Registered User
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 5,940
Hybrid rev 2020.01.12.1:
*fixed*
  • decode: crash when ffmpeg was not compiled with 'zscale'
-> downloads: http://www.selur.de/downloads

Cu Selur
__________________
Hybrid here in the forum, homepage
Notice: Since email notifications do not work here any more, it might take me quite some time to notice a reply to a thread,..
Selur is offline   Reply With Quote
Old 7th February 2020, 08:03   #3583  |  Link
Gravitator
Registered User
 
Join Date: May 2014
Posts: 178
Хай!
Hybrid v2020.01.12.1

I use a two-second sample ProRes for encoding.
The culprit of the memory consumption of Deinterlacer: QTGMC (ffmpeg not eating).
Attached Images
 
__________________
Win10x64, Xeon E5450, GTX 750 2GB, DDR3 8GB.
Gravitator is offline   Reply With Quote
Old 7th February 2020, 15:58   #3584  |  Link
Selur
Registered User
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 5,940
No surprise, QTGMC will use quite a bit of memory and cpu power depending on the resolution and settings,...
Not sure why you mention ffmpeg, you are using VSPipe and x265, ffmpeg isn't used.

Cu Selur
__________________
Hybrid here in the forum, homepage
Notice: Since email notifications do not work here any more, it might take me quite some time to notice a reply to a thread,..
Selur is offline   Reply With Quote
Old 8th February 2020, 01:53   #3585  |  Link
Gravitator
Registered User
 
Join Date: May 2014
Posts: 178
Quote:
Originally Posted by Selur View Post
No surprise, QTGMC will use quite a bit of memory and cpu power depending on the resolution and settings,...
Deinterlacer: QTGMC - eats 4GB at any encoding settings (Overcoming the memory limit leads to the reset of information on the virtual memory HDD - fatal system throttling / only reboot).
Quote:
Originally Posted by Selur View Post
Not sure why you mention ffmpeg, you are using VSPipe and x265, ffmpeg isn't used.
Deinterlacer: FFMpeg - eats 80MB.
This only happens when using ProRes (Drop sample?).
__________________
Win10x64, Xeon E5450, GTX 750 2GB, DDR3 8GB.
Gravitator is offline   Reply With Quote
Old 8th February 2020, 02:06   #3586  |  Link
Gravitator
Registered User
 
Join Date: May 2014
Posts: 178
Checking the new release leads to the collapse of Hybrid.
__________________
Win10x64, Xeon E5450, GTX 750 2GB, DDR3 8GB.
Gravitator is offline   Reply With Quote
Old 8th February 2020, 03:39   #3587  |  Link
Gravitator
Registered User
 
Join Date: May 2014
Posts: 178
AOM
10bit mod & Profile: Main, High, Professional - оn any settings, disabling the "64-pt transform" leads to an instant encoding finish (Empty *.mkv or nothing at the output);
8bit mod & Profile: Main - ok, High - no, Professional - no.
__________________
Win10x64, Xeon E5450, GTX 750 2GB, DDR3 8GB.
Gravitator is offline   Reply With Quote
Old 9th February 2020, 02:38   #3588  |  Link
Gravitator
Registered User
 
Join Date: May 2014
Posts: 178
RAV1E
Add new features: --threads, --first/second-pass (Instead of --pass 1/2), --rdo-lookahead-frames.
__________________
Win10x64, Xeon E5450, GTX 750 2GB, DDR3 8GB.
Gravitator is offline   Reply With Quote
Old 9th February 2020, 07:14   #3589  |  Link
Selur
Registered User
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 5,940
Quote:
Deinterlacer: QTGMC - eats 4GB at any encoding settings
You can:
a. limit the thread count
b. limit the cache size
in Hybrid which will allow you to reduce the memory footprint.

Quote:
Deinterlacer: FFMpeg - eats 80MB.
So ? Using a simple Yadif (or most others simpler deinterlacing methods) instead of QTGMC will use less memory.

Quote:
Checking the new release leads to the collapse of Hybrid.
fixed locally.

Quote:
AOM
10bit mod & Profile: Main, High, Professional - оn any settings, disabling the "64-pt transform" leads to an instant encoding finish (Empty *.mkv or nothing at the output);
8bit mod & Profile: Main - ok, High - no, Professional - no.
may be the command line options changed

Quote:
RAV1E
Add new features: --threads, --first/second-pass (Instead of --pass 1/2), --rdo-lookahead-frames.
will think about it
__________________
Hybrid here in the forum, homepage
Notice: Since email notifications do not work here any more, it might take me quite some time to notice a reply to a thread,..
Selur is offline   Reply With Quote
Old 9th February 2020, 08:06   #3590  |  Link
Gravitator
Registered User
 
Join Date: May 2014
Posts: 178
It’s not normal that for 2 second (60 frames) 1080p Prores video, it consumes 4GB or more (There is no control of memory consumption).
-----
This only happens with ProRes in the *.mkv container! Then comes the call to VSPipe (*.mov moderate memory consumption and without VSPipe).
__________________
Win10x64, Xeon E5450, GTX 750 2GB, DDR3 8GB.
Gravitator is offline   Reply With Quote
Old 9th February 2020, 08:45   #3591  |  Link
Selur
Registered User
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 5,940
Quote:
It’s not normal that for 2 second (60 frames) 1080p Prores video, it consumes 4GB or more (There is no control of memory consumption).
You are right QTGMC should not be used at all for 1080p content unless you explicitly tell Hybrid to do so.

Using:
Code:
# Imports
import os
import sys
import ctypes
# Loading Support Files
Dllref = ctypes.windll.LoadLibrary("I:/Hybrid/64bit/vsfilters/Support/libfftw3f-3.dll")
import vapoursynth as vs
core = vs.get_core()
# Import scripts folder
scriptPath = 'I:/Hybrid/64bit/vsscripts'
sys.path.append(os.path.abspath(scriptPath))
# Loading Plugins
core.std.LoadPlugin(path="I:/Hybrid/64bit/vsfilters/GrainFilter/AddGrain/AddGrain.dll")
core.std.LoadPlugin(path="I:/Hybrid/64bit/vsfilters/DenoiseFilter/FFT3DFilter/fft3dfilter.dll")
core.std.LoadPlugin(path="I:/Hybrid/64bit/vsfilters/DenoiseFilter/DFTTest/DFTTest.dll")
core.std.LoadPlugin(path="I:/Hybrid/64bit/vsfilters/Support/EEDI3.dll")
core.std.LoadPlugin(path="I:/Hybrid/64bit/vsfilters/ResizeFilter/nnedi3/vsznedi3.dll")
core.std.LoadPlugin(path="I:/Hybrid/64bit/vsfilters/Support/libmvtools.dll")
core.std.LoadPlugin(path="I:/Hybrid/64bit/vsfilters/Support/temporalsoften.dll")
core.std.LoadPlugin(path="I:/Hybrid/64bit/vsfilters/Support/scenechange.dll")
core.std.LoadPlugin(path="I:/Hybrid/64bit/vsfilters/Support/fmtconv.dll")
core.std.LoadPlugin(path="I:/Hybrid/64bit/vsfilters/SourceFilter/LSmashSource/vslsmashsource.dll")
# Import scripts
import havsfunc
# Loading F:\TestClips&Co\files\interlaceAndTelecineSamples\interlaced\avc - interlaced.m2ts using LWLibavSource
clip = core.lsmas.LWLibavSource(source="F:/TESTCL~1/files/INTERL~1/INTERL~1/AVC-IN~1.M2T", format="YUV420P8", cache=0, prefer_hw=0)
# making sure input color matrix is set as 709
clip = core.resize.Point(clip, matrix_in_s="709",range_s="limited")
# making sure frame rate is set to 29.970
clip = core.std.AssumeFPS(clip, fpsnum=30000, fpsden=1001)
# Setting color range to TV (limited) range.
clip = core.std.SetFrameProp(clip=clip, prop="_ColorRange", intval=1)
# setting field order to what QTGMC should assume
clip = core.std.SetFrameProp(clip=clip, prop="_FieldBased", intval=2)
# Deinterlacing using QTGMC
clip = havsfunc.QTGMC(Input=clip, Preset="Fast", TFF=True)
# make sure content is preceived as frame based
clip = core.std.SetFieldBased(clip, 0)
clip = clip[::2]
# Output
clip.set_output()
Vapoursynth uses ~4.2GB, using preset 'placebo' it uses an additional ~300MB here.
Settin "Filtering->Vapoursynth->Misc->Limit Cache MB" to '1024', less than 1500MB get used.

Quote:
Checking the new release leads to the collapse of Hybrid.
the option is removed now; too much trouble fixing it properly

Cu Selur
__________________
Hybrid here in the forum, homepage
Notice: Since email notifications do not work here any more, it might take me quite some time to notice a reply to a thread,..
Selur is offline   Reply With Quote
Old 9th February 2020, 10:06   #3592  |  Link
Selur
Registered User
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 5,940
Quote:
AOM
10bit mod & Profile: Main, High, Professional - оn any settings, disabling the "64-pt transform" leads to an instant encoding finish (Empty *.mkv or nothing at the output);
8bit mod & Profile: Main - ok, High - no, Professional - no.
calling it in a command line I got a few messages:
TX64 can only be disabled on I420 images.
8bit + profile 1: Profile 1 requires 4:4:4 color format
8bit + profile 2: Profile 2 bit-depth < 10 requires 4:2:2 color format

The main surprise here is the color space restriction since this is more restrictive than https://en.wikipedia.org/wiki/AV1#Profiles which doesn't allow High profile with 4:2:0,...
-> created an issue entry over at: https://github.com/mozilla/aom/issues/10
__________________
Hybrid here in the forum, homepage
Notice: Since email notifications do not work here any more, it might take me quite some time to notice a reply to a thread,..

Last edited by Selur; 9th February 2020 at 10:36.
Selur is offline   Reply With Quote
Old 16th February 2020, 11:54   #3593  |  Link
Selur
Registered User
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 5,940
Hybrid rev 2020.02.16.1:
*fixed*
  • Video: QSVEnc encoding mode mapping.
  • Vapoursynth: custom script mismapping
  • Vapoursynth: SelectRangeEvery and Tweak
  • Vapoursynth: Fixed HDR to SDR DG call
  • Vapoursynth: HDRToSDR
  • Vapoursynth: LWLivavSource use track instead of streamindex
  • Avisynth: removed 8bit enforcement for Tweak and Levels
  • Video: aomenc - tx64 handling
  • Profile: error message regarding 'input' when loading a GlobalDataModel
  • Muxing: mp4 video&audio tagging
  • Video: NVEnc, arib-std-b67 vs. arib-srd-b67
  • Muxing: h264 avi muxing
  • Analysis: mediainfo video bitrate indication
  • Avisynth: handling high bitdepth content
  • Decoder: FFmpeg decoder call
*changed*
  • Avisynth: force LibavSource for AV1 content
  • Avisynth: make sure BalanceBorders isn't used when Top/Bottom/Left/Right isn't mod 2
*added*
  • Vapoursynth: option to save/load custom script content
  • Video: rav1e added "--threads X", "--switch-frame-interval X", "--reservoir-frame-delay X" and "--rdo-lookahead-frames X"
  • Video: NVEncC added support for '--psnr', '--ssim'
*removed*
  • check for update
  • Synth: removed FFms2k (it's changes were incorporated in ffms2)

-> downloads: http://www.selur.de/downloads

Cu Selur
__________________
Hybrid here in the forum, homepage
Notice: Since email notifications do not work here any more, it might take me quite some time to notice a reply to a thread,..
Selur is offline   Reply With Quote
Old 16th February 2020, 14:41   #3594  |  Link
Gravitator
Registered User
 
Join Date: May 2014
Posts: 178
Hybrid v2020.02.16.1

RAV1E
Unable to make the first pass, as in the TEMP folder is not created file *.ivf
Attachments Pending Approval
File Type: txt HybridDebugOutput.txt
__________________
Win10x64, Xeon E5450, GTX 750 2GB, DDR3 8GB.

Last edited by Gravitator; 16th February 2020 at 14:52.
Gravitator is offline   Reply With Quote
Old 16th February 2020, 15:19   #3595  |  Link
Selur
Registered User
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 5,940
I see the problem, will fix it when I find the time.
-> fixed locally, will be fine during next release
__________________
Hybrid here in the forum, homepage
Notice: Since email notifications do not work here any more, it might take me quite some time to notice a reply to a thread,..

Last edited by Selur; 16th February 2020 at 16:05.
Selur is offline   Reply With Quote
Old 17th February 2020, 12:31   #3596  |  Link
Gravitator
Registered User
 
Join Date: May 2014
Posts: 178
1st and 2nd pass works, but there is a problem with complex coding 2pass (The output is an empty container).
Attachments Pending Approval
File Type: txt HybridDebugOutput.txt
__________________
Win10x64, Xeon E5450, GTX 750 2GB, DDR3 8GB.
Gravitator is offline   Reply With Quote
Old 17th February 2020, 19:01   #3597  |  Link
Selur
Registered User
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 5,940
no clue what's causing this,... also I can't access the files attached there unless a moderator approves them.
-> got it
__________________
Hybrid here in the forum, homepage
Notice: Since email notifications do not work here any more, it might take me quite some time to notice a reply to a thread,..

Last edited by Selur; 17th February 2020 at 19:06.
Selur is offline   Reply With Quote
Old 17th February 2020, 20:01   #3598  |  Link
Selur
Registered User
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 5,940
Hybrid rev 2020.02.17.1:
*fixed*
  • video: rav1e 2pass calls
*changed*
  • video: x265, adjusted to 3.3 branch

-> downloads: http://www.selur.de/downloads

Cu Selur
__________________
Hybrid here in the forum, homepage
Notice: Since email notifications do not work here any more, it might take me quite some time to notice a reply to a thread,..
Selur is offline   Reply With Quote
Old Yesterday, 20:34   #3599  |  Link
Selur
Registered User
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 5,940
Hybrid rev 2020.02.19.1:
*fixed*
  • Video: x265, messed up during 3.3. branch adjustment
*changed*
  • Internals: removed some abandoned code which causes unneeded slow downs after files with lot of meta data were analysed

-> downloads: http://www.selur.de/downloads

Cu Selur
__________________
Hybrid here in the forum, homepage
Notice: Since email notifications do not work here any more, it might take me quite some time to notice a reply to a thread,..
Selur is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 04:26.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2020, vBulletin Solutions Inc.