Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > Capturing and Editing Video > Avisynth Development

Reply
 
Thread Tools Search this Thread Display Modes
Old 22nd October 2019, 19:20   #1041  |  Link
kedautinh12
Registered User
 
Join Date: Jan 2018
Posts: 41
Quote:
Originally Posted by HolyWu View Post
https://github.com/HolyWu/L-SMASH-Works/releases/latest

Uploaded new binary which ditches libaom and is built by clang-cl. The binary size is smaller than the previous ICL build and decoding speed seems to be marginally faster.




No problem. Here.
Your Latest still error with .vp9, add this video and check
https://drive.google.com/file/d/1FAl...w?usp=drivesdk
kedautinh12 is offline   Reply With Quote
Old 22nd October 2019, 19:29   #1042  |  Link
stax76
Registered User
 
stax76's Avatar
 
Join Date: Jun 2002
Location: Chamber 36
Posts: 5,873
Quote:
Originally Posted by Atak_Snajpera View Post
Question: Would be possible to use multiple threads to speed up indexing process? For example by using some kind of chunk indexing?
I'm asking because NVMe SSDs with read speed of 3GiB/s+ are getting much more affordable. I have Xeon E5-2690@3.2GHz (8C/16T) and I see that i'm experiencing a bottleneck due to single threaded code.
In this example I'm indexing 4k movie (~50Mbps) from RAM disk...

1,24GiB/s is a max I can get on single core. ffmsindex is even more cpu intensive (only ~0,5GiB/s).

Currently indexing of ~60 GiB 4k movie takes ~1 minute. With proper multi-threading we could easily reduce indexing time to ~15s!
Maybe you are asking the wrong question, how about MakeMKV creating an index? Answer: It's just code, anything is possible.
stax76 is offline   Reply With Quote
Old 23rd October 2019, 03:11   #1043  |  Link
kedautinh12
Registered User
 
Join Date: Jan 2018
Posts: 41
Quote:
Originally Posted by MeteorRain View Post
https://down.7086.in/AviSynthPlus%20...-r935%2B34.zip

Stop indexing progress spamming

-- Now only refresh at every 1%.
Still error with vp9, only old ver r929 of VFR-maniac still fine
kedautinh12 is offline   Reply With Quote
Old 23rd October 2019, 03:35   #1044  |  Link
poisondeathray
Registered User
 
Join Date: Sep 2007
Posts: 3,982
Quote:
Originally Posted by kedautinh12 View Post
Your Latest still error with .vp9, add this video and check
https://drive.google.com/file/d/1FAl...w?usp=drivesdk
This is AVC. Works ok. Rename the file characters
poisondeathray is offline   Reply With Quote
Old 23rd October 2019, 04:05   #1045  |  Link
kedautinh12
Registered User
 
Join Date: Jan 2018
Posts: 41
Quote:
Originally Posted by poisondeathray View Post
This is AVC. Works ok. Rename the file characters
I was renamed and load ok but still error with image in video
kedautinh12 is offline   Reply With Quote
Old 23rd October 2019, 04:36   #1046  |  Link
poisondeathray
Registered User
 
Join Date: Sep 2007
Posts: 3,982
Quote:
Originally Posted by kedautinh12 View Post
I was renamed and load ok but still error with image in video
what error? what time ?
poisondeathray is offline   Reply With Quote
Old 23rd October 2019, 07:01   #1047  |  Link
kedautinh12
Registered User
 
Join Date: Jan 2018
Posts: 41
Quote:
Originally Posted by poisondeathray View Post
what error? what time ?
When i load video with LWLibavVideoSource still error with L-SMASH-Works_20190917 and LSMASHSource-r935+34
https://drive.google.com/open?id=115...Yi9jrKPfOO2smu

But i load ok with L-SMASH-Works r929
https://drive.google.com/open?id=16c...G738RIUaCO2MtC
kedautinh12 is offline   Reply With Quote
Old 23rd October 2019, 07:05   #1048  |  Link
poisondeathray
Registered User
 
Join Date: Sep 2007
Posts: 3,982
I see no errors with 20190917

Are you sure it's the correct video ? Earlier you said ".vp9" . This is AVC in MP4.
poisondeathray is offline   Reply With Quote
Old 23rd October 2019, 07:27   #1049  |  Link
kedautinh12
Registered User
 
Join Date: Jan 2018
Posts: 41
Quote:
Originally Posted by poisondeathray View Post
I see no errors with 20190917

Are you sure it's the correct video ? Earlier you said ".vp9" . This is AVC in MP4.
Ah sorry my fault, this video right
https://drive.google.com/open?id=1y0...wXqzCMQwNSrTlx
Error frame with vp9 in .MKV
kedautinh12 is offline   Reply With Quote
Old 6th November 2019, 18:32   #1050  |  Link
Atak_Snajpera
RipBot264 author
 
Atak_Snajpera's Avatar
 
Join Date: May 2006
Location: Poland
Posts: 7,229
Creation of audio index file needs some optimalization because file size can be extremely large.
Example: 10 min TrueHD


It looks like that every 1 minute of TrueHD audio adds extra 10 MiB to index file. With typical 100+ minute movie index file will be over 1 GiB! Parsing that big ass file on single core is just super ineficient.

Question: Do we really need those repeated information in each line? From what I see only values for POS,PTS,DTS are changing. Furthermore values PTS and DTS are increasing in predictable manner.

Code:
<LSMASHWorksIndexVersion=0.0.2.0>
<LibavReaderIndexFile=15>
<FileSize=526166830>
<FileHash=0x7b6795d7>
<LibavReaderIndex=0x00000180,1,truehd>
<ActiveVideoStreamIndex>-0000000001</ActiveVideoStreamIndex>
<ActiveAudioStreamIndex>+0000000000</ActiveAudioStreamIndex>
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=0,PTS=0,DTS=0,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=576,PTS=75,DTS=75,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=740,PTS=150,DTS=150,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=902,PTS=225,DTS=225,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=1050,PTS=300,DTS=300,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=1194,PTS=375,DTS=375,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=1340,PTS=450,DTS=450,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=1476,PTS=525,DTS=525,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=1624,PTS=600,DTS=600,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=1762,PTS=675,DTS=675,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=1912,PTS=750,DTS=750,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=2058,PTS=825,DTS=825,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=2196,PTS=900,DTS=900,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=2346,PTS=975,DTS=975,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=2490,PTS=1050,DTS=1050,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Atak_Snajpera is offline   Reply With Quote
Old 15th November 2019, 09:32   #1051  |  Link
HolyWu
Registered User
 
HolyWu's Avatar
 
Join Date: Aug 2006
Location: Taiwan
Posts: 665
https://github.com/HolyWu/L-SMASH-Wo...ks_20191115.7z
  • Update to FFmpeg-20191114-73ee53f.
  • VapourSynth: Export mastering display metadata and content light level in frame properties.
  • VideoSource: Improve capability check in prefer_hw.
  • LWLibav: Fix VP9 decoding issue with superframes.
  • VideoSource: Enable AV1 decoding via libdav1d.
  • Add parameter ff_loglevel.
  • LWLibav: Adjust the structure of index file to reduce file size.
HolyWu is offline   Reply With Quote
Old 15th November 2019, 14:49   #1052  |  Link
Atak_Snajpera
RipBot264 author
 
Atak_Snajpera's Avatar
 
Join Date: May 2006
Location: Poland
Posts: 7,229
Quote:
Originally Posted by HolyWu View Post
https://github.com/HolyWu/L-SMASH-Wo...ks_20191115.7z
  • Update to FFmpeg-20191114-73ee53f.
  • VapourSynth: Export mastering display metadata and content light level in frame properties.
  • VideoSource: Improve capability check in prefer_hw.
  • LWLibav: Fix VP9 decoding issue with superframes.
  • VideoSource: Enable AV1 decoding via libdav1d.
  • Add parameter ff_loglevel.
  • LWLibav: Adjust the structure of index file to reduce file size.
Thank you for your excellent work!
Atak_Snajpera is offline   Reply With Quote
Old 15th November 2019, 14:57   #1053  |  Link
fg118942
Registered User
 
Join Date: Aug 2018
Posts: 9
Quote:
Originally Posted by HolyWu View Post
https://github.com/HolyWu/L-SMASH-Wo...ks_20191115.7z
  • Update to FFmpeg-20191114-73ee53f.
  • VapourSynth: Export mastering display metadata and content light level in frame properties.
  • VideoSource: Improve capability check in prefer_hw.
  • LWLibav: Fix VP9 decoding issue with superframes.
  • VideoSource: Enable AV1 decoding via libdav1d.
  • Add parameter ff_loglevel.
  • LWLibav: Adjust the structure of index file to reduce file size.
HolyWu, thank you so much for fixing the issue of VP9.
However, using LSMASHVideoSource in version 20191115 will cause Access Violation.
fg118942 is offline   Reply With Quote
Old 16th November 2019, 10:21   #1054  |  Link
HolyWu
Registered User
 
HolyWu's Avatar
 
Join Date: Aug 2006
Location: Taiwan
Posts: 665
https://github.com/HolyWu/L-SMASH-Wo...ks_20191116.7z
  • LibavSMASH: Fix access violation.
HolyWu is offline   Reply With Quote
Old 16th November 2019, 11:07   #1055  |  Link
2ndR
Registered User
 
Join Date: Nov 2009
Posts: 2
Perfect
2ndR is offline   Reply With Quote
Old 19th November 2019, 01:06   #1056  |  Link
hydra3333
Registered User
 
Join Date: Oct 2009
Location: crow-land
Posts: 532
Thank you HolyWu.
I have just visited this thread for the first time in a while.
I have changed my icky x264 build process to use your LSW git accordingly
Nice work !!!!


edit:
PS is there any possibility you may turn on the Issues tab in your github fork ?
Apparently,
- Go to the Settings page of your fork.
- Check the box next to Issues
- You can now file issues on your own fork and they will not be placed in the main repo.

Last edited by hydra3333; 19th November 2019 at 01:13.
hydra3333 is offline   Reply With Quote
Old 19th November 2019, 16:13   #1057  |  Link
FranceBB
Broadcast Encoder
 
FranceBB's Avatar
 
Join Date: Nov 2013
Location: Germany
Posts: 681
Quote:
Originally Posted by HolyWu View Post
Thank you, once again!
__________________
Broadcast Encoder
Avisynth memes: 1 - 2 - 3
Videotek - Audacity XP
FranceBB is offline   Reply With Quote
Old 21st November 2019, 17:19   #1058  |  Link
Patman
Registered User
 
Patman's Avatar
 
Join Date: Jan 2015
Posts: 139
Quote:
Originally Posted by HolyWu View Post
Hi HolyWu,

thanks for your build. I think there is a problem when some special characters like ' are included in the file name. Can you please check that? For me the LibavSMASHSource Filter is corrupted. LWLibavSource works.
__________________
My Builds
Patman is offline   Reply With Quote
Old 22nd November 2019, 02:59   #1059  |  Link
HolyWu
Registered User
 
HolyWu's Avatar
 
Join Date: Aug 2006
Location: Taiwan
Posts: 665
Quote:
Originally Posted by Patman View Post
I think there is a problem when some special characters like ' are included in the file name. Can you please check that? For me the LibavSMASHSource Filter is corrupted. LWLibavSource works.
Cannot reproduce.

AVS:


VS:
HolyWu is offline   Reply With Quote
Old 22nd November 2019, 11:12   #1060  |  Link
StainlessS
HeartlessS Usurer
 
StainlessS's Avatar
 
Join Date: Dec 2009
Location: Over the rainbow
Posts: 7,263
Is the offending character perhaps slanting single quote (`) ?

EDIT: Normal Single quote ('), Grave [backwards slant] (`), Acute [forwards slant] (ˊ).

EDIT: Patman, post your actual problem filename.

EDIT: I note these new functions in Avs+:- http://avisynth.nl/index.php/Interna...ring_functions
Code:
 StrToUtf8

    StrToUtf8(string)   AVS+ 
    Converts string from ANSI to UTF8. 

StrFromUtf8

    StrFromUtf8(string)   AVS+ 
    Converts string from UTF8 to ANSI
__________________
I sometimes post sober.
StainlessS@MediaFire ::: AND/OR ::: StainlessS@SendSpace

"Some infinities are bigger than other infinities", but how many of them are infinitely bigger ???

Last edited by StainlessS; 22nd November 2019 at 14:52.
StainlessS is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 08:10.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2019, vBulletin Solutions Inc.