L-SMASH Source - Page 53

kedautinh12 · 22nd October 2019, 18:20

Quote:

Originally Posted by HolyWu

https://github.com/HolyWu/L-SMASH-Works/releases/latest

Uploaded new binary which ditches libaom and is built by clang-cl. The binary size is smaller than the previous ICL build and decoding speed seems to be marginally faster.

No problem. Here.

Your Latest still error with .vp9, add this video and check
https://drive.google.com/file/d/1FAl...w?usp=drivesdk

stax76 · 22nd October 2019, 18:29

Quote:

Originally Posted by Atak_Snajpera

Question: Would be possible to use multiple threads to speed up indexing process? For example by using some kind of chunk indexing?
I'm asking because NVMe SSDs with read speed of 3GiB/s+ are getting much more affordable. I have Xeon E5-2690@3.2GHz (8C/16T) and I see that i'm experiencing a bottleneck due to single threaded code.
In this example I'm indexing 4k movie (~50Mbps) from RAM disk...

1,24GiB/s is a max I can get on single core. ffmsindex is even more cpu intensive (only ~0,5GiB/s).

Currently indexing of ~60 GiB 4k movie takes ~1 minute. With proper multi-threading we could easily reduce indexing time to ~15s!

Maybe you are asking the wrong question, how about MakeMKV creating an index? Answer: It's just code, anything is possible.

kedautinh12 · 23rd October 2019, 02:11

Quote:

Originally Posted by MeteorRain

https://down.7086.in/AviSynthPlus%20...-r935%2B34.zip

Stop indexing progress spamming

-- Now only refresh at every 1%.

Still error with vp9, only old ver r929 of VFR-maniac still fine

poisondeathray · 23rd October 2019, 02:35

Quote:

Originally Posted by kedautinh12

Your Latest still error with .vp9, add this video and check
https://drive.google.com/file/d/1FAl...w?usp=drivesdk

This is AVC. Works ok. Rename the file characters

kedautinh12 · 23rd October 2019, 03:05

Quote:

Originally Posted by poisondeathray

This is AVC. Works ok. Rename the file characters

I was renamed and load ok but still error with image in video

poisondeathray · 23rd October 2019, 03:36

Quote:

Originally Posted by kedautinh12

I was renamed and load ok but still error with image in video

what error? what time ?

kedautinh12 · 23rd October 2019, 06:01

Quote:

Originally Posted by poisondeathray

what error? what time ?

When i load video with LWLibavVideoSource still error with L-SMASH-Works_20190917 and LSMASHSource-r935+34
https://drive.google.com/open?id=115...Yi9jrKPfOO2smu

But i load ok with L-SMASH-Works r929
https://drive.google.com/open?id=16c...G738RIUaCO2MtC

poisondeathray · 23rd October 2019, 06:05

I see no errors with 20190917

Are you sure it's the correct video ? Earlier you said ".vp9" . This is AVC in MP4.

kedautinh12 · 23rd October 2019, 06:27

Quote:

Originally Posted by poisondeathray

I see no errors with 20190917

Are you sure it's the correct video ? Earlier you said ".vp9" . This is AVC in MP4.

Ah sorry my fault, this video right
https://drive.google.com/open?id=1y0...wXqzCMQwNSrTlx
Error frame with vp9 in .MKV

Atak_Snajpera · 6th November 2019, 18:32

Creation of audio index file needs some optimalization because file size can be extremely large.
Example: 10 min TrueHD

It looks like that every 1 minute of TrueHD audio adds extra 10 MiB to index file. With typical 100+ minute movie index file will be over 1 GiB! Parsing that big ass file on single core is just super ineficient.

Question: Do we really need those repeated information in each line? From what I see only values for POS,PTS,DTS are changing. Furthermore values PTS and DTS are increasing in predictable manner.

Code:

<LSMASHWorksIndexVersion=0.0.2.0>
<LibavReaderIndexFile=15>
<FileSize=526166830>
<FileHash=0x7b6795d7>
<LibavReaderIndex=0x00000180,1,truehd>
<ActiveVideoStreamIndex>-0000000001</ActiveVideoStreamIndex>
<ActiveAudioStreamIndex>+0000000000</ActiveAudioStreamIndex>
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=0,PTS=0,DTS=0,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=576,PTS=75,DTS=75,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=740,PTS=150,DTS=150,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=902,PTS=225,DTS=225,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=1050,PTS=300,DTS=300,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=1194,PTS=375,DTS=375,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=1340,PTS=450,DTS=450,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=1476,PTS=525,DTS=525,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=1624,PTS=600,DTS=600,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=1762,PTS=675,DTS=675,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=1912,PTS=750,DTS=750,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=2058,PTS=825,DTS=825,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=2196,PTS=900,DTS=900,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=2346,PTS=975,DTS=975,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40
Index=0,Type=1,Codec=86060,TimeBase=1/90000,POS=2490,PTS=1050,DTS=1050,EDI=0
Channels=8:0x63f,Rate=48000,Format=s32,BPS=24,Length=40

HolyWu · 15th November 2019, 09:32

https://github.com/HolyWu/L-SMASH-Wo...ks_20191115.7z

Update to FFmpeg-20191114-73ee53f.
VapourSynth: Export mastering display metadata and content light level in frame properties.
VideoSource: Improve capability check in prefer_hw.
LWLibav: Fix VP9 decoding issue with superframes.
VideoSource: Enable AV1 decoding via libdav1d.
Add parameter ff_loglevel.
LWLibav: Adjust the structure of index file to reduce file size.

Atak_Snajpera · 15th November 2019, 14:49

Quote:

Originally Posted by HolyWu

https://github.com/HolyWu/L-SMASH-Wo...ks_20191115.7z

Update to FFmpeg-20191114-73ee53f.
VapourSynth: Export mastering display metadata and content light level in frame properties.
VideoSource: Improve capability check in prefer_hw.
LWLibav: Fix VP9 decoding issue with superframes.
VideoSource: Enable AV1 decoding via libdav1d.
Add parameter ff_loglevel.
LWLibav: Adjust the structure of index file to reduce file size.

Thank you for your excellent work!

fg118942 · 15th November 2019, 14:57

Quote:

Originally Posted by HolyWu

https://github.com/HolyWu/L-SMASH-Wo...ks_20191115.7z

Update to FFmpeg-20191114-73ee53f.
VapourSynth: Export mastering display metadata and content light level in frame properties.
VideoSource: Improve capability check in prefer_hw.
LWLibav: Fix VP9 decoding issue with superframes.
VideoSource: Enable AV1 decoding via libdav1d.
Add parameter ff_loglevel.
LWLibav: Adjust the structure of index file to reduce file size.

HolyWu, thank you so much for fixing the issue of VP9.
However, using LSMASHVideoSource in version 20191115 will cause Access Violation.

HolyWu · 16th November 2019, 10:21

https://github.com/HolyWu/L-SMASH-Wo...ks_20191116.7z

LibavSMASH: Fix access violation.

2ndR · 16th November 2019, 11:07

Perfect

hydra3333 · 19th November 2019, 01:06

Thank you HolyWu.
I have just visited this thread for the first time in a while.
I have changed my icky x264 build process to use your LSW git accordingly

Nice work !!!!

edit:
PS is there any possibility you may turn on the Issues tab in your github fork ?
Apparently,
- Go to the Settings page of your fork.
- Check the box next to Issues
- You can now file issues on your own fork and they will not be placed in the main repo.

FranceBB · 19th November 2019, 16:13

Quote:

Originally Posted by HolyWu

https://github.com/HolyWu/L-SMASH-Wo...ks_20191116.7z

LibavSMASH: Fix access violation.

Thank you, once again!

Patman · 21st November 2019, 17:19

Quote:

Originally Posted by HolyWu

https://github.com/HolyWu/L-SMASH-Wo...ks_20191116.7z

LibavSMASH: Fix access violation.

Hi HolyWu,

thanks for your build. I think there is a problem when some special characters like ' are included in the file name. Can you please check that? For me the LibavSMASHSource Filter is corrupted. LWLibavSource works.

HolyWu · 22nd November 2019, 02:59

Quote:

Originally Posted by Patman

I think there is a problem when some special characters like ' are included in the file name. Can you please check that? For me the LibavSMASHSource Filter is corrupted. LWLibavSource works.

Cannot reproduce.

AVS:

VS:

StainlessS · 22nd November 2019, 11:12

Is the offending character perhaps slanting single quote (`) ?

EDIT: Normal Single quote ('), Grave [backwards slant] (`), Acute [forwards slant] (ˊ).

EDIT: Patman, post your actual problem filename.

EDIT: I note these new functions in Avs+:- http://avisynth.nl/index.php/Interna...ring_functions

Code:

 StrToUtf8

    StrToUtf8(string)   AVS+ 
    Converts string from ANSI to UTF8. 

StrFromUtf8

    StrFromUtf8(string)   AVS+ 
    Converts string from UTF8 to ANSI

15th November 2019, 09:32	#1051 \| Link
HolyWu Registered User Join Date: Aug 2006 Location: Taiwan Posts: 754	https://github.com/HolyWu/L-SMASH-Wo...ks_20191115.7z Update to FFmpeg-20191114-73ee53f. VapourSynth: Export mastering display metadata and content light level in frame properties. VideoSource: Improve capability check in prefer_hw. LWLibav: Fix VP9 decoding issue with superframes. VideoSource: Enable AV1 decoding via libdav1d. Add parameter ff_loglevel. LWLibav: Adjust the structure of index file to reduce file size.

16th November 2019, 10:21	#1054 \| Link
HolyWu Registered User Join Date: Aug 2006 Location: Taiwan Posts: 754	https://github.com/HolyWu/L-SMASH-Wo...ks_20191116.7z LibavSMASH: Fix access violation.

19th November 2019, 01:06	#1056 \| Link
hydra3333 Registered User Join Date: Oct 2009 Location: crow-land Posts: 540	Thank you HolyWu. I have just visited this thread for the first time in a while. I have changed my icky x264 build process to use your LSW git accordingly Nice work !!!! edit: PS is there any possibility you may turn on the Issues tab in your github fork ? Apparently, - Go to the Settings page of your fork. - Check the box next to Issues - You can now file issues on your own fork and they will not be placed in the main repo. Last edited by hydra3333; 19th November 2019 at 01:13.

22nd November 2019, 11:12	#1060 \| Link
StainlessS HeartlessS Usurer Join Date: Dec 2009 Location: Over the rainbow Posts: 8,716	Is the offending character perhaps slanting single quote (`) ? EDIT: Normal Single quote ('), Grave [backwards slant] (`), Acute [forwards slant] (ˊ). EDIT: Patman, post your actual problem filename. EDIT: I note these new functions in Avs+:- http://avisynth.nl/index.php/Interna...ring_functions Code: StrToUtf8 StrToUtf8(string) AVS+ Converts string from ANSI to UTF8. StrFromUtf8 StrFromUtf8(string) AVS+ Converts string from UTF8 to ANSI __________________ I sometimes post sober. StainlessS@MediaFire ::: AND/OR ::: StainlessS@SendSpace "Some infinities are bigger than other infinities", but how many of them are infinitely bigger ??? Last edited by StainlessS; 22nd November 2019 at 14:52.

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

23rd October 2019, 06:05	#1048 \| Link
poisondeathray Registered User Join Date: Sep 2007 Posts: 4,448	I see no errors with 20190917 Are you sure it's the correct video ? Earlier you said ".vp9" . This is AVC in MP4.

16th November 2019, 11:07	#1055 \| Link
2ndR Registered User Join Date: Nov 2009 Posts: 4	Perfect