Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > Capturing and Editing Video > Avisynth Development

Reply
 
Thread Tools Search this Thread Display Modes
Old 2nd August 2019, 17:05   #821  |  Link
StainlessS
HeartlessS Usurer
 
StainlessS's Avatar
 
Join Date: Dec 2009
Location: Over the rainbow
Posts: 9,731
PDR, confirmation please,
LSMASHAudioSource will sometimes index audio [EDIT: in an ISO container] (as well as LWLibavAudioSource), and not just fail on that audio.

[EDIT: Something I may need to anticipate in multi-source script function]

EDIT: Are there any circumstances in which LSmashVideoSource will index video ?
__________________
I sometimes post sober.
StainlessS@MediaFire ::: AND/OR ::: StainlessS@SendSpace

"Some infinities are bigger than other infinities", but how many of them are infinitely bigger ???

Last edited by StainlessS; 2nd August 2019 at 19:14.
StainlessS is offline   Reply With Quote
Old 7th August 2019, 18:19   #822  |  Link
StainlessS
HeartlessS Usurer
 
StainlessS's Avatar
 
Join Date: Dec 2009
Location: Over the rainbow
Posts: 9,731
Thanks HolyWu.

ChaosKing,
I think you were keeping list of file extensions that LSmashVideoSource could deal with.
Playing with MediaInfo 19.07, I noticed this
Code:
00000108    07:25:42.729    MIFO_Get: General
00000109    07:25:42.729    MIFO_Get: Count                            : 322
00000110    07:25:42.729    MIFO_Get: StreamCount                      : 1
00000111    07:25:42.729    MIFO_Get: StreamKind                       : General
00000112    07:25:42.729    MIFO_Get: StreamKind/String                : General
00000113    07:25:42.729    MIFO_Get: StreamKindID                     : 0
00000114    07:25:42.729    MIFO_Get: VideoCount                       : 3
00000115    07:25:42.729    MIFO_Get: AudioCount                       : 3
00000116    07:25:42.729    MIFO_Get: Video_Format_List                : AVC / AVC / AVC
00000117    07:25:42.729    MIFO_Get: Video_Format_WithHint_List       : AVC / AVC / AVC
00000118    07:25:42.729    MIFO_Get: Video_Codec_List                 : AVC / AVC / AVC
00000119    07:25:42.729    MIFO_Get: Audio_Format_List                : AAC / AAC / AAC
00000120    07:25:42.729    MIFO_Get: Audio_Format_WithHint_List       : AAC / AAC / AAC
00000121    07:25:42.729    MIFO_Get: Audio_Codec_List                 : AAC LC / AAC LC / AAC LC-SBR
00000122    07:25:42.729    MIFO_Get: CompleteName                     : D:\MintSource\TEST\VAVAVA.mp4
00000123    07:25:42.729    MIFO_Get: FolderName                       : D:\MintSource\TEST
00000124    07:25:42.729    MIFO_Get: FileName                         : VAVAVA
00000125    07:25:42.729    MIFO_Get: FileExtension                    : mp4
00000126    07:25:42.729    MIFO_Get: Format                           : MPEG-4
00000127    07:25:42.729    MIFO_Get: Format/String                    : MPEG-4
00000128    07:25:42.729    MIFO_Get: Format/Extensions                : mp4 m4v m4a m4b m4p 3gpp 3gp 3gpp2 3g2 k3g jpm jpx mqv ismv isma f4v
00000129    07:25:42.729    MIFO_Get: Format_Commercial                : MPEG-4
00000130    07:25:42.729    MIFO_Get: Format_Profile                   : Base Media
00000131    07:25:42.729    MIFO_Get: InternetMediaType                : video/mp4
00000132    07:25:42.729    MIFO_Get: CodecID                          : isom
00000133    07:25:42.729    MIFO_Get: CodecID/String                   : isom (isom/avc1)
So I've added missing ones to my list of ISO file extensions that LSmashVideoSource/LSmashAudioSource can open.
Complete list.
Code:
    Function IsISOFileName(String s)        {s=RT_GetFileExtension(s) Return(s==".mov"||s==".mp4"||s==".m4v"||s==".3gp"||s==".3gpp2"||s==".3g2"||s==".mj2"||s==".dvb"||
                                            \ s==".dcf"||s==".m21"||s==".m4a"||s==".m4b"||s==".m4p"||s==".k3g"||s==".jpm"||s==".jpx"||s==".mqv"||s==".ismv"||s==".isma"||s==".f4v")}
Or bare.
Code:
mov, mp4, m4v, 3gp, 3gpp2, 3g2, mj2, dvb, dcf, m21, m4a, m4b, m4p, k3g, jpm, jpx, mqv, ismv, isma, f4v
__________________
I sometimes post sober.
StainlessS@MediaFire ::: AND/OR ::: StainlessS@SendSpace

"Some infinities are bigger than other infinities", but how many of them are infinitely bigger ???

Last edited by StainlessS; 7th August 2019 at 18:27.
StainlessS is offline   Reply With Quote
Old 7th August 2019, 18:19   #823  |  Link
Selur
Registered User
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 6,418
thanks, btw. a small tool to create the cache file (like fmsindex for ffvideosource) would be nice
__________________
Hybrid here in the forum, homepage
Notice: Since email notifications do not work here any more, it might take me quite some time to notice a reply to a thread,..
Selur is offline   Reply With Quote
Old 7th August 2019, 18:30   #824  |  Link
FranceBB
Broadcast Encoder
 
FranceBB's Avatar
 
Join Date: Nov 2013
Location: Metropolitan City of Milan, Italy
Posts: 1,843
Quote:
Originally Posted by HolyWu View Post
L-SMASH-Works-r935+26-win64-20190808
  • Update to FFmpeg 4.2.
  • Add parameter cachefile.
Uh... may I ask you an x86 version, please? :P
FranceBB is offline   Reply With Quote
Old 7th August 2019, 20:10   #825  |  Link
Atak_Snajpera
RipBot264 author
 
Atak_Snajpera's Avatar
 
Join Date: May 2006
Location: Poland
Posts: 7,624
Quote:
Originally Posted by HolyWu View Post
L-SMASH-Works-r935+26-win64-20190808
  • Update to FFmpeg 4.2.
  • Add parameter cachefile.
Thank you for cachefile file option!
Atak_Snajpera is offline   Reply With Quote
Old 8th August 2019, 08:17   #826  |  Link
LigH
German doom9/Gleitz SuMo
 
LigH's Avatar
 
Join Date: Oct 2001
Location: Germany, rural Altmark
Posts: 6,476
@Selur: In the meantime, you may use avsr (by Groucho2004) with a minimal script, if applicable...
__________________

New German Gleitz board
MediaFire: x264 | x265 | VPx | AOM | Xvid
LigH is offline   Reply With Quote
Old 8th August 2019, 09:07   #827  |  Link
Groucho2004
 
Join Date: Mar 2006
Location: Barcelona
Posts: 5,042
Quote:
Originally Posted by LigH View Post
@Selur: In the meantime, you may use avsr (by Groucho2004) with a minimal script, if applicable...
What do you mean by "minimal script"? All you have to do is use the "-i" switch with avsr and the cache/index file will be created. There's no progress indicator though...
__________________
Groucho's Avisynth Stuff
Groucho2004 is offline   Reply With Quote
Old 8th August 2019, 14:12   #828  |  Link
stax76
Registered User
 
stax76's Avatar
 
Join Date: Jun 2002
Location: On thin ice
Posts: 6,742
Quote:
Add parameter cachefile
Thanks for adding this.
__________________
mpv.net - StaxRip - MediaInfo.NET - Get-MediaInfo - More
stax76 is offline   Reply With Quote
Old 8th August 2019, 15:06   #829  |  Link
Atak_Snajpera
RipBot264 author
 
Atak_Snajpera's Avatar
 
Join Date: May 2006
Location: Poland
Posts: 7,624
Quote:
Originally Posted by Groucho2004 View Post
What do you mean by "minimal script"? All you have to do is use the "-i" switch with avsr and the cache/index file will be created. There's no progress indicator though...
Perhaps something like this?

Code:
LoadPlugin("LSMASHSource.dll")
LWLibavVideoSource("video.mkv")
Trim(0,-1)
Atak_Snajpera is offline   Reply With Quote
Old 8th August 2019, 23:06   #830  |  Link
MeteorRain
結城有紀
 
Join Date: Dec 2003
Location: NJ; OR; Shanghai
Posts: 891
Perhaps something like this?

Code:
avs4x26x-x64 video.mkv
__________________
Projects
x265 - Yuuki-Asuna-mod Download / GitHub
TS - ADTS AAC Splitter | LATM AAC Splitter | BS4K-ASS
Neo AviSynth+ filters - F3KDB | FFT3D | DFTTest | MiniDeen | Temporal Median
MeteorRain is offline   Reply With Quote
Old 9th August 2019, 07:23   #831  |  Link
LigH
German doom9/Gleitz SuMo
 
LigH's Avatar
 
Join Date: Oct 2001
Location: Germany, rural Altmark
Posts: 6,476
Yes, I mean that only for indexing, none of the filters for the final video need to be included ("minimal" in the sense to only load the [audio and] video). Like Atak_Snajpera suggested.
__________________

New German Gleitz board
MediaFire: x264 | x265 | VPx | AOM | Xvid
LigH is offline   Reply With Quote
Old 9th August 2019, 09:25   #832  |  Link
Groucho2004
 
Join Date: Mar 2006
Location: Barcelona
Posts: 5,042
Quote:
Originally Posted by LigH View Post
Yes, I mean that only for indexing, none of the filters for the final video need to be included ("minimal" in the sense to only load the [audio and] video). Like Atak_Snajpera suggested.
Right. As I mentioned, since one most likely already has a script, indexing will be triggered by using avsr with the switch "-i" which simply displays the clip properties.
__________________
Groucho's Avisynth Stuff
Groucho2004 is offline   Reply With Quote
Old 9th August 2019, 19:37   #833  |  Link
MeteorRain
結城有紀
 
Join Date: Dec 2003
Location: NJ; OR; Shanghai
Posts: 891
Quote:
Originally Posted by Groucho2004 View Post
What do you mean by "minimal script"?
Quote:
Originally Posted by Groucho2004 View Post
Right. As I mentioned, since one most likely already has a script,
Having non-minimal script could significantly increase loading time if complicated filters are used, such as waifu or QTGMC.

I always use a bare source script to generate the index, and later a fully functional script to do the actual encode.

Anyway, you can always use avs4x26x like I mentioned above to automatically create the script (in memory) and generate the index.
__________________
Projects
x265 - Yuuki-Asuna-mod Download / GitHub
TS - ADTS AAC Splitter | LATM AAC Splitter | BS4K-ASS
Neo AviSynth+ filters - F3KDB | FFT3D | DFTTest | MiniDeen | Temporal Median
MeteorRain is offline   Reply With Quote
Old 11th August 2019, 19:04   #834  |  Link
LigH
German doom9/Gleitz SuMo
 
LigH's Avatar
 
Join Date: Oct 2001
Location: Germany, rural Altmark
Posts: 6,476
Praise the HolyWu!
__________________

New German Gleitz board
MediaFire: x264 | x265 | VPx | AOM | Xvid
LigH is offline   Reply With Quote
Old 11th August 2019, 21:22   #835  |  Link
Taurus
Registered User
 
Taurus's Avatar
 
Join Date: Mar 2002
Location: Krautland
Posts: 903
Quote:
Originally Posted by HolyWu View Post
Link updated in the previous post. The other thread as well.
Taurus is offline   Reply With Quote
Old 13th August 2019, 13:54   #836  |  Link
Atak_Snajpera
RipBot264 author
 
Atak_Snajpera's Avatar
 
Join Date: May 2006
Location: Poland
Posts: 7,624
I have another feature request.
Store index file in compressed form. Currently index file can be extremely large in comparison to .ffindex.
video.mkv is remuxed Alien Covenant DVD (2h movie). Just take a look how tiny .ffindex is


Large index file is not a problem if you load that file locally from SSD. Normally It should take less than 1s. However it is a different story if you have to load that file directly via network 100Mbps LAN or wi-fi n.

Quote:
video=LWLibavVideoSource("\\XEON-PC\RipBot264temp\job1\video.mkv",threads=0,cachefile="\\XEON-PC\RipBot264temp\job1\video.mkv.lwi")
That large uncompressed index file significantly delays starting of encoding process. It gets even worse if more than one server is downloading that file.

example


Now 6 servers are downloading 200MiB index file at the same time. (1.2GiB total). Assuming that real transfer rate for LAN100Mbps is only ~10MiB/s we can easily predict that encoding process will be delayed by about 2 minutes!

So my suggestion is to always compress index file with some basic zip algorithm. LZMA (normal) can compress that index file to ~5MiB while Zip to ~10MiB.
Time saving will be immediately noticeable. Delay will be measured in seconds instead of minutes.

Last edited by Atak_Snajpera; 13th August 2019 at 14:20.
Atak_Snajpera is offline   Reply With Quote
Old 13th August 2019, 15:45   #837  |  Link
Myrsloik
Professional Code Monkey
 
Myrsloik's Avatar
 
Join Date: Jun 2003
Location: Kinnarps Chair
Posts: 2,400
Quote:
Originally Posted by Atak_Snajpera View Post
I have another feature request.
Store index file in compressed form. Currently index file can be extremely large in comparison to .ffindex.
video.mkv is remuxed Alien Covenant DVD (2h movie). Just take a look how tiny .ffindex is


Large index file is not a problem if you load that file locally from SSD. Normally It should take less than 1s. However it is a different story if you have to load that file directly via network 100Mbps LAN or wi-fi n.



That large uncompressed index file significantly delays starting of encoding process. It gets even worse if more than one server is downloading that file.

example


Now 6 servers are downloading 200MiB index file at the same time. (1.2GiB total). Assuming that real transfer rate for LAN100Mbps is only ~10MiB/s we can easily predict that encoding process will be delayed by about 2 minutes!

So my suggestion is to always compress index file with some basic zip algorithm. LZMA (normal) can compress that index file to ~5MiB while Zip to ~10MiB.
Time saving will be immediately noticeable. Delay will be measured in seconds instead of minutes.
FFMS2 uses zlib and preprocessing of the data (store the differences between timestamps/frame numbers instead of absolute timestamps/frame numbers). Huffman coding based things already work wonders on that kind of data. Just a hint.
__________________
VapourSynth - proving that scripting languages and video processing isn't dead yet
Myrsloik is offline   Reply With Quote
Old 13th August 2019, 16:59   #838  |  Link
FranceBB
Broadcast Encoder
 
FranceBB's Avatar
 
Join Date: Nov 2013
Location: Metropolitan City of Milan, Italy
Posts: 1,843
Quote:
Originally Posted by HolyWu View Post
Link updated in the previous post. The other thread as well.
Thank you!
FranceBB is offline   Reply With Quote
Old 14th August 2019, 19:56   #839  |  Link
Morku
Registered User
 
Join Date: Jul 2012
Posts: 198
Edit: Nevermind.

Last edited by Morku; 19th August 2019 at 20:43.
Morku is offline   Reply With Quote
Old 14th August 2019, 20:37   #840  |  Link
stax76
Registered User
 
stax76's Avatar
 
Join Date: Jun 2002
Location: On thin ice
Posts: 6,742
Did you verify that it actually outputs double width? There was a patch for native high bit depth support.
__________________
mpv.net - StaxRip - MediaInfo.NET - Get-MediaInfo - More
stax76 is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 00:03.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2021, vBulletin Solutions Inc.