Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion. Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules. |
18th October 2020, 22:17 | #2642 | Link |
Doom9ing since 2001
Join Date: Oct 2001
Location: Seattle, WA, USA
Posts: 2,002
|
What are the factors that have most impact on ffmsindex performance? File size/bitrate? Specific containers? Specific codecs? I notice that some videos take a lot longer to index than others - sometimes it takes 10-15 minutes to index a video, and I'm curious where the bottleneck is.
|
19th October 2020, 07:30 | #2643 | Link |
German doom9/Gleitz SuMo
Join Date: Oct 2001
Location: Germany, rural Altmark
Posts: 6,781
|
One factor I remember right away: If you try to index uncompressed video or audio, the index file can get extremely huge and needs a lot of time to be written.
The container can be a factor too. Some keep video and audio in easily accessible units, others may switch between them in the middle of a frame's content. Last edited by LigH; 19th October 2020 at 07:33. |
19th October 2020, 08:02 | #2644 | Link |
Broadcast Encoder
Join Date: Nov 2013
Location: Royal Borough of Kensington & Chelsea, UK
Posts: 2,903
|
Yep and some codecs are faster / better indexable than others.
For instance, it takes way less to index an H.264 than it generally takes to index an Apple ProRes of the same size, so even codecs might come into play here. Still, for me, the one that slows me down, the real bottleneck, is the LAN. You know, I use Avisynth at work all the time and it's not exactly easy to justify the "waiting" while you index an 800 GB AppleProRes file over the network with a connection of 1 Gbit/s... I generally act as a "stalker", though, and I watch the RAM being allocated while it's indexing in AVSPmod. This way, I get a "feeling" of what it's doing and how long it's gonna take. Oh and if it has 16 PCM audio tracks, the painful waiting even worse... Still, all in all, I'm kinda happy to wait 'cause, despite that, ever since 2006, ffms2 and LSMASH made make me index and then encode pretty much everything... |
20th October 2020, 08:05 | #2645 | Link |
Doom9ing since 2001
Join Date: Oct 2001
Location: Seattle, WA, USA
Posts: 2,002
|
Because indexing performance is so unpredictable sometimes I prefer to run the ffmsindex.exe process manually before I even try to load the script. It doesn't make it run any faster, of course, but at least that way I can track its progress and estimate time needed.
Some of the worst performance I've observed so far seems to be indexing AVI files with FFV1 video. A 100GB file (1hr 720p60 YUY2) can take nearly 30 mins to index on an 8th gen i5, which is barely 2x speed. It probably doesn't help that the indexing process is not fully multi-threaded. |
20th October 2020, 09:48 | #2646 | Link |
Formerly davidh*****
Join Date: Jan 2004
Posts: 2,496
|
https://forum.doom9.org/showthread.php?t=176878
Seektester is a handy utility for determining whether ffmpegsource is seeking correctly for a given container/codec. |
21st October 2020, 07:33 | #2647 | Link |
Broadcast Encoder
Join Date: Nov 2013
Location: Royal Borough of Kensington & Chelsea, UK
Posts: 2,903
|
Thanks for the tool. By the way, it would be nice to have AVSPmod display it somehow as well.
I would be fine even with a very simple command line progress bar that occasionally pops-up... |
22nd October 2020, 12:33 | #2648 | Link |
Registered User
Join Date: Sep 2003
Location: Berlin, Germany
Posts: 3,079
|
I solved almost all of my indexing annoyances by using DSS2Mod by forclip (using 32-bit only). Thanks wonkey_monkey for recommending the Seek Tester utility. I just tested DSS2Mod using different AVC clips. Only SD resolution, only progressive. Container formats were MP4, MKV and FLV. For DSS2Mod I used "preroll=15". In all tests I did not get any seek errors, so at least for such sources this source filter works excellently...
|
23rd November 2020, 05:37 | #2649 | Link | |
Registered User
Join Date: Oct 2018
Posts: 16
|
Quote:
https://github.com/bjakja/Kainote |
|
23rd November 2020, 23:31 | #2650 | Link |
Registered User
Join Date: Jul 2018
Posts: 450
|
ffms2:
- ffmpeg n4.4@9208b72a38; - zlib 1.2.11; - dav1d 0.7.1; - changed the default threads number: * VP9 - min(CPU logical processors, 8); * AV1 - 1 when CPU logical processors = 1, otherwise 2; * rest - CPU logical processors; - MPEG2 streams in mkv container should be ok now. |
24th November 2020, 04:22 | #2652 | Link | |
Registered User
Join Date: Jan 2018
Posts: 2,156
|
Quote:
|
|
24th November 2020, 04:25 | #2653 | Link | |
Registered User
Join Date: Jan 2018
Posts: 2,156
|
Quote:
|
|
25th November 2020, 03:56 | #2655 | Link |
HeartlessS Usurer
Join Date: Dec 2009
Location: Over the rainbow
Posts: 10,980
|
Yes indeed, merci StvG.
__________________
I sometimes post sober. StainlessS@MediaFire ::: AND/OR ::: StainlessS@SendSpace "Some infinities are bigger than other infinities", but how many of them are infinitely bigger ??? |
8th December 2020, 21:29 | #2656 | Link |
Formerly davidh*****
Join Date: Jan 2004
Posts: 2,496
|
Does anyone know if there any known problems with crackling audio with ffmpegsource? I made a screen recording which plays fine in VirtualDub and MPC-HC, but loading it via AviSynth with atrack=1 results in crackly audio. Audio codec is AAC.
|
9th December 2020, 00:46 | #2657 | Link | |
Registered User
Join Date: Jan 2012
Location: Mesopotamia
Posts: 2,587
|
Quote:
__________________
See My Avisynth Stuff |
|
9th December 2020, 01:21 | #2658 | Link |
Professional Code Monkey
Join Date: Jun 2003
Location: Kinnarps Chair
Posts: 2,555
|
Lots of audio issues are known.
__________________
VapourSynth - proving that scripting languages and video processing isn't dead yet |
10th April 2021, 22:29 | #2659 | Link |
Registered User
Join Date: Sep 2007
Posts: 5,374
|
Is it possible for ffms2 to support float read/import?
ffmpeg has had float support for a while; for example you can read/write EXR as "gbrpf32le" (or with alpha "gbrapf32le") But avs+ supports "RGBPS" (or with alpha "RGBAPS ") Or is there something preventing ffms2 from navigating this pixel format ? |
22nd May 2021, 10:59 | #2660 | Link |
Registered User
Join Date: Jan 2018
Posts: 2,156
|
New issue here:
https://forum.doom9.org/showthread.php?p=1943303 Last edited by kedautinh12; 23rd May 2021 at 02:08. |
Thread Tools | Search this Thread |
Display Modes | |
|
|