Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion. Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules. |
19th August 2019, 13:56 | #17162 | Link | |
Registered User
Join Date: Feb 2008
Posts: 145
|
Quote:
|
|
19th August 2019, 15:34 | #17163 | Link |
Registered User
Join Date: Oct 2001
Posts: 454
|
I just looked and canīt find it either.. Strange...
edit: ahhhhhh : appdata/local/temp/encodingserver1 ... there i found some on one of the machines (which takes up a few seconds for the index files.) Iīve noticed, that the "master machine" (which is one of the ones in the swarm needing about 5min to build the index files compared to around 20 sec) had about 50% to 80% GPU load on the csrss.exe while the index lwmi was building... Just checked another machine (small 4 Core Celeron with 64bit win10), which does exactly the same - high GPU load on csrss while the index was built... This machine also takes minutes on the same 20min file I am encoding to build the index file. Checked third machine: Dual Xeon 5660 - no GPU... this one was done in 5 seconds... another thing: The video file always is copied completely into the TEMP directory - renamed to video.mkv. (The setting is "off" in the settings). Maybe this is on purpose and good for jobs where the source is stored on a usb-hd or slow SMD share - but doing a lot of jobs from a local harddrive Iīd guess it would be enough to not copy the whole video - it fills up the temp drive a lot (and after all, we have all these nice indexes now...) Last edited by ReinerSchweinlin; 19th August 2019 at 15:58. |
19th August 2019, 16:40 | #17164 | Link |
Registered User
Join Date: Oct 2001
Posts: 454
|
Update:
Tested another PC - old Core2Duo - no GPU: This one also takes a long time to build the index - not much difference to the master machine (i5 kaby Lake)... So "having a GPU" canīt be the issue It seems, the dual-xeon is so much faster since it has A LOT of cache build in, so it can index much faster - just guessing here. |
19th August 2019, 16:50 | #17165 | Link |
RipBot264 author
Join Date: May 2006
Location: Poland
Posts: 7,815
|
Some tips from me.
1) Make sure you have been fully updated and ALL your remote PC have latest version of EncodingServer.exe running 2) Start with new fresh job Compressed index file is stored in JOB folder as video.mkv.lwi.7z. This file is next automatically decompressed on fly to %TEMP%/encodingserverX by EncodingServer.exe. Then EncodingServer modifies cachefile="" in X.avs file with proper path to extracted index file. I did this to save few seconds on my slow LAN100/Wi-FI N network (real transfer is only ~10MiB/s). If Index file is 30MiB then I save 3s from starting procedure. In order to save few extra seconds I also compressed ffmpeg.exe with UPX (20MiB vs 60MiB).
__________________
Windows 7 Image Updater - SkyLake\KabyLake\CoffeLake\Ryzen Threadripper Last edited by Atak_Snajpera; 19th August 2019 at 16:53. |
19th August 2019, 17:13 | #17166 | Link | |
ByteShare
Join Date: Sep 2014
Location: On the Internet
Posts: 560
|
Quote:
|
|
19th August 2019, 17:19 | #17167 | Link | |||||||||
ByteShare
Join Date: Sep 2014
Location: On the Internet
Posts: 560
|
Quote:
Quote:
Quote:
Quote:
Quote:
Quote:
Quote:
Quote:
Quote:
-Close RipBot Open, wait for the update to download files, close, reopen and the update will be installed. You might need to do this more than once if you didn't wait long enough. Once you're on the most recent update you should then see if this fixed any of your issues. -Sidenote. It would be helpful to change the point releases with these updates such as 1.25.xx, ie 1.25.02 or something I did some testing in between 1.25 and the most recent update: https://forum.doom9.org/showthread.p...66#post1881866 I'll need to do more testing myself to see if: -Any of the filter combination issues I was having got fixed -Extracting a frame is faster -Auto Crop is faster -See any weird frames jumping around (but audio in sync when it stops) on some files when using QTGMC that I hadn't seen until LSmash. Last edited by byteshare; 19th August 2019 at 18:16. |
|||||||||
19th August 2019, 17:22 | #17168 | Link | |
Registered User
Join Date: Oct 2001
Posts: 454
|
Quote:
@Atak Thanx. Of course, everything is up to date At least a few hours ago. Started ripbot on every machine three times, waited 5 minutes in between to fully catch all updates - then started to investigate.. I think I found the issue of some machines doing very slow "indexing" mentioned above: Close the encoding server windows (which is displaying the "indexing" procedure from 0 to 100%) - this did the trick for me - all machines now only take some seconds - the slower ones having the lowest cpu/bandwith... Machines which took minutes before now are starting after a few seconds.. Nice So it seems the screen-output of ther encoding server window is causing this? |
|
19th August 2019, 18:18 | #17169 | Link | |
ByteShare
Join Date: Sep 2014
Location: On the Internet
Posts: 560
|
Quote:
With the above version: -Extracting a frame is faster -Auto Crop is faster Still need to test: -Any of the filter combination issues I was having got fixed -See any weird frames jumping around (but audio in sync when it stops) on some files when using QTGMC that I hadn't seen until LSmash. Last edited by byteshare; 19th August 2019 at 21:09. |
|
19th August 2019, 20:16 | #17170 | Link |
Registered User
Join Date: Oct 2001
Posts: 454
|
@byteshare
Yes, we are on the same page, ah version Did some more testing - while encoding some old anime, I noticed this: source video (resized to fit width of the target for better comparison) encoded video (q22, slow, no filter, resized to match 720p, HEVC, 10 Bit) Its not exactly the same frame, but that doesnīt matter.. Notice the 1 pixel dots between the soft noise in the picture - and in the middle of the white "snake-like" thing... These artefacts seem to come from resizing, I have seen them quite a lot when encoding animes.. |
19th August 2019, 20:57 | #17171 | Link | |
ByteShare
Join Date: Sep 2014
Location: On the Internet
Posts: 560
|
Quote:
That said what are you using to resize the video? Have you tried: nnedi3_resize16 Also, are you using other filters? Last edited by byteshare; 19th August 2019 at 21:01. |
|
19th August 2019, 21:31 | #17172 | Link | |
Registered User
Join Date: Jan 2010
Posts: 456
|
Quote:
I ran that to update to the latest files, checked the files with yours I removed all jobs from previous version I copied the updated folder everywere and added 5 jobs Same thing, massive network usage
__________________
E5 2697 v2 @ 3.0GHz on P9X79 Deluxe 24GB Xeon E5-2680 v2 @ 3.1GHz 16GB Sony Vaio VPC-F13Z1E/B |
|
19th August 2019, 22:01 | #17173 | Link | |
Registered User
Join Date: Feb 2008
Posts: 145
|
Quote:
ill try a fresh install when i can lay hands kn the boxes in person, happy to provide anything to troubleshoot though. Still would love to solve my GPU issue filtering too! |
|
19th August 2019, 23:49 | #17174 | Link |
Registered User
Join Date: Jun 2016
Posts: 116
|
I made sure all CRCs matched on both of my machines.
I am still getting high network usage and now the encoding server shows it is creating the index file. Here is print out of it - if it helps. https://pastebin.com/WB2ACdfg thoughts?? |
20th August 2019, 02:05 | #17175 | Link | |
Registered User
Join Date: Jun 2016
Location: Canada
Posts: 131
|
flickering frames
Quote:
|
|
20th August 2019, 02:28 | #17176 | Link |
Registered User
Join Date: Feb 2008
Posts: 145
|
I've erased everything, dropped back to v1.24, and turned off auto-updating for now It seems like others are experiencing the same issues with index building I was so I'll wait a bit, hopefully address filtering via GPU not working on clients (for me) later. I suspect the fix won't be super difficult to solve the indexing but I've got a stack of videos waiting for me and cannot proceed at such a slow pace...
|
20th August 2019, 05:32 | #17177 | Link |
Registered User
Join Date: Mar 2016
Location: Austria
Posts: 32
|
bad sequence header magic
Hello
After last update I'm not able to start a DE job. On local and remote machine EncodingServer runs into Code:
Encoding started... ""\\USERX-MASTER\Ripbot264temp\Tools\ffmpeg\bin\ffmpeg.exe" -loglevel panic -i "\\USERX-MASTER\RipBot264temp\job1\Chunks\1.avs" -strict -1 -f yuv4mpegpipe - | "\\USERX-MASTER\Ripbot264temp\tools\x264\x264_x64.exe" --seek 0 --colorprim bt709 --transfer bt709 --colormatrix bt709 --opencl --opencl-device 0 --opencl-clbin "C:\Users\UserX\AppData\Local\Temp\x264_lookahead_1.clbin" --pass 1 --bitrate 3000 --stats "\\USERX-MASTER\RipBot264temp\job1\Chunks\1.stats" --fps 24000/1001 --force-cfr --min-keyint 24 --keyint 240 --frames 1440 --sar 1:1 --level 4.1 --aud --nal-hrd vbr --vbv-bufsize 25000 --vbv-maxrate 25000 --b-pyramid none --ref 5 --stdin y4m --output NUL -" y4m [error]: bad sequence header magic x264 [error]: could not open input file |
20th August 2019, 07:40 | #17178 | Link | ||
ByteShare
Join Date: Sep 2014
Location: On the Internet
Posts: 560
|
Quote:
I'm not having that issue with AVC/HEVC source either without filters or with LSFmod or FastLineDarkenMod. I need to test with more filters besides QTGMC. Quote:
I'm using: /port 1000 /minimize /priority low /restart-if-no-progress 8 |
||
20th August 2019, 07:42 | #17179 | Link | |
ByteShare
Join Date: Sep 2014
Location: On the Internet
Posts: 560
|
Quote:
|
|
20th August 2019, 11:40 | #17180 | Link | |
Registered User
Join Date: Oct 2001
Posts: 454
|
Quote:
Iīd rather leave them in the forum - external Image hosting tends to ditch pictures after a while - several older threads are almost unusable because people put the images on imageshack - now they are gone... Or is there a particular reason why itīs not recommended to save them directly in the forum? I used the default resize funktion in Ripbot. Looking at the Avisynthscript, it is spline resize - I am not at the pc right now, so Iīd have to check exactly, but I think I remember it was spline36, using some plugin for multihtreading.... The default one.. didnīt change anything. no custom scripts. No, no filters, just resizing. |
|
Tags |
264, 265, appletv, avchd, bluray, gui, iphone, ipod, ps3, psp, ripbot264, x264 2-pass, x264 gui, x264_64, x265, xbox360 |
|
|