Log in

View Full Version : RipBot264 v1.18.3 - Simple and easy to use GUI -> IPOD . PSP . CONSOLES . BLURAY


Pages : 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 [342] 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429

byteshare
30th July 2019, 02:34
Haali is needed by Ripbot but not by K-lite Codec pack. First install Ripbot and Haali and then remove and install K-lite again. K-lite installer should prompt you to uninstall Haali, for which you should say no as it's needed by Ripbot. Then K-lite will be installed and everything works fine this way at least for me. If this does not help, try K-lite Full pack instead of Mega pack. You probably don't need the Mega pack. Here is the list of differences between various K-lite editions: https://www.codecguide.com/download_kl.htm
So I tried:
1 Install Haali Media Splitter
2 Remove & reinstall K-lite.
3 K-lite installer should prompt you to uninstall Haali, for which you should say no.
--And then the same with with K-lite Full pack instead of Mega pack.

For testing I tried uninstalling K-lite, rebooting, then only installing ffdshow and matroska splitter for RipBot and still get the same issue.
I am using the same files on different machines...so maybe it has something to do with my video card? IDK so for now if I need to test I just copy the RipBot script into AvsPmod.

Juha
30th July 2019, 12:12
When you uninstalled K-lite, it asked you to give feedback. What you chose? I answered I don't need it anymore. Sometimes uninstallers ask why are you removing it so that it knows if it should remove all the settings completely or just some of them in case of soon-to-happen re-installation. I recommend trying once more and choosing I don't need it anymore. Then I would try again if Ripbot preview works without K-lite being installed.

I have 2 machines and both had that preview issue and it got fixed on both.

If the preview still does not work for you despite K-lite is uninstalled it's hard to say what could be the issue. Maybe you have some codec remnants somewhere? In this case I would uninstall everything codec related stuff I could and then disable every codec that is left by using this tool: http://www.nirsoft.net/utils/installed_codec.html (make a system restore point in case of problems) and then install back the stuff that Ripbot is needing. Then try again the preview.

Have you also updated your graphics drivers?

nekrosoft13
30th July 2019, 15:52
Atak,

In administrator mode, only ripbot264 (Without EncodingServer.exe started due to HT mode)

https://image.noelshack.com/fichiers/2019/29/2/1563309377-2019-07-16-22h34-49.png

https://image.noelshack.com/fichiers/2019/29/2/1563309411-2019-07-16-22h36-38.png

the log is:

ProcessAffinityMask=111111111111111111111111111111111111
SystemAffinityMask=111111111111111111111111111111111111
Node=0
ProcessAffinityMaskPerNode=111111111111111111111111111111111111
SystemAffinityMaskPerNode=111111111111111111111111111111111111

If i make only EncodingServer.exe /node 0 (via cmd.exe) EncodingServer.exe doesn't run

https://image.noelshack.com/fichiers/2019/29/2/1563310074-2019-07-16-22h47-32.png

However, if i do EncodingServer.exe /affinity 1 - EncodingServer.exe start

https://image.noelshack.com/fichiers/2019/29/2/1563310253-2019-07-16-22h49-57.png

https://image.noelshack.com/fichiers/2019/29/2/1563310363-2019-07-16-22h50-04.png

The log is:

ProcessAffinityMask=111111111111111111111111111111111111
SystemAffinityMask=111111111111111111111111111111111111
Node=1
ProcessAffinityMaskPerNode=111111111111111111111111111111111111
SystemAffinityMaskPerNode=111111111111111111111111111111111111

And now, as EncodingServer.exe run, if i do EncodingServer.exe /node 0 or EncodingServer.exe /node 1, nothing happens either

https://image.noelshack.com/fichiers/2019/29/2/1563311228-2019-07-16-23h06-45.png

The log is:

ProcessAffinityMask=111111111111111111111111111111111111
SystemAffinityMask=111111111111111111111111111111111111
Node=0
ProcessAffinityMaskPerNode=111111111111111111111111111111111111
SystemAffinityMaskPerNode=111111111111111111111111111111111111

Nevertheless, i don't know if it's important but i noticed that when i execute EncodingServer.exe /node 0

The log is:

ProcessAffinityMask=111111111111111111111111111111111111
SystemAffinityMask=111111111111111111111111111111111111
Node=1
ProcessAffinityMaskPerNode=111111111111111111111111111111111111
SystemAffinityMaskPerNode=111111111111111111111111111111111111

And if i do EncodingServer.exe /node 1

The log is:

ProcessAffinityMask=111111111111111111111111111111111111
SystemAffinityMask=111111111111111111111111111111111111
Node=0
ProcessAffinityMaskPerNode=111111111111111111111111111111111111
SystemAffinityMaskPerNode=111111111111111111111111111111111111

https://image.noelshack.com/fichiers/2019/29/2/1563312130-2019-07-16-23h21-47.png

it's seems that the node number is switched when we do EncodingServer.exe /node 1 or EncodingServer.exe /node 0 twice

https://image.noelshack.com/fichiers/2019/29/2/1563312193-2019-07-16-23h22-54.png

Bye

did you get it to work? I been having the smae issue for few months.

Atak_Snajpera
30th July 2019, 16:44
did you get it to work? I been having the smae issue for few months.

Try this https://www.mediafire.com/file/aw8gqz7snt7twlb/EncodingServer.exe/file

byteshare
30th July 2019, 17:09
When you uninstalled K-lite, it asked you to give feedback. What you chose? I answered I don't need it anymore. Sometimes uninstallers ask why are you removing it so that it knows if it should remove all the settings completely or just some of them in case of soon-to-happen re-installation. I recommend trying once more and choosing I don't need it anymore. Then I would try again if Ripbot preview works without K-lite being installed.

I have 2 machines and both had that preview issue and it got fixed on both.

If the preview still does not work for you despite K-lite is uninstalled it's hard to say what could be the issue. Maybe you have some codec remnants somewhere? In this case I would uninstall everything codec related stuff I could and then disable every codec that is left by using this tool: http://www.nirsoft.net/utils/installed_codec.html (make a system restore point in case of problems) and then install back the stuff that Ripbot is needing. Then try again the preview.

Have you also updated your graphics drivers?
When I uninstalled Klite I choose I wanted a fresh install.
I have updated my drivers from time to time but I don't recall the preview ever working for the PCs that it isn't working on.
I haven't tried that tool, but I think avspmod is enough for now, since I've already spent a bit of time on this.
An extra step but it works and I don't need to use the preview very often except when something goes wrong or trying a new avisynth script.
Thanks for the help. Next time I format my computer I'll see what happens, or if I get annoyed enough I'll come back to this, lol.

nekrosoft13
30th July 2019, 18:47
Try this https://www.mediafire.com/file/aw8gqz7snt7twlb/EncodingServer.exe/file

that worked ! thank you :thanks:

I have both nodes at 100%, will post a screenshot later.

gabbett1
30th July 2019, 22:06
Hello, Atak. I have distributed encoding working, but for some reason the host computer will not encode, only the secondary PC's do the work until it's time to mux. Any thoughts? What info can I get you to help figure this out? Thanks.

Atak_Snajpera
31st July 2019, 11:06
Screenshots ,please.

nekrosoft13
31st July 2019, 14:25
Here you go

http://oi65.tinypic.com/2eq70rd.jpg

Atak_Snajpera
31st July 2019, 15:21
Here you go

http://oi65.tinypic.com/2eq70rd.jpg

LoL! It was for gabbett1 ;)

BTW. I would add two extra servers because CPU usage is still not at constant 100%.

gabbett1
31st July 2019, 20:19
Screenshots ,please.

LOL, figures. It must have updated or something. It's working fine. disregard. Thanks.

Atak_Snajpera
1st August 2019, 17:44
v1.25.0
Added: Variable priority mode to EncodingServer.
In this mode EncodingClient will be automatically changing encoding priority in order to balance progress on multiple servers running on the same machine.
Added: EncodingClient now also shows encoding priority set on server side and selected encoding numa node.
Fixed: EncodingClient is now copying file to shared folder in buffered mode.
Windows disables buffered write if write buffer in application is higher than 16MiB.
Because of this write buffer has been reduced from 64MiB to 16MiB.
Buffered write significantly reduces copy time on machine with huge amount of RAM.
Changed: lsmash is now a default decoder for all formats except VC1. FFMS will be still used for VC1.
Fixed: EncodingServer not starting on some Xeon machines with high number of threads.
Fixed: few minor bugs found since last version.


Progress balancing OFF
https://i.imgsafe.org/32/322ed275a6.png

Progress balancing ON
https://i.imgsafe.org/32/322ed0e740.png

Important message
Use variable priority only if:
1) you encode on single machine (for example with high number of cores/threads)
2) ...and use multiple servers to get full cpu usage
3) ...and chunks size is set to 0 (one big chunk for each active server)

Otherwise encoding time will be bigger than in default mode.

byteshare
2nd August 2019, 17:50
v1.25.0
Added: Variable priority mode to EncodingServer.
In this mode EncodingClient will be automatically changing encoding priority in order to balance progress on multiple servers running on the same machine.
Added: EncodingClient now also shows encoding priority set on server side and selected encoding numa node.
Fixed: EncodingClient is now copying file to shared folder in buffered mode.
Windows disables buffered write if write buffer in application is higher than 16MiB.
Because of this write buffer has been reduced from 64MiB to 16MiB.
Buffered write significantly reduces copy time on machine with huge amount of RAM.
Changed: lsmash is now a default decoder for all formats except VC1. FFMS will be still used for VC1.
Fixed: EncodingServer not starting on some Xeon machines with high number of threads.
Fixed: few minor bugs found since last version.

Awesome! Thank you.
I'm seeing *.lwi files now, is that from the lsmash?

byteshare
3rd August 2019, 06:12
I'm using this custom script in the custom area:
video=video.ConvertBits(16).ConvertToStacked().SMDegrain(tr=3,thSAD=400,thSADC=150,refinemotion=false,contrasharp=true,plane=4,pel=2,prefilter=4,Truemotion=False,chroma=true,hpad=32,vpad=32,str=2,amp=1,lsb_in=true,lsb=true,lsb_out=true).ConvertFromStacked().ConvertBits(8).FineDehalo().FastLineDarkenMOD4().LSFmod()

The AVISynth Preview doesn't throw an error and it also works fine in AVSpmod.
On the Encoding server I either see it get to encoding of x265 and then crash (see below):
1|153422453|ENCODING_STARTED
2|153422750|ENCODING_PROGRESS=1 192.168.1.90:1000 -> ;CPU=13;RAM=40;DECODER=0;ENCODER=0;OTHER=13;ENCODING_PRIORITY=low;
3|153423078|ENCODING_PROGRESS=1 192.168.1.90:1000 -> ;CPU=13;RAM=40;DECODER=0;ENCODER=0;OTHER=13;ENCODING_PRIORITY=low;
4|153423421|ENCODING_PROGRESS=1 192.168.1.90:1000 -> ;CPU=13;RAM=40;DECODER=0;ENCODER=0;OTHER=13;ENCODING_PRIORITY=low;
5|153423890|ENCODING_PROGRESS=1 192.168.1.90:1000 -> ;CPU=18;RAM=40;DECODER=2;ENCODER=0;OTHER=16;ENCODING_PRIORITY=low;
6|153424265|ENCODING_PROGRESS=1 192.168.1.90:1000 -> ;CPU=18;RAM=40;DECODER=2;ENCODER=0;OTHER=16;ENCODING_PRIORITY=low;
7|153424625|ENCODING_PROGRESS=1 192.168.1.90:1000 -> ;CPU=18;RAM=40;DECODER=2;ENCODER=0;OTHER=16;ENCODING_PRIORITY=low;
8|153425125|ENCODING_PROGRESS=1 192.168.1.90:1000 -> ;CPU=28;RAM=40;DECODER=6;ENCODER=0;OTHER=22;ENCODING_PRIORITY=low;
9|153425500|ENCODING_PROGRESS=1 192.168.1.90:1000 -> ;CPU=28;RAM=40;DECODER=6;ENCODER=0;OTHER=22;ENCODING_PRIORITY=low;
10|153425859|ENCODING_PROGRESS=1 192.168.1.90:1000 -> ;CPU=28;RAM=40;DECODER=6;ENCODER=0;OTHER=22;ENCODING_PRIORITY=low;
11|153426359|ENCODING_PROGRESS=1 192.168.1.90:1000 -> ;CPU=27;RAM=40;DECODER=6;ENCODER=0;OTHER=21;ENCODING_PRIORITY=low;
12|153426734|ENCODING_PROGRESS=1 192.168.1.90:1000 -> ;CPU=27;RAM=40;DECODER=6;ENCODER=0;OTHER=21;ENCODING_PRIORITY=low;
13|153427093|ENCODING_PROGRESS=1 192.168.1.90:1000 -> ;CPU=27;RAM=40;DECODER=6;ENCODER=0;OTHER=21;ENCODING_PRIORITY=low;
14|153427609|ENCODING_PROGRESS=1 192.168.1.90:1000 -> ;CPU=22;RAM=42;DECODER=3;ENCODER=0;OTHER=19;ENCODING_PRIORITY=low;
15|153427984|ENCODING_PROGRESS=1 192.168.1.90:1000 -> ;CPU=22;RAM=42;DECODER=3;ENCODER=0;OTHER=19;ENCODING_PRIORITY=low;
16|153428375|ENCODING_PROGRESS=1 192.168.1.90:1000 -> ;CPU=22;RAM=42;DECODER=3;ENCODER=0;OTHER=19;ENCODING_PRIORITY=low;
17|153428921|ENCODING_PROGRESS=1 192.168.1.90:1000 -> ;CPU=27;RAM=46;DECODER=4;ENCODER=0;OTHER=23;ENCODING_PRIORITY=low;
18|153429328|ENCODING_PROGRESS=1 192.168.1.90:1000 -> ;CPU=27;RAM=46;DECODER=4;ENCODER=0;OTHER=23;ENCODING_PRIORITY=low;
19|153429765|ENCODING_PROGRESS=1 192.168.1.90:1000 -> ;CPU=27;RAM=46;DECODER=4;ENCODER=0;OTHER=23;ENCODING_PRIORITY=low;
20|153430390|ENCODING_PROGRESS=1 192.168.1.90:1000 -> ;CPU=72;RAM=47;DECODER=16;ENCODER=0;OTHER=56;ENCODING_PRIORITY=low;
21|153430718|ENCODING_PROGRESS=1 192.168.1.90:1000 -> ERROR;CPU=72;RAM=47;DECODER=16;ENCODER=0;OTHER=56;ENCODING_PRIORITY=low;
22|153430984|SERVER_IDLE
23|153431500|ENCODING_STARTED
Or I see an error in the main (not TCP Communication):
x265 [error]: unable to open input file <->

Even if I close the Encoding Server and restart that and no matter how many times the Encoding server retries a chunk it doesn't seem to work but if I close RipBot and try again it works?

Like I said it works but wasn't sure if there was something more "interesting" going on.

BLKMGK
3rd August 2019, 20:28
Any ideas on what is causing this (I'm using DE)?

Encoding started...
""\\XXXXX\Ripbot264temp\Tools\ffmpeg\bin\ffmpeg.exe" -loglevel panic -i "\\XXXXX\RipBot264temp\job883\Chunks\5.avs" -strict -1 -f yuv4mpegpipe - | "\\XXXXXXX\Ripbot264temp\tools\x265\x265_x64.exe" --seek 4 --colorprim bt709 --transfer bt709 --colormatrix bt709 --crf 18 --fps 24000/1001 --min-keyint 24 --keyint 240 --frames 1441 --sar 1:1 --preset slow --ctu 32 --y4m --pools "+" --output "\\XXXXXXX\RipBot264temp\job883\Chunks\5.265" -"
x265 [error]: unable to open input file <->


I have a number of Windows clients. For some reason TV shows NEVER show this error but movies often (but not always) do. It looks like a permissions issue but the share is wide open and if I type in the address on the client machine I get right in and appear to have Full Control as intended. I'm at wit's end and have been unable to find a correlation to understand why this doesn't happen on everything. I feel like it must be something silly but cannot find it and have been trying for at least a month.

This slow my encoding greatly to say the least when it occurs :( Help please!

P.S. When it occurs no client except the host is able to encode.

Still stuck on this! It appears to only occur on jobs for which I'm running AVISynth filtering. I'd really appreciate some input on what to look for as this filtering is really something I need, thanks!

Atak_Snajpera
3rd August 2019, 22:29
Show us your avisynth script.

BLKMGK
4th August 2019, 05:05
Show us your avisynth script.

I'm clicking on the AVIsynth button, selecting the DeNoise dropd-own, and then selecting the bottom-most filter. I then either leave it at zero or bump the level to 2 depending upon the video source. I also allow it to autocrop.

Nothing custom. It acts as if there's a file not being shared and it cannot access it. If I do videos onesy twosey it doesn't seem to happen as often but if I stack up a queue of say 9 of them I start running into this. I have managed to process videos with these filters enabled but when this occurs it always seems to be on filtered videos.

The share is set to allow "everybody" full control and I can use the filemanager on the problem systems to get to the source files but running the CMD in the job folder results in the same error, I'm not sure what it cannot access. I have a stack of about 4 videos doing it right now but I also just added some things that are much shorter and lower resolution - they will process just fine I'm sure. I'm now on 1.25 on most of my machines but my Win7 cannot run that encoder Server for some reason and is on an older one. A brand new updated Win10 machine is having this issue too though.

Atak_Snajpera
4th August 2019, 10:57
I'm clicking on the AVIsynth button, selecting the DeNoise dropd-own, and then selecting the bottom-most filter. I then either leave it at zero or bump the level to 2 depending upon the video source. I also allow it to autocrop.

Nothing custom. It acts as if there's a file not being shared and it cannot access it. If I do videos onesy twosey it doesn't seem to happen as often but if I stack up a queue of say 9 of them I start running into this. I have managed to process videos with these filters enabled but when this occurs it always seems to be on filtered videos.

The share is set to allow "everybody" full control and I can use the filemanager on the problem systems to get to the source files but running the CMD in the job folder results in the same error, I'm not sure what it cannot access. I have a stack of about 4 videos doing it right now but I also just added some things that are much shorter and lower resolution - they will process just fine I'm sure. I'm now on 1.25 on most of my machines but my Win7 cannot run that encoder Server for some reason and is on an older one. A brand new updated Win10 machine is having this issue too though.

It looks like you are using GPU filter KNLMeansCL for denoising. I suppose that filter is having some issues accessing your GPU. Perhaps device id is not set correctly. I'm just guessing now...

Run EncodingServer.exe on each machine (host as well) and take a screenshot.

BLKMGK
4th August 2019, 17:29
Host both idle and encoding at 5ghz

https://i.postimg.cc/VL4cdXD5/host-encoding.jpg
https://i.postimg.cc/fbf7NTw4/host-idle.jpg

Second machine - Ryzen 3900X and yes it's blowing away the other machine when it encodes! :-O

https://i.postimg.cc/J0MhZJv0/ryzen.png
https://i.postimg.cc/7hHxf4JT/ryzen2.png
https://i.postimg.cc/g0hRKVSH/ryzen3.png

I hadn't realized this leveraged the GPU and it hadn't been set on the Ryzen machine or my others that I've not posted so as not to flood the site with images. I did set the GPU on the second box (it's crappy but usually headless) but same error currently. If the GPU is the issue, is there a CPU based filter that's as good? IMO this one removes film grain and some glitches amazingly well! It may be that my GPU in the second machine is not good enough perhaps? I've checked another machine with just an Intel GPU and no joy there either.

Please let me know if I can provide anything else to figure this one out, I really appreciate the assistance.:thanks: I'd be happy to switch to a CPU based filter if I can maintain quality.

I'll try hosting an encode on my Ryzen box too to see if it encounters this problem but cannot do it this moment.

Atak_Snajpera
4th August 2019, 18:01
If you are going to use KNLMeansCL in DE mode then you must:
1) have decent gpus in all PC's. GeForce 210 is just a crap GPU (Supports up to OpenCL 1.1 [knlmeansCL requires 1.2] and only two compute units!).
2) manually set device id in encoding server if you have more than one GPU. One of your machines has Intel GPU and GeForce 1070 for example.
This will tell encodingserver to use GeForce 1070 (faster)
EncodingServer.exe /knlmeanscl-opencl-device-id 1

In your case It might be a good idea to run one server using Intel GPU and other GeForce 1070 .
EncodingServer.exe /knlmeanscl-opencl-device-id 0
EncodingServer.exe /knlmeanscl-opencl-device-id 1

This way you will be using literally everything what can compute ;) CPU+iGPU+dGPU

If you want you can also try running KNLMeansCL on CPU but be warned it will be veeeeeeeerrrrrrryyyyy slooooooooow.
EncodingServer.exe /knlmeanscl-opencl-device-type CPU

BLKMGK
4th August 2019, 20:11
If you are going to use KNLMeansCL in DE mode then you must:
1) have decent gpus in all PC's. GeForce 210 is just a crap GPU (Supports up to OpenCL 1.1 [knlmeansCL requires 1.2] and only two compute units!).
2) manually set device id in encoding server if you have more than one GPU. One of your machines has Intel GPU and GeForce 1070 for example.
This will tell encodingserver to use GeForce 1070 (faster)
EncodingServer.exe /knlmeanscl-opencl-device-id 1

In your case It might be a good idea to run one server using Intel GPU and other GeForce 1070 .
EncodingServer.exe /knlmeanscl-opencl-device-id 0
EncodingServer.exe /knlmeanscl-opencl-device-id 1

This way you will be using literally everything what can compute ;) CPU+iGPU+dGPU

If you want you can also try running KNLMeansCL on CPU but be warned it will be veeeeeeeerrrrrrryyyyy slooooooooow.
EncodingServer.exe /knlmeanscl-opencl-device-type CPU

Thank you, that's a HUGE help! What's the minimum GPU you'd recommend? I assume a 1050 would work? I have one of those in a Linux machine for realtime streaming, the 210 was bought simply to get me video on the Ryzen box but I'll upgrade it. I wish I could interleave jobs and send the ones that don't require GPU to just those machines lol. The Ryzen box does require two encoding servers to get full utilization BTW, it's close to triple the speed of my 8700K :eek: I'll see how it handles the filter on the CPU :devil:

P.S. what are these *.lwi files now showing up with the new client? Seem to contain data about the various videos.

Atak_Snajpera
4th August 2019, 20:19
*.lwi is an index file for video file. It is required to have frame accurate seeking.

BLKMGK
4th August 2019, 22:01
Must require something other than OpenCL 1.2, I've got a GTX 680 that claims to support OpenCL 1.2 with a whopping 4 compute units that also hits this error - argh! Looks like I might need more than one new video card! :O

Atak_Snajpera
5th August 2019, 10:35
Try with 1050

byteshare
5th August 2019, 16:58
*.lwi is an index file for video file. It is required to have frame accurate seeking.
Thank you for clarifying that.

userx
5th August 2019, 18:58
Hello,
For some time the first pass in 2-pass mode won't start at my remote machine. 2nd pass works like expected. If I start a job on commandline manually I get following output:
PS Microsoft.PowerShell.Core\FileSystem::\\USERX-MASTER\RipBot264temp\job5\Chunks> .\39.cmd
"\\HOST\RipBot264temp\job5\Chunks"
CMD.EXE wurde mit dem oben angegebenen Pfad als aktuellem Verzeichnis gestartet.
UNC-Pfade werden nicht unterstützt.
Stattdessen wird das Windows-Verzeichnis als aktuelles Verzeichnis gesetzt.
""\\HOST\Ripbot264temp\Tools\ffmpeg\bin\ffmpeg.exe" -loglevel panic -i "\\HOST\RipBot264temp\job5\Chunks\39.avs" -strict -1 -f yuv4mpegpipe - | "\\HOST\Ripbot264temp\tools\x264\x264_x64.exe" --seek 48 --colorprim bt709 --transfer bt709 --colormatrix bt709 --opencl --opencl-device 0 --opencl-clbin "C:\Users\UserX\AppData\Local\Temp\x264_lookahead.clbin" --pass 1 --bitrate 3000 --stats "\\HOST\RipBot264temp\job5\Chunks\39.stats" --fps 25 --force-cfr --min-keyint 25 --keyint 250 --frames 1488 --sar 1:1 --level 4.1 --aud --nal-hrd vbr --vbv-bufsize 25000 --vbv-maxrate 25000 --b-pyramid none --ref 5 --stdin y4m --output NUL -"
y4m [info]: 1280x720p 1:1 @ 25/1 fps (cfr)
x264 [info]: using SAR=1/1
x264 [info]: using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX
x264 [info]: OpenCL acceleration enabled with Advanced Micro Devices, Inc. Capeverde (SI)
x264 [info]: profile Main, level 4.1, 4:2:0, 8-bit
A s s e r t i o n f a i l e d !

P r o g r a m : \ \ H O S T \ R i p b o t 2 6 4 t e m p \ t o o l s \ x 2 6 4 \ x 2 6 4 _ x 6 4 . e x e
F i l e : e n c o d e r / s l i c e t y p e . c , L i n e 1 9 8 9

E x p r e s s i o n : c o s t > = 0


Can someone give me a hint how i can solve this problem?
Thanks

Atak_Snajpera
5th August 2019, 19:38
Are you sure you are using latest version?

I'm asking because this looks odd
--opencl-clbin "C:\Users\UserX\AppData\Local\Temp\x264_lookahead.clbin"
It should be with digit related with server instance
--opencl-clbin "C:\Users\UserX\AppData\Local\Temp\x264_lookahead_1.clbin"

userx
6th August 2019, 05:50
Are you sure you are using latest version?

I'm asking because this looks odd

It should be with digit related with server instance

yes, it's the latest version 1.25
in ...\AppData\Local\Temp\ i found
x264_lookahead.clbin
x264_lookahead_1.clbin
x264_lookahead_2.clbin
x264_lookahead_3.clbin
All with file changed date from yesterday

Does it matter if i start Ripbot264.exe on remote machine which start EncodingServer instances automatically compared to starting EncodingServer instances alone?

Atak_Snajpera
6th August 2019, 14:02
Can you upload all .cmd files from Chunks folder?
Are you using multiple servers on the same machine? If yes then does this problem also occur if you use only one?

brumsky
6th August 2019, 17:50
Hey Atak_Snajpera,

Would it be possible to configure a way to use analysis save and load while doing distributed encoding? Thinking through it you'd have to code a way to save a separate analysis file for each chuck and configure a way to reuse them.

thanks for all your hard work.

Atak_Snajpera
6th August 2019, 18:16
But why would you need that?

brumsky
6th August 2019, 18:55
But why would you need that?

When I'm trying to find the ideal bitrate or if I don't like the quality of the encode. Really, just about any time you have to redo the encode. Some settings can be tweaked like subme or aq-mode. I have encode that have a dark scene that don't look good and I'll change aq-mode to 3 and it looks a lot better.

I know other settings like --tu-inter can't be changed otherwise it'll affect the data stored in the analysis file.

Just a thought, if it's to much work I understand.

byteshare
7th August 2019, 09:01
Two questions about the LWI files:
1. Once they get made if you keep the file and later add a video (new job) that has a *.lwi file will it be reused or does a new one get generated?
2. Is it possible to have the .lwi files written to the job folder?
--So that clean up is easier and to save a little bit of time in the cases (like myself) when the RipBot temp folder is on a different drive, such as video on a physical drive and the temp folder on a SSD.

Atak_Snajpera
7th August 2019, 09:59
Unfortunatelly lsmash plugin does not have an option to select folder for index file. This annoys me as well...

slalom
7th August 2019, 10:57
On the latest version, some jobs after creating chunks, don't start

byteshare
7th August 2019, 16:52
Unfortunatelly lsmash plugin does not have an option to select folder for index file. This annoys me as well...
Thank you for letting me know, and glad I'm not the only one annoyed, LOL

On the latest version, some jobs after creating chunks, don't start
Does the encoding server start and stop?
Or do the chunks get made and the chunk list shows and then nothing happens after that?
Any logs?

I had an issue with starting a job, checking a few chunks but not liking the output so I changed the job, but then the first few chunks weren't over written and the job would finish but then started all over again. It was strange. I manually (right click job > clear) cleared the DE progress and it worked. So, anything like that?

userx
7th August 2019, 19:10
Can you upload all .cmd files from Chunks folder?
Are you using multiple servers on the same machine? If yes then does this problem also occur if you use only one?

Chunks_cmds (https://www.dropbox.com/s/ox3a5lbs698exbe/Chunks.rar?dl=0)

I usually using multiple servers but for testing i started an single instance which led to the same result.

output for this job on remote machine:
Y:\job6\Chunks>1.cmd
""\\USERX-MASTER\Ripbot264temp\Tools\ffmpeg\bin\ffmpeg.exe" -loglevel panic -i "\\USERX-MASTER\RipBot264temp\job6\Chunks\1.avs" -strict -1 -f yuv4mpegpipe - | "\\USERX-MASTER\Ripbot264temp\tools\x264\x264_x64.exe" --seek 0 --colorprim bt709 --transfer bt709 --colormatrix bt709 --opencl --opencl-device 0 --opencl-clbin "C:\Users\UserX\AppData\Local\Temp\x264_lookahead_2.clbin" --pass 1 --bitrate 3000 --stats "\\USERX-MASTER\RipBot264temp\job6\Chunks\1.stats" --fps 25 --force-cfr --min-keyint 25 --keyint 250 --frames 1500 --sar 1:1 --level 4.1 --aud --nal-hrd vbr --vbv-bufsize 25000 --vbv-maxrate 25000 --b-pyramid none --ref 5 --stdin y4m --output NUL -"
y4m [info]: 1280x720p 1:1 @ 25/1 fps (cfr)
x264 [info]: using SAR=1/1
x264 [info]: using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX
x264 [info]: OpenCL acceleration enabled with Advanced Micro Devices, Inc. Capeverde (SI)
x264 [info]: profile Main, level 4.1, 4:2:0, 8-bit
A s s e r t i o n f a i l e d !

P r o g r a m : \ \ U S E R X - M A S T E R \ R i p b o t 2 6 4 t e m p \ t o o l s \ x 2 6 4 \ x 2 6 4 _ x 6 4 . e x e
F i l e : e n c o d e r / s l i c e t y p e . c , L i n e 1 9 8 9

E x p r e s s i o n : c o s t > = 0

LigH
8th August 2019, 08:13
The location of the error and its description appear to me like a miscalculation in the x264 encoder; I wonder if the reason may be the OpenCL acceleration processing wrong data, maybe due to task switching... bold guess. :o
__

Unfortunatelly lsmash plugin does not have an option to select folder for index file. This annoys me as well...

HolyWu introduced a 'cachefile' parameter. (https://forum.doom9.org/showthread.php?p=1881332#post1881332)

slalom
8th August 2019, 08:16
Does the encoding server start and stop?
Or do the chunks get made and the chunk list shows and then nothing happens after that?
Any logs?

I had an issue with starting a job, checking a few chunks but not liking the output so I changed the job, but then the first few chunks weren't over written and the job would finish but then started all over again. It was strange. I manually (right click job > clear) cleared the DE progress and it worked. So, anything like that?
Servers are off. I can start them but nothing happens
Yes
Show log doesn't show anything

Tried that, even removed the job and added it again

Atak_Snajpera
8th August 2019, 08:39
The location of the error and its description appear to me like a miscalculation in the x264 encoder; I wonder if the reason may be the OpenCL acceleration processing wrong data, maybe due to task switching... bold guess. :o
__



HolyWu introduced a 'cachefile' parameter. (https://forum.doom9.org/showthread.php?p=1881332#post1881332)
I think it Has to be some driver issue. Capeverde is a first generation of gcn (HD 7000 series) with only 1gib of vram.

duffbeer
8th August 2019, 09:25
Can I ask why lsmash is now the default decoder? What is the advantage?

I only ask because preparing the jobs now seems much slower. Cropping takes much longer and it seems to take too long each time I refresh the preview frame (to find a bright coloured frame for cropping accurately). Is this due to lsmash?

Atak_Snajpera
8th August 2019, 10:02
Can I ask why lsmash is now the default decoder? What is the advantage?

I only ask because preparing the jobs now seems much slower. Cropping takes much longer and it seems to take too long each time I refresh the preview frame (to find a bright coloured frame for cropping accurately). Is this due to lsmash?

Because of this
https://forum.doom9.org/showthread.php?p=1879893#post1879893

lsmash also has better support for interlaced AVC (does not duplicate frame count).

duffbeer
8th August 2019, 10:25
Because of this
https://forum.doom9.org/showthread.php?p=1879893#post1879893

lsmash also has better support for interlaced AVC (does not duplicate frame count).

OK. Seems odd as I never had any problems with the previous decoder.

Does this change explain the speed problems I mentioned?
I may have to go back to 1.24 as the new version is much slower now.

Atak_Snajpera
8th August 2019, 11:22
Lsmash tries to be more accurate while seeking.

SKPN
8th August 2019, 22:34
Is there a way to set the aspect ratio separate from the resolution?

rayers1060
9th August 2019, 05:27
Hi, is is possible to modify the encoding server to work on a separate network?. specifically I have a few idle pc's that are offsite and would like to utilize them for encoding. We dont want to create a VPN. Is this a request that could be in the future?. RipBot264 works great with the few pc's that we have on the same Lan ??, a few more would definitely help

slalom
9th August 2019, 13:17
Is there a way to set the aspect ratio separate from the resolution?
Have you tried custom setting for resolution?

SKPN
9th August 2019, 13:20
Have you tried custom setting for resolution?

Yea, but there is no option to set the aspect ratio when doing that.

Atak_Snajpera
9th August 2019, 14:20
Yea, but there is no option to set the aspect ratio when doing that.

You can specify aspect ratio in encoding profile. Just add --sar with proper aspect ratio

--sar <width:height|int> Sample Aspect Ratio, the ratio of width to height of an individual pixel.
Choose from 0=undef, 1=1:1("square"), 2=12:11, 3=10:11, 4=16:11,
5=40:33, 6=24:11, 7=20:11, 8=32:11, 9=80:33, 10=18:11, 11=15:11,
12=64:33, 13=160:99, 14=4:3, 15=3:2, 16=2:1 or custom ratio of <int:int>. Default 0

byteshare
9th August 2019, 16:24
Hi, is is possible to modify the encoding server to work on a separate network?. specifically I have a few idle pc's that are offsite and would like to utilize them for encoding. We dont want to create a VPN. Is this a request that could be in the future?. RipBot264 works great with the few pc's that we have on the same Lan ??, a few more would definitely help
You can do it with a VPN for sure, but if you don't want a VPN have you tried setting public IP addresses for the servers?
That would seem like a security risk IMO.