Log in

View Full Version : RipBot264 v1.18.3 - Simple and easy to use GUI -> IPOD . PSP . CONSOLES . BLURAY


Pages : 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 [389] 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429

GZZ
26th January 2022, 22:22
Did you end up figuring out the crop function? Is it needed or not. I found one github issue that crop was needed, but reading that thread you provided, it seems it is not.

Got this answer: https://forum.doom9.org/showthread.php?p=1962181#post1962181


Dont know how to read it. But I think doing no crop on DV track and only crop reencode should be fine. Not sure what crop then is used for.

Ryushin
4th February 2022, 14:13
Hi Atak,

The script from https://forum.doom9.org/showthread.php?t=183479 works pretty well. At this point it looks fairly straightforward to add this capability to RB.

I know RB is your creation and you have been working on it for almost 15 years. Incredible really. I can understand if you are burnt out working on RB and have other things you would rather do. Can you give me your thoughts or why or why not you don't want to open source RB and put it up on Git.

gabbett1
11th February 2022, 12:46
When you said that if you change the IP address by just 1 number in either direction that the problem goes away, then there must be another device using that address (it might be hidden).

Maybe change ALL your IP address's, and see if that does anything.

Or you can try what is suggested in the post's just before this one..Safe Mode, some app running in the background causing havoc.

And if Atak isn't going to chime in, that's about all I can suggest.

Happy New Year.
I don't recall ever saying that if I go up 1 or down 1 on the IP and the problem goes away...

guest
12th February 2022, 00:59
I don't recall ever saying that if I go up 1 or down 1 on the IP and the problem goes away...

Hi gabbett1,

So I must have mis-interpreted this comment :-

One, if I enter the IP address of the host server, it will blank out the options for that server as if the IP is not allowed. If I change the IP by one digit in any direction, those options return. Are we no longer allowed to use the host computer as one of the distributed encoding processors?

So have you managed to get things working ???, it's been a while.

gabbett1
12th February 2022, 14:32
Hi gabbett1,

So I must have mis-interpreted this comment :-



So have you managed to get things working ???, it's been a while.

Ah, yes. All I was saying there is that the computer that is the host can no longer be used as also an encoder anymore apparently. The buttons will literally gray out for distributed encoding if I use the IP of the host computer (but only in the box for that IP, not all of the others). Now, as far as other computers to encode with, I cannot get any of them to connect.

Hopefully all that makes sense.

I don't have any IP conflicts.

No, it's still not working. I resorted back to not using distributed encoding for now. Then life happened... Sorry for the delay.

guest
13th February 2022, 04:17
No, it's still not working. I resorted back to not using distributed encoding for now. Then life happened... Sorry for the delay.

Hi, well, that's NOT good, the best part of RipBot IS the Distributed Encoding, if you can't get that to work you might as well be using Handbrake !!!!

There must be some simple solution, but it's almost impossible to diagnose using PM's with no screenshots or more detailed explanation.

I quite often have issue's, but you've just got to work thru it, 'til it works.

This is an interesting comment :- Then life happened...

Cheers

slalom
16th February 2022, 21:53
Ah, yes. All I was saying there is that the computer that is the host can no longer be used as also an encoder anymore apparently. The buttons will literally gray out for distributed encoding if I use the IP of the host computer (but only in the box for that IP, not all of the others). Now, as far as other computers to encode with, I cannot get any of them to connect.

Hopefully all that makes sense.

I don't have any IP conflicts.

No, it's still not working. I resorted back to not using distributed encoding for now. Then life happened... Sorry for the delay.
Maybe some application is blocking Encoding Server to start

guest
17th February 2022, 03:03
Maybe some application is blocking Encoding Server to start

Hi slalom,

They DID mention that they're running nVidia, but does "clean" setup.

I recall that certain Logitech app's play havoc, too.

Probably need way more info.

To do without RipBot's best feature for so long is BS.

It's certainly got nothing to do with RB updates, there haven't been any :(

guest
28th February 2022, 03:44
I may not have posted anything here in 5 months, but I have certainly kept track of any activity.

I have to say that I am very disappointed with Atak's absence, and lack of updates, these MANY months...

Anyway, I have been busy with updating & improving RipBot, trying to keep it current, and refreshed.

My last build was downloaded a LOT, but I pulled the plug after not getting any feedback, either positive or negative, but I won't pull it this time....

So this build is just the "Tool's" folder, so just as before, rename the original folder, and just copy & paste this in, and it's ready to go.

I strongly suggest that you go to the Avisynth folder under Tools, and run the 2 .cmd's... "Install dlls.bat" & "Install.bat"

Many new filters & options all available from the "Custom Script" drop down list.

The latest builds of all the main components, Avisynth, FFMPEG, x264, x265, etc, etc.

Some important "instruction's" are included, but maybe a little out-dated.

So go get it....

https://forum.doom9.org/showthread.php?p=1968792#post1968792

guest
1st March 2022, 01:46
I may not have posted anything here in 5 months, but I have certainly kept track of any activity.

I have to say that I am very disappointed with Atak's absence, and lack of updates, these MANY months...

Anyway, I have been busy with updating & improving RipBot, trying to keep it current, and refreshed.

My last build was downloaded a LOT, but I pulled the plug after not getting any feedback, either positive or negative, but I won't pull it this time....

So this build is just the "Tool's" folder, so just as before, rename the original folder, and just copy & paste this in, and it's ready to go.

I strongly suggest that you go to the Avisynth folder under Tools, and run the 2 .cmd's... "Install dlls.bat" & "Install.bat"

Many new filters & options all available from the "Custom Script" drop down list.

The latest builds of all the main components, Avisynth, FFMPEG, x264, x265, etc, etc.

Some important "instruction's" are included, but maybe a little out-dated.

So go it....

https://www.mediafire.com/file/6n3it679bleta6g/RipBot264v1.26.1+(28-02-22).7z/file

Great to see you make a return visit, this is awesome...thankyou :)

MCFish
2nd March 2022, 12:24
.........
https://www.mediafire.com/file/6n3it679bleta6g/RipBot264v1.26.1+(28-02-22).7z/file

Thanks

mcjordan
5th March 2022, 16:00
Thank you so much!

rlev11
7th March 2022, 20:05
I have been using ripbot for a while now to convert everything I have into 10bit x265 to load on my Plex server and have noticed something I can't figure out as I now work through doing stuff in 4K.

I have an encoding farm that consists of 3 5950x, 1 3950x, 2 3900x, 1 i9-10850k, 1 3700x, and a 5700g. Whenever I have done 480p,720p,1080p and also 4k movies in 1:2.35 aspect, the fps for each server scales like I would expect them to. the 16cores are faster than the 12, 12 faster than 10, 10 faster than the 8 core and the differences are what the additional cores should be, except when I encode 4k full frame either 1.85 or 1.78 aspect ratios.

When I do the full frame 4k, the performance drops like a rock on the 16 core 5950 and 3950 servers to the tune of 50 to 60 percent, where the 12 core 3900x machines are much faster fps compared to the 16 core. The 16 core servers are even slower on average than the two 8 core servers.

When looking at the encoding server utilization bar, on the 3900x, the green decoder bar is a constant 51-52 percent. On the 5950, the decoder bar bounces constantly between 50 and 80 percent (not sure if really means anything)

Anybody have any idea on why this is happening??

guest
17th March 2022, 05:44
Hi Atak,

I'm clutching at straws here, you haven't been posting much these days, but I noticed you posted a comment on another Forum a couple of days ago.

I have been trying to get AWB to work successfully with RipBot, and there are quite a few issues.

This is the script (but it's only for video)

#Custom
LoadPlugin("C:\RipBot264v1.26.1\Tools\AviSynth plugins\ffms\ffms_latest\x64\ffms2.dll")
LoadPlugin("C:\RipBot264v1.26.1\Tools\AviSynth plugins\GRunT\grunt.dll")
LoadPlugin("C:\RipBot264v1.26.1\Tools\AviSynth plugins\RgbAdapt\RgbAdapt_x64.dll")
LoadPlugin("C:\RipBot264v1.26.1\Tools\AviSynth plugins\RT_Stats\RT_Stats_x64.dll")
Import("C:\RipBot264v1.26.1\Tools\AviSynth plugins\scripts\extras\RGBAdapt_Awb_Process.avs")
video=RGBAdapt_AWB_Process(video)

And this one is suppose to do the audio as well :-

#Custom
LoadPlugin("D:\AWB\Lsmash\LSMASHSource.dll")
LoadPlugin("D:\AWB\GRunT\grunt.dll")
LoadPlugin("D:\AWB\RgbAdapt\RgbAdapt_x64.dll")
LoadPlugin("D:\AWB\RT_Stats\RT_Stats_x64.dll")
Import("D:\AWB\RGBAdapt_Awb_Process.avs")
LWLibavVideoSource("D:\AWB\nobody.mkv")
va=last
aa=LWLibavAudioSource("D:\AWB\nobody.mkv")
AudioDub(va,aa)
AWB_Func()

And one more option, if the above script is directly added to a new Job (instead of a video), it doesn't seem to use Distributed Encoding :(

And adding the "audio" script, it stalls at Demuxing, and that's it.

https://forum.doom9.org/showthread.php?t=174411&page=7

If you can have a look at this, that would be awesome, but I'll understand if you don't.

Regards

Atak_Snajpera
17th March 2022, 14:36
LWLibavVideoSource("D:\AWB\nobody.mkv")
va=last
aa=LWLibavAudioSource("D:\AWB\nobody.mkv")
AudioDub(va,aa)
AWB_Func()

Why do you add additional video source?

guest
17th March 2022, 14:53
LWLibavVideoSource("D:\AWB\nobody.mkv")
va=last
aa=LWLibavAudioSource("D:\AWB\nobody.mkv")
AudioDub(va,aa)
AWB_Func()

Why do you add additional video source?

It's actually a script I was given to extract the audio from that .mkv file.

But it didn't work, just stalled during demuxing (but I'd already said that)

If I only added this :-LoadPlugin("C:\RipBot264v1.26.1\Tools\AviSynth plugins\ffms\ffms_latest\x64\ffms2.dll")
LoadPlugin("C:\RipBot264v1.26.1\Tools\AviSynth plugins\GRunT\grunt.dll")
LoadPlugin("C:\RipBot264v1.26.1\Tools\AviSynth plugins\RgbAdapt\RgbAdapt_x64.dll")
LoadPlugin("C:\RipBot264v1.26.1\Tools\AviSynth plugins\RT_Stats\RT_Stats_x64.dll")
Import("C:\RipBot264v1.26.1\Tools\AviSynth plugins\scripts\extras\RGBAdapt_Awb_Process.avs")
video=RGBAdapt_AWB_Process(video)

There was no audio track, so that had to be demuxed, and added separately, once the video script had loaded.

Sorry there was an Lsmash script & an FFMS script.

But if this was loaded as a "Custom" file the script didn't alter the white balance, and the MPC-HC preview was just a flashing, flickering mess.

This is a sample of the MPC-HC preview (different source) :-

https://www.mediafire.com/file/rskh22ej7jwbxi8/VID_20220304_130802.mkv/file

LigH
18th March 2022, 08:54
AviSynth always decodes. You can't use AviSynth to demultiplex an audio stream preserving its encoded format. If you want to do that, you would need an external software like mkvextract or ffmpeg.

What you are doing in your script is loading and decoding the audio stream from possibly the same source file as the video, which should in general work well, except for corrupt source files. Here you could try to remultiplex it using mkvtoolnix or ffmpeg and see if they report an error. In case of audio streams, it may be useful to add a stream_index parameter to LwLibavAudioSource() to select a specific audio stream by number. If you use FFMPEGSource2() to load video and audio to one clip, note that its default value for atrack is -2, means to ignore audio streams.

Indexing an uncompressed or lossless audio format can take a long while and produce a huge index file. Do not get afraid when the process "stalls", this might be necessary when caching and indexing is enabled (by default it is). Once the index file is written, the next attempts to open the same script will be much faster.

guest
18th March 2022, 13:59
AviSynth always decodes. You can't use AviSynth to demultiplex an audio stream preserving its encoded format. If you want to do that, you would need an external software like mkvextract or ffmpeg.

What you are doing in your script is loading and decoding the audio stream from possibly the same source file as the video, which should in general work well, except for corrupt source files. Here you could try to remultiplex it using mkvtoolnix or ffmpeg and see if they report an error. In case of audio streams, it may be useful to add a stream_index parameter to LwLibavAudioSource() to select a specific audio stream by number. If you use FFMPEGSource2() to load video and audio to one clip, note that its default value for atrack is -2, means to ignore audio streams.

Indexing an uncompressed or lossless audio format can take a long while and produce a huge index file. Do not get afraid when the process "stalls", this might be necessary when caching and indexing is enabled (by default it is). Once the index file is written, the next attempts to open the same script will be much faster.

Thanks for your suggestions & advice :)

Yeah, the "video" section of the script works pretty well, but due to the way it has to be imported into RipBot, DE isn't initiated.

As for the "audio" section of the script, was I think, an afterthought suggestion from several different ppl.

I think the best way would be just to demux the video, and add the audio after the script has loaded.

Atak_Snajpera
18th March 2022, 15:03
Can't you just add video file normally instead of messing with script itself?

guest
19th March 2022, 02:22
Can't you just add video file normally instead of messing with script itself?

I thought I had explained why...

If you add a video file, then add this script, as a Custom script, the MPC-HC preview is crap, it flashes & flickers....and if you do do an encode, it turns out even worse :(

BUT, if you set up that script to load the movie you want to process, then the preview plays as it should, and the encode is good.

But there's NO audio, and Distributed Encoding isn't envoked, so it's just a single basic encode, which would take a LOT longer to process, especially if it was 4K, x265.

On the AWB Forum, there has been 3 ppl state that they have downloaded RipBot, ran the script, and it's good, BUT none of these 3 use RipBot, and probably think that if it works for them in basic encoding mode, then that's good enough to prove I don't know what I'm talking about...I'm sure if they knew more about RipBot, they would quickly realise that it doesn't work properly.

So that's why I posted on this forum.

I was hoping to call on your expertise, and figure out a way to get this to work, the "normal" way, as a Custom script.

If not, then it's the other procedure.

guest
27th March 2022, 07:29
Well, it's taken just under a month to reach a substantial 100 downloads of "my" updated build of RipBot, so I hope it's working well for all that have tried it.

I will endeavour to post an update in the next week or so, there has been several significant updates to the components that are used in RipBot.

So have at it, and keep watching :)

https://forum.doom9.org/showthread.php?p=1964827#post1964827

guest
27th March 2022, 07:45
I have been using ripbot for a while now to convert everything I have into 10bit x265 to load on my Plex server and have noticed something I can't figure out as I now work through doing stuff in 4K.

I have an encoding farm that consists of 3 5950x, 1 3950x, 2 3900x, 1 i9-10850k, 1 3700x, and a 5700g. Whenever I have done 480p,720p,1080p and also 4k movies in 1:2.35 aspect, the fps for each server scales like I would expect them to. the 16cores are faster than the 12, 12 faster than 10, 10 faster than the 8 core and the differences are what the additional cores should be, except when I encode 4k full frame either 1.85 or 1.78 aspect ratios.

When I do the full frame 4k, the performance drops like a rock on the 16 core 5950 and 3950 servers to the tune of 50 to 60 percent, where the 12 core 3900x machines are much faster fps compared to the 16 core. The 16 core servers are even slower on average than the two 8 core servers.

When looking at the encoding server utilization bar, on the 3900x, the green decoder bar is a constant 51-52 percent. On the 5950, the decoder bar bounces constantly between 50 and 80 percent (not sure if really means anything)

Anybody have any idea on why this is happening??

Hi rlev11, tbh I only just now saw your post....

That is one hell of a "farm" you've got going there !!!

OK, that IS strange behaviour, for sure, so you've obviously got Distributed Encoding sussed & working, so how many server ports do you enable per pc ???, maybe you need to "load" the 16 cores a bit more to get close to 100%.

I'm curious to know if you're using a "genuine" build of RipBot, or are you using the "Pauly Dunne" build ???

There is a possibility that the "older" Tool's in RipBot might be slowing you down....(just thinking out loud).

I have several Ryzen's, and they need to be "fed", but again, tbh, I haven't done much 4K encoding of late.

Might be a case of trial & error, 'til you get the results you should be getting !!!

Cheers

rlev11
27th March 2022, 19:42
Hi rlev11, tbh I only just now saw your post....

That is one hell of a "farm" you've got going there !!!

OK, that IS strange behaviour, for sure, so you've obviously got Distributed Encoding sussed & working, so how many server ports do you enable per pc ???, maybe you need to "load" the 16 cores a bit more to get close to 100%.

I'm curious to know if you're using a "genuine" build of RipBot, or are you using the "Pauly Dunne" build ???

There is a possibility that the "older" Tool's in RipBot might be slowing you down....(just thinking out loud).

I have several Ryzen's, and they need to be "fed", but again, tbh, I haven't done much 4K encoding of late.

Might be a case of trial & error, 'til you get the results you should be getting !!!

Cheers

Thanks for the reply. I am running 1.26.1 on all the machines. I had tried in the past running more than 1 port, but found that the combined fps for 2 ports was even lower than what 1 port was showing.

Since I posted that original message, I have found a "fix" so to speak. When I start up the 16 core machines in the startup script I added /affinity FFFCFFFC to the command line. This stops Ripbot from using one of the cores on CCD0 and CCD1. I did that to balance out the thermals on the die (seemed logical).
Once I did that my fps jumped back up to where I would expect them to be on the 16 core(now 14 cores used). Where before the 16 core would show 2-3 fps compared to the 3900x around 4 fps, the 5950x's are now in the 5-7 fps. Disabling the 2 cores didn't seem to make much of a difference either in the lower resolution stuff so I just leave them running 14 core for Ripbot all the time.

Still not sure what is being flooded that kills the performance only on full frame 4k, but for now I am happy. Only thing that is a little strange is since I did this I see a stalled encoding server a little bit more often, but the server resets and continues on without messing up the entire encode. Full frame 4k in 10bit X265 with some Mdegrain3 for minor cleanup ends up averaging around 40fps and a movie can be done in under an hour, works for me...

rlev11
28th March 2022, 16:30
Hi, well, that IS strange behaviour alright, and it's only happening on the 5950's & the 3950 ??

So, I'm curious, what motherboards are you running, are they all the same ??, are you running the latest BIOS & AMD Chipset drivers ??

Also, where did you come up with the /affinity FFFCFFFC "fix" ??, I might have to remember that..lol.

And you say full frame @ 40fps, in under an hour, what other settings are you using ??

I know you have some serious encoding "horse power" there, and that's some pretty impressive encoding times.

And this, "....I see a stalled encoding server a little bit more often....", it seems to be a "thing" with RipBot, unfortunately.

Yes, only on the 3950 and 5950's. the 12,10 and 8 core machines all behave themselves and the fps are what I would expect. From 480p all the way thru full frame 4k they scale out with similar percentage differences in fps. The same with the 16 cores EXCEPT once I hit full frame 4k using all 16 cores.

the 16 cores are all running on a mixture of gigabyte and asus x570 motherboards with the latest bios installed and also windows 11 with the latest amd drivers. All are running 32 gig ddr3200 memory in XMP mode. The rest are running B450 or B550 chipsets, latest bios and drivers, and the lone intel is running on a Z490.

When I saw and researched the /affinity switch for the encoding server command line, my first thought was OK, lets knock them down to 12 core 3900x levels and see what happens. They immediately jumped to 3900x performance or just a tad over. so I added in 2 more cores to their current level of running 14 cores for ripbot. I used this site to give me the hex code to use:
https://bitsum.com/tools/cpu-affinity-calculator/

I start each encodong server with this script:
encodingserver /minimize /restart-if-no-progress /affinity FFFCFFFC /priority normal

As far as settings in ripbot using MA10-default,default profile, Mode=CQ, CRF=18. Audio I usually knock dts down to ac3 or just copy the stream if it is already in ac3 or aac. This way my Plex server can play everything in direct stream with no encoding. In avisynth tab I just do a autodetect crop, then a cpu denoise of mdegrain3 and do somewhere between 100 and 400 depending on the noise level (grain noise just bugs me for some reason). I'll also render any forced subs if they exist. Helps to throw 212 threads at an encode. The under an hour was for a 1 hour 4k TV show I've been doing lately

guest
11th April 2022, 02:42
Has anyone contemplated, or is using, an nVidia Tesla GPU card(s) with RipBot for OpenCL & CUDA filters ???

Glarioo
18th April 2022, 07:33
In this small package, there is :-

the lastest L-Smash, MKVToolNix, and another de-interlacing filter. (CQTGMC, thanks to Ceppo)

https://www.mediafire.com/file/51e0k76pdfyozzm/Tools+(13-04-22).7z/file

Once the 7z is unpacked, it should be plain to see where they need to be copied to, and just overwrite the existing folders / files.

Cheers

Thank you for the update, Pauly. Much appreciated.

jfisher1740
19th April 2022, 02:47
In this small package, there is :-

the lastest L-Smash, MKVToolNix, and another de-interlacing filter. (CQTGMC, thanks to Ceppo)

https://www.mediafire.com/file/51e0k76pdfyozzm/Tools+(13-04-22).7z/file

Once the 7z is unpacked, it should be plain to see where they need to be copied to, and just overwrite the existing folders / files.

Cheers

Big thank you Pauly! I took about a 9 month hiatus from RipBot and was surprised that it didn't update when I launched it earlier this week. Just installed all your updates and it worked flawlessly. Running in DE mode and I did not update the DE servers. No issues.

guest
19th April 2022, 04:57
Thank you for the update, Pauly. Much appreciated.

Thankyou for the thankyou :)

guest
19th April 2022, 05:03
Big thank you Pauly! I took about a 9 month hiatus from RipBot and was surprised that it didn't update when I launched it earlier this week. Just installed all your updates and it worked flawlessly. Running in DE mode and I did not update the DE servers. No issues.

Hi, yes it's pretty sad that "official" update's seem to be a thing if the past :(

Don't forget to disable Auto Updates, it will mess up these builds !!!

Good to hear that DE is working for you, I checked some of your previous posts, and most of them where DE issues...hope it stays working for you.

And thankyou for the thankyou :)

ReinerSchweinlin
20th April 2022, 20:52
Has anyone contemplated, or is using, an nVidia Tesla GPU card(s) with RipBot for OpenCL & CUDA filters ???
yes,
K80
K40
M40
Grid 520
......
As long as you can set the card to WDDM Mode, you can use it for almost anything (Direct X, Vulkan, etc..)... OPENCL and CUDA are also available in Compute Mode (wich is slightly faster)... Some of the vrey new and big cards only have CUDA (Ampere datacenter ones) and some rare ones are "hard to fiddle" because they only offer certain drivers (some Kepler Grid ones), but for the most part - the stuff that appears on ebay works fine....

guest
21st April 2022, 02:26
yes,
K80
K40
M40
Grid 520
......
As long as you can set the card to WDDM Mode, you can use it for almost anything (Direct X, Vulkan, etc..)... OPENCL and CUDA are also available in Compute Mode (wich is slightly faster)... Some of the vrey new and big cards only have CUDA (Ampere datacenter ones) and some rare ones are "hard to fiddle" because they only offer certain drivers (some Kepler Grid ones), but for the most part - the stuff that appears on ebay works fine....

Good to know, I am running K20Xm's, 14 Compute Units, 2688 Cuda Cores.

So with the Dual GPU cards (eg:- K80), do you assign one GPU per port in DE ??

Or can you assign both GPU's to the same port, as to get the maximum assistance from the nearly 5000 Cuda Cores ??

ReinerSchweinlin
21st April 2022, 15:24
The K80 is presented to the system as two seperate GPUs. Since Ripbot is only able to adress one, you wont be much faster than with the K20x.... In theory, it would be possible to use both at the same time, but often the overhead of splitting the workloads into two chunks and moving it over the PCI_E Bus destroys the advantage... The lesser data, the more computation, the better the benefit (blender render is almost twice the speed for example)... So the more demanding the filter is, the more benefit from two cards (realsr vulkan implemenatation shows that quite nice.. up to four cards at the same time can be used).

A M40 would speed up things compared to the K20x.

If you donīt HAVE to use Grid/Tesla.... GCN Cards are quite strong in OPENCL... A used R9 Fury is around the same price.-tag as a M40 and is a lot stronger in OPENCL computation... (take a look at geebench opencl resukt browser to get a rough estimate)

In addition: Unless you have a lot of CPU power, often the Encode-Part is the bottleneck (at least when doins x265 slow or better)...

one thing you could try: Set the card to compute mode and turn of ECC, might squeeze out some speed :)

guest
22nd April 2022, 01:38
The K80 is presented to the system as two seperate GPUs. Since Ripbot is only able to adress one, you wont be much faster than with the K20x.... In theory, it would be possible to use both at the same time, but often the overhead of splitting the workloads into two chunks and moving it over the PCI_E Bus destroys the advantage... The lesser data, the more computation, the better the benefit (blender render is almost twice the speed for example)... So the more demanding the filter is, the more benefit from two cards (realsr vulkan implemenatation shows that quite nice.. up to four cards at the same time can be used).

A M40 would speed up things compared to the K20x.

If you donīt HAVE to use Grid/Tesla.... GCN Cards are quite strong in OPENCL... A used R9 Fury is around the same price.-tag as a M40 and is a lot stronger in OPENCL computation... (take a look at geebench opencl resukt browser to get a rough estimate)

In addition: Unless you have a lot of CPU power, often the Encode-Part is the bottleneck (at least when doins x265 slow or better)...

one thing you could try: Set the card to compute mode and turn of ECC, might squeeze out some speed :)

Hi Reiner, thanks for the great reply & info.

Actually the main reason I wanted to try some Tesla's is that my "best" GPU, an MSI 1080 Gamer X, stopped working, and then I saw some YouTube clips of guys using these Tesla cards for gaming & transcoding, and as the price of new & used GPU's has been so high, you could get certain Tesla cards for cheap, so I opted for a K20Xm.

I did ask around about encoding with these, and got the big "thumbs down", saying they were no good for that, but I needed to find out for myself.

I was mainly after the CUDA functionality, not the OpenCL, and after a far bit of "testing" RipBot was using it for both.

Even though RipBot has no "default" CUDA filters !!

So, you mentioned that the K80 was recognised as 2 GPU's, and that RipBot could only address 1...you must be relying on the info under the OpenCL tab, as it does ONLY show 1 device at a time, even if you have 2 GPU's.

I have a couple of systems that have an AMD & nVidia GPU, and the only way you can use both with RipBot is the following command(s)..(in the RipBot264.ini file)

This one assigns 1 GPU per encoding port...

Server1CommandLine=/port 1000 /minimize /priority normal /restart-if-no-progress /x264-opencl-device-id 0 /knlmeanscl-opencl-device-id 0
Server2CommandLine=/port 2000 /minimize /priority normal /restart-if-no-progress /x264-opencl-device-id 1 /knlmeanscl-opencl-device-id 1

Not sure if this one would work, trying to assign both GPU's to the same port, which would be great for a K80, for example.

Server1CommandLine=/port 1000 /minimize /priority normal /restart-if-no-progress /x264-opencl-device-id 0 /knlmeanscl-opencl-device-id 0 /x264-opencl-device-id 1 /knlmeanscl-opencl-device-id 1

But that may only work for OpenCL, not CUDA.

I also have no idea how to do this :-

one thing you could try: Set the card to compute mode and turn of ECC, might squeeze out some speed

ReinerSchweinlin
22nd April 2022, 11:33
Hi Reiner, thanks for the great reply & info.

Actually the main reason I wanted to try some Tesla's is that my "best" GPU, an MSI 1080 Gamer X, stopped working, and then I saw some YouTube clips of guys using these Tesla cards for gaming & transcoding, and as the price of new & used GPU's has been so high, you could get certain Tesla cards for cheap, so I opted for a K20Xm.

I used to have some K20x as well and used them for all kinds of computation, gaming, etc... (whenever I get them running, my curiosity is satisfied, so no long time usage, only "testing" to see what is possible...). Being Kepler Generation, the K20x donīt support the newest versions of everything, but most stuff still works up to the point when Nvidia dropped support a while ago...

I did ask around about encoding with these, and got the big "thumbs down", saying they were no good for that, but I needed to find out for myself.

Using NVENC is certainly possible with these, although they only support an older version... For streaming in h264, its usable, but for video its not really worth it... Even the newest generations of the nvidia encoders can not compete with x265... They are fast, yes.... h265 support in the K20 is not worth it, I think its even missing.... I could talk a lot about the nvenc part, but better head over to the thread of "current state of hardware encoding"... more info there... Plex cheat sheet (google it) and wikipedia also have all the info you need. Bottom line: Encoding is not worth it with the k20..
But using them as a computation device for filters (in ripbot or whatever..) they are fine... Not the fastest, of course, but for the money, they work good and provide more VRAM than the consumer GTX counterparts..

I was mainly after the CUDA functionality, not the OpenCL, and after a far bit of "testing" RipBot was using it for both.

Nice :)


So, you mentioned that the K80 was recognised as 2 GPU's, and that RipBot could only address 1...you must be relying on the info under the OpenCL tab, as it does ONLY show 1 device at a time, even if you have 2 GPU's.

yes, the system acts as if two cards were installed.. To use two cards at the same time, the filter implementation has to be build for that as well as the program calling it... Its possible to use OPENCL with multiple compute units, but its not implem,ented in ripbot and the filters in use (at least to my knowledge) wouldnīt support it anyways... Iīd drop the thought of a K80 - for the same price, a M40 offers the much better value (being one GPU being faster than the two Kepler ones on the K80, offering 24GB variants and being Maxwell 2.0 which supports more modern CUDA stuff..)..

I have a couple of systems that have an AMD & nVidia GPU, and the only way you can use both with RipBot is the following command(s)..(in the RipBot264.ini file)

This one assigns 1 GPU per encoding port...



Not sure if this one would work, trying to assign both GPU's to the same port, which would be great for a K80, for example.

We have to differentiate here... There is an old OPENCL "Boost" for x264 which ripbot still offers... Here some of the computation done in x264 is offloaded to a OPENCL device.. This only makes sense in scnearios, where the CPU is not very powerful, the bandwith is not bottlenecking and where some of the power of the CPU is needed for other stuff... It doesnt use NEVCN, it just seperates the computation (If I remember, motion estimation is done in OPENCL... might remember wrong...)... In most of the times, the speedup is not there compared to "pure CPU encoding", do some measuerements to see it... The newer the CPU, the lesser the benefit (on a Ryzen 5 3600 with a M40, I did not gain anything...).... So plamning to get a bigger GPU in order to speedup Encoding in x264 probably is not worth it - rather spend some money on a bigger CPU (or more cores)...
x265 does not offer this kind of technique - it was investigated, but since the computation is even more complex and the type of math used here is not very suitable for a GPU, its not done in x265 back then by the developers, the idea was dropped... Some newer developments of direct memory access for GPUs and offloading motion estimation (read up Intel AI SDK news on developer forums) might give this idea a new live, but so far, x265 is best on a lot of CPU cores :)

The second thing is using filters with GPU acceleration... This makes sense... IF the Filter is capable of using more than one GPU and the GUI is able to call it, then it will work - but again, most of whats under the hoodd of ripbot is not capable of splitting workloads... If using multiple filters, doing one on GPU1 and the other on GPU2 COULD work, but then you have the Bandwith Bottleneck of movniog stuff over the PCIE BUS... (the K80 Chips canīt "talk" to each other directly, no SLI or similar awareness here...

Bottom line - its much easier to get ONE bigger GPU - and much more promising in terms of "getting faster"..


But that may only work for OpenCL, not CUDA.

I also have no idea how to do this :-
OPENCL, CUDA; VULKAN, DirectML, etc... all have the possibility to use multiple GPUs... But its no automatism.... In most cases, using already compiled filters you are out of luck using more than one GPU for one filter (at least as far as I know - have been tinkering with stuff like this for a long time...) If someone knows of an easy hack - Iīd be glad to hear about it (giving my GRID GPUs some more usability...)

Danette
27th April 2022, 04:55
Which version is the last to be able to handle Avisynth+ 32-bit?

guest
27th April 2022, 09:24
Which version is the last to be able to handle Avisynth+ 32-bit?

v1.20.0...

http://www.digital-digest.com/software/RipBot264_history.html

VirulentPip
28th April 2022, 15:55
Hey, I have Ripbot on a Windows 10 PC and Windows 11.

The Windows 10 PC is where I'd want most of the brute force coming from, I can get encodings going from the Windows 10 PC and also from the windows 11 PC using the windows 10.. However what I cannot get working is adding in the Win11 PC to add to the power when I want to. I double click the EncodingServer exe, however no GUI opens, it goes to Task Manager but nothing to show to be able to actually "run" I've restarted the PC but still no luck, currently RipBot is situated on my D Drive, would I need to have it on C Drive for the EncodingServer to open properly? Or is it a Win 11 issue?

Thanks.


Edit - Turns out GeForce Experience was stopping it.. Was the only difference between the machines and the server popped up as soon as it was uninstalled.

Atak_Snajpera
28th April 2022, 16:09
Run Win11 in safe mode and check if EncodingServer opens.

Ryushin
28th April 2022, 17:51
So I upgraded my server using a used Supermicro motherboard and I ordered two Xeon E5-2680 V4 (14 cores) processors for it from Ebay. Got everything installed on Tuesday.

I configured my virtual machine with to use 24 cores and two threads for a total of 48 CPU threads. Gave the VM 32GB of RAM as well. I am not using NUMA.

Run the x265 Benchmark and received a score of 59.2 so I was happy with this.

Received Moonfall in 4K from Amazon and I proceeded to add it to RB. Noticed i would have to do a bit of degraining and enabled MDegrain2 with a THSAD value of 200. Started the encoding with two servers and was amazed at how slow the encoding went and how it was not utilizing the CPU.

So I did a test encoding with no MDegrain2 and it was fast. So most likely it was the threading problem with MDegrain2. My "Use multiple processing threads" setting was set to the default of 0 which I think means use a thread for each CPU thread which would be 48.

So I ran some tests by lowering the number of threads used for MDegrain2 and the results were dramatic:

1 Minute Chunk Size, First Chunk, 1 Encoding Server
No MDegrain - 6.38 fps (CPU running about 45-85%)
MDegrain2 48 threads (0 for unlimited) - 1.27 fps
MDegrain2 24 threads - 1.29 fps
MDegrain2 18 threads - 2.31 fps
MDegrain2 15 threads - 4.36 fps
MDegrain2 14 threads - 4.44 fps
MDegrain2 13 threads - 4.38 fps
MDegrain2 12 threads - 4.15 fps
MDegrain2 10 threads - 3.62 fps

1 Minute Chunk Size, First and Second Chunk, 2 Encoding servers
No MDegrain - 4.17 and 12.13 fps = 16.30 fps (CPU running about 92-100%)
MDegrain2 15 threads - 3.05 and 3.62 fps = 6.67 fps
MDegrain2 14 threads - 3.18 and 4.22 fps = 7.40 fps
MDegrain2 13 threads - 3.26 and 3.96 fps = 7.22 fps

So I hope this helps someone who has a highly threaded setup and that you will probably have to tune the MDegrain2 thread settings for each machine.

blacksapprow
28th April 2022, 22:14
I am waiting for AV1 codec support in RipBot!

https://www.tomshardware.com/news/intel-av1-encoder-for-cpus

@Atak_Snajpera please look to the bottom link: :helpful:

https://gitlab.com/AOMediaCodec/SVT-AV1/-/releases/v1.0.0

VirulentPip
28th April 2022, 22:41
Quick questions

1. Is it possible to hardcode subtitles
2. Is it possible to set Default audio track

Only started using today, noticed on first encode that both tracks were set as default so have to go into mkvtoolnix to adjust that post encode, so would be nice if there's something I'm missing so don't have to have an unnecessary process.

Atak_Snajpera
28th April 2022, 22:45
1. Avisynth script -> permanent subtitles
2. Not implemented yet. Will take a look.

VirulentPip
29th April 2022, 20:25
Would it work if I add an Intel CPU (i5 12600K) to the distributed encoding which currently has 2x AMD CPUs (3900x as primary and 5800x when not gaming)

Atak_Snajpera
30th April 2022, 00:47
You can add any pc as long as it runs on Windows OS.

VirulentPip
2nd May 2022, 10:08
After encoding I get *ERROR* next to the jobs with an Error Text File. Output is fine and cannot see anything in the text that would indicate error


D:\Movies\47 Ronin (2013) Remux-1080p>"C:\Ripbot\EncodingClient.exe" "D:\Temp\RipBot264temp\job1\job1_EncodingClient.meta"

mkvmerge v61.0.0 ('So') 64-bit
'D:\Temp\RipBot264temp\job1\video.265': Using the demultiplexer for the format 'HEVC/H.265'.
'D:\Temp\RipBot264temp\job1\2_audio_English_DEFAULT.ac3': Using the demultiplexer for the format 'AC-3'.
'D:\Temp\RipBot264temp\job1\1_audio_English.ac3': Using the demultiplexer for the format 'AC-3'.
'D:\Temp\RipBot264temp\job1\video.265' track 0: Using the output module for the format 'HEVC/H.265 (unframed)'.
'D:\Temp\RipBot264temp\job1\2_audio_English_DEFAULT.ac3' track 0: Using the output module for the format 'AC-3'.
'D:\Temp\RipBot264temp\job1\1_audio_English.ac3' track 0: Using the output module for the format 'AC-3'.
The file 'D:\Video\47 Ronin (2013) Remux-1080p_new.mkv' has been opened for writing.
'D:\Temp\RipBot264temp\job1\video.265' track 0: Extracted the aspect ratio information from the video bitstream and set the display dimensions to 1920/1080.


The cue entries (the index) are being written...
Multiplexing took 8 seconds.
-------------------------

Elapsed Time: 01h:33m:08s

Jake802
3rd May 2022, 23:33
Anybody have any ideas as to what would cause my subtitles to no longer work, when making an AVCHD Disc? It appears to only happen when I want to do AVCHD and They load and then nothing shows up for the preview window

VirulentPip
4th May 2022, 09:02
What causes this to happen? It's starting to get very annoying. It's very hit and miss and I cannot seem to figure out what would cause it. Was hoping to have all queued encodes done over night but this one was hung on this "Incomplete" chunk till I shutdown the server and it was allocated to another.

TCP Communication is repeating the same thing over and over Encoding_Process > 99.7% 1462/1466 frames 8.32fps then a few other bits I cannot read as it goes so fast but says Client > Server OK

Main says it encoded all 1466 frames for chunk 43.


https://imgur.com/2EnB5K6

Atak_Snajpera
4th May 2022, 10:55
Check if ffmpeg.exe and x264_x64.exe/x265_x64.exe is stil present in taskmanager

guest
4th May 2022, 10:58
Anybody have any ideas as to what would cause my subtitles to no longer work, when making an AVCHD Disc? It appears to only happen when I want to do AVCHD and They load and then nothing shows up for the preview window

Hi Jake802,

You haven't posted here for nearly 3 years....

So you say that they load, but nothing shows in the preview window, but what if you go ahead & just process it (you could add the subtitles later, using MKVToolNix) if it didn't work..

No idea why subtitles would just stop working, there must be a problem somewhere else....if you are running the latest available build of RipBot, nothing has significantly changed with that for well over 9 months :( So it probably isn't that...

Maybe you could try Pauly Dunne's build, and see if that makes any difference.

VirulentPip
4th May 2022, 11:44
Check if ffmpeg.exe and x264_x64.exe/x265_x64.exe is stil present in taskmanager

Underneath the Encoding Server process is Ffmpeg and a windows command processor processes.

The "incomplete" chuck issue has occurred a further 3 times since my post.