RipBot264 v1.18.3 - Simple and easy to use GUI -> IPOD . PSP . CONSOLES . BLURAY

[kempodragon]

Back in April, I built a whole new rig using the Threadripper 1950x. For a test run, I encoded one of my recordings of my camcorder for upload to Vimeo. This was a straight bitrate reduction, no change in fps or resolution. In terms of speed alone, it smoked my old setup, but there was a strange bottleneck that made me wonder if anyone else had similar problems.

My old setup: AMD A-10 Kaveri quad core, and my MSI gx70 laptop, also an AMD A-10 quad core working together over wi-fi. Each system could run two servers instances, my main achieving an average of ~50 fps combined and my laptop also able to run two servers with an average of 25 fps combined, for a total of ~75 fps. Both systems were stock and all core usage was at the max. I always ran 2 pass, so the speeds are an average of both passes.

My Threadripper was able to achieve an average speed of ~250 fps over 2 passes, but I could only run 4 servers before all 16 cores were maxed out. This is what has me puzzled, and was hoping some one could shed some light. I run completely stock speeds and my temps max out at 68 degrees C thanks to the Enermax Liqtech AIO that I have installed.

I haven't updated to the newest Ripbot yet, so maybe the update will let me use more servers, but I really would like to know why I could only run 4 servers, it seems I should have been able to run more.

[slalom]

@Atak
After the latest update, when I run Ripbot the program starts and I get an error "Windows could not find...", it's a small window so It doesn't show which file.
I checked the taskbar and "EncodingServer.exe" was not running. I had to start it maually from the folder

This happened on all 3 PCs, after today's update, can you check that please?

[Atak_Snajpera]

@kempodragon
And what is your question?

[slalom]

@Atak
I can't give a screenshot, you would't understand the language
It just says "Windows could not find..." and there is half the path to my Ripbot folder
It also says, "make sure the name is correct and try again"

I manually run EncodingServer.exe and everything works

[guest]

* = logical processor aka thread

Yes. If you enable NUMA in bios you will get two graphs in task manager like I showed you before.

SUCCESS :) I have 2 NUMA Nodes per pc. (old Xeon's)

I wish I knew how to add those screenshots you use...(hint, hint).

OK, turned out that NUMA was enable on all the pc's I've checked so far, on the Tyan boards, they call it "ACPI SRAT Table", and with that enabled the Task Manager displays as per your screenie :)

With the Coreinfo check, I get 2 lines, one for each node, with 6 asterisks for node 0, and ditto for node 1. (dual 6 core's)

I'll be very interested if NUMA is an option on the ASUS X9 WS board I have the Xeon E5 12 core on.

So on with the next question, how do I now "enable" them in DE, like you show (post #15981 pg 800) ??

Cheers :)

[guest]

Back in April, I built a whole new rig using the Threadripper 1950x. For a test run, I encoded one of my recordings of my camcorder for upload to Vimeo. This was a straight bitrate reduction, no change in fps or resolution. In terms of speed alone, it smoked my old setup, but there was a strange bottleneck that made me wonder if anyone else had similar problems.

My old setup: AMD A-10 Kaveri quad core, and my MSI gx70 laptop, also an AMD A-10 quad core working together over wi-fi. Each system could run two servers instances, my main achieving an average of ~50 fps combined and my laptop also able to run two servers with an average of 25 fps combined, for a total of ~75 fps. Both systems were stock and all core usage was at the max. I always ran 2 pass, so the speeds are an average of both passes.

My Threadripper was able to achieve an average speed of ~250 fps over 2 passes, but I could only run 4 servers before all 16 cores were maxed out. This is what has me puzzled, and was hoping some one could shed some light. I run completely stock speeds and my temps max out at 68 degrees C thanks to the Enermax Liqtech AIO that I have installed.

I haven't updated to the newest Ripbot yet, so maybe the update will let me use more servers, but I really would like to know why I could only run 4 servers, it seems I should have been able to run more.

Just because it's "maxed out" doesn't mean you can't add more servers...I use up to 8 on one pc...it all helps !!!

Oh to have a Threadripper :(

[Atak_Snajpera]

So on with the next question, how do I now "enable" them in DE, like you show (post #15981 pg 800) ??
Just run two servers with different /node value

EncodingServer.exe /node 0
EncodingServer.exe /node 1

[guest]

Just run two servers with different /node value

EncodingServer.exe /node 0
EncodingServer.exe /node 1

OK, sounds easy enough...

What about other pc's when using DE, on different IP's ??

Say for instance, you had 4 pc's, running 4 server instances each, can you somehow use node 0 & 1 multiple times ?? or ..

And does the Server Name change ?? (this is a user input naming option)

And with Priority, what difference can that make ??

Hope that makes some sort of sense..

[Atak_Snajpera]

You can run as many servers on single node as you want if you are still having problems with low cpu usage

EncodingServer.exe /node 0
EncodingServer.exe /node 0
EncodingServer.exe /node 1
EncodingServer.exe /node 1

And with Priority, what difference can that make ??
https://docs.microsoft.com/en-us/windows/desktop/procthread/scheduling-priorities

[guest]

You can run as many servers on single node as you want if you are still having problems with low cpu usage

EncodingServer.exe /node 0
EncodingServer.exe /node 0
EncodingServer.exe /node 1
EncodingServer.exe /node 1


https://docs.microsoft.com/en-us/windows/desktop/procthread/scheduling-priorities

Excellent, thank you very much...

Now a tiny little difference I have noticed in the ripbot.ini, between the auto-updated previous version, to the "full" version you posted on Mediafire..

in the pre, it shows:- "MTFiltersList=MDegrain2;QTGMC;"

in the "full":- "MTFiltersList=MDegrain2;QTGMC;z_ConvertFormat;"

what does the "z_ConvertFormat;" control ??

And I just got another "core" auto update.

[Atak_Snajpera]

Extra note to my previous answer. I also strongly recommend manually specifying port number!
EncodingServer.exe /node 0 /port 1000
EncodingServer.exe /node 0 /port 2000
EncodingServer.exe /node 1 /port 3000
EncodingServer.exe /node 1 /port 4000

what does the "z_ConvertFormat;" control ??
This filter is used in HDR to SDR conversion.

And I just got another "core" auto update.
It is a fix for issue reported by slalom. (EncodingServer.exe couldn't be automatically executed by Ripbot264.exe if path had spaces)

[guest]

Extra note to my previous answer. I also strongly recommend manually specifying port number!
EncodingServer.exe /node 0 /port 1000
EncodingServer.exe /node 0 /port 2000
EncodingServer.exe /node 1 /port 3000
EncodingServer.exe /node 1 /port 4000


Nice :)

or in any "random" order, meaning:- node 0/port 1000, node 1/port 2000, node 0/port 3000, node 1/port 4000, etc, for all 16 if needed, and this will pick up on the other NUMA servers in the DE, which will need there own similar settings, correct ?? or only per pc.

Not sure how to word the question I'm trying to ask.

[Atak_Snajpera]

You've lost me with this one...

[guest]

You've lost me with this one...

I thought I would...

So let's say you have 4 PC's doing DE, 2 of them can use Numa, and the others can't.

Do you have to allow for that on each PC's DE settings, or just on the individual PC ?

Still not sure if that makes sense.

[Atak_Snajpera]

If other PCs are regular single socket CPU (no multiple numa nodes) then you can omit /node switch completely

EncodingServer.exe /port 1000
EncodingServer.exe /port 2000
EncodingServer.exe /port 3000
EncodingServer.exe /port 4000

/node 0 will work as well
EncodingServer.exe /node 0 /port 1000
EncodingServer.exe /node 0 /port 2000
EncodingServer.exe /node 0 /port 3000
EncodingServer.exe /node 0 /port 4000

Some examples
PC A = dual socket xeon (6c/12t)
EncodingServer.exe /node 0 /port 1000
EncodingServer.exe /node 1 /port 2000

PC B = laptop (2c/4t)
EncodingServer.exe
PC C = desktop (16c/32t)
EncodingServer.exe /port 1000
EncodingServer.exe /port 2000

[kempodragon]

@Atak When I ran my test encode, I opened one server at a time while watching core usage. At 4 servers, all 16 cores were at 100%, while my cpu temps reached 68 degrees C where they stabilized. That's why I wanted to know if anyone else had similar problems. I didn't want to try anymore servers, because I was afraid of overheating.

[Atak_Snajpera]

I still don't get it. You ran 4 encoding tasks and you are surprised that you have 100% cpu usage? Well you should be happy that you have software which can fully utilize those 32 threads.

[kempodragon]

Yes, my old quad core could only do two servers before all the cores hit 100%, that's why I was surprised when I hit 100% on all 16 cores with only 4 servers. I honestly thought I could get more encoders running before hitting full cpu utilization. Is there some limit to number of servers that one computer can open?

[Atak_Snajpera]

No limit but EncodingClient is designed for 16 so above that you can't use them anyway.
Cpu usage may rise much faster if you do some heavy filtering in avisynth (resize from 2160p to 1080p + tonemapping (HDR->SDR) + mdegrain2)

[kempodragon]

Well my camcorder only does 1080p60 and I don't do heavy filtering so no real stress there. I'm curious to see what your new x265 benchmark does as well as the newest version of Ripbot, since they appear to be optimized for Threadripper and the newest Intel.

[slalom]

It is a fix for issue reported by slalom. (EncodingServer.exe couldn't be automatically executed by Ripbot264.exe if path had spaces)
I DO have spaces in the path, same path all those years

:thanks:

[gabbett1]

My ripbot just updated and now it won't encode. When I try to start jobs, it just sits there. Normal encoding works, but distributed encoding seems to freeze.

[Ryushin]

Yep, VSFilter is what is crashing ffmpeg. On the Dell, I removed the MDegrain and just tried to encode the movie just using single thread, on Superfast and it crashed .7% into it. Error:

Problem signature:
Problem Event Name: APPCRASH
Application Name: ffmpeg.exe
Application Version: 0.0.0.0
Application Timestamp: 00000000
Fault Module Name: VSFilter.dll
Fault Module Version: 3.1.0.800
Fault Module Timestamp: 5ace31a2
Exception Code: c0000005
Exception Offset: 00000000000ce9aa
OS Version: 6.3.9600.2.0.0.272.7
Locale ID: 1033
Additional Information 1: d121
Additional Information 2: d121596965eaaf60f095f4d9bc0bf843
Additional Information 3: a18a
Additional Information 4: a18a1eba5b1778212204d59f13f4f060


Will you be able to create a sample with script? We need proper bug report for people maintaining VSFilter.

So I'm finally getting back to this. It seems if I try to render subs using either .srt or .ass I get this crash. I've tested this with a small test file as well. I can pack c:\temp\ripbot264 and c:\ripbot264temp to submit to the people who are maintaining VSFilter. Can you confirm that rendering .srt or .ass is causing ffmpeg to crash on your end? It is doing it on two systems here.

[Atak_Snajpera]

Can you confirm that rendering .srt or .ass is causing ffmpeg to crash on your end? It is doing it on two systems here.
In my case VSfilter also crashed with DVD subtitles. Problem definitely is in this filter.

[byteshare]

Well my camcorder only does 1080p60 and I don't do heavy filtering so no real stress there. I'm curious to see what your new x265 benchmark does as well as the newest version of Ripbot, since they appear to be optimized for Threadripper and the newest Intel.
Could add some denoise filters, even light will increase CPU demand

[byteshare]

My ripbot just updated and now it won't encode. When I try to start jobs, it just sits there. Normal encoding works, but distributed encoding seems to freeze.
In the EncodingServer.exe window do you see any errors?
Does the server just sit at idle?

[gabbett1]

In the EncodingServer.exe window do you see any errors?
Does the server just sit at idle?

I don't see any errors. It's just idle.

I did notice that if I turned off distributed encoding and then back on I will get the error "cannot find F:\Blue". I looked through all the settings and cannot find any such command. I don't know why this is coming up. So I created a file called Blue on my F drive and tried the process again. It opened the file up for each movie waiting to be encoded. Was very odd.

[gabbett1]

I noticed that the encoding client hadn't been started. I turned it on manually and it works now. Looks like I'll have to start the encoding client manually for now?

[Ryushin]

In my case VSfilter also crashed with DVD subtitles. Problem definitely is in this filter.

Looks like it may be fixed:
https://forum.doom9.org/showpost.php?p=1850600&postcount=951

I'll be testing it shortly.

[byteshare]

Not sure why but RipBot is changing é to Θ when muxing the files after an encode.
The filename displays correctly in the queue.
I'm having this issue on a Windows 10 machine.
Using RipBot Core 2018.07.11
Example:
Pokémon XYZ - 0889 - From A to Z! [iTunes DL 1080p] (Arian)
Into:
PokΘmon XYZ - 0889 - From A to Z! [iTunes DL 1080p] (Arian)

On my current encode it is now just failing to mux them:
Z:\>"C:\RipBot\EncodingClient.exe" "Z:\Temp\RipBot264temp\job113\job113_EncodingClient.meta"

Z:\>"C:\RipBot\tools\mkvtoolnix\mkvmerge.exe" -o "Z:\MergeAudio&Video\A\Pokémon Movie 12 - Arceus And The Jewel Of Life [BluRay] (LightEssence).mkv" --compression 0:none --title "Pokémon Movie 12 - Arceus And The Jewel Of Life [BluRay] (LightEssence)" --default-duration 0:24000/1001fps "Z:\Temp\RipBot264temp\video.265"
mkvmerge v23.0.0 ('The Bride Said No') 32-bit
'Z:\Temp\RipBot264temp\video.265': Using the demultiplexer for the format 'HEVC/h.265'.
'Z:\Temp\RipBot264temp\video.265' track 0: Using the output module for the format 'HEVC/h.265 (unframed)'.
The file 'Z:\MergeAudio&Video\A\PokΘmon Movie 12 - Arceus And The Jewel Of Life [BluRay] (LightEssence).mkv' has been opened for writing.
'Z:\Temp\RipBot264temp\video.265' track 0: Extracted the aspect ratio information from the HEVC video data and set the display dimensions to 1920/1080.


The cue entries (the index) are being written...
Multiplexing took 25 seconds.
-------------------------

Elapsed Time: 05h:29m:33s

If I manually do it I don't have an issue with the video and is the correct length. Maybe something to do with MKVToolNix Command Line?

[Privateer5000]

I have an issue when i shut down my computer and Ripbot is running (just idle, minimized in tray). I get an Error Message saying "Connot focus a disabled or invisible Window" and my computer does not shut off. I have to close RipBot by hand and then i can turn off my computer. Any Idea?

[varekai]

Any Idea?
Close RipBot and then shut down Windows?

[Privateer5000]

But this also happens when i tell Ripbot to shut down when encoding is finished. Problem was introduced with Version 1.23

[guest]

But this also happens when i tell Ripbot to shut down when encoding is finished. Problem was introduced with Version 1.23

No problems here...with Windows 7 & very latest Ripbot !!

[Privateer5000]

Maybe a Windows 10 Problem, have Win10 running on both PC's

[Atak_Snajpera]

Problem solved. Expect auto-update soon. (tomorrow)

[Privateer5000]

Thanks a lot :-)

[guest]

So, I was using Ripbot (very latest build) yesterday, with approx 20 or so job's in the queue, and it was ticking along quite nicely.

But just now (the next day), I opened Ripbot, and it displayed an error I had never seen before, something like "List index is out of bounds", and there were no job's in the queue, so I re started Ripbot, with the Temp Folder open, and before my very eyes, ALL the job folder's just disappeared, and I've got nothin' !!!!

Now I have to do it all again :(

Any clues ??

PS:- I just wanted to add, that the ONLY thing I did differently was that I had Ripbot turn itself off, yesterday.

Maybe there's a little glitch with that function as noted by Privateer5000.

[byteshare]

Is there any info I can send that would help explain why sometimes an encode server never starts?
It is listed as idle in the Encoding Client and shows starting in the job chunk list.
I haven't seen a reason for it yet

[guest]

Is there any info I can send that would help explain why sometimes an encode server never starts?
It is listed as idle in the Encoding Client and shows starting in the job chunk list.
I haven't seen a reason for it yet

OMG, byteshare, I am SO glad you've brought this up.

I have had this problem on nearly every job I've done, since the very latest build....it is so annoying that you go away from the pc, expecting it to just carry on, and you return, only to notice it hasn't done anything for, some times hours, just because one chunk / server has either failed to start, or "freeze's" just at the end, like 99.8%.

It used to happen randomly on earlier builds, but was never diagnosed to discover what was really causing it, so no fix was made.

If there was some way Atak could come up with a process that "scan's" all the servers / chunks every so often, can detect if one or more has stalled, or failed to start, and refresh's them and they start the next available server.

I had a couple of instance's yesterday (after losing the whole queue), that a server would fail to start, so you'd try and stop it, but that didn't work, you could press the Stop button all day, it would not respond, so the only way was to force Ripbot to close, and a few times even a reboot was required to reset everything.

And another thing, ABORT is a bit hit & miss, sometimes it will, but for me, most times it won't. Use to work every time, when it was a part of the "chunk's" DE screen.

I was really hoping that the last "BIG" auto update with Avisynth & ffmpeg updates may have fixed the problem, but it actually seems worse :(

Are you using Numa Nodes ???

So, Atak, please don't take this the wrong way, we are trying to explain what some major problems are, and we're more than happy to help, where possible. Trying to help make Ripbot better, and better :) :thanks:

[Ryushin]

Looks like it may be fixed:
https://forum.doom9.org/showpost.php?p=1850600&postcount=951

I'll be testing it shortly.

All the tests I've run so far are showing this is fixed in the latest vsfilter.

[guest]

Further observations & comments, following on from posts #16038, 39 & 40.

I have been watching the chunk/server window as it's processing, (fresh setup of Windows 10 1803), and I've noticed that some chunks will "stall" at "Starting" for a certain amount of time, then just reset to "Offline".

Then, other "chunk's" will be processing away, then all of a sudden, they just restart, back to 0%, and not not just one at a time, up to 4 or 5. And this seems to just loop, until the user does something, but once these problems start, "Abort" doesn't work, and a forced closure is needed, and more often than not, a PC re-start :)

So there's something very strange going on, as this is happening on both Windows 7 & 10.

Might have to go back to the build before 1.23.0 (Final), where a lot of problems started :(....but I really like the NUMA Node option.

[byteshare]

Further observations & comments, following on from posts #16038, 39 & 40.

I have been watching the chunk/server window as it's processing, (fresh setup of Windows 10 1803), and I've noticed that some chunks will "stall" at "Starting" for a certain amount of time, then just reset to "Offline".

Then, other "chunk's" will be processing away, then all of a sudden, they just restart, back to 0%, and not not just one at a time, up to 4 or 5. And this seems to just loop, until the user does something, but once these problems start, "Abort" doesn't work, and a forced closure is needed, and more often than not, a PC re-start :)

So there's something very strange going on, as this is happening on both Windows 7 & 10.

Might have to go back to the build before 1.23.0 (Final), where a lot of problems started :(....but I really like the NUMA Node option.
Mine tend to get stuck in the "Encoding" status, but on the server it just says: "Encoding started..."

[guest]

Mine tend to get stuck in the "Encoding" status, but on the server it just says: "Encoding started..."

Yes, that's what used to happen, but today, when they actually stop encoding, and start themselves again, and this can just loop.

[Atak_Snajpera]

Is this what happens on your machine?
https://s22.postimg.cc/b28mhz6yp/Untitled-1.png

[guest]

Is this what happens on your machine?

Well, from what I can make out from this muddled up screenshot, is that, that is what happens, but more...

[Danette]

This has me baffled: I have placed an AVS file into the Tools-Avisynth plugins-Scripts-Custom folder so that I can apply it from the dropdown menu in the batch settings. However, the job is rejected every time, returning the error message “I don’t know what ‘YV12’ means.” I have tried many different types of script to test this, such as; QTGMC, TIVTC, and many simpler scripts. Same problem occurs each time.

[Atak_Snajpera]

Show me your custom avs script.

[Danette]

I've tried many scripts, but just a simple one is: video=trim(video,30,100)
Even the default ConvertToInterlaced.avs that is supplied with the GUI returns the same problem.
The JobsRejected log, in addition to showing the YV12 error, cites the "getinfo.avs" file, line 8 for that rejected job. When I look at line 8 of that file, it's just the "#Deinterlace" line.

[byteshare]

Is this what happens on your machine?
https://s22.postimg.cc/b28mhz6yp/Untitled-1.png

Yes. Both on my Windows 7 and 10 machines