RipBot264 v1.18.3 - Simple and easy to use GUI -> IPOD . PSP . CONSOLES . BLURAY

[mparade]

After switching off firewall completely on home-pc result is still the same. Should I reopen encodingserver.exe and reconfigure servers on work-pc?

Now I got this error message on work-pc:

http://mammutmail.com/hu/download/2f69b2770124bed00cf2ab46cbf28579

[duffbeer]

Though what is stranger is the huge amount of difference it is between HD and 4K. Is there an option to use a different decoder for the auto detect boards and new frame option. I notice things got really slow for me around the time lsmash was implemented.

The VM has been fine, but a little slow in general, but overall, it got the job done. Now though the Gathering Information on anything related to 4K sources seems to take a very long time.

Oh, one other thing, is it still necessary to convert .sup to .sub when rendering subtitles?

You're not alone. I reported this issue quite a while ago and nothing has changed.
I have a 9900K based PC that is a dedicated encoder. I have the same delay issues as you. If I go back to 1.24.1 everything is OK.
Right now it takes me about 90 mins to queue up a 4K source. Cropping seems to be really slow.

[Atak_Snajpera]

After switching off firewall completely on home-pc result is still the same. Should I reopen encodingserver.exe and reconfigure servers on work-pc?

Now I got this error message on work-pc:

http://mammutmail.com/hu/download/2f69b2770124bed00cf2ab46cbf28579

You are still behind some extra firewall/antivirus on home-pc. There is some software on your PC or settings which actively refuse connection. In first case (socket error 10060) connection was totally ignored hence timedout message. Now after disabling your firewall you get at least different error message. I suspect that extra "layer of protection" (different software) is now rejecting incoming connection with proper message.

[Ryushin]

You're not alone. I reported this issue quite a while ago and nothing has changed.
I have a 9900K based PC that is a dedicated encoder. I have the same delay issues as you. If I go back to 1.24.1 everything is OK.
Right now it takes me about 90 mins to queue up a 4K source. Cropping seems to be really slow.

90 minutes seems about same for me as well and about 15 minute chunks as well.
Pull in a 4K: Long time, but this seem CPU bound now, so no complaints here.
Second Audio THD source (Gathering Information): 15 Minutes
Autocrop Frames: 15-30 minutes
Leave Avisysnth Windows (Gathering Information) 5-15 minutes

Waiting to buy a Epyc rome processor. Then I'll do tests again. I'm currently tuning my VMs for the new SSD raidz2. Don't expect to see much improvement there as the bottle neck seems to be CPU bound now.

[duffbeer]

90 minutes seems about same for me as well and about 15 minute chunks as well.
Pull in a 4K: Long time, but this seem CPU bound now, so no complaints here.
Second Audio THD source (Gathering Information): 15 Minutes
Autocrop Frames: 15-30 minutes
Leave Avisysnth Windows (Gathering Information) 5-15 minutes

Waiting to buy a Epyc rome processor. Then I'll do tests again. I'm currently tuning my VMs for the new SSD raidz2. Don't expect to see much improvement there as the bottle neck seems to be CPU bound now.

I don't think it is CPU bound. I don't run any VMs on my PC - it is a 9900K and has nothing else installed on it.
I would like to know how some people are using 1.25 without setup speed issues and some are not.
1.24.1 was fine so the latest version has been broken as far as I'm concerned.

[byteshare]

I don't think it is CPU bound. I don't run any VMs on my PC - it is a 9900K and has nothing else installed on it.
I would like to know how some people are using 1.25 without setup speed issues and some are not.
1.24.1 was fine so the latest version has been broken as far as I'm concerned.
On a Ryzen 1700 and SSD it doesn't take that much time. Are you hitting 100% CPU when the auto crop is going?


So how do you set up RB to "wake up" a server ??, I have the options enabled in RB, I have all the MAC address & username's etc, but I have no success (but I haven't tried that recently)
If you fill in the MAC address info it should be working. If it is not, test that you can get your PC to wake up remotely without RB but either another app or application.


Sorry if I've upset you, but I did have the full quote, in the previous quote, and decided just to use that sentence for the next comment..check.
Didn’t upset me but without the rest of the context it seemed like a completely different point.


Yes, I want to maximise CPU usage, to do it faster....
Not sure why you're suggesting another client doing other jobs....(which I do anyway), BUT on "big ass" encodes, 1 client, ALL the DE servers dedicated to that one job...isn't that utilising CPU usage, and getting it done as fast as possible ??? or am I missing something here.
I’m saying if you want it the fastest it is already setup to go pretty fast, once you solved the muxing problem. I’m saying if you want it to be more efficient then setting up a second RB would solve that problem. I was saying if you want both since the Dev doesn’t have an interest right now in changing how the jobs work, than you’d likely need some expensive software to do that. I’m not sure exactly your need for both fast and efficient but I am happy with just efficiency in RB, which is why I use it over other software.

[mparade]

You are still behind some extra firewall/antivirus on home-pc. There is some software on your PC or settings which actively refuse connection. In first case (socket error 10060) connection was totally ignored hence timedout message. Now after disabling your firewall you get at least different error message. I suspect that extra "layer of protection" (different software) is now rejecting incoming connection with proper message.

Ok, thanks. I don't have any idea. Firewall switched off completely on both machines + neither of them has antivirus installed.
This is what I still get:

[2019-11-04 20:49:22] Client established connection with server.
[2019-11-04 20:49:22] Command "CONNECT" received from client.
[2019-11-04 20:49:22] Connecting with client... (192.168.88.178:1011)
[2019-11-04 20:49:24] Socket Error # 10061
Connection refused.

[Atak_Snajpera]

By the way. Are you using VPN built in windows or you use other custom software? What are other ips detected in client IP combobox? What does Adapter description show for each extra IP?

[guest]

If you fill in the MAC address info it should be working. If it is not, test that you can get your PC to wake up remotely without RB but either another app or application.

I had a bit of a play around with this yesterday, and it seems that some of my SMC boards don't support the S3 power settings in BIOS, so it won't wake, but I can at least shut them down remotely.


Didn’t upset me but without the rest of the context it seemed like a completely different point.

OK, good, and fair enough, I guess I thought I didn't need to double up on the quotes..


I’m saying if you want it the fastest it is already setup to go pretty fast, once you solved the muxing problem. I’m saying if you want it to be more efficient then setting up a second RB would solve that problem. I was saying if you want both since the Dev doesn’t have an interest right now in changing how the jobs work, than you’d likely need some expensive software to do that. I’m not sure exactly your need for both fast and efficient but I am happy with just efficiency in RB, which is why I use it over other software.

I guess I'll work with what I've got, I am yet to do a "big ass" 4K encode, but I think the NVMe's will make a big difference at the end of the process, not so much at the start.

I'm puzzled by the long times that other user's are talking about, I might do some test's and post the results.

Cheers

[Ryushin]

Atak,

Going to buy a temporary CPU from Ebay. Wondering if it's more important to have hertz or cores for Ripbot. Looking at a 6 core 2.6Ghz or a 8 core 2.0Ghz.

Found out my current CPU goes for $6.00 now on Ebay. LOL

[Atak_Snajpera]

Atak,

Going to buy a temporary CPU from Ebay. Wondering if it's more important to have hertz or cores for Ripbot. Looking at a 6 core 2.6Ghz or a 8 core 2.0Ghz.

Found out my current CPU goes for $6.00 now on Ebay. LOL

2.6 * 6 = ~16
2.0 * 8 = 16
In this case i would choose higher clock .

[mparade]

By the way. Are you using VPN built in windows or you use other custom software? What are other ips detected in client IP combobox? What does Adapter description show for each extra IP?

Admin installed ZyWALL IPSec VPN Client on my home-pc.
10.10.10.10 the other ip detected in client IP combobox.
Adapter description includes two options regardless of ip chosen in client IP combobox:

1.Intel(R) I211 Gigabit Network Connection
2. TheGreenBow Virtual Miniport Adapter

[Ryushin]

Admin installed ZyWALL IPSec VPN Client on my home-pc.
10.10.10.10 the other ip detected in client IP combobox.
Adapter description includes two options regardless of ip chosen in client IP combobox:

1.Intel(R) I211 Gigabit Network Connection
2. TheGreenBow Virtual Miniport Adapter

Just to let you know, I've seen some VPN's tunnel ALL traffic down the VPN. Local traffic (such as network printers) could no longer be accessed. I don't like these types of VPNs at all and I set up firewalls and VPNs for a living. I understand their usage for extreme security, but not having access to your local network, c'mon.

[guest]

So I have noticed a few posts about very long times to start a 4K job, so I thought I'd do a couple of tests for myself.

I chose Harry Potter #1, which is a remux 4K, 60.7Mb/s, 84.5Gb mkv.

I also ran it thru MKVToolnix to rip out EVERYTHING but the video, which took 4:30 mins (Raid-0 to nvme)

Also wanted to see what difference there was between LSmash & FFMS2.

So, chose the untouched mkv to start with, and it took 4:30 mins to demux, and a further 4:20 mins until the job creation was ready, with LSmash.

Using FFMS2 it took 4:30 mins to demux, and further 3:50 mins 'til job was ready.

Then the stripped mkv took 0 mins to demux, and a total of 3:25 mins with LSmash.

Same file using FFMS2 took 0 mins to demux, and a total of 3:12 mins.

Once they were queued up, it was time to see how long it took to copy the file, get the chunks created, etc, etc.

The untouched job took 12:00 mins 'til the chunks were all ready to go.

With the stripped mkv, it took 8:45 mins...not forgetting the it took 4:30 mins to strip out the file in the first place, so it's close'ish.

All these figures are having the original file on a RAID-0 of 2 x Seagate 3Tb 7,200 rpm spinners, copying to an ADATA NVM'e, using a single Xeon 12c cpu.

Now, I cannot provide any final muxing, etc info at this time, as that will take a couple of days for me to get around to do that, but I WILL post my results.

So regardless of how long that's going to take, there WILL be a reasonable amount of time that all DE servers aren't doing anything.

[howzz]

@Atak_Snajpera

i noticed that in the latest update, you included an option for user to select decoding method. although Lmash is slow, on my NvMe it's still fast for demuxing, indexing etc.
but my question is, is there any real speed difference in using GPU for "decoding" method?

btw, i see a lot of folks are discussing about NvMe here. i was an early adapter of NvMe for my 4K workflow, trust me, invest in a couple good NvMe drives. it's worth it. and do yourself a favor, don't go below 1TB. my current 4K workflow, nothing takes longer than 4 mins for initial demux, indexing, gathering information altogether. most 4K UHD sources take 3~4 mins total to do all that. if you have the source sits on the same NvMe drive, it'll only take 3~4 mins.

the trick with shopping for NvMe drives is look for TLC drives and avoid QLC drives at all cost. QLC's raw writing speed is less than 100 MB/s. i've tried them all and went through them all and experience all of it the hard way. once the SLC cache run out, QLC's raw writing speed will fall below 100 MB/s sometimes 70 MB/s, that's slower than most high end 7200rpm spindle. and smaller the drive, smaller the SLC casche will be. on a 1TB QLC drive, your SLC cache is probably gonna be about less than 20GB when it's filled at 50%. the intel 660P 2TB drive, theoretically, if you over provision it and treat it as a 1.5TB drive, theoretically you'll always have more than 50GB of SLC caching. but just do yourself a favor, avoid all the QLC drives out there. go for a fast TLC drive from Corsair, Sillicon power, Samsung, and you'll be a lot happier. most TLC's raw writing speed, provided if the onboard processor is of recent version, will be around 600~800 MB/s even after it runs out of its SLC caching. so when doing 4K UHD workflow working with large 60~70 GB files, you're going to be counting on the raw writing speed. when shopping around, look for reviews that do tests on large 25~50 GB file "write" tests, and the chart will show you the speed difference once those SLC cache runs out.

if money is of no object, Samsung is the way to go. but otherwise get one of those Corsair MP510, or silicon power TLC drives. 1~2TB will be most ideal. and make sure that your mobo supports PCIe 3.0 x4 M.2, even though realistically, ripbot workflow will never really exceed 1500 MB/s throuput, just under the max bandwidth of PCIe 2.0 x4

[duffbeer]

So I have noticed a few posts about very long times to start a 4K job, so I thought I'd do a couple of tests for myself.

I chose Harry Potter #1, which is a remux 4K, 60.7Mb/s, 84.5Gb mkv.

I also ran it thru MKVToolnix to rip out EVERYTHING but the video, which took 4:30 mins (Raid-0 to nvme)

Also wanted to see what difference there was between LSmash & FFMS2.

So, chose the untouched mkv to start with, and it took 4:30 mins to demux, and a further 4:20 mins until the job creation was ready, with LSmash.

Using FFMS2 it took 4:30 mins to demux, and further 3:50 mins 'til job was ready.

Then the stripped mkv took 0 mins to demux, and a total of 3:25 mins with LSmash.

Same file using FFMS2 took 0 mins to demux, and a total of 3:12 mins.

Once they were queued up, it was time to see how long it took to copy the file, get the chunks created, etc, etc.

The untouched job took 12:00 mins 'til the chunks were all ready to go.

With the stripped mkv, it took 8:45 mins...not forgetting the it took 4:30 mins to strip out the file in the first place, so it's close'ish.

All these figures are having the original file on a RAID-0 of 2 x Seagate 3Tb 7,200 rpm spinners, copying to an ADATA NVM'e, using a single Xeon 12c cpu.

Now, I cannot provide any final muxing, etc info at this time, as that will take a couple of days for me to get around to do that, but I WILL post my results.

So regardless of how long that's going to take, there WILL be a reasonable amount of time that all DE servers aren't doing anything.

Now try it with full 4K UHD disc as the source. You will see how much longer it takes.

[guest]

Now try it with full 4K UHD disc as the source. You will see how much longer it takes.

Haven't got access to any "full" disk's, unless I acquire a UHD rip as an .iso.

But why would there be a big difference ?? Is it the ripping process that takes so long ??

Do you rip it first, or let RB do that (if it can) ??

Ripping Bluray disk's was a PITA, I'm guessin' 4K are SO much worse.

[Atak_Snajpera]

but my question is, is there any real speed difference in using GPU for "decoding" method?

IT is complicated..
https://i.imgsafe.org/28/286ce8b657.png

https://i.imgsafe.org/28/286ce86c97.png

https://i.imgsafe.org/37/37bfdbdafa.png

most TLC's raw writing speed, provided if the onboard processor is of recent version, will be around 600~800 MB/s even after it runs out of its SLC caching.
TLC is still pathetic in comparison to old good MLC. Write speed on Samsung 970 PRO is ~2.5 GiB/s (No SLC cache BS)!

[Atak_Snajpera]

Just to let you know, I've seen some VPN's tunnel ALL traffic down the VPN. Local traffic (such as network printers) could no longer be accessed. I don't like these types of VPNs at all and I set up firewalls and VPNs for a living. I understand their usage for extreme security, but not having access to your local network, c'mon.

Since you have been doing this VPN stuff for living I would like you to ask something.

When you connect to remote LAN via VPN then shouldn't home-pc get the same three sections of IP?

https://i.postimg.cc/Hsc4zwhm/screenshot-home-pc.png

https://i.postimg.cc/PfFQ13KK/socket-error-message.png

My common sense tells me that after connecting to remote LAN Client IP should be starting from 192.168.2.xxx

[byteshare]

Just to let you know, I've seen some VPN's tunnel ALL traffic down the VPN. Local traffic (such as network printers) could no longer be accessed. I don't like these types of VPNs at all and I set up firewalls and VPNs for a living. I understand their usage for extreme security, but not having access to your local network, c'mon.
Which VPN solution would you recommend for setting up RipBot to have remote servers?

[Atak_Snajpera]

Which VPN solution would you recommend for setting up RipBot to have remote servers?

Just use builtin in windows.

[NasaRacer]

Not sure if this is a known issue but on a few of my recent 4k UHD Mkvs, the file Demuxing and indexing are normal. Then during "gathering information" it fails with the message "FFAudioSource: No audio track found
(C:\Temp\RipBot264temp\job1\getinfo.avs, line 4)" So using MKVToolNix I made a shorter version of the same file 1min of the file and then another with 10min of the file. The 1min version works but the 10min version fails with the same error. Then I made a full version of the file with the video only and no audio track and that is working okay as well. I used XMedia Recode to encode just the audio and that worked correctly. So I am not sure what the issue is.
The audio is Dolby TrueHD 7.1 both movies in question are from Disney.

[Atak_Snajpera]

Not sure if this is a known issue but on a few of my recent 4k UHD Mkvs, the file Demuxing and indexing are normal. Then during "gathering information" it fails with the message "FFAudioSource: No audio track found
(C:\Temp\RipBot264temp\job1\getinfo.avs, line 4)" So using MKVToolNix I made a shorter version of the same file 1min of the file and then another with 10min of the file. The 1min version works but the 10min version fails with the same error. Then I made a full version of the file with the video only and no audio track and that is working okay as well. I used XMedia Recode to encode just the audio and that worked correctly. So I am not sure what the issue is.
The audio is Dolby TrueHD 7.1 both movies in question are from Disney.
Can you send me that not working 10 minute version?

[Ryushin]

Since you have been doing this VPN stuff for living I would like you to ask something.

When you connect to remote LAN via VPN then shouldn't home-pc get the same three sections of IP?

My common sense tells me that after connecting to remote LAN Client IP should be starting from 192.168.2.xxx

A lot of VPN software/gateways will use a IP subnet to connect to, then the VPN gateway will route the traffic to the appropriate network.

For example, I use OpenVPN for and Fortigate for my VPNs. The IP block that you use for the VPN users should be almost a random block because you do not want your VPN users to have the same block as you are running on your networks. In fact, to go further, any networks that are behind your VPNs, you will not want them to be commonly used for home networks.

I try and stay away from the 192.168.*.* blocks for business use. Most likely the home users are using 192.168.0.* and 192.168.1.*, but not always.

An example set up simple corporate network.
Internal Networks: 10.20.10.0/24
DMZ: 10.20.30.0/24
Secured Development: 10.20.40.0/24
VPN Network: 172.27.99.0/24

A road warrior or home user would connect to the VPN. They will get a 172.27.99.* for their VPN address. If I have configured a split VPN, then only the networks behind the VPN gateway will have routes added to the VPN client. The VPN client will still be able to access their local traffic and get access to the Internet without going through the VPN. If I configured Tunnel Mode VPN, and can force ALL traffic to go through the VPN or just allow the client to have access to their local network, but any traffic outside of their local network gets tunneled down the VPN.

There are some VPNs that will bridge traffic and make the VPN client seem like their are on one of the local work networks, but these are not done much any more.

Does RipBot assume everything is flat network (Layer2) or does it allow routing to take place (Layer 3) and jump networks to appropriate routed destination.

Does RipBot bind to single IP address or does it bind to all the local addresses on the machine. I wondering if that could be causing issues if it is binding to a single address as this will cause issues with VPNs.

Did I understand the question right?

As for what VPN I recommend, that would be OpenVPN. I would look at using a Raspberry Pi and a firewall distro, or a wireless router that comes bundled with a OpenVPN gui. Learning OpenVPN, especially, with everything it can do, is not for the faint of heart.

[Atak_Snajpera]

Does RipBot bind to single IP address or does it bind to all the local addresses on the machine. I wondering if that could be causing issues if it is binding to a single address as this will cause issues with VPNs.
It binds to one specified IP for encodingclient (selected in Client IP combobox) and encodingserver (selected via command line).

According to mparade post here https://forum.doom9.org/showthread.php?p=1889585#post1889585
other ip is 10.10.10.10 - TheGreenBow Virtual Miniport Adapter. Does not look like anything useful...

[howzz]

IT is complicated..
https://i.imgsafe.org/28/286ce8b657.png

https://i.imgsafe.org/28/286ce86c97.png

https://i.imgsafe.org/37/37bfdbdafa.png


TLC is still pathetic in comparison to old good MLC. Write speed on Samsung 970 PRO is ~2.5 GiB/s (No SLC cache BS)!

are these numbers in FPS i assume?

my suggestion for the TLC was because realistically, for cost reasons. But if money is no object, the Samsung Pro really is the way to go. but for those building large capacity 1TB/2TB drives for NvMe, TLC is a pretty fast compromise imo.

edit: are there even any 2TB samsung MLC NvMes? at least i can't find any.

[howzz]

and secondly, i forgot to ask. is there any quality lost if choosing GPU as the decoder as oppose to Lmash. :p
i mean decoding is decoding right? quality is affected during the x265 "encoding" calculations.

[Atak_Snajpera]

and secondly, i forgot to ask. is there any quality lost if choosing GPU as the decoder as oppose to Lmash. :p
i mean decoding is decoding right? quality is affected during the x265 "encoding" calculations.

No quality penalty. GPU just provides frames to encoder.

[Ryushin]

It binds to one specified IP for encodingclient (selected in Client IP combobox) and encodingserver (selected via command line).

According to mparade post here https://forum.doom9.org/showthread.php?p=1889585#post1889585
other ip is 10.10.10.10 - TheGreenBow Virtual Miniport Adapter. Does not look like anything useful...

Can you change Ripbot so there is an option to bind to all IPs on the local machine which I think should be the default? I also run IPv6, so it will be nice to just put a DNS name in instead of a IP. Also, me being me, to be able to bind to certain IPs is also very beneficial and I do that all the time for machines that are connected on multiple networks, especially if one of them is Internet facing and I want to only provide a service to internal clients.

[guest]

So today I was able to test a reasonably sized 4K movie..

I chose to do "Frozen", which I stripped out the audio, as I don't need/want TrueHD (turned out the thd track was corrupted anyway).

So the file ended up being 42.5Gb @ 56.8Mb/s, NO audio, or subs !!

After the encoding if was 35.25Gb @ 47.1Mb/s, using CRF 12.

After the initial loading of the job, it took a further 3 hrs:37 m to complete the encode.

The combining took 1:45 mins, and the muxing took 2:55 mins for a total of only 4:40 mins.

A lot better than this :-

..the combining of the chunks took 10 minutes 30, then the muxing process took a further 15 minutes 30 .. (from post #17533)

which was admittedly a larger file with all it's tracks, but on slow SSD's.

Now I would think that "Frozen" would have taken a little longer if it had to do EVERYTHING, but I did the final "mux" with MKVToolnix, to add audio & subs.

[guest]

So I'm doing some more 4K encoding today, and I have been having some problems with the connection to some of the DE servers, in the other room....wasn't happening yesterday....

I got these errors, and wondering what might be causing them :-

[7/11/2019 13:35:33] TCPClient7 raised exception while attempting to sent command.(Not Connected)
[7/11/2019 13:35:47] TCPClient10 raised exception while attempting to sent command.(Not Connected)
[7/11/2019 13:40:00] TCPClient8 raised exception while attempting to sent command.(Not Connected)
[7/11/2019 13:40:00] TCPClient7 raised exception while attempting to sent command.(Not Connected)
[7/11/2019 13:46:06] TCPClient12 raised exception while attempting to sent command.(Not Connected)
[7/11/2019 13:46:30] TCPClient12 raised exception while attempting to sent command.(Not Connected)
[7/11/2019 13:56:27] TCPClient13 raised exception while attempting to sent command.(Not Connected)
[7/11/2019 13:57:53] TCPClient9 raised exception while attempting to sent command.(Not Connected)

But it seems to be going OK now, I think it takes a while for the process to "warm up".

Another thing I've noticed that might be associated with this, is some chunks will get to a certain %, and just stall there :(

And with all the chunks "flashing" is some way of showing that they are processing, it's a bit hard to focus in on which ones are doing this.

Not sure if the chunk "line's" are suppose to flash, but it would be a lot easier on the eyes if maybe they changed font size and/or colour, and NOT flash....just as well I'm not "epileptic".

And I have a feature request for chunks....it would be handy to have a small display of how many "chunks" are being processed, instead of having to count them.

And to top it off, how about some more DE servers, say another 4, at least. Need all the help I can get, and I have more pc's I could add to the 4K process.

And no I don't like the idea of running separate sessions with different pc's, that really doesn't speed up my process...I just want to get it done one "system", as fast as possible !!!

I do smaller basic encodes on separate pc's.

[mparade]

Just use builtin in windows.

Could you suggest something in my case for the VPN connection to work? Admin would like to help if problem is on "his side".

Thank you for the help.

[GZZ]

So I'm doing some more 4K encoding today, and I have been having some problems with the connection to some of the DE servers, in the other room....wasn't happening yesterday....

I got these errors, and wondering what might be causing them :-

[7/11/2019 13:35:33] TCPClient7 raised exception while attempting to sent command.(Not Connected)
[7/11/2019 13:35:47] TCPClient10 raised exception while attempting to sent command.(Not Connected)
[7/11/2019 13:40:00] TCPClient8 raised exception while attempting to sent command.(Not Connected)
[7/11/2019 13:40:00] TCPClient7 raised exception while attempting to sent command.(Not Connected)
[7/11/2019 13:46:06] TCPClient12 raised exception while attempting to sent command.(Not Connected)
[7/11/2019 13:46:30] TCPClient12 raised exception while attempting to sent command.(Not Connected)
[7/11/2019 13:56:27] TCPClient13 raised exception while attempting to sent command.(Not Connected)
[7/11/2019 13:57:53] TCPClient9 raised exception while attempting to sent command.(Not Connected)

But it seems to be going OK now, I think it takes a while for the process to "warm up".

Another thing I've noticed that might be associated with this, is some chunks will get to a certain %, and just stall there :(

And with all the chunks "flashing" is some way of showing that they are processing, it's a bit hard to focus in on which ones are doing this.

Not sure if the chunk "line's" are suppose to flash, but it would be a lot easier on the eyes if maybe they changed font size and/or colour, and NOT flash....just as well I'm not "epileptic".

And I have a feature request for chunks....it would be handy to have a small display of how many "chunks" are being processed, instead of having to count them.

And to top it off, how about some more DE servers, say another 4, at least. Need all the help I can get, and I have more pc's I could add to the 4K process.

And no I don't like the idea of running separate sessions with different pc's, that really doesn't speed up my process...I just want to get it done one "system", as fast as possible !!!

I do smaller basic encodes on separate pc's.

You should definitly look in your Windows system log and see if your netcard is disconnecting/reconnecting. I had a issue like yours when I had a bad driver for my 10Gbe netcard, upgrading to a newer driver helped. I think its more of a network issue then a problem in the application.

[guest]

You should definitely look in your Windows system log and see if your netcard is disconnecting/reconnecting. I had a issue like yours when I had a bad driver for my 10Gbe netcard, upgrading to a newer driver helped. I think its more of a network issue then a problem in the application.

I am only using the onboard 1 Gbe NIC's for DE, I doubt that there is any advantage of using a 10 Gbe, however, I am only using the Windows NIC drivers, so I will endeavour to update ALL the Intel drivers, so thanks for the suggestion.

I have to agree that it's certainly a network / cable problem, I had to swap out a patch cable yesterday, as it was dropping in & out, causing problems.

Just out of interest, what 10 Gbe NIC's are you running ?? do you use RJ45 or SFP+ connections ??

I'm gradually setting up a 10 Gbe LAN, and mainly using Mellanox NIC's. (but not for RB)

[Ryushin]

Could you suggest something in my case for the VPN connection to work? Admin would like to help if problem is on "his side".

Thank you for the help.

I think the first thing is to verify that you can connect to each process. From your Ripbot machine, install nmap (they have a windows version).

Then using nmap, see if the Encoding Server ports are open on your other machines. I would run command like this from Linux:
nmap -p 1000,2000,3000,4000 192.168.9.7

My results look like this:
nmap -p 1000,2000,3000,4000 192.168.9.7
Starting Nmap 7.80 ( https://nmap.org ) at 2019-11-07 05:22 MST
Nmap scan report for taffy (192.168.9.7)
Host is up (0.0023s latency).

PORT STATE SERVICE
1000/tcp open cadlock
2000/tcp filtered cisco-sccp
3000/tcp filtered ppp
4000/tcp filtered remoteanything

Nmap done: 1 IP address (1 host up) scanned in 1.25 seconds

I'm running one Encoding Server on that client. The scan shows port 1000 as open, and the other ports as filtered. Filtered will be either there is nothing listening on those ports or a firewall has filtered them.

That will at least tell you if you have some kind of network problem.

[byteshare]

Another thing I've noticed that might be associated with this, is some chunks will get to a certain %, and just stall there :(

And with all the chunks "flashing" is some way of showing that they are processing, it's a bit hard to focus in on which ones are doing this.

Not sure if the chunk "line's" are suppose to flash, but it would be a lot easier on the eyes if maybe they changed font size and/or colour, and NOT flash....just as well I'm not "epileptic".
Add "/restart-if-no-progress" to your startup script for the servers. Problem is that FFMPEG and/or AVISynth can get hung up.

[guest]

Add "/restart-if-no-progress" to your startup script for the servers. Problem is that FFMPEG and/or AVISynth can get hung up.

Hi byteshare,

I DO have that on EVERY PC, and tbh, I don't think it works that well.

[Atak_Snajpera]

Hi byteshare,

I DO have that on EVERY PC, and tbh, I don't think it works that well.

Do ffmpeg.exe and x26x.exe still use cpu when this happens?

[GZZ]

I am only using the onboard 1 Gbe NIC's for DE, I doubt that there is any advantage of using a 10 Gbe, however, I am only using the Windows NIC drivers, so I will endeavour to update ALL the Intel drivers, so thanks for the suggestion.

I have to agree that it's certainly a network / cable problem, I had to swap out a patch cable yesterday, as it was dropping in & out, causing problems.

Just out of interest, what 10 Gbe NIC's are you running ?? do you use RJ45 or SFP+ connections ??

I'm gradually setting up a 10 Gbe LAN, and mainly using Mellanox NIC's. (but not for RB)

First off DE encoding wont benefit from 10gbe at all and you properly need better cable (cat6a). I use it to gain better performance from my synology NAS. On avg it gives me 300-400mb/s and up to 700mb/s. So really nice when moving large uhd/bluray files.

I use RJ45 cable and a 8 port buffalo switch (mp2008).

[guest]

First off DE encoding wont benefit from 10gbe at all

I use RJ45 cable and a 8 port buffalo switch (mp2008).

Yes, I think I had mentioned already that 10 Gbe would be no advantage to RB....

I'm using SFP+ cables & NIC's, with a MikroTik 8 port switch.

You didn't mention what NIC's you're using...

[guest]

Do ffmpeg.exe and x26x.exe still use cpu when this happens?

TBH, that didn't even enter my mind, to check !!

I wouldn't really know what I was looking for, anyway.

I just watched the stalled chunk/server, for a couple of minutes, and when it hadn't progressed, I simply stopped it, and let another server take over.

I DID (once) have pop error msg stating that Encoder Stalled, and I think it was in relation to FFMPEG or similar, didn't stay up for long.

I'm using the very latest RB build, and I am going to update all my NIC drivers today, probably won't affect this...but good to do.

[GZZ]

Yes, I think I had mentioned already that 10 Gbe would be no advantage to RB....

I'm using SFP+ cables & NIC's, with a MikroTik 8 port switch.

You didn't mention what NIC's you're using...

Asus XG-C100C in my desktop and Intel x540-T2 in my nas.

[guest]

Asus XG-C100C in my desktop and Intel x540-T2 in my nas.

So just a simple P2P connection between them, then.

Are you planning to expand to other pc's ??

To get the best out of 10 Gbe, you need fast drives @ both ends.

I'm just starting out with 10 Gbe, and the transfer speeds vary a LOT.

[byteshare]

Update today, MKVTooNix update to 39.0.0, core 2019.11.08, and scripts 2019.11.08.
@Atak Anything that could affect us or more along the lines of bug fixes?

[GZZ]

So just a simple P2P connection between them, then.

Are you planning to expand to other pc's ??

To get the best out of 10 Gbe, you need fast drives @ both ends.

I'm just starting out with 10 Gbe, and the transfer speeds vary a LOT.

10GBE is more the for the fun of it. But I got 1GBE Fiber internet connection and if I use it close to 100%, then copying a file over the network will make the download/upload suffer. No problem with that on 10GBE. For the moment I dont plan on other expansions of my network.

Got 2 SSD in Raid 0 for Encoding and processing files. It gives me 1200mb/s of read/write speed. On my nas its just 4x10GB Ironwolf disc in Raid 5 (can be expanded to 8 disc).

[guest]

Update today, MKVTooNix update to 39.0.0, core 2019.11.08, and scripts 2019.11.08.
@Atak Anything that could affect us or more along the lines of bug fixes?

BIG changes in Encoding Client for server "control" :)

Can't wait to check this out :)

[mparade]

I think the first thing is to verify that you can connect to each process. From your Ripbot machine, install nmap (they have a windows version).

Then using nmap, see if the Encoding Server ports are open on your other machines. I would run command like this from Linux:
nmap -p 1000,2000,3000,4000 192.168.9.7

My results look like this:
nmap -p 1000,2000,3000,4000 192.168.9.7
Starting Nmap 7.80 ( https://nmap.org ) at 2019-11-07 05:22 MST
Nmap scan report for taffy (192.168.9.7)
Host is up (0.0023s latency).

PORT STATE SERVICE
1000/tcp open cadlock
2000/tcp filtered cisco-sccp
3000/tcp filtered ppp
4000/tcp filtered remoteanything

Nmap done: 1 IP address (1 host up) scanned in 1.25 seconds

I'm running one Encoding Server on that client. The scan shows port 1000 as open, and the other ports as filtered. Filtered will be either there is nothing listening on those ports or a firewall has filtered them.

That will at least tell you if you have some kind of network problem.

Thank you very much for the help.
I got this result:

Nmap scan report for amd-tr4.alllight.hungary (192.168.2.24)

Host is up (0.012s latency).



PORT STATE SERVICE

1000/tcp open cadlock

2000/tcp open cisco-sccp

3000/tcp open ppp

4000/tcp open remoteanything



Nmap done: 1 IP address (1 host up) scanned in 2.33 seconds

[Atak_Snajpera]

Thank you very much for the help.
I got this result:

You were supposed to do that test from work-pc to home-pc. (192.168.88.178)

[mparade]

From server machine:

Starting Nmap 7.80 ( https://nmap.org ) at 2019-11-09 18:52 Közép-európai téli ido

Note: Host seems down. If it is really up, but blocking our ping probes, try -Pn

Nmap done: 1 IP address (0 hosts up) scanned in 3.21 seconds



screenshot about it:

http://mammutmail.com/hu/download/aa18c3bcdfc3eb71d61b3c97600352e6

[Atak_Snajpera]

Ask your admin for help. I guess that your vpn has been configured to block uncommon ports (1001,1002,1003 and so on). Weird stuff...

Next time use www.postimage.org site for images because that full screen adv is driving me crazy ;)