View Full Version : RipBot264 v1.18.3 - Simple and easy to use GUI -> IPOD . PSP . CONSOLES . BLURAY
Pages :
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
[
20]
21
22
ReinerSchweinlin
13th March 2021, 16:15
double clicking the "jobXX_EncodeAudio1/2/3.cmd file(s) (within the applicable RipBot264temp job folder) manually launches the audio encodes. the desired tracks can be combined using mkvtoolnix or the likes.
Thanx, I know. Thats not what i was asking - doing it manualy is always possible..
In some cases - but I canīt see which ones - there IS a "Copy video stream" option in RB.
@Pauly Dunne
Thanx. I did see the option too in a few cases, I am pretty sure I had none of the ones you mentioned as inputs.
FuzzyNutz
13th March 2021, 18:10
IT does what it's says on the tin
tin says shinola.
guest
14th March 2021, 02:14
tin says shinola.
Why don't you say what you REALLY mean ?? lol (or is that why it was edited ?)
OK, so to try and answer your question, the "Reconnect" when enabled, allows the server to reconnect automatically if there is some interruption in the connection, similar to having /restart-if-no-progress, added to the cmd line.
Also, if this is enabled, and you have started an encode, then you decide to start another pc to help, once it's up & running, it will kick in and start encoding automatically.
As for "suspend jobless server", if enabled, when you have one or more servers helping with DE, and you have a queue of jobs to get thru, when a job is coming to the end of the chunks, and a particular server has no more to do on that job, it should go to sleep (if it's set up to do so), and then once the next job is starting, then the sleeping server will be woken up, and should start encoding.
Particularly helpful if the remaining chunks & completion process is going to take a while.
I had this happen for me a couple of weeks ago, pretty impressive...saves a bit of electricity :)
guest
14th March 2021, 02:33
i have an i5 10th gen and an Nvidia 1650 GPU.
im not after outright speed but more quality. currently im using CPU for 4K HDR encodes. im wondering if i should be using some sort of combination of GPU and CPU or will i loose quality?
You should be able to use both, using appropriate cmd line switches.
/port 1000 /minimize /priority low /x264-opencl-device-type CPU
/port 2000 /minimize /priority low /x264-opencl-device-type GPU
or
/port 1000 /minimize /priority low /x264-opencl-device-id 0
As for quality, it might depend on what filtering you're using.
I tried some of these switches today, and I couldn't see that it enabled anything different
guest
15th March 2021, 07:42
So I have spent a few hours looking around for updates to all the Tools used in RipBot, and I found quite a few, there are a lot that haven't been updated for years, and to be honest, there might be several that RipBot doesn't use anymore.
So I've incorporated them into the Tool's Folder, and modified the .ini's so that the new version/build numbers show up when you chose the Tool's tab.
Removed picture, as it's now redundant, due to latest available updates
chainring
15th March 2021, 16:32
So I have spent a few hours looking around for updates to all the Tools used in RipBot, and I found quite a few, there are a lot that haven't been updated for years, and to be honest, there might be several that RipBot doesn't use anymore.
So I've incorporated them into the Tool's Folder, and modified the .ini's so that the new version/build numbers show up when you chose the Tool's tab.
I gave it a test run, and only had 1 hiccup with the x264 version I had chosen (there are quite a few modded one's out there).
Just sayin'.
Share the love and upload your tools folder. Please?
blacksapprow
17th March 2021, 15:09
@Atak
With version v1.26.0 it says "Added: VP9 decoding" how can we choose this option?
Atak_Snajpera
17th March 2021, 15:15
Just open any file which uses vp9 codec.
blacksapprow
17th March 2021, 15:22
Sorry but, where is "MKV encoded" pane?
My current system is quite old. i7-4960X CPU with GTX 670 4GB. As far as I know it needs 6th. generation processor & like GTX 10xx GPU.
RipBot264 Settings pane displays at right MPEG-2, VC1, AVC, HEVC and OTHER am I missing it here?
Atak_Snajpera
17th March 2021, 18:24
It means that RipBot264 can decode files encoded by VP9 codec. I didn't write "Added: VP9 HARDWARE decoding"
blacksapprow
17th March 2021, 20:08
VP9 is a very good quality encoder&decoder. Can you think of adding it as a decoder?
guest
18th March 2021, 02:01
Sorry but, where is "MKV encoded" pane?
My current system is quite old. i7-4960X CPU with GTX 670 4GB. As far as I know it needs 6th. generation processor & like GTX 10xx GPU.
RipBot264 Settings pane displays at right MPEG-2, VC1, AVC, HEVC and OTHER am I missing it here?
Hi blacksapprow,
You system might be a little dated, but it's better than some, I'm sure, and should be more than capable of encoding with RipBot.
I have a few PC's that aren't as good as your's, and they work quite well.
OK, there really isn't an "MKV encoded" pane", you choose what file type AFTER you've created a job (see pic)
This :- MPEG-2, VC1, AVC, HEVC and OTHER, is ONLY where you choose what decoder you want to use, either CPU (recommended) or GPU (if you have good fast powerful video card, Intel or nVidia).
https://i.imgur.com/P4Unp0K.jpg
guest
18th March 2021, 02:44
It means that RipBot264 can decode files encoded by VP9 codec. I didn't write "Added: VP9 HARDWARE decoding"
You really should start considering more encoding options, for video & audio, eg:- VP9, NVEnc and E-AC3.
There are a lot of requests, and nothing gets done, because you don't see the need.
The "other" free encoding app's, out there, are able to do all this, but unfortunately, RipBot is starting to fall behind.
jlpsvk
18th March 2021, 15:41
is anybody experiencing that sometimes encodes ends without error, but is not completely encoded???
ReinerSchweinlin
21st March 2021, 11:32
@Atak,
Stumbled across some stuff, so I thought Iīd give feedback:
- If filenames contain characters like "?", ripbot waits forever while preparing a job saying "waiting for file...."
- Some files with variable framerates are impossible to get right with Ripbot, it seems the length (or the frame count, fps...) is misinterpreted wrong (I know, youīd need a sample - any private adress I can send it to?)
- If an already encoded (or partially encoded file) is edited and only the audio section is changed, the whole file is re-encoded again, even if the video already is done and muxed in the temp-folder.
- Canīt find under which conditions the "copy video" is possible or not, could you help ?
- if the output folder somehow accidently points into nothingness (a non existand drive letter for example), ripbot is behaving like everything is normal, finishing without an error (but oobviously producing no output). Of course the workaround to manually call the mux-batch files etc.. is possible, so not much is lost - but maybe a small check would come in handy (or interpret the error from the muxer shown in the console).
Keep up the good work, thanx for Ripbot!
ReinerSchweinlin
21st March 2021, 11:42
You really should start considering more encoding options, for video & audio, eg:- VP9, NVEnc and E-AC3.
There are a lot of requests, and nothing gets done, because you don't see the need.
The "other" free encoding app's, out there, are able to do all this, but unfortunately, RipBot is starting to fall behind.
Well, I certainly see that one could always do more and implement more features. There are always people wishing for more features. But we have to keep in mind that this (Ripbot) is something we get for free and itīs totaly up to Atak to decide whether he wants something added or not. I personaly wouldnīt mind some more documentation on Ripbot - but hey... Itīs Ataks project and his spare time hes giving into it.
What I like about Ripbot:
Distributed encoding ... thats simply the killer feature.
Just like mentioned in post 1: Itīs simple while still being powerfull. Of course, Staxrip, hybrid, etc... are more flexible - but also require a lot more time to fiddle around. In Ripbot, a lot of time went into the decision of which preset to offer... Which makes it convinient for the user (I am sure Atak spent a lot of time testing the degrain settings to come up with something usefull - or tesed around with CU sizes to max out CPU usage and find a good speed balance... In many cases there was more work done than obvious for the standard user - I appreciate this attention to detail).
Given its complexity, its suprisingly stable - it just works - and thats worth a lot more than 230909 feauters (in my oppinion).
ReinerSchweinlin
21st March 2021, 11:45
VP9 is a very good quality encoder&decoder. Can you think of adding it as a decoder?
Do you mean encoder? Decoding already works.
Atak_Snajpera
21st March 2021, 12:47
- If filenames contain characters like "?", ripbot waits forever while preparing a job saying "waiting for file...."
How can you have filename with "?" character ???
https://i.postimg.cc/cL85ZGy9/Untitled-2.png
- Some files with variable framerates are impossible to get right with Ripbot, it seems the length (or the frame count, fps...) is misinterpreted wrong (I know, youīd need a sample - any private adress I can send it to?)
variable frame rate has been always a pain in the ass...
- If an already encoded (or partially encoded file) is edited and only the audio section is changed, the whole file is re-encoded again, even if the video already is done and muxed in the temp-folder.
Works as intended. Job is a job. You change something then you start from the scratch.
- Canīt find under which conditions the "copy video" is possible or not, could you help ?
Available only if input file is TS ,MTS, M2T or M2TS
- if the output folder somehow accidently points into nothingness (a non existand drive letter for example), ripbot is behaving like everything is normal, finishing without an error (but oobviously producing no output). Of course the workaround to manually call the mux-batch files etc.. is possible, so not much is lost - but maybe a small check would come in handy (or interpret the error from the muxer shown in the console).
Will take a look...
Atak_Snajpera
21st March 2021, 13:20
Was there any RipBot264 version that supported DGHable for tone mapping?
But why would you use worse tonemapping algorithm?
Old (DGHable)
https://i.postimg.cc/Jz0CXzDp/old.png
New (Tweaked by me BT2446)
https://i.postimg.cc/GhcCcQcw/new.png
guest
21st March 2021, 14:02
Well, I certainly see that one could always do more and implement more features. There are always people wishing for more features. But we have to keep in mind that this (Ripbot) is something we get for free and itīs totaly up to Atak to decide whether he wants something added or not. I personaly wouldnīt mind some more documentation on Ripbot - but hey... Itīs Ataks project and his spare time hes giving into it.
What I like about Ripbot:
Distributed encoding ... thats simply the killer feature.
Just like mentioned in post 1: Itīs simple while still being powerfull. Of course, Staxrip, hybrid, etc... are more flexible - but also require a lot more time to fiddle around. In Ripbot, a lot of time went into the decision of which preset to offer... Which makes it convinient for the user (I am sure Atak spent a lot of time testing the degrain settings to come up with something usefull - or tesed around with CU sizes to max out CPU usage and find a good speed balance... In many cases there was more work done than obvious for the standard user - I appreciate this attention to detail).
Given its complexity, its suprisingly stable - it just works - and thats worth a lot more than 230909 feauters (in my oppinion).
I agree 1000% that DE, IS the killer feature, nobody else has or seems to be attempting to add this to the likes of Staxrip or Handbrake.
Staxrip has a parallel encoding option, but that's just not the same :(
Hybrid is insanely complicated.
Handbrake is simple, has a plethora of video & audio encoding options, but single encoding.
But a few extras would make RB, just so, so much better, and put it at the "top of the heap".
I also have to say that "feauters", really confused me, but then I realised it was a typo. Oh, and just 3 or 4 new features would be plenty :)
guest
22nd March 2021, 02:19
Actually I'm facing an issue with HDRtoSDR tonemapping. Currently I'm using v1.26.0. But when I encode a movie in 1080p SDR format from a 4K HDR REMUX source by turning on the Tonemap option, the output I got is little bit Darker. While the 1080p REMUX source of that same movie is very light and colorful. So are there any tweak settings that can fixed this issue?
So first of all, why are you downsizing from good HDR 4K to SDR 1080p ?? Haven't you got a TV that can play 4K ??
So, when you load your file into RipBot and go to this page, do you have the "Tonemap" option enabled ??
The Tonemap options changed a while back.
Also, do you check the "preview" once you've done you settings ??
Atak_Snajpera
22nd March 2021, 14:36
you will have to manually tweak values in file HDRtoSDR.avs
this line
video=ConverXYZ_BT2446_C_HDRtoSDR(video,PQMode=true,Lhdr=50000.0,Lsdr=100.0,pColor=0,pct_ref=0.6,pct_ip=0.6,pct_wp=1.0,pct_sdr_skin=1.0,pct_hdr_skin=0.44,threads=1)
ReinerSchweinlin
22nd March 2021, 15:31
thanx for getting back :)
How can you have filename with "?" character ???
https://i.postimg.cc/cL85ZGy9/Untitled-2.png
If files from a unix share are used for example. Lots of possibilities.
variable frame rate has been always a pain in the ass...
I know :)
Works as intended. Job is a job. You change something then you start from the scratch.
Well - if the whole video stream is encoded and only the audio stream changes or is added - why encode the whole videostream again? ("oops, forgott second audio, lets add it" - now THE WHOLE job incldugin video encoding is done again - instead of only the second audio stream...).
I am fully aware that one can alwys deal with this kind of stuff manualy.
Available only if input file is TS ,MTS, M2T or M2TS
Ah, I see. Thanx. Any chance of extending the "video copy" option to other containers?
Will take a look...
Thanx
ReinerSchweinlin
22nd March 2021, 15:34
I agree 1000% that DE, IS the killer feature, nobody else has or seems to be attempting to add this to the likes of Staxrip or Handbrake.
Staxrip has a parallel encoding option, but that's just not the same :(
Hybrid is insanely complicated.
Handbrake is simple, has a plethora of video & audio encoding options, but single encoding.
But a few extras would make RB, just so, so much better, and put it at the "top of the heap".
I also have to say that "feauters", really confused me, but then I realised it was a typo. Oh, and just 3 or 4 new features would be plenty :)
Yeah, everybody always has a wish list :) Yesterday I thought: "cleaning up some cartoons would be nice - maybe I try to fiddle in anime4k in its avisynth version as a custom avs skript"... No luck so far, have to do more fiddling :)
blacksapprow
22nd March 2021, 21:17
@ProBroSam
Which player software are you using.
MegaCodecPack with MadVR combination gives good colors when playing UHD 4K content.
slalom
22nd March 2021, 22:31
Well - if the whole video stream is encoded and only the audio stream changes or is added - why encode the whole videostream again? ("oops, forgott second audio, lets add it" - now THE WHOLE job incldugin video encoding is done again - instead of only the second audio stream...).
I am fully aware that one can alwys deal with this kind of stuff manualy.
RipBot264 doesn't know you forgot, use MKVMerge
You really should start considering more encoding options, for video & audio, eg:- VP9, NVEnc and E-AC3.
E-AC3 is very popular in series, anyone knows, is that a free codec?
guest
23rd March 2021, 01:33
E-AC3 is very popular in series, anyone knows, is that a free codec?
Hi slalom, it must be free, as you can very easily convert to E-AC3 using eac3to, which uses FFMEG.
And Handbrake does E-AC3 conversions, as well.
ReinerSchweinlin
23rd March 2021, 07:31
RipBot264 doesn't know you forgot, use MKVMerge
As I said, this can always done manualy, but that was not what I was asking.
If the answer to every issue or proposal would be: "do it yourself manualy" the point of feedback would be a little pointless :)
E-AC3 is very popular in series, anyone knows, is that a free codec?
google it :)
Just kidding... Dolby Digital is free nowadays, since the patents expired. DD+ Licences can be bought nowadays, but if it really is free for pesonal usw - I dont know.
guest
23rd March 2021, 09:40
As I said, this can always done manually, but that was not what I was asking.
If the answer to every issue or proposal would be: "do it yourself manually" the point of feedback would be a little pointless :)
So what where you asking ??
If you forget to add something to RB and then process it, you're going to either add it manually afterwards, or do it again !!!
RB can actually just process video, but it can't just process audio tracks.
And yes, some feedback IS pointless.
google it :)
Just kidding... Dolby Digital is free nowadays, since the patents expired. DD+ License's can be bought nowadays, but if it really is free for personal use - I don't know.
I had already answered this.
slalom
23rd March 2021, 16:12
As I said, this can always done manualy, but that was not what I was asking.
If the answer to every issue or proposal would be: "do it yourself manualy" the point of feedback would be a little pointless :)
Ok, you would have to add a new job with the encoded video (wait for the file to add), add from the other job the parts (subs/audio) you forgot, select "copy stream" for video (if it existed), press start and wait for it to mux
chainring
24th March 2021, 03:55
While I haven't tried it, an option to process audio and not video would be to feed it through VidCoder. Fast. Simple. Works great.
ReinerSchweinlin
24th March 2021, 14:56
So what where you asking ??
- If an already encoded (or partially encoded file) is edited and only the audio section is changed, the whole file is re-encoded again, even if the video already is done and muxed in the temp-folder.
My thought was: If a job already is finished and one wants to change something in the audio section, it would be nice if the already encoded video (of not changed) would be kept. At the moment, itīs encoded once more (which is unnecessary).
Since Ripbot keeps track of all the already encoded chunks, the check for "is video completed already" wouldnīt be too difficult.
If you forget to add something to RB and then process it, you're going to either add it manually afterwards, or do it again !!!
I know, thatīs why I said:
I am fully aware that one can always deal with this kind of stuff manualy.
RB can actually just process video, but it can't just process audio tracks.
Except in certain cases when the "copy video" option is possible :)
Don`t get me wrong, I am fully capable to solve these "problems" manualy. I just thought it would be a nice addition to ripbot. And since these functions are not very complicated, they might be considered. If not, fine with me, its a free peace of software and the decision to implement something or fix a bug or change something is up to Atak.
I had already answered this.
So you think the info here is wrong?
https://en.wikipedia.org/wiki/Comparison_of_audio_coding_formats
It mentions AC3 as free (patents exired), EAC not free.
So which is correct? looking up Dolby Labs Website, they offer licences, no mentioning of EAC being royalty free.
Just because some feature is included somehwere doesnīt mean itīs free as in "no patents, no royalty, open source...".
ReinerSchweinlin
24th March 2021, 14:59
Ok, you would have to add a new job with the encoded video (wait for the file to add), add from the other job the parts (subs/audio) you forgot, select "copy stream" for video (if it existed), press start and wait for it to mux
Thanx :) I know - It can be done manualy. Ma thought was to solve it in Ripbot. Of course one can allways call up any muxer, ffmpeg, any other muxing GUI, etc...
While I haven't tried it, an option to process audio and not video would be to feed it through VidCoder. Fast. Simple. Works great.
Thanx for the suggestion. At the moment, I use DMMediaencoder for stuff like this - or write a small batch file using mkv-muxer or ffmpeg via CLI.
Thanx all for participating, maybe I should have rephrased. I wasnīt looking for a solution, I was mentioning a behaviour, deducing a proposal in Ripbot.
guest
25th March 2021, 02:08
So you think the info here is wrong?
https://en.wikipedia.org/wiki/Comparison_of_audio_coding_formats
It mentions AC3 as free (patents expired), EAC not free.
So which is correct? looking up Dolby Labs Website, they offer license's, no mentioning of EAC being royalty free.
Just because some feature is included somewhere doesnīt mean itīs free as in "no patents, no royalty, open source...".
Well, if you can do an E-AC3 conversion with eac3to, Handbrake, and more (and they are free), then E-AC3 must be (that's my logic, anyway)
guest
25th March 2021, 02:17
At the moment, I use DMMediaencoder for stuff like this -
I had never heard of that app, so I Googled it, it's a little bit old (but whatever works, I guess)
Maybe you could try VidCoder, as chainring suggested, (it's current)
ReinerSchweinlin
25th March 2021, 04:05
Thanx for getting back. Again, I am not searching for any other tool to do this :) I have plenty of solutions. I was making a suggestion for Ripbot.
But since its mentioned again - Vidcoder is a handbrake GUI - so not Video-passhtrough and no AAC-HE V2 (which - in my case is what I am using and Ripbot has it conviniently built in) - at least last time I checked..
Again, I could list dozens of solutions how to use OTHER Tools to do this - my intend was to make a proposal for Ripbot.
But thanx.
guest
25th March 2021, 04:13
Thanx for getting back. Again, I am not searching for any other tool to do this :) I have plenty of solutions. I was making a suggestion for Ripbot.
But since its mentioned again - Vidcoder is a handbrake GUI - so not Video-passhtrough and no AAC-HE V2 (which - in my case is what I am using and Ripbot has it conviniently built in) - at least last time I checked..
Again, I could list dozens of solutions how to use OTHER Tools to do this - my intend was to make a proposal for Ripbot.
But thanx.
OK, well that's good that you have other options (as do I, when things go a bit pear shaped).
Yes, I noticed that VidCoder is built around Handbrake (not sure how that works), but I have never used VidCoder..I use Handbrake for certain things that I can't with RipBot.
Yes, a lot of us suggest updates, mod's & extra's, but it seems to fall on deaf ears.
But like you say, it's free, it's Atak's "baby" so its completely up to him what he does & doesn't do :(
chainring
25th March 2021, 16:42
But since its mentioned again - Vidcoder is a handbrake GUI - so not Video-passhtrough and no AAC-HE V2 (which - in my case is what I am using and Ripbot has it conviniently built in) - at least last time I checked..
But thanx.
Well, darn, you're correct. I must have been thinking of something else.
jlcpremier
26th March 2021, 01:55
I am using distributed encoding and recently upgraded to v1.26 on all machines. I've noticed that on just about every job, a slave machine or two hangs when it finishes encoding that chunk. It will stop at either :02, :01 or :00 seconds left. If I manually disable that node by clicking the network button, it will re-encode that chunk on another node, or I can go into the temp folder and usually the chunk is there so then I just have to run the CombineAllChunks.cmd
We are running a full 16 server distributed encoding farm. I've noticed this problem mainly when using the avisynth filters for Mdegrain2 and KNLMeansCL. Each server is an HP EliteDesk 800G1 w/i7 and 8GB RAM on SSD, solely being used with CPU encoding (no GPU)
Is there any settings I can check or change to make this more reliable? You can see an example of how a job looks when it hangs below
https://i.ibb.co/0Fc8Rr4/ripbot-copy.png
guest
26th March 2021, 02:34
I am using distributed encoding and recently upgraded to v1.26 on all machines. I've noticed that on just about every job, a slave machine or two hangs when it finishes encoding that chunk. It will stop at either :02, :01 or :00 seconds left. If I manually disable that node by clicking the network button, it will re-encode that chunk on another node, or I can go into the temp folder and usually the chunk is there so then I just have to run the CombineAllChunks.cmd
We are running a full 16 server distributed encoding farm. I've noticed this problem mainly when using the avisynth filters for Mdegrain2 and KNLMeansCL. Each server is an HP EliteDesk 800G1 w/i7 and 8GB RAM on SSD, solely being used with CPU encoding (no GPU)
Is there any settings I can check or change to make this more reliable?
Welcome to the Forum.
Wow, 16 servers...nice :)
So was it working OK before the update to 1.26.0 ??
OK, for KNLMeanCL processing you need an appropriate, supported GPU.
MDegrain filters are pretty CPU intense, but shouldn't really cause any problems.
Also, do you know what version of Avisynth you're running (bottom of Encoding Server window is an easy way to check, you can simply run that from the RipBot264 installation folder).
So just out of interest, what were you encoding here (in reference to the screenshot) ?
Atak_Snajpera
26th March 2021, 07:38
I am using distributed encoding and recently upgraded to v1.26 on all machines. I've noticed that on just about every job, a slave machine or two hangs when it finishes encoding that chunk. It will stop at either :02, :01 or :00 seconds left. If I manually disable that node by clicking the network button, it will re-encode that chunk on another node, or I can go into the temp folder and usually the chunk is there so then I just have to run the CombineAllChunks.cmd
We are running a full 16 server distributed encoding farm. I've noticed this problem mainly when using the avisynth filters for Mdegrain2 and KNLMeansCL. Each server is an HP EliteDesk 800G1 w/i7 and 8GB RAM on SSD, solely being used with CPU encoding (no GPU)
Is there any settings I can check or change to make this more reliable? You can see an example of how a job looks when it hangs below
https://i.ibb.co/0Fc8Rr4/ripbot-copy.png
Next time when you get this problem please also show me what encoding server reports in main TAB and in tcp communication TAB. IT looks like string containing "encoded ..." Was not sent back to encoding client.
jlcpremier
26th March 2021, 09:05
Welcome to the Forum.
Wow, 16 servers...nice :)
So was it working OK before the update to 1.26.0 ??
OK, for KNLMeanCL processing you need an appropriate, supported GPU.
MDegrain filters are pretty CPU intense, but shouldn't really cause any problems.
Also, do you know what version of Avisynth you're running (bottom of Encoding Server window is an easy way to check, you can simply run that from the RipBot264 installation folder).
So just out of interest, what were you encoding here (in reference to the screenshot) ?
Yeah working in IT has it's perks :)
It wasn't getting hung as much but still would occasionally on jobs. I haven't really played around much with the NR filters before, so I think it may be more tied to that. I also notice the nodes take a lot longer to fire off when the filters are in use.
I looked up some info on KNLMeansCL and there wasn't a whole lot of info about it, in terms of ripbot, but in the test file I ran just using KNLMeansCL at levels 1, 3, and 5 for noise reduction it made a substantial difference with the noise reduction, and file size even though there's no real graphics card for it to use the GPU for. Just running it through the Degrain filter at each level didn't actually make much difference in the PQ or the size reduction of the file. For some reason putting them together did though.
Version of avisynth+ shows as 3.4 (r925)
I'm taking all 9 seasons of 24 I have on bluray and trying to compress them down and improve the picture. This particular show has so much noise and grain in the source files that a standard 1080P episode with no noise reduction is still around 2-3GB encoded at slow CQ24, with the Mdegrain2/KNLMeansCL filters set to max it drops down to about 400MB and still looks great. But that's over 200 episodes, so you can see why it being automated would be nice. :)
slalom
26th March 2021, 10:37
Thanx :) I know - It can be done manualy. Ma thought was to solve it in Ripbot. Of course one can allways call up any muxer, ffmpeg, any other muxing GUI, etc...
The answer is, you can't
guest
26th March 2021, 11:13
Yeah working in IT has it's perks :)
It wasn't getting hung as much but still would occasionally on jobs. I haven't really played around much with the NR filters before, so I think it may be more tied to that. I also notice the nodes take a lot longer to fire off when the filters are in use.
I looked up some info on KNLMeansCL and there wasn't a whole lot of info about it, in terms of ripbot, but in the test file I ran just using KNLMeansCL at levels 1, 3, and 5 for noise reduction it made a substantial difference with the noise reduction, and file size even though there's no real graphics card for it to use the GPU for. Just running it through the Degrain filter at each level didn't actually make much difference in the PQ or the size reduction of the file. For some reason putting them together did though.
Version of avisynth+ shows as 3.4 (r925)
I'm taking all 9 seasons of 24 I have on bluray and trying to compress them down and improve the picture. This particular show has so much noise and grain in the source files that a standard 1080P episode with no noise reduction is still around 2-3GB encoded at slow CQ24, with the Mdegrain2/KNLMeansCL filters set to max it drops down to about 400MB and still looks great. But that's over 200 episodes, so you can see why it being automated would be nice. :)
Hi, so have you tried MDegrain3 (or MDegrain4, custom filter you'd have to add yourself)..I find they do an excellent job of cleaning up things.
That's a fairly old version of Avisynth...
I'm also curious about the power consumption with 16 SFF servers running....just looking at your screenshot, even with 16 DE server's your processing speeds aren't that impressive, but that's probably due to the filters you're using.
Just out of interest, under the "Main" tab of RB, do you have "Limit to following filters only" checked ??
Also, under the "Distributed Encoding" tab, you could maybe bump up the "Chunks Size" to 2.
Well, that's my 10 cents worth. It's ALL about speed !!!!
Cheers
guest
28th March 2021, 07:50
So, I'm sure some of you remember and used to use this denoising filter when it was an integral function of RipBot264, but was replaced by MDegrain.
It did a pretty good job, I used to use quite a bit (back in the day), and I have only just now decided to figure out how "put it back" with several filtering options (settings acquired off the "Net", and referencing how it worked in a much older version of RB).
So if anyone is interested, you can get it here :-
Link has been removed due to limited feedback, and that the filter isn't "up to scratch".
slalom
28th March 2021, 21:42
I get an error, are you sure the file is ok?
slalom
29th March 2021, 12:30
WinRar v4.2 gives me error,
The archive is unknown format or damaged
v5.9 opens it fine
slalom
29th March 2021, 19:51
I later installed the v6.0 to be safe
will test that filter some time later
Ryushin
29th March 2021, 20:52
So, I'm sure some of you remember and used to use this denoising filter when it was an integral function of RipBot264, but was replaced by MDegrain.
I believe HQDN3D was taken out because it did not support 10 bit color. Since I convert everything to 10bit color and x265 (even from 8 bit sources) I'm afraid I can't use it. I also stopped using it because MDegrain2 was such a drastic improvement I never went back. Even when originally I was only getting 2fps from a Blue-ray source when using MDegrain2, the quality was worth the wait.
guest
30th March 2021, 00:07
I believe HQDN3D was taken out because it did not support 10 bit color. Since I convert everything to 10bit color and x265 (even from 8 bit sources) I'm afraid I can't use it. I also stopped using it because MDegrain2 was such a drastic improvement I never went back. Even when originally I was only getting 2fps from a Blue-ray source when using MDegrain2, the quality was worth the wait.
Hi, like I said, I haven't tested it with any x265 encodes, yet.
I still do a lot of x264 encodes.
Interesting that this filter is still used in Handbrake, and Staxrip.
I think why I did this is, I used to use it a lot, it did a pretty good job, and is a lot faster than MDegrain, and its just another denoising option that someone might find a use for, that got "axed" !!!
slalom
30th March 2021, 13:30
I also stopped using it because MDegrain2 was such a drastic improvement I never went back.
I will have to agree
I just checked the preview for 3 movies, HQDN3D_strong vs MDegrain1
MDegrain1 is way better for my eyes. I don't know about encoding speed
ReinerSchweinlin
30th March 2021, 17:12
I will have to agree
I just checked the preview for 3 movies, HQDN3D_strong vs MDegrain1
MDegrain1 is way better for my eyes. I don't know about encoding speed
Same here, MDegrain is much more natural and transparent looking for me.
ReinerSchweinlin
31st March 2021, 13:42
And as a side note, Handbrake only seems to have 2 denoiser's, HQND3D & NLMeans, so they don't know what they're missing :)
Yes, Handbrake is very stable and user friendly and doesnīt change too often - one of the reasons why many Benchmarks use it and users like it. But it misses some very basic and advanced features, which others like Ripbot, Staxrip, etc... offer. Like:
- Very high Quality deinterlacing
- GPU Denoising
- Normalizing Audio
.
.
.
On the other hand, its very good documented, stable, many nice features for batch encoding, cross-plattform, etc...
Each to his own...
Atak_Snajpera
31st March 2021, 22:55
High quality deinterlacing is also absent in handbreak.
guest
5th April 2021, 08:46
So I have been doing some testing with different Grain & Denoising filters, some that are not part of Ripbot264.
However, they can be found in Handbrake, Staxrip, & Hybrid.
One thing that this has shown me, is that HQN3D just isn't really "in the race".
So the original footage is VERY grainy / noisy, and even though MDegrain 2 & 4 did a pretty good job, in a reasonable time, I found that the SMDegrain grainy did the best job, however, to get those results, it takes a L-O-N-G time, as an example of that the SMDegrain grainy took a bit over an hour to process a 4:40 sample, whereas MDegrain 4 only took about 23 minutes.
TemporalDegrain2 took nearly 1:40:00
TNLmeans took just over 00:47:30
xNLmeans took 2:16:00
I just want to add that these times were on an old slightly overclocked Intel i7 3930K, using DE, but only 2, 2minute chunks.
So even thought these filters do a very similar job, there is a big difference in encoding times, versus the end result, fortunately (or not) at least RipBot has the massive advantage of DE, I would hate to see how long the other popular encoders would take.
Atak_Snajpera
5th April 2021, 16:53
How about English !!!!!
I've just noticed that you left 25 of these crappy posts on many of this Forums topics...go somewhere else !!!!
Online Casino bullshit !!!
You are yelling at the bot...
LigH
6th April 2021, 07:31
Better https://forum.doom9.org/images/buttons/report.gif report such posts to the moderators instead.
ReinerSchweinlin
7th April 2021, 07:29
Issue with multiple audio tracks:
Hi all... I remember reporting this a while ago and just noticed the behaviours still being the same:
- when I do a batch encode and tell RB to just copy audio - only the first audio track is copied. Same behaviour when audio is encoded.
Anybody else having this issue?
guest
7th April 2021, 10:37
Issue with multiple audio tracks:
Hi all... I remember reporting this a while ago and just noticed the behaviours still being the same:
- when I do a batch encode and tell RB to just copy audio - only the first audio track is copied. Same behaviour when audio is encoded.
Anybody else having this issue?
Well, I don't use Batch all that much, but I just loaded a couple of files, using batch, and unless I'm blind, I cannot see ANY option for multiple audio tracks, however, you could add up to another 2 tracks per job, once the batch process has created the job(s).
I was going to show a screen shot, but there's no point :(
However, having said that, for those who use batch a lot, it would be a very handy option to have....
slalom
7th April 2021, 21:17
Issue with multiple audio tracks:
Hi all... I remember reporting this a while ago and just noticed the behaviours still being the same:
- when I do a batch encode and tell RB to just copy audio - only the first audio track is copied. Same behaviour when audio is encoded.
Anybody else having this issue?
Yes, obviously you have to add it manually
Daringbaaz
9th April 2021, 09:41
Rip Bot Encoding Server Not opeaning, it Was Working Fine Previously,
I Checked task manager there was encoding Server.exe Listed But it' won't Open,
- Win 10 pro - Ryzen ThreadRipper 32c
Thanks
LigH
9th April 2021, 10:34
There are several reasons known, of background applications blocking the appearance. I remember "Search Everything" as one candidate...
guest
9th April 2021, 11:36
Rip Bot Encoding Server Not opening, it Was Working Fine Previously,
I Checked task manager there was encoding Server.exe Listed But it' won't Open,
- Win 10 pro - Ryzen ThreadRipper 32c
Thanks
Well, there hasn't been any auto updates for months, so it can't that, that has caused the problem.
What graphics cards are you running, if nVidia, there's a problem with certain functions of that.
Have you changed or installed some new software or drivers since it last worked ???
guest
11th April 2021, 08:33
Now I might be about 18 months behind the times, but I noticed something interesting this afternoon.
With v1.25.0, MTmodes.avs is still available in the Scripts folder, and IF you autoupdate to v1.26.0, it's still there...
HOWEVER, if you download a fresh v1.26.0, it's gone !!!!!
Is it still used, OR has it been secretly integrated, so we can't tell ???
Either way, what does this do, does it enable multi threading on certain filters to speed them up OR does it disable multithreading on certain filters that don't utilize MT ?
On a slightly different topic, as we all know Lsmash IS the default decoder, with no other choice other than use a GPU encoder.
Does anyone still use FFMS ?? (or any other decoder)
And this :- "z_ConvertFormat", is this redundant, as I can't find any other reference to it ???
slalom
11th April 2021, 20:34
This might make some sense
http://avisynth.nl/index.php/AviSynth+#Multithreading_.28MT.29_Notes
guest
12th April 2021, 01:08
This might make some sense
http://avisynth.nl/index.php/AviSynth+#Multithreading_.28MT.29_Notes
Hey slalom, yep, I'm pretty sure I had already seen that, but thanks :)
I have done a little bit of AVSMeter testing, and I can't notice any real difference, regardless to what is turned off, or on, or threads used !!!
It's all a little confusing....the thing is, I have been trying some new filters, and I can't get anywhere near 100% CPU usage, even with 4 DE servers enabled (I know I could use more, but then I can't use as many other DE servers :( )
Will have to keep testing different scripts 'til I find the solution.
If RB does use MT, then the script or commands must be hidden in the code somewhere. Just strange how MTmodes "disappears" after v1.25.0.
ReinerSchweinlin
12th April 2021, 07:35
- when I do a batch encode and tell RB to just copy audio - only the first audio track is copied. Same behaviour when audio is encoded.
Since the issue is confirmed by others:
@Atak
Any chance you could fix this? If set to "copy", it would come in handy to simply copy all audio streams into the resulting video, instead of only the first one.
Not a "fix" but more of a request of an addition:
For audio recoding in batch mode, I assume the current way its implemented makes handling of multiple audio streams with differrent channel counts difficult. One way to easily deal with it could be to use "bitrate per channel" instead of total bitrate.
For example:
videofile with 3 audio tracks:
A: 7.1 surround DTS 1,5mbit/s
B: 5.1 surround AC3 640kbit/s
C: 2 Commentary 265 kbit/s
Set to AAC, 64kbit/channel in batch mode would result in
A: 7.1 AAC / 512 kbit/s
B: 5.1 AAC / 384 kbit/s
C: 2.0 AAC / 128 kbit/s
This would make batch handling for files with multiple audio tracks much easier :) Looking forward to your feedback :)
ReinerSchweinlin
12th April 2021, 07:36
There are several reasons known, of background applications blocking the appearance. I remember "Search Everything" as one candidate...
Thanx for that info, I`ll keep that in mind - had several occasions where the servers didnīt pop up, so this might be usefull info :)
guest
12th April 2021, 10:40
I did some more testing with MDegrain filters & MTModes, and made some interesting observations.
Firstly the RB imbedded MDegrain filters do not have a blksize setting, yet, most scripts do.
So I did a test using no blksize, blksize=8 (generally used for SD) & blksize=16 (which I've read is suitable for HD).
I was surprised to see that both no blksize & blksize=8 were very similar speed, however blksize=16 was WAY faster.
And this variant :- bv1=MAnalyse(super,blksize=16,isb=true,delta=1,overlap=4,lambda=1000)
Also did some speed tests when using SMDegrain filters and it seems they don't need the MTModes function.
But TemporalDegrain, TemporalDegrain2, TNL & xNL do need the MTModes "help".
And surprise, suprise a new build of HQND3D was released yesterday, and a x64 version, too.
slalom
12th April 2021, 16:16
Hey slalom, yep, I'm pretty sure I had already seen that, but thanks :)
I have done a little bit of AVSMeter testing, and I can't notice any real difference, regardless to what is turned off, or on, or threads used !!!
It's all a little confusing....the thing is, I have been trying some new filters, and I can't get anywhere near 100% CPU usage, even with 4 DE servers enabled (I know I could use more, but then I can't use as many other DE servers :( )
As I have noticed, the heavier the filters, the lower the CPU usage is
JKyle
16th April 2021, 03:59
@Atak_Snajpera,
One of the StaxRip users requested MCAS to be included in StaxRip, so I modified the code very slightly as follows for use in StaxRip:
/* MCAS
An improved sharpening script based on CAS and aWarpSharp2
Original work by Atak_Snajpera for RipBot264
Mod by JKyle 2021-04-15 for StaxRip v2.4.0
##### Requirements #####
Plugins:
CAS
aWarpSharp2
##### Parameters #####
float "strength" (default: 1.0)
----------------------------
Same as CAS's parameter.
Must be between 0.0 and 1.0.
*/
function MCAS(clip video, float "strength")
{
strength = default(strength, 1.0)
LevelLimit=(video.BitsPerComponent==8) ? 255 : 1023
IntensityMask=ConvertToY(video).Levels(0, 2, LevelLimit, 0, LevelLimit, coring=false)
EdgeMask=aSobel(IntensityMask, chroma=0, thresh=255, SetAffinity=false).invert.Levels(0, 2, LevelLimit, 0, LevelLimit, coring=false).Blur(1)
SharpMask=Overlay(IntensityMask, EdgeMask, mode="Multiply", opacity=1.0)
SharpenedVideo=CAS(video, strength)
video=Overlay(video, SharpenedVideo, mask=SharpMask, opacity=1.0)
return video
}
May I redistribute the script MCAS.avsi in StaxRip?
Thanks in advance. :)
Ryushin
17th April 2021, 13:57
Hi Atak,
Your program has been my main encoding program for ages. Even before you where able to get DE working.
I'm starting to get worried now that you might be abandoning it. I know RB must have been a huge time sink and now have it working well, it might be best to leave it alone. Also, who knows what you have going on your life, both good and bad that could affect what you are doing.
Years ago I had a couple of free projects that I worked on that I provided for free. My life got busy which caused them to stagnate and they were no longer viable after a length of time.
I just don't want to see that happen with RB. If you are at that point where you don't want to deal with it any longer, maybe it would be best to put it up on Github/Gitlab/etc. Let others carry the torch.
You've been very quiet lately and a bit of an enigma. Just wanting to make sure you're okay and make sure your hard work is not lost to time.
Daringbaaz
17th April 2021, 16:07
Yes, We Don't Want to Loose RipBot, I didn't Found any Alternative of Ripbot. Please Do Something Which Can Help This Project Updated/Alive.
If There is any option to Donate then Please Let me Know, I Will Surely Donate Some Amount,
Thanks
Hi Atak,
Your program has been my main encoding program for ages. Even before you where able to get DE working.
I'm starting to get worried now that you might be abandoning it. I know RB must have been a huge time sink and now have it working well, it might be best to leave it alone. Also, who knows what you have going on your life, both good and bad that could affect what you are doing.
Years ago I had a couple of free projects that I worked on that I provided for free. My life got busy which caused them to stagnate and they were no longer viable after a length of time.
I just don't want to see that happen with RB. If you are at that point where you don't want to deal with it any longer, maybe it would be best to put it up on Github/Gitlab/etc. Let others carry the torch.
You've been very quiet lately and a bit of an enigma. Just wanting to make sure you're okay and make sure your hard work is not lost to time.
guest
18th April 2021, 01:37
Yes, We Don't Want to Loose RipBot, I didn't Found any Alternative of Ripbot. Please Do Something Which Can Help This Project Updated/Alive.
If There is any option to Donate then Please Let me Know, I Will Surely Donate Some Amount,
Thanks
We're NOT going to lose RipBot anytime soon, worst case scenario is we may never get passed v1.26.0, but there'll always be someone willing & able to provide updates for the components & app's it uses to do it's thing.
And yes, you sure can donate as much as you like to the project, simply open RipBot, go to the "About" page under "Settings", and there you go,
OR
https://www.paypal.com/donate/?cmd=_s-xclick&hosted_button_id=L9PHKCWELLYJJ&source=url
Ryushin
19th April 2021, 14:53
So I have a NTSC/60p/120p TVs. I've never been happy with my encodes for content that was originally recorded in 25fps which has mostly been BBC shows prior to or just after Blu-ray came out.
I've tried multiple methods to try and fix it. 29.97 progressive, detelecine back down to 24fps. They all turned out awful. Judder is very prevalent.
To me, interlacing is awful. The combing effect drives me nuts. The judder from panning shots also irks me but it was better than the combing.
So the inherit problem comes from the original filming of shows and movies in 25p that that the BBC and other did. The BBC decided the best way to display it on 60fps TVs was to convert it to 59.94 interlaced or 29.97 interleaved frames. Maybe that looked good for old CRT TVs, but it looks horrible to me.
I wanted to attempt to solve this problem again, and in addition, run them through MDegrain to fix them compared to my older encodes. After doing some research, going down the threads of those that make slow motion videos, the cure was simple. De-interlace to 59.94fps progressive. Low and behold, RB has that option, and the results are just excellent. Judder is gone and no interlacing. File size seems comparable to what the 24/29fps would be when using x265.
I've redone, Sherlock, Cranford, and I'm about to start Downton Abbey. I'll have to go through all my BBC shows at some point like Doctor Who and get this all fixed. I'm finally happy with my BBC encodes.
Ripmann
24th April 2021, 16:29
Hi Atak,
Your program has been my main encoding program for ages. Even before you where able to get DE working.
I'm starting to get worried now that you might be abandoning it. I know RB must have been a huge time sink and now have it working well, it might be best to leave it alone. Also, who knows what you have going on your life, both good and bad that could affect what you are doing.
Years ago I had a couple of free projects that I worked on that I provided for free. My life got busy which caused them to stagnate and they were no longer viable after a length of time.
I just don't want to see that happen with RB. If you are at that point where you don't want to deal with it any longer, maybe it would be best to put it up on Github/Gitlab/etc. Let others carry the torch.
You've been very quiet lately and a bit of an enigma. Just wanting to make sure you're okay and make sure your hard work is not lost to time.
Very well put. I had to forfeit countless programs I really loved because they stopped working for some reason, be it a new Windows version, or some security update, or simply because the libraries they used became obsolete. I really don't want this to happen to RipBotarguably the best encoding program out there.
Please consider these suggestions. Maybe even put the code on a private depository in advance, so it'll be much easier to open it up later. I'm not much of a programmer, but I can definitely contribute some little tweaks, including some that I've been pestering you about, like adding an option for setting the video title for the mkv metadata.
NiGHTsC
30th April 2021, 08:01
Have some faith, he's been working on it more than a decade, he sure won't just abandon it without a post.
JASAN
30th April 2021, 20:29
Hey. Wanted to drop this off here just in case someone has ever experienced the same issue I did in recent months.
The problem was simply that starting a Ripbot encode did NOT trigger the startup of any EncodingServers. The client window appears, and four (which is what I use) EncodingServer.exe instances appear as tasks, but their WINDOWS do not appear and work does not commence. It was the absolute most frustrating thing for me and I tried dozens of things to try and fix it. I have a few other machines here and on each of those, the EncodingServer app would start fine. But it simply wouldn't on my main desktop. I read about something like this in previous posts on this thread and have tried reinstalling the VC redistributables, it did not help at all. Tried clean boots via msconfig and all of a sudden EncodingServer started working again and that's when I knew it was something I was running that was preventing proper operation.
By a process of elimination I have discovered that two Nvidia services kill the ability for EncodingServer.exe to bring up a window and/or commence work.
NVIDIA Display Container LS (this is the prime culprit)
NVIDIA LocalSystem Container
I have a Ryzen 9 3950X (but had an I7 4-core before, same issue) and a GTX1080. The services above appear to be related to the nVIDIA GeForce experience app that is installed by default with the GeForce drivers. I messed around in there with settings but absolutely could not fix this without completely stopping and disabling those services. Soon as I did, boom, up came all four windows for EncodingServer.
FWIW I also think that I had problems with my browser (Brave) at one point, but I changed a lot of flags in there and now there are no issues with EncodingServer, even with Brave running. I can only imagine that there is something related to the GPU perhaps, that when in operation somehow jams up EncodingServer's functionality.
Running the NVIDIA Display Container LS, over time, also seemed to spin up some sort of weird background process, making my mouse pointer sluggish to animate and move over time. Stopping that process instantly gave me back pointer responsiveness, however it also kills off the GeForce experience app from my systray. I'm fine with that.
Regards
Dhry
Thank you, thank you, Thank you.
I had this issue for years and gave up on any newer versions of ripbot, the last version I could use successfully on all my pcs was 1.19.3!!!
JASAN
30th April 2021, 20:32
not my solution, I found this today from a user named DHRY
Hey. Wanted to drop this off here just in case someone has ever experienced the same issue I did in recent months.
The problem was simply that starting a Ripbot encode did NOT trigger the startup of any EncodingServers. The client window appears, and four (which is what I use) EncodingServer.exe instances appear as tasks, but their WINDOWS do not appear and work does not commence. It was the absolute most frustrating thing for me and I tried dozens of things to try and fix it. I have a few other machines here and on each of those, the EncodingServer app would start fine. But it simply wouldn't on my main desktop. I read about something like this in previous posts on this thread and have tried reinstalling the VC redistributables, it did not help at all. Tried clean boots via msconfig and all of a sudden EncodingServer started working again and that's when I knew it was something I was running that was preventing proper operation.
By a process of elimination I have discovered that two Nvidia services kill the ability for EncodingServer.exe to bring up a window and/or commence work.
NVIDIA Display Container LS (this is the prime culprit)
NVIDIA LocalSystem Container
I have a Ryzen 9 3950X (but had an I7 4-core before, same issue) and a GTX1080. The services above appear to be related to the nVIDIA GeForce experience app that is installed by default with the GeForce drivers. I messed around in there with settings but absolutely could not fix this without completely stopping and disabling those services. Soon as I did, boom, up came all four windows for EncodingServer.
FWIW I also think that I had problems with my browser (Brave) at one point, but I changed a lot of flags in there and now there are no issues with EncodingServer, even with Brave running. I can only imagine that there is something related to the GPU perhaps, that when in operation somehow jams up EncodingServer's functionality.
Running the NVIDIA Display Container LS, over time, also seemed to spin up some sort of weird background process, making my mouse pointer sluggish to animate and move over time. Stopping that process instantly gave me back pointer responsiveness, however it also kills off the GeForce experience app from my systray. I'm fine with that.
Regards
Dhry
Viper714
2nd May 2021, 01:58
Hey. Wanted to drop this off here just in case someone has ever experienced the same issue I did in recent months.
The problem was simply that starting a Ripbot encode did NOT trigger the startup of any EncodingServers. The client window appears, and four (which is what I use) EncodingServer.exe instances appear as tasks, but their WINDOWS do not appear and work does not commence. It was the absolute most frustrating thing for me and I tried dozens of things to try and fix it. I have a few other machines here and on each of those, the EncodingServer app would start fine. But it simply wouldn't on my main desktop. I read about something like this in previous posts on this thread and have tried reinstalling the VC redistributables, it did not help at all. Tried clean boots via msconfig and all of a sudden EncodingServer started working again and that's when I knew it was something I was running that was preventing proper operation.
By a process of elimination I have discovered that two Nvidia services kill the ability for EncodingServer.exe to bring up a window and/or commence work.
NVIDIA Display Container LS (this is the prime culprit)
NVIDIA LocalSystem Container
I have a Ryzen 9 3950X (but had an I7 4-core before, same issue) and a GTX1080. The services above appear to be related to the nVIDIA GeForce experience app that is installed by default with the GeForce drivers. I messed around in there with settings but absolutely could not fix this without completely stopping and disabling those services. Soon as I did, boom, up came all four windows for EncodingServer.
FWIW I also think that I had problems with my browser (Brave) at one point, but I changed a lot of flags in there and now there are no issues with EncodingServer, even with Brave running. I can only imagine that there is something related to the GPU perhaps, that when in operation somehow jams up EncodingServer's functionality.
Running the NVIDIA Display Container LS, over time, also seemed to spin up some sort of weird background process, making my mouse pointer sluggish to animate and move over time. Stopping that process instantly gave me back pointer responsiveness, however it also kills off the GeForce experience app from my systray. I'm fine with that.
Regards
Dhry
Thank you so much for that. I tried disabling the items in the startup and it did not work. Disabling these services worked perfectly!!!
:goodpost:
kempodragon
2nd May 2021, 16:48
I recently started converting my 3d movies to play on my Oculus Quest with BD3D2MK3D. The encoder that it uses, while doing an excellent job, doesn't make full use of my Threadripper. I only get about 48fps at ~30% CPU usage. BD3D2MK3D does allow an external encoder to be used, so I want to call Ripbot using the command line and take advantage of its distributed encoding. I looked at using the avs script that BD3 generates, but Ripbot doesn't support level 5.0, which is needed for the full SBS files that I make. I've read the help file, but it doesn't say if EncodingClient.exe or EncondingServer.exe is called. You help is greatly appreciated.
I've always wanted to know how old certain Forum members were, and then I stumbled across this, thanks to "kempodragon".
https://forum.doom9.org/showthread.php?t=176546
BTW kempo, why don't you just use RipBot to start with !!!!
kempodragon
3rd May 2021, 20:19
Two reasons I can't use Ripbot directly:
1: Ripbot can't decode MVC streams that are in 3d Blu-rays. Rolz created BD3D2MK3D to convert 3d Blurays, but he uses the MeGui encoder.
2: Ripbot's gui doesn't go up level 5.0 which is what I need for full SBS encodes.
Importing the scripts that BD3D2MK3D creates was my first choice, but I don't know how to force the encoder to use level 5.0. I prefer full SBS because a VR headset is essentially a full SBS viewer.
Two reasons I can't use Ripbot directly:
1: Ripbot can't decode MVC streams that are in 3d Blu-rays. Rolz created BD3D2MK3D to convert 3d Blurays, but he uses the MeGui encoder.
2: Ripbot's gui doesn't go up level 5.0 which is what I need for full SBS encodes.
Importing the scripts that BD3D2MK3D creates was my first choice, but I don't know how to force the encoder to use level 5.0. I prefer full SBS because a VR headset is essentially a full SBS viewer.
Hi kempo,
Well, it just so happens I have played around a fair bit with MVC 3D's, and yes, RipBot does not recognise them.
But why are you wanting to run them thru RipBot anyway ??
Also, you might be able to answer a question I have had about MVC tracks, are they a "proper" video track, or are they just the 3D component of the AVC track, to produce the 3D affect ??
Also, if you had a "grainy" MVC 3D movie, and ran it thru RipBot to clean it up, then remuxed the MVC track back in, would that cause problems ???
So here's what I know, you CAN demux the MVC track with tsmuxer (the newer nightly builds), I think you can also "up" the level's...then you could run it thru RipBot do what you want to the AVC track & maybe audio track, them mux them back together with tsmuxer, and IF you still needed to, use BD3D2MK3D to achieve your FULL SBS, there's the process.
Of course tsmuxer only output's .ts, .m2ts & .iso files !!
MKVToolnix, MKVmerge, (whatever you want to call it), also doesn't like MVC tracks, if I remember correctly.
And you can also increase the level's in RipBot, it's the x264 or x265 command line.
This is what I use in RipBot :-
for x264:- --level 5.2 --aud --nal-hrd vbr --vbv-bufsize 300000 --vbv-maxrate 300000
for x265:- --level 5.2 --profile main10 --output-depth 10
All you have to do is go to the Profiles folder in the main RipBot264 folder, and edit the .txt files found under avc & hevc, then they will become available in the drop down within RipBot :)
Ripmann
4th May 2021, 16:05
Is there a way to change the default values for the denoise settings? The KNLMeansCL ones are too strong for me, even at KNLMeansCL1. I usually change them in the JobX.avs files, but I'd prefer to just set up the defaults and forget about it if possible. (sometimes I forget and have to redo a ten-hour job because of it.)
Atak_Snajpera
4th May 2021, 16:28
Is there a way to change the default values for the denoise settings? The KNLMeansCL ones are too strong for me, even at KNLMeansCL1. I usually change them in the JobX.avs files, but I'd prefer to just set up the defaults and forget about it if possible. (sometimes I forget and have to redo a ten-hour job because of it.)
In next version You will have that...
Ripmann
4th May 2021, 16:31
In next version You will have that...
Who-hoo, Atak is back!
Is there a way to change the default values for the denoise settings? The KNLMeansCL ones are too strong for me, even at KNLMeansCL1. I usually change them in the JobX.avs files, but I'd prefer to just set up the defaults and forget about it if possible. (sometimes I forget and have to redo a ten-hour job because of it.)
Why don't you make your own, and save it as a Custom filter ???
And why are you using KNLMeansCL anyway ???
Since @Atak_Snajpera seems to be back, I'd like to take this opportunity to ask him AGAIN (https://forum.doom9.org/showthread.php?p=1940875#post1940875) if he doesn't object to redistributing this custom filter script (originally composed by him(?) for RipBot264) in StaxRip.
(Meanwhile, I've renamed the filter to CASm and modified some portion for maintenance in StaxRip.)
# CASm
#
# An improved sharpening script based on CAS and aWarpSharp2
#
# Original work by Atak_Snajpera for RipBot264
# Renamed and modded by JKyle 2021-04-22 for StaxRip
#
# ---Requirements---
#
# Core plugins:
# CAS
# aWarpSharp2
#
# ---Parameters---
#
# float "strength" (default: 1.0)
# ----------------------------
# Same as CAS's parameter.
# Must be between 0.0 and 1.0.
#
function CASm(clip video, float "strength")
{
strength = default(strength, 1.0)
LevelLimit = (video.BitsPerComponent == 8) ? 255 : 1023
IntensityMask = ConvertToY(video).Levels(0, 2, LevelLimit, 0, LevelLimit, coring = false)
EdgeMask = aSobel(IntensityMask, chroma = 0, thresh = 255, SetAffinity = false).invert.Levels(0, 2, LevelLimit, 0, LevelLimit, coring=false).Blur(1)
SharpMask = Overlay(IntensityMask, EdgeMask, mode = "Multiply", opacity = 1.0)
SharpenedVideo = CAS(video, strength)
video = Overlay(video, SharpenedVideo, mask = SharpMask, opacity = 1.0)
return video
}
It will be saved as CASm.avsi and included in the default filter profiles in StaxRip.
Thanks in advance. :)
Atak_Snajpera
4th May 2021, 17:15
Since @Atak_Snajpera seems to be back, I'd like to take this opportunity to ask him AGAIN (https://forum.doom9.org/showthread.php?p=1940875#post1940875) if he doesn't object to redistributing this custom filter script (originally composed by him(?) for RipBot264) in StaxRip.
(Meanwhile, I've renamed the filter to CASm and modified some portion for maintenance in StaxRip.)
# CASm
#
# An improved sharpening script based on CAS and aWarpSharp2
#
# Original work by Atak_Snajpera for RipBot264
# Renamed and modded by JKyle 2021-04-22 for StaxRip
#
# ---Requirements---
#
# Core plugins:
# CAS
# aWarpSharp2
#
# ---Parameters---
#
# float "strength" (default: 1.0)
# ----------------------------
# Same as CAS's parameter.
# Must be between 0.0 and 1.0.
#
function CASm(clip video, float "strength")
{
strength = default(strength, 1.0)
LevelLimit = (video.BitsPerComponent == 8) ? 255 : 1023
IntensityMask = ConvertToY(video).Levels(0, 2, LevelLimit, 0, LevelLimit, coring = false)
EdgeMask = aSobel(IntensityMask, chroma = 0, thresh = 255, SetAffinity = false).invert.Levels(0, 2, LevelLimit, 0, LevelLimit, coring=false).Blur(1)
SharpMask = Overlay(IntensityMask, EdgeMask, mode = "Multiply", opacity = 1.0)
SharpenedVideo = CAS(video, strength)
video = Overlay(video, SharpenedVideo, mask = SharpMask, opacity = 1.0)
return video
}
It will be saved as CASm.avsi and included in the default filter profiles in StaxRip.
Thanks in advance. :)
Sure do whatever you want with that script.
Sure do whatever you want with that script.
:thanks:
Ripmann
4th May 2021, 18:24
And why are you using KNLMeansCL anyway ???
Why? What's the problem with it? have almost no knowledge of denoising algorithms, but from my own experimentation, I seem to get the best results from combining MDegrain 1 or 2 (depending on the grain amount) with an additional, very light denoise from KNLMeansCL. Using slightly different parameters, MDegrain removes the main grain and KNLMeansCL slightly optimizes the video for downsampling. I'm sure there can be a better way, I but haven't found one yet.
Why? What's the problem with it? have almost no knowledge of denoising algorithms, but from my own experimentation, I seem to get the best results from combining MDegrain 1 or 2 (depending on the grain amount) with an additional, very light denoise from KNLMeansCL. Using slightly different parameters, MDegrain removes the main grain and KNLMeansCL slightly optimizes the video for downsampling. I'm sure there can be a better way, I but haven't found one yet.
Well.I think SMDegrain does a better job than either !!!
I have been using that for a few weeks, and like it a lot !!!
Ripmann
4th May 2021, 19:28
Well.I think SMDegrain does a better job than either !!!
I have been using that for a few weeks, and like it a lot !!!
Thanks for the advice, I'll look into it.
kempodragon
4th May 2021, 19:58
Pauly, MVC is indeed the 3d only info of the frame. I don't know about your second question. Personally, I dislike the very concept of MVC. Since the movie is played frame sequentially on 3d Blu-rays, with the left eye generally being the main frame and the right eye frame having the 3d info, I feel it should be stored as a true frame sequential. Dark Shikari created a lossless frame sequential test file with left and right full frames awhile back. Thanks for tip on the command line, I'll test it out this weekend.
Ripmann
4th May 2021, 23:29
Pauly, is there a chance you can help me with installing/using the SMDegrain plugin? A sample script, perhaps? I downloaded SMDegrain.avsi to test it, placed it into AviSynth plugins, and then tried calling the function in a custom script. I tried several variations, but it went something like this:
LoadPlugin("[INSTALLATION PATH]\RipBot264\Tools\AviSynth plugins\SMDegrain.avsi")
video=SMDegrain(tr=2,thSAD=300,contrasharp=true,refinemotion=true,lsb=true)
But it keeps failing. I'm sure I'm missing something embarrasingly basic, but I never bothered to learn AviSynth and its scripting so I'm shooting in the dark here.
Ripmann
5th May 2021, 02:29
Well, well, well....
Nice try, and you're definitely on the right track, but it's not that simple, it needs other "dependencies" to work.
May I draw your attention to this post :-
https://forum.doom9.org/showthread.php?p=1941489#post1941489
Oh, right, the dependencies. Zs_RF_Shared and the rest. Totally missed that. I'll see if I can install them manually before bothering you again. Thanks!
Ryushin
21st May 2021, 21:39
Looks like MKVToolNix is going to support Dolby Vision soon.
https://gitlab.com/mbunkus/mkvtoolnix/-/issues/2784
guest
23rd May 2021, 08:28
RipBot does NOT like this file...
It's a VP9 with Opus in mkv container....decoder error :(
https://www.mediafire.com/file/q1wcsmh8xvybh9n/★+4K+Tilt+train+Geneva.7z/file
Atak_Snajpera
23rd May 2021, 09:17
Remove "★" and "ü" from file name.
guest
23rd May 2021, 10:49
Remove "★" and "ü" from file name.
OMG....
I also had to remove the "★" from the folder name, that that file was in...
Unbelievable.. :stupid:
david.dgc
23rd May 2021, 20:10
Hello,
How works the excel file "workhours.csv" ?
The program will only encode within the time set and pauses according to this file?
How we enter time schedules inside?
Thanks
Atak_Snajpera
23rd May 2021, 20:34
Go to settings - work hours and generate simple rule. Next open that file in notepad to see how correct syntax should look like.
guest
26th May 2021, 02:27
"We" have a long awaited autoupdate......
I was hoping for some significant changes, etc....but you can see for yourselves.
Thanks, Atak.
FuzzyNutz
26th May 2021, 03:52
great that we can now add track descriptions. would be more useful if there was predefineable user-editable descriptions, separate for video, audio and subtitles, similar to what MKVToolNix has. thus, eliminating the need to manually type often used descriptions.
twas i that requested this be added to MKVToolNix, btw.
update: i assumed track descriptions = track names. seems i assumed wrong. so, what are track descriptions?
guest
26th May 2021, 05:32
great that we can now add track descriptions. would be more useful if there was predefineable user-editable descriptions, separate for video, audio and subtitles, similar to what MKVToolNix has. thus, eliminating the need to manually type often used descriptions.
twas i that requested this be added to MKVToolNix, btw.
This might need to be suggested to the author of MKVToolnix...not here.
FuzzyNutz
26th May 2021, 07:49
This might need to be suggested to the author of MKVToolnix...not here.
i referenced an existing ability of MKVToolNix as an example of what i want added to RipBot264.
as an aside, i offered that the author of MKVToolNix added said ability at my request.
screaming
30th May 2021, 01:44
Started up RipBot264 and it auto-updated to v1.26.1. Whatever .mkv I feed it, it generates an error after trying to index:
System exception - Access Violation
(c:\temp\job1\getinfo.avs, line 2)
Looking at the getinfo.avs file, line 2 looks something like this:
video=LWLibavVideoSource("c:\Video\Temp\video.mkv",cachefile="c:\temp\RipBot264temp\job1\video.mkv.lwi",prefer_hw=3)
Also spotted at the bottom of the test.log file:
[avisynth @ 0000018da9c30e00] System exception - Access Violation
(c:\temp\RipBot264temp\job1\getinfo.avs, line 2)
c:\temp\RipBot264temp\job1\getinfo.avs: Unknown error occurred
I have tried multiple files, and I'm getting the same error each time now.
Atak_Snajpera
30th May 2021, 09:04
Set all decoders to CPU instead of GPU
screaming
30th May 2021, 15:12
Set all decoders to CPU instead of GPU
Thank you. I switched just the AVC decoder from GPU to CPU, and that has allowed me to proceed with next steps and to start the encoding.
Is there a reason why decoders need to be set to CPU instead of GPU? Is there an issue a component or plugin that has an issue, or perhaps with a system driver on my computer?
Atak_Snajpera
30th May 2021, 15:21
Latest version of lsmash seems to have broken hardware decoders. I haven't noticed that because I always use software decoders.
slalom
31st May 2021, 19:25
@Atak
When I add an audio track from the 3-dot button, the program freezes
that's with the latest update, after 2021.05.25
guest
1st June 2021, 08:13
Hey guy's,
If anyone is having issues with L Smash, (or just want's to use the older RB decoder, try this :-
overwrite this field in RipBot264.ini if you want to use FFMS2 instead of L-Smash
[DefaultVideoDecoder]
MPEG-2=FFMS2
VC-1=FFMS2
AVC=FFMS2
HEVC=FFMS2
OTHER=FFMS2
slalom
2nd June 2021, 09:39
@Atak
When I add an audio track from the 3-dot button, the program freezes
that's with the latest update, after 2021.05.25
Probably my bad, they were jobs added with 2021.05.25 update
Ripmann
3rd June 2021, 23:07
Hey guys, I'm having a dismal month with no free time whatsoever. Just wanted to drop by to thank Pauly Dunne for his advice (although I haven't had a chance to finish the installation yet) and Atak for adding all the title and filter strength options.
A minor note about the strength values: if it's not too much trouble, could you tweak the KNLMeansCL strength input to accept decimal values like 1.5? Back when I ran denoise tests, I saw a notable difference between values like 1.0 and 1.5. So just one decimal point, for better control, would be perfect. Otherwise, great job. Glad to see you back in action.
EDIT: By the way, I didn't notice any issues with audio tracks or GPU encoding after the patch (Nvidia card). In case somebody is wary of the update because of the reports above, back up the installation folder just in case and give it a try.
guest
4th June 2021, 01:57
Hey guys, I'm having a dismal month with no free time whatsoever. Just wanted to drop by to thank Pauly Dunne for his advice (although I haven't had a chance to finish the installation yet) and Atak for adding all the title and filter strength options.
A minor note about the strength values: if it's not too much trouble, could you tweak the KNLMeansCL strength input to accept decimal values like 1.5? Back when I ran denoise tests, I saw a notable difference between values like 1.0 and 1.5. So just one decimal point, for better control, would be perfect. Otherwise, great job. Glad to see you back in action.
EDIT: By the way, I didn't notice any issues with audio tracks or GPU encoding after the patch (Nvidia card). In case somebody is wary of the update because of the reports above, back up the installation folder just in case and give it a try.
Hey Ripmann,
Yeah, it's been a little while, and thankyou for your compliment.
Not sure if you would have seen my lengthy explanation of the differences between the original KNLMeansCL filter scripts, and the current one's, before I took that post down.
Anyway, I know it's each to their own, but I still don't understand why you like KNLMeansCL...
OK, so I have just done a very simple edit / test, and it seems like you can use ANY decimal point value you want....you simply choose one from the drop down, and edit the "h" value, eg:-
#After_Prefetch_Denoise
LoadPlugin("D:\RipBot264v1.26.1\Tools\AviSynth plugins\KNLMeansCL\KNLMeansCL.dll")
video=ConvertToYUV444(video).KNLMeansCL(d=0, a=2, s=4, h=1.5, device_type="GPU", device_id=0, channels="YUV").ConvertToYUV420
OR
You could also write up a few custom scripts, and simply choose it from the Custom Script drop down list.
I'm sure you've now seen this :-
https://forum.doom9.org/showthread.php?p=1943629#post1943629
guest
6th June 2021, 14:05
So I have just noticed yet another little update...
The mostly obvious addition is a "Demo" mode for the filter's you use, either Sharpen, MDegrain or KNLMeansCL..it split's your clip into a 4 way split screen in MPC-HC, so you can easily compare the difference between the 3 available presets for these filters, but only in their default levels, NOT if you choose a different "Strength" :(
Interesting feature, but as it doesn't adjust to user custom settings, it's just "bling".
Having said all that, I have just tried to start my Job Queue and it has an L-Smash error on the existing jobs, BUT if you load a new job, there isn't a problem.
This would be a MAJOR problem for those who have massive Job Queue's :(
Another observation, when I try and use the "Demo" feature MPC-HC "Cannot render the file", however, "Preview Script" works fine
slalom
9th June 2021, 19:21
That split-screen playback is much smoother and it helps a lot to find the right preset filter. It helps a lot!
guest
10th June 2021, 02:59
That split-screen playback is much smoother and it helps a lot to find the right preset filter. It helps a lot!
C'mon slalom,
It's ONLY useful if you're using the default filters, with default settings !!
And unless you have a large display, it's hard to really define the fine differences.
But as soon as you alter the filter scripts, it's useless, and you have to go back to the tried & tested (and full screen) original preview script function.
And for those out there that use their own custom filters, you don't even get the "Demo" option.
And as RB still only has 2 degraining / denoising filters, there are probably a LOT of custom filters being used (me for one).
So like I said before,
Interesting feature, but as it doesn't adjust to user custom settings, it's just "bling".
Wolfe999
11th June 2021, 02:29
This small app written in Delphi is specially for people looking for something simple without exotic filters and unnecessary settings
@Atak_Snajpera You were true to your word. What a beautifull and "simple" app you've created, so useful for my needs now. A pity it doesn't have the possibility to choose encoding with Nvidia, but for that purpose there's another great program like StaxRip. Besides, with a Ryzen 2700x I can get "enough" speed.
In any case, thank you, I will begin to use it more frequently from now on.
@Pauly Dunne Thank you so much also for your "extra Avisynth degraining / denoising filters". A fantastic addition and, following your advise, used SMDegrain with more than satisfying results.
Hope you continue and expand your useful work.
And thanx to all the good info I could get reading this thread :D
guest
11th June 2021, 05:14
@Pauly Dunne Thank you so much also for your "extra Avisynth degraining / denoising filters". A fantastic addition and, following your advise, used SMDegrain with more than satisfying results.
Hope you continue and expand your useful work.
And thanx to all the good info I could get reading this thread :D
Hi Wolfe999,
Thankyou very much for the great feedback, hopefully some other users might be interested.
And I will continue....
Cheers
Ripmann
12th June 2021, 01:43
Phew, what a month. I'll be finally getting back to my encoding backlog soon (haven't even had time to update to see the Demo mode yet) but I just remembered something I wanted to ask Atak for a long, looong, looooong time:
In the New Job window, the Output (file path/name) edit field: is it possible to make it editable (same as the Description field above it), so I can just CTRL-V paste the path and name without opening a Save As dialogue?
I don't know about the rest of us, but I'd certainly find it extremely time-saving, and I'm guessing it's an extremely quick and easy tweak to do, with no apparent downsides. I'm guessing it was disabled to avoid accidentally misspelled path errors, but hey, if you screw up one time, you'll either return to using the Save As dialogue or start being more careful about what you type in there, right? Thanks, Atak.
coreying
14th June 2021, 00:16
Is anyone having issues closing RipBot? I've got 2 Windows 10 systems.
On my brand new AMD Ryzen 5900 system after attempting to close RipBot, the queue window closes, but the system tray icon remains. I have to go to task manager and end process on RipBot264.exe. This happens whether I've done anything in RipBot or not (e.g. open RipBot, do nothing else other than click close). The first version installed here was v1.26.0, but it continues to occur after the update.
My old Intel i7-4770k system didn't have this issue, but then the update to v1.26.1 has introduced the problem on this system too.
guest
14th June 2021, 02:41
Is anyone having issues closing RipBot? I've got 2 Windows 10 systems.
On my brand new AMD Ryzen 5900 system after attempting to close RipBot, the queue window closes, but the system tray icon remains. I have to go to task manager and end process on RipBot264.exe. This happens whether I've done anything in RipBot or not (e.g. open RipBot, do nothing else other than click close). The first version installed here was v1.26.0, but it continues to occur after the update.
My old Intel i7-4770k system didn't have this issue, but then the update to v1.26.1 has introduced the problem on this system too.
Hi coreying,
This is your first post here, in just over 8 years....
OK, so unfortunately this seems to happen every so often, and it's not necessarily a fault with RipBot, but it IS annoying when one pc does it, and another doesn't.
I have this happen, and have to do what you described, not sure if Atak would be able to track it down.
Off topic a bit here...
However, I have noticed some rather sneaky changes to RipBot with the last couple of updates (not that should affect this, tho), and it's mainly to do with the Avisynth MTmodes & how many "Use multiple threads for encoding" you can set for Prefetch.
It use to be a Limit of 16, NOW you can go all the way up to 64.
Back on topic...
So have you been using RipBot all these years, or just recently...just wondering about the version you had, before the problem started.
I doubt that it would be the AMD platform, as I have a 3950X, and it tends to behave itself pretty well.
Have you got nVidia software / drivers, or any Logitech stuff ??
Atak_Snajpera
14th June 2021, 08:26
Is anyone having issues closing RipBot? I've got 2 Windows 10 systems.
On my brand new AMD Ryzen 5900 system after attempting to close RipBot, the queue window closes, but the system tray icon remains. I have to go to task manager and end process on RipBot264.exe. This happens whether I've done anything in RipBot or not (e.g. open RipBot, do nothing else other than click close). The first version installed here was v1.26.0, but it continues to occur after the update.
My old Intel i7-4770k system didn't have this issue, but then the update to v1.26.1 has introduced the problem on this system too.
Check if problem stil occurs in "safe mode". I suspect some app running in background is doing this.
guest
15th June 2021, 05:25
If there's something that has been happening, that's a little annoying is, when using DE, just very randomly, it will just "finish" a Job, and start on the next one, when indeed to previous Job has NOT completed.
Fortunately, 95% of the time, when you go back to that stopped Job, it will resume, BUT when it doesn't, it's rather frustrating, and when that happens on a LONG 4K encode, it's a real PITA !!!
slalom
15th June 2021, 21:46
And unless you have a large display, it's hard to really define the fine differences
You should try 27" 1440p
guest
16th June 2021, 01:58
You should try 27" 1440p
Maybe so, and I do have a 27" 2160p LG monitor.
But the situation doesn't change, it does NOT display custom settings !!!
guest
16th June 2021, 03:55
Phew, what a month. I'll be finally getting back to my encoding backlog soon (haven't even had time to update to see the Demo mode yet) but I just remembered something I wanted to ask Atak for a long, looong, looooong time:
In the New Job window, the Output (file path/name) edit field: is it possible to make it editable (same as the Description field above it), so I can just CTRL-V paste the path and name without opening a Save As dialogue?
I don't know about the rest of us, but I'd certainly find it extremely time-saving, and I'm guessing it's an extremely quick and easy tweak to do, with no apparent downsides. I'm guessing it was disabled to avoid accidentally misspelled path errors, but hey, if you screw up one time, you'll either return to using the Save As dialogue or start being more careful about what you type in there, right? Thanks, Atak.
Interesting, I just noticed that this field in Batch, IS editable...
PatchWorKs
16th June 2021, 08:11
Question/idea: is possible to use a remote G-Colab notebook too as encoding server ?
Some (maybe) useful Colabs:
- https://colab.research.google.com/github/shirooo39/MiXLab/blob/master/MiXLab.ipynb
- https://colab.research.google.com/github/AlphaAtlas/VapourSynthColab/blob/master/VapourSynthColab.ipynb
- https://colab.research.google.com/github/sudo-ken/FFmpeg-for-GDrive/blob/master/FFmpeg_for_GDrive.ipynb
- https://colab.research.google.com/github/yunooooo/FFmpeg-for-Google-Drive/blob/master/FFmpeg.ipynb
Hope that inspires !
note: last but not least, why RB264 does not have a git ?
coreying
16th June 2021, 11:24
Hi coreying,
This is your first post here, in just over 8 years....
<snip>
So have you been using RipBot all these years, or just recently...just wondering about the version you had, before the problem started.
Yes, using RipBot all these years. It's excellent software.
Have you got nVidia software / drivers, or any Logitech stuff ??
All the above :)
Check if problem stil occurs in "safe mode". I suspect some app running in background is doing this.
I tried Safe Mode, and yep, RipBot closes fine. So I rebooted into Windows, and first started by closing everything in the System Tray. This is when I noticed that each time I started RipBot, the "NVIDIA Settings" tray icon would reappear.
So I tried stopping the Nvidia services one by one and found that the issue is with the "NVIDIA LocalSystem Container" which starts 3 x nvcontainer.exe background tasks. I can perform a reboot, stop only this single service, and RipBot closes normally.
It appears this service must be running for the NVIDIA GeForce Experience software to work. Not specifically sure why it causes RipBot to break or why RipBot starts the Nvidia tray icon etc.
But I have also replicated this on my old Intel computer that I've used RipBot on successfully for the past 8 years. As mentioned in my previous post, it also broke recently. I thought it was the update to 1.26.1 - but around the same time I had also put in a new GPU which updated the drivers so...
Thanks guys :)
Atak_Snajpera
16th June 2021, 12:57
I always install clean drivers without spying services like GeForce experience. By the way. I have never had any issues with AMD drivers for example. NVIDIA really likes to know what executables you launch...
MCFish
16th June 2021, 23:35
For some time now encodingclient.exe halts at 100% at random encodes. The main window closes, but the task is running and tray icon still showing 100% completion. When killing task, muxing start and encoding is resuming on next item.
Very annoying as it halts the whole ripbot thing until i kill the task again. Tried to initiate a few encodes from another computer, but same random thing happen.
Seems like it cant quit after encoding sometimes
Atak_Snajpera
17th June 2021, 00:43
I haven't touched encodinclient's code for long time so maybe some app running in background is causing this issue. See above posts about GeForce experience
guest
17th June 2021, 03:23
For some time now encodingclient.exe halts at 100% at random encodes. The main window closes, but the task is running and tray icon still showing 100% completion. When killing task, muxing start and encoding is resuming on next item.
Very annoying as it halts the whole ripbot thing until i kill the task again. Tried to initiate a few encodes from another computer, but same random thing happen.
Seems like it cant quit after encoding sometimes
That's almost the opposite to the random problems I have...
https://forum.doom9.org/showthread.php?p=1945078#post1945078
But yeah, as Atak mentioned, if you're running any nVidia app's (behind the scenes), they play havoc with certain RB functions...someone needs to fix something...
I think you can disable them in ProcessHacker.....
MCFish
17th June 2021, 08:29
No nvidia on that computer. Have only seen the encodingserver thing with nvidia, it doesnt bother me. Ugh finding background task ill save for another day....are alot
frencher
18th June 2021, 01:45
Hi all,
I search my future CPU for Ribot264 for 4K h265 @60fps.
AMD Ryzen, Intel i7/i9 ?
My actual CPU is Intel i7 3930k 6/12 threads (2011) recode at 3/4 fps.
My dream is 15/20 or better fps.
i7 3930k vs Last intel i9
https://cpu.userbenchmark.com/Compare/Intel-Core-i9-11900K-vs-Intel-Core-i7-3930K/4110vs1487
guest
18th June 2021, 04:09
Hi all,
I search my future CPU for Ribot264 for 4K h265 @60fps.
AMD Ryzen, Intel i7/i9 ?
My actual CPU is Intel i7 3930k 6/12 threads (2011) recode at 3/4 fps.
My dream is 15/20 or better fps.
i7 3930k vs Last intel i9
https://cpu.userbenchmark.com/Compare/Intel-Core-i9-11900K-vs-Intel-Core-i7-3930K/4110vs1487
I have an overclocked 3930K, they were pretty good, back in the day, but these day's, pretty slow for this sort of "work".
I also have a slightly overclocked Ryzen 9 3950X, and it's pretty damn good !! :)
I would strongly suggest a Ryzen 9 5900X (or higher).
Of course a Threadripper 32 or 64 core would just smoke this stuff, but at what cost :(
Check this :-
https://www.tomshardware.com/features/intel-core-i9-11900K-vs-amd-ryzen-9-5900x
guest
18th June 2021, 04:16
Hey Ripmann,
Today is your lucky day, Atak has released another autoupdate, and amongst a couple of other changes (yet tbd), your request has been granted, and you can now freely edit this :-• In the New Job window, the Output (file path/name) edit field: is it possible to make it editable (same as the Description field above it), so I can just CTRL-V paste the path and name without opening a Save As dialogue?
frencher
18th June 2021, 12:14
I have an overclocked 3930K, they were pretty good, back in the day, but these day's, pretty slow for this sort of "work".
I also have a slightly overclocked Ryzen 9 3950X, and it's pretty damn good !! :)
I would strongly suggest a Ryzen 9 5900X (or higher).
Of course a Threadripper 32 or 64 core would just smoke this stuff, but at what cost :(
Check this :-
https://www.tomshardware.com/features/intel-core-i9-11900K-vs-amd-ryzen-9-5900x
Hello,
How many fps in 4K encoding do you encode with your Ryzen?
Has anyone done the test with a Threadripper 32 or 64?
guest
18th June 2021, 12:27
Hello,
How many fps in 4K encoding do you encode with your Ryzen?
Has anyone done the test with a Threadripper 32 or 64?
Hi, I have to admit I haven't used the Ryzen on any encoding recently, and no 4K for even longer, and it so depends on the settings & filters you use, that can affect things so much, but it's reasonably impressive.
Some 4K encodes can take day's, and it's a bit of an anxious wait, hoping nothing goes wrong, and it's all been a waste of time.
So just re reading your 1st post, you state that your future CPU needs to process 4K x265 @ 60fps....that's a lot...
It would probably be cheaper to have 2 5900X's, (than a Threadripper) and use Distributed Encoding, you'd have 32 cores crunching thru this..
I think I need to rethink how I process 4K footage, unless it needs some sort of denoising or cleanup, it probably doesn't warrant the time it takes to encode them, if it's not really necessary.
If you need to remove video, remove or convert audio tracks and unneeded subtitles, there are other substantially quicker ways to achieve that.
There might be some older post's from those who are rich enough to be able to afford a 32 or 64 core Threadripper setup.
frencher
18th June 2021, 14:36
Hi, I have to admit I haven't used the Ryzen on any encoding recently, and no 4K for even longer, and it so depends on the settings & filters you use, that can affect things so much, but it's reasonably impressive.
Some 4K encodes can take day's, and it's a bit of an anxious wait, hoping nothing goes wrong, and it's all been a waste of time.
So just re reading your 1st post, you state that your future CPU needs to process 4K x265 @ 60fps....that's a lot...
It would probably be cheaper to have 2 5900X's, (than a Threadripper) and use Distributed Encoding, you'd have 32 cores crunching thru this..
I think I need to rethink how I process 4K footage, unless it needs some sort of denoising or cleanup, it probably doesn't warrant the time it takes to encode them, if it's not really necessary.
If you need to remove video, remove or convert audio tracks and unneeded subtitles, there are other substantially quicker ways to achieve that.
There might be some older post's from those who are rich enough to be able to afford a 32 or 64 core Threadripper setup.
4K @ 15/20 fps ;)
Here h265 4K to h265 1080p
https://i.goopics.net/800/w9AgR.jpg (https://goopics.net/i/w9AgR)
With Threadreapper :goodpost:
We now move into the world of video encoding, wherein you are at the whims of the encoder itself. As you can see here, the x.265 encoder demands clock speed almost as much as raw core count, with the 3960X and 3970X outperforming our tweaked 3990X.
https://overclock3d.net/reviews/cpu_mainboard/amd_ryzen_threadripper_3990x_64_core_monster_review/7
https://overclock3d.net/gfx/articles/2020/04/12092218585l.jpg
chainring
18th June 2021, 17:15
@ frencher
Do you have a link handy for that x265 benchmark? Searching brings up multiple hits and different tools.
Thanks!
frencher
18th June 2021, 18:15
@ frencher
Do you have a link handy for that x265 benchmark? Searching brings up multiple hits and different tools.
Thanks!
The benchmark link is just above the screenshot
Ryzen Threadripper PRO 3995WX ā 64 cores / 128 threads @ 5489 dollars :eek:
Look here: https://www.tomshardware.fr/les-ryzen-threadripper-pro-debarquent-sur-le-marche-diy/
Atak_Snajpera
18th June 2021, 19:01
That benchmark does not show full potential of 3990X!
In distributed encoding mode 64 core CPU will be always noticeable faster than OC 32 core. Check my x265 FHD Benchmark. Divide FPS by 4 to get estimated speed for 4k resolution.
https://forum.pclab.pl/topic/1184884-x265-fhd-benchmark/
chainring
18th June 2021, 19:02
I mean the actual benchmark program itself. I looked at the link you posted and I'm either blind or they make it exceedingly difficult to find the benchmark program.
edit: Just realized that may not be your benchmark run. Duh.
frencher
18th June 2021, 21:44
That benchmark does not show full potential of 3990X!
In distributed encoding mode 64 core CPU will be always noticeable faster than OC 32 core. Check my x265 FHD Benchmark. Divide FPS by 4 to get estimated speed for 4k resolution.
https://forum.pclab.pl/topic/1184884-x265-fhd-benchmark/
Atak,
Would you have a screenshot with x265 FHD Benchmark and your processor.
Thank you.
frencher
18th June 2021, 21:49
I mean the actual benchmark program itself. I looked at the link you posted and I'm either blind or they make it exceedingly difficult to find the benchmark program.
edit: Just realized that may not be your benchmark run. Duh.
http://www.mediafire.com/file/nm5n7xg2nb22zl7/x265_FHD_Benchmark.7z/file
Atak_Snajpera
18th June 2021, 22:52
Atak,
Would you have a screenshot with x265 FHD Benchmark and your processor.
Thank you.
This
http://i.cubeupload.com/CJ6v4n.png
frencher
18th June 2021, 23:21
i7 3930k :(
https://i.goopics.net/800/gYy4J.jpg (https://goopics.net/i/gYy4J)
Intel Core i7-3930K @ 3.2GHz ( 6C / 12T )
y4m [info]: 1920x1080 fps 50/1 i420p8 sar 1:1 unknown frame count
raw [info]: output file: NUL
x265 [info]: HEVC encoder version 2.2+15-a18ab7656c30
x265 [info]: build info [Windows][GCC 6.2.0][64 bit] 8bit
x265 [info]: using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX
x265 [info]: Main Still Picture profile, Level-4.1 (Main tier)
x265 [info]: Thread pool created using 12 threads
x265 [info]: Slices : 1
x265 [info]: frame threads / pool features : 3 / wpp(17 rows)
x265 [info]: Coding QT: max CU size, min CU size : 64 / 8
x265 [info]: Residual QT: max TU size, max depth : 32 / 1 inter / 1 intra
x265 [info]: ME / range / subpel / merge : hex / 57 / 2 / 2
x265 [info]: Keyframe min / max / scenecut / bias: 50 / 500 / 40 / 5.00
x265 [info]: Lookahead / bframes / badapt : 20 / 4 / 2
x265 [info]: b-pyramid / weightp / weightb : 1 / 1 / 0
x265 [info]: References / ref-limit cu / depth : 3 / on / on
x265 [info]: AQ: mode / str / qg-size / cu-tree : 1 / 1.0 / 32 / 1
x265 [info]: Rate Control / qCompress : CRF-28.0 / 0.60
x265 [info]: tools: rd=3 psy-rd=2.00 rskip signhide tmvp strong-intra-smoothing
x265 [info]: tools: lslices=6 deblock sao
encoded 2500 frames in 202.16s (12.37 fps), 7025.74 kbps, Avg QP:37.21
Results please send to: x264.fhd.benchmark@gmail.com
frencher
18th June 2021, 23:25
This
http://i.cubeupload.com/CJ6v4n.png
The cubeupload.com capture is blocked by Malwarebyte.
I use https://goopics.net/
guest
19th June 2021, 02:47
4K @ 15/20 fps ;)
Here h265 4K to h265 1080p
https://i.goopics.net/800/w9AgR.jpg (https://goopics.net/i/w9AgR)
That screenshot doesn't really prove a thing !!!
You don't mention what settings you're using, or filters, just "h265 4K to h265 1080p", and is that with the 3930K ???
Who knows..and why aren't you using Distributed Encoding ??
Tell me your settings, and I will do a test on my 3950X for you..
guest
19th June 2021, 02:50
i7 3930k :(
https://i.goopics.net/800/gYy4J.jpg (https://goopics.net/i/gYy4J)
Intel Core i7-3930K @ 3.2GHz ( 6C / 12T )
y4m [info]: 1920x1080 fps 50/1 i420p8 sar 1:1 unknown frame count
raw [info]: output file: NUL
x265 [info]: HEVC encoder version 2.2+15-a18ab7656c30
x265 [info]: build info [Windows][GCC 6.2.0][64 bit] 8bit
x265 [info]: using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX
x265 [info]: Main Still Picture profile, Level-4.1 (Main tier)
x265 [info]: Thread pool created using 12 threads
x265 [info]: Slices : 1
x265 [info]: frame threads / pool features : 3 / wpp(17 rows)
x265 [info]: Coding QT: max CU size, min CU size : 64 / 8
x265 [info]: Residual QT: max TU size, max depth : 32 / 1 inter / 1 intra
x265 [info]: ME / range / subpel / merge : hex / 57 / 2 / 2
x265 [info]: Keyframe min / max / scenecut / bias: 50 / 500 / 40 / 5.00
x265 [info]: Lookahead / bframes / badapt : 20 / 4 / 2
x265 [info]: b-pyramid / weightp / weightb : 1 / 1 / 0
x265 [info]: References / ref-limit cu / depth : 3 / on / on
x265 [info]: AQ: mode / str / qg-size / cu-tree : 1 / 1.0 / 32 / 1
x265 [info]: Rate Control / qCompress : CRF-28.0 / 0.60
x265 [info]: tools: rd=3 psy-rd=2.00 rskip signhide tmvp strong-intra-smoothing
x265 [info]: tools: lslices=6 deblock sao
encoded 2500 frames in 202.16s (12.37 fps), 7025.74 kbps, Avg QP:37.21
Results please send to: x264.fhd.benchmark@gmail.com
We seem to have a bit of a pissing contest going on here...I get it, you both have pretty basic cpu's.
Also, what's the go with that VERY old x265 build ???
x265 [info]: HEVC encoder version 2.2+15-a18ab7656c30
"We're" up to 3.5 + 10 !!!!, that could even make a difference !!!
guest
19th June 2021, 06:07
Hey guy's,
So now that Atak has provided us with some recent updates, you still have to run the updates to get to the current version.
So I have started with 1.26.0 from page 1, and then downloaded & installed ALL the available updates, so that you can just start using v1.26.1, straight off.
So anyone interested, it's here for the taking, this is legit, and updated, untouched v1.26.1.
https://www.mediafire.com/file/ox6da3k67bipcly/RipBot264v1.26.1.7z/file
However, if you would like to try my very modified v1.26.1, that has the majority of the components that RipBot uses, all running with the latest available versions & builds, not to mention many, many, more filters, for DeHaloing, Denoising, DeBlocking, Deinterlacing, etc. I've been working on this for a few months, and have been using without issue.
So if you want to give that a try, then grab it here :-
https://www.mediafire.com/file/axhu7qkfy4w4vzl/RipBot264v1.26.1_%2528special%2529.7z/file
DO NOT forget to read the "instructions" !!!!
And check out the Tools listing to see what you get, and most of the "extra" filters are found under the "Custom Script" drop down.
Atak_Snajpera
19th June 2021, 12:46
"We're" up to 3.5 + 10 !!!!, that could even make a difference !!!
Plot twist: newer builds are even slower !!!
Ryushin
19th June 2021, 12:52
Hi Atak,
I've been having a memory error from x265 since the latest update:
---------------------------
x265_x64.exe - Application Error
---------------------------
The instruction at 0x00007FF701D6E902 referenced memory at 0x0000000000020000. The memory could not be written.
Click on OK to terminate the program
---------------------------
Same VM system that has been running for years with ECC memory. Did not install any windows updates in the last week or so. Only the RB update has occurred, but I'm not sure if it was this last update, or the update before that.
Atak_Snajpera
19th June 2021, 13:20
Just to be 100% sure ,can you run memtest on that PC?
https://www.memtest.org/#downiso
Maybe you are running out of memory? (physical/virtual on that VM)
frencher
19th June 2021, 14:30
That screenshot doesn't really prove a thing !!!
You don't mention what settings you're using, or filters, just "h265 4K to h265 1080p", and is that with the 3930K ???
Who knows..and why aren't you using Distributed Encoding ??
Tell me your settings, and I will do a test on my 3950X for you..
I will have specified if I had changed my config (I7 3930k) and I just applied a resize from {GPU} 4k h265 to Full HD h265 (1080p).
Indeed I will be interested in testing on your 3950X.
I did not find tutorials for distributed encoding
guest
19th June 2021, 14:34
Plot twist: newer builds are even slower !!!
I guess it would depend on your CPU instruction set,
Either SSE*, AVX, or AVX2, and another problem might be in a DE setup, if you had an AVX2 CPU on the client, and some servers were a mixture of SSE* or AVX, would there be a conflict or a problem ??
Your latest update brought the x265 build up to 5.9, but what instruction set do you use, to be more compatible with the different systems that users would have, you'd probably have to go for an SSE* type.
guest
19th June 2021, 14:40
I will have specified if I had changed my config (I7 3930k) and I just applied a resize from {GPU} 4k h265 to Full HD h265 (1080p).
Indeed I will be interested in testing on your 3950X.
I did not find tutorials for distributed encoding
OK, so if it's just a simple resize, I'd be happy to do a quick test on one of my 4K movies, but I will be using CPU decoding instead, but I might try the GPU option, not that that should affect the encoding fps's.
So give be a couple of days, I WILL get back to you, either here or PM.
As for DE, there aren't any active tutorials to be found, but it's kinda straight forward, there just a couple of settings to change & enable, and you're away.
Do you have more than 1 PC ???, if not, you can still use it on 1, and it will increase speeds.
guest
19th June 2021, 14:43
Hi Atak,
I've been having a memory error from x265 since the latest update:
---------------------------
x265_x64.exe - Application Error
---------------------------
The instruction at 0x00007FF701D6E902 referenced memory at 0x0000000000020000. The memory could not be written.
Click on OK to terminate the program
---------------------------
Same VM system that has been running for years with ECC memory. Did not install any windows updates in the last week or so. Only the RB update has occurred, but I'm not sure if it was this last update, or the update before that.
Hi Ryushin,
No prob's here, mate....maybe you could overwrite the x265.exe, with one from a previous build.
OR, from here (take your pick) http://msystem.waw.pl/x265/
frencher
19th June 2021, 23:20
OK, so if it's just a simple resize, I'd be happy to do a quick test on one of my 4K movies, but I will be using CPU decoding instead, but I might try the GPU option, not that that should affect the encoding fps's.
So give be a couple of days, I WILL get back to you, either here or PM.
As for DE, there aren't any active tutorials to be found, but it's kinda straight forward, there just a couple of settings to change & enable, and you're away.
Do you have more than 1 PC ???, if not, you can still use it on 1, and it will increase speeds.
Hello Paul Dunne,
Rather here because it is possible that it also interests other people than me.
I would like to have the procedure to gain some fps because for the moment the budget for a Ryzen is not there.
I actually have 3 non-OC PCs
An Intel i7 3930k :cool:
An Intel E6700 :rolleyes:
An AMD 64 X2 :D
guest
20th June 2021, 01:47
Hello Paul Dunne,
Rather here because it is possible that it also interests other people than me.
I would like to have the procedure to gain some fps because for the moment the budget for a Ryzen is not there.
I actually have 3 non-OC PCs
An Intel i7 3930k :cool:
An Intel E6700 :rolleyes:
An AMD 64 X2 :D
OK, so "we" have a starting point at least :)
So the next and most important thing is, are these on a network ??
It doesn't need to be anything special, and I don't think wireless works (I could be wrong, I've never tried it).
Can't use DE on other PC's without them being connected.
And you're correct, there's NO tutorials around, the one that Atak posted many years ago isn't available anywhere, any more, and it was pretty basic, and would now be very out dated.
It would be great for all concerned, if Atak produced another more current & detailed, setup & usage video. Hint, hint.
Atak_Snajpera
20th June 2021, 08:44
Ofcourse wireless works. Even old 54 Mbps (pre-N) will be more than enough for slow pcs.
guest
20th June 2021, 09:57
Ofcourse wireless works. Even old 54 Mbps (pre-N) will be more than enough for slow pcs.
Thanks for confirming that, like I said I've never tried it. :)
frencher
20th June 2021, 11:31
OK, so "we" have a starting point at least :)
So the next and most important thing is, are these on a network ??
It doesn't need to be anything special, and I don't think wireless works (I could be wrong, I've never tried it).
Can't use DE on other PC's without them being connected.
And you're correct, there's NO tutorials around, the one that Atak posted many years ago isn't available anywhere, any more, and it was pretty basic, and would now be very out dated.
It would be great for all concerned, if Atak produced another more current & detailed, setup & usage video. Hint, hint.
Ofcourse wireless works. Even old 54 Mbps (pre-N) will be more than enough for slow pcs.
Yes I am using a dual 2.4 / 5 Ghz Wi-Fi network and are all connected.
https://i.goopics.net/800/mAXJG.jpg (https://goopics.net/i/mAXJG)
I have a fairly good speed, but I intend to use a much faster Devolo 2400 CPL later.
Of course a video would be welcome, by the way I just subscribed to the Atak_Snajpera youtube channel
Atak_Snajpera
20th June 2021, 12:07
Thanks for confirming that, like I said I've never tried it. :)
It is a simple math.
Let's say you have 50 Mbps 4k@24fps movie and 3 PCs in DE mode
Each PC during encoding achieves 4 fps. This means that each PC will be downloading data from HOST PC @~8 Mbps (50Mbps/24fps*4fps). In this scenario three PCs will consume 24Mbps of wireless bandwidth. Ofcourse you have to also include encoded data which is being sent back to HOST PC so overall network usage will be higher. It all depends from bitrate used in encoded file.
guest
20th June 2021, 12:30
It is a simple math.
Let's say you have 50 Mbps 4k@24fps movie and 3 PCs in DE mode
Each PC during encoding achieves 4 fps. This means that each PC will be downloading data from HOST PC @~8 Mbps (50Mbps/24fps*4fps). In this scenario three PCs will consume 24Mbps of wireless bandwidth. Ofcourse you have to also include encoded data which is being sent back to HOST PC so overall network usage will be higher. It all depends from bitrate used in encoded file.
Well, that's good news for @frencher
guest
20th June 2021, 12:59
Yes I am using a dual 2.4 / 5 Ghz Wi-Fi network and are all connected.
OK, well that's good, but I don't think you find anything relevent on that YT channel (I just had a look).
OK, well to start with you'd need RipBot on all machines.
So if you want to use all of them, you need to have one that you use as the client (where you do the encoding jobs), and the other 2 can be the server's (helpers, if you will), you just need to enable Distributed Encoding, apply the appropriate IP address.
Say your Client pc (3930K) was 192.168.1.1, and the other pc's were 192.168.1.2, and so on.
Don't forget to click APPLY once done.
https://i.imgur.com/u8ve9Fb.jpg
Left side column, #1 & 2 are the Client's IP settings
#3 & 4 are say the 6700's IP settings
#5 & 6 are the AMD's IP settings.
And you will need to do simliar on the other PC's. (Apparently not, see Atak's comment below)
So once that's done you need to test, and have say the 6700 with RipBot open, and start a job on the 3930K, and once it opens the Encoding Client window, it will prepare the encoding, and once it starts, it should start encoding on all PC's.
That should work, it's harder to describe things sometimes, than doing them.
Atak_Snajpera
20th June 2021, 13:30
And you will need to do simliar on the other PC's.
Only EncodingServer.exe is required on slave PCs.
guest
20th June 2021, 13:34
Only EncodingServer.exe is required on slave PCs.
Well, there's something I didn't know :)
Thanks for the info.......
frencher
20th June 2021, 16:02
Only EncodingServer.exe is required on slave PCs.
My E6700 OS is Windows 7 x86 no x64 :mad:
And require Avisynth+ for EncodingServer.exe
It's possible to upgade Win7 Pro x86 directly to Win10 x64 ?
frencher
20th June 2021, 16:05
OK, well that's good, but I don't think you find anything relevent on that YT channel (I just had a look).
OK, well to start with you'd need RipBot on all machines.
So if you want to use all of them, you need to have one that you use as the client (where you do the encoding jobs), and the other 2 can be the server's (helpers, if you will), you just need to enable Distributed Encoding, apply the appropriate IP address.
Say your Client pc (3930K) was 192.168.1.1, and the other pc's were 192.168.1.2, and so on.
Don't forget to click APPLY once done.
https://i.imgur.com/u8ve9Fb.jpg
Left side column, #1 & 2 are the Client's IP settings
#3 & 4 are say the 6700's IP settings
#5 & 6 are the AMD's IP settings.
And you will need to do simliar on the other PC's. (Apparently not, see Atak's comment below)
So once that's done you need to test, and have say the 6700 with RipBot open, and start a job on the 3930K, and once it opens the Encoding Client window, it will prepare the encoding, and once it starts, it should start encoding on all PC's.
That should work, it's harder to describe things sometimes, than doing them.
Pauly Dunne :thanks: ;)
Atak_Snajpera
20th June 2021, 16:43
My E6700 OS is Windows 7 x86 no x64 :mad:
And require Avisynth+ for EncodingServer.exe
It's possible to upgade Win7 Pro x86 directly to Win10 x64 ?
Using old dual cores for 4k will be a waste of energy.
Athlon x2 + E6700 will give you at best extra 0.5 fps. Also keep in mind that encoding 4k footage will consume 4 times more memory than typical 1080p. I doubt that your old PCs have more than 4 GiB of RAM.
frencher
20th June 2021, 19:49
Using old dual cores for 4k will be a waste of energy.
Athlon x2 + E6700 will give you at best extra 0.5 fps. Also keep in mind that encoding 4k footage will consume 4 times more memory than typical 1080p. I doubt that your old PCs have more than 4 GiB of RAM.
It is better for me to wait for the future CPU, I suspected a little.
guest
21st June 2021, 01:11
It is better for me to wait for the future CPU, I suspected a little.
Well, you could at least give it a try.
Don't forget you can use DE on 1 PC, it's just a little different with the IP address's.
Although, seeing you use a Wireless network, you may not need to change anything.
For example, I'm on a wired LAN, with 192.168.1.X's, and if I want to use just the one PC with DE, I just need to have the network switch / hub powered on.
otherwise-----
I think the IP address you'd need to use is 127.0.0.1, with the :1000 as well.
Nothing ventured, nothing gained.
Ryushin
23rd June 2021, 22:36
Hi Atak,
I've been having a memory error from x265 since the latest update:
---------------------------
x265_x64.exe - Application Error
---------------------------
The instruction at 0x00007FF701D6E902 referenced memory at 0x0000000000020000. The memory could not be written.
Click on OK to terminate the program
---------------------------
Same VM system that has been running for years with ECC memory. Did not install any windows updates in the last week or so. Only the RB update has occurred, but I'm not sure if it was this last update, or the update before that.
Installed the latest Windows updates and rebooted. Memory error went away. there was probably something residual left over after RB updated. The reboot probably fixed it.
StormMeows
24th June 2021, 18:30
Hey guys, long time lurker here. I am planning to soon encode a lot of my blu-ray backups and want to maintain the best quality. I was originally going to do staxrip with my NVIDIA GPU but the more I researched it, I do not feel like the quality is up to my standards. Most of the GPU encoding I saw loses a lot of detail from the original bluray source. Would Ripbot be a good program to do x265 bluray backups? I want to be able to get the best possible quality as the original source and retain the lossless audio tracks on all of my encodes. If this is a great way to go, I plan on getting a better encoding PC dedicated to my encodes. Also, is there a guide anywhere that goes over what are good extra advanced settings I can use on all of my encodes? I want the encode to look similar to the orginal. I am fine with a bigger file size as well (as long as it is smaller by at least 20% of the original). I would really appreciate any guidance. Thanks guys!
Ripmann
24th June 2021, 23:40
Just updated and immediately noticed that the output line is now editable. Thanks a lot, Atak. Major time saver. I don't think I'll ever be using the Save As dialog anymore.
I have a quick noob question: is there a lossy codec similar to AC3 that allows you to keep all 7.1 channels, not just 5.1? I can't afford to use uncompressed DTS or TrueHD audio and having the audio track being almost the same size (if not more) as the video track, but I'd like to keep all channels at least for some of the encodes as well. Is there a solution for this? I'm sure there must be, but I just got my first modest 7.1 system and this is the first time I have to worry about this.
...Would Ripbot be a good program to do x265 bluray backups? I want to be able to get the best possible quality as the original source and retain the lossless audio tracks on all of my encodes...
It definitely is. I've been using it for years and it's fantastic, there's no other word for it. I believe it was designed to be noob friendly, so you should be able to dive right in. Once you get the hang of it, you'll be able to optimize your encodes further and further. I highly recommend you try it.
As for the advanced settings, most of this stuff is fairly self-explanatory. It also depends on what you exactly you want and the kinds of video files you'll be processing. You may have to look up some of the terminology, but other than that, you'll probably be better off by taking a small sample file and doing several attempts to see how it looks on various settings, asking for help with specific issues, once you encounter them. Hope this helps.
StormMeows
25th June 2021, 00:31
It definitely is. I've been using it for years and it's fantastic, there's no other word for it. I believe it was designed to be noob friendly, so you should be able to dive right in. Once you get the hang of it, you'll be able to optimize your encodes further and further. I highly recommend you try it.
As for the advanced settings, most of this stuff is fairly self-explanatory. It also depends on what you exactly you want and the kinds of video files you'll be processing. You may have to look up some of the terminology, but other than that, you'll probably be better off by taking a small sample file and doing several attempts to see how it looks on various settings, asking for help with specific issues, once you encounter them. Hope this helps.
Thank you! I am glad to hear that it is newb friendly. I am going to do research on these advanced settings. Trial and error is going to be key. When I do a sample, how do I know what scenes of movies to test? Are there certain scenes that I need to test (like dark scenes or action sequences)? Or do I just encode the first 10 minutes of a film and compare it to the original? Is there a best practice that I can use for testing the samples so I can ensure I don't waste a whole day on an encode and there is tons of pixelation or similar in the final result? Thank you!
guest
25th June 2021, 01:50
Just updated and immediately noticed that the output line is now editable. Thanks a lot, Atak. Major time saver. I don't think I'll ever be using the Save As dialog anymore.
I "told" you about this, age's ago....have you been hiding under a rock ?
https://forum.doom9.org/showthread.php?p=1945290#post1945290
I have a quick noob question: is there a lossy codec similar to AC3 that allows you to keep all 7.1 channels, not just 5.1? I can't afford to use uncompressed DTS or TrueHD audio and having the audio track being almost the same size (if not more) as the video track, but I'd like to keep all channels at least for some of the encodes as well. Is there a solution for this? I'm sure there must be, but I just got my first modest 7.1 system and this is the first time I have to worry about this.
You must be compressing your encodes down a LOT, if the audio track is a similar size to the video track. :confused:
guest
25th June 2021, 02:02
Thank you! I am glad to hear that it is newb friendly. I am going to do research on these advanced settings. Trial and error is going to be key. When I do a sample, how do I know what scenes of movies to test? Are there certain scenes that I need to test (like dark scenes or action sequences)? Or do I just encode the first 10 minutes of a film and compare it to the original? Is there a best practice that I can use for testing the samples so I can ensure I don't waste a whole day on an encode and there is tons of pixelation or similar in the final result? Thank you!
Hi StormMeows,
I wouldn't exactly say it was "newb" / "noob" friendly, but it is fairly easy to use, and I'm not too sure about these "Advanced Setting's" either, they're just "setting's" !!!
I'd say the complicated function of RipBot is the Distributed Encoding, now once you've sorted that out, you'll never look back.
Do you have more than one PC ???
What have you got in mind for your "new" encoding PC ???, something pretty powerful, I would suggest !!! (Ryzen 9 5950X)
Also, what is you main objective, meaning do you do a lot of 4K encoding ??
After reading your recent posts on other Forums, you have a pretty powerful system already, and also from what I understand, encoding & re encoding, is just a waste of time & energy (electricity), as you want to basically keep the movies "as is" !!!
SO...
If you want to keep the original size & quality of any of your video's (especially 4K), you'd be just as well off running them thru MKVToolNix, and removing any video, audio & subtitles tracks you don't need, and that's that...quick 'n easy, and will in most cases greatly reduce the file size.
It's just that any 4K encoding can take a very long time, especially if you're using "strong" filter's.
But like Ripmann suggested, grab a sample or a short video, and just test any settings that you think that particular file needs, to "look good", in your eye's.!!!
Ripmann
25th June 2021, 05:14
I "told" you about this, age's ago....have you been hiding under a rock ?
Sorry, missed it. As I said, busy month. Never had a chance to update RipBot before today, let alone have enough time to read the forums.
You must be compressing your encodes down a LOT, if the audio track is a similar size to the video track. :confused:
An uncompressed TrueHD 7.1 stream for a 90-minute movie is 2.5GB. If my goal is to make a 4.37gb DVD-sized encode, that's 57% of the overall file wasted on audio. Even if it's a 7.94gb encode, it's still 31.5% of the total. Clearly a waste of space, especially considering that the 640kbps 5.1 AC3 version for the same file is 413mb. If there's a way to compress that 7.1 to half a gigabyte, I'll gladly take it. Who wouldn't?
guest
25th June 2021, 07:21
Sorry, missed it. As I said, busy month. Never had a chance to update RipBot before today, let alone have enough time to read the forums.
An uncompressed TrueHD 7.1 stream for a 90-minute movie is 2.5GB. If my goal is to make a 4.37gb DVD-sized encode, that's 57% of the overall file wasted on audio. Even if it's a 7.94gb encode, it's still 31.5% of the total. Clearly a waste of space, especially considering that the 640kbps 5.1 AC3 version for the same file is 413mb. If there's a way to compress that 7.1 to half a gigabyte, I'll gladly take it. Who wouldn't?
Hey Ripmann,
Well, unfortunately, I have no use for 7.1 "anything" as my Home Theatre only supports 5.1.
I was going to a lot of trouble to convert THD to DTSMA with eac3to, and another old app that I can't recall the name of atpit.
But then I found a quick way to convert pretty much ANY audio to E-AC3, using eac3to, (which is still 5.1), but it sounds pretty good to my old ears.
Unfortunately, RipBot doesn't convert THD to much, or at least E-AC3, but there other ways.
Anyway, we all have different ways of doing things that we want, just a shame that there isn't just one app, that will do it all.
Imagine combining Handbrake, Straxrip, Hybrid & RipBot, together. :D
https://forum.doom9.org/showthread.php?p=1945413#post1945413
Ripmann
25th June 2021, 15:41
Damn, I stopped actively following the codec scene a long time ago, but I was expecting that an easy 7.1 solution was out there, considering that such systems became widespread years ago.
I'm definitely looking up all the stuff you mentioned, though. RipBot is so convenient, familiar, and time-saving that I became utterly lazy relying on its features. I heard about E-AC3 a while ago but stayed with RipBot's AC3 anyway. Same with better degraining methods like SMDegrain. We discussed it more a month ago and I already did a dozen of jobs using RipBot's built-in denoising methods. Time to get off my butt and take a crash course in newer alternatives. Thanks for the pointers.
EDIT: From the first glance, it looks like E-AC3 supports 7.1 after all. Thanks again for the motivation.
chainring
25th June 2021, 18:09
EDIT: From the first glance, it looks like E-AC3 supports 7.1 after all. Thanks again for the motivation.
Yep, just lossy vs. TrueHD being lossless.
Ripmann
26th June 2021, 13:32
Atak, how difficult would it be to fully switch to E-AC3? After playing with it for a bit, it looks like a superior successor to AC3 in every possible way. Up to 15 channels, Atmos compatibility, much higher maximum bitrate, better compression algorithm, etc. Would it be too time consuming for you to implement it at this point?
Atak_Snajpera
26th June 2021, 13:57
Does ffmpeg even support E-AC3 7.1 encoding?
guest
26th June 2021, 14:45
Does ffmpeg even support E-AC3 7.1 encoding?
Not yet it don't, and I've been looking !!
Handbrake, clever FFmpeg-GUI, & Axiom can change nearly any format to E-AC3, but the max is still only 5.1.
Also, a certain procedure using eac3to, with the help of FFMPEG, can do conversions to E-AC3, up to default E 640, but you can edit that value, and I use 1536.
But a downmixed THD or DTS 7.1 to E-AC3 5.1 sound's pretty good, if you run it @ 1536.
If you could (and I know you could) add an E-AC3 option, that would be brilliant :)
g0th1ckn1ght
26th June 2021, 21:36
Hi all, i have recently come back to Ripbot for backing up my blu rays. Can any offer any advice on how i use Ripbot. I run anydvd hd along with ripbot
insert blu ray into drive
I open the stream and demux the bluray using ripbot (demux audio as well to keep original uncompressed audio as well as any subtitles i need)
I then select hevc and copy stream for video
Copy stream for audio
Add subtitles (including forced)
Then hit done and it starts remuxing
So far the quality has great (as far as i can tell, no difference between inserting the disc into the player vs watching my ,mkv's via Kodi)
Large file sizes are not a big deal for me, video and audio quality are
guest
27th June 2021, 01:59
Hi all, i have recently come back to Ripbot for backing up my blu rays. Can any offer any advice on how i use Ripbot. I run anydvd hd along with ripbot
insert blu ray into drive
I open the stream and demux the bluray using ripbot (demux audio as well to keep original uncompressed audio as well as any subtitles i need)
I then select hevc and copy stream for video
Copy stream for audio
Add subtitles (including forced)
Then hit done and it starts remuxing
So far the quality has great (as far as i can tell, no difference between inserting the disc into the player vs watching my ,mkv's via Kodi)
Large file sizes are not a big deal for me, video and audio quality are
Nearly 6 years since your last post.....
Not too sure why you're asking, you have described your process, that works for you, just carry on.
What else do you want to know ??
g0th1ckn1ght
27th June 2021, 11:58
Nearly 6 years since your last post.....
Not too sure why you're asking, you have described your process, that works for you, just carry on.
What else do you want to know ??
I was just wondering if there was anything else i am missing or if this method is the best way to get the best quality
guest
28th June 2021, 01:11
I was just wondering if there was anything else i am missing or if this method is the best way to get the best quality
I would say that the way you are doing it, is probably the quickest way, and you maintain the original video & audio quality, so like I said before, if you're happy with that, then by all means continue doing that.
Once you start using different filters, for removing grain or noise, then it becomes a different & slower process.
Sometimes you can "clean up" the video, and actually make it look better than original, unfortunately, too many movies have grain & noise, which can be filtered out, however, there are ppl out there that like the "feel" of some grain & noise.....me, not so much, the clearer & cleaner the better.
It's all in the eye of the beholder (as they say).
g0th1ckn1ght
28th June 2021, 01:22
I would say that the way you are doing it, is probably the quickest way, and you maintain the original video & audio quality, so like I said before, if you're happy with that, then by all means continue doing that.
Once you start using different filters, for removing grain or noise, then it becomes a different & slower process.
Sometimes you can "clean up" the video, and actually make it look better than original, unfortunately, too many movies have grain & noise, which can be filtered out, however, there are ppl out there that like the "feel" of some grain & noise.....me, not so much, the clearer & cleaner the better.
It's all in the eye of the beholder (as they say).
Thank you for the advice. I am going for the "as close to original" as I can get.
I do understand what you mean about noise an grain though. Doesn't always look the best.
Thanks again
kempodragon
28th June 2021, 16:56
After much experimentation, I've partially succeeded in getting Ripbot to encode my 3-D movies. First I tried loading the main view file, which is also used for 2D playback. I then copied the avs file that BD3D2MK3D generated into Ripbot's editor. When I tried previewing the file, I got the message it could not initialize the mvc file, and listed the line with the plugin.
To confirm that BD3 avs file wasn't the problem, I opened it with VirtualDub2, and, just for fun, I made an uncompressed full SBS file. I wanted to see how Ripbot would handle an uncompressed file, but at 1.6 TB it was too big to transfer to the ssd that I have Ripbot's temp file on. :D
Finally, I directly opened the BD3 avs in Ripbot. It opened with no problem, but took so long extracting the frame information that I thought Ripbot had locked up. Once it finished, I was able to preview it with no problems, so I crossed my fingers and tried encoding.
Here's why I partially succeeded. Ripbot encoded it with no problems, but DE would not start no matter what. Task manager showed nothing in the wait states, but did say the DE server was waiting for network I/O. I could not manually start DE either. There were no error messages, DE simply refused to start. Hopefully, Atak can figure this problem out because I would love to see what kind of encoding speed I can get with DE, since even w/o it Ripbot still managed a respectable 32 fps encoding a full SBS at level 5.0
Atak_Snajpera
28th June 2021, 17:57
De mode will never work if physical video.mkv file is missing in job folder.
StormMeows
11th July 2021, 18:11
Hey guys, is there anyone out there that uses Staxrip and Ripbot? I recently learned how to use Staxrip for backing up my large blu-ray collection and I am loving it, but it doesn't take full advantage of my AMD 5950x. When I am doing x264 8-bit encodes, it is only typically using ~70% of the CPU power. I have been following this Ripbot thread and have seen the evidence where you can 100% use the AMD multi threading processors, like my 5950x. With Staxrip, I could probably change some settings to make it reach 100% but that might suffer quality of the overall encode, right? Thanks for any guidance on this. I have a ton of movies I need to do and don't want to lose any quality (I aim for transparency to the original blu-ray). Thanks!
Atak_Snajpera
11th July 2021, 18:47
Just activate distributed encoding mode with 2 servers and you will have constant 100% cpu usage.
StormMeows
11th July 2021, 19:17
Just activate distributed encoding mode with 2 servers and you will have constant 100% cpu usage.
How is the quality of Ripbot x264 8 bit going to compare to Staxrip? I read that the more threads that I use on my AMD processor, the more it degrades the overall quality. Is that why Staxrip only typically uses 60-75% of my CPU? Thanks
JKyle
11th July 2021, 20:34
How is the quality of Ripbot x264 8 bit going to compare to Staxrip? I read that the more threads that I use on my AMD processor, the more it degrades the overall quality. Is that why Staxrip only typically uses 60-75% of my CPU? Thanks
StaxRip does x265 chunk encoding by cutting frames into N chunks (simple arithmetic division of the total number of frames = equal chunking) if Input/Output > Chunks is set to N in x265 Options. But unlike RipBot, each chunk employs separate processes in the SAME CPU in StaxRip.
I don't know how RipBot cuts the frames for DE in different servers, but if it cuts the frames evenly by simple arithmetic division (equal chunking), the only difference b/w StaxRip and RipBot lies in whether different CPUs can be employed (RipBot) or not (StaxRip).
And equal chunking is obviously inferior to scene-aware chunking which cuts frames based on frame similarities via ffmpeg, etc.
If you're interested in scene-aware chunking in x265, you may want to try Av1an (https://github.com/master-of-zen/Av1an). But since it's a CLI app, it has some learning curve, though.
For reference, there was a request to implement scene-aware chunking in StaxRip (https://github.com/staxrip/staxrip/issues/619), but it's put off as of now due to some difficult obstacles at the code level.
Anyway, my apologies for cluttering up this thread with StaxRip topics. :rolleyes:
StormMeows
11th July 2021, 21:54
StaxRip does x265 chunk encoding by cutting frames into N chunks (simple arithmetic division of the total number of frames = equal chunking) if Input/Output > Chunks is set to N in x265 Options. But unlike RipBot, each chunk employs separate processes in the SAME CPU in StaxRip.
I don't know how RipBot cuts the frames for DE in different servers, but if it cuts the frames evenly by simple arithmetic division (equal chunking), the only difference b/w StaxRip and RipBot lies in whether different CPUs can be employed (RipBot) or not (StaxRip).
And equal chunking is obviously inferior to scene-aware chunking which cuts frames based on frame similarities via ffmpeg, etc.
If you're interested in scene-aware chunking in x265, you may want to try Av1an (https://github.com/master-of-zen/Av1an). But since it's a CLI app, it has some learning curve, though.
For reference, there was a request to implement scene-aware chunking in StaxRip (https://github.com/staxrip/staxrip/issues/619), but it's put off as of now due to some difficult obstacles at the code level.
Anyway, my apologies for cluttering up this thread with StaxRip topics. :rolleyes:
Thanks for the comparison between the two programs! I really appreciate it. It sounds like for x264 8-bit 1080p blu-ray encodes, I am fine using either of these fine programs.
Deputy Cartman
15th July 2021, 14:42
Looooong time RipBot264 user but I'm unable to resolve an issue with Temp files and I'm hoping someone here can point me in the right direction.
I just upgraded my ancient i7-3770K desktop, using Windows 10 Enterprise, to a Ryzen 5950X so I'm interested in doing encodes on said desktop. I have had RipBot264 running on a Windows 2019 VM on my ESXi server for quite some time now, Windows Server 2016 before that, that is able to write to and use a Temp\Ripbot264temp directory hosted on a CentOS 8 VM, also on said ESXi server, no problem. I have a lot of VMs running and this 16 core Ryzen 5950X is a beast, hence my desire to shift encodes to my newly-upgraded desktop.
Unfortunately, though I've mapped the Samba share with the same CentOS 8 account credentials as on the Windows Server 2019 VM, when I try to add an encode, it always spits out:
Cannot create file
"W:\Temp\Ripbot264temp\job1\Blu-Ray_structure_getinfo.cmd". The system cannot find the file specified.
I am able to create directories and files on on the mapped network drive in Temp\RipBot264temp without incident.
I do not want to write temp files to my 2 TB NVMe SSD in order to maintain its longevity.
RipBot264.ini reads as follows when it produces the mentioned error.
StoreTempFilesin=W
*truncated*
DefaultOutputPath=W:\
Change StoreTempFilesin to C or AUTO and POOF, no more error.
I am using RipBot264 1.26.1 on both Windows Server 2019 and on Windows 10 Enterprise (21H1). I am pretty confident it has nothing to do with the CentOS 8 Samba shares because SMB3 is the minimum protocol version allowed and even the "WTF were you thinking!?" chmod 777 of the directory does not fix the issue on Windows 10 (21H1).
guest
17th July 2021, 01:49
Thanks for the comparison between the two programs! I really appreciate it. It sounds like for x264 8-bit 1080p blu-ray encodes, I am fine using either of these fine programs.
What you need to do is stop swapping from forum to forum, asking the same basic questions !!!
If you're after SPEED, then the ONLY option IS RipBot, and using the Distributed Encoding option, with your 5950X, it would just plough thru like nothing, as you don't use much filtering.
And if you have other PC's, they can join it, to speed it up even more !!
Until Staxrip implements a simliar DE option, (which doesn't seem to be in their plans any time soon) it WILL be slower !!!
guest
20th July 2021, 01:18
Hi Atak,
I can't help but hear about unprecedented rain & flooding in your part of the World....unbelievable damage.
Is this affecting you at all ??
Keep safe.
Cheers
LigH
20th July 2021, 12:20
In Germany, mainly the western part (Erftstadt, Wuppertal, etc.). About 160 people dead. The government was warned precisely and conveniently ahead of time; but it didn't pass through to the people. The disaster alarm system broke in the last decades. A siren test day last year failed, and this year it got postponed to next year because they did not get fixed in time.
guest
22nd July 2021, 01:45
In Germany, mainly the western part (Erftstadt, Wuppertal, etc.). About 160 people dead. The government was warned precisely and conveniently ahead of time; but it didn't pass through to the people. The disaster alarm system broke in the last decades. A siren test day last year failed, and this year it got postponed to next year because they did not get fixed in time.
I wasn't sure what you were talking about, until I had a bit more of a look on YT, and now I know that there was some flood early warning system in place....not sure how that would be affective, a bit like forecasting earthquakes, volcanic eruptions, tsunami's, etc
It's generally too late to do much :(
Ronski
22nd July 2021, 06:37
I do not want to write temp files to my 2 TB NVMe SSD in order to maintain its longevity.
I can't help with your network issue, but what NVME drive are you using? How many encodes do you do?
Most 2TB NVME drives have a pretty high TBW rating, so will last an extremely long time. I've recently written a huge amount of data (Chia plots) to various NVME drives, and they've all got a lot of life left. each plot creates around 1.4TB of writes. I've always used an SSD for the temp file and for storing my working files, and made use of the move setting to limit wear, but I don't do a huge amount of encodes.
guest
28th July 2021, 06:34
So now that I have got a 5950X, to work along side the 3950X, I have been testing these "so called" AVX & AVX2 optimized x265's...
And sadly I cannot notice a significant difference between any of them, unless I am missing something....
If anyone has an opinion on this, I would be glad to hear it.
I also ran a few tests with a 4 minute test file I have (which unfortunately only uses 3 DE servers)...
So with all the x265 builds I tried, there was only a few seconds difference in the encoding time (start to finish), which was approx 3:00 minutes (on the 5950X),
I tested on the 3950X with ALL the same settings, and it was 15 seconds quicker, due to the fact that the 3950X was to run at 100% on the 3 DE servers,
whereas the 5950X was substantially less, at around 75% +/-, due to the extra "power" the 5950X has, I guess.
And just as a reference, I also ran the 4 minute test file without DE, on the 5950X. and it took 4:11, so that's how much difference DE can make, just on the same PC.
And just as a test, I also ran it on a single E5 2690 v1, and it took 13:11, running at 100% on the 3 DE's.
So just to sum up, I was rather disappointed that the "optimized" x265's were a bit of a let down :(
Atak_Snajpera
28th July 2021, 12:41
Avx optimizations are always automatically used in x265 by default. To see a difference you must explicity disable them via command line.
https://x265.readthedocs.io/en/3.4/cli.html#performance-options
Boulder
28th July 2021, 12:54
The optimization during compiling does not help if the code is already optimized manually (i.e. written in assembly). It will help in cases where there's only pure C code or something like that.
Having said that, the GCC builds of x265 produced by the Media Autobuild Suite were a couple of % faster than any of those other available builds on my 3900X when the Zen2 optimizations were enabled. I've been using MABS to build them ever since.
guest
28th July 2021, 14:51
Avx optimizations are always automatically used in x265 by default. To see a difference you must explicity disable them via command line.
https://x265.readthedocs.io/en/3.4/cli.html#performance-options
Interesting...
So to lock it in, you'd use --asm avx, or --asm avx2, and to "kill" them all, it'd be --no-asm
guest
28th July 2021, 14:58
The optimization during compiling does not help if the code is already optimized manually (i.e. written in assembly). It will help in cases where there's only pure C code or something like that.
Having said that, the GCC builds of x265 produced by the Media Autobuild Suite were a couple of % faster than any of those other available builds on my 3900X when the Zen2 optimizations were enabled. I've been using MABS to build them ever since.
I tried a couple of DJATOM's Zen optimized builds, didn't notice any difference.
Any suggestions ??, what have you been using, and where can I get my hands on some ??? :)
I've found that 3.5+10-82786fc GCC 11.1 (none) from here, seems to be as good as any :- http://msystem.waw.pl/x265/
Boulder
28th July 2021, 15:10
I tried a couple of DJATOM's Zen optimized builds, didn't notice any difference.
Any suggestions ??, what have you been using, and where can I get my hands on some ??? :)
I've found that 3.5+10-82786fc GCC 11.1 (none) from here, seems to be as good as any :- http://msystem.waw.pl/x265/
This is what I use: https://file.io/0em0NP3ZGdou
It's basically just what MABS produces by default but with CFLAGS="-march=znver2 -O2 -pipe" added to the parameter file \local64\etc\custom_profile.
guest
28th July 2021, 15:22
This is what I use: https://file.io/0em0NP3ZGdou
It's basically just what MABS produces by default but with CFLAGS="-march=znver2 -O2 -pipe" added to the parameter file \local64\etc\custom_profile.
I just tried to download this, and got this msg :(
"The file you requested has been deleted"
Boulder
28th July 2021, 16:09
I just tried to download this, and got this msg :(
"The file you requested has been deleted"
That service seems to allow just one download for non registered uploads.
I've put the zip file here, if it works better:
https://www.4shared.com/s/fNyWQ4RLpiq
benwaggoner
28th July 2021, 17:36
This is what I use: https://file.io/0em0NP3ZGdou
It's basically just what MABS produces by default but with CFLAGS="-march=znver2 -O2 -pipe" added to the parameter file \local64\etc\custom_profile.
Yeah, you want to be optimizing for YOUR version of Zen, not just Zen generically.
Profile-Guided Optimization may also help if you're trying to squeeze every last bit of performance out of it, particularly if you profile using the settings you'll be using with the final build.
guest
29th July 2021, 01:27
That service seems to allow just one download for non registered uploads.
I've put the zip file here, if it works better:
https://www.4shared.com/s/fNyWQ4RLpiq
Thanks for doing that, I use IDM to download stuff, and some sites don't work too well, so that's why I didn't get it on the first attempt.
Is this a "special" build ??
Cheers
guest
29th July 2021, 03:39
This is what I use: https://file.io/0em0NP3ZGdou
It's basically just what MABS produces by default but with CFLAGS="-march=znver2 -O2 -pipe" added to the parameter file \local64\etc\custom_profile.
OK, Boulder, I have done a fair bit more testing and have some interesting results:-
Oh, and BTW, those parameters don't work under Windows, or at least in RipBot :(
So, using your x265.exe, (which seems to be 3.5+10-82786fc GCC 10.3) with my test file using --ctu 32, took 2:11, using --ctu 64, took 3:34.
The x265 I am currently using (3.5+10-82786fc GCC 11.1 (none) from here, seems to be as good as any :- http://msystem.waw.pl/x265/ ) using --ctu 32, took 2:07, using --ctu 64, took 3:31.
So just the tiniest bit faster....and these were ALL done at Level 5.2 10bit.
Dropping down to Level 4.0 --ctu16 (default), it took the same time, 2:07.
I read somewhere that the GCC 11.1 builds are a little better with Ryzen's.
So using --ctu 32 would yield a much faster encode, but would --ctu 64 look a little better ???? :rolleyes:
Boulder
29th July 2021, 12:25
I tested the two builds and the difference was just one second for 1500 frames so with my scripts and setup it's negligible. Nevertheless, the GCC builds seem best for Zen2 and probably Zen3 as well.
I use CTU 64 for 1080p and above and CTU 32 for below that.
guest
30th July 2021, 03:31
I tested the two builds and the difference was just one second for 1500 frames so with my scripts and setup it's negligible. Nevertheless, the GCC builds seem best for Zen2 and probably Zen3 as well.
I use CTU 64 for 1080p and above and CTU 32 for below that.
Thanks for the info, and I might do a test using 32 & 64 on a 4K encode.
Cheers
excellentswordfight
31st July 2021, 10:21
OK, Boulder, I have done a fair bit more testing and have some interesting results:-
Oh, and BTW, those parameters don't work under Windows, or at least in RipBot :(
So, using your x265.exe, (which seems to be 3.5+10-82786fc GCC 10.3) with my test file using --ctu 32, took 2:11, using --ctu 64, took 3:34.
The x265 I am currently using (3.5+10-82786fc GCC 11.1 (none) from here, seems to be as good as any :- http://msystem.waw.pl/x265/ ) using --ctu 32, took 2:07, using --ctu 64, took 3:31.
So just the tiniest bit faster....and these were ALL done at Level 5.2 10bit.
Dropping down to Level 4.0 --ctu16 (default), it took the same time, 2:07.
I read somewhere that the GCC 11.1 builds are a little better with Ryzen's.
So using --ctu 32 would yield a much faster encode, but would --ctu 64 look a little better ???? :rolleyes:
Look at your CPU utilization and you will probably find that decreasing the maximum CU size will increase the potential for higher multi threaded load. The resolution you are encoding at and the number of threads you have available will determine how much impact this will have. Also note that it might be worth changing the merange value to accommodate for this change. With a high thread CPU like 5950X you will have a hard time saturating 32 threads for 1080p and bellow for single instance encoding without lowering the CU size, hence the speed increase.
I have a vague recollection that the devs posted some tests showing that it does effect encoding output somewhat hence why they stick to 64 even for lower res (for UHD you probably always wanna stick to 64). But I'm pretty sure its rather negatable, for high core count systems its probably worth the trade off.
guest
31st July 2021, 11:01
Look at your CPU utilization and you will probably find that decreasing the maximum CU size will increase the potential for higher multi threaded load. The resolution you are encoding at and the number of threads you have available will determine how much impact this will have. Also note that it might be worth changing the merange value to accommodate for this change. With a high thread CPU like 5950X you will have a hard time saturating 32 threads for 1080p and bellow for single instance encoding without lowering the CU size, hence the speed increase.
I have a vague recollection that the devs posted some tests showing that it does effect encoding output somewhat hence why they stick to 64 even for lower res (for UHD you probably always wanna stick to 64). But I'm pretty sure its rather negatable, for high core count systems its probably worth the trade off.
Interesting....and it's early days for me and the 5950X, haven't really done too much with it yet, done a bit more with the 3950X, but I think the 5950X is SO much better :)
I haven't done too much in the way of "tuning" x265, and I also don't know what merange runs at, within RipBot...I thought I saw a reference, showing it @ 9, but apparently the "default" setting is 57.
https://x265.readthedocs.io/en/stable/presets.html
So some testing is on the cards, as I have a LOT to do, and a short time to do it.
excellentswordfight
31st July 2021, 11:47
Interesting....and it's early days for me and the 5950X, haven't really done too much with it yet, done a bit more with the 3950X, but I think the 5950X is SO much better :)
I haven't done too much in the way of "tuning" x265, and I also don't know what merange runs at, within RipBot...I thought I saw a reference, showing it @ 9, but apparently the "default" setting is 57.
https://x265.readthedocs.io/en/stable/presets.html
So some testing is on the cards, as I have a LOT to do, and a short time to do it.
"Motion search range. Default 57
The default is derived from the default CTU size (64) minus the luma interpolation half-length (4) minus maximum subpel distance (2) minus one extra pixel just in case the hex search method is used. If the search range were any larger than this, another CTU row of latency would be required for reference frames."
https://x265.readthedocs.io/en/stable/cli.html
So for 1080p and lower you might wanna try --ctu 32 --merange 26 if you use preset slow or lower, for UHD just stick with default.
guest
31st July 2021, 12:29
"Motion search range. Default 57
The default is derived from the default CTU size (64) minus the luma interpolation half-length (4) minus maximum subpel distance (2) minus one extra pixel just in case the hex search method is used. If the search range were any larger than this, another CTU row of latency would be required for reference frames."
https://x265.readthedocs.io/en/stable/cli.html
So for 1080p and lower you might wanna try --ctu 32 --merange 26 if you use preset slow or lower, for UHD just stick with default.
Nice, not too concerned about 1080p or lower all that much, but currently I'm doing a lot of DVD res stuff, old TV series, DVD rips etc.
But the main project is getting a LOT of 4K stuff done, it's just such a shame that it takes so long....if I could get a encode done in a day (6 - 8 hours, won't let it run overnight !!!!), that would be awesome.
So what would you recommend for nice 4K results & speed ??
Do you use RipBot ??
Ripmann
1st August 2021, 21:41
A quick and easy feature request for consideration:
Please consider adding a "Copy Stream" option for the video track Profile (similar to that for audio tracks). Not sure how useful it would be in a single job mode, but there's definitely use for it the batch window (mass convert audio tracks only).
guest
2nd August 2021, 03:27
A quick and easy feature request for consideration:
Please consider adding a "Copy Stream" option for the video track Profile (similar to that for audio tracks). Not sure how useful it would be in a single job mode, but there's definitely use for it the batch window (mass convert audio tracks only).
I'm pretty sure that this same question was asked not too long ago..
That copy option is only available for certain file types, eg:- .ts, ,m2ts, etc. .mp4 & .mkv don't.
ReinerSchweinlin
2nd August 2021, 15:12
Please consider adding a "Copy Stream" option for the video track Profile (similar to that for audio tracks). Not sure how useful it would be in a single job mode, but there's definitely use for it the batch window (mass convert audio tracks only).
Yes, I asked that some time ago, too.
chainring
2nd August 2021, 16:05
Snip...
So what would you recommend for nice 4K results & speed ??
Back some time ago, I had the same dilemma. I don't recall which thread it was in, but I asked benwaggoner and Blue_Misfit about resizing 4K content down to 2560 x X since the majority of 4K releases had been rendered at DCI 2K. I figured 2560 was a happy medium between 4K (3840) and DCI 2K (2048). Consensus was it'd be a good idea as long as my playback device could handle the resolution.
All the content I have is played back through Nvidia Shields and I have zero problems. I also play those same movies on a Samsung Tab S6 (OLED screen) via Kodi and it has no problems, either.
Anything 4K with HDR, gets the following treatment:
Resized to 2560 x X
x265 10 bit
--hdr10 --hdr10-opt
Preset Medium
Flavor to taste with:
I start with CQ16 and adjust upwards if file size gets out of control.
Denoise with MDegrain and adjust to grain content. Most of the time, MDegrain2 is the highest I go.
I've been overall very satisfied with the speed of processing when using RipBot's DE mode and four older Dell PCs. If there's no MDegrain involved, I can rip through an encode in 2-3 hours. Add in MDegrain2 and we're talking more like 9 hours. File sizes are sometimes ridiculously small, even at CQ16 and it's a bit difficult to accept, but I go with it.
Boulder
2nd August 2021, 20:44
--hdr10-opt is the one that causes the bitrate drop, the CRF values with and without it are not directly comparable. For HDR, I use CRF 14 or 15, downscaling to 1440p or 1080p largely depending on whether it's a native 4K source or just upscaled from 2K.
Atak_Snajpera
3rd August 2021, 07:38
You are wasting energy! 30Mbps for 1080p and 60Mbps for 2160p? That's Probably more than original bitrate. Just remux that movie and do not reencode!
guest
3rd August 2021, 10:44
You are wasting energy! 30Mbps for 1080p and 60Mbps for 2160p? That's Probably more than original bitrate. Just remux that movie and do not reencode!
I was actually expecting you to chime in...
I think you'll find that GOOD quality original 1080p's & 2160p's can be ≥ than the bitrates I encode @ !!!
As far as I have noticed, it doesn't affect the processing time of the encode, it's simply the muxing that might take a little longer, but if you've got powerful CPU's & fast NVMe's, it's NOT an issue.
And just so you know, there's NO wasted energy here, "sunshine", I ONLY encode when I'm getting "free" power from my solar panels !!!!
Admittedly, some could be simply remuxed, but some need filtering !!
And while I have your attention, I have noticed an issue with Windows 11 (not that you'll care too much), but in the Encoding Client window, that little row of "button's" for each server, seem to loose their functionality, mainly the Shutdown Server button, not only doesn't it change it's appearance, you can't tell whether it's enabled or disabled, but either way, as it doesn't seem to want to turn off the server(s)....however, the main Shutdown Servers & Client works, tho.
Atak_Snajpera
3rd August 2021, 11:46
You do not have my attention sunshine.
guest
3rd August 2021, 12:58
You do not have my attention sunshine.
I beg to differ...you replied :rolleyes:
chainring
3rd August 2021, 15:43
Hey chainring, yeah, not interested in downsizing 4K footage, I mean, that's why I bought a 4K, HDR TV !!!
4K, meh. HDR is where it's at.
I also use SMDegrain filters, found them better than MDegrain, I also don't use any CRF settings, I just go for bitrate, size is NOT an issue.
After years of messing with different scripts put together by the honest to god geniuses of Doom9, I no longer have the time nor inclination to constantly tweak scripts anymore. MDegrain works plenty good for me.
Bitrate is for when you need a predictable sized outcome. Why, if you're doing this for your own purposes, are you not letting CQ decide? Constant Quality. It ain't dumb. Go back and find posts from akupenguin and Dark_Shikari; get some history under your belt.
So 15,000kbps for 720p, 30,000kbps for 1080p, and 60,000kbps for 4K, and SMDegrain to "flavour"
You're wasting time and energy encoding at those bit rates. Why don't you stick with a remux?
Ryushin
3rd August 2021, 20:56
Hi Atak,
I think I uncovered a bug. For some reason I can never bind to my subnet, 192.168.9.* for the encoding server. I tried adding to the encoding server:
/IP 192.168.9.40
And it always grabs the secondary IP 192.168.1.40. I added 172.28.27.40 and 192.168.0.40 as secondary IPs and the encoding server will bind to those, but not to 192.168.9.40. Very odd.
LigH
4th August 2021, 09:14
Shh, calm down please. Let's focus on technical solutions, not personal opinions.
ReinerSchweinlin
9th August 2021, 19:17
I just wanted to say "thanx" for the compare function in the avisynth tab :) Very helpful !
slalom
15th August 2021, 08:43
So 15,000kbps for 720p, 30,000kbps for 1080p, and 60,000kbps for 4K, and SMDegrain to "flavour"
1/2 το 1/3 of those numbers are good for me
Daringbaaz
15th August 2021, 19:59
Is There any Update Related to Ripbot,
Specially EncodingServer.exe
it Won't Opening on My RDP (Dedicated)
Atak_Snajpera
16th August 2021, 14:43
Is There any Update Related to Ripbot,
Specially EncodingServer.exe
it Won't Opening on My RDP (Dedicated)
https://forum.doom9.org/showthread.php?p=1941815#post1941815
ReinerSchweinlin
17th August 2021, 20:15
Hi Atak,
I think I uncovered a bug. For some reason I can never bind to my subnet, 192.168.9.* for the encoding server. I tried adding to the encoding server:
/IP 192.168.9.40
And it always grabs the secondary IP 192.168.1.40. I added 172.28.27.40 and 192.168.0.40 as secondary IPs and the encoding server will bind to those, but not to 192.168.9.40. Very odd.
Did you give "changing the network adapter priority" a try?
https://www.windowscentral.com/how-change-priority-order-network-adapters-windows-10
Daringbaaz
25th August 2021, 07:43
https://forum.doom9.org/showthread.php?p=1941815#post1941815
I had tried older Version 1.19.3
1st thing : My Server is EPYC and There is Not any GPU and Not any Graphics Driver Installed :)
2nd : I Try to Run Main Ripbotexe and it's Showing Warning That Java Is Not Installed, (But I Had Installed Java, Reboot Server,. But No Luck)
When i opened Encoding Server then it worked on older version,
and last thing I tried to Completely cleaned and Re-install OS (Win Server 2019)
But still Same as I mentioned)
Latest Version Showing Decoding error, after Video import and Encoding Server not Working)
in Older version : Encoding Server Worked But Main Server isn't Working :(
Please Sir, Do Something, if You Need any Donation/Contribution Then I will as much I Can.
Also If you are Available to Develop Ripbot With Some More Audio Formats then it Will Be Better .
https://i.imgur.com/gW87c7w.jpg
guest
28th August 2021, 03:07
For several months now, I have made available very up to date & modified build's of RipBot264.
I have also provided updates on a regular basic.
With many different extra filters & options, that made RB that little bit better than the "vanilla" version, which hasn't seen a substantial update in a very long time.
If anyone is keeping track of available updates of the components that RB use's, you'd soon realise just how far behind it is :(
I guess I was also hoping that this might prompt Atak to follow suite, and provide updates, and extra's, but it hasn't had that affect, sadly.
Don't get me wrong, RB IS still working well, but maybe Atak is now just "resting on his laurel's", and leaving good enough alone.
I also hoped that anyone that was happy to download and use my builds would also be happy to provide some feedback, either good or bad, and even the odd thanks, would have been appreciated,
but after 100's of downloads over the period I have been providing these builds & updates, not a single comment...NOTHING !!!, which sadden's me.
So as of date of posting this, I will no longer provide this service, and I will keep all my hard work to myself, and for my benefit only.
So to the many that did download my "stuff", thankyou, but you've only got yourselves to blame for this to be ending, today !!!
darkio
6th September 2021, 21:55
please add the ability to use external LUT 3D (.cube).
Very usefull for some old content like anime.
Ripmann
6th September 2021, 23:45
So as of date of posting this, I will no longer provide this service, and I will keep all my hard work to myself, and for my benefit only.
So to the many that did download my "stuff", thankyou, but you've only got yourselves to blame for this to be ending, today !!!
Hey man, you shouldn't take these things so personally. Take me for example. I asked to take a look at your SMDegrain setup, what, a month ago? And that's only because I encountered a bug and didn't have enough free time to get it working myself. I think I downloaded your file but didn't even get a chance to open the archivelet alone install or test itwith me just coming out of the hospital a few days ago and all. Not all of us got sick, of course, but I'm sure other people also have unrelated things on their mind, especially considering the s%*storm the world is currently in. And even for those who don't, with dozens, if not hundreds of programs installed on an average computer, I'd speculate that you're not the only not getting any feedback on your efforts. Doesn't mean that they are not appreciated. Hell, I've been using RipBot for a decade and only bothered commenting on it last year or so. For the average user, "if it works, it works" is the standard operating mantra.
TL;DR version: take it easy, and on behalf of everyone who asked to use your stuff, thank you.
P.S. I don't know about "resting on his laurels" (which frankly no longer sounds as comfortable as it did back in Ancient Greece) but I'd also really welcome more development pouring into RipBot. Although I'm still a devout user, it's getting harder and harder to stay with it without being forced to use other toolstools I previously didn't even like. E-AC3, up-to-date HDR/HDR10+/DV tools and support, and perhaps a more comprehensive set of degrain filters like SMDegrain (or whatever better alternatives are out there) would really be appreciated. I know it's a lot to ask from a selfless developer who already sacrificed so much of his time into this free software, but that's what you get when you end up with thousands of people depending on your work. Perhaps, if you feel exhausted, you can reconsider going the open source route? I'm sure someone will be willing to pick up the burden like they did with MPC and MPC-HC/MPC-BE. Wouldn't make your own legacy any less meaningful. Quite the opposite, in fact.
guest
7th September 2021, 01:15
Hey man, you shouldn't take these things so personally. Take me for example. I asked to take a look at your SMDegrain setup, what, a month ago? And that's only because I encountered a bug and didn't have enough free time to get it working myself. I think I downloaded your file but didn't even get a chance to open the archivelet alone install or test itwith me just coming out of the hospital a few days ago and all. Not all of us got sick, of course, but I'm sure other people also have unrelated things on their mind, especially considering the s%*storm the world is currently in. And even for those who don't, with dozens, if not hundreds of programs installed on an average computer, I'd speculate that you're not the only not getting any feedback on your efforts. Doesn't mean that they are not appreciated. Hell, I've been using RipBot for a decade and only bothered commenting on it last year or so. For the average user, "if it works, it works" is the standard operating mantra.
TL;DR version: take it easy, and on behalf of everyone who asked to use your stuff, thank you.
P.S. I don't know about "resting on his laurels" (which frankly no longer sounds as comfortable as it did back in Ancient Greece) but I'd also really welcome more development pouring into RipBot. Although I'm still a devout user, it's getting harder and harder to stay with it without being forced to use other toolstools I previously didn't even like. E-AC3, up-to-date HDR/HDR10+/DV tools and support, and perhaps a more comprehensive set of degrain filters like SMDegrain (or whatever better alternatives are out there) would really be appreciated. I know it's a lot to ask from a selfless developer who already sacrificed so much of his time into this free software, but that's what you get when you end up with thousands of people depending on your work. Perhaps, if you feel exhausted, you can reconsider going the open source route? I'm sure someone will be willing to pick up the burden like they did with MPC and MPC-HC/MPC-BE. Wouldn't make your own legacy any less meaningful. Quite the opposite, in fact.
Thanks, Ripmann,
Good to hear you're OK, now..sure a crazy time, atm. :(
I actually only got asked by about 3 ppl, and with the 100's of downloads, you'd think that at least 1 or 2 would bother to leave a comment, (good or bad).
I know that E-AC3 conversion has been asked about for age's, but is just brushed aside, but there are other app's that do the job very & quickly, and all you have to do is mux it in either before or after a RB encode.
I generally do video ONLY for 4K stuff, as I need to convert the TrueHD track & subtitles tracks to be compatible with my equipment.
Also have started splitting 4K movies into 20 - 30 minute chunks, then importing them in using the Batch feature, that way you don't have to hope your PC (or RB) will reliably encode for a day or so.
A little bit more procedure, but a lot less anxiety, I can tell ya !!
I'm sure that HDR could be updated fairly easily, there's always someone out there working on that side of things.
Anyway, life goes on.
Stay well, my friend.
guest
7th September 2021, 02:48
please add the ability to use external LUT 3D (.cube).
Very usefull for some old content like anime.
Has this got anything to with Adobe files ?? (.cube)
darkio
7th September 2021, 07:49
Has this got anything to with Adobe files ?? (.cube)
yes, but there are free luts can be used.
Da vinci resolve use luts and many others.
It's color correction (color grading).
Sometime, source video have bad colours can be improved.
Avisynth use luts too for editing.
guest
7th September 2021, 13:06
yes, but there are free luts can be used.
Da vinci resolve use luts and many others.
It's color correction (color grading).
Sometime, source video have bad colours can be improved.
Avisynth use luts too for editing.
So why can't you process the files you want, THEN run them thru RipBot if needed.
I doubt that your request will be addressed.
darkio
7th September 2021, 14:06
So why can't you process the files you want, THEN run them thru RipBot if needed.
I doubt that your request will be addressed.
because there are 2 time compresion.
ripbot can handle simple color correction like satutation, contrast etc,
so, why can't use external lut?
guest
7th September 2021, 15:32
because there are 2 time compresion.
ripbot can handle simple color correction like satutation, contrast etc,
so, why can't use external lut?
Well, if you could upload a .cube and whatever else it needs, might be a starting point for this.
darkio
7th September 2021, 15:43
this is the plugin
http://www.avisynth.nl/index.php/AVSCube
and this is a zip with 54 luts freeware inside
https://www.swisstransfer.com/d/f66b03e6-2ab9-4a16-bddc-475c345f893d
Thanks in advance
Example LUT
Source NO LUT:
https://i.postimg.cc/7GpWQ8xY/Lut-OFF.png (https://postimg.cc/7GpWQ8xY)
Same Source LUT ON: (Clouseau 54.CUBE)
https://i.postimg.cc/1VGJC8CJ/Lut-ON.png (https://postimg.cc/1VGJC8CJ)
Used in Tmpgenc Mastering Works 7
guest
8th September 2021, 11:26
this is the plugin
http://www.avisynth.nl/index.php/AVSCube
and this is a zip with 54 luts freeware inside
https://www.swisstransfer.com/d/f66b03e6-2ab9-4a16-bddc-475c345f893d
Thanks in advance
Example LUT
Source NO LUT:
https://i.postimg.cc/7GpWQ8xY/Lut-OFF.png (https://postimg.cc/7GpWQ8xY)
Same Source LUT ON: (Clouseau 54.CUBE)
https://i.postimg.cc/1VGJC8CJ/Lut-ON.png (https://postimg.cc/1VGJC8CJ)
Used in Tmpgenc Mastering Works 7
Hi darkio,
I am happy to provide this awesome add-on for RipBot264, at your request.
It took me and a new friend of mine, kedautinh12, several hours to get it to work within RipBot.
And I think this IS a MAJOR game-changer for the app, so thankyou.
ENJOY !!!!!
SKPN
8th September 2021, 19:33
Is there a way to delete the files from the watch folder(s) after they are processed in automated batch mode?
guest
9th September 2021, 04:59
Is there a way to delete the files from the watch folder(s) after they are processed in automated batch mode?
Not ever having used Watch Folders, maybe you could create a small cmd or batch file that would "clean out" the folders, and you could run that cli using the "Run command script after finished job" on the Main tab page of RipBot.
OR, wait and see if the dev comes up with a suggestion or a revision to the app.
legend
11th September 2021, 12:14
I have nvidia GPU. I did not find x265 NVenc like other GUI. How do I enable this?
guest
11th September 2021, 12:43
I have nvidia GPU. I did not find x265 NVenc like other GUI. How do I enable this?
This has been asked about many times, and that's about as far as it goes :(
You'll have to look elsewhere to use this option.
LigH
13th September 2021, 10:01
NVEnc is not x265. They are different H.265 video encoders. NVEnc uses your Nvidia GPU to encode H.265 video, x265 does not. Furthermore, x265 can be controlled in many more different ways than NVEnc, so it is suited much better for segmented encoding, and also it can run in several parallel instances (your GPU encoder chip can be used only by one process at a time). If you don't need segmented encoding, possibly distributed across a network of many PCs encoding different parts of a video, then you may not really need RipBot264...
guest
13th September 2021, 12:38
NVEnc is not x265. They are different H.265 video encoders. NVEnc uses your Nvidia GPU to encode H.265 video, x265 does not. Furthermore, x265 can be controlled in many more different ways than NVEnc, so it is suited much better for segmented encoding, and also it can run in several parallel instances (your GPU encoder chip can be used only by one process at a time). If you don't need segmented encoding, possibly distributed across a network of many PCs encoding different parts of a video, then you may not really need RipBot264...
Very nicely explained, LigH.
So, not everyone has compatible nVidia GPU's, and also the fact that Distributed Encoding couldn't be used, then there's not really any point !!
So even if Atak took the time to implement this, only limited users would take what ever advantage GPU encoding might offer, if the spped of DE isn't there, and let's face it, DE is the most impressive function of any of the main available Encoding apps.
The same probably applies to wanting to use NV Decoding.
The only process that is probably an option would be to let RipBot do it's complete process, then before deleting the Temp files, to manually re-encode the files generated by RB, using NVEnc, so basically doubling the time taken to get the desired result.
Might be able to use the function introduced some time ago to run the "Job finished successfully.cmd" to automate some script / cli.
So just repeating what LigH said :-
If you don't need segmented encoding, possibly distributed across a network of many PCs encoding different parts of a video, then you may not really need RipBot264...
phred1
18th September 2021, 11:00
Hiya
Updated to latest version 1.21.6 from a much older version. Now I cant get the EncodingServer to start. Where do I start with finding what I have done wrong? All tools seems to be installed (some with green and some with black icons in the list).
Atak_Snajpera
18th September 2021, 11:21
Try again in SAFE MODE
Daringbaaz
19th September 2021, 13:03
https://i.imgur.com/C3Yxtv5.jpg
Can Anyone Tell me Why There is some segments not Started or Not Completed,
Due to this My encoding Stopped on 99.4% and I Didn't Find any option to re-start That segments,
Please Help Me,
Atak_Snajpera
19th September 2021, 13:22
You should check what EncodingServer (192.168.1.70:4000) is showing in both tabs.
guest
19th September 2021, 15:19
Can Anyone Tell me Why There is some segments not Started or Not Completed,
Due to this My encoding Stopped on 99.4% and I Didn't Find any option to re-start That segments,
Please Help Me,
I have that happen quite often...best thing is to Abort the Job.
Then restart the job, 9 times out of 10 it will remember how many chunks it has already encoded, and complete the job.
stillempty
21st September 2021, 21:04
@Atak - Thanks for all your hard work over the years. I have been using Ripbot264 for a long time and have always been able to tweak the things I need for excellent results. I hope you have not lost your passion for this program!
@Pauly Dunne - I truly understand the frustration of trying to improve things for strangers and not getting feedback. Sadly you probably only hear about the things that do not work. I would most definitely take a look at the builds you were putting together for the community!
I have been playing around with HDR10+ and Dovi recently and am now very close to having these things worked out in Ripbot264. I will share this info in the next few days, to hopefully save others some time.
Empty
guest
22nd September 2021, 01:28
@Atak - Thanks for all your hard work over the years. I have been using Ripbot264 for a long time and have always been able to tweak the things I need for excellent results. I hope you have not lost your passion for this program!
@Pauly Dunne - I truly understand the frustration of trying to improve things for strangers and not getting feedback. Sadly you probably only hear about the things that do not work. I would most definitely take a look at the builds you were putting together for the community!
I have been playing around with HDR10+ and Dovi recently and am now very close to having these things worked out in Ripbot264. I will share this info in the next few days, to hopefully save others some time.
Empty
Hey Empty,
Thanks for the comment :)
I will be interested to see what you've come up with...
userx
25th September 2021, 10:37
Hi
After last update i'm not able to apply new jobs to the queue.
The Done-button is not clickable.
Can anybody help?
https://i.imgur.com/kCOf6Pw.png
https://i.imgur.com/85WJozb.png
ReinerSchweinlin
27th September 2021, 21:32
I encountered something similar in the avisynth tab: After "demo" of sharpening, the "ok" button grayed out. Selecting a crop area and switching back worked as a workaround.
guest
28th September 2021, 02:33
Hi Atak,
Remember way back here :-
https://forum.doom9.org/showthread.php?p=1951664#post1951664
I was able to add LUT's support to RipBot 3 weeks ago.
And then I read the "Avisynth+_Cube.txt"
Apply 3D LUT to HDR10 PQ clip obtained from DGSource():
loadplugin("...\dgdecodenv.dll")
loadplugin("...\avsresize.dll")
loadplugin("...\vscube.dll")
dgsource("THE GREAT WALL.dgi",fulldepth=true)
z_ConvertFormat(pixel_type="RGBP16",colorspace_op="2020ncl:st2084:2020:l=>rgb:linear:2020:f", dither_type="none")
Cube("...\test.cube")
z_ConvertFormat(pixel_type="YUV420P16",colorspace_op="rgb:linear:2020:f=>2020ncl:st2084:2020:l",dither_type="none")
As far as I know you can't use DGSource in RipBot... (or can you, and you've kept it to yourself)
It would be nice to use .dgi in RB.
BTW, everybody, an auto-update "snuck out" with LUT support
userx
28th September 2021, 17:00
I encountered something similar in the avisynth tab: After "demo" of sharpening, the "ok" button grayed out. Selecting a crop area and switching back worked as a workaround.
@ReinerSchweinlin
Thanks for the hint.
I have to open the avisynth window, click into any setting box e.g. Resize -> OFF to get the OK of avisynth window clickable, exit this window by OK. Afterwards the Done-Button is clickable again.
Edit:
When changing the output filename / path AFTER this workaround DONE gets disabled again.
ReinerSchweinlin
28th September 2021, 21:16
For several months now, I have made available very up to date & modified build's of RipBot264.
....
So as of date of posting this, I will no longer provide this service, and I will keep all my hard work to myself, and for my benefit only.
Sorry to hear that. In the last year, I have not had enough time to visit doom9 on a regular basis, so I didnīt even download your stuff or played with it. I can understand your frustration and - although I didnīt use your stuff - wanted to say thanx for your efforts and files...
@Atak
I am not sure if I did read correct between the lines - I got the impression you were absent a lot (but since I was absent, I am deriving that from what others wrote)... So I hope you are fine and of good health!
guest
29th September 2021, 01:48
Sorry to hear that. In the last year, I have not had enough time to visit doom9 on a regular basis, so I didnīt even download your stuff or played with it. I can understand your frustration and - although I didnīt use your stuff - wanted to say thanx for your efforts and files...
Hey Reiner,
I am happy to know that you would have been interested in trying my "stuff"....it doesn't mean that you can't still try it, but I doubt that I will post it again on the Forum.
Speaking of which, I don't want to sound like the Forum "detective", but you have posted no less than 31 times, so far this year, and one post was just before my post that you have quoted.....:sly:
I did have a couple of users "ask" for it, and they were very happy with all the extra filters & features, and even how much faster it seemed to be...but out of the many that downloaded it, I got nothin', hence my decision to "pull it".
Anyway, I would like to say that I will be pretty much leaving these forums, for the time being, I might post from time to time.
I will probably respond to any direct posts, but that's about it.
But when you don't seem to get the info you're seeking, and then if you sound a little frustrated, or defensive, they "warn" you, so why bother.
videoh
29th September 2021, 02:40
I did have a couple of users "ask" for it, and they were very happy with all the extra filters & features, and even how much faster it seemed to be...but out of the many that downloaded it, I got nothin' Sounds contradictory to me. You got requests and good feedback but then you say you got nothing.
Also, you say you added filters and such. So it should not be an issue for you to add DGSource(), or am I missing something?
guest
29th September 2021, 03:16
Sounds contradictory to me. You got requests and good feedback but then you say you got nothing.
Also, you say you added filters and such. So it should not be an issue for you to add DGSource(), or am I missing something?
Come on videoh,
What I meant was, I had a couple of PM requests, BUT out of the close to a hundred or so downloads, when it was "open slather", I got nothing.
No contradiction...
I might be able to get it too work, but I don't know how to incorporate it into the way RipBot scripts are written, for encoding & decoding tasks.
It just confuses my old brain.......and I need to be "spoon feed", as I've said before, I really don't know what I'm doing, but if it works, it's great.
I think I've touched on this before with you, unless I'm getting the names mixed up.
I'd say that I wouldn't use it, I think it's nVidia based, and may not work with the Distributed Encoding process.
BUT there might be users out there that would like different options, and RipBot has none, it's LSmash or nothin'.
videoh
29th September 2021, 04:49
We'll miss you, Pauly.
ReinerSchweinlin
29th September 2021, 14:54
Sherlock,
Speaking of which, I don't want to sound like the Forum "detective", but you have posted no less than 31 times, so far this year, and one post was just before my post that you have quoted.....:sly:
yes.
"having not mich time" or "being absent" doesnīt have to literally mean "no visit at all" :) Beleive me, I have been spending much less time on forums last year than I used to - I know, I was there :)
phred1
1st October 2021, 22:58
Try again in SAFE MODE
Hi and tnx!
Like in booting Windows 10 in Safe Mode or launching the app in like "Windows 8" mode? =)
sapphiresky83
7th October 2021, 03:23
Hi all! Long time Ripbot user. Just did a fresh Win 10 install with the latest version of Windows last week. Ive done this before and have restored my RipBot setup every time without issue.
This time, however, I am having an issue where while using Distributed Encoding, where my two machines, each running two servers a piece, is encoding the same chunks over and over again rather than completing the entire list of chunks. Ive never experienced this before.
Ive set everything up the same exact way I did before I did the fresh install.
Ive gone through updating/installing/reinstalling all of the support and background apps (ffmpeg/avisynth+) but still no joy.
Thanks!
Sent from my iPhone using Tapatalk
guest
10th October 2021, 13:58
Is there some way of adapting this "call" so that RipBot can use it ?
pre=ex_KNLMeansCL(a=2,s=2,d=1,h=7.0,wmode=0)
SMDegrain(tr=3,thSAD=300,contrasharp=30,prefilter=pre,refinemotion=true)
TIA
Atak_Snajpera
10th October 2021, 15:28
Is there some way of adapting this "call" so that RipBot can use it ?
TIA
pre=ex_KNLMeansCL(video,a=2,s=2,d=1,h=7.0,wmode=0)
video=SMDegrain(video,tr=3,thSAD=300,contrasharp=30,prefilter=pre,refinemotion=true)
guest
11th October 2021, 01:25
pre=ex_KNLMeansCL(video,a=2,s=2,d=1,h=7.0,wmode=0)
video=SMDegrain(video,tr=3,thSAD=300,contrasharp=30,prefilter=pre,refinemotion=true)
:thanks: it worked, except the contrasharp value, I had to change it to true.
Ripmann
12th October 2021, 02:47
EDIT: Since Akak is sadly AFK, I spent last couple of days figuring it out on my own. I finally found a solution to the problem and will post it a little bit later, after I finish my tests.
====================================
Hey guys. I finally got back into encoding my library backlog and immediately noticed this issue while experimenting with HDR sources. Using denoise filters on an HDR source seems to cause extremely buggy results in some frames. It looks like severe chroma smearing of some kind. I've noticed it before but couldn't quite identify the root cause, but now tests clearly showed that it's the degrain filters (in this case MDegrain2) that cause it. It's possible that the problem is not HDR related, but I don't remember noticing it on SDR sources. My guess is that it's the very low contrast of HDR video streams that either causes or exacerbates this.
See the screens, and I'm attaching a short video sample (under fair use), if you want to test it yourself. The link will expire in two weeks. The buggy frames are the first few frames of the scene change. In case Atak is unable to address this, does anyone know how to tweak the job's MDegrain code manually to fix this? I was forced to stop everything I was doing and can't do anything until I figure this out.
https://s9.gifyu.com/images/low_res2.gif
Source sample: https://www.mediafire.com/file/x95dz50wuoj9eks
Full-res screens: https://imgur.com/a/O4lyRiq
Related discussion: https://forum.doom9.org/showthread.php?t=177128
(It has some suggestions but I'm not proficient enough to get them into RipBot. I tried playing with SMDegrain.avsi settings , but the job seemed to ignore it altogether.)
guest
12th October 2021, 10:42
Related discussion: https://forum.doom9.org/showthread.php?t=177128 (Denoising HDR sources)
(It has some suggestions but I'm not proficient enough to get them into RipBot. I tried playing with SMDegrain.avsi settings , but the job seemed to ignore it altogether.)
Hey Ripmann,
I was interested in this link, but it wouldn't open for me...
guest
12th October 2021, 11:12
So a question about multiple video cards...
If you had say 2 or so nVidia cards, would it be beneficial to just use them individually and add a command line to each card, per port.....or SLI them, and use them as is (one unit) ??
Ripmann
12th October 2021, 17:09
So a question about multiple video cards...
If you had say 2 or so nVidia cards, would it be beneficial to just use them individually and add a command line to each card, per port.....or SLI them, and use them as is (one unit) ??
I fixed that link. To answer your GPU question, last I checked you cannot SLI two different graphics cards. If your cards have the same chipsets, then it makes sense to SLI only to have a smoother experience, full acceleration, and faster FPS rates for everything else. If that's something you not interested in for some atypical reason, then having two disconnected cards seems only useful for minor power saving (since the spare one will always be idle when not encoding) and full control over separation of tasks (gaming on one, encoding on another). Other than that, I seriously doubt that you'll have any noticeable benefits separating the two for encoding purposes, and manually assigning the workload for each job seems like too much work by itself.
guest
13th October 2021, 00:38
I fixed that link. To answer your GPU question, last I checked you cannot SLI two different graphics cards. If your cards have the same chipsets, then it makes sense to SLI only to have a smoother experience, full acceleration, and faster FPS rates for everything else. If that's something you not interested in for some atypical reason, then having two disconnected cards seems only useful for minor power saving (since the spare one will always be idle when not encoding) and full control over separation of tasks (gaming on one, encoding on another). Other than that, I seriously doubt that you'll have any noticeable benefits separating the two for encoding purposes, and manually assigning the workload for each job seems like too much work by itself.
Hi Ripmann,
Checked out the link...:thanks:
Of course I would be using identical GPU's :rolleyes:
I will try both setup's, but assigning one card to one port, and the other one to a different port is pretty straightforward (even for me), in RipBot.
As for this small print comment :-
(It has some suggestions but I'm not proficient enough to get them into RipBot. I tried playing with SMDegrain.avsi settings , but the job seemed to ignore it altogether.)
May I suggest you visit Dogway's forum, he's doing a LOT with SMDegrain, with various pre-filters, etc & more.
Ripmann
13th October 2021, 04:58
I will try both setup's, but assigning one card to one port, and the other one to a different port is pretty straightforward (even for me), in RipBot.
Sure, if you're having doubts, testing is definitely the way to go. It's not like you'll need a lot work to switch between the modes, and you'll have hard data to back up your decision. I predict you'll probably end up going SLI since it's hard to come up with reasons not to, but as a fan of the scientific method I'm not even going to try to dissuade you.
May I suggest you visit Dogway's forum, he's doing a LOT with SMDegrain, with various pre-filters, etc & more.
Thanks for the tip. I'll take a look, but so far my searches didn't come up with anything actionable at my skill level. I'm still largely a novice when it comes to advanced x265 params and don't know first thing about AviSynth coding. And while usually I wouldn't mind learning yet another scripting language, my COVID-derailed life is in such a backlogged chaos right now that I was kind of hoping for an easier solution than that. Like a couple of lines of code from someone who knows what he's doing. Besides, since this seems like a common and reproducible problem, it means that other people's encodes have the same issues. I'd rather see a solution that works for everyone, not just me.
guest
13th October 2021, 06:40
Hey guys. I finally got back into encoding my library backlog
Source sample: https://www.mediafire.com/file/x95dz50wuoj9eks
I thought I'd download this and have a look, but it's only 17Mb, and 17Mb of 4K footage is nothing!..hence I couldn't get it to play.
Ripmann
13th October 2021, 09:25
I thought I'd download this and have a look, but it's only 17Mb, and 17Mb of 4K footage is nothing!..hence I couldn't get it to play.
Just tried downloading and it works fine for me. The clip is only 2 seconds long, just enough to illustrate the problem without wasting time on unnecessary encoding. I don't know what player you use, but you need to pause go frame by frame to notice it. It's the first couple of frames after the scene change, which is probably the reason no one else is complaining about it. It's hard to notice on normal 24fps playback. Unless you catch it by accident, you have to focus and know exactly what to look for. There were plenty of these in the original encode (as well as in the other two before that, as I found out today), but I assume once a solution for fixing this particular segment is found, the rest will probably go away as well.
By the way, since it doesn't seem like a local problemanyone cares to replicate?those of you who really care about losing quality at this level may want to pause your HDR+degrain encodes and keep the originals until you make sure your jobs were not affected.
guest
13th October 2021, 10:34
Just tried downloading and it works fine for me. The clip is only 2 seconds long, just enough to illustrate the problem without wasting time on unnecessary encoding. I don't know what player you use, but you need to pause go frame by frame to notice it. It's the first couple of frames after the scene change, which is probably the reason no one else is complaining about it. It's hard to notice on normal 24fps playback. Unless you catch it by accident, you have to focus and know exactly what to look for. There were plenty of these in the original encode (as well as in the other two before that, as I found out today), but I assume once a solution for fixing this particular segment is found, the rest will probably go away as well.
By the way, since it doesn't seem like a local problemanyone cares to replicate?those of you who really care about losing quality at this level may want to pause your HDR+degrain encodes and keep the originals until you make sure your jobs were not affected.
I use either VLC or Potplayer, still can't even frame by frame it...but that doesn't matter.
So what is that footage from ??
BTW, I sent you a PM...
Ripmann
13th October 2021, 12:40
I never warmed to VLC for some reason, even though I've been trying it every 5 years or so since its release. If you get a "real" player like MPC-BE or MPC-HC, you can easily go frame by frame from there. I forget what the default shortcuts are, but it should be directional left/right arrows plus the combinations with SHIFT and CTRL. One of these will skip several seconds, another will jump to the next/previous keyframe, and yet another will go frame by frame. Check the keyboard shortcuts if you actually decide to use it.
Also again, the sample is the original source. If you want to test whether you can reproduce the issue, you'll have to encode it (the screens above used HEVC, CRF15, MDegrain2x400), and then compare the frames I was talking about by opening two players side by side (or rather placing one on top of another and toggling minimize/restore for one) and comparing the differences visually. If you can reproduce, chances are that any of your jobs that use similar settings will have similar issues of their own.
guest
13th October 2021, 13:37
I never warmed to VLC for some reason, even though I've been trying it every 5 years or so since its release. If you get a "real" player like MPC-BE or MPC-HC, you can easily go frame by frame from there. I forget what the default shortcuts are, but it should be directional left/right arrows plus the combinations with SHIFT and CTRL. One of these will skip several seconds, another will jump to the next/previous keyframe, and yet another will go frame by frame. Check the keyboard shortcuts if you actually decide to use it.
Also again, the sample is the original source. If you want to test whether you can reproduce the issue, you'll have to encode it (the screens above used HEVC, CRF15, MDegrain2x400), and then compare the frames I was talking about by opening two players side by side (or rather placing one on top of another and toggling minimize/restore for one) and comparing the differences visually. If you can reproduce, chances are that any of your jobs that use similar settings will have similar issues of their own.
The only time I use MPC-HC is within RipBot...
I might try and process the sample, and see if it even loads, @ 2 seconds, I'd be surprised.
What is the original footage ??
I haven't used MDegrain for quite some time..
guest
14th October 2021, 08:16
So a question about multiple video cards...
If you had say 2 or so nVidia cards, would it be beneficial to just use them individually and add a command line to each card, per port.....or SLI them, and use them as is (one unit) ??
So I tried 2 x HD 6850 AMD cards, both as singles & crossfire, and RipBot recognises them as 2 separate cards, either way.
I guess SLI would be similar.
So 1 port get's Device 0, another port gets Device 1...that's all there is to it, it seems.
Ripmann
15th October 2021, 00:26
I'm posting what seems to be a solution to the smearing problem I described above (post #19286 (https://forum.doom9.org/showthread.php?p=1954617#post1954617)). My first idea was to set plane=0 in MDegrain, to only process the luma (brightness) and not chroma (colors). However, I figured out that since there was a problem with colors, there may have possibly been similar problem with brightness, and I wasn't wrong. They're just harder to notice, but they are there. So I read up on the functions and played with the settings some more, and what I came up is lowering thSCD2 from its default setting of 130 to something more appropriate, like so:
video=MDegrain1(video,super,bv1,fv1,thSAD=600,thSCD2=80)
According to the wiki, thSCD2 is the threshold which sets how many blocks have to change for the frame to be considered as a scene change. It's ranged from 0 (0%) to 255(100%). The default is 130, or 51%, which was clearly a problem with the scene above. I lowered it to 65 (~25%), and the artifacts were finally gone. I still have to do few tests to come up with an optimal number, but 80 (31%) worked well so far on a less than a handful of test scenes.
In short, what happens on the default settings is that the filter compares previous and next frames and 'merges' their data. It didn't see the last frame before the scene change as a a totally unrelated scene, and therefore the artifacts I highlighted are the buggy remnants of the previous unrelated frame.
So, anyway, I typed it up almost immediately after my first rounds of testing, since the results look very promising and I don't want anyone waste time on this the way I did. If I find any issues, I'll let you know and update the post.
Relevant wiki for MVTools:
http://www.avisynth.nl/users/fizick/mvtools/mvtools2.html#functions
Ripmann
15th October 2021, 02:01
Probably a long shot again, but here we go:
Did somebody here try BM3D for AVS+ (https://forum.doom9.org/showthread.php?p=1951430#post1951430)? How does it compare to KNLMeansCL? I'm looking for a better GPU denoiser (CPU ones fight for the processing power with the encoder and greatly increase the processing time, but GPU ones seem to run in parallel) to replace KNLMeansCL, and this one looks promising. KNLMeansCL is just too simplistic parameter-wise, and I can't get good results with it without losing a lot of quality in some scenes. Anyway, I just tried adding BM3DCUDA to a RipBot job script and failed miserably so far. If anyone has done it already, I'd appreciate a snippet for reference.
EDIT: Also, ATAK, if you're reading this, any chance you could quickly add "Edit Job.avs" into the job submenu? Preferably to open its .avs with a default text editor, but even just opening it with the default association would be great. Would really speed things up. Thanks.
Ryushin
15th October 2021, 17:03
I'm posting what seems to be a solution to the smearing problem I described above (post #19286 (https://forum.doom9.org/showthread.php?p=1954617#post1954617)). My first idea was to set plane=0 in MDegrain, to only process the luma (brightness) and not chroma (colors). However, I figured out that since there was a problem with colors, there may have possibly been similar problem with brightness, and I wasn't wrong. They're just harder to notice, but they are there. So I read up on the functions and played with the settings some more, and what I came up is lowering thSCD2 from its default setting of 130 to something more appropriate, like so:
video=MDegrain1(video,super,bv1,fv1,thSAD=600,thSCD2=80)
[/I]
Thank you for digging into this and finding a solution. I've updated my MDegrain custom filters with this information.
guest
22nd October 2021, 11:24
Just thought I'd let you guy's know that (even tho it may have been done before), I had an epiphany today, and figured out how to produce & encode DGI. (created with DGDecNV) sources thru RipBot.
It turned out to be pretty simple, a little bit of script editing, and that's that.
All you need is an nVidia GPU, and some drivers.
As for encoding using NVEnc, is a very different story...
archiel
24th October 2021, 15:11
I have recently migrated to Windows 11 (from Win 10 Pro 64 bit). I have noted that
(1) ripbot264 no longer closes cleanly - it continues to be visible in task manager as 'not responding'.
(2) EncodingServer no longer works, I can see it in Task Manager, but there is no gui and trying to run in distributed mode does not work - no connections are made. Trying compatibility mode did not help (tried 8 and 7, there is no Windows 10 mode). EncodingServer loads normally in safe mode.
Otherwise when run in local mode ripbot264 works as expected, other then the failure to close fully on exit.
guest
25th October 2021, 12:22
I have recently migrated to Windows 11 (from Win 10 Pro 64 bit). I have noted that
(1) ripbot264 no longer closes cleanly - it continues to be visible in task manager as 'not responding'.
(2) EncodingServer no longer works, I can see it in Task Manager, but there is no gui and trying to run in distributed mode does not work - no connections are made. Trying compatibility mode did not help (tried 8 and 7, there is no Windows 10 mode). EncodingServer loads normally in safe mode.
Otherwise when run in local mode ripbot264 works as expected, other then the failure to close fully on exit.
So, have you had any luck ??
I ran RipBot with a very early Beta build of W11, with no issues at all, however, W11 itself started to piss me off, so I went back to W10.
But I am about to upgrade one PC to "proper" W11 in the next day or so, so hopefully there'll be no problem's.
So, there must be something you need to re install, as your RipBot work OK with W10, so just check, are you using the latest build of RipBot ??, maybe a newer build of Avisynth, or VC_redist.x64...
Are you running nVidia GPU software....
archiel
25th October 2021, 20:34
So, have you had any luck ??
I ran RipBot with a very early Beta build of W11, with no issues at all, however, W11 itself started to piss me off, so I went back to W10.
But I am about to upgrade one PC to "proper" W11 in the next day or so, so hopefully there'll be no problem's.
So, there must be something you need to re install, as your RipBot work OK with W10, so just check, are you using the latest build of RipBot ??, maybe a newer build of Avisynth, or VC_redist.x64...
Are you running nVidia GPU software....
No change from above, if EncodingServer.exe tries to run then RipBot will hang. The machine is dual boot and the same problem whether I run on Win 11 current version or latest insider release (dev channel). RipBot, Windows and all other software are latest versions, as is motherboard bios (Gigabyte Aorus B550 Pro V2)
Avisynth+ is 3.7.0 and the Nvidia software is
Release Version
FrameView SDK 1.1.4923.29968894
GeForce Experience 3.23.0.74
Graphics Driver 472.12
PhysX System Software 9.21.0713
Windows Insider Dev Channel
FrameView SDK 1.1.4923.29968894
GeForce Experience 3.23.0.74
Graphics Driver 510.31
PhysX System Software 9.19.0218
Hopefully you will have a better result.
Atak_Snajpera
25th October 2021, 22:00
Uninstall GeForce experience.
guest
26th October 2021, 01:25
No change from above, if EncodingServer.exe tries to run then RipBot will hang. The machine is dual boot and the same problem whether I run on Win 11 current version or latest insider release (dev channel). RipBot, Windows and all other software are latest versions, as is motherboard bios (Gigabyte Aorus B550 Pro V2)
Avisynth+ is 3.7.0 and the Nvidia software is
Release Version
FrameView SDK 1.1.4923.29968894
GeForce Experience 3.23.0.74
Graphics Driver 472.12
PhysX System Software 9.21.0713
Windows Insider Dev Channel
FrameView SDK 1.1.4923.29968894
GeForce Experience 3.23.0.74
Graphics Driver 510.31
PhysX System Software 9.19.0218
Hopefully you will have a better result.
Yes, there it is, and like Atak said (above post).
RipBot has a long history with certain elements of nVidia drivers, so you really only need to do a "Custom" install, and then probably only choosing the main graphics driver, maybe the audio driver, and maybe Physics, but NOTHING else, and DON'T use the "Express" install option !!!
You can go one step further if you like and grab this :-
https://www.techpowerup.com/download/techpowerup-nvcleanstall/
or
https://www.nvidia.com/en-us/drivers/driver-utility/
And customise your "bloated" nVidia driver package to install only what you really need.
Good luck, I might even do the same myself.
Cheers
archiel
26th October 2021, 12:41
Uninstall GeForce experience.
Done ....and all is fine again. Thank you
archiel
26th October 2021, 12:41
Yes, there it is, and like Atak said (above post).
RipBot has a long history with certain elements of nVidia drivers, so you really only need to do a "Custom" install, and then probably only choosing the main graphics driver, maybe the audio driver, and maybe Physics, but NOTHING else, and DON'T use the "Express" install option !!!
You can go one step further if you like and grab this :-
https://www.techpowerup.com/download/techpowerup-nvcleanstall/
or
https://www.nvidia.com/en-us/drivers/driver-utility/
And customise your "bloated" nVidia driver package to install only what you really need.
Good luck, I might even do the same myself.
Cheers
Thanks for the links, I will have a play later.
chainring
29th October 2021, 18:00
Speaking of video drivers...
In the past, I've had some occasional server stalls when doing encodes in DE mode with MDegrain active. The freeze would manifest itself with one, or multiple, servers stalling during the encode process. Kill the server, restart and the encode continues.
I'm using four Dell PCs, all with built-in Intel graphics. Intel has had a problem with a process called Desktop Window Manager going crazy and, if memory serves, gobbling up RAM. Beta graphics drivers from Intel fixed the DWM thing and it seems that may have also fixed the stalled server problem, too. I've processed at least ten 4K HDR movies, using MDegrain, and so far not one stall.
Noisrevid
4th November 2021, 14:49
I'm trying to figure out for the life of me why Handbrake is encoding about 8x-10x faster with the exact same x265 settings and presets on both GUIs.. Tried multiple machines and they all are acting the same way. Example, Faster preset for HEVC in Ripbot264 = like 12 fps.. Handbrake = 100+ fps. Tried GPU decoding and CPU decoding in settings for Ripbot264 and doesn't make much if any difference on any Nvidia or AMD machine. Tried Intel and AMD CPU powered machines, same issue. Couldn't find anything in the forum giving me any indication why Ripbot264 would be up to 10x slower..
Edit: Resolution was set to 720p in both Ripbot264 and Handbrake from original 1080p (same clip used). Confirmed all threads are being used by Ripbot264 as well and "Use Multiple processing threads" is checked.
Edit 2: New observation is that smaller videos seem to encode at roughly the same speed in Ripbot264 but longer videos just encode incredibly slow right away. Both original videos are the same exact format as each other, one's 15 minutes, one's 1.5 hours.
SKPN
4th November 2021, 14:51
I've been having some issues recently with encodes hanging after completing the chunks. I use the batch encoder distributed among two servers (one on the main encoding PC and the other in a VM on my gaming PC). Sometimes the encodes will go through from start to finish and work properly, but other times the chunks will finish encoding and the window will disappear, but the step to combine and mux the files will not start. In task manager, the encoding window will sometimes show not responding. If I force it closed, the process continues and the file is created. Other times, nothing will be out of the ordinary in the task manager, and the only way to finish the encode is to manually combine the chunks and mux the files. Then I have to remove the job from the main window after closing and reopening RB (aborting causes it to hang).
Any ideas on what might be happening? I generally do large batches while AFK, so when one gets stuck it stops the entire process and I don't see it until hours later. It's been really slowing down my library updates.
Noisrevid
4th November 2021, 14:59
I've been having some issues recently with encodes hanging after completing the chunks. I use the batch encoder distributed among two servers (one on the main encoding PC and the other in a VM on my gaming PC). Sometimes the encodes will go through from start to finish and work properly, but other times the chunks will finish encoding and the window will disappear, but the step to combine and mux the files will not start. In task manager, the encoding window will sometimes show not responding. If I force it closed, the process continues and the file is created. Other times, nothing will be out of the ordinary in the task manager, and the only way to finish the encode is to manually combine the chunks and mux the files. Then I have to remove the job from the main window after closing and reopening RB (aborting causes it to hang).
Any ideas on what might be happening? I generally do large batches while AFK, so when one gets stuck it stops the entire process and I don't see it until hours later. It's been really slowing down my library updates.
I was testing distributed encoding last night and experiencing the exact same problem on videos that were longer than a certain point with hanging or systems that would go from IDLE to ENCODING over and over without figuring itself out.. Until eventually all 8 of my machines were hung up going from IDLE to ENCODE status.. Sometimes the issue would pop up immediately with the second chunk just not working at all 90% of the time. Adjusting the chunk size from 1 min to 2 min helps but it eventually breaks again. Let me know if you find the fix, maybe upping the chunk to 3+ minutes may help? I also don't know what "BDO Strength" means in the settings but it seems to be default to 1.0 and doesn't go higher, only lower.
Noisrevid
4th November 2021, 15:52
https://i.imgur.com/C3Yxtv5.jpg
Can Anyone Tell me Why There is some segments not Started or Not Completed,
Due to this My encoding Stopped on 99.4% and I Didn't Find any option to re-start That segments,
Please Help Me,
Same issue here.. eventually all my DE machines will freeze like this. @Atak, the TCP communication tab just constantly says [CLIENT -> SERVER] OK and [CLIENT <- SERVER] OK over and over when these freeze like this. There are no errors listed anywhere.. hitting Abort on the job cancels everything gracefully.
Atak_Snajpera
4th November 2021, 16:27
@Atak, the TCP communication tab just constantly says [CLIENT -> SERVER] OK and [CLIENT <- SERVER] OK over and over when these freeze like this. There are no errors listed anywhere.. hitting Abort on the job cancels everything gracefully.
Noisrevid is online now Report Post Reply With Quote
Copy whole log from TCP communication tab and paste somewhere (eg. https://pastebin.com/)
Ryushin
4th November 2021, 17:02
Just wanted to mentioned that I have not had a job hang in many months. It just runs now with no issues.
The only problem that I've been having is the encoded files sometimes have 1-2 white frames in them when the DE 1 minute chunks breaks on a screen transition. It's rare, but I've seen it happen about a dozen times or so for example when I encoded television season. Only way to see it to watch the whole season. I've mitigated this by changing my chunks from 1 minute to 5 minutes.
Noisrevid
4th November 2021, 17:06
Just wanted to mentioned that I have not had a job hang in many months. It just runs now with no issues.
The only problem that I've been having is the encoded files sometimes have 1-2 white frames in them when the DE 1 minute chunks breaks on a screen transition. It's rare, but I've seen it happen about a dozen times or so for example when I encoded television season. Only way to see it to watch the whole season. I've mitigated this by changing my chunks from 1 minute to 5 minutes.
Strange, and you're using all the latest and great Ripbot264 files? I'm starting to think the issue for me is going from existing x265 encodes to x265 encodes with DE.. I don't seem to have a problem with x264 -> x265 with DE.
Atak_Snajpera
4th November 2021, 17:29
Just wanted to mentioned that I have not had a job hang in many months. It just runs now with no issues.
The only problem that I've been having is the encoded files sometimes have 1-2 white frames in them when the DE 1 minute chunks breaks on a screen transition. It's rare, but I've seen it happen about a dozen times or so for example when I encoded television season. Only way to see it to watch the whole season. I've mitigated this by changing my chunks from 1 minute to 5 minutes.
What is your source video file? .TS .MKV? Could you load your file in SeekTester I made some time ago
https://forum.doom9.org/showthread.php?t=176878
Just make sure that you are using L-SMASH dll from RipBot264 and frame limit exceeds problematic point!
Noisrevid
4th November 2021, 18:09
x265 -> x265 Ripbot264 encodes are causing all my issues. Encode itself is 10x slower than Handbrake, DE fails eventually on longer movies, etc.
x264 -> x265 Ripbot264 is perfect.. Encode speed beats Handbrake using same settings and DE works flawlessly.
@Atak, sorry to spam with issues, I think your application is superior to Handbrake and i'd love to see you could see what's happening on my side with x265 -> x265 slowness and DE problems, can I provide any logs to help out here? I'd prefer to use Ripbot264 + DE..
Atak_Snajpera
4th November 2021, 18:12
Just run HWINFO in background and Process Hacker to check CPU temps/Clocks and memory usage.
Noisrevid
4th November 2021, 18:19
Just run HWINFO in background and Process Hacker to check CPU temps/Clocks and memory usage.
Already run HWinfo on all of my machines.. Temps are in check.. No WHEA errors.. everything's healthy. I guess there's an issue with the decoder in Ripbot264 for x265 content or something else getting in the way.
Can someone download a fresh copy of the latest Ripbot264 and do a x265 to x265 encode and compare to the latest with Handbrake?
I'm seeing the same behavior across 8 different machines. It's not a hardware issue.
Atak_Snajpera
4th November 2021, 18:55
Are you using GPU decoders in Ripbot264?
Noisrevid
4th November 2021, 19:01
Are you using GPU decoders in Ripbot264?
Tried both CPU and GPU in Ripbot264 with no change in speed.
Ryushin
6th November 2021, 14:36
What is your source video file? .TS .MKV? Could you load your file in SeekTester I made some time ago
https://forum.doom9.org/showthread.php?t=176878
Just make sure that you are using L-SMASH dll from RipBot264 and frame limit exceeds problematic point!
Source files are MKVs. I export the episodes using MakeMKV. Then use PowerDVD to identify and label them from the discs, then batch the episodes into RB. By the time I watch an episode and I notice it, the source files are deleted and gone from my ZFS snapshots. Since moving to five minute chunks I have not seen it happen, but that only means it will be five times less likely to occur now.
The next time it does happen, and I have the source still available, I'll do you what you ask.
Oscar77
9th November 2021, 17:18
I've been having some issues recently with encodes hanging after completing the chunks. I use the batch encoder distributed among two servers (one on the main encoding PC and the other in a VM on my gaming PC). Sometimes the encodes will go through from start to finish and work properly, but other times the chunks will finish encoding and the window will disappear, but the step to combine and mux the files will not start. In task manager, the encoding window will sometimes show not responding. If I force it closed, the process continues and the file is created. Other times, nothing will be out of the ordinary in the task manager, and the only way to finish the encode is to manually combine the chunks and mux the files. Then I have to remove the job from the main window after closing and reopening RB (aborting causes it to hang).
Any ideas on what might be happening? I generally do large batches while AFK, so when one gets stuck it stops the entire process and I don't see it until hours later. It's been really slowing down my library updates.
I have same problem with DE and 16 server
When i Launch multi encode with SD or 720p with 30 batch in queue i have no problem
But if i launch Batch in 1080P the first encode is ok but the second encode stop just after muxing operation and the service ClientEncode is green in task bar, if i lauch taskmanager and kill Clientencode the muxing is progress and after the third encode launch
http://prnt.sc/1ywwv2j
https://prnt.sc/1ywx3x7
https://prnt.sc/1ywx6yz
https://prnt.sc/1ywx93y
Pulp Catalyst
15th November 2021, 01:20
Is there a simple and quick way to get ripbot264 to detect when a film has a slight audio sync to it
some films start of fine, but as time goes on the sync gets worse, by the end of the film the audio sync is really bad.
is there nothing ripbot can do to detect this (staxrip on the same films does not have this issue?)
but i like ripbot because it's far simpler and much more reliable (stax is less reliable and also the hdr to sdr in ripbot is very good)
truth is, the interface in ripbot reminds me of "autogk"...good times
guest
15th November 2021, 03:40
Is there a simple and quick way to get ripbot264 to detect when a film has a slight audio sync to it
some films start of fine, but as time goes on the sync gets worse, by the end of the film the audio sync is really bad.
is there nothing ripbot can do to detect this (staxrip on the same films does not have this issue?)
but i like ripbot because it's far simpler and much more reliable (stax is less reliable and also the hdr to sdr in ripbot is very good)
truth is, the interface in ripbot reminds me of "autogk"...good times
Are the original source files "in sync" ??
May depend on what you are using to demux the files, RipBot uses L-Smash, but StaxRip has different options, AFAIK.
Pulp Catalyst
15th November 2021, 03:50
yes the originals are fine...handbrake works okay too, but i love using ripbot because the hdrtosdr is so good and the interface batch works amazing
one clue is that mediainfo lite reports on some of them (originals) things like "Delay relative to video : 5 ms" could this be the cause, and if so using batch mode where would i put this?
Audio
ID : 2
Format : DTS
Format/Info : Digital Theater Systems
Codec ID : A_DTS
Duration : 2 h 1 min
Bit rate mode : Constant
Bit rate : 1 509 kb/s
Channel(s) : 6 channels
Channel layout : C L R Ls Rs LFE
Sampling rate : 48.0 kHz
Frame rate : 93.750 FPS (512 SPF)
Bit depth : 24 bits
Compression mode : Lossy
Delay relative to video : -9 ms
Stream size : 1.28 GiB (2%)
Title : Lord.of.war2003
Language : English
Default : No
Forced : No
guest
15th November 2021, 04:07
yes the originals are fine...handbrake works okay too, but i love using ripbot because the hdrtosdr is so good and the interface batch works amazing
one clue is that mediainfo lite reports on some of them (originals) things like "Delay relative to video : 5 ms" could this be the cause, and if so using batch mode where would i put this?
Is this only happening in batch mode ??
Are you using CPU or GPU decoding ??
There is an option to change the "delay" of the audio track, BUT if it isn't a constant delay, this won't help.
If this isn't a regular occurrence, you might have to remux the video & audio tracks after the RipBot encode is completed.
Ryushin
19th November 2021, 16:29
Is there a simple and quick way to get ripbot264 to detect when a film has a slight audio sync to it
some films start of fine, but as time goes on the sync gets worse, by the end of the film the audio sync is really bad.
is there nothing ripbot can do to detect this (staxrip on the same films does not have this issue?)
I have this issue with 4K discs that join multiple m2ts files (at least as a few months ago) into the video file. Whenever I encounter a 4K with branching, then I just use MakeMKV to make a single MKV file from the multiple m2ts files and import that MKV into RB and do what I normally do. This AV sync issue does not happen with Blu-ray and only 4K.
I also might add, that it occurred when using distributed encoding, but I have not tested that in over a couple of years.
fattestpizza
21st November 2021, 08:56
I've installed Ripbot on a new PC at home, and I'm having issues with it getting stuck when trying to open encoding servers. If I analyse the wait chain it's getsting stuck on rundll32.exe. If I close that process they start fine.
Also if I uninstall and reinstall avisynth+ the issue stops, but starts again when I reboot.
Any ideas?
Atak_Snajpera
21st November 2021, 11:03
Uninstall GeForce experience.
fattestpizza
21st November 2021, 12:59
Uninstall GeForce experience.
Thanks, but I don't have it installed. Before the rundll32 issue though I was having problems with RadeonSoftware.exe also holding it up, but I disabled the Radeon utility and that got past that. I'll actually uninstall it to see how it goes.
For what it's worth I'm using a laptop with a Ryzen 5800H APU and an RTX 3060.
Atak_Snajpera
21st November 2021, 14:22
Run windows in SAFE MODE
MCFish
22nd November 2021, 20:32
I've been having some issues recently with encodes hanging after completing the chunks. I use the batch encoder distributed among two servers (one on the main encoding PC and the other in a VM on my gaming PC). Sometimes the encodes will go through from start to finish and work properly, but other times the chunks will finish encoding and the window will disappear, but the step to combine and mux the files will not start. In task manager, the encoding window will sometimes show not responding..
I have the same problem, had it for some time now.
Have tried to use a clean install of windows and ripbot(as atak suggested), and used another computer as ripbot server. Still hangs randomly as you describe
sapphiresky83
23rd November 2021, 05:11
Hey all, I posted a few pages back but never had any replies, and so going to try once more.
Has anyone else run into the issue of a machine in your distributed encoding chain repeating the same chunks over and over again? I have 2 servers running on my desktop rig and they both will encode their assigned chunks, but then when they are finished, rather than grabbing the next in queue, they repeat the same chunks over that they already processed.
Here is a snipped from the activity logs of the encoding servers:
Encoding started...
""\\ROGSTRIX-Z390E\Ripbot264temp\Tools\ffmpeg\bin\ffmpeg.exe" -loglevel panic -i "\\ROGSTRIX-Z390E\RipBot264temp\job1\Chunks\68.avs" -strict -1 -f yuv4mpegpipe - | "\\ROGSTRIX-Z390E\Ripbot264temp\tools\x264\x264_x64.exe" --seek 21 --colorprim bt709 --transfer bt709 --colormatrix bt709 --opencl --opencl-device 0 --opencl-clbin "C:\Users\jjbut\AppData\Local\Temp\EncodingServer1\x264_lookahead.clbin" --crf 20 --fps 24000/1001 --force-cfr --min-keyint 24 --keyint 240 --frames 1446 --sar 1:1 --level 4.0 --aud --nal-hrd vbr --vbv-bufsize 25000 --vbv-maxrate 25000 --b-pyramid none --stdin y4m --output "\\ROGSTRIX-Z390E\RipBot264temp\job1\Chunks\68.264" -"
y4m [info]: 1920x1080p 1:1 @ 24000/1001 fps (cfr)
x264 [info]: using SAR=1/1
x264 [info]: using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
x264 [info]: OpenCL acceleration enabled with NVIDIA Corporation NVIDIA GeForce RTX 3070 Ti
x264 [info]: profile High, level 4.0, 4:2:0, 8-bit
[37.3%] 539/1446 frames, 28.23 fps, 9473.89 kbps, eta 0:00:32
[2021-11-22 23:02:32] Connection Closed Gracefully.
464|CLIENT -> SERVER| OK
465|CLIENT -> SERVER| GET_ENCODING_PROGRESS;SET_ENCODING_PRIORITY=belownormal;
466|CLIENT <- SERVER| OK
467|CLIENT <- SERVER| ENCODING_FINISHED
468|CLIENT -> SERVER| OK
469|CLIENT -> SERVER| GET_ENCODING_SUMMARY
470|CLIENT <- SERVER| OK
471|CLIENT <- SERVER| ENCODING_SUMMARY=192.168.0.245:1000 -> ERROR;CHUNK=68;CPU=94;RAM=33;DECODER=0;ENCODER=0;OTHER=94;ENCODING_PRIORITY=normal;
472|CLIENT -> SERVER| OK
473|CLIENT -> SERVER| STANDBY
474|CLIENT <- SERVER| OK
475|CLIENT <- SERVER| SERVER_IDLE
476|CLIENT -> SERVER| OK
477|CLIENT -> SERVER| ENCODE_CHUNK_68=\\ROGSTRIX-Z390E\RipBot264temp\job1\Chunks\68.cmd
478|CLIENT <- SERVER| OK
479|CLIENT <- SERVER| ENCODING_STARTED
480|CLIENT -> SERVER| OK
481|CLIENT -> SERVER| GET_ENCODING_PROGRESS;SET_ENCODING_PRIORITY=low;
482|CLIENT <- SERVER| OK
483|CLIENT <- SERVER| ENCODING_PROGRESS=192.168.0.245:1000 -> Initializing encoding process...;CHUNK=68;CPU=42;RAM=36;DECODER=0;ENCODER=0;OTHER=42;ENCODING_PRIORITY=normal;
484|CLIENT -> SERVER| OK
485|CLIENT -> SERVER| GET_ENCODING_PROGRESS;SET_ENCODING_PRIORITY=low;
486|CLIENT <- SERVER| OK
487|CLIENT <- SERVER| ENCODING_PROGRESS=192.168.0.245:1000 -> Initializing encoding process...;CHUNK=68;CPU=42;RAM=36;DECODER=0;ENCODER=0;OTHER=42;ENCODING_PRIORITY=normal;
488|CLIENT -> SERVER| OK
489|CLIENT -> SERVER| GET_ENCODING_PROGRESS;SET_ENCODING_PRIORITY=low;
490|CLIENT <- SERVER| OK
491|CLIENT <- SERVER| ENCODING_PROGRESS=192.168.0.245:1000 -> Initializing encoding process...;CHUNK=68;CPU=42;RAM=36;DECODER=0;ENCODER=0;OTHER=42;ENCODING_PRIORITY=normal;
492|CLIENT -> SERVER| OK
493|CLIENT -> SERVER| GET_ENCODING_PROGRESS;SET_ENCODING_PRIORITY=low;
I've gone through settings over and over, have reinstalled the software many times and the required/supporting software as well.
Somewhat recently the machine in question had Windows 10 reinstalled fresh. I've done this many times before and have never run into this particular issue before.
Thanks in advance to anyone who might be able to assist!
Atak_Snajpera
23rd November 2021, 15:20
I suspect that encoder did not encode all frames. Encoding server always checks at the end if number of encoded frames match number of frames to encode. Checks 68.txt file located in chunks folder
Ps. Try again without opencl acceleration in x264.
Dhry
23rd November 2021, 18:42
Hi. Sorry, not sure if this has been asked before.
I have a render farm with several servers, some of which are nice and fast, others which aren't so fast. For any given job, I find that what happens is most of the servers complete their chunks of work, but then they all have to sit around twiddling their thumbs while the last one or two servers crunch their chunk before it's time to move on to the next job.
Is there a way to allow the idle servers to just move on to the next job in the queue and start their business, while the slow servers at the end of a job just finish what they're doing? If not there's a potential huge waste of idle server time toward the end of each job. See attached screenshot for example.
Cheers
Dhry
Atak_Snajpera
23rd November 2021, 20:47
Hi. Sorry, not sure if this has been asked before.
I have a render farm with several servers, some of which are nice and fast, others which aren't so fast. For any given job, I find that what happens is most of the servers complete their chunks of work, but then they all have to sit around twiddling their thumbs while the last one or two servers crunch their chunk before it's time to move on to the next job.
Is there a way to allow the idle servers to just move on to the next job in the queue and start their business, while the slow servers at the end of a job just finish what they're doing? If not there's a potential huge waste of idle server time toward the end of each job. See attached screenshot for example.
Cheers
Dhry
No...
guest
24th November 2021, 02:44
Hi. Sorry, not sure if this has been asked before.
I have a render farm with several servers, some of which are nice and fast, others which aren't so fast. For any given job, I find that what happens is most of the servers complete their chunks of work, but then they all have to sit around twiddling their thumbs while the last one or two servers crunch their chunk before it's time to move on to the next job.
Is there a way to allow the idle servers to just move on to the next job in the queue and start their business, while the slow servers at the end of a job just finish what they're doing? If not there's a potential huge waste of idle server time toward the end of each job. See attached screenshot for example.
Cheers
Dhry
This HAS been asked about before, and got the same answer as given in the previous post.....
However, you can enable a "sleep" function, that (when it works), puts the idle PC's to sleep, and then when the next job starts, the "sleeping" server(s) hopefully wake up, and start encoding.
I tried this not so long ago, and had limited success...it's just one of the problems when running so many servers, unfortunately.
I feel your pain.
Sveni-go
2nd December 2021, 10:12
Hi,
Is there any way that Ripbot convert DTS in DD+ automatically ? or implemented in Audio
FuzzyNutz
2nd December 2021, 20:34
Please make RB work well with Windows scaling and give us a dark mode.
Scaling is common for 4k display users and dark mode is the new norm for peeps in the know. Non-dark mode is so last century. "Once you go black, you never go back!"
-I'm aware the Windows compatibility high DPI scaling override setting "System (Enhanced)" for RB's executable file provides a decent workaround for most areas of RB's gui, but the lower window for bottom-right cropping on page 1 of the "AviSynth Filters" section as well as MPC become dysfunctional.
FuzzyNutz
2nd December 2021, 21:09
Please add an option for vbr (vs cbr) for AAC and the ability to choose the vbr number. For now, I manually edit the "jobX_EncodeAudioX" file to get vbr6.
An option to choose cbr numbers beyond 320 would be great, too.
-I understand 5.1 @ 320 and 2.0 @ 128 are transparent.
FuzzyNutz
2nd December 2021, 21:16
Please add, perhaps in the settings area, the ability for prepopulated user defined data for track descriptions. So, users don't have to manually enter often used descriptions. Each track type, (video, audio and subtitle), should have it's own prepopulated user defined descriptions list. Also, users should be able to control the order of the descriptions within the lists (vs the order being automatically alphabetical).
And make it so, if the description box for subtitle tracks is empty, nothing from the source file gets injected in the resulting track.
FuzzyNutz
2nd December 2021, 21:40
When a source containing a dts-ma track is loaded, RB displays a dts symbol above the top-right of the selected audio track. I hope that's not an indication RB is encoding from the core (vs the full dts-ma).
FuzzyNutz
2nd December 2021, 22:00
Please implement the ability for RB to only choose sample frames that don't have video info that's too dark, in proximity to the crop line, when "new frame" is used in page 1 of the "AviSynth Filters" section.
Pulp Catalyst
3rd December 2021, 06:00
Is there a simple and quick way to get ripbot264 to detect when a film has a slight audio sync to it
some films start of fine, but as time goes on the sync gets worse, by the end of the film the audio sync is really bad.
is there nothing ripbot can do to detect this (staxrip on the same films does not have this issue?)
but i like ripbot because it's far simpler and much more reliable (stax is less reliable and also the hdr to sdr in ripbot is very good)
truth is, the interface in ripbot reminds me of "autogk"...good times
edit
so i found a movie that i have ripped twice now, ripbot always gets a audio sync with it as time goes on in the video
its "wreck-it Ralph"
at the beginning it's okay, by the time in the end it's about 3-5 seconds off.
i ripped disk with makemkv then tried dvdfab
same results
is there something on these types of movies that ripbot is not detecting?
it compressed fine with stax and handbrake
but the quality of handbrake on movies is really subpar, and staxrip doesn't do easy out of the box hdr to sdr without getting into user intervention with parameters.
in ripbot i always use batch processing
Atak_Snajpera
3rd December 2021, 19:08
Is numer of frames the same in video encoded by ripbot and staxrip/handbreak?
Two possibile scenarios:
1) some frames are being dropped during encoding
2) slightly wrong framerate in encoded file
guest
4th December 2021, 01:23
edit
so i found a movie that i have ripped twice now, ripbot always gets a audio sync with it as time goes on in the video
its "wreck-it Ralph"
at the beginning it's okay, by the time in the end it's about 3-5 seconds off.
i ripped disk with makemkv then tried dvdfab
same results
is there something on these types of movies that ripbot is not detecting?
it compressed fine with stax and handbrake
but the quality of handbrake on movies is really subpar, and staxrip doesn't do easy out of the box hdr to sdr without getting into user intervention with parameters.
in ripbot i always use batch processing
I would like to suggest the following "test"...
Demux the original "ripped" file to separate the audio & video tracks, THEN do the same to the file you've encoded with RB, then using MKVToolNix, import the RB encoded video file, and the original ripped audio file, and remux then back together, and see if it's still out of sync.
As mentioned in the previous post, it's something to do with frames or framerates.
Maybe you could try a different process of ripping the disc, maybe MakeMKV is the problem.
NiGHTsC
4th December 2021, 08:51
anyone having problem previewing MP4 because of LSMASHSource.dll?
64bit issue when it's 32bit version, and 32bit issue when I switch to 64bit version....
Cannot load a 32(64) bit DLL in 64(32) bit Avisynth
Also, how do I fix some out of sync issue with convertfps now? since it's now LWLibavVideoSource instead of DirectShowSource
Thank you.
guest
4th December 2021, 09:43
anyone having problem previewing MP4 because of LSMASHSource.dll?
64bit issue when it's 32bit version, and 32bit issue when I switch to 64bit version....
Cannot load a 32(64) bit DLL in 64(32) bit Avisynth
Also, how do I fix some out of sync issue with convertfps now? since it's now LWLibavVideoSource instead of DirectShowSource
Thank you.
If you want to try a different decoder, do this, and see if it fixes your issue:-
overwrite this field in RipBot264.ini if you want to use FFMS2 instead of L-Smash
[DefaultVideoDecoder]
MPEG-2=FFMS2
VC-1=FFMS2
AVC=FFMS2
HEVC=FFMS2
OTHER=FFMS2
NiGHTsC
4th December 2021, 18:01
If you want to try a different decoder, do this, and see if it fixes your issue:-
overwrite this field in RipBot264.ini if you want to use FFMS2 instead of L-Smash
[DefaultVideoDecoder]
MPEG-2=FFMS2
VC-1=FFMS2
AVC=FFMS2
HEVC=FFMS2
OTHER=FFMS2Love you!
gabbett1
5th December 2021, 16:02
Just installed the new version and could not get the distributed encoding to work. The encoding clients are open on the other computers, however Ripbot perpetually says "connecting" and just hangs there. I should also note that one of the encoding servers is the computer itself with Ripbot and it will not encode either.
guest
6th December 2021, 00:46
Just installed the new version and could not get the distributed encoding to work. The encoding clients are open on the other computers, however Ripbot perpetually says "connecting" and just hangs there. I should also note that one of the encoding servers is the computer itself with Ripbot and it will not encode either.
What new version ???, latest is v1.26.1
If you're running an nVidia GPU, the issue is more than likely the driver software.
Check this post for what to do to fix the problem:-
https://forum.doom9.org/showthread.php?p=1955821#post1955821
And maybe read the posts just before & after.
guest
6th December 2021, 00:50
Hi,
Is there any way that Ripbot convert DTS in DD+ automatically ? or implemented in Audio
I don't think you got a reply.
You might be better off converting your audio "outside" of Ripbot, and muxing it back in later, just let RipBot encoding the video track(s).
gabbett1
6th December 2021, 13:14
What new version ???, latest is v1.26.1
If you're running an nVidia GPU, the issue is more than likely the driver software.
Check this post for what to do to fix the problem:-
https://forum.doom9.org/showthread.php?p=1955821#post1955821
And maybe read the posts just before & after.
Thanks, I'll give it a read. I don't know if this will be the issue or not. I seem to have this exact same issue every time I update and I can't remember how I would fix it. Could it really be a GPU issue on ALL of my computers?
guest
6th December 2021, 13:24
Thanks, I'll give it a read. I don't know if this will be the issue or not. I seem to have this exact same issue every time I update and I can't remember how I would fix it. Could it really be a GPU issue on ALL of my computers?
So when you say every time you update, do you mean updating RipBot, or your graphics drivers ??
There hasn't been any significant RipBot updates for months & months !!!
Depends how you have the other computers setup ??
Do you use them separately, or as Distributed Encoding servers ??
Do you use nVidia video cards ??
gabbett1
6th December 2021, 18:56
So when you say every time you update, do you mean updating RipBot, or your graphics drivers ??
There hasn't been any significant RipBot updates for months & months !!!
Depends how you have the other computers setup ??
Do you use them separately, or as Distributed Encoding servers ??
Do you use nVidia video cards ??
Every time I update Ripbot. I have never had an issue with my graphics driver before. Yes, I do have Nvidia control panel, but I always do a "clean" install of drivers. I stopped doing Ripbot updates for quite some time because it was working and I didn't want to go through this issue again. Well, low and behold, I had some issues arrive trying to preview script when adding subtitles. I would only get audio and no video. SO I did an update and it did fix the issue. Now I have to figure out my distributed encoding issue again and I can't remember how I did it before.
guest
7th December 2021, 07:32
Every time I update Ripbot. I have never had an issue with my graphics driver before. Yes, I do have Nvidia control panel, but I always do a "clean" install of drivers. I stopped doing Ripbot updates for quite some time because it was working and I didn't want to go through this issue again. Well, low and behold, I had some issues arrive trying to preview script when adding subtitles. I would only get audio and no video. SO I did an update and it did fix the issue. Now I have to figure out my distributed encoding issue again and I can't remember how I did it before.
I'm still not sure where you are getting the RipBot updates from !!!
slalom
7th December 2021, 21:36
Hi. Sorry, not sure if this has been asked before.
I have a render farm with several servers, some of which are nice and fast, others which aren't so fast. For any given job, I find that what happens is most of the servers complete their chunks of work, but then they all have to sit around twiddling their thumbs while the last one or two servers crunch their chunk before it's time to move on to the next job.
Is there a way to allow the idle servers to just move on to the next job in the queue and start their business, while the slow servers at the end of a job just finish what they're doing? If not there's a potential huge waste of idle server time toward the end of each job. See attached screenshot for example.
Cheers
Dhry
Try setting the order of the servers from faster to the slower in DE window
Might be a little better
gabbett1
9th December 2021, 16:39
I'm still not sure where you are getting the RipBot updates from !!!
Sorry, I've been busy.
I get the Ripbot updates from this site.
https://forum.doom9.org/showthread.php?t=127611
guest
10th December 2021, 10:12
Sorry, I've been busy.
I get the Ripbot updates from this site.
https://forum.doom9.org/showthread.php?t=127611
Hi gabbett1,
I have to let you know that that is NOT how you get RipBot updates !!!
That is the 1st page of this forum, and that version / build of RipBot is very old !!
The ONLY way you can get updates is thru the program itself, when you have Auto Updates enabled, and you're connected to the "net".
The program search's for updates every time it is started.
The latest version is 1.26.1, dated 27/09/21 15:19.
There was only one significant addition with that version, and that's nearly 3 months ago.
GAP
10th December 2021, 12:23
How do you convert lossless AVI files to lossless MP4 files?
LigH
10th December 2021, 17:39
The MP4 container can only contain specific video formats. One could be lossless MPEG-4 AVC video. So you could use x264 --qp 0 ... but RipBot264 may not be the optimal user interface to do that.
slalom
13th December 2021, 11:17
How do you convert lossless AVI files to lossless MP4 files?
You can't convert something and be lossless again
LigH
13th December 2021, 12:14
You can't convert something and be lossless again
Oh, you can. You can convert from one lossless video format to another lossless video format without losing a bit of information (matching color space attributes provided). And among all the video formats supported in an MP4 container, there are some lossless, too.
slalom
15th December 2021, 10:19
Do you know 1 minute of lossless avi is a few GBs in size?
LigH
15th December 2021, 12:35
Depends on the resolution and compression. Uncompressed video is larger than losslessly compressed video; a ratio of 1:3 is possible, depending on the clarity of the content. But those are basics of video compression, nothing specific to RipBot264.
ReinerSchweinlin
15th December 2021, 15:14
How do you convert lossless AVI files to lossless MP4 files?
In Ripbot, you can set Q=0, which is losless in x264 or x265...
Whether the colourspace stays the same depends on what you have at hand initially, 12Bit is not supported in Ripbot as far as I know. RGB also is not..
There are not too many cases where this scenario makes a lot of sense - losless x264/5 is not always dealt with correctly on any decoder, the space saving might not be too much, depending on what you initially have...
screaming
20th December 2021, 23:26
Running v1.26.1, I've done a number of HEVC encodes with no problem, except for 2 recent encodes. Both videos were animation, and there ended up being an audio sync problem with both. What can I do to troubleshoot or resolve the issue?
Atak_Snajpera
20th December 2021, 23:57
Post mediainfo report for source file
screaming
21st December 2021, 00:21
Post mediainfo report for source file
Here is the video and audio stream info:
Video
ID : 1
Format : AVC
Format/Info : Advanced Video Codec
Format profile : High@L4.1
Format settings : CABAC / 4 Ref Frames
Format settings, CABAC : Yes
Format settings, Reference frames : 4 frames
Format settings, GOP : M=1, N=12
Codec ID : V_MPEG4/ISO/AVC
Duration : 21 min 51 s
Bit rate mode : Variable
Bit rate : 31.6 Mb/s
Maximum bit rate : 38.0 Mb/s
Width : 1 920 pixels
Height : 1 080 pixels
Display aspect ratio : 16:9
Frame rate mode : Constant
Frame rate : 23.976 (24000/1001) FPS
Color space : YUV
Chroma subsampling : 4:2:0
Bit depth : 8 bits
Scan type : Progressive
Bits/(Pixel*Frame) : 0.636
Stream size : 4.83 GiB (99%)
Default : Yes
Forced : No
Audio
ID : 2
Format : E-AC-3
Format/Info : Enhanced AC-3
Commercial name : Dolby Digital Plus
Codec ID : A_EAC3
Duration : 21 min 51 s
Bit rate mode : Constant
Bit rate : 256 kb/s
Channel(s) : 6 channels
Channel layout : L R C LFE Ls Rs
Sampling rate : 48.0 kHz
Frame rate : 31.250 FPS (1536 SPF)
Compression mode : Lossy
Stream size : 40.0 MiB (1%)
Language : English
Service kind : Complete Main
Default : Yes
Forced : No
activoice
21st December 2021, 02:04
I've been using Ripbot for quite a long time now, and I've recently come across a problem that only happens with some videos. It has to be an issue with the source video that I am encoding from, but playing back the orignal video this problem is not present.
If I encode the entire video in 1 chunk this does not occur.
But if I use distributed encoding mode if I set the chunk size to something other than 0, so the file is broken up into smaller chunks of 1 minute or more. Sometimes at the point where the video is joined I get some duplicate frames. It's inconsistent, it doesn't happen in every video I encode, in fact it's rare but when it does happen I see it happen 2 or 3 times within that same encoded Video file.
For example if I take a video and I set the chunk size to 10, then at the point where the video is re-joined after encoding I can see that at either the 10, 20, 30, or 40 min mark there might be a few duplicated frames. The audio continues to playback correctly, and the video and audio remain in sync. It's definitely some issue with the source video file, as I can do 10 episodes in a series, and of that maybe 2 of them exhibit this problem. If I re-encode the video with a chunk size of 0 so it's all done in one chunk then this problem does not happen.
I've also checked the number of frames in the output video file, if I encode it in 1 chunk, or multiple chunks the resulting output file has the same number of frames in both cases...
Any ideas what the issue might be with the source video file that would cause this to happen? I'm wondering if there is a way for me to detect this problem with the source video file before starting the encode.
Atak_Snajpera
21st December 2021, 15:18
@activoice
You may check whether LWLibavVideoSource is truly frame accurate with those problematic source files in my SeekTester tool. I recommend to increase default frame limit from 1000 to something bigger if initial test shows no errors.
https://forum.doom9.org/showthread.php?t=176878
Ps. Just make sure that LoadPlugin line has correct path to LSMASHDource.dll
https://i.postimg.cc/65PmVv5h/seekteset.png
@screaming
Is sync issue constant during whole playback (let's say constant 1 second delay) or it slowly increases when you watch? (unnoticeable at the beginning but very obvious at the end )
screaming
21st December 2021, 16:40
@screaming
Is sync issue constant during whole playback (let's say constant 1 second delay) or it slowly increases when you watch? (unnoticeable at the beginning but very obvious at the end )
The sync issue is noticeable right from the beginning. The audio sync is only off by a tiny amount, like a split second, but it's just enough that I noticed it. It's also not entirely consistent, where sometimes the audio is slightly ahead of the video, and sometimes a little behind.
Atak_Snajpera
21st December 2021, 16:44
Is sync correct when You click PREVIEW SCRIPT button? What is your CPU?
screaming
21st December 2021, 17:47
Is sync correct when You click PREVIEW SCRIPT button? What is your CPU?
Sync is slightly off in preview. My CPU is an Intel Core i5-9600K.
Atak_Snajpera
22nd December 2021, 01:21
Three is an option for manual adjustment of audio delay
screaming
22nd December 2021, 15:43
Three is an option for manual adjustment of audio delay
I have used Ripbot264 (thank you for such a fantastic application, btw) for a very long time. In all that time, I've never had to adjust for an audio delay. How often do others have to make adjustments for audio delays? Regardless, I'm not sure if I could line it up correctly, as my first 2 tries had audio drifting back and forth for early and late audio.
I mentioned there was another video that had a bad sync as well. On the Ripbot encode, the audio drift got worse as the video progressed. I just ended up encoding via Handbrake, and I might do the same with this video as well. I might investigate this further, as perhaps a library or utility that Ripbot uses needs to be updated.
Atak_Snajpera
22nd December 2021, 16:20
Maybe your source video file uses variable Frame Rate instead of Constant Frame Rate?
screaming
22nd December 2021, 21:44
Maybe your source video file uses variable Frame Rate instead of Constant Frame Rate?
The source video is the one I posted the stream info a few posts ago, and that shows the frame rate mode as constant. My test encode via Handbrake with generally similar HEVC settings yielded a video file with audio in sync. I'm tried another encode on Ripbot with forced 23.976 framerate, but that had an audio sync as well.
guest
23rd December 2021, 02:12
The source video is the one I posted the stream info a few posts ago, and that shows the frame rate mode as constant. My test encode via Handbrake with generally similar HEVC settings yielded a video file with audio in sync. I'm tried another encode on Ripbot with forced 23.976 framerate, but that had an audio sync as well.
Try this :- (or some of it)
https://forum.doom9.org/showthread.php?p=1958502#post1958502
activoice
23rd December 2021, 15:36
@activoice
You may check whether LWLibavVideoSource is truly frame accurate with those problematic source files in my SeekTester tool. I recommend to increase default frame limit from 1000 to something bigger if initial test shows no errors.
https://forum.doom9.org/showthread.php?t=176878
Thanks that helped, I am seeing a lot of errors, so that confirms it's a source video problem.
So if I encode in a single chunk I don't see any problem with the output video is that because the frames are being encoded in sequence?
Atak_Snajpera
23rd December 2021, 15:54
Thanks that helped, I am seeing a lot of errors, so that confirms it's a source video problem.
So if I encode in a single chunk I don't see any problem with the output video is that because the frames are being encoded in sequence?
That's right. You may also try remuxing your video file in mkvtoolnix to see if this fixes seek issues.
screaming
23rd December 2021, 19:22
Try this :- (or some of it)
https://forum.doom9.org/showthread.php?p=1958502#post1958502
I've used that trick of mixing encoded video with remuxed audio before, but that did not work this time when using the encoded HEVC video from Ripbot with the remuxed audio from the original video file.
I really prefer using Ripbot for 1080p encodes, but if I have to use Handbrake for the rare HEVC encode, so be it.
gabbett1
23rd December 2021, 21:53
Hi gabbett1,
I have to let you know that that is NOT how you get RipBot updates !!!
That is the 1st page of this forum, and that version / build of RipBot is very old !!
The ONLY way you can get updates is thru the program itself, when you have Auto Updates enabled, and you're connected to the "net".
The program search's for updates every time it is started.
The latest version is 1.26.1, dated 27/09/21 15:19.
There was only one significant addition with that version, and that's nearly 3 months ago.
Actually I do have 1.26.1 from the link on the first page, even though the link says 1.26.0.7.
A couple things I've noticed when trying to do the distributed encoding.
One, if I enter the IP address of the host server, it will blank out the options for that server as if the IP is not allowed. If I change the IP by one digit in any direction, those options return. Are we no longer allowed to use the host computer as one of the distributed encoding processors?
Next, when I try to do distributed encoding, the other computers I'm trying to use say "Access violation at address 0051AE24 in module 'EncodingServer.exe'. Read of address 00000098"
guest
24th December 2021, 00:38
Actually I do have 1.26.1 from the link on the first page, even though the link says 1.26.0.7.
A couple things I've noticed when trying to do the distributed encoding.
One, if I enter the IP address of the host server, it will blank out the options for that server as if the IP is not allowed. If I change the IP by one digit in any direction, those options return. Are we no longer allowed to use the host computer as one of the distributed encoding processors?
Next, when I try to do distributed encoding, the other computers I'm trying to use say "Access violation at address 0051AE24 in module 'EncodingServer.exe'. Read of address 00000098"
Well, clearly you have autoupdate enabled, to get v1.26.1.
There must be some addressing conflict somewhere you need to rectify.
guest
24th December 2021, 00:41
I've used that trick of mixing encoded video with remuxed audio before, but that did not work this time when using the encoded HEVC video from Ripbot with the remuxed audio from the original video file.
I really prefer using Ripbot for 1080p encodes, but if I have to use Handbrake for the rare HEVC encode, so be it.
Yes, Handbrake is a good "standby" when you have some problem with RipBot.
Have you tried Staxrip ??
screaming
24th December 2021, 03:37
Yes, Handbrake is a good "standby" when you have some problem with RipBot.
Have you tried Staxrip ??
Never heard of Staxrip, but I'll keep it in mind. Thanks.
gabbett1
29th December 2021, 02:08
Well, clearly you have autoupdate enabled, to get v1.26.1.
There must be some addressing conflict somewhere you need to rectify.
What kind of addressing conflict? I don't understand why this issue comes back every time.
phred1
29th December 2021, 17:03
Try again in SAFE MODE
Yes, booting in SAFE MODE did the trick =)
But when booting as normal Encoding Server won't start again. What can I di to change this behavior?
Atak_Snajpera
29th December 2021, 18:12
Some app running in background is blocking Encoding Server. (Geforce Experience and so on)
guest
30th December 2021, 00:53
What kind of addressing conflict? I don't understand why this issue comes back every time.
When you said that if you change the IP address by just 1 number in either direction that the problem goes away, then there must be another device using that address (it might be hidden).
Maybe change ALL your IP address's, and see if that does anything.
Or you can try what is suggested in the post's just before this one..Safe Mode, some app running in the background causing havoc.
And if Atak isn't going to chime in, that's about all I can suggest.
Happy New Year.
phred1
7th January 2022, 07:20
Some app running in background is blocking Encoding Server. (Geforce Experience and so on)
Ahh, tnx! Is there any special procedure you can recommend for finding the blocking app? Feels I'm really lost here :(
Atak_Snajpera
7th January 2022, 16:50
Check Wait Chain option
https://superuser.com/questions/497621/what-is-the-analyze-wait-chain-in-task-manager
slalom
11th January 2022, 20:43
@Atak
Audio delay goes up to 10000ms
Sometimes that's not enough. Mkv merge can go higher but has no preview
Can you remove the delay limit on the next upgrade please?
GZZ
15th January 2022, 23:53
Any tried this, I did a conversion from Dolby Vision (Profile 7, Dolby Vision Dual layer) to Profile 8 (Dolby Vision Single Layer). Could be nice if this feature could be added into RipBot264.
https://forum.doom9.org/showthread.php?t=183479
I havent tried to use it on a encoding with cropping, but it should be possible to crop the RPU data before injecting it into the encoded MKV. So no need to do Dolby Vision encoding in x265 as its just extracted - Cropped - Injected into the final mkv file.
Ryushin
21st January 2022, 15:31
Any tried this, I did a conversion from Dolby Vision (Profile 7, Dolby Vision Dual layer) to Profile 8 (Dolby Vision Single Layer). Could be nice if this feature could be added into RipBot264.
https://forum.doom9.org/showthread.php?t=183479
I havent tried to use it on a encoding with cropping, but it should be possible to crop the RPU data before injecting it into the encoded MKV. So no need to do Dolby Vision encoding in x265 as its just extracted - Cropped - Injected into the final mkv file.
I very much would like to see this feature added. I've been wanting to work on adding the Dolby Vision stream with cropping. I saw a thread (https://hardforum.com/threads/authoring-dolby-vision-compatible-compliant-mp4-files-for-htpc-media-server-updated-01-09-2022.2012996/) about what is involved but I have not done more than reading at this point.
If this could be added to RipBot so the Dolby Vision stream is added along with the HDR10, that would be wonderful.
GZZ: How big was your Dolby Vision stream? I read it added several GB to the file size.
GZZ
22nd January 2022, 23:48
GZZ: How big was your Dolby Vision stream? I read it added several GB to the file size.
It is very small, like 65mb for at complete movie (2 hours) and it result in like 100mb with overhead. But bear in mind this is only single layer and dosnt include the secondlayer video track you find on the uhd, but I did a simple compare, really basic on my LG oled (b6) tv and took 2 image with my iphone ans its possible to see that the dynamic data of Dolby Vision does shine compared to HDR10.
Will upload them later today
Ryushin
23rd January 2022, 18:59
It is very small, like 65mb for at complete movie (2 hours) and it result in like 100mb with overhead. But bear in mind this is only single layer and dosnt include the secondlayer video track you find on the uhd, but I did a simple compare, really basic on my LG oled (b6) tv and took 2 image with my iphone ans its possible to see that the dynamic data of Dolby Vision does shine compared to HDR10.
Will upload them later today
That would be most appreciated. I'm going to look at working on this today. I do crop all my 4K encodes, so I'll have to go down that rabbit hole. If I can get this to work on my Sony Z9D with the Shield 2019, I'll re-rip all my DV discs and extract the DV track and mux it back into the MKVs I've already made.
Ryushin
23rd January 2022, 22:31
It is very small, like 65mb for at complete movie (2 hours) and it result in like 100mb with overhead. But bear in mind this is only single layer and dosnt include the secondlayer video track you find on the uhd, but I did a simple compare, really basic on my LG oled (b6) tv and took 2 image with my iphone ans its possible to see that the dynamic data of Dolby Vision does shine compared to HDR10.
Will upload them later today
So I think the cropping is actually quite easy. According to this:
https://github.com/quietvoid/dovi_tool/issues/39
I quote regarding turning on the crop option:
"It has no knowledge of the letterbox bars size, they are simply set to zero, to tell the Dolby Vision decoder that there are no letterbox bars encoded in the video."
So far I've created a Dolby Vision version of Transformers the Movie and Dune Part1. Transformers looked better, but Dune was dimmer. BTW, I'm one of those strange ones that likes the "Vivid" settings on a TV, and on the Z9D, Vivid is amazing. My problem is probably due to settings the Z9D is setting to display Dolby Vision. I'll dig into that more as I like to keep the Dolby Vision stream in my encodes.
Either way, the new DV tools are awesome in how easy they are to use. Could still use a bit more work so you can specify a location to pick up and store the RPU.bin file
Ryushin
23rd January 2022, 23:20
So far I've created a Dolby Vision version of Transformers the Movie and Dune Part1. Transformers looked better, but Dune was dimmer. BTW, I'm one of those strange ones that likes the "Vivid" settings on a TV, and on the Z9D, Vivid is amazing. My problem is probably due to settings the Z9D is setting to display Dolby Vision. I'll dig into that more as I like to keep the Dolby Vision stream in my encodes.
Looks like Sony has limited Dolby Vision to dark mode on on the Z9D and Sony F generation TVs. So HDR10 looks quite a bit brighter to me compared to DV. Such a shame. I'm going to keep digging to see if there is some kind of setting that I can use to increase the brightness.
Ryushin
24th January 2022, 14:21
Looks like Sony has limited Dolby Vision to dark mode on on the Z9D and Sony F generation TVs. So HDR10 looks quite a bit brighter to me compared to DV. Such a shame. I'm going to keep digging to see if there is some kind of setting that I can use to increase the brightness.
Actually, the more I dug into this, the more I found a lot of people complaining about the brightness of Dolby Vision regardless of the brand of TV. It seems that Dolby Vision is geared towards watching in a darkened environment as the cinematographer intended. The newer TVs have a DV Bright/Dark mode, but even then, people saying HDR10 is brighter.
The WAF (Wife Acceptance Factor) of DV is well... "Fix it and change it back the way you had it." Since there is no way to disable Dolby Vision in the Z9D, I guess I'll be keeping the HDR10.
At least there is now a way to easily extract the Dolby Vision Stream. Because the stream is so small, I may still extract the stream is store it for possible later use.
GZZ
26th January 2022, 12:40
My compared image, taken with Iphone 12pro, real life view.
TV: LG B6 OLED (2016 4k model)
Lensflare is visible as its daylight in the room and close to a window.
Its from the start of Indiana Jones UHD, uncompressed video where only the DV is converted from Profile 7 to Profile 8 in order to work on Apple TV.
HDR10: https://ibb.co/cx3Lw2C
DV: https://ibb.co/fSVCZpx
HDR10: https://ibb.co/GtjWr77
DV: https://ibb.co/s9VLh1G
I see much better control of britgtness on the DV on both image. Its clear how Static (HDR10) vs. Dynamic (DV) data can adapt to a single image.
I dont see what you talked about on brightness, might be the way Sony uses the DV data.
Ryushin
26th January 2022, 20:21
I see much better control of britgtness on the DV on both image. Its clear how Static (HDR10) vs. Dynamic (DV) data can adapt to a single image.
I dont see what you talked about on brightness, might be the way Sony uses the DV data.
Your images do seem to show the differences, especially the dancers.
I was reading in the thread you posted. Did you end up figuring out the crop function? Is it needed or not. I found one github issue that crop was needed, but reading that thread you provided, it seems it is not.
GZZ
26th January 2022, 22:22
Did you end up figuring out the crop function? Is it needed or not. I found one github issue that crop was needed, but reading that thread you provided, it seems it is not.
Got this answer: https://forum.doom9.org/showthread.php?p=1962181#post1962181
Dont know how to read it. But I think doing no crop on DV track and only crop reencode should be fine. Not sure what crop then is used for.
Ryushin
4th February 2022, 14:13
Hi Atak,
The script from https://forum.doom9.org/showthread.php?t=183479 works pretty well. At this point it looks fairly straightforward to add this capability to RB.
I know RB is your creation and you have been working on it for almost 15 years. Incredible really. I can understand if you are burnt out working on RB and have other things you would rather do. Can you give me your thoughts or why or why not you don't want to open source RB and put it up on Git.
gabbett1
11th February 2022, 12:46
When you said that if you change the IP address by just 1 number in either direction that the problem goes away, then there must be another device using that address (it might be hidden).
Maybe change ALL your IP address's, and see if that does anything.
Or you can try what is suggested in the post's just before this one..Safe Mode, some app running in the background causing havoc.
And if Atak isn't going to chime in, that's about all I can suggest.
Happy New Year.
I don't recall ever saying that if I go up 1 or down 1 on the IP and the problem goes away...
guest
12th February 2022, 00:59
I don't recall ever saying that if I go up 1 or down 1 on the IP and the problem goes away...
Hi gabbett1,
So I must have mis-interpreted this comment :-
One, if I enter the IP address of the host server, it will blank out the options for that server as if the IP is not allowed. If I change the IP by one digit in any direction, those options return. Are we no longer allowed to use the host computer as one of the distributed encoding processors?
So have you managed to get things working ???, it's been a while.
gabbett1
12th February 2022, 14:32
Hi gabbett1,
So I must have mis-interpreted this comment :-
So have you managed to get things working ???, it's been a while.
Ah, yes. All I was saying there is that the computer that is the host can no longer be used as also an encoder anymore apparently. The buttons will literally gray out for distributed encoding if I use the IP of the host computer (but only in the box for that IP, not all of the others). Now, as far as other computers to encode with, I cannot get any of them to connect.
Hopefully all that makes sense.
I don't have any IP conflicts.
No, it's still not working. I resorted back to not using distributed encoding for now. Then life happened... Sorry for the delay.
guest
13th February 2022, 04:17
No, it's still not working. I resorted back to not using distributed encoding for now. Then life happened... Sorry for the delay.
Hi, well, that's NOT good, the best part of RipBot IS the Distributed Encoding, if you can't get that to work you might as well be using Handbrake !!!!
There must be some simple solution, but it's almost impossible to diagnose using PM's with no screenshots or more detailed explanation.
I quite often have issue's, but you've just got to work thru it, 'til it works.
This is an interesting comment :- Then life happened...
Cheers
slalom
16th February 2022, 21:53
Ah, yes. All I was saying there is that the computer that is the host can no longer be used as also an encoder anymore apparently. The buttons will literally gray out for distributed encoding if I use the IP of the host computer (but only in the box for that IP, not all of the others). Now, as far as other computers to encode with, I cannot get any of them to connect.
Hopefully all that makes sense.
I don't have any IP conflicts.
No, it's still not working. I resorted back to not using distributed encoding for now. Then life happened... Sorry for the delay.
Maybe some application is blocking Encoding Server to start
guest
17th February 2022, 03:03
Maybe some application is blocking Encoding Server to start
Hi slalom,
They DID mention that they're running nVidia, but does "clean" setup.
I recall that certain Logitech app's play havoc, too.
Probably need way more info.
To do without RipBot's best feature for so long is BS.
It's certainly got nothing to do with RB updates, there haven't been any :(
guest
28th February 2022, 03:44
I may not have posted anything here in 5 months, but I have certainly kept track of any activity.
I have to say that I am very disappointed with Atak's absence, and lack of updates, these MANY months...
Anyway, I have been busy with updating & improving RipBot, trying to keep it current, and refreshed.
My last build was downloaded a LOT, but I pulled the plug after not getting any feedback, either positive or negative, but I won't pull it this time....
So this build is just the "Tool's" folder, so just as before, rename the original folder, and just copy & paste this in, and it's ready to go.
I strongly suggest that you go to the Avisynth folder under Tools, and run the 2 .cmd's... "Install dlls.bat" & "Install.bat"
Many new filters & options all available from the "Custom Script" drop down list.
The latest builds of all the main components, Avisynth, FFMPEG, x264, x265, etc, etc.
Some important "instruction's" are included, but maybe a little out-dated.
So go get it....
https://forum.doom9.org/showthread.php?p=1968792#post1968792
guest
1st March 2022, 01:46
I may not have posted anything here in 5 months, but I have certainly kept track of any activity.
I have to say that I am very disappointed with Atak's absence, and lack of updates, these MANY months...
Anyway, I have been busy with updating & improving RipBot, trying to keep it current, and refreshed.
My last build was downloaded a LOT, but I pulled the plug after not getting any feedback, either positive or negative, but I won't pull it this time....
So this build is just the "Tool's" folder, so just as before, rename the original folder, and just copy & paste this in, and it's ready to go.
I strongly suggest that you go to the Avisynth folder under Tools, and run the 2 .cmd's... "Install dlls.bat" & "Install.bat"
Many new filters & options all available from the "Custom Script" drop down list.
The latest builds of all the main components, Avisynth, FFMPEG, x264, x265, etc, etc.
Some important "instruction's" are included, but maybe a little out-dated.
So go it....
https://www.mediafire.com/file/6n3it679bleta6g/RipBot264v1.26.1+(28-02-22).7z/file
Great to see you make a return visit, this is awesome...thankyou :)
MCFish
2nd March 2022, 12:24
.........
https://www.mediafire.com/file/6n3it679bleta6g/RipBot264v1.26.1+(28-02-22).7z/file
Thanks
mcjordan
5th March 2022, 16:00
Thank you so much!
rlev11
7th March 2022, 20:05
I have been using ripbot for a while now to convert everything I have into 10bit x265 to load on my Plex server and have noticed something I can't figure out as I now work through doing stuff in 4K.
I have an encoding farm that consists of 3 5950x, 1 3950x, 2 3900x, 1 i9-10850k, 1 3700x, and a 5700g. Whenever I have done 480p,720p,1080p and also 4k movies in 1:2.35 aspect, the fps for each server scales like I would expect them to. the 16cores are faster than the 12, 12 faster than 10, 10 faster than the 8 core and the differences are what the additional cores should be, except when I encode 4k full frame either 1.85 or 1.78 aspect ratios.
When I do the full frame 4k, the performance drops like a rock on the 16 core 5950 and 3950 servers to the tune of 50 to 60 percent, where the 12 core 3900x machines are much faster fps compared to the 16 core. The 16 core servers are even slower on average than the two 8 core servers.
When looking at the encoding server utilization bar, on the 3900x, the green decoder bar is a constant 51-52 percent. On the 5950, the decoder bar bounces constantly between 50 and 80 percent (not sure if really means anything)
Anybody have any idea on why this is happening??
guest
17th March 2022, 05:44
Hi Atak,
I'm clutching at straws here, you haven't been posting much these days, but I noticed you posted a comment on another Forum a couple of days ago.
I have been trying to get AWB to work successfully with RipBot, and there are quite a few issues.
This is the script (but it's only for video)
#Custom
LoadPlugin("C:\RipBot264v1.26.1\Tools\AviSynth plugins\ffms\ffms_latest\x64\ffms2.dll")
LoadPlugin("C:\RipBot264v1.26.1\Tools\AviSynth plugins\GRunT\grunt.dll")
LoadPlugin("C:\RipBot264v1.26.1\Tools\AviSynth plugins\RgbAdapt\RgbAdapt_x64.dll")
LoadPlugin("C:\RipBot264v1.26.1\Tools\AviSynth plugins\RT_Stats\RT_Stats_x64.dll")
Import("C:\RipBot264v1.26.1\Tools\AviSynth plugins\scripts\extras\RGBAdapt_Awb_Process.avs")
video=RGBAdapt_AWB_Process(video)
And this one is suppose to do the audio as well :-
#Custom
LoadPlugin("D:\AWB\Lsmash\LSMASHSource.dll")
LoadPlugin("D:\AWB\GRunT\grunt.dll")
LoadPlugin("D:\AWB\RgbAdapt\RgbAdapt_x64.dll")
LoadPlugin("D:\AWB\RT_Stats\RT_Stats_x64.dll")
Import("D:\AWB\RGBAdapt_Awb_Process.avs")
LWLibavVideoSource("D:\AWB\nobody.mkv")
va=last
aa=LWLibavAudioSource("D:\AWB\nobody.mkv")
AudioDub(va,aa)
AWB_Func()
And one more option, if the above script is directly added to a new Job (instead of a video), it doesn't seem to use Distributed Encoding :(
And adding the "audio" script, it stalls at Demuxing, and that's it.
https://forum.doom9.org/showthread.php?t=174411&page=7
If you can have a look at this, that would be awesome, but I'll understand if you don't.
Regards
Atak_Snajpera
17th March 2022, 14:36
LWLibavVideoSource("D:\AWB\nobody.mkv")
va=last
aa=LWLibavAudioSource("D:\AWB\nobody.mkv")
AudioDub(va,aa)
AWB_Func()
Why do you add additional video source?
guest
17th March 2022, 14:53
LWLibavVideoSource("D:\AWB\nobody.mkv")
va=last
aa=LWLibavAudioSource("D:\AWB\nobody.mkv")
AudioDub(va,aa)
AWB_Func()
Why do you add additional video source?
It's actually a script I was given to extract the audio from that .mkv file.
But it didn't work, just stalled during demuxing (but I'd already said that)
If I only added this :-LoadPlugin("C:\RipBot264v1.26.1\Tools\AviSynth plugins\ffms\ffms_latest\x64\ffms2.dll")
LoadPlugin("C:\RipBot264v1.26.1\Tools\AviSynth plugins\GRunT\grunt.dll")
LoadPlugin("C:\RipBot264v1.26.1\Tools\AviSynth plugins\RgbAdapt\RgbAdapt_x64.dll")
LoadPlugin("C:\RipBot264v1.26.1\Tools\AviSynth plugins\RT_Stats\RT_Stats_x64.dll")
Import("C:\RipBot264v1.26.1\Tools\AviSynth plugins\scripts\extras\RGBAdapt_Awb_Process.avs")
video=RGBAdapt_AWB_Process(video)
There was no audio track, so that had to be demuxed, and added separately, once the video script had loaded.
Sorry there was an Lsmash script & an FFMS script.
But if this was loaded as a "Custom" file the script didn't alter the white balance, and the MPC-HC preview was just a flashing, flickering mess.
This is a sample of the MPC-HC preview (different source) :-
https://www.mediafire.com/file/rskh22ej7jwbxi8/VID_20220304_130802.mkv/file
LigH
18th March 2022, 08:54
AviSynth always decodes. You can't use AviSynth to demultiplex an audio stream preserving its encoded format. If you want to do that, you would need an external software like mkvextract or ffmpeg.
What you are doing in your script is loading and decoding the audio stream from possibly the same source file as the video, which should in general work well, except for corrupt source files. Here you could try to remultiplex it using mkvtoolnix or ffmpeg and see if they report an error. In case of audio streams, it may be useful to add a stream_index parameter to LwLibavAudioSource() to select a specific audio stream by number. If you use FFMPEGSource2() to load video and audio to one clip, note that its default value for atrack is -2, means to ignore audio streams.
Indexing an uncompressed or lossless audio format can take a long while and produce a huge index file. Do not get afraid when the process "stalls", this might be necessary when caching and indexing is enabled (by default it is). Once the index file is written, the next attempts to open the same script will be much faster.
guest
18th March 2022, 13:59
AviSynth always decodes. You can't use AviSynth to demultiplex an audio stream preserving its encoded format. If you want to do that, you would need an external software like mkvextract or ffmpeg.
What you are doing in your script is loading and decoding the audio stream from possibly the same source file as the video, which should in general work well, except for corrupt source files. Here you could try to remultiplex it using mkvtoolnix or ffmpeg and see if they report an error. In case of audio streams, it may be useful to add a stream_index parameter to LwLibavAudioSource() to select a specific audio stream by number. If you use FFMPEGSource2() to load video and audio to one clip, note that its default value for atrack is -2, means to ignore audio streams.
Indexing an uncompressed or lossless audio format can take a long while and produce a huge index file. Do not get afraid when the process "stalls", this might be necessary when caching and indexing is enabled (by default it is). Once the index file is written, the next attempts to open the same script will be much faster.
Thanks for your suggestions & advice :)
Yeah, the "video" section of the script works pretty well, but due to the way it has to be imported into RipBot, DE isn't initiated.
As for the "audio" section of the script, was I think, an afterthought suggestion from several different ppl.
I think the best way would be just to demux the video, and add the audio after the script has loaded.
Atak_Snajpera
18th March 2022, 15:03
Can't you just add video file normally instead of messing with script itself?
guest
19th March 2022, 02:22
Can't you just add video file normally instead of messing with script itself?
I thought I had explained why...
If you add a video file, then add this script, as a Custom script, the MPC-HC preview is crap, it flashes & flickers....and if you do do an encode, it turns out even worse :(
BUT, if you set up that script to load the movie you want to process, then the preview plays as it should, and the encode is good.
But there's NO audio, and Distributed Encoding isn't envoked, so it's just a single basic encode, which would take a LOT longer to process, especially if it was 4K, x265.
On the AWB Forum, there has been 3 ppl state that they have downloaded RipBot, ran the script, and it's good, BUT none of these 3 use RipBot, and probably think that if it works for them in basic encoding mode, then that's good enough to prove I don't know what I'm talking about...I'm sure if they knew more about RipBot, they would quickly realise that it doesn't work properly.
So that's why I posted on this forum.
I was hoping to call on your expertise, and figure out a way to get this to work, the "normal" way, as a Custom script.
If not, then it's the other procedure.
guest
27th March 2022, 07:29
Well, it's taken just under a month to reach a substantial 100 downloads of "my" updated build of RipBot, so I hope it's working well for all that have tried it.
I will endeavour to post an update in the next week or so, there has been several significant updates to the components that are used in RipBot.
So have at it, and keep watching :)
https://forum.doom9.org/showthread.php?p=1964827#post1964827
guest
27th March 2022, 07:45
I have been using ripbot for a while now to convert everything I have into 10bit x265 to load on my Plex server and have noticed something I can't figure out as I now work through doing stuff in 4K.
I have an encoding farm that consists of 3 5950x, 1 3950x, 2 3900x, 1 i9-10850k, 1 3700x, and a 5700g. Whenever I have done 480p,720p,1080p and also 4k movies in 1:2.35 aspect, the fps for each server scales like I would expect them to. the 16cores are faster than the 12, 12 faster than 10, 10 faster than the 8 core and the differences are what the additional cores should be, except when I encode 4k full frame either 1.85 or 1.78 aspect ratios.
When I do the full frame 4k, the performance drops like a rock on the 16 core 5950 and 3950 servers to the tune of 50 to 60 percent, where the 12 core 3900x machines are much faster fps compared to the 16 core. The 16 core servers are even slower on average than the two 8 core servers.
When looking at the encoding server utilization bar, on the 3900x, the green decoder bar is a constant 51-52 percent. On the 5950, the decoder bar bounces constantly between 50 and 80 percent (not sure if really means anything)
Anybody have any idea on why this is happening??
Hi rlev11, tbh I only just now saw your post....
That is one hell of a "farm" you've got going there !!!
OK, that IS strange behaviour, for sure, so you've obviously got Distributed Encoding sussed & working, so how many server ports do you enable per pc ???, maybe you need to "load" the 16 cores a bit more to get close to 100%.
I'm curious to know if you're using a "genuine" build of RipBot, or are you using the "Pauly Dunne" build ???
There is a possibility that the "older" Tool's in RipBot might be slowing you down....(just thinking out loud).
I have several Ryzen's, and they need to be "fed", but again, tbh, I haven't done much 4K encoding of late.
Might be a case of trial & error, 'til you get the results you should be getting !!!
Cheers
rlev11
27th March 2022, 19:42
Hi rlev11, tbh I only just now saw your post....
That is one hell of a "farm" you've got going there !!!
OK, that IS strange behaviour, for sure, so you've obviously got Distributed Encoding sussed & working, so how many server ports do you enable per pc ???, maybe you need to "load" the 16 cores a bit more to get close to 100%.
I'm curious to know if you're using a "genuine" build of RipBot, or are you using the "Pauly Dunne" build ???
There is a possibility that the "older" Tool's in RipBot might be slowing you down....(just thinking out loud).
I have several Ryzen's, and they need to be "fed", but again, tbh, I haven't done much 4K encoding of late.
Might be a case of trial & error, 'til you get the results you should be getting !!!
Cheers
Thanks for the reply. I am running 1.26.1 on all the machines. I had tried in the past running more than 1 port, but found that the combined fps for 2 ports was even lower than what 1 port was showing.
Since I posted that original message, I have found a "fix" so to speak. When I start up the 16 core machines in the startup script I added /affinity FFFCFFFC to the command line. This stops Ripbot from using one of the cores on CCD0 and CCD1. I did that to balance out the thermals on the die (seemed logical).
Once I did that my fps jumped back up to where I would expect them to be on the 16 core(now 14 cores used). Where before the 16 core would show 2-3 fps compared to the 3900x around 4 fps, the 5950x's are now in the 5-7 fps. Disabling the 2 cores didn't seem to make much of a difference either in the lower resolution stuff so I just leave them running 14 core for Ripbot all the time.
Still not sure what is being flooded that kills the performance only on full frame 4k, but for now I am happy. Only thing that is a little strange is since I did this I see a stalled encoding server a little bit more often, but the server resets and continues on without messing up the entire encode. Full frame 4k in 10bit X265 with some Mdegrain3 for minor cleanup ends up averaging around 40fps and a movie can be done in under an hour, works for me...
rlev11
28th March 2022, 16:30
Hi, well, that IS strange behaviour alright, and it's only happening on the 5950's & the 3950 ??
So, I'm curious, what motherboards are you running, are they all the same ??, are you running the latest BIOS & AMD Chipset drivers ??
Also, where did you come up with the /affinity FFFCFFFC "fix" ??, I might have to remember that..lol.
And you say full frame @ 40fps, in under an hour, what other settings are you using ??
I know you have some serious encoding "horse power" there, and that's some pretty impressive encoding times.
And this, "....I see a stalled encoding server a little bit more often....", it seems to be a "thing" with RipBot, unfortunately.
Yes, only on the 3950 and 5950's. the 12,10 and 8 core machines all behave themselves and the fps are what I would expect. From 480p all the way thru full frame 4k they scale out with similar percentage differences in fps. The same with the 16 cores EXCEPT once I hit full frame 4k using all 16 cores.
the 16 cores are all running on a mixture of gigabyte and asus x570 motherboards with the latest bios installed and also windows 11 with the latest amd drivers. All are running 32 gig ddr3200 memory in XMP mode. The rest are running B450 or B550 chipsets, latest bios and drivers, and the lone intel is running on a Z490.
When I saw and researched the /affinity switch for the encoding server command line, my first thought was OK, lets knock them down to 12 core 3900x levels and see what happens. They immediately jumped to 3900x performance or just a tad over. so I added in 2 more cores to their current level of running 14 cores for ripbot. I used this site to give me the hex code to use:
https://bitsum.com/tools/cpu-affinity-calculator/
I start each encodong server with this script:
encodingserver /minimize /restart-if-no-progress /affinity FFFCFFFC /priority normal
As far as settings in ripbot using MA10-default,default profile, Mode=CQ, CRF=18. Audio I usually knock dts down to ac3 or just copy the stream if it is already in ac3 or aac. This way my Plex server can play everything in direct stream with no encoding. In avisynth tab I just do a autodetect crop, then a cpu denoise of mdegrain3 and do somewhere between 100 and 400 depending on the noise level (grain noise just bugs me for some reason). I'll also render any forced subs if they exist. Helps to throw 212 threads at an encode. The under an hour was for a 1 hour 4k TV show I've been doing lately
guest
11th April 2022, 02:42
Has anyone contemplated, or is using, an nVidia Tesla GPU card(s) with RipBot for OpenCL & CUDA filters ???
Glarioo
18th April 2022, 07:33
In this small package, there is :-
the lastest L-Smash, MKVToolNix, and another de-interlacing filter. (CQTGMC, thanks to Ceppo)
https://www.mediafire.com/file/51e0k76pdfyozzm/Tools+(13-04-22).7z/file
Once the 7z is unpacked, it should be plain to see where they need to be copied to, and just overwrite the existing folders / files.
Cheers
Thank you for the update, Pauly. Much appreciated.
jfisher1740
19th April 2022, 02:47
In this small package, there is :-
the lastest L-Smash, MKVToolNix, and another de-interlacing filter. (CQTGMC, thanks to Ceppo)
https://www.mediafire.com/file/51e0k76pdfyozzm/Tools+(13-04-22).7z/file
Once the 7z is unpacked, it should be plain to see where they need to be copied to, and just overwrite the existing folders / files.
Cheers
Big thank you Pauly! I took about a 9 month hiatus from RipBot and was surprised that it didn't update when I launched it earlier this week. Just installed all your updates and it worked flawlessly. Running in DE mode and I did not update the DE servers. No issues.
guest
19th April 2022, 04:57
Thank you for the update, Pauly. Much appreciated.
Thankyou for the thankyou :)
guest
19th April 2022, 05:03
Big thank you Pauly! I took about a 9 month hiatus from RipBot and was surprised that it didn't update when I launched it earlier this week. Just installed all your updates and it worked flawlessly. Running in DE mode and I did not update the DE servers. No issues.
Hi, yes it's pretty sad that "official" update's seem to be a thing if the past :(
Don't forget to disable Auto Updates, it will mess up these builds !!!
Good to hear that DE is working for you, I checked some of your previous posts, and most of them where DE issues...hope it stays working for you.
And thankyou for the thankyou :)
ReinerSchweinlin
20th April 2022, 20:52
Has anyone contemplated, or is using, an nVidia Tesla GPU card(s) with RipBot for OpenCL & CUDA filters ???
yes,
K80
K40
M40
Grid 520
......
As long as you can set the card to WDDM Mode, you can use it for almost anything (Direct X, Vulkan, etc..)... OPENCL and CUDA are also available in Compute Mode (wich is slightly faster)... Some of the vrey new and big cards only have CUDA (Ampere datacenter ones) and some rare ones are "hard to fiddle" because they only offer certain drivers (some Kepler Grid ones), but for the most part - the stuff that appears on ebay works fine....
guest
21st April 2022, 02:26
yes,
K80
K40
M40
Grid 520
......
As long as you can set the card to WDDM Mode, you can use it for almost anything (Direct X, Vulkan, etc..)... OPENCL and CUDA are also available in Compute Mode (wich is slightly faster)... Some of the vrey new and big cards only have CUDA (Ampere datacenter ones) and some rare ones are "hard to fiddle" because they only offer certain drivers (some Kepler Grid ones), but for the most part - the stuff that appears on ebay works fine....
Good to know, I am running K20Xm's, 14 Compute Units, 2688 Cuda Cores.
So with the Dual GPU cards (eg:- K80), do you assign one GPU per port in DE ??
Or can you assign both GPU's to the same port, as to get the maximum assistance from the nearly 5000 Cuda Cores ??
ReinerSchweinlin
21st April 2022, 15:24
The K80 is presented to the system as two seperate GPUs. Since Ripbot is only able to adress one, you wont be much faster than with the K20x.... In theory, it would be possible to use both at the same time, but often the overhead of splitting the workloads into two chunks and moving it over the PCI_E Bus destroys the advantage... The lesser data, the more computation, the better the benefit (blender render is almost twice the speed for example)... So the more demanding the filter is, the more benefit from two cards (realsr vulkan implemenatation shows that quite nice.. up to four cards at the same time can be used).
A M40 would speed up things compared to the K20x.
If you donīt HAVE to use Grid/Tesla.... GCN Cards are quite strong in OPENCL... A used R9 Fury is around the same price.-tag as a M40 and is a lot stronger in OPENCL computation... (take a look at geebench opencl resukt browser to get a rough estimate)
In addition: Unless you have a lot of CPU power, often the Encode-Part is the bottleneck (at least when doins x265 slow or better)...
one thing you could try: Set the card to compute mode and turn of ECC, might squeeze out some speed :)
guest
22nd April 2022, 01:38
The K80 is presented to the system as two seperate GPUs. Since Ripbot is only able to adress one, you wont be much faster than with the K20x.... In theory, it would be possible to use both at the same time, but often the overhead of splitting the workloads into two chunks and moving it over the PCI_E Bus destroys the advantage... The lesser data, the more computation, the better the benefit (blender render is almost twice the speed for example)... So the more demanding the filter is, the more benefit from two cards (realsr vulkan implemenatation shows that quite nice.. up to four cards at the same time can be used).
A M40 would speed up things compared to the K20x.
If you donīt HAVE to use Grid/Tesla.... GCN Cards are quite strong in OPENCL... A used R9 Fury is around the same price.-tag as a M40 and is a lot stronger in OPENCL computation... (take a look at geebench opencl resukt browser to get a rough estimate)
In addition: Unless you have a lot of CPU power, often the Encode-Part is the bottleneck (at least when doins x265 slow or better)...
one thing you could try: Set the card to compute mode and turn of ECC, might squeeze out some speed :)
Hi Reiner, thanks for the great reply & info.
Actually the main reason I wanted to try some Tesla's is that my "best" GPU, an MSI 1080 Gamer X, stopped working, and then I saw some YouTube clips of guys using these Tesla cards for gaming & transcoding, and as the price of new & used GPU's has been so high, you could get certain Tesla cards for cheap, so I opted for a K20Xm.
I did ask around about encoding with these, and got the big "thumbs down", saying they were no good for that, but I needed to find out for myself.
I was mainly after the CUDA functionality, not the OpenCL, and after a far bit of "testing" RipBot was using it for both.
Even though RipBot has no "default" CUDA filters !!
So, you mentioned that the K80 was recognised as 2 GPU's, and that RipBot could only address 1...you must be relying on the info under the OpenCL tab, as it does ONLY show 1 device at a time, even if you have 2 GPU's.
I have a couple of systems that have an AMD & nVidia GPU, and the only way you can use both with RipBot is the following command(s)..(in the RipBot264.ini file)
This one assigns 1 GPU per encoding port...
Server1CommandLine=/port 1000 /minimize /priority normal /restart-if-no-progress /x264-opencl-device-id 0 /knlmeanscl-opencl-device-id 0
Server2CommandLine=/port 2000 /minimize /priority normal /restart-if-no-progress /x264-opencl-device-id 1 /knlmeanscl-opencl-device-id 1
Not sure if this one would work, trying to assign both GPU's to the same port, which would be great for a K80, for example.
Server1CommandLine=/port 1000 /minimize /priority normal /restart-if-no-progress /x264-opencl-device-id 0 /knlmeanscl-opencl-device-id 0 /x264-opencl-device-id 1 /knlmeanscl-opencl-device-id 1
But that may only work for OpenCL, not CUDA.
I also have no idea how to do this :-
one thing you could try: Set the card to compute mode and turn of ECC, might squeeze out some speed
ReinerSchweinlin
22nd April 2022, 11:33
Hi Reiner, thanks for the great reply & info.
Actually the main reason I wanted to try some Tesla's is that my "best" GPU, an MSI 1080 Gamer X, stopped working, and then I saw some YouTube clips of guys using these Tesla cards for gaming & transcoding, and as the price of new & used GPU's has been so high, you could get certain Tesla cards for cheap, so I opted for a K20Xm.
I used to have some K20x as well and used them for all kinds of computation, gaming, etc... (whenever I get them running, my curiosity is satisfied, so no long time usage, only "testing" to see what is possible...). Being Kepler Generation, the K20x donīt support the newest versions of everything, but most stuff still works up to the point when Nvidia dropped support a while ago...
I did ask around about encoding with these, and got the big "thumbs down", saying they were no good for that, but I needed to find out for myself.
Using NVENC is certainly possible with these, although they only support an older version... For streaming in h264, its usable, but for video its not really worth it... Even the newest generations of the nvidia encoders can not compete with x265... They are fast, yes.... h265 support in the K20 is not worth it, I think its even missing.... I could talk a lot about the nvenc part, but better head over to the thread of "current state of hardware encoding"... more info there... Plex cheat sheet (google it) and wikipedia also have all the info you need. Bottom line: Encoding is not worth it with the k20..
But using them as a computation device for filters (in ripbot or whatever..) they are fine... Not the fastest, of course, but for the money, they work good and provide more VRAM than the consumer GTX counterparts..
I was mainly after the CUDA functionality, not the OpenCL, and after a far bit of "testing" RipBot was using it for both.
Nice :)
So, you mentioned that the K80 was recognised as 2 GPU's, and that RipBot could only address 1...you must be relying on the info under the OpenCL tab, as it does ONLY show 1 device at a time, even if you have 2 GPU's.
yes, the system acts as if two cards were installed.. To use two cards at the same time, the filter implementation has to be build for that as well as the program calling it... Its possible to use OPENCL with multiple compute units, but its not implem,ented in ripbot and the filters in use (at least to my knowledge) wouldnīt support it anyways... Iīd drop the thought of a K80 - for the same price, a M40 offers the much better value (being one GPU being faster than the two Kepler ones on the K80, offering 24GB variants and being Maxwell 2.0 which supports more modern CUDA stuff..)..
I have a couple of systems that have an AMD & nVidia GPU, and the only way you can use both with RipBot is the following command(s)..(in the RipBot264.ini file)
This one assigns 1 GPU per encoding port...
Not sure if this one would work, trying to assign both GPU's to the same port, which would be great for a K80, for example.
We have to differentiate here... There is an old OPENCL "Boost" for x264 which ripbot still offers... Here some of the computation done in x264 is offloaded to a OPENCL device.. This only makes sense in scnearios, where the CPU is not very powerful, the bandwith is not bottlenecking and where some of the power of the CPU is needed for other stuff... It doesnt use NEVCN, it just seperates the computation (If I remember, motion estimation is done in OPENCL... might remember wrong...)... In most of the times, the speedup is not there compared to "pure CPU encoding", do some measuerements to see it... The newer the CPU, the lesser the benefit (on a Ryzen 5 3600 with a M40, I did not gain anything...).... So plamning to get a bigger GPU in order to speedup Encoding in x264 probably is not worth it - rather spend some money on a bigger CPU (or more cores)...
x265 does not offer this kind of technique - it was investigated, but since the computation is even more complex and the type of math used here is not very suitable for a GPU, its not done in x265 back then by the developers, the idea was dropped... Some newer developments of direct memory access for GPUs and offloading motion estimation (read up Intel AI SDK news on developer forums) might give this idea a new live, but so far, x265 is best on a lot of CPU cores :)
The second thing is using filters with GPU acceleration... This makes sense... IF the Filter is capable of using more than one GPU and the GUI is able to call it, then it will work - but again, most of whats under the hoodd of ripbot is not capable of splitting workloads... If using multiple filters, doing one on GPU1 and the other on GPU2 COULD work, but then you have the Bandwith Bottleneck of movniog stuff over the PCIE BUS... (the K80 Chips canīt "talk" to each other directly, no SLI or similar awareness here...
Bottom line - its much easier to get ONE bigger GPU - and much more promising in terms of "getting faster"..
But that may only work for OpenCL, not CUDA.
I also have no idea how to do this :-
OPENCL, CUDA; VULKAN, DirectML, etc... all have the possibility to use multiple GPUs... But its no automatism.... In most cases, using already compiled filters you are out of luck using more than one GPU for one filter (at least as far as I know - have been tinkering with stuff like this for a long time...) If someone knows of an easy hack - Iīd be glad to hear about it (giving my GRID GPUs some more usability...)
Danette
27th April 2022, 04:55
Which version is the last to be able to handle Avisynth+ 32-bit?
guest
27th April 2022, 09:24
Which version is the last to be able to handle Avisynth+ 32-bit?
v1.20.0...
http://www.digital-digest.com/software/RipBot264_history.html
VirulentPip
28th April 2022, 15:55
Hey, I have Ripbot on a Windows 10 PC and Windows 11.
The Windows 10 PC is where I'd want most of the brute force coming from, I can get encodings going from the Windows 10 PC and also from the windows 11 PC using the windows 10.. However what I cannot get working is adding in the Win11 PC to add to the power when I want to. I double click the EncodingServer exe, however no GUI opens, it goes to Task Manager but nothing to show to be able to actually "run" I've restarted the PC but still no luck, currently RipBot is situated on my D Drive, would I need to have it on C Drive for the EncodingServer to open properly? Or is it a Win 11 issue?
Thanks.
Edit - Turns out GeForce Experience was stopping it.. Was the only difference between the machines and the server popped up as soon as it was uninstalled.
Atak_Snajpera
28th April 2022, 16:09
Run Win11 in safe mode and check if EncodingServer opens.
Ryushin
28th April 2022, 17:51
So I upgraded my server using a used Supermicro motherboard and I ordered two Xeon E5-2680 V4 (14 cores) processors for it from Ebay. Got everything installed on Tuesday.
I configured my virtual machine with to use 24 cores and two threads for a total of 48 CPU threads. Gave the VM 32GB of RAM as well. I am not using NUMA.
Run the x265 Benchmark and received a score of 59.2 so I was happy with this.
Received Moonfall in 4K from Amazon and I proceeded to add it to RB. Noticed i would have to do a bit of degraining and enabled MDegrain2 with a THSAD value of 200. Started the encoding with two servers and was amazed at how slow the encoding went and how it was not utilizing the CPU.
So I did a test encoding with no MDegrain2 and it was fast. So most likely it was the threading problem with MDegrain2. My "Use multiple processing threads" setting was set to the default of 0 which I think means use a thread for each CPU thread which would be 48.
So I ran some tests by lowering the number of threads used for MDegrain2 and the results were dramatic:
1 Minute Chunk Size, First Chunk, 1 Encoding Server
No MDegrain - 6.38 fps (CPU running about 45-85%)
MDegrain2 48 threads (0 for unlimited) - 1.27 fps
MDegrain2 24 threads - 1.29 fps
MDegrain2 18 threads - 2.31 fps
MDegrain2 15 threads - 4.36 fps
MDegrain2 14 threads - 4.44 fps
MDegrain2 13 threads - 4.38 fps
MDegrain2 12 threads - 4.15 fps
MDegrain2 10 threads - 3.62 fps
1 Minute Chunk Size, First and Second Chunk, 2 Encoding servers
No MDegrain - 4.17 and 12.13 fps = 16.30 fps (CPU running about 92-100%)
MDegrain2 15 threads - 3.05 and 3.62 fps = 6.67 fps
MDegrain2 14 threads - 3.18 and 4.22 fps = 7.40 fps
MDegrain2 13 threads - 3.26 and 3.96 fps = 7.22 fps
So I hope this helps someone who has a highly threaded setup and that you will probably have to tune the MDegrain2 thread settings for each machine.
blacksapprow
28th April 2022, 22:14
I am waiting for AV1 codec support in RipBot!
https://www.tomshardware.com/news/intel-av1-encoder-for-cpus
@Atak_Snajpera please look to the bottom link: :helpful:
https://gitlab.com/AOMediaCodec/SVT-AV1/-/releases/v1.0.0
VirulentPip
28th April 2022, 22:41
Quick questions
1. Is it possible to hardcode subtitles
2. Is it possible to set Default audio track
Only started using today, noticed on first encode that both tracks were set as default so have to go into mkvtoolnix to adjust that post encode, so would be nice if there's something I'm missing so don't have to have an unnecessary process.
Atak_Snajpera
28th April 2022, 22:45
1. Avisynth script -> permanent subtitles
2. Not implemented yet. Will take a look.
VirulentPip
29th April 2022, 20:25
Would it work if I add an Intel CPU (i5 12600K) to the distributed encoding which currently has 2x AMD CPUs (3900x as primary and 5800x when not gaming)
Atak_Snajpera
30th April 2022, 00:47
You can add any pc as long as it runs on Windows OS.
VirulentPip
2nd May 2022, 10:08
After encoding I get *ERROR* next to the jobs with an Error Text File. Output is fine and cannot see anything in the text that would indicate error
D:\Movies\47 Ronin (2013) Remux-1080p>"C:\Ripbot\EncodingClient.exe" "D:\Temp\RipBot264temp\job1\job1_EncodingClient.meta"
mkvmerge v61.0.0 ('So') 64-bit
'D:\Temp\RipBot264temp\job1\video.265': Using the demultiplexer for the format 'HEVC/H.265'.
'D:\Temp\RipBot264temp\job1\2_audio_English_DEFAULT.ac3': Using the demultiplexer for the format 'AC-3'.
'D:\Temp\RipBot264temp\job1\1_audio_English.ac3': Using the demultiplexer for the format 'AC-3'.
'D:\Temp\RipBot264temp\job1\video.265' track 0: Using the output module for the format 'HEVC/H.265 (unframed)'.
'D:\Temp\RipBot264temp\job1\2_audio_English_DEFAULT.ac3' track 0: Using the output module for the format 'AC-3'.
'D:\Temp\RipBot264temp\job1\1_audio_English.ac3' track 0: Using the output module for the format 'AC-3'.
The file 'D:\Video\47 Ronin (2013) Remux-1080p_new.mkv' has been opened for writing.
'D:\Temp\RipBot264temp\job1\video.265' track 0: Extracted the aspect ratio information from the video bitstream and set the display dimensions to 1920/1080.
The cue entries (the index) are being written...
Multiplexing took 8 seconds.
-------------------------
Elapsed Time: 01h:33m:08s
Jake802
3rd May 2022, 23:33
Anybody have any ideas as to what would cause my subtitles to no longer work, when making an AVCHD Disc? It appears to only happen when I want to do AVCHD and They load and then nothing shows up for the preview window
VirulentPip
4th May 2022, 09:02
What causes this to happen? It's starting to get very annoying. It's very hit and miss and I cannot seem to figure out what would cause it. Was hoping to have all queued encodes done over night but this one was hung on this "Incomplete" chunk till I shutdown the server and it was allocated to another.
TCP Communication is repeating the same thing over and over Encoding_Process > 99.7% 1462/1466 frames 8.32fps then a few other bits I cannot read as it goes so fast but says Client > Server OK
Main says it encoded all 1466 frames for chunk 43.
https://imgur.com/2EnB5K6
Atak_Snajpera
4th May 2022, 10:55
Check if ffmpeg.exe and x264_x64.exe/x265_x64.exe is stil present in taskmanager
Anybody have any ideas as to what would cause my subtitles to no longer work, when making an AVCHD Disc? It appears to only happen when I want to do AVCHD and They load and then nothing shows up for the preview window
Hi Jake802,
You haven't posted here for nearly 3 years....
So you say that they load, but nothing shows in the preview window, but what if you go ahead & just process it (you could add the subtitles later, using MKVToolNix) if it didn't work..
No idea why subtitles would just stop working, there must be a problem somewhere else....if you are running the latest available build of RipBot, nothing has significantly changed with that for well over 9 months :( So it probably isn't that...
Maybe you could try Pauly Dunne's build, and see if that makes any difference.
VirulentPip
4th May 2022, 11:44
Check if ffmpeg.exe and x264_x64.exe/x265_x64.exe is stil present in taskmanager
Underneath the Encoding Server process is Ffmpeg and a windows command processor processes.
The "incomplete" chuck issue has occurred a further 3 times since my post.
Atak_Snajpera
4th May 2022, 12:05
So encoding Has finished but encoding processes did not terminate? Post screenshots showing what you see.
VirulentPip
4th May 2022, 12:55
So encoding Has finished but encoding processes did not terminate? Post screenshots showing what you see.
https://imgur.com/5gk0xg3
Tried adding this before but nothing was appearing.
The screenshot of the EncodingServer "Main" didn't save unfortunately.
But it was as if the encoding was done at the bottom would be for example 1466/1466 but still in "Encoding" mode and the TCP window be repeating 1462/1466.
Jake802
4th May 2022, 14:15
Thank you. I haven't had any issues or need to post anything. So I can use this MKVToolNix to add files to my AVCHD once it's done in RipBot?
Thank you. I haven't had any issues or need to post anything. So I can use this MKVToolNix to add files to my AVCHD once it's done in RipBot?
You certainly should be able to...the main movie file in an AVCHD if I recall is an .m2ts... that should load into MKVToolNix, you can then add / remove other audio & subtitle tracks, (simply drag n drop) and let it do it's thing.
You can use the version within RipBot264 Tools folder (but it's old), so I would suggest you go here :- https://www.fosshub.com/MKVToolNix.html & grab the "installer" MKVToolNix Windows installer (64-bit), and you're set.
edit:- I just realised that this will produce an .mkv file, if you want to maintain the .m2ts format for the AVCHD, you will need to use Tsmuxer to add the subtitle track(s).
Get the latest here :- https://www.videohelp.com/software/tsMuxeR
I have very rarely used RipBot to "do" subtitles !!!!
Atak_Snajpera
4th May 2022, 21:56
https://imgur.com/5gk0xg3
Tried adding this before but nothing was appearing.
The screenshot of the EncodingServer "Main" didn't save unfortunately.
But it was as if the encoding was done at the bottom would be for example 1466/1466 but still in "Encoding" mode and the TCP window be repeating 1462/1466.
I would like to see screenshot of process hacker showing what processes are still in memory when this issue appears.
alexflin
6th May 2022, 20:19
Hi, I need help, I'm using this program https://prnt.sc/kFn4wSDzIMNh to encode my videos getting UHD compatibility, can I add the same commands to ripbot264 to encode multiple videos in batch mode?
Hi, I need help, I'm using this program https://prnt.sc/kFn4wSDzIMNh to encode my videos getting UHD compatibility, can I add the same commands to ripbot264 to encode multiple videos in batch mode?
Welcome,
So what app is that screen shot of ??
You might be able to create your own custom x265 "profile" within RipBot, and add some of those commands shown, but it might be a bit "hit and miss" until you get what you want.
For info on command options go here :-
https://x265.readthedocs.io/en/master/cli.html
You can access the profile folder within the main RipBot264 folder, then go to the hevc folder, and you will find the default profiles.
RipBot is pretty good at figuring out what the source files are, and also x265 would figure out it's own settings, depending on the content.
As for HDR, RipBot handles that pretty well, but again, depending on the input content, you can't make something HDR, if it's not there to start with (afaik).
A lot of ppl convert HDR to SDR, which RipBot can do too.
I would suggest just trying a few options, and see how it goes, but there is ALWAY's room for improvement.
Good luck.
alexflin
8th May 2022, 01:20
Welcome,
So what app is that screen shot of ??
You might be able to create your own custom x265 "profile" within RipBot, and add some of those commands shown, but it might be a bit "hit and miss" until you get what you want.
For info on command options go here :-
https://x265.readthedocs.io/en/master/cli.html
You can access the profile folder within the main RipBot264 folder, then go to the hevc folder, and you will find the default profiles.
RipBot is pretty good at figuring out what the source files are, and also x265 would figure out it's own settings, depending on the content.
As for HDR, RipBot handles that pretty well, but again, depending on the input content, you can't make something HDR, if it's not there to start with (afaik).
A lot of ppl convert HDR to SDR, which RipBot can do too.
I would suggest just trying a few options, and see how it goes, but there is ALWAY's room for improvement.
Good luck.
Thanks for the help, this app is integrated in the Blu-Disc Studio HD, they recomend use this app to make compatible the video files with the program. I'm using the 30 days trial to create all the UDH blurays with menu of my favourite tv shows
Hey,
Have been busy again updating most of the SMDegrain filter's, re-instated a few "older" filters.
Updates for a few "key" item's. etc, (changelog included)
Please note, this is a Tools folder replacement, so rename your existing Tools folder (just in case), and if you've modified any scripts.
ALL previous update links will be removed, as they are all in this build.
So go get it :-
The link that was here, is now obsolete, go here for the latest build..
https://forum.doom9.org/showpost.php?p=1969982&postcount=19510
And I would like to thank the 161 ppl that downloaded the previous Tools folder download back in February, and the many that also downloaded the 3 other update files.
And the few that provided very positive feedback :)
VirulentPip
10th May 2022, 13:27
Hey,
Have been busy again updating most of the SMDegrain filter's, re-instated a few "older" filters.
Updates for a few "key" item's. etc, (changelog included)
Please note, this is a Tools folder replacement, so rename your existing Tools folder (just in case), and if you've modified any scripts.
ALL previous update links will be removed, as they are all in this build.
So go get it :-
https://www.mediafire.com/file/1363bejqfy3gtsj/Tools+(08-05-22).7z/file
And I would like to thank the 161 ppl that downloaded the previous Tools folder download back in February, and the many that also downloaded the 3 other update files.
And the few that provided very positive feedback :)
Haven't updated with this latest one yet.. But since using your version, I've had 1 "incomplete" chunk in now well over 60 encodes maybe even more. Has made life easier knowing can just queue up a bunch over night knowing that the chances of them being completed by morning are now very very high. Thanks again.
Atak_Snajpera
10th May 2022, 15:14
Haven't updated with this latest one yet.. But since using your version, I've had 1 "incomplete" chunk in now well over 60 encodes maybe even more. Has made life easier knowing can just queue up a bunch over night knowing that the chances of them being completed by morning are now very very high. Thanks again.
You may try this workaround
EncodingServer.exe /restart-if-no-progress
Encoding will be restarted if there is no progress within 1 minute.
guest
11th May 2022, 00:47
Haven't updated with this latest one yet.. But since using your version, I've had 1 "incomplete" chunk in now well over 60 encodes maybe even more. Has made life easier knowing can just queue up a bunch over night knowing that the chances of them being completed by morning are now very very high. Thanks again.
Hi, that IS a very high success rate, I would be extremely happy with that :)
I use to encode overnight, back in the day, but nearly every time there would be a failure, while I was asleep, so I didn't bother doing that anymore, just wasn't worth it...
So thanks for the great feedback..
Cheers
guest
11th May 2022, 00:51
You may try this workaround
EncodingServer.exe /restart-if-no-progress
Encoding will be restarted if there is no progress within 1 minute.
Yeah, I'm afraid to say that this doesn't always work...I have been using this command for a long time, and if a chunk doesn't want to co-operate, it won't, you generally need to abort the encode, and hope that that faulty chunk gets encoded next time.
VirulentPip
12th May 2022, 12:32
Is there anything I can do to force the Encoding Client to open on a secondary monitor? Whenever a new encode starts it always re-opens on Primary Display, even when using software such as UltraMon (free trial) UltraMon works fine for RipBot (main) but not the Encoder Client or Server windows.
The reason I ask is that I have the Encoding Client on my Gaming PC as I have a very high TBW NVME drive on here and I like to have the Ripbot stuff open on a second monitor. However when a new one starts the Encoding Client will either minimise the game if in Fullscreen or appear on top if in Windowed Borderless, it doesn't appear on top if keep the Encoding Client on Primary Monitor while in Windowed Borderless.
guest
15th May 2022, 02:50
Is there anything I can do to force the Encoding Client to open on a secondary monitor? Whenever a new encode starts it always re-opens on Primary Display, even when using software such as UltraMon (free trial) UltraMon works fine for RipBot (main) but not the Encoder Client or Server windows.
The reason I ask is that I have the Encoding Client on my Gaming PC as I have a very high TBW NVME drive on here and I like to have the Ripbot stuff open on a second monitor. However when a new one starts the Encoding Client will either minimise the game if in Fullscreen or appear on top if in Windowed Borderless, it doesn't appear on top if keep the Encoding Client on Primary Monitor while in Windowed Borderless.
Hi, I used to use multiple monitors, back in the day, but not anymore, so I can't really help...however, have you tried other app's ??
Maybe Multimon trial version hasn't got all it's features enabled..
Have you heard of, or tried Display Fusion Pro ??
Good luck.. (sent you a PM)
guest
15th May 2022, 05:30
I have been doing a couple of encodes today (1st time, in a LONG time), and to anyone that is using "my" build's and using ANY of the SMDegrain filters might see very slow, and low CPU usage, encodes.
So please check how you've got this setup...
https://i.imgur.com/NQoaeu9.jpg
Note:- I'm running an AMD Ryzen 5950X, hence the 32 cores setting, but I think it will "self adjust" if you're using less cores.
Before changing these, the CPU usage was VERY low, so a little trial and error might be needed to get your system working to it's maximum.
Ryushin
16th May 2022, 19:30
I have been doing a couple of encodes today (1st time, in a LONG time), and to anyone that is using "my" build's and using ANY of the SMDegrain filters might see very slow, and low CPU usage, encodes.
Hi Pauly Dunne,
I've set up your tools folder and started testing the SMDegrain over the weekend. Just wanted to add the SMDegrain needs to be added to the filter list and it works after that. I also have to turn off Auto Updates because Atak's immediately overwrites some of the files. In addition I had to upgrade my encoding servers to your build as well in order to work.
I've just started to look into the options for SMDegrain to tune it to my needs. I'm curious about the main differences in your script names. What does the "E-H" mean? I should also note that your scripts call "SMDegrain 350d.avs" which uses CUDA. Since I don't have an NVidia card, I've been modifying the scripts to use "SMDegrain 350d cpu.avs".
Right now the the tests I've run as follows:
Source: Invasion of the Body Snatchers 4K - First 15 Minutes
CQ 18
No Degraining: 7.4 GB
MDegrain2 thSAD=400: 2.9 GB
MDegrain3 thSAD=600: 2.4 GB
SMDegrain E-H std: 5.7 GB
SMDegrain E-H BM3D CPU: (too slow: .28 fps)
SMDegrain E-H KNL: (does not work, probably needs GPU)
SMDegrain Hard std: 6.3 GB
I'll dig into it further to tune SMDegrain for heavier degraining, because as of right now, plain MDegrain2 is giving me a much smaller file size.
guest
16th May 2022, 23:23
Hi Pauly Dunne,
I've set up your tools folder and started testing the SMDegrain over the weekend. Just wanted to add the SMDegrain needs to be added to the filter list and it works after that. I also have to turn off Auto Updates because Atak's immediately overwrites some of the files. In addition I had to upgrade my encoding servers to your build as well in order to work.
I've just started to look into the options for SMDegrain to tune it to my needs. I'm curious about the main differences in your script names. What does the "E-H" mean? I should also note that your scripts call "SMDegrain 350d.avs" which uses CUDA. Since I don't have an NVidia card, I've been modifying the scripts to use "SMDegrain 350d cpu.avs".
Right now the the tests I've run as follows:
Source: Invasion of the Body Snatchers 4K - First 15 Minutes
CQ 18
No Degraining: 7.4 GB
MDegrain2 thSAD=400: 2.9 GB
MDegrain3 thSAD=600: 2.4 GB
SMDegrain E-H std: 5.7 GB
SMDegrain E-H BM3D CPU: (too slow: .28 fps)
SMDegrain E-H KNL: (does not work, probably needs GPU)
SMDegrain Hard std: 6.3 GB
I'll dig into it further to tune SMDegrain for heavier degraining, because as of right now, plain MDegrain2 is giving me a much smaller file size.
Hi Ryushin, glad to know you're finally getting around to trying the build :)
"E-H" means Extra Hard !!
And yes, BM3D does use CUDA, and hence an appropriate nVidia GPU, that is why there's a CPU version of the script.
Same with the DG & KNL scripts, the latter needing OpenCL, mainly.
And also yes to turning off the Autoupdates (this was in the "instructions").
I hope your "updating" of the servers, you just replaced the Tools folder ?!?! This is because of the Avisynth version, as most of the scripts/filters need 3.7.2.
I have gone to the trouble & expense of adding nVidia GPU's to ALL my servers so that I can use ALL the filters !!
Now, unlike you (and many others) you go for smaller files size, where as I go for bitrate, so using CQ18 just doesn't interest me.
The settings I decided on a couple of days ago, are working VERY well for me atm, I am seeing good speed, and great results, mind you I am only doing 1080p right now, but I have a 4K movie queued up, so I might try your settings with that, and see what I get.
I don't think I need to add SMDegrain to the filter list, just unchecking it, and I get 100% CPU usage :) I've just tested this, and I still think that just simply unchecking that option is all that's required, when using SMDegrain (but each to their own)
So not knowing what PC's you have working, to get those "numbers" (above), but my Ryzen's are doing a great job :)
PS:- I've just started a couple of 4K tests, and the pre filter's REALLY slow the process down, but "straight" SMDegrain's seem to do well. Have I ever said how much I HATE 4K encoding, even with several Ryzen 9's grinding away :(
Ripbot has worked perfectly for me for years. Just today I tried starting it up and immediately see a dialog:
Runtime error 217 at 00411E42
There is an entry in Event Viewer showing the following:
Faulting application name: RipBot264.exe, version: 1.26.1.0, time stamp: 0x2a425e19
Faulting module name: KERNELBASE.dll, version: 10.0.19041.1706, time stamp: 0x40a40d01
Exception code: 0x0eedfade
Fault offset: 0x0012c3a2
Faulting process id: 0x3de8
Faulting application start time: 0x01d86a0e3aa8b2ba
Faulting application path: C:\Program Files (x86)\RipBot264\RipBot264.exe
Faulting module path: C:\Windows\System32\KERNELBASE.dll
Report Id: 559a9f50-9bcf-42cc-89e0-339a3a17fd84
Faulting package full name:
Faulting package-relative application ID:
What could be causing this?
---
Edit: Rebooted and it's working now. No idea what happened, but my PC hung at the "Waiting for System Event Notification service" during shutdown and I physically had to turn it off and back on. Evidently something in the OS got fried.
guest
18th May 2022, 05:53
So I upgraded my server using a used Supermicro motherboard and I ordered two Xeon E5-2680 V4 (14 cores) processors for it from Ebay. Got everything installed on Tuesday.
I configured my virtual machine with to use 24 cores and two threads for a total of 48 CPU threads. Gave the VM 32GB of RAM as well. I am not using NUMA.
Run the x265 Benchmark and received a score of 59.2 so I was happy with this.
Received Moonfall in 4K from Amazon and I proceeded to add it to RB. Noticed i would have to do a bit of degraining and enabled MDegrain2 with a THSAD value of 200. Started the encoding with two servers and was amazed at how slow the encoding went and how it was not utilizing the CPU.
So I did a test encoding with no MDegrain2 and it was fast. So most likely it was the threading problem with MDegrain2. My "Use multiple processing threads" setting was set to the default of 0 which I think means use a thread for each CPU thread which would be 48.
So I ran some tests by lowering the number of threads used for MDegrain2 and the results were dramatic:
1 Minute Chunk Size, First Chunk, 1 Encoding Server
No MDegrain - 6.38 fps (CPU running about 45-85%)
MDegrain2 48 threads (0 for unlimited) - 1.27 fps
MDegrain2 24 threads - 1.29 fps
MDegrain2 18 threads - 2.31 fps
MDegrain2 15 threads - 4.36 fps
MDegrain2 14 threads - 4.44 fps
MDegrain2 13 threads - 4.38 fps
MDegrain2 12 threads - 4.15 fps
MDegrain2 10 threads - 3.62 fps
1 Minute Chunk Size, First and Second Chunk, 2 Encoding servers
No MDegrain - 4.17 and 12.13 fps = 16.30 fps (CPU running about 92-100%)
MDegrain2 15 threads - 3.05 and 3.62 fps = 6.67 fps
MDegrain2 14 threads - 3.18 and 4.22 fps = 7.40 fps
MDegrain2 13 threads - 3.26 and 3.96 fps = 7.22 fps
So I hope this helps someone who has a highly threaded setup and that you will probably have to tune the MDegrain2 thread settings for each machine.
Hi Ryushin, This is all very interesting, as I seem to be having a similar problem, not a particular filter but EVERYTHING :(
I've had a dual Xeon E5-2697v2 (12 cores) setup for a while, and it's worked good 'til now, I "transplanted" it into a case, instead of being directly screwed to a table !!
The only thing I changed was the type & amount of RAM. (more)
I did a test run with it today, and it was SLOW, an old dual Xeon X5690 (a measly 6 cores) system was twice as fast, which is pretty sad.
I've tried a few "thread" settings, but nothing seems to help.
I'm running Windows Server 2022, might need to try "normal" Windows.
Ryushin
18th May 2022, 12:55
Hi Ryushin, This is all very interesting, as I seem to be having a similar problem, not a particular filter but EVERYTHING :(
I've had a dual Xeon E5-2697v2 (12 cores) setup for a while, and it's worked good 'til now, I "transplanted" it into a case, instead of being directly screwed to a table !!
The only thing I changed was the type & amount of RAM. (more)
I did a test run with it today, and it was SLOW, an old dual Xeon X5690 (a measly 6 cores) system was twice as fast, which is pretty sad.
I've tried a few "thread" settings, but nothing seems to help.
I'm running Windows Server 2022, might need to try "normal" Windows.
Did you turn off the option "Limit to the following filters only"? Some functions don't seem to thread well and cause the encode to slow down. This is why I added the SMDegrain to that list.
Is the RAM running at a slower speed, that could cause a bit of a difference as well.
Once I tuned the threading settings I was getting good performance. But that area where performance was good was pretty narrow. You're probably going to have to do some benchmarking with different thread settings and see where your sweet spot is. Perhaps NUMA is enabled as well. I was testing NUMA on my older Ryzen, I found non NUMA was better for me.
guest
19th May 2022, 08:48
Did you turn off the option "Limit to the following filters only"? Some functions don't seem to thread well and cause the encode to slow down. This is why I added the SMDegrain to that list.
Is the RAM running at a slower speed, that could cause a bit of a difference as well.
Once I tuned the threading settings I was getting good performance. But that area where performance was good was pretty narrow. You're probably going to have to do some benchmarking with different thread settings and see where your sweet spot is. Perhaps NUMA is enabled as well. I was testing NUMA on my older Ryzen, I found non NUMA was better for me.
Hi, I am not using this PC as the Client, so the ALL the settings are dependent on the the settings of the Client (main) PC, so changing them is irrelevant.
I'm still not convinced that SMDegrain needs to added to the Threads list !!!
The RAM is the same speed, 1066, it was what came with the Dell R720's, I didn't need 128Gb in them, so I borrowed 64Gb.
I'm doubtful that it's a Windows Server 2022 issue....
Correct me if I'm wrong, but I don't think NUMA is an option with Ryzen CPU's, it's called something else, but I don't think it works the same way, but I'm running Intel Xeon's, and have the NUMA function disabled.
But one very annoying error is randomly happening AGAIN, x265 [error]: unable to open input file, and with x264, as well :(
I did my 1st encode on one of the R720's, and initially got this error, but then I realised I hadn't updated vc-redist(s), after that it worked, but was a bit slow & stalled a few times, but it was runnung @ 100% CPU usage, 'til it stalled, but it completed the chunk, and then with the next encode the error returned, so I turned it off in disgust !!!!
Ryushin
20th May 2022, 13:13
Hi, I am not using this PC as the Client, so the ALL the settings are dependent on the the settings of the Client (main) PC, so changing them is irrelevant.
I'm still not convinced that SMDegrain needs to added to the Threads list !!!
The RAM is the same speed, 1066, it was what came with the Dell R720's, I didn't need 128Gb in them, so I borrowed 64Gb.
I'm doubtful that it's a Windows Server 2022 issue....
Correct me if I'm wrong, but I don't think NUMA is an option with Ryzen CPU's, it's called something else, but I don't think it works the same way, but I'm running Intel Xeon's, and have the NUMA function disabled.
But one very annoying error is randomly happening AGAIN, x265 [error]: unable to open input file, and with x264, as well :(
I did my 1st encode on one of the R720's, and initially got this error, but then I realised I hadn't updated vc-redist(s), after that it worked, but was a bit slow & stalled a few times, but it was runnung @ 100% CPU usage, 'til it stalled, but it completed the chunk, and then with the next encode the error returned, so I turned it off in disgust !!!!
When I was testing MDegrain2 when it was just first being added as an option in RB it was painfully slow. Atak added the threading option for certain functions that would work with threading while other functions would not.
I think NUMA is NUMA. I just built a 24 core EPYC server and Linux reports NUMA is available.
I noticed that I got the unable to open input file on certain scripts in Pauly Dunne's tools. The SMDegrain CPU is working fine for me and that is what I'm doing testing with. I'm seeing 7-12 FPS with 4K with SMDegrain depending on options.
Ryushin
20th May 2022, 21:20
So I've spent a few days getting to know SMDegrain and it's options compared to MDegrain. At first using Pauly Dunne's custom scripts for SMDegrain did not provide better results than MDegrain and were in fact worse size wise than just using MDegrain. Pauly encodes for bit rate and I prefer Constant Quality since the file size actually tells me how clean the output is.
I found good documentation for SMDegrain here: http://avisynth.nl/index.php/SMDegrain
Originally I was testing with a 15 minute clip from Invasion of the Body Snatchers in 4K. But the better test case was to use Blade Runner in 4K since the 15 minutes clip from the beginning has lots of grain, haze, cigarette smoke, etc, plus it will show off color banding if there are problems.
My test results:
Source: Blade Runner 1982 4K - 15 Minutes cut from 2:58-17:58
Source Size: 4.0 GB
Constant Quality 18
6.1 GiB: No Degraining: (Note, file size is larger than the source because of so much grain)
2.2 GiB: MDegrain2 thSAD=400
1.6 GiB: MDegrain3 thSAD=600
Note: I Find MDegrain3 can cause problems with example of a close up a face, you can see the facial texture, but if they suddenly turn their face, it blurs, then you can see the texture again when the turn finishes. Very annoying to watch and as such, I only used MDegrain3 on the absolute grainiest sources.
4.1 GiB: SMDegrain(video) (no options) (See docs for the default options)
2.8 GiB: SMDegrain(video,tr=2,thSAD=400,thSCD2=80)
2.8 GiB: SMDegrain(video,tr=2,thSAD=400,thSADC=200,thSCD2=80)
1.7 GiB: SMDegrain(video,tr=2,thSAD=800,thSADC=400,thSCD2=80)
1.9 GiB: SMDegrain(video,tr=2,thSAD=800,thSADC=400,thSCD2=80,contrasharp=true,prefilter=2,refinemotion=true)
1.0 GiB: SMDegrain(video,tr=4,thSAD=800,thSADC=400,thSCD2=80)
1.1 GiB: SMDegrain(video,tr=4,thSAD=800,thSADC=400,thSCD2=80,contrasharp=true,prefilter=2,refinemotion=true)
828 MiB: SMDegrain(video,tr=8,thSAD=800,thSADC=400,thSCD2=80)
3.1 GiB: SMDegrain(video,tr=8,thSAD=800,thSADC=400,thSCD2=80,contrasharp=true,prefilter=-1,refinemotion=true)
1.2 GiB: SMDegrain(video,tr=8,thSAD=800,thSADC=400,thSCD2=80,contrasharp=true,prefilter=0,refinemotion=true)
967 MiB: SMDegrain(video,tr=8,thSAD=800,thSADC=400,thSCD2=80,contrasharp=true,prefilter=1,refinemotion=true)
767 MiB: SMDegrain(video,tr=8,thSAD=800,thSADC=400,thSCD2=80,contrasharp=true,prefilter=2,refinemotion=true)
So increasing the "tr" value is essentially which MDegrain you want to use. In the case above, from 2-8. The file size was actually quite good using a tr of 8.
The contrasharp provides sharpening. I found adding the contrasharp provided a nice detail enhancement but it really needed to be paired with using a prefilter which blurs out the grain a bit before sharpening. A prefilter of -1 provides no filtering, 0 is light, 1 is medium, and 2 is strong. Blocky sources need to use 3 for the prefilter. Refinemotion helps with detecting motion, but if the prefilter is too strong it can cause problems.
I watched the output of the 767 MiB file this morning and compared it to the source and the difference is outstanding.
Atak, please add SMDegrain to RipBot264. It seems to be a swiss army knife of sorts. You will probably need to give perhaps three presets and hopefully and Advanced that lets you tune some of the parameters such as tr, thSAD, contrasharp, prefilter, refinemotion, etc. I almost think SMDegain could be so good you can retire MDegrain at this point.
You can download the 15 minute Blade Runner source file and the 767 MiB file to see the differences from here:
https://cloud.chrisdos.com/s/mdMDjgQMbMCdaes The link expires in two weeks.
I've ripped some of my grainiest 4K movies to try things out on and watch them and see how it fairs.
Pauly Dunne, thank you for the hard work of providing the SMDegrain scripts and tools. I'll try and take SMDegrain pieces and integrate them into to RB's default tools folder so I can turn on auto updates again.
guest
21st May 2022, 03:03
So I've spent a few days getting to know SMDegrain and it's options compared to MDegrain. At first using Pauly Dunne's custom scripts for SMDegrain did not provide better results than MDegrain and were in fact worse size wise than just using MDegrain. Pauly encodes for bit rate and I prefer Constant Quality since the file size actually tells me how clean the output is.
I found good documentation for SMDegrain here: http://avisynth.nl/index.php/SMDegrain
Atak, please add SMDegrain to RipBot264. It seems to be a swiss army knife of sorts. You will probably need to give perhaps three presets and hopefully and Advanced that lets you tune some of the parameters such as tr, thSAD, contrasharp, prefilter, refinemotion, etc. I almost think SMDegain could be so good you can retire MDegrain at this point.
Pauly Dunne, thank you for the hard work of providing the SMDegrain scripts and tools. I'll try and take SMDegrain pieces and integrate them into to RB's default tools folder so I can turn on auto updates again.
Hi Ryushin,
WOW, you HAVE been busy, well done !!!
I am SO SO happy that you have pursued this, I knew that you would NOT be disappointed with SMDegrain, once you got your head around it.
So I have compared & cross referenced some of your "scripts" with "my" filters names, and it seems that you are mainly using the E-H (extra hard) settings, and just changing the "tr" values.
There are so many others to choose from with lower settings, already.
For example :-
3.1 GiB: SMDegrain(video,tr=8,thSAD=800,thSADC=400,thSCD2=80,contrasharp=true,prefilter=-1,refinemotion=true) is basically the SMDegrain E-H Minblur#-1 filter, and so on...
1.2 GiB: SMDegrain(video,tr=8,thSAD=800,thSADC=400,thSCD2=80,contrasharp=true,prefilter=0,refinemotion=true) SMDegrain E-H Minblur#0
967 MiB: SMDegrain(video,tr=8,thSAD=800,thSADC=400,thSCD2=80,contrasharp=true,prefilter=1,refinemotion=true) SMDegrain E-H Minblur#1
767 MiB: SMDegrain(video,tr=8,thSAD=800,thSADC=400,thSCD2=80,contrasharp=true,prefilter=2,refinemotion=true) SMDegrain E-H Minblur#2
So if your starting from scratch with your own SMDegrain scripts, they are already there !!!, you just need to look in the Custom folder.
Should I rename them to something a little more explanatory ??
Now I know you're no stranger to modifying scripts, so you can go crazy modding any of these to suit your needs, and just save them in the Custom folder, and delete any that you don't want.
So I will take this opportunity to provide some basic "hardware" requirements for some of the SMDegrain variants :-
Any BM3D CPU filters requires a CPU with AVX2 instructions, so that means basically most hi-end Ryzens, Threadrippers, etc, but very few Intel's, maybe Gen 12.
I would suggest you check the specs of the CPU's you use !!
Any BM3D CUDA filters requires an nVidia GPU (faster the better).
Any DGDecNV filters requires an nVidia GPU for the nvenc/nvdec, functions.
Any KNLMeansCL filters requires OpenCL, either nVidia or AMD GPU's.
Most of the other filters are good to go.
Also, if you want to suss out more "Dogway" modded SMDegrain stuff, go here :-
https://forum.doom9.org/showthread.php?t=182881
The link you posted for SMDegrain info is now a little dated, due to Dogway's mod's. (that's what I use)
And don't ignore some of the other filters in the Custom list...
I would be shocked if Atak did do anything to implement some SMDegrain filters, but never, say never.
And as for Auto Updates, just disable it, to avoid problems !!!!
Cheers & thanks :)
PS:- I have downloaded your Bladerunner sample, will take a close look.
guest
21st May 2022, 03:19
When I was testing MDegrain2 when it was just first being added as an option in RB it was painfully slow. Atak added the threading option for certain functions that would work with threading while other functions would not.
I think NUMA is NUMA. I just built a 24 core EPYC server and Linux reports NUMA is available.
I noticed that I got the unable to open input file on certain scripts in Pauly Dunne's tools. The SMDegrain CPU is working fine for me and that is what I'm doing testing with. I'm seeing 7-12 FPS with 4K with SMDegrain depending on options.
Hello again,
I did some more testing on my "slow" dual E5-2697v2 yesterday, and tried all sorts of setting's to see if I could get some performance back.
And I ended up changing a couple of x265 commands, and filter settings.
I even tried NUMA & no NUMA, and with NUMA enabled, made a very noticeable speed increase, and if you only use 2 encoding port address's, you have one for /node 0, and one for /node 1...nice.
Speaking on NUMA, Ryzens don't have it, BUT Threadripper's & EPYC's, apparently do....
And I still don't think SMDegrain needs to be added to the filter thread list, I actually noticed a slight increase in speed, with it not even IN the list, in the RipBot264.ini file.
And I think I had a bit of a brain fart with the R720 the other day when I got that x265 error....as it had previously worked ok on an encode, but the next encode, I got the error...turns out I was using a different filter which required AVX2, which the Xeon's don't have.....
I'm seeing 7-12 FPS with 4K with SMDegrain depending on options. So what machine(s) are you running to get this speed ??, and how many DE server ports are you using ??
guest
21st May 2022, 03:28
You can download the 15 minute Blade Runner source file and the 767 MiB file to see the differences from here:
https://cloud.chrisdos.com/s/mdMDjgQMbMCdaes The link expires in two weeks.
I just had a look at your sample, and even on my laptop, it IS impressive, that's for sure :)
You just need to convert the audio to E-AC3 @ 1536kbps.
NICE, cheers.
Ryushin
21st May 2022, 12:08
I just had a look at your sample, and even on my laptop, it IS impressive, that's for sure :)
You just need to convert the audio to E-AC3 @ 1536kbps.
NICE, cheers.
Oh, the audio for the test clip was just minimal as I really did not want the audio size to affect my testing. The finished files have AC3 Core and TrueHD+Atmos in the files or DTS (compressed) and DTS:X if available.
Ryushin
21st May 2022, 12:14
So what machine(s) are you running to get this speed ??, and how many DE server ports are you using ??
My main RP machine is a virtual machine with 24 cores and 48 threads. The Linux KVM Hypervisor has dual E5-2680 v4 @ 2.40GHz (14 cores) and passes 24 cores and 48 threads to the VM. I have a first gen Ryzen 1800X that I use for an encoding server. With those I see 7-12 FPS with 4K just using SMDegrain CPU and no GPU assistance.
Ryushin
21st May 2022, 18:45
So I encoded Invasion of the Body Snatchers 4K over last night and I started watching it this morning and I encountered a problem in one of the scenes in the movie.
It's a dark scene with two people talking and their faces are in the light. If you watch the women's cheek you will see that seems degrain for a quarter second, then not degrain, and back and forth. It was very odd.
I extracted that 90 second scene out and looked it it in detail and the source has some odd grain around the women's cheek and that is probably where the problem occurs. I ran a bunch of tests using different options against the sample in order to find out how to solve the problem. Reducing the block size from the default of 16 to 8 solved the problem. As a bonus the file size was 11% smaller than before using the default block size. Encoding takes a hit since I'm essentially quadrupling the number of blocks to analyze. Encoding was about 30-40% slower.
Link to the sample source and the two encoded files (link valid for two weeks):
https://cloud.chrisdos.com/s/6JkTfF2etSo8Ln8
I've changed my scripts to use a block size of 8 now:
SMDegrain(video,tr=8,thSAD=800,thSADC=400,thSCD2=80,contrasharp=true,prefilter=2,refinemotion=true,blksize=8)
Pauly Dunne: You have a lot of scripts. Most would not run on my system since I don't have a GPU. So you may want to add a GPU/CPU in the name or provide a different folders with GPU and CPU optimized scripts. You may also want to condense the scripts into an advanced vs simplified. Perhaps just have 4-5 scripts from very light to very hard and then all the other scripts in a different folder for those that want to try all the different options and alternatives to SMDegrain.
guest
22nd May 2022, 03:23
Pauly Dunne: You have a lot of scripts. Most would not run on my system since I don't have a GPU. So you may want to add a GPU/CPU in the name or provide a different folders with GPU and CPU optimized scripts. You may also want to condense the scripts into an advanced vs simplified. Perhaps just have 4-5 scripts from very light to very hard and then all the other scripts in a different folder for those that want to try all the different options and alternatives to SMDegrain.
Hello again,
You're like a dog with a bone....VERY particular (which is good)
Yes, I realise there are a LOT of scripts, and I doubt that many of them would get used, once the user has "favourite's", then they could quite easily copy the others to another folder, and greatly reduce the drop down list.
As for using a different folder, for different type or category's, how would you "call them up" from within RipBot ???
The only way I've known is to have EVERYTHING in the Custom folder, so it is available with the "Custom Script" option "box".
If you create a New Folder within the Custom Folder, it does not show up in the Custom Script list !!!!
So if you know a way to do that, please let me know, and I will add it !!!
Same goes for Advanced & Simplified, how ???
However, I do like your suggestion of using CPU or GPU in the scripts name :)
Anyway, it's a good base for users to start with, and customise to meet their own requirements, and remove the rest.
I have downloaded your 2 sample's, and I will have to run them on a PC, but I DID noticed they are a very high bitrate, coming from you (I know they are only tests), but the Blade Runner sample @ CQ18, was around 6700kb/s, and todays were in the low to mid 40mb/s.
So keep up the good work, and if you have any suggestions / changes or additions, please let me know.....Upward & Onward :)
Cheers & thanks.
guest
22nd May 2022, 10:58
SMDegrain E-H KNL: (does not work, probably needs GPU)
I stumbled across some new/old info about OpenCL support for Intel CPU's that maybe you could suss out (I know I'm going to try again).
Atak posted this on another Forum :-
https://forum.doom9.org/showthread.php?p=1969319#post1969319
So I downloaded the Intel OpenCL Driver (needs an Intel account,tho).
So if you wanted to try a KNLMeansCL script without a GPU, you could mod the script to use device_type="CPU".
Ryushin
22nd May 2022, 12:27
I have downloaded your 2 sample's, and I will have to run them on a PC, but I DID noticed they are a very high bitrate, coming from you (I know they are only tests), but the Blade Runner sample @ CQ18, was around 6700kb/s, and todays were in the low to mid 40mb/s.
This is why I like Constant Quality. I'm not wasting bits if they are not needed. Even after degraining there was still some grain and as such CQ raised the bit rate to make sure the quality of the entire scene was the same as the whole clip. Another example is Avengers Endgame 4K is so clean the entire 3 hour movie comes out to 5.76 GiB (4553 kb/s bit rate) without any degraining whatsoever using CQ18. ideally, if you watched Endgame with a CQ18 and x265, it should be visually indistinguishable to an encode with hard bit rate of 90 Mb/s.
Using CQ also allows me to judge how clean the output is. I had another 4K movie that looked pretty clean and just had some light grain and it came out to be 18GB in size using CQ18 with no degraining. Just adding a little MDegrain2 with a thSAD=100 brought the file size down to 8GB still with CQ18. There really is no downside to using constant quality. Only reason I see to use a hard bit rate is if I'm trying to fit it on a medium that has a finite size limitation.
Ryushin
22nd May 2022, 12:31
So if you wanted to try a KNLMeansCL script without a GPU, you could mod the script to use device_type="CPU".
I think SMDegrain gives me the all the options I want at this point. The prefilter options and sharpening that actually works instead of adding artifacts like my tests gave me before. I'm very happy with SMDegrain at this point and I'll be creating scripts using it almost exclusively.
guest
23rd May 2022, 03:33
Yes, I realise there are a LOT of scripts, and I doubt that many of them would get used, once the user has "favourite's", then they could quite easily copy the others to another folder, and greatly reduce the drop down list.
As for using a different folder, for different type or category's, how would you "call them up" from within RipBot ???
The only way I've known is to have EVERYTHING in the Custom folder, so it is available with the "Custom Script" option "box".
If you create a New Folder within the Custom Folder, it does not show up in the Custom Script list !!!!
So if you know a way to do that, please let me know, and I will add it !!!
Same goes for Advanced & Simplified, how ???
So keep up the good work, and if you have any suggestions / changes or additions, please let me know.....Upward & Onward :)
Cheers & thanks.
Hi Ryushin,
Hi, can you please comment on this...
Thanks
Ryushin
23rd May 2022, 10:44
Hi Ryushin,
Hi, can you please comment on this...
Thanks
Since you can't have subfolders and such, my suggestions would be something like the following:
In the custom scripts, have only about a dozen scripts with generic names, such as:
SMDegrain_GPU_Light/Medium/Hard/Very_Hard
SMDegrain_CPU_Light/Medium/Hard/Very_Hard
Then in your install instructions, provide another folder with the advanced scripts and tell them them where to place them. I would also add the requirements in the script name, such as GPU, CPU, AVX2, etc.
Then the install instructions can also have an advanced section and you can lay out what HQD3D (which I think can only do 8-bit color), CQTMGC, BM3D, etc, can do. Maybe even provide a link that has more details such as that link I provided for SMDegrain.
In the beginning, all the scripts will overwhelm someone. There is also probably quite a bit of overlap. Such as is using BM3D going to give better results than just SMDegrain, and if so, what are the advantages/disadvantages.
Ryushin
23rd May 2022, 12:53
So I encoded Invasion of the Body Snatchers 4K over last night and I started watching it this morning and I encountered a problem in one of the scenes in the movie.
It's a dark scene with two people talking and their faces are in the light. If you watch the women's cheek you will see that seems degrain for a quarter second, then not degrain, and back and forth. It was very odd.
I extracted that 90 second scene out and looked it it in detail and the source has some odd grain around the women's cheek and that is probably where the problem occurs. I ran a bunch of tests using different options against the sample in order to find out how to solve the problem. Reducing the block size from the default of 16 to 8 solved the problem. As a bonus the file size was 11% smaller than before using the default block size. Encoding takes a hit since I'm essentially quadrupling the number of blocks to analyze. Encoding was about 30-40% slower.
Link to the sample source and the two encoded files (link valid for two weeks):
https://cloud.chrisdos.com/s/6JkTfF2etSo8Ln8
I've changed my scripts to use a block size of 8 now:
SMDegrain(video,tr=8,thSAD=800,thSADC=400,thSCD2=80,contrasharp=true,prefilter=2,refinemotion=true,blksize=8)
So the encoding performance hit was pretty significant probably closer to 50% slower, so I did some more testing. Removing the thSCD2=80 option (which changes it back to it's default of 130) fixed the problem as well. I know Ripmann changed the option because the scene change detection was not being detected properly and it was merging frames that were not related to each other. Perhaps since SMDegrain brightens to the scene to find more grain before degraining the scene detection will work better. I guess we'll see what happens as I'll go back to using the default of thSCD2=130 by leaving the option out.
guest
24th May 2022, 07:43
Since you can't have subfolders and such, my suggestions would be something like the following:
In the custom scripts, have only about a dozen scripts with generic names, such as:
SMDegrain_GPU_Light/Medium/Hard/Very_Hard
SMDegrain_CPU_Light/Medium/Hard/Very_Hard
Then in your install instructions, provide another folder with the advanced scripts and tell them them where to place them. I would also add the requirements in the script name, such as GPU, CPU, AVX2, etc.
Then the install instructions can also have an advanced section and you can lay out what HQD3D (which I think can only do 8-bit color), CQTMGC, BM3D, etc, can do. Maybe even provide a link that has more details such as that link I provided for SMDegrain.
In the beginning, all the scripts will overwhelm someone. There is also probably quite a bit of overlap. Such as is using BM3D going to give better results than just SMDegrain, and if so, what are the advantages/disadvantages.
Hi, thanks for that...that IS a lot of work, and again, there are so many variants of all the pre-filters, I wouldn't know where to start, and where to put what....maybe a bit re-naming & explanation might be enough, and the user can sort it out to their liking.
I know there's a LOT that I personally wouldn't use.
I'll have a good look at it, when I get the chance...maybe I'll get a "lightbulb" moment :)
guest
24th May 2022, 08:08
So the encoding performance hit was pretty significant probably closer to 50% slower, so I did some more testing. Removing the thSCD2=80 option (which changes it back to it's default of 130) fixed the problem as well. I know Ripmann changed the option because the scene change detection was not being detected properly and it was merging frames that were not related to each other. Perhaps since SMDegrain brightens to the scene to find more grain before degraining the scene detection will work better. I guess we'll see what happens as I'll go back to using the default of thSCD2=130 by leaving the option out.
So I had a look at those clips you posted, and you must have a very good eye for "defect's", I don't think I could pick it...but it lead you to modding the script until it's fixed...
So, I can't help but notice you're are mainly using the Extra Hard (might have a name change soon), scripts, and only changing the "tr=" value, and maybe the pre-filter #.
With the Light, Medium & Hard scripts the "tr=" value is changed, along with a lot of the "th" type values, have you tried any of them for lesser noisy sources ??
Also, I had another good look at the SMDegrain link's info, and it would be interesting to try this script :-
I've changed my scripts to use a block size of 8 now:
SMDegrain(video,tr=8,thSAD=800,thSADC=400,thSCD2=80,contrasharp=true,prefilter=2,refinemotion=true,blksize=8)
SMDegrain(video,tr=8,thSAD=800,thSADC=400,thSCD1=300,thSCD2=130,contrasharp=true,prefilter=2,refinemotion=true,blksize=8)
I think thSCD1 works in conjunction with blksize values.
And you could leave thSCD2 out (like you mentioned)
I wonder if there's some way to incorporate a 2 pass SMDegrain run, like here (and the post below):-
https://forum.doom9.org/showthread.php?p=1969268#post1969268
Anyway, regardless to all that, I'm just so happy that you have finally come around to using & preferring SMDegrain, it was one aim of mine, when I started doing all these additions, so thankyou :)
And please, if you come up with some different scripts or filters, don't forget to let me know, either here on the Forum, a PM, or email.
PS:- It would be interesting to try these out on the Jetson's, and see what result you get, even though you're happy with how you did them, several months back.
Ryushin
24th May 2022, 11:45
So, I can't help but notice you're are mainly using the Extra Hard (might have a name change soon), scripts, and only changing the "tr=" value, and maybe the pre-filter #.
With the Light, Medium & Hard scripts the "tr=" value is changed, along with a lot of the "th" type values, have you tried any of them for lesser noisy sources ??
Anyway, regardless to all that, I'm just so happy that you have finally come around to using & preferring SMDegrain, it was one aim of mine, when I started doing all these additions, so thank you :)
PS:- It would be interesting to try these out on the Jetson's, and see what result you get, even though you're happy with how you did them, several months back.
I had been keeping Invasion of the Body Snatches ripped to do testing against SMDegrain, just needed the time and motivation to do it. For 95% of everything, MDegrain2 did a fantastic job and sometimes if it "works" just leave it alone. I appreciate your work to bring SMDegrain and other tools to RipBot. Now if only Atak would integrate SMDegrain into it and it would be nice to hear from him more often.
But those super grainy sources always bothered me and I did not like using MDegrain3 because of the blurring I saw in skin textures when there was movement. SMDegrain seems to do really well and the results are natural looking.
I have not tested any lighter grainy sources yet, but I feel it will at least do as well as MDegrain2. I probably won't be doing any blurring/sharpening on the lighter sources. I'll start with the tr=2 for lighter degrain and tr=4 probably for medium degrain. Strangely, the tr=2 would be the equivalent of MDegrain2 and tr=8 would be MDegrain8. But the file size difference between tr=2 and tr=8 was dramatic and I saw no blurring issues like when just using MDegrain3. Encoding performance is still good using tr=8. I tried tr=12 trying to solve the issue I mentioned but the slow down was not worth it.
I have Superman The Animated Series still up on the server. I have a run with MDegrain2 and using Handbrake with NLMeans animation Tune. I'll run SMDegrain against it as well to see where it ends up and compare the three. Jetsons and Flintstones I'll probably just leave alone as the results from Handbrake are stunning, just the encoding was so slow it was just painful to do.
slalom
26th May 2022, 17:00
The reason I ask is that I have the Encoding Client on my Gaming PC as I have a very high TBW NVME drive on here and I like to have the Ripbot stuff open on a second monitor. However when a new one starts the Encoding Client will either minimise the game if in Fullscreen or appear on top if in Windowed Borderless, it doesn't appear on top if keep the Encoding Client on Primary Monitor while in Windowed Borderless.
keep it minimized while gaming
Hello again,
I did some more testing on my "slow" dual E5-2697v2 yesterday, and tried all sorts of setting's to see if I could get some performance back.
And I ended up changing a couple of x265 commands, and filter settings.
I even tried NUMA & no NUMA, and with NUMA enabled, made a very noticeable speed increase, and if you only use 2 encoding port address's, you have one for /node 0, and one for /node 1...nice.
That's what it's for, for 2 CPUs
guest
27th May 2022, 01:30
That's what it's for, for 2 CPUs
Hi slalom, you haven't posted in quite a while...
I kind of agree, but it's not always the best option.
Depending on the workload.
Axelstrife
27th May 2022, 17:46
Hi, Is there there a guide of some sort for the distributed encoding? i'm trying to figure why it isn't working for me.
Ive got encoding servers open on both PC's and both PC's Ip's entered into the encoding client on the main PC both say online, but when i add a movie to encode and hit start it just says "please wait" and then after a minute or two says "All jobs finished" pop up notification despite nothing actually happening.
Ive got both PC's windows firewall disabled to eliminate that as the issue.
I have read about some software causing issues which is why i reinstalled windows on one PC and the other received a fresh reinstall about three days ago and only has 6 programs installed since then (Plex, Sonarr, Radarr, SABnzbd, media info, 7zip)
Is there a port that needs to be open? ive got no idea why this isnt working
Atak_Snajpera
27th May 2022, 21:59
Record your desktop and upload your video somewhere. This way I will see what you see and help me to identify your issue.
slalom
27th May 2022, 23:24
Hi slalom, you haven't posted in quite a while...
I kind of agree, but it's not always the best option.
Depending on the workload.
I am around... :cool:
guest
28th May 2022, 01:52
Hi, Is there there a guide of some sort for the distributed encoding? i'm trying to figure why it isn't working for me.
Ive got encoding servers open on both PC's and both PC's Ip's entered into the encoding client on the main PC both say online, but when i add a movie to encode and hit start it just says "please wait" and then after a minute or two says "All jobs finished" pop up notification despite nothing actually happening.
Ive got both PC's windows firewall disabled to eliminate that as the issue.
I have read about some software causing issues which is why i reinstalled windows on one PC and the other received a fresh reinstall about three days ago and only has 6 programs installed since then (Plex, Sonarr, Radarr, SABnzbd, media info, 7zip)
Is there a port that needs to be open? ive got no idea why this isnt working
Hi, you posted a very similar "question" nearly 3 years ago...you were having problems with DE....did you fix it, back then ??
You've listed the programs you've installed, BUT have you got an nVidia GPU, as the drivers (or part there of) can cause a lot of problems.
And apparently some Logitech stuff, does to.
Maybe you need to go back to your 1st post, and see what replies you got....their might be a "fix" mentioned back then.
As long as the other PC(s) have slightly different IP address's, and on the same group, it should work.
It's probably something simple, but it's frustrating !!!!
If you can't get it to work, do what Atak suggested, and he WILL be able to help, I'm sure.
Axelstrife
28th May 2022, 07:02
Record your desktop and upload your video somewhere. This way I will see what you see and help me to identify your issue.
Here you go, i am recording from Gaming PC and remoting into my plex server PC.
https://youtu.be/GJAZRLf6dzA
Axelstrife
28th May 2022, 07:13
Hi, you posted a very similar "question" nearly 3 years ago...you were having problems with DE....did you fix it, back then ??
You've listed the programs you've installed, BUT have you got an nVidia GPU, as the drivers (or part there of) can cause a lot of problems.
And apparently some Logitech stuff, does to.
Maybe you need to go back to your 1st post, and see what replies you got....their might be a "fix" mentioned back then.
As long as the other PC(s) have slightly different IP address's, and on the same group, it should work.
It's probably something simple, but it's frustrating !!!!
If you can't get it to work, do what Atak suggested, and he WILL be able to help, I'm sure.
The issue back then was different, i actually did have that issue this time but i solved it and then ran into this issue.
both PC's have Nvidia GPU's RTX 3090 and GT 720(9900kf in this PC doesn't have igpu) ive not installed any drivers from Nvidia's website yet so it's only whatever drivers windows uses.
No logitech software is installed
I posted a Youtube link the a screen recording showing exactly what happens in reply to Atak.
guest
28th May 2022, 07:39
Here you go, i am recording from Gaming PC and remoting into my plex server PC.
https://youtu.be/GJAZRLf6dzA
Hi,
I have just watched this clip, and unfortunately, it's not really clear enough to see exactly what's going on. (It helped a little when I put my glasses on).
You might want to change the UAC settings, so you don't get that popup warning.
What happens if you don't use DE, just the single basic encode ???
Are you using the Pauly Dunne build ???
I use that, and don't have any issues...
Do you have any other PC's you can connect to ??
Axelstrife
28th May 2022, 08:16
Hi,
I have just watched this clip, and unfortunately, it's not really clear enough to see exactly what's going on. (It helped a little when I put my glasses on).
You might want to change the UAC settings, so you don't get that popup warning.
What happens if you don't use DE, just the single basic encode ???
Are you using the Pauly Dunne build ???
I use that, and don't have any issues...
Do you have any other PC's you can connect to ??
THANKYOU!, Your comment just lead me to figure out why it wasn't working.
I was manually opening "encoding client" not knowing it would automatically open when i start an encode which i just discovered when attempting to encode only on a single PC but i didn't turn off distributed encoding in the settings so the encoding client popped up.
Thanks for the UAC tip, those are annoying.
slalom
30th May 2022, 20:41
You don't have to, you setup everything in DE settings
guest
31st May 2022, 04:46
You don't have to, you setup everything in DE settings
Yes, he's got it working now, I PM'ed him :)
It's just that there's no relevant instructions on how to do it, anymore.
guest
7th June 2022, 03:14
Hi,
There are several significant updates in this build (read the changelog)
Also, I have completely re-organised the Script & Custom Scripts folders, so it's not so cluttered in the Custom Script list.
https://forum.doom9.org/showthread.php?p=1970572#post1970572
And as always, backup your existing Tools folder before using this, just to be sure.
Good luck. :readguid:
MCFish
8th June 2022, 00:49
Thanks man
guest
9th June 2022, 04:38
I'm curious why my Ryzen 3950X & 5950X (16 core) are encoding quite a bit slower than the 5900X (12 core), even an old dual Xeon X5690 is faster.
This a 4K encode, but on other encodes they "catch up".
https://i.imgur.com/xRW77Rb.jpg
Ryushin
9th June 2022, 13:55
I'm curious why my Ryzen 3950X & 5950X (16 core) are encoding quite a bit slower than the 5900X (12 core), even an old dual Xeon X5690 is faster.
This a 4K encode, but on other encodes they "catch up".
https://i.imgur.com/xRW77Rb.jpg
Are you degraining? Did you uncheck that box to "Limit to the following filters only"? If you are using Pauly Dunne's Tools, make sure you add SMDegrain to the list. Use Atak's experience here. Not every one of the pieces in RB needs to be threaded and only certain processes can take advantage of it and too many threads can slow down the machine.
In my post a few weeks ago, when I got my new to me dual CPUs with 14 cores and 28 threads I had awful performance when using MDegrain at the time. Once I dug into it I found I had to limit the number threads.
https://forum.doom9.org/showthread.php?p=1968247#post1968247
In my case, for that system, 14 threads was optimal for my general encoding even though I had 48 CPU/Threads.
My suggestion is to use a grainy 4K 15-20 minute sample as your test and tune each encoding server individually with degraining enabled. Enable the "Limit to the following filters only" option. Change the chunk size to 2-5 minutes (for testing), enable only one Server process. Then tune that machine to the number of threads that get the highest fps possible. Watch the Task Manager during this time and if you are getting less than 80% utilization and if so, after tuning for one Server process, increase it to two and see what your overall FPS is. Once each computer has been tuned for the number of threads, then run your encodes again.
Your set up should just fly when each machine is tuned.
guest
9th June 2022, 14:50
Are you degraining? Did you uncheck that box to "Limit to the following filters only"? If you are using Pauly Dunne's Tools, make sure you add SMDegrain to the list. Use Atak's experience here. Not every one of the pieces in RB needs to be threaded and only certain processes can take advantage of it and too many threads can slow down the machine.
In my post a few weeks ago, when I got my new to me dual CPUs with 14 cores and 28 threads I had awful performance when using MDegrain at the time. Once I dug into it I found I had to limit the number threads.
https://forum.doom9.org/showthread.php?p=1968247#post1968247
In my case, for that system, 14 threads was optimal for my general encoding even though I had 48 CPU/Threads.
My suggestion is to use a grainy 4K 15-20 minute sample as your test and tune each encoding server individually with degraining enabled. Enable the "Limit to the following filters only" option. Change the chunk size to 2-5 minutes (for testing), enable only one Server process. Then tune that machine to the number of threads that get the highest fps possible. Watch the Task Manager during this time and if you are getting less than 80% utilization and if so, after tuning for one Server process, increase it to two and see what your overall FPS is. Once each computer has been tuned for the number of threads, then run your encodes again.
Your set up should just fly when each machine is tuned.
Yes, I was degraining a grainy 4K, and I had "Limit to the following filters only" unchecked, and threads at "0".
Then I did add SMDegrain to the list, and checked the "Limit to the following filters only", and changed the Threads to 24, didn't make a noticable difference, if anything, it was a little slower.
But now that you have provided a fairly detailed process of "tuning", I will definitely take some time to get it set up.
Having said that, each encode can be quite different to another, even each chunk can change, due to it's "content's".
Well done, thanks.
Edit:-
Well after spending a couple of hours testing this process, with & without SMDegrain in the "list", trying many different threads, and I thought I'd found the sweet spot @ 22 threads.
And I found the difference between having SMDegrain in the "list", and "Limit to the following filters only" checked or not, made very little difference.
So at this point, I'll just have to put up with the 16 Core Ryzens being slower than the 12 Core 5900X (at least on this particular encode), I'm using a pretty high tr setting.
video=SMDegrain(video,tr=10,thSAD=1000,thSADC=500,thSCD1=400,thSCD2=130,contrasharp=true,prefilter=2,str=1.2,refinemotion=true)
wamar21
10th June 2022, 04:29
Yes, he's got it working now, I PM'ed him :)
It's just that there's no relevant instructions on how to do it, anymore.
Here's a quick setup on a fresh win10 install
https://youtu.be/tftERYq94GE
guest
10th June 2022, 05:30
Here's a quick setup on a fresh win10 install
https://youtu.be/A3tWMGkmcaM
Best viewed in 1080p, turn the sound down, and play at 0.5 speed.
Welcome to the Forum, and I'm sure a LOT of people will appreciate that you took the time to do this.
Even tho you're using a VM, the basic steps are the same.
Cheers
wamar21
10th June 2022, 20:12
Thanks, I also noticed a few ambiguities I wanna clear up anyway. Hopefully this one stays useful for as long as possible. Ill tweak it a bit.
I wanted it to be somewhere between "good, clear, useful tutorial" and "annoying 2000s homage/shitpost" but I may have rode that line a bit too close.
UPDATE: Removed the "brb helping w/ groceries" bit for clarity's sake, RIP cultural artifact.
Ryushin
11th June 2022, 13:22
Well after spending a couple of hours testing this process, with & without SMDegrain in the "list", trying many different threads, and I thought I'd found the sweet spot @ 22 threads.
And I found the difference between having SMDegrain in the "list", and "Limit to the following filters only" checked or not, made very little difference.
So at this point, I'll just have to put up with the 16 Core Ryzens being slower than the 12 Core 5900X (at least on this particular encode), I'm using a pretty high tr setting.
video=SMDegrain(video,tr=10,thSAD=1000,thSADC=500,thSCD1=400,thSCD2=130,contrasharp=true,prefilter=2,str=1.2,refinemotion=true)
So each of your encoding servers is set for 22 threads? I would think each one would be different based on number of cores, IPC capabilities, etc. I would probably actually run just MDegrain2 for the tests to get your baseline. I know there is some variance in encoding speed when dealing with different aspect ratios and 4K vs HD.
guest
11th June 2022, 14:48
So each of your encoding servers is set for 22 threads? I would think each one would be different based on number of cores, IPC capabilities, etc. I would probably actually run just MDegrain2 for the tests to get your baseline. I know there is some variance in encoding speed when dealing with different aspect ratios and 4K vs HD.
No, they are not...I was only testing on the Client PC, which is one of the 16 Core Ryzen's, but I ended up just putting it back to "0" for the Threads, Unchecked "Limit..." option, and removed SMDegrain from the list.
It seems that it's the particular filter I am using, a VERY strong high "tr" #.
When I go back to using "normal" filter's, ALL the Ryzen's are pretty much equal.
Fortunately, I don't think I have too many "extra" noisy 4K's to filter, and it's not much of an issues with lesser resolutions.
I might give MDegrain2 a go when I have some spare time, but for now I just want to get some encoding done, while the weather is nice & sunny, which it hasn't been for months & months.
As I don't "waste" electricity doing encodes on overcast days, or over night !!! It's a fine weather, Solar Energy only, process !!
EDIT:-
SSDD....so I tried something a little weird today, I actually limited the Cores available to the CPU in BIOS, so the 16 core CPU, would now run with 12 cores !!!
Surprisingly enough, it made a significant difference...FASTER !!!, but only on that very heavy filter script.
Another thing I tried was the x265 commands...I added --pools 24 that didn't seem to have much of an affect.
Ryushin
12th June 2022, 11:25
No, they are not...I was only testing on the Client PC, which is one of the 16 Core Ryzen's, but I ended up just putting it back to "0" for the Threads, Unchecked "Limit..." option, and removed SMDegrain from the list.
SSDD....so I tried something a little weird today, I actually limited the Cores available to the CPU in BIOS, so the 16 core CPU, would now run with 12 cores !!!
Surprisingly enough, it made a significant difference...FASTER !!
This is why you have to tune the CPU threads for each of your encoding Servers (per computer). So run a 1 minute chunk and time each one just using MDegrain2. Adjust the threads until you find the sweet spot for the encoding server. I would still use the Limit to the following filters option enabled though.
I think if you spend a couple of hours or so tuning your threads for each of your Servers it will pay big dividends in encoding time vs watts used.
Atak: You might want to create a tool that uses MDegrain2/SMDegrain that will find the sweet spot for thread use per Computer. As CPU core count seems to be increasing more and more people are going to hit this issue.
guest
12th June 2022, 14:31
This is why you have to tune the CPU threads for each of your encoding Servers (per computer). So run a 1 minute chunk and time each one just using MDegrain2. Adjust the threads until you find the sweet spot for the encoding server. I would still use the Limit to the following filters option enabled though.
I think if you spend a couple of hours or so tuning your threads for each of your Servers it will pay big dividends in encoding time vs watts used.
Atak: You might want to create a tool that uses MDegrain2/SMDegrain that will find the sweet spot for thread use per Computer. As CPU core count seems to be increasing more and more people are going to hit this issue.
I will try this other procedure when I get a chance, but this "problem" only seems to be A "problem" when using very heavy filters, other wise, it's working great, and CPU utilization is basically 100%.
Even when it's encoding very slowly, it's still pushing the CPU's to pretty much 100%, can't ask anymore than that.
Correct me if I'm wrong, BUT all the encoding servers use the RipBot settings of the client machine, so that individual server settings "do not apply" !!!
As Atak mentioned once, in reality the server PC's ONLY need the Encoding Server, not the whole "app", you'd only need to manually start the Encoding Server, and DE will do the rest, so there's no settings required.
But it IS strange that in some situations, a 12 core system, does a faster job than a 16 core system....
Atak_Snajpera
12th June 2022, 15:27
You can manually define number of prefetch threads for each server like this
EncodingServer.exe /avisynth-prefetch-threads 8
By the default prefetch threads = number of physical cores on current PC
guest
13th June 2022, 02:00
You can manually define number of prefetch threads for each server like this
EncodingServer.exe /avisynth-prefetch-threads 8
By the default prefetch threads = number of physical cores on current PC
Thanks for chiming in, Atak...
You know, that option has been there all along, staring us in the face, but not really knowing what it does.
So, under "Settings", "Distributed Encoding" tab, click on the little "Spanner", then "Command line help".....
EDIT:-
I just tried this on my 3950X 16 Core (which is currently running as an encoding server), and adding that command, only using 24 instead of 8, hasn't changed anything, that I can detect.
In the Encoding Server "window", it still shows :- x265 [info]: Thread pool created using 32 threads
So again, ALL the server machines take their "instructions" and "settings" from the main Client PC, regardless how the server PC is setup !
EDIT #2:-
OK, changed the command line on the Client PC, and even tho it states that Avisynth is only using 24 threads, the x265 info remains @ what ever the CPU provides.
The ONLY way it seems, to change the amount of threads that x265 uses is in the command line for x265, by adding --pools [integer]
Ryushin
13th June 2022, 12:20
Even when it's encoding very slowly, it's still pushing the CPU's to pretty much 100%, can't ask anymore than that.
But it IS strange that in some situations, a 12 core system, does a faster job than a 16 core system....
Yea, I saw a 100% CPU as well when I had unlimited threads. A bottleneck is still taking place. By optimizing the threads, you are removing the bottleneck that was causing slower processing.
Ryushin
13th June 2022, 16:43
Hi Atak,
If your schedule allows, it would be nice to get a RipBot 2.0. You might want to change the name to just RipBot or maybe something like RipBotEncoder.
SMDegrain has been a game changer in quality, though not without its steeper learning curve. I have transitioned over to SMDegrain exclusively though using Pauly Dunnes Tools. Though I create my own scripts to use the CPU only instead of the GPU. SMDegrain is powerful and flexible enough to be the primary degrainer for RB. The options for Blur plus Contrasharp on very grainy sources produces output that defies what I would think would be possible.
Dolby Vision is also easier to deal with and is scriptable: https://forum.doom9.org/showthread.php?t=183479 There are some options that have to be passed if cropping is going to be used in the final output.
It would be nice to see a UI overhaul of the AVI Synth settings. If the window could be made quite a bit larger to see the 2.40:1 bottom borders for 4K sources like you can with HD sources. The larger window will also give you more space for the options. For the SMDegrain settings. A pull down menu with a few presets for most people, something like this:
Light: SMDegrain(video,tr=2,thSAD=200,thSADC=100,refinemotion=true)
Medium: SMDegrain(video,tr=4,thSAD=400,thSADC=200,refinemotion=true)
Heavy: SMDegrain(video,tr=8,thSAD=800,thSADC=400,refinemotion=true)
Then add a Blur+Sharp radio button next to SMDegrain filter that adds the following depending how heavy they wanted it:
Light: contrasharp=true,prefilter=0
Medium: contrasharp=true,prefilter=1
Heavy: contrasharp=true,prefilter=2
Then having an Advanced option on the bottom of the pull down that opens up another new window with more switches and options. Such as having the tr, thSAD (I think thSADC should always be half of thSAD), refinemotion, contrasharp, prefilter, str (for darker sources), blksize, etc. A little "?" mark next to each option would be nice with a mouse hover pop up that provides details on that option.
Changes for the Distributed Encoding model would be good too. The Primary server would dole out work to the clients. The RipBot install on the client would have something like a "DE Client" startup option and then RB will just start up minimized to the system tray with no Server processes started. The Primary RB server would then communicate with the RB Client to start up how many server processes along with the options for those server processes. The DE window can also have a per Client Thread Calibration button that you can click that will open up a window with two grainy 1 minutes sources, one for HD and one for 4K that the user can choose select one they want, then pop up a warning that this could take a long time, then the Primary server will send the Job to the RB Client, start up a single Server Process along with the number of threads to test for SMDegrain Heavy or MDegrain2-400, over and over until the optimum number of threads is found. Though some intelligence can be added, like start with half threads, then the lower quarter threads, upper quarter of threads, then fine tune it between the two quarters that had the best speed.
Atak, I know I've asked this before, but it would be nice to get RB up on Git along with the source and a issue tracker.
guest
14th June 2022, 04:06
Yea, I saw a 100% CPU as well when I had unlimited threads. A bottleneck is still taking place. By optimizing the threads, you are removing the bottleneck that was causing slower processing.
Hi, are you reading everything I've said ??
It's ONLY happening with the VERY very strong filter I am using, on ALL the other filters, they are all pretty much equal encoding speed.
So there must be something going on when you bump up the "tr", "thSAD" & "thSADC" levels/numbers.
Up to "tr=8" is fine...
But one thing I need to repeat, is, ALL the server PC's, regardless of any tweaks & tuning, take ALL their settings & instructions from the client PC.
So if you went to all the trouble of tuning every server, when running them as a client, is all over ridden, when they are used as a server, because the servers ONLY require the Encoding Server to do the DE process.
Now I'm pretty sure that running RipBot on a VM, wouldn't change the fundamentals, and I don't use VM's for ANYTHING !!
But there's obviously a significant difference between your hardware & setup, to what I have.
I have tried everything that has been suggested, and have not seen any significant change, so I think we need to put this topic to rest, it's just going around in circles.
guest
14th June 2022, 04:48
SMDegrain has been a game changer in quality, though not without its steeper learning curve. I have transitioned over to SMDegrain exclusively though using Pauly Dunnes Tools. Though I create my own scripts to use the CPU only instead of the GPU. SMDegrain is powerful and flexible enough to be the primary degrainer for RB. The options for Blur plus Contrasharp on very grainy sources produces output that defies what I would think would be possible.
WOW, I'm blown away with this post !!!
I knew when I started to implement SMDegrain into RipBot, that is was superior, and that was before I realised that there were options to use pre-filters as well.
It wasn't until I discovered Dogway's Doom9 page, that I realised all this.
https://forum.doom9.org/showthread.php?t=182881
I certainly can't take any credit for what SMDegrain can do !!!
But I have to say that there are a lot more pre-filters, than just 0,1 & 2, sure there are GPU based pre-filters that other users could benefit from.
There also many other filters available in my builds, too, not just focusing on SMDegrain.
And finally, since I first post my RipBot build(s), there has been 100's of downloads, the latest build posted only a week ago, has been downloaded over 30 times.
There has only been a few say thanks, but for Ryushin to say these words, is pretty amazing.
guest
20th June 2022, 04:26
Updated several of the SMDegrain based filters.
I have also added several Debanding Filters.
I have been doing some more tidying up of the Script & Custom folders.
now updated....
reallywonder
22nd June 2022, 17:13
Hi, first-time poster here. Been using this since about 2009 or so, love it.
I'm wondering if there's an option in the .ini for disabling the balloon notifications when encoding is done? I've searched the thread and didn't see anyone ask this before.
I auto-hide taskbar at top of screen, and the balloon makes the taskbar appear and is annoying, and sometimes, even after clearing the balloon, the taskbar "sticks" and doesn't go away even though it should (this is a MS problem).
I didn't see anything in the UI settings, and the .ini only really has stuff in there if something has been changed from default.
Atak_Snajpera
22nd June 2022, 18:37
Hi, first-time poster here. Been using this since about 2009 or so, love it.
I'm wondering if there's an option in the .ini for disabling the balloon notifications when encoding is done? I've searched the thread and didn't see anyone ask this before.
I auto-hide taskbar at top of screen, and the balloon makes the taskbar appear and is annoying, and sometimes, even after clearing the balloon, the taskbar "sticks" and doesn't go away even though it should (this is a MS problem).
I didn't see anything in the UI settings, and the .ini only really has stuff in there if something has been changed from default.
I will add that option in next version
guest
23rd June 2022, 01:42
Hi, first-time poster here. Been using this since about 2009 or so, love it.
I'm wondering if there's an option in the .ini for disabling the balloon notifications when encoding is done? I've searched the thread and didn't see anyone ask this before.
I auto-hide taskbar at top of screen, and the balloon makes the taskbar appear and is annoying, and sometimes, even after clearing the balloon, the taskbar "sticks" and doesn't go away even though it should (this is a MS problem).
I didn't see anything in the UI settings, and the .ini only really has stuff in there if something has been changed from default.
Welcome to the Forum...
You know, I have been using RipBot a lot longer than that, and I cannot relate to this "popup" problem.
What version of Windows are you using ??
guest
23rd June 2022, 01:44
I will add that option in next version
Wow, "next version", I'm REALLY looking forward to this, I hope it's soon.
reallywonder
23rd June 2022, 05:35
Welcome to the Forum...
You know, I have been using RipBot a lot longer than that, and I cannot relate to this "popup" problem.
What version of Windows are you using ??
still using 7, lol. not moving up to 10/11.
guest
23rd June 2022, 06:11
still using 7, lol. not moving up to 10/11.
OK, well that explains why I don't see it, I haven't used W7 for a L-O-N-G time.
RB works well with W10, but there a couple of small issues when using W11, but it all still works, in my experience, anyway.
I'm using W11 Workstation Pro.
Hopefully the "next version" will address a few things..
NiGHTsC
26th June 2022, 02:17
One quick and new AVS user
How do you rotate a video now?
I tried Turn180() in AviSynth but it gives error...
guest
26th June 2022, 04:48
One quick and new AVS user
How do you rotate a video now?
I tried Turn180() in AviSynth but it gives error...
I actually tried this last week, what you need to do is:-
video=Turn180(video)
NiGHTsC
26th June 2022, 06:20
I actually tried this last week, what you need to do is:-
video=Turn180(video)Thank you Thank you Thank you!!!
guest
11th July 2022, 03:39
Here's an update for July.
A few refresh's to the SMDegrain filters.
A few other updates & additions (see changelog txt)
redundant now, sorry guys.
Enjoy, and :thanks: to the over 40 ppl that downloaded the previous update, from June.
hardkhora
14th July 2022, 01:46
From 1.26.1 to 1.26.2 I see that the following were updated:
avisynth
plugins_jpsdr
hdrtools
masktools
mvtools
x265
mkvtoolnix
x264
mediainfo
ffmpeg
core
Any feature or bug changes to RipBot?
guest
14th July 2022, 02:47
From 1.26.1 to 1.26.2 I see that the following were updated:
avisynth
plugins_jpsdr
hdrtools
masktools
mvtools
x265
mkvtoolnix
x264
mediainfo
ffmpeg
core
Any feature or bug changes to RipBot?
First time poster, welcome...
Well, from what I can see, there aren't too many changes here (see RipBot's "About" tab for changelog).
https://i.imgur.com/chHmWgw.jpg
I for one was expecting some MAJOR changes, so a little underwhelming, I have to say.
I guess we'll just have to wait and see if Pauly Dunne, updates soon.
hardkhora
14th July 2022, 03:43
First time poster, welcome...
Well, from what I can see, there aren't too many changes here (see RipBot's "About" tab for changelog).
https://i.imgur.com/chHmWgw.jpg
I for one was expecting some MAJOR changes, so a little underwhelming, I have to say.
I guess we'll just have to wait and see if Pauly Dunne, updates soon.
Awesome, thank you for being nice and not calling me an idiot or something for not seeing the Changelog in the About section :D
Didn't even think to look there :stupid: LOL
guest
14th July 2022, 04:58
Well, finally "we" get an official update....
And yes, I have done my "magic", and have updated my build to the latest v1.26.2.
DO NOT enable auto update, as it will ruin nearly everything :(
https://www.mediafire.com/file/l7s36a6og5nqil0/RipBot264v1.26.2+(14-07-22).7z/file
So I would suggest that you download my latest build, DO NOT overwrite your current RipBot folder (yet).
Keep your existing RipBot264.ini & EncodingClient.ini (for reference), as there has been some subtle changes in the new update.
And sorry to the 18 ppl that downloaded my Tools update from just a few days ago.
guest
14th July 2022, 05:04
Awesome, thank you for being nice and not calling me an idiot or something for not seeing the Changelog in the About section :D
Didn't even think to look there :stupid: LOL
Hi hardkhora,
Wouldn't do that !!!
And tbh, if it wasn't for your post, we wouldn't have known about the update, or at least the 100's of ppl that use the Pauly Dunne build's, as Auto Update needs to be disabled.
So thankyou :)
Try the Pauly Dunne build, there are way more filtering options.
guest
14th July 2022, 05:57
Hey guy's,
I think I have discovered a problem, after applying the latest update.
Hopefully I'm wrong, BUT if you have Jobs queued, ready to go, created with v1.26.1, when using DE, the "server's" do not start encoding.
HOWEVER, if you refresh or reload the Job's, everything works properly.
:rolleyes::eek::mad::(
VirulentPip
17th July 2022, 07:24
Well, finally "we" get an official update....
And yes, I have done my "magic", and have updated my build to the latest v1.26.2.
DO NOT enable auto update, as it will ruin nearly everything :(
https://www.mediafire.com/file/l7s36a6og5nqil0/RipBot264v1.26.2+(14-07-22).7z/file
So I would suggest that you download my latest build, DO NOT overwrite your current RipBot folder (yet).
Keep your existing RipBot264.ini & EncodingClient.ini (for reference), as there has been some subtle changes in the new update.
And sorry to the 18 ppl that downloaded my Tools update from just a few days ago.
Thanks :)
I shouldn't have to copy over this install to the machines used for distributed encoding should I? The important parts for that are the tools which are copied over as normal?
guest
17th July 2022, 10:21
Thanks :)
I shouldn't have to copy over this install to the machines used for distributed encoding should I? The important parts for that are the tools which are copied over as normal?
Hi VirulentPip,
First of all, thanks for using my build(s).
I think you will have to update everything, because this is slightly different to the previous Tools folder installs, in that Atak has updated the "core", and the Encoding Client & Server parts.
As TDS mentioned in this post :-
https://forum.doom9.org/showthread.php?p=1971732#post1971732
I would suggest updating everything, just to be sure that everything is the same versions.
Shouldn't be a problem again, until those items are changed again.
However, depending how you use the DE computers, but in reality, they ONLY need the Encoding Server to work, but it's handy to have the whole RipBot app on each, so that it controls how many Servers it starts "automatically".
VirulentPip
17th July 2022, 17:32
Okay cool, will copy everything over anyways.
One feature I'm still waiting for from a core aspect is being able to select default audio track, really becoming a pain to go into mkvtoolnix post encoding to change and remux :(
Atak_Snajpera
17th July 2022, 20:32
First audio file in ripbot is always marked as default.
VirulentPip
17th July 2022, 20:48
First audio file in ripbot is always marked as default.
I just noticed this is now the case ! So happy now. It hasn't always been like this for me.. Track one and two have always both been set as default.
slalom
19th July 2022, 20:09
Track one and two have always both been set as default.
Yes, but the first track would play by default, maybe you wanted the second track default with the old version
guest
20th July 2022, 07:42
Yes, but the first track would play by default, maybe you wanted the second track default with the old version
I've rarely had issues with default audio tracks, and tbh, I don't understand the problem.
But I rarely encode audio thru RipBot anymore, as it doesn't convert to E-AC3, so I just add it later, after external conversion.
slalom
21st July 2022, 21:40
But I rarely encode audio thru RipBot anymore, as it doesn't convert to E-AC3, so I just add it later, after external conversion.
Use the 3-dot button to add it before video encoding
guest
22nd July 2022, 03:02
Use the 3-dot button to add it before video encoding
Yes you can, BUT RipBot can't do the conversion, so you've got to do it externally, anyway.
sapphiresky83
22nd July 2022, 15:29
Last night I went to open Ripbot264, instead of the program I received an updating status window. When that was done my shortcut no longer worked and when I ventured into my RipBot264 application folder the main application executable has been removed completely out of the folder, however, all of the other components of RipBot264 including the Encoding Server and Encoding Clients executable programs are still in the folder.
It looks like it just literally removed the main RipBot264 application file.
Upon replacing the main executable from a backup directory, Malwarebytes has grabbed the main executable as well as the Encoding Server executable as malware and specifically "Malware.Heuristic.1003"
https://i.ibb.co/Rhff9Lw/Rip-Bot-Malware.png (https://ibb.co/tZgg4yr)
Anyone else run into this or know what's up with that?
Thanks.
Atak_Snajpera
22nd July 2022, 16:20
https://www.virustotal.com/gui/file-analysis/ODI1MzE2YmNlZmMyOTYxZDllZTI0MWM0ZjJmZmRkNTg6MTY1ODUwMzQyOA==
It means that antiviruses just suck. Especially that Heuristic part. This literally happens every time I do an update. Uninstall that crap and just use build in antivirus in Windows.
Ryushin
22nd July 2022, 19:27
Hi Pauly,
I've been using your build and I've been encountering a problem when pulling in a ripped 4K UHD disc. If I use MakeMKV to extract the feature into a mkv file is pulls in fine.
Error:
https://i.postimg.cc/gwDK4Mpp/RB-Pauly-Dunne-Tools-Error.png (https://postimg.cc/gwDK4Mpp)
Renaming Pauly's eac3to and replace it with RipBot's allows it to work fine.
Pulling in ripped Blu-ray discs seems to work fine with Pauly's eac3to.
slalom
22nd July 2022, 22:18
Yes you can, BUT RipBot can't do the conversion, so you've got to do it externally, anyway.
I meant after the conversion
guest
23rd July 2022, 02:23
Hi Pauly,
I've been using your build and I've been encountering a problem when pulling in a ripped 4K UHD disc. If I use MakeMKV to extract the feature into a mkv file is pulls in fine.
Error:
https://i.postimg.cc/gwDK4Mpp/RB-Pauly-Dunne-Tools-Error.png (https://postimg.cc/gwDK4Mpp)
Renaming Pauly's eac3to and replace it with RipBot's allows it to work fine.
Pulling in ripped Blu-ray discs seems to work fine with Pauly's eac3to.
Hey Ryushin,
I'm rather confused with this comment, it's almost like you're commenting on a error, then you say that if you "rename" something, or overwrite it, it works.
It doesn't work on ripped 4K's but is OK with BluRay's...
I can't comment either way, as I don't "rip" 4K or BluRay disc's, and therefore, I don't have any issues.
But maybe it's a bug with the latest eac3to...
PS:- I just noted this info about eac3to :-
eac3to v3.36
* fixed: UHD Blu-Ray support didn't work with newer releases
* fixed: on some OSs there were crashes
* fixed: libav command line output hooking wasn't working properly
* added special handling for TrueHD seamless branching
* 2nd pass for audio gap fixing is auto-disabled for (UHD) Blu-Rays now
* libDcaDec: updated to 0.2.0
Ryushin
23rd July 2022, 11:28
Hey Ryushin,
I'm rather confused with this comment, it's almost like you're commenting on a error, then you say that if you "rename" something, or overwrite it, it works.
It doesn't work on ripped 4K's but is OK with BluRay's...
I can't comment either way, as I don't "rip" 4K or BluRay disc's, and therefore, I don't have any issues.
But maybe it's a bug with the latest eac3to...
PS:- I just noted this info about eac3to :-
The version in your 20220714 build is v3.36, but maybe there is a change in syntax that does not work with RB.
Yea, I read my post it it didn't make much sense. If I use MakeMVK to extract the video into a mkv file from the source disc then I can import that fine into RB. But if RB (eac3to) has to demux the video from a source disc then it gives me that error.
I'll look at the eac3to thread and see what I can find out.
guest
24th July 2022, 01:57
The version in your 20220714 build is v3.36, but maybe there is a change in syntax that does not work with RB.
Yea, I read my post it it didn't make much sense. If I use MakeMKV to extract the video into a mkv file from the source disc then I can import that fine into RB. But if RB (eac3to) has to demux the video from a source disc then it gives me that error.
I'll look at the eac3to thread and see what I can find out.
As it has been a L-O-N-G time since I ripped a BluRay disc, or even a DVD, wouldn't it be preferable to rip with a 3rd party app to "defeat" any encryption, etc, anyway ??
BTW, the odd time I used MakeMKV, I didn't like it :(
However, you DID mention that you found a work around, so just go with that, I'd suggest.
Ryushin
29th July 2022, 12:48
As it has been a L-O-N-G time since I ripped a BluRay disc, or even a DVD, wouldn't it be preferable to rip with a 3rd party app to "defeat" any encryption, etc, anyway ??
BTW, the odd time I used MakeMKV, I didn't like it :(
However, you DID mention that you found a work around, so just go with that, I'd suggest.
I rip the disc to my NAS using MakeMKV or AnyDVD to remove the encryption. Then I RB to import it and it demuxes it into it's components. I switched to using RB's eac3to and it is extracting discs fine. I have thousands of discs.
MakeMKV has become invaluable to me to extract episodes out of disc TV series and then I label them and batch import them into RB. MakeMVK also makes files with Dolby Vision in them and then I can use a third party tool to extract just the Dolby Vision out and then mux it back into my encoded versions.
phred1
3rd August 2022, 12:41
Convert HEVC to SDR?
I've got some files encoded in HEVC that i'd like to convert to SDR. How on earth do I setup RipBot to do this? I've google myself blue but cannot find the answer. Please help!
When trying to convert the files to x264 I get this purple tint. Tonemapp button for AviSynth is not clickable in GUI.
MediaInfo data:
Video
ID : 1
Format : HEVC
Format/Info : High Efficiency Video Coding
Format profile : Main 10@L5@High
HDR format : Dolby Vision, Version 1.0, dvhe.05.06, BL+RPU
Codec ID : V_MPEGH/ISO/HEVC
Duration : 33 min 35 s
Bit rate : 24.3 Mb/s
Width : 3 840 pixels
Height : 2 026 pixels
Display aspect ratio : 1.895
Frame rate mode : Constant
Frame rate : 23.976 (24000/1001) FPS
Color space : YUV
Chroma subsampling : 4:2:0
Bit depth : 10 bits
Bits/(Pixel*Frame) : 0.131
Stream size : 5.71 GiB (97%)
Language : English
Default : Yes
Forced : No
Ryushin
3rd August 2022, 12:54
Convert HEVC to SDR?
I've got some files encoded in HEVC that i'd like to convert to SDR. How on earth do I setup RipBot to do this? I've google myself blue but cannot find the answer. Please help!
MediaInfo data:
Video
ID : 1
Format : HEVC
Format/Info : High Efficiency Video Coding
Format profile : Main 10@L5@High
HDR format : Dolby Vision, Version 1.0, dvhe.05.06, BL+RPU
Codec ID : V_MPEGH/ISO/HEVC
Duration : 33 min 35 s
Bit rate : 24.3 Mb/s
Width : 3 840 pixels
Height : 2 026 pixels
Display aspect ratio : 1.895
Frame rate mode : Constant
Frame rate : 23.976 (24000/1001) FPS
Color space : YUV
Chroma subsampling : 4:2:0
Bit depth : 10 bits
Bits/(Pixel*Frame) : 0.131
Stream size : 5.71 GiB (97%)
Language : English
Default : Yes
Forced : No
According to that file it is Dolby Vision only and there is no HDR10 in it so you won't be able to convert it to SDR using RipBot's Tonemap feature in the avisynth options.
Using MediaInfo, my HDR look like this for a pure HDR10 file:
HDR format : SMPTE ST 2086, HDR10 compatible
And my Dolby Vision with HDR look like this:
HDR format : Dolby Vision, Version 1.0, dvhe.08.06, BL+RPU, HDR10 compatible / SMPTE ST 2086, HDR10 compatible
Atak_Snajpera
3rd August 2022, 13:53
Convert HEVC to SDR?
I've got some files encoded in HEVC that i'd like to convert to SDR. How on earth do I setup RipBot to do this? I've google myself blue but cannot find the answer. Please help!
When trying to convert the files to x264 I get this purple tint. Tonemapp button for AviSynth is not clickable in GUI.
MediaInfo data:
Video
ID : 1
Format : HEVC
Format/Info : High Efficiency Video Coding
Format profile : Main 10@L5@High
HDR format : Dolby Vision, Version 1.0, dvhe.05.06, BL+RPU
Codec ID : V_MPEGH/ISO/HEVC
Duration : 33 min 35 s
Bit rate : 24.3 Mb/s
Width : 3 840 pixels
Height : 2 026 pixels
Display aspect ratio : 1.895
Frame rate mode : Constant
Frame rate : 23.976 (24000/1001) FPS
Color space : YUV
Chroma subsampling : 4:2:0
Bit depth : 10 bits
Bits/(Pixel*Frame) : 0.131
Stream size : 5.71 GiB (97%)
Language : English
Default : Yes
Forced : No
Could you upload some sample to Mediafire or similar service? 100 MiB/200 MiB should be enough.
guest
3rd August 2022, 14:49
Convert HEVC to SDR?
I've got some files encoded in HEVC that i'd like to convert to SDR. How on earth do I setup RipBot to do this? I've google myself blue but cannot find the answer. Please help!
When trying to convert the files to x264 I get this purple tint. Tonemapp button for AviSynth is not clickable in GUI.
MediaInfo data:
Video
ID : 1
Format : HEVC
Format/Info : High Efficiency Video Coding
Format profile : Main 10@L5@High
HDR format : Dolby Vision, Version 1.0, dvhe.05.06, BL+RPU
Codec ID : V_MPEGH/ISO/HEVC
Duration : 33 min 35 s
Bit rate : 24.3 Mb/s
Width : 3 840 pixels
Height : 2 026 pixels
Display aspect ratio : 1.895
Frame rate mode : Constant
Frame rate : 23.976 (24000/1001) FPS
Color space : YUV
Chroma subsampling : 4:2:0
Bit depth : 10 bits
Bits/(Pixel*Frame) : 0.131
Stream size : 5.71 GiB (97%)
Language : English
Default : Yes
Forced : No
Would this be of any use at all :-
https://forum.doom9.org/showthread.php?t=183479
Also (just thinking out loud), what if you "convert" it to HDR10 first, then try going to SDR...but why do you want to ??
phred1
3rd August 2022, 15:26
According to that file it is Dolby Vision only and there is no HDR10 in it so you won't be able to convert it to SDR using RipBot's Tonemap feature
Thanx for the explanation! I'll give up on these files since it will require too much CLI for my taste :-/
cypher007
9th August 2022, 11:58
ive got a potential issue with the work hours function.
im running it on a Z490 board with i5 10400f and server 2022.
yesterday when i tried it it went to sleep at the right time then woke up about 30 secs later then shutdown again, it looped like this until i held the power button. now the soft raid 1 is resyncing due to the power cycles. anyway just wondering why it did this? do i need to change anything in the bios? is it because im using a server OS?
Atak_Snajpera
9th August 2022, 13:50
I suspect that some device is waking up your pc. Mouse, keyboard and so on... Windows should also have some logs showing what woke up your device.
https://www.minitool.com/news/find-what-woke-up-my-computer.html
cypher007
9th August 2022, 19:14
I suspect that some device is waking up your pc. Mouse, keyboard and so on... Windows should also have some logs showing what woke up your device.
https://www.minitool.com/news/find-what-woke-up-my-computer.html
wouldnt it stay on though if it was that?
the only thing apart from the lan, TV, AV reciever, UPS (via usb), is a logitech wireless keyboard.
ive monitored it tonight and it stays off for about 3 mins then powers up and before it even has time to send a post screen to my TV and beep it shutsdown. so maybe 5 secs?
ill trun off the keyboard and see if it stays off.
cypher007
9th August 2022, 22:46
my next attempt i will disconnect the ups.
Atak_Snajpera
9th August 2022, 23:57
Like i said you should check logs in event viewer.
When in sleep mode poweroff your pc and then check logs
cypher007
10th August 2022, 02:16
Like i said you should check logs in event viewer.
When in sleep mode poweroff your pc and then check logs
what command does ripbot use to put it into sleep mode? as server 2022 doesn't have sleep as an option when clicking the power button.
Atak_Snajpera
10th August 2022, 11:38
what command does ripbot use to put it into sleep mode? as server 2022 doesn't have sleep as an option when clicking the power button.
RipBot already puts your pc in sleep mode if you start encoding and you are outside the working hours. Just let it go to sleep mode and then power off after first loop.
Then open EVENT VIEWER an check this entry
https://i.postimg.cc/zXzGH8k3/Capture.png
cypher007
12th August 2022, 11:11
RipBot already puts your pc in sleep mode if you start encoding and you are outside the working hours. Just let it go to sleep mode and then power off after first loop.
Then open EVENT VIEWER an check this entry
https://i.postimg.cc/zXzGH8k3/Capture.png
ok found out it was the LAN adapter. changed to wake only on magic packet and disabled wake on pattern match and it worked.
next problem after going to sleep at 19:00 yesterday it didnt wake up this morning at 7:00. so tried WOL and it woke then shutdown. so pressed the power button and it woke from sleep. ripbot says its suspended till tomorrow at 7:00. so i tried changing my clock to 6:58 the next day and it goto 7:00 and nothing, that was while i was logged in not in sleep mode.
Atak_Snajpera
12th August 2022, 13:43
ok found out it was the LAN adapter. changed to wake only on magic packet and disabled wake on pattern match and it worked.
next problem after going to sleep at 19:00 yesterday it didnt wake up this morning at 7:00. so tried WOL and it woke then shutdown. so pressed the power button and it woke from sleep. ripbot says its suspended till tomorrow at 7:00. so i tried changing my clock to 6:58 the next day and it goto 7:00 and nothing, that was while i was logged in not in sleep mode.
This should fix that bug (replace that file)
https://www.mediafire.com/file/0ndbxwwnys9/RipBot264.exe/file
BTW. Thank you for reporting that issue.
guest
16th August 2022, 08:25
Hi Atak,
I have been using the Batch feature a lot recently, and I have several series that need a particular aspect ratio, and I cannot add it when using Batch, the closest is "Auto Height" which doesn't produce the desired results.
Could you please add an option like the Custom setting, in the single job settings :- Custom x,xx:1, so you type in exactly what is needed ??
EDIT:- I've just noticed that it would also be handy to be able to select a "Colour" option, so you could import a LUT (.cube).
EDIT #2:- So now that I am trying to use LUT's, I am now getting an error in Encoding Server...but this is when using a "custom" .cube created with Adobe Premiere :(
It will work in MPC-HC "preview", but when starting the encode, I get this :-
y4m [error]: bad sequence header magic
x264 [error]: could not open input file
cypher007
20th August 2022, 14:12
This should fix that bug (replace that file)
https://www.mediafire.com/file/0ndbxwwnys9/RipBot264.exe/file
BTW. Thank you for reporting that issue.
thanks for the quick reply. ill give it a go.
guest
21st August 2022, 14:46
I just got a small Auto update, and it's really only been "core.exe", and MKVToolNix 70.0 (which didn't download properly) but I can't figure out what might have changed.
Any explanation ???
Cheers
EDIT:- On further investigation, it appears that the LUT folder has been moved from the "Profiles" folder, to "AviSynth plugins/avscube/LUT", for whatever reason.
No changes in the Batch settings :(
cypher007
22nd August 2022, 10:40
This should fix that bug (replace that file)
https://www.mediafire.com/file/0ndbxwwnys9/RipBot264.exe/file
BTW. Thank you for reporting that issue.
is this file part of the updater now? as i ran up ripbot then let it update tried again and same problem. should i download the file separately and test?
guest
22nd August 2022, 11:42
is this file part of the updater now? as i ran up ripbot then let it update tried again and same problem. should i download the file separately and test?
The autoupdate is a newer version, so there's probably no point in getting that separate file.
cypher007
22nd August 2022, 11:46
The autoupdate is a newer version, so there's probably no point in getting that separate file.
i see, it seems the bug persists then. it went to sleep at 19:00 and didnt wake at 7:00.
one thought do i need to clear the schedule and reapply it? as i just updated ripbot and left the work hours as they were in the list.
guest
22nd August 2022, 11:58
i see, it seems the bug persists then. it went to sleep at 19:00 and didnt wake at 7:00.
one thought do i need to clear the schedule and reapply it? as i just updated ripbot and left the work hours as they were in the list.
TBH cypher007, I have no idea, I have never used this feature, and never will.
Clear the schedule, you've got nothing to lose...
I would suggest with all the issues you're having that you just forget about it, and do something else to control your encoding time.
cypher007
22nd August 2022, 12:49
hmm tried a test by changing the date and time and still doesnt wake. wonder if its because its server 2022?
Atak_Snajpera
22nd August 2022, 17:32
hmm tried a test by changing the date and time and still doesnt wake. wonder if its because its server 2022?
I only have access to win7 PC. It works fine. Btw. You do not have to change clock for testing purposes. Just manually edit WorkHours.csv file in notepad and then restart ripbot264.exe
for example
"2022-08-22 16:00";"2022-08-22 16:01"
"2022-08-22 16:02";"2022-08-22 16:03"
PC should go to sleep at 16:01 and then wake up at 16:02
guest
23rd August 2022, 07:45
Hi Atak,
I have been using the Batch feature a lot recently, and I have several series that need a particular aspect ratio, and I cannot add it when using Batch, the closest is "Auto Height" which doesn't produce the desired results.
Could you please add an option like the Custom setting, in the single job settings :- Custom x,xx:1, so you type in exactly what is needed ??
EDIT:- I've just noticed that it would also be handy to be able to select a "Colour" option, so you could import a LUT (.cube).
EDIT #2:- So now that I am trying to use LUT's, I am now getting an error in Encoding Server...but this is when using a "custom" .cube created with Adobe Premiere :(
It will work in MPC-HC "preview", but when starting the encode, I get this :-
y4m [error]: bad sequence header magic
x264 [error]: could not open input file
Well, it appears that what ever you did in the latest autoupdate has fixed the above error I was getting when using LUT's, so thanks for that.
If you could please add the above features to the Batch process, would finish it off nicely.
guest
25th August 2022, 02:27
Hi Atak,
So most of us are aware that Custom Scripts are generally for video adjustments etc, but I don't think you can create/change audio scripts the same way.
I tried to add a delay in the audio, and added it to an existing video custom script, AVSMeter didn't want to know about it, and just stopped.
In the "Show Audio Script" window, there are several # category's:-
#Audio Source
#Delay
#Tempo
#Normalize
# Audio Dub
Could you please advise how this might be achieved ??
Atak_Snajpera
25th August 2022, 16:44
I tried to add a delay in the audio, and added it to an existing video custom script, AVSMeter didn't want to know about it, and just stopped.
Add this to your custom script
#Return
DelayAudio(1)
slalom
25th August 2022, 19:09
That "Download cover" is not working again
guest
26th August 2022, 03:52
Add this to your custom script
#Return
DelayAudio(1)
Thank you for this :)
FYI, I have come across a bit of an issue when using VideoRedo...I have been working of a LOT of TV Series, and I like to remove the intro's & the end credits, and after processing them thru VRD, the clips develop a 200 millisecond delay (or advance) to both video and audio, which in itself, isn't an issue, as they cancelled themselves out, and it plays properly.
HOWEVER, if I then run them thru RB to "clean them up", RB imports the tracks, but it retains the 200 ms audio delay, BUT the video track doesn't.
So the end result is a sync problem :(
So after importing something like 20 - 30 episodes using Batch, I then have to go thru each Job, and manually change the Audio Delay setting, back to "0". (Would be nice to have this option in Batch, as well as the other's I mentioned in a previous post)
Having said all that, IF I do RB first, then VRD, it's not an issue, as I explained before.
So hopefully your suggestion will get around this issue.
UPDATE:- Well, to my shock & horror, this does not work, if I add those 2 lines to one of my Custom Scripts, and then run AVSMeter, it thinks about it for a second, then the "Abort button" changes to "Start".
However, if I copy the DelayAudio(1) under the existing #Return, it works (as far as AVSMeter is concerned).
guest
27th August 2022, 04:15
Hey guy's,
So today I have another updated build, with a few significant update's, and a few refreshed SMDegrain dependancy's.
But there is something new, for those of you that would like to be able to apply some limited colour grading, using LUT's.
Mainly "White Balance / Temperature" adjustment, which on some video's can make a HUGE difference...anyway, more info in the "changelog.txt"
Atak_Snajpera
27th August 2022, 10:51
our suggestion will get around this issue.
UPDATE:- Well, to my shock & horror, this does not work, if I add those 2 lines to one of my Custom Scripts, and then run AVSMeter, it thinks about it for a second, then the "Abort button" changes to "Start".
However, if I copy the DelayAudio(1) under the existing #Return, it works (as far as AVSMeter is concerned).
#AVSameLength
delayAudio(1)
guest
27th August 2022, 13:06
#AVSameLength
delayAudio(1)
Thanks again, I have been able to do a quick test on my little laptop, and I have noticed that this seems to be OK, however, it's fussy..if I add it to a particular Custom Script, it's doesn't add the DelayAudio(1) under #AVSameLength, (in the "Show Video Script", window) but in other scripts, it does add the value.
Not sure why, unless it's the complexity of some of the scripts...
:thanks:
Glarioo
30th August 2022, 19:04
Hey guy's,
So today I have another updated build, with a few significant update's, and a few refreshed SMDegrain dependancy's.
But there is something new, for those of you that would like to be able to apply some limited colour grading, using LUT's.
Mainly "White Balance / Temperature" adjustment, which on some video's can make a HUGE difference...anyway, more info in the "changelog.txt"
I have also done something else a little different this time, as mentioned in my last post, I have made 2 options available, you can either grab the complete Tools folder, or just the updated items within the Tools folder, so the choice is yours :)
Link to the complete Tools folder:-
https://www.mediafire.com/file/ra4s0f7z1mjyxrc/Tools+complete+(27-08-22).7z/file
Link to the Tools updates only:-
https://www.mediafire.com/file/zf1ugm03a6i9gxd/Tools+(updates+only)+(27-08-22).7z/file
Thanks Pauly
blacksapprow
2nd September 2022, 11:57
RipBot 1.26 is about 1,5 years old. When will the new version be available? Any workaround? I am personally looking forward to see AV1.
Note: I know updating....
blacksapprow
3rd September 2022, 10:40
I have a well, do not find it funny but, I am sometimes downloading Netflix films, sometimes Star Trek episodes, Next Gen, Voyager, Enterprise etc. with various downloading programs. Those are:
FlixiCam, Kigo, NoteBurner, SameMovie, TunePat (Those 5 are very similar to each other, their total bit rate is 7.500kbps) and FreeNetflix (this one have a bit higher total bit rate of 10.000kbps.) If you choose more than one language, total bit rate is again the same. Picture quality degrades with each additional dub.)
I want to ask, on which format to save. The file(s) not saved in real original, it depends on the program, the graphics card uses it's full decode branch.
There is typically 4 option, those are mp4 with h264, mp4 with h265, mkv with h264 and finally mkv with h265. For, future dub menu and subtitle changes I know MKVToolNix of course, for mp4 there is VideoReDo TVSuite, this one is a paid one.
For better compatibility I prefer h264 but, mp4 or mkv! Which one to choose? Can anyone help!
guest
3rd September 2022, 12:00
I have a well, do not find it funny but, I am sometimes downloading Netflix films, sometimes Star Trek episodes, Next Gen, Voyager, Enterprise etc. with various downloading programs. Those are:
FlixiCam, Kigo, NoteBurner, SameMovie, TunePat (Those 5 are very similar to each other, their total bit rate is 7.500kbps) and FreeNetflix (this one have a bit higher total bit rate of 10.000kbps.) If you choose more than one language, total bit rate is again the same. Picture quality degrades with each additional dub.)
I want to ask, on which format to save. The file(s) not saved in real original, it depends on the program, the graphics card uses it's full decode branch.
There is typically 4 option, those are mp4 with h264, mp4 with h265, mkv with h264 and finally mkv with h265. For, future dub menu and subtitle changes I know MKVToolNix of course, for mp4 there is VideoReDo TVSuite, this one is a paid one.
For better compatibility I prefer h264 but, mp4 or mkv! Which one to choose? Can anyone help!
Well, my 2 cents worth...however, it is entirely up to you what format you want to process all your files.
I too am doing a LOT of TV series at the moment, and I am doing most of them to x265 mkv.
I use MKVToolNix & VideoRedo (free) a LOT.
So it's up to you, everyone will have a different preference.
howzz
7th September 2022, 09:35
Yes, using RipBot all these years. It's excellent software.
All the above :)
I tried Safe Mode, and yep, RipBot closes fine. So I rebooted into Windows, and first started by closing everything in the System Tray. This is when I noticed that each time I started RipBot, the "NVIDIA Settings" tray icon would reappear.
So I tried stopping the Nvidia services one by one and found that the issue is with the "NVIDIA LocalSystem Container" which starts 3 x nvcontainer.exe background tasks. I can perform a reboot, stop only this single service, and RipBot closes normally.
It appears this service must be running for the NVIDIA GeForce Experience software to work. Not specifically sure why it causes RipBot to break or why RipBot starts the Nvidia tray icon etc.
But I have also replicated this on my old Intel computer that I've used RipBot on successfully for the past 8 years. As mentioned in my previous post, it also broke recently. I thought it was the update to 1.26.1 - but around the same time I had also put in a new GPU which updated the drivers so...
Thanks guys :)
i thought i'd drop a line and mention that this issue of Ripbot not closing properly and remains in the background still exist. i never noticed this issue until today when i was trying to troubleshoot a gameplay issue then noticed that Ripbot despite being closed using the x button, still remains in the tray. And when you click on the tray icon to bring it back up OR right click close the program it brings the program back up but freezes. only way to get out of this is by going into task manager and end the task manually.
yes, i have a Nvidia gpu but don't have Geforce Experience installed, as i hate that crap. How do we get around this? Nvidia driver is an essential part of many people's setup. Is there a way to code around this problem?
great software btw, been using it since 2008 or so or god knows how long. so thanks!
guest
7th September 2022, 10:47
i thought i'd drop a line and mention that this issue of Ripbot not closing properly and remains in the background still exist. i never noticed this issue until today when i was trying to troubleshoot a gameplay issue then noticed that Ripbot despite being closed using the x button, still remains in the tray. And when you click on the tray icon to bring it back up OR right click close the program it brings the program back up but freezes. only way to get out of this is by going into task manager and end the task manually.
yes, i have a Nvidia gpu but don't have Geforce Experience installed, as i hate that crap. How do we get around this? Nvidia driver is an essential part of many people's setup. Is there a way to code around this problem?
great software btw, been using it since 2008 or so or god knows how long. so thanks!
Hello,
Yes, I have this problem from time to time, and it's not necessarily a fault with nVidia "stuff", it's just something RB does from time to time, and yes, the only way to "kill" it is how you've been doing it.
However, maybe you could try a "clean" install of the nVidia drivers by using this little tool...
https://www.techpowerup.com/nvcleanstall/
rlev11
9th September 2022, 20:32
This is an FYI for everyone on something I have stumbled upon that had been an issue up until a few weeks ago. I am currently running 1 client and 8 additional encoding servers (all running Windows 11 now) using distributed encoding.
I started all of the encoding servers with a .bat script at startup with the following line
"encodingserver /minimize /restart-if-no-progress /priority normal" (with "/affinity 3FFC3FFC" added on 4k encodes on my 16core ryzens)
I was consistently having issues completing encoding jobs where one of the servers (any one of the 9) would either hang near the end of chunk and not restart, or would start an encode, then that encoding chunk line would go blank and it would start another encoding chunk leaving 1 blank. Of course when it got to the end it would just stop and never finish. The only way to get past this would be to abort the encode and then start it back up. Doing this about half the time it would just encode the 1 blank chuck and finish up, and the other half it would start the whole encode over from scratch. VERY Frustrating especially when doing some batch encoding unattended. I was also consistently getting "encoding server stalled" messages and the chunk would restart as it was supposed to. All the machines use nvme drives and 10gbit network So I figured it was not any kind if network or file share latency.
About 2 weeks ago I removed the /minimize from the servers batch script (and also the line that starts the server on the client PC) and low and behold I have not had 1 encode with an issue where before it was easily 1 in 5 would hang. Over the last couple of weeks I have definitely been encoding for well over 50 hours without a hiccup which finally made me believe it wasn't just luck. Nothing else has changed other than the encoding server window now showing on the desktop as opposed to sitting minimized in the system tray on all the systems. I still get an occasional "encoding server stalled" message and that chunk does automatically restart, but nowhere near the amount of the error messages from when it was running minimized in the system tray.
guest
10th September 2022, 01:59
This is an FYI for everyone on something I have stumbled upon that had been an issue up until a few weeks ago. I am currently running 1 client and 8 additional encoding servers (all running Windows 11 now) using distributed encoding.
I started all of the encoding servers with a .bat script at startup with the following line
"encodingserver /minimize /restart-if-no-progress /priority normal" (with "/affinity 3FFC3FFC" added on 4k encodes on my 16core ryzens)
I was consistently having issues completing encoding jobs where one of the servers (any one of the 9) would either hang near the end of chunk and not restart, or would start an encode, then that encoding chunk line would go blank and it would start another encoding chunk leaving 1 blank. Of course when it got to the end it would just stop and never finish. The only way to get past this would be to abort the encode and then start it back up. Doing this about half the time it would just encode the 1 blank chuck and finish up, and the other half it would start the whole encode over from scratch. VERY Frustrating especially when doing some batch encoding unattended. I was also consistently getting "encoding server stalled" messages and the chunk would restart as it was supposed to. All the machines use nvme drives and 10gbit network So I figured it was not any kind if network or file share latency.
About 2 weeks ago I removed the /minimize from the servers batch script (and also the line that starts the server on the client PC) and low and behold I have not had 1 encode with an issue where before it was easily 1 in 5 would hang. Over the last couple of weeks I have definitely been encoding for well over 50 hours without a hiccup which finally made me believe it wasn't just luck. Nothing else has changed other than the encoding server window now showing on the desktop as opposed to sitting minimized in the system tray on all the systems. I still get an occasional "encoding server stalled" message and that chunk does automatically restart, but nowhere near the amount of the error messages from when it was running minimized in the system tray.
Hi rlev11, wow, this is all very interesting !!!
1st of all, how many encoding servers do you run on each machine ??
I actually posted a comment some time back stating that I was very surprised that my 5900X was encoding the chunks substantially faster than my 3950X & 5950X (but only when using certain filters).
https://forum.doom9.org/showthread.php?p=1970064#post1970064 and several posts after this...
Another user suggested that I try changing the "Use multiple processing threads" setting, but that didn't have any effect.
I tried some thread setting within the x265 command line, that did have a limited effect. But I ended up just leaving it as is, and putting up with it.
Then Atak introduced a new setting in the encoder commands to specify how many threads you wanted to use (haven't tried that yet)
And now you're suggesting affinity settings.
In a previous post you showed /affinity FFFCFFFC, (this sets it @ 14 cores) and in this post it's changed to this /affinity 3FFC3FFC (this sets it @ 12 cores), so IS that a proper change, or a typo ??
What would 10 cores be ??
I also checked out that app you provided a link to, and I can't figure out how that works, but will have a closer look...but I could just try the ones you use, couldn't I :D
https://bitsum.com/tools/cpu-affinity-calculator/
And as for the "blank" chunks, that IS a very annoying situation that I think all RipBot users will be familiar with, as well as the randomness of whether it will just encode the "blank" chunks, or start over..so your suggestion sounds promising :)
EDIT:- Update. I just tried the /affinity FFFCFFFC with a 1080p encode, and it's a little slower (as you'd expect with 2 less cores being used), but I will give it a go on my next 4K encode.
EDIT:- Update #2, Just did a test on a 4K HDR clip, and found that the 12 core affinity setting was noticably faster on the 3950X, but still slower than the 5900X. There is also another "command" that I tried /x265-threads 12, but that was slower, again.
guest
10th September 2022, 05:56
Hey guy's,
I thought I do y'all a favour, as there is no direct way to get / download the very latest v1.26.2 build.
So this is a completely untouched, updated, clean build.
https://www.mediafire.com/file/caq1qeg8awfoh48/RipBot264v1.26.2+(10-09-22)+virgin.7z/file
And while I'm here, I am in the process of re hashing my "special" build, as there was a significant change to SMDegrain recently, that affects HDR processing, so once I've done the required updates, I will post it.
I would also really appreciate it, if a few of the 100's that have downloaded my builds, might mention what features & filters they prefer & use.
If you don't want to post a comment here, feel free to send me a PM.
There are a LOT of filter options, and TBH, I only use a couple of them.
It's just nice to have a big choice.
Atak_Snajpera
10th September 2022, 14:36
Maybe stupid windows 11 is suspending minimized EncodingServer.exe after sometime?
for calculating affinity you just need an old good calculator set in programmer mode
https://i.postimg.cc/Ghg5nVvS/Untitled-1.png
rlev11
10th September 2022, 23:40
TDS,
Yea, must be something different with the way windows 11 prioritizes resources. Windows 10 would do the same thing occasionally, but nowhere near what 11 was doing with the chunks hanging.
I only use 1 encoding window per machine. I found that I don't really gain that much firing up a second encoder. My cpu usage is up around 80% already on all the cores. Yea the 5900x is the real sweet spot for encoding, I have found that it is faster than the 3950x and is close to the 5950x. /affinity 3FFC3FFC is what I have been using now, only shutting off 2 cores, it still was slower than shutting off 4. On that affinity calculator, cpu 0 thru 31 would give you the 16 physical core count, so start by checking the boxes for 0 thru 31. Each of those cpu are actually "threads" so to shut off 1 core you would then uncheck cpu 0 and 1. so unchecking then cpu 0-1, 14-17 and 30-31, shuts off 2 physical cores on each die and gives the affinity mask I use
I did a test with all my machines. Doing a GOT episode which is 4k full screen (1.78-1) which will tax the encoders the most. The first number is FPS downsizing the encode to 1920x1080 with all cores active, Second number is 1080p with the 4 cores shut off on the 5950x and3950x using the affinity mask I posted before, Third number is 4k encode with all cores active, and last number is 4k with the 5950x and 3950x downgraded to 12 cores with the same affinity mask. This is doing a 10 bit x265 with mdegrain3 strength of 200 which is what I normally do things at. As you can see the 16 core Ryzens fall off a cliff with all the cores active doing 4k full frame.
5950x 19, 18, 1.6, 3.9
5900x 16, 16, 3.6, 3.6
3850x 16, 14, 1.2, 3.4
3900x 14, 14, 2.9, 2.9
5700G 11, 11, 2.4, 2.4
10850k 11, 11, 2.3, 2.3
I found the sweet spot for the 16 cores is running them at 12 core. That affinity mask will turn off 2 cores on each of the 2 dies to balance the thermals. My main thing I focused on with doing the 4k with the 16 core Ryzens is watching the encoding server window bar graph at the bottom. when all 16 cores are active doing 4k, the green and blue parts looks like the swiss alps, it bounces all over the place. Running only 12 cores it is nice and steady the whole way across.
Now my only remaining gripe. The last chunk is always bigger than all the other ones. I know it is just the remaining smaller chunk number added to the normal chunk size. Unfortunately, especially in 4k encodes, it always seems that my slowest machine is the one that has to do the much larger chunk at the end which can slow down the entire encode by a good amount. It would be nice if that last chuck was just the remaining bit, and not the remaining bit plus the normal chunk size. (I know, I am impatient).
And I am anxiously awaiting getting my hands on a 7950X....
guest
11th September 2022, 02:45
Hi rlev11, there's bound to be some differences between the 2 OS's, but generally they behave themselves pretty well, I've been using W11 since it first appeared...I just don't understand why some still prefer to "live in the past" with opted up W7 :rolleyes:
OK, so you state you generally only use 1 DE server per PC, I generally use 2, it can sometimes work out to be a little faster over the encoding job (in most cases).
What size chunks do you prefer ?, I generally go for the 1 minute (but I'm just testing a 2 minute chunk, right now).
The results are in on the 2 minute test, that last chunk is HUGE, why couldn't that have been a 2 minute chunk, and the balance being a smaller chunk ?? oh well. (but at least it finished on the faster pc ;) )
So those comparison numbers are very interesting, thanks for that, so if the 5900X is the sweetspot, what advantage will the 7950X be, if you have to throttle it ???...just get more 5900X's :confused:
I would be very interested in seeing how the 12th Gen Intel's would go here, with their strange "E" & "P" core setup...
Also a coincidence, I am currently encoding GoT 4K HDR10, but I am using this setting :-
video=SMDegrain(video,tr=3,thSAD=300,thSADC=150,thSCD1=400,thSCD2=130,contrasharp=true,prefilter=2,str=1.2,refinemotion=true) @ CRF 14
And a custom x265 profile :-
--level 6.2 --profile main10 --hdr10 --hdr10-opt --output-depth 10 --ctu 64 --merange 57 --high-tier --vbv-bufsize 800000 --vbv-maxrate 800000
And it looks GOOD :p
And I 100% agree that that last chunk is a constant PITA, why does it have to be like that...maybe ffmpeg (or whatever is used to split them) can't process less that 1 minute chunks :sly:
guest
11th September 2022, 03:09
Maybe stupid windows 11 is suspending minimized EncodingServer.exe after sometime?
for calculating affinity you just need an old good calculator set in programmer mode
Don't need a "old good calculator", W11 calculator does just fine :)
Atak_Snajpera
11th September 2022, 09:30
It would be nice if that last chuck was just the remaining bit, and not the remaining bit plus the normal chunk size. (I know, I am impatient).
Last chunk could have only 1 frame. Did you think about that? That's why last chunk is always longer to avoid that stupid case.
.I just don't understand why some still prefer to "live in the past" with opted up W7
I just don't understand why some still think that dumped down win11 is superior.
guest
11th September 2022, 10:21
Last chunk could have only 1 frame. Did you think about that? That's why last chunk is always longer to avoid that stupid case.
The chances of that situation happening would be VERY rare, as the last chunk is always nearly half as big again, than the second last chunk !!!
I just don't understand why some still think that dumped down win11 is superior.
I used your updated W7, sometime back, just to see how it would work for me, and I soon went back to W10, even with all the "bell's & whistles" that you've incorporated into W7, it's just not "modern" (up to date) enough.
You've built RipBot around W7, and due to that, certain functions don't work as you intended, anymore.
It's time it got a rebuild for working that little bit smoother with W10 & W11, it's the way of the future, W7 is just getting older & older (like all of us)
It's pretty obvious to a lot of us, that for whatever reason you've kind of lost interest in both RipBot & your Windows 7 Updater, you haven't made an appearance over there, since 2021 !!!, and RB is far from up to date as it could be.
I know it's free, and it still works VERY well, but it could be so much better.
Atak_Snajpera
11th September 2022, 10:57
The chances of that situation happening would be VERY rare, as the last chunk is always nearly half as big again, than the second last chunk !!!
When you code something you MUST always take edge cases into consideration! Soon or later you will have case where last chunk would be extremely short.
guest
11th September 2022, 11:18
When you code something you MUST always take edge cases into consideration! Soon or later you will have case where last chunk would be extremely short.
Well, it would certainly be rare, I'm sure it would be greatly appreciated if it could be changed, and IF that "edge case" occurs, then deal with it some other way, which could be simply to re-encode NOT using DE, so it wouldn't be an issue.
Wishful thinking :)
Atak_Snajpera
11th September 2022, 12:23
then deal with it some other way, which could be simply to re-encode NOT using DE, so it wouldn't be an issue.
Great. Solution which creates another problem. No thanks!
Remember. The simplest solutions are often the best. I'm not going to mess in that part of the code. Ain't broken , don't fix it!
guest
11th September 2022, 12:44
Ain't broken , don't fix it!
Well, if you don't want to mess with the code, maybe you need to consider putting your code on github, and give someone else a chance to "play".
I'm sure you could make a copy of the code, then make a change, let us user's give it a good test, and if it doesn't work, then, go back to what works...there's NOTHING to lose !!!
Atak_Snajpera
11th September 2022, 12:55
I doubt that you will find anybody who codes in Delphi7 here ;)
guest
11th September 2022, 13:24
I doubt that you will find anybody who codes in Delphi7 here ;)
Well you never know, somebody might leave a post saying that they're proficient with Delphi 7.
What would be really great, if you released a Beta version with some of these radical changes, and if it doesn't work it doesn't matter...
LigH
11th September 2022, 23:00
Maybe stupid windows 11 is suspending minimized EncodingServer.exe after sometime?
Windows 10 sometimes quits ProcessExplorer's tray icons even though it is registered as task manager...
Ryushin
13th September 2022, 21:55
I doubt that you will find anybody who codes in Delphi7 here ;)
Hi Atak,
I use to do some serious Pascal programming back in the 90's. I may do all my programming in Linux now, but I can take a look. Though the big issue though is getting access to the source code in case something happened to you. So Github/Gitlab/Gitea would be great.
And you're right about the edge cases. Having the software work is the end goal.
I can probably get Dephi7 running under WINE or I can do under in a Windows VM.
guest
14th September 2022, 01:34
I doubt that you will find anybody who codes in Delphi7 here ;)
Well, well, well, like I said previously, someone might leave a post saying that were familiar with Delphi7 :)
And tbh, I was actually thinking (hoping) that it might be Ryushin, and there you have it :)
Now I think you have some respect for Ryushin, just going on past posts & comments, and I know that you could definitely trust him with your well guarded code.
Who knows, you two "working" together could be REALLY good for the future of RipBot.
But of course it's all up to you, are you willing, or happy to release the code ??
Ryushin
14th September 2022, 13:37
And tbh, I was actually thinking (hoping) that it might be Ryushin, and there you have it :)
Who knows, you two "working" together could be REALLY good for the future of RipBot.
But of course it's all up to you, are you willing, or happy to release the code ??
Now hold on. I need to put a damper on your enthusiasm there. There is a lot more than Atak just simply releasing the source code. Atak's knowledge of encoding with all of it's deep level of details is a huge wealth of knowledge. I don't have that level of expertise, but that does not say I could not learn it. The big issue regarding all of this is time.
Atak started RB over 15 years ago. It has been one of his great works and passions. But I'm sure, over that 15 years, Atak's life has changed. He could very well be married and have a family. He may not have much time to work on RB any longer and as such there have been few updates.
Atak mentioned many years ago RB was written in Delphi Pascal. I've always had a soft heart towards pascal as I did my first serious programming with it on the Apple ][e all those years ago. But time marches on. I've lived mostly in the Linux world since '93. I've done most of my programming there. I mostly do Shell scripts as I pretty much do all my work over ssh, but occasionally I'll do some C, C++, Python, etc. I'm not a Windows programmer and I don't know the Windows APIs. I'm also not a programmer by trade. I'm a Systems Engineer that takes care of Firewalls, Servers, Networks, etc. I do some programming for creating tools to take care of servers and do my job. But these programs are short and act as a tools for what I need to do.
I'm also not retired. I have my wife who almost died a few years ago and had several years of recovery. I re-evaluated my life at that point and I choose to spend more time with her as life can be short and I don't want to get to my end of days and say I should have worked more. So I have enough on my plate with work, life, and everything else without taking on a huge project.
There are some big barriers to adding features to RB. The first thing though is Atak needs to put his project up on Github/Gitlab/Gitea, etc. That way in case something happens to him, his work is not lost to the world as he is the only one that has successfully created a not commercial solution for distributed encoding.
The other issue is the online updates. This is completely under his control. It would probably be better if the updates went over Git with RB branches of Stable and Dev. All the packages and tools could easily be updated in that manner and it would make it very easy to distribute.
Once the source code is released, then the real problem comes into being, and that is it is written in Delphi Pascal. Hardly no one writes in this any longer and as such it will act as a large barrier to attract developers. RB needs to be re-written from the ground up in a new language. Could be Visual Basic like StaxRip is using, or Python, .NET, etc. But once the source is available, we can see how Atak created everything and the level of knowledge and detail he learned to make RB work. Then perhaps RibBotNG (Next Gen) can be born.
So yea, I have great respect for Atak. This has been a massive project for one person and he has gone far above and beyond what most developers do to support his work. I just don't want to see RB go quietly into the dark. At least if the source code is available, then we can at least probably get it to compile and fix the occasional bug.
guest
15th September 2022, 07:14
Now hold on. I need to put a damper on your enthusiasm there. There is a lot more than Atak just simply releasing the source code.
Now, you did put your hand up about having some knowledge of Delphi. :D
I know it's not that simple, but if it were to happen, it has to be a good thing for RipBot's future.
You've definitely got some interesting thoughts about what could be done.
Ryushin
15th September 2022, 14:09
Now, you did put your hand up about having some knowledge of Delphi. :D
I said I knew the Pascal programming language. Delphi uses Pascal as it's base and extends on it. It's been so long since I programmed in Pascal it will be like learning the language all over again. What I'm saying is that I could learn it again.
guest
17th September 2022, 04:59
Hey guy's,
I have spent quite a bit of time re-hashing the structure of this build, so that "my" "Tool's" & "Scripts" are in their own folders.
Which of course means that ALL the scripts have had to be updated to the new "path's", which unfortunately means that NONE of them will work in previous builds. :confused:
This build has ALL the previous updates, as well as a couple of new updates (see changelog for more info), and this build is also complete, not just a "Tools" folder.
Also, there is a good chance that my 2 main folders could be copied into a standard RipBot, and work, as long as they are copied into the same locations !!!! (I haven't tested this idea).
https://www.mediafire.com/file/vfyjubhfi407k5w/RipBot264_PD+(17-09-22).7z/file
I will also be removing all but the "virgin" build of RipBot on MediaFire, to avoid confusion.
https://www.mediafire.com/file/caq1qeg8awfoh48/RipBot264v1.26.2_%252810-09-22%2529_virgin.7z/file
EDIT:- Don't forget to check the "RipBot264.ini", so that it suits your requirements & computer.
hardkhora
17th September 2022, 20:24
Is there an example text file of using the Automated Batch Mode and how to specify different encode settings?
Ideally this allows different AviSynth settings too?
guest
18th September 2022, 02:59
Is there an example text file of using the Automated Batch Mode and how to specify different encode settings?
Ideally this allows different AviSynth settings too?
Hi, tbh I haven't used this function, but since you've posed the question, I thought I'd take a look.
I think once you've set up a "Watched Folder", you can set up the Avisynth settings for that folder, and save it, and then you could add another folder with different settings...
once these are saved, a _RipBot264.ini file is saved to that "Watched Folder", and from there you can see the settings for that folder.
You could even edit the settings in the .ini file, too.
Also, you should be able to "recall" those saved folders in the future, by choosing the "Automated" mode in Batch, and then click on the saved folder and all the Avisynth settings will be shown.
I think it works a little bit like the Batch feature in Handbrake, so whatever files are in that "Watched Folder" get added to the Job queue, using the Avisynth settings for that particular folder.
I hope that makes sense to you, and you can figure out what you need to do....
I have just tried to use this, and it's not working, meaning it doesn't want to start encoding :(, but I will persist !!!
__________________
Not poorly done, just doin' it my way !!!
So much to do, and so little time :(
guest
24th September 2022, 06:32
Hi Atak,
I was just reading the changelog for v1.26.2, and there is an added item, which does not seem to appear where it says it should, under [settings] in the RipBot264.ini.
AllJobsFinishedNotification=0
https://i.imgur.com/chHmWgw.jpg
Does this have to added by the user ??
And in reference to my previous post, could you PLEASE give some instruction on how "Watched Folders" work ??
:thanks:
Atak_Snajpera
24th September 2022, 13:45
Does this have to added by the user ??
Yes..
guest
24th September 2022, 13:56
Yes..
Thankyou...
So I'm guessing that a value of 1, would be the same as not having it in the .ini at all.
And about Watched Folders, please ??
Atak_Snajpera
25th September 2022, 08:22
Thankyou...
So I'm guessing that a value of 1, would be the same as not having it in the .ini at all.
And about Watched Folders, please ??
No idea why you need a tutorial but here you go...
https://youtu.be/SkfVyWZzJPo
guest
25th September 2022, 08:26
No idea why you need a tutorial but here you go...
https://youtu.be/SkfVyWZzJPo
Thanks Atak,
and I'm not the only one that will appreciate this, just a shame it's in Polish, but I guess "we" can figure that out.
Cheers
PS:- is that Windows 11 I see there :D:sly:
Atak_Snajpera
25th September 2022, 08:29
Polish? Ripbot is in english. There is nothing to figure out.
PS:- is that Windows 11 I see there
Yes. Specially for you so you won't complain again that something "DOES NOT WORK" on you precious latest and greatest OS
guest
25th September 2022, 08:34
Polish? Ripbot is in english. There is nothing to figure out.
Yes. Specially for you so you won't complain again that something "DOES NOT WORK" on you precious latest and greatest OS
What is wrong with you....you just seem to be angry most of the time ??
I know RipBot is English, but all the drop down context menu's aren't !!!
Atak_Snajpera
25th September 2022, 08:37
I know RipBot is English, but all the drop down context menu's aren't !!!
Problem?
guest
25th September 2022, 08:40
Problem?
?????
Not a problem for you....
Have you "pulled" the video off YT ???
Glad I downloaded it :).....I have figured out the translation, and now it makes sense to me.
UPDATE:- I have tried this over & over & over again, it will import & prepare the chosen file, but it won't start encoding.
Does this use DE ???, 'cause even your YT clip showed it just doing the encode the "single" way.
gabbett1
30th September 2022, 13:44
Hello, I currently have AviSynthPlus_3.7.2_20220317 installed on my computer, but every time I try to start my encoding server a popup says: AviSynth+ MT x64 not installed.
I'm currently running RipBot264 version 1.26.2
gabbett1
30th September 2022, 21:33
It seems that you haven't installed it the way RipBot needs it to be...
Go to the Avisynth install folder, from the version you've got, there should be a Libraries folder, with x64 & x86 folders within that folder.
Copy these to the RipBot Tools, Avisynth folder, into the Libraries folder, overwriting what's in there, then run the install.cmd file.
If you follow that, that should fix your problem.
Or you could use this :-
https://www.mediafire.com/file/r5q2tueo5zb4xvr/Libraries.7z/file
Tried doing that and didn't seem to work.
guest
30th September 2022, 23:32
Tried doing that and didn't seem to work.
Well, that's very strange !!!
What version of Windows are you running ??
gabbett1
1st October 2022, 14:38
Hi gabbett1,
You must have something odd going on there...
May I suggest you at least try this :-
https://www.mediafire.com/file/caq1qeg8awfoh48/RipBot264v1.26.2_%252810-09-22%2529_virgin.7z/file
But I recommend you give this a try :-
https://www.mediafire.com/file/8xcys1o79sxfa60/RipBot264_PD_%252830-09-22%2529.7z/file
Good luck ;)
Thanks. Tried the first link and have the same issue.
I've been having all sorts of issues with this program. I can't even get my encoding server to work anymore. I'm thinking about reformatting my PC and starting from scratch. This is about the only thing I use this PC for and I can't even get the program to work right.
guest
1st October 2022, 14:59
Thanks. Tried the first link and have the same issue.
I've been having all sorts of issues with this program. I can't even get my encoding server to work anymore. I'm thinking about reformatting my PC and starting from scratch. This is about the only thing I use this PC for and I can't even get the program to work right.
Well, that's frustrating !!!!
I just did a fresh setup of Windows 11 22H2, and used the second link's build, and everything ran sweet, straight off :(
But, the first link's build should work OK as well.
I think a fresh setup is the way to go ;)
I can relate to the "pain" you're feeling, as most of my PC's are for RipBot, mainly.
JThomasG
1st October 2022, 18:59
Hi,
im running on Windows 11
EncodingServer is not starting as it should
i can see the process running but window/icon wont show up and encoding will not start on this computer.
do anyone have any ideas (i know it not much to go on :\ )
edit: additional info, looking at analyse chain work under encoding server process i can see that encoding server is waiting on asus framework thread for some reason...?
manually killing the asus framework process started encoding server. Perhaps something for Developer to look at?^
/tnx
Atak_Snajpera
1st October 2022, 23:18
Indeed you should Ask Asus why they block my software.
guest
2nd October 2022, 00:50
Hi,
im running on Windows 11
EncodingServer is not starting as it should
i can see the process running but window/icon wont show up and encoding will not start on this computer.
do anyone have any ideas (i know it not much to go on :\ )
edit: additional info, looking at analyse chain work under encoding server process i can see that encoding server is waiting on asus framework thread for some reason...?
manually killing the asus framework process started encoding server. Perhaps something for Developer to look at?^
/tnx
First off, welcome to the Forum....
Now this is all very interesting, like I said, I just installed Windows 11 22H2, and also installed all the Asus Amoury Crate, etc stuff, and I'm not having this issue, however....
I did a bit of Googling, and found this :-
https://rog.asus.com/forum/showthread.php?129795-FIX-FOUND!-The-system-is-busy-Please-wait-for-ASUS-Framework-Service-to-respond
Maybe there's a port assignment problem here, so it might depend on the IP addressing that you're using. That's my take on it, anyway.
I use 192.168.1.xxx on my home network, I use to use 192.168.0.xxx, and that led to some issues.
I was also going to suggest that it might nVidia driver's, or some Logitech driver's or even vc_redist.... but good on you for stating what YOUR problem was :)
Now, there are options within RipBot to be able to "set" the IP address, and the listening port, so maybe you could try that.
https://i.imgur.com/qeVyG18.jpg
Good luck.
gabbett1
2nd October 2022, 15:27
Well, that's frustrating !!!!
I just did a fresh setup of Windows 11 22H2, and used the second link's build, and everything ran sweet, straight off :(
But, the first link's build should work OK as well.
I think a fresh setup is the way to go ;)
I can relate to the "pain" you're feeling, as most of my PC's are for RipBot, mainly.
This is an "older" PC so Windows 11 is probably out. I may upgrade to Windows 10 vs what I'm running now (Win 7).
guest
3rd October 2022, 00:54
This is an "older" PC so Windows 11 is probably out. I may upgrade to Windows 10 vs what I'm running now (Win 7).
How old, is old ??
You CAN run W11 on an older PC, if you know what you're doing !!
You could also go for Windows 10 22H2 !
So it's interesting to know that you're having RipBot problems with Windows 7. :rolleyes:
gabbett1
3rd October 2022, 20:57
How old, is old ??
You CAN run W11 on an older PC, if you know what you're doing !!
You could also go for Windows 10 22H2 !
So it's interesting to know that you're having RipBot problems with Windows 7. :rolleyes:
I'm running an i7-7700k from 2017.
guest
4th October 2022, 05:20
For all of us that prefer to use Windows 10 or 11.
Here's another crazy feature request :-
Would there be any chance that RipBot could have the option of the Windows Dark Theme, it's SO much easier on the eye's.
archiel
11th October 2022, 13:19
Issue with eac3 audio - Resolved see edit below
I am trying to do a batch run on some that have been encoded using eac3, but the audio file, as shown in the encoding settings is the wrong length / not the same length as shown via MediaInfo before demuxing. This results in the output files with mismatched Audio/Video. It does not matter whether I select an audio profile or just copy the audio stream.
if I load MediaInfo data after the file is loaded by clicking on EAC3 in Encoding settings I see
Complete name : H:\Temp\RipBot264temp\job1\1_audio_English_DEFAULT.eac3
Format : E-AC-3
Format/Info : Enhanced AC-3
Commercial name : Dolby Digital Plus
File size : 64.0 MiB
Duration : 46 min 34 s
Overall bit rate mode : Constant
Overall bit rate : 192 kb/s
Audio
Format : E-AC-3
Format/Info : Enhanced AC-3
Commercial name : Dolby Digital Plus
Duration : 46 min 34 s
Bit rate mode : Constant
Bit rate : 192 kb/s
Channel(s) : 6 channels
Channel layout : L R C LFE Ls Rs
Sampling rate : 48.0 kHz
Frame rate : 31.250 FPS (1536 SPF)
Compression mode : Lossy
Stream size : 64.0 MiB (100%)
Service kind : Complete Main
However I just load the source file i get the following Audio data
ID : 2
Format : E-AC-3
Format/Info : Enhanced AC-3
Commercial name : Dolby Digital Plus
Codec ID : A_EAC3
Duration : 46 min 16 s
Bit rate mode : Constant
Bit rate : 192 kb/s
Channel(s) : 6 channels
Channel layout : L R C LFE Ls Rs
Sampling rate : 48.0 kHz
Frame rate : 31.250 FPS (1536 SPF)
Bit depth : 32 bits
Compression mode : Lossy
Stream size : 63.6 MiB (4%)
Language : English
Service kind : Complete Main
Edit- If I simply extract the audio file (to mka) from mvktoolnix or .eac3 via mkvextract I still see the file length changes. If I simply convert the audio in ffmpeg, then the audio length is unaffected.
I think I need to take this over to the mkvmerge forums, but is anyone is seeing his (can they replicate). If it is relevant I am running win11 22H2 pro.
The audio was fine, but the video was reporting the wrong frame rate, which resulted in an incorrect duration. At a guess the whole file had been cropped, but not on a key frame, so the first block had a different frame rate - the file showed as 24.131 instead of 23.976, the rate for the rest of the file.
Thanks, Archiel
(I did a quick search on eac3 but did not find anything, so apologies if this is already noted)
guest
12th October 2022, 00:35
Issue with eac3 audio
I am trying to do a batch run on some that have been encoded using eac3, but the audio file, as shown in the encoding settings is the wrong length / not the same length as shown via MediaInfo before demuxing. This results in the output files with mismatched Audio/Video. It does not matter whether I select an audio profile or just copy the audio stream.
I think I need to take this over to the mkvmerge forums, but is anyone is seeing this (can they replicate). If it is relevant I am running win11 22H2 pro.
Thanks, Archiel
(I did a quick search on eac3 but did not find anything, so apologies if this is already noted)
Interesting problem you've got there...any chance of uploading a sample or the whole file you're having problems with ??
archiel
12th October 2022, 10:02
Interesting problem you've got there...any chance of uploading a sample or the whole file you're having problems with ??
Turns out I was trying to solve the wrong problem, but your request to upload pushed me in the right direction. The issue was not with the audio but the video! It looks as if the original files were cropped, but not on a cut frame. [Only noticed this after cropping a section to upload and comparing the MediaInfo data.]
The result was that the file framerate was reported as 24.131 instead of 23.976 (the framerate for everything after the first block) and this meant that the file duration was read as being 46:16 rather than 46:34. Forcing the framerate to 23.96 (AviSynth > Output Speed > Assume -> 23.976) meant that the files can now be processed.
Now I just need to work out how to add the frame rate change as a script to batch processing.
archiel
12th October 2022, 12:30
Can anyone assist in how to change the Frame Rate for a batch processing?
I know I can edit each entry manually - go to AviSynth > Output Speed and select the required FPS and it appears that the only file modified in the temp job folder is info.txt
e.g. from-------------------to
67008----------------------67008
24.131201---------------23.976023
48000----------------------48000
6---------------------------6
134154240---------------135015788
1280-----------------------1280
720-------------------------720
YV12------------------------YV12
But what do I need to add as a script to do the conversion?
Atak_Snajpera
12th October 2022, 14:42
Can anyone assist in how to change the Frame Rate for a batch processing?
I know I can edit each entry manually - go to AviSynth > Output Speed and select the required FPS and it appears that the only file modified in the temp job folder is info.txt
e.g. from-------------------to
67008----------------------67008
24.131201---------------23.976023
48000----------------------48000
6---------------------------6
134154240---------------135015788
1280-----------------------1280
720-------------------------720
YV12------------------------YV12
But what do I need to add as a script to do the conversion?
1) Copy text below in notepad and save to Tools\AviSynth plugins\Scripts
#Custom
video=AssumeFPS(video,24/1.001)
2) Select your custom .avs script in batch mode
archiel
12th October 2022, 18:49
1) Copy text below in notepad and save to Tools\AviSynth plugins\Scripts
#Custom
video=AssumeFPS(video,24/1.001)
2) Select your custom .avs script in batch mode
Thanks for this - I had just worked it out from the manual, phrased slightly differently
video=AssumeFPS(video, 24000, 1001)
The only difference between this and a manual edit is that line 6 of the info.txt (in this case 134154240) is not altered.
What does line 6 represent and does this matter?
EDIT: Having checked the MediaInfo data for the output produced via script or manually, they appear to be identical (other than time stamps and IDs) so I assume that field 6 is not relevant.
Thanks, Archiel
cypher007
13th October 2022, 23:00
im trying to start encoding 4k uhd movies as close as i can to what the disc has in the way of picture. some discs have Dolby Vision which my TV supports. ive noticed some MKVs are now including the DV meta data. im using a PC with a nvidia 1650 hdmi 2.0 connection to the TV and mpc-hc and madvr to play MKVs. what id like to know is if ripbot can create an MKV from an original rip of the whole movie with the Dolby Vision working?
darkio
14th October 2022, 10:50
hi all.
Can ripbot264 use smooth frame interpolation > 50/59.94 fps like 100/119.88 fps ?
There is a good avisynth filtrr:
http://avisynth.nl/index.php/SVPflow
guest
15th October 2022, 01:03
hi all.
Can ripbot264 use smooth frame interpolation > 50/59.94 fps like 100/119.88 fps ?
There is a good avisynth filtrr:
http://avisynth.nl/index.php/SVPflow
Your definitely on the right track, with that link :)
So what exactly are you wanting to do ?? Slow down or speed up things ?
Would this also be something similar ??
https://github.com/Dogway/Avisynth-Scripts/blob/master/MIX%20mods/FrameRateConverterMIX.avsi
This the code / script from Staxrip, if it means much to anyone...
AddAutoloadDir("C:\StaxRip-v2.13.0-x64\Apps\FrameServer\AviSynth\plugins")
LoadPlugin("C:\StaxRip-v2.13.0-x64\Apps\Plugins\AVS\SVPFlow\svpflow1.dll")
LoadPlugin("C:\StaxRip-v2.13.0-x64\Apps\Plugins\AVS\SVPFlow\svpflow2.dll")
Threads = 8
super_params = "{pel:2,gpu:1}"
analyse_params = """{block:{w:16,h:16}, main:{search:{coarse:{distance:-10}}}, refine:[{thsad:200}]}"""
smoothfps_params = "{rate:{num:4,den:2},algo:23,cubic:1}"
super = SVSuper(super_params)
vectors = SVAnalyse(super, analyse_params)
SVSmoothFps(super, vectors, smoothfps_params, mt=threads)
#Prefetch(threads) must be added at the end of the script and Threads=9 after the source
Prefetch(threads)
If that could be edited to suit RipBot, then it's a new filter :)
cypher007
15th October 2022, 19:41
it looks like ripbot is removing the DV data from the mkv's im trying to recompress.
guest
16th October 2022, 01:16
it looks like ripbot is removing the DV data from the mkv's im trying to recompress.
Yes, this has been discussed before, and you might have to try another process...
Have a look at this :-
https://forum.doom9.org/showthread.php?t=183479
stretch009
16th October 2022, 21:09
I have 1.26.0. I saw mention of 1.26.2. Would appreciate if someone shared a link to it. Thanks.
guest
17th October 2022, 02:13
I have 1.26.0. I saw mention of 1.26.2. Would appreciate if someone shared a link to it. Thanks.
Hey stretch,
It's been a while since your last post, here.
So there are 2 ways to get 1.26.2 !!!
Enable autoupdate, OR go here :-
https://forum.doom9.org/showthread.php?p=1974392#post1974392
OR here :-
https://forum.doom9.org/showthread.php?p=1974691#post1974691
JThomasG
24th October 2022, 22:15
Hello,
has any one else encountered this issue when doing distributed encoding (and solved it)?
Sometimes a encodingserver stalls/get stuck on 99.x % for a chunk and doesn't finish?
i can manually stop the encoding for the specific server and let it continue on another chunk.
thanks.
guest
25th October 2022, 00:26
Hello,
has any one else encountered this issue when doing distributed encoding (and solved it)?
Sometimes a encodingserver stalls/get stuck on 99.x % for a chunk and doesn't finish?
i can manually stop the encoding for the specific server and let it continue on another chunk.
thanks.
So it appears that you have solved the problem you had in your first post, and now this is happening..... :(
Unfortunately, this can & does happen from time to time, and what you do is about the best way to "fix" it.
However, maybe you could try this (in the RipBot264.ini)
Server1CommandLine=/port 1000 /minimize /priority normal /restart-if-no-progress
It may not help, but it won't hurt.
Good luck.
JThomasG
25th October 2022, 09:42
Ok, thanks i will try that,
about the other issue for now im killing asusframework process that blocks encodingserver :)
Atak_Snajpera
26th October 2022, 14:54
Hello,
has any one else encountered this issue when doing distributed encoding (and solved it)?
Sometimes a encodingserver stalls/get stuck on 99.x % for a chunk and doesn't finish?
i can manually stop the encoding for the specific server and let it continue on another chunk.
thanks.
Can you check if ffmpeg.exe or x264_x64.exe/x265_x64.exe is still present in memory when this happens?
Ryushin
26th October 2022, 20:50
it looks like ripbot is removing the DV data from the mkv's im trying to recompress.
Use the DDVT Tool to do what you want:
https://forum.doom9.org/showthread.php?t=183479
l extract the Dolby Vision out from files created by MakeMKV, I select crop (if necessary) and save the RPU.bin. I create my encoded file using RipBot and I crop (if necessary). I then use DDVT to mux the RPU.bin file with my RipBot encode to create a new file with Dolby Vision in it. I'm not resizing the video (other than cropping) though as that will add another few steps to change the Dolby Vision for the smaller file.
guest
27th October 2022, 00:12
Use the DDVT Tool to do what you want:
https://forum.doom9.org/showthread.php?t=183479
l extract the Dolby Vision out from files created by MakeMKV, I select crop (if necessary) and save the RPU.bin. I create my encoded file using RipBot and I crop (if necessary). I then use DDVT to mux the RPU.bin file with my RipBot encode to create a new file with Dolby Vision in it. I'm not resizing the video (other than cropping) though as that will add another few steps to change the Dolby Vision for the smaller file.
Hey Ryushin,
You've been quiet for a while....
I was half expecting you to comment on this post, as I knew you'd done the same thing a while back...I actually pointed the op to that link, as well.
Good thing is, you've provided some instructions :)
Daringbaaz
27th October 2022, 04:37
Hi, Anyone Please Tell Me Why Encoding Server is Not Working on My "Win Server 2019" AMD EPYC 7502P,
Please Help Me to Solve The Issue,
Thanks
guest
27th October 2022, 06:14
Hi, Anyone Please Tell Me Why Encoding Server is Not Working on My "Win Server 2019" AMD EPYC 7502P,
Please Help Me to Solve The Issue,
Thanks
Need more info !!!
Atak_Snajpera
27th October 2022, 13:43
Hi, Anyone Please Tell Me Why Encoding Server is Not Working on My "Win Server 2019" AMD EPYC 7502P,
Please Help Me to Solve The Issue,
Thanks
Wait, I'm activating my crystal ball... This may take a while!
https://www.seekpng.com/png/full/16-163826_crystal-ball-royalty-free-vector-clip-art-illustration.png
JThomasG
28th October 2022, 12:23
Can you check if ffmpeg.exe or x264_x64.exe/x265_x64.exe is still present in memory when this happens?
I will check if x265_x64.exe is running on the PC that "stalls" next time it happens.
Aslo just something i noticed, perhaps just a coincidence (or a clue), but i changed from demux (TRUEHD / AC3) to core when selecting the audio it seems to be running fine... perhaps /restart-if-no-progress at work but i had this option set earlier also.
i did multiple encodes (10+) to x265 with core audio and didn't need to restart any of them :).
JThomasG
29th October 2022, 14:38
Hi, Anyone Please Tell Me Why Encoding Server is Not Working on My "Win Server 2019" AMD EPYC 7502P,
Please Help Me to Solve The Issue,
Thanks
not sure if it's the same issue or a Win server 2019 specific "security" issue but my issue when encoding server didn't start was that the process was waiting for another process to finish, i had to kill that process for encoding server to start, look in task mananger if you can see encoding server there and then go to details -> analyze wait chain.
rlev11
29th October 2022, 22:27
Hello,
has any one else encountered this issue when doing distributed encoding (and solved it)?
Sometimes a encodingserver stalls/get stuck on 99.x % for a chunk and doesn't finish?
i can manually stop the encoding for the specific server and let it continue on another chunk.
thanks.
As someone else has said, make sure that the /restart-if-no-progress is in the command line which starts all of the encoding servers. The other thing is make sure that the encoding server window is open on the desktop (not minimized in the tray). I have now done hundreds of encoding hours using 9 total machines all running Windows 11 and since I have made sure that the encoding server windows are visible on all the desktops, I have not had 1 instance of a batch encode hang on its own.
cypher007
2nd November 2022, 10:20
is there a way a pause button could be added? this would be useful when i want to put the computer to sleep for a bit. also had a conversion trashed as my laptop went to sleep when i pulled the power out to move it. i had the lid closed but had both when lid closed do nothing set and put computer to sleep both set to never.
guest
2nd November 2022, 11:47
is there a way a pause button could be added? this would be useful when i want to put the computer to sleep for a bit. also had a conversion trashed as my laptop went to sleep when i pulled the power out to move it. i had the lid closed but had both when lid closed do nothing set and put computer to sleep both set to never.
You must have a short memory...you've basically asked this question before.
see here :-
https://forum.doom9.org/showthread.php?p=1912195#post1912195
and the posts afterwards.
I VERY much doubt you will get a "Pause" button, the best way is to use Distributed Encoding, and if you accidently close the lid, or the power goes off, you will only lose what chunks were encoding at the time (more often than not).
Also, if you want to stop the encode, you need to be watching the encoding window, and when a chunk(s) finishes, you manually stop it, and then Abort the job...98 times out of 100, it will start up, where it left off.
cypher007
2nd November 2022, 13:19
You must have a short memory...you've basically asked this question before.
see here :-
and the posts afterwards.
I VERY much doubt you will get a "Pause" button, the best way is to use Distributed Encoding, and if you accidently close the lid, or the power goes off, you will only lose what chunks were encoding at the time (more often than not).
Also, if you want to stop the encode, you need to be watching the encoding window, and when a chunk(s) finishes, you manually stop it, and then Abort the job...98 times out of 100, it will start up, where it left off.
whoops well it was 2 years ago.
gabbett1
2nd November 2022, 16:14
I'm getting an eac3to v3.34 Demuxing error since the latest update.
eac3to v3.34
command line: "E:\Blue Ray Ripping\Tools\eac3to\eac3to.exe" "D:\Rip\BULLET_TRAIN" 1) 2: "C:\Temp\RipBot264temp\job1\video.mkv" -seekToIFrames 3: "C:\Temp\RipBot264temp\job1\audio_1_English.dtsma.w64" -down16 -dcadec 10: "C:\Temp\RipBot264temp\job1\10_subtitles_English_1080.sup" 11: "C:\Temp\RipBot264temp\job1\11_subtitles_English_1080.sup" 12: "C:\Temp\RipBot264temp\job1\12_subtitles_Chinese_1080.sup" 13: "C:\Temp\RipBot264temp\job1\13_subtitles_Chinese_1080.sup" 14: "C:\Temp\RipBot264temp\job1\14_subtitles_French_1080.sup" 15: "C:\Temp\RipBot264temp\job1\15_subtitles_Korean_1080.sup" 16: "C:\Temp\RipBot264temp\job1\16_subtitles_Portuguese_1080.sup" 17: "C:\Temp\RipBot264temp\job1\17_subtitles_Spanish_1080.sup" 18: "C:\Temp\RipBot264temp\job1\18_subtitles_Thai_1080.sup" 19: "C:\Temp\RipBot264temp\job1\19_subtitles_French_1080.sup" 20: "C:\Temp\RipBot264temp\job1\20_subtitles_English_1080.sup" 21: "C:\Temp\RipBot264temp\job1\21_subtitles_Chinese_1080.sup" 22: "C:\Temp\RipBot264temp\job1\22_subtitles_Korean_1080.sup" 23: "C:\Temp\RipBot264temp\job1\23_subtitles_Portuguese_1080.sup" 24: "C:\Temp\RipBot264temp\job1\24_subtitles_Spanish_1080.sup" 25: "C:\Temp\RipBot264temp\job1\25_subtitles_Thai_1080.sup" 1: "C:\Temp\RipBot264temp\job1\chapters.txt" -progressnumbers -log="C:\Temp\RipBot264temp\job1\demuxlog.txt"
------------------------------------------------------------------------------
M2TS, 1 video track, 7 audio tracks, 16 subtitle tracks, 2:06:32, 24p /1.001
1: Chapters, 17 chapters
2: h264/AVC, 1080p24 /1.001 (16:9)
3: DTS Master Audio, English, 5.1 channels, 16 bits, 48kHz
(core: DTS, 5.1 channels, 1509kbps, 48kHz)
4: AC3, English, 5.1 channels, 384kbps, 48kHz, -8ms
5: DTS Master Audio, French, 5.1 channels, 16 bits, 48kHz
(core: DTS, 5.1 channels, 1509kbps, 48kHz)
guest
3rd November 2022, 00:56
I'm getting an eac3to v3.34 Demuxing error since the latest update.
What update are you referring to ??
There hasn't been a significant update(s) since the end of August, and then eac3to wasn't in that round of updates.
What version of RipBot are you using, Atak's, or Pauly Dunne's ??
rlev11
3rd November 2022, 16:45
If you use distributed encoding, I suggest that you do not install the latest windows 11 patch KB5018496 and maybe the October .net KB5018341. This just came down on all my boxes and I am having issues again where a encoding server will start an encode chunk, immediately say it completed it, then the same server will start another chunk and continue on. In the distributed encoding window on the client. that server will have a blank area where it would normally say encoded xxxc frames at whatever fps. So the encode never finishes up with that chunk missing. The only way to get past it is to abort the encode and then start it back right away. Before these updates I recently have done hundreds of hours of encoding with absolutely Zero issues.
Sometime it will just encode that 1 missing frame but most of the time it starts the whole process over from scratch. It is now doing this on at least 50% of my encodes, so it pretty much kills any unattended encoding for now.
When I get some time I am going to roll back and do some troubleshooting to A. confirm it is that patch, and then B. see if I can figure out what the heck is going on
guest
4th November 2022, 00:31
If you use distributed encoding, I suggest that you do not install the latest windows 11 patch KB5018496 and maybe the October .net KB5018341. This just came down on all my boxes and I am having issues again where a encoding server will start an encode chunk, immediately say it completed it, then the same server will start another chunk and continue on. In the distributed encoding window on the client. that server will have a blank area where it would normally say encoded xxxc frames at whatever fps. So the encode never finishes up with that chunk missing. The only way to get past it is to abort the encode and then start it back right away. Before these updates I recently have done hundreds of hours of encoding with absolutely Zero issues.
Sometime it will just encode that 1 missing frame but most of the time it starts the whole process over from scratch. It is now doing this on at least 50% of my encodes, so it pretty much kills any unattended encoding for now.
When I get some time I am going to roll back and do some troubleshooting to A. confirm it is that patch, and then B. see if I can figure out what the heck is going on
I wonder if this is the update that gabbett1 was on about ??
I have both those updates, but unfortunately, I haven't done any encodes since....
It will be interesting to hear what you discover, and I will report back, after I've done some encodes.
rlev11
4th November 2022, 02:20
Removed all the updates since last week when everything was working OK on the client and all 8 servers. No change, still doing it. Next step was I restored my client to a full backup from last week before the updates and also half my servers to start. Started up a distributed encode with the restored client and only the restored servers and it still did it near the end of the encode.
I can't think of anything else it could be at the moment. None of the restored machines had any updates that snuck in after the restore.
Update:
Pretty sure something in the ripbot folder got screwed up somehow. Last thing I did was kill my Ripbot folder, download a fresh copy, and put my settings back in. Encoded about 8 hours now with only 1 glitch which I am going to call just an anomaly. After I get done with this latest round I'll start one by one putting the Windows11 updates back on and start testing .
cypher007
4th November 2022, 11:45
feature wanted: lock size "dual layer BD size".
it already has single layer as a setting but i would like dual layer for larger films that need more space/bitrate.
or if someone can tell me the number to put in here that will fill a dual layer BDR. ive tried finding it on the net and get all sorts of different answers.
Atak_Snajpera
4th November 2022, 12:18
https://forum.blu-ray.com/showthread.php?t=311517
guest
4th November 2022, 12:51
feature wanted: lock size "dual layer BD size".
it already has single layer as a setting but i would like dual layer for larger films that need more space/bitrate.
or if someone can tell me the number to put in here that will fill a dual layer BDR. ive tried finding it on the net and get all sorts of different answers.
God only knows why you want to still use "optical drives", they are such a thing of the past....
Anyway, as you can see, Atak has pointed you to some info, but in the drop down, you could simply type in double of the default, eg:- 47600 (twice the 23800, shown), you could probably go a little bit more.
Ryushin
4th November 2022, 17:31
Hi Atak,
I kind of remember a long time ago that AAC 7.1 was problematic with some decoders and that is why 5.1 was the standard.
I convert my 4K discs (thank goodness for optical media!) for home streaming that includes the full Dolby TrueHD+atmos 7.1 (or DTS:X), and I also make a streaming 2K version that uses AAC 5.1 from the TrueHD 7.1 track.
This morning I needed a quick AAC track from Top Gun Mavrick and I ran FFMPEG to convert the TrueHD track expecting to get a 5.1 track as the output. Low and behold, I had a 7.1 track. I tested it by playing it through my system and it turned out all the channels were behaving correctly.
Atak, can you please add an audio option for 7.1 AAC at 448K option for sources that have 7.1 or more channels.
I'm going to write a script to batch extract and convert the 7.1 track from my 4K home encodes and mux it into my 2K encodes.
gabbett1
4th November 2022, 18:58
What update are you referring to ??
There hasn't been a significant update(s) since the end of August, and then eac3to wasn't in that round of updates.
What version of RipBot are you using, Atak's, or Pauly Dunne's ??
Sorry I was away for a bit. Ripbot downloaded an update when I started it. I think I'm using Atak's version, but honestly I wasn't aware there were different ones. I'm currently running version 1.26.2. My system is running Windows 7.
guest
5th November 2022, 02:50
(thank goodness for optical media!)
Hey,
I think that was a bit of a dig at me...I'm sure you know what I meant !!!
I don't really know why you keep asking for additions, you know it'll never happen :rolleyes:
May I suggest you try this, and see if it suits your needs :-
https://forum.doom9.org/showthread.php?t=181206
I did a TrueHD to AAC 7.1 conversion with that app, and here's a comparison :-
Audio #1
ID : 2
Format : MLP FBA 16-ch
Format/Info : Meridian Lossless Packing FBA with 16-channel presentation
Commercial name : Dolby TrueHD with Dolby Atmos
Codec ID : A_TRUEHD
Duration : 3 h 2 min
Bit rate mode : Variable
Bit rate : 3 403 kb/s
Maximum bit rate : 5 616 kb/s
Channel(s) : 8 channels
Channel layout : L R C LFE Ls Rs Lb Rb
Sampling rate : 48.0 kHz
Frame rate : 1 200.000 FPS (40 SPF)
Compression mode : Lossless
Stream size : 4.34 GiB (6%)
Title : TrueHD Atmos 7.1
Language : English
Default : Yes
Forced : No
Number of dynamic objects : 11
Bed channel count : 1 channel
Bed channel configuration : LFE
Audio
Format : AAC LC
Format/Info : Advanced Audio Codec Low Complexity
Format version : Version 4
Codec ID : 2
Bit rate mode : Variable
Channel(s) : 8 channels
Channel layout : C L R Ls Rs Lw Rw LFE
Sampling rate : 48.0 kHz
Frame rate : 46.875 FPS (1024 SPF)
Compression mode : Lossy
Stream size : 1.44 GiB (100%)
guest
5th November 2022, 03:16
Sorry I was away for a bit. Ripbot downloaded an update when I started it. I think I'm using Atak's version, but honestly I wasn't aware there were different ones. I'm currently running version 1.26.2. My system is running Windows 7.
Well, like I said before, it's been a few months since the last update, surely, you've used RipBot more recently than that ??
And also, as you got an update you are clearly using Atak's version !!!
I can highly recommend Pauly's, I have been using it almost as long as it's been available, SO many more options !!!
https://forum.doom9.org/showthread.php?p=1974691#post1974691
Ryushin
5th November 2022, 14:55
Hey,
I think that was a bit of a dig at me...I'm sure you know what I meant !!!
May I suggest you try this, and see if it suits your needs :-
https://forum.doom9.org/showthread.php?t=181206
Yea, that was a dig at you. :)
I'm grateful for high quality optical media. Once I own it the studios can't take it away from me, unlike digital only.
My little one liner since I'm a linux guy:
ffmpeg -i Top_Gun_Maverick_2022_4K.mkv -c:a:1 aac -b:a 448k Top_Gun_Maverick_2022_4K.aac
guest
6th November 2022, 00:33
..............since I'm a linux guy:
Well, as you should know, I'm not...it's ALL Windows for me.
I can't use 7.1 anyway, so I will stick with E-AC3 5.1 conversions, for now.
Check this out, it sparked an interesting few comments...
https://forum.doom9.org/showthread.php?p=1977780#post1977780
gabbett1
7th November 2022, 17:18
Well, like I said before, it's been a few months since the last update, surely, you've used RipBot more recently than that ??
And also, as you got an update you are clearly using Atak's version !!!
I can highly recommend Pauly's, I have been using it almost as long as it's been available, SO many more options !!!
https://forum.doom9.org/showthread.php?p=1974691#post1974691
I downloaded Pauly's and I am getting this error now.
eac3to v3.34
command line: "C:\Users\Plex Server\Desktop\Dunne Ripbot\Tools\eac3to\eac3to.exe" "D:\Rip\BULLET_TRAIN" 1) 2: "C:\Temp\RipBot264temp\job1\video.mkv" -seekToIFrames 3: "C:\Temp\RipBot264temp\job1\audio_1_English.dtsma.w64" -down16 -dcadec 10: "C:\Temp\RipBot264temp\job1\10_subtitles_English_1080.sup" 11: "C:\Temp\RipBot264temp\job1\11_subtitles_English_1080.sup" 12: "C:\Temp\RipBot264temp\job1\12_subtitles_Chinese_1080.sup" 13: "C:\Temp\RipBot264temp\job1\13_subtitles_Chinese_1080.sup" 14: "C:\Temp\RipBot264temp\job1\14_subtitles_French_1080.sup" 15: "C:\Temp\RipBot264temp\job1\15_subtitles_Korean_1080.sup" 16: "C:\Temp\RipBot264temp\job1\16_subtitles_Portuguese_1080.sup" 17: "C:\Temp\RipBot264temp\job1\17_subtitles_Spanish_1080.sup" 18: "C:\Temp\RipBot264temp\job1\18_subtitles_Thai_1080.sup" 19: "C:\Temp\RipBot264temp\job1\19_subtitles_French_1080.sup" 20: "C:\Temp\RipBot264temp\job1\20_subtitles_English_1080.sup" 21: "C:\Temp\RipBot264temp\job1\21_subtitles_Chinese_1080.sup" 22: "C:\Temp\RipBot264temp\job1\22_subtitles_Korean_1080.sup" 23: "C:\Temp\RipBot264temp\job1\23_subtitles_Portuguese_1080.sup" 24: "C:\Temp\RipBot264temp\job1\24_subtitles_Spanish_1080.sup" 25: "C:\Temp\RipBot264temp\job1\25_subtitles_Thai_1080.sup" 1: "C:\Temp\RipBot264temp\job1\chapters.txt" -progressnumbers -log="C:\Temp\RipBot264temp\job1\demuxlog.txt"
------------------------------------------------------------------------------
M2TS, 1 video track, 7 audio tracks, 16 subtitle tracks, 2:06:32, 24p /1.001
1: Chapters, 17 chapters
2: h264/AVC, 1080p24 /1.001 (16:9)
3: DTS Master Audio, English, 5.1 channels, 16 bits, 48kHz
(core: DTS, 5.1 channels, 1509kbps, 48kHz)
4: AC3, English, 5.1 channels, 384kbps, 48kHz, -8ms
5: DTS Master Audio, French, 5.1 channels, 16 bits, 48kHz
(core: DTS, 5.1 channels, 1509kbps, 48kHz)
guest
8th November 2022, 01:56
I downloaded Pauly's and I am getting this error now.
eac3to v3.34
command line: "C:\Users\Plex Server\Desktop\Dunne Ripbot\Tools\eac3to\eac3to.exe" "D:\Rip\BULLET_TRAIN" 1) 2: "C:\Temp\RipBot264temp\job1\video.mkv" -seekToIFrames 3: "C:\Temp\RipBot264temp\job1\audio_1_English.dtsma.w64" -down16 -dcadec 10: "C:\Temp\RipBot264temp\job1\10_subtitles_English_1080.sup" 11: "C:\Temp\RipBot264temp\job1\11_subtitles_English_1080.sup" 12: "C:\Temp\RipBot264temp\job1\12_subtitles_Chinese_1080.sup" 13: "C:\Temp\RipBot264temp\job1\13_subtitles_Chinese_1080.sup" 14: "C:\Temp\RipBot264temp\job1\14_subtitles_French_1080.sup" 15: "C:\Temp\RipBot264temp\job1\15_subtitles_Korean_1080.sup" 16: "C:\Temp\RipBot264temp\job1\16_subtitles_Portuguese_1080.sup" 17: "C:\Temp\RipBot264temp\job1\17_subtitles_Spanish_1080.sup" 18: "C:\Temp\RipBot264temp\job1\18_subtitles_Thai_1080.sup" 19: "C:\Temp\RipBot264temp\job1\19_subtitles_French_1080.sup" 20: "C:\Temp\RipBot264temp\job1\20_subtitles_English_1080.sup" 21: "C:\Temp\RipBot264temp\job1\21_subtitles_Chinese_1080.sup" 22: "C:\Temp\RipBot264temp\job1\22_subtitles_Korean_1080.sup" 23: "C:\Temp\RipBot264temp\job1\23_subtitles_Portuguese_1080.sup" 24: "C:\Temp\RipBot264temp\job1\24_subtitles_Spanish_1080.sup" 25: "C:\Temp\RipBot264temp\job1\25_subtitles_Thai_1080.sup" 1: "C:\Temp\RipBot264temp\job1\chapters.txt" -progressnumbers -log="C:\Temp\RipBot264temp\job1\demuxlog.txt"
------------------------------------------------------------------------------
M2TS, 1 video track, 7 audio tracks, 16 subtitle tracks, 2:06:32, 24p /1.001
1: Chapters, 17 chapters
2: h264/AVC, 1080p24 /1.001 (16:9)
3: DTS Master Audio, English, 5.1 channels, 16 bits, 48kHz
(core: DTS, 5.1 channels, 1509kbps, 48kHz)
4: AC3, English, 5.1 channels, 384kbps, 48kHz, -8ms
5: DTS Master Audio, French, 5.1 channels, 16 bits, 48kHz
(core: DTS, 5.1 channels, 1509kbps, 48kHz)
OK, well that is pretty much exactly the same as the first error msg you posted, so at least it's consistent !!!
Are you having problems with other demuxing ???
Maybe there is something wrong with this particular file.
Would you be able to upload a sample ??
May I suggest that you run this thru MKVToolNix, and remove all the stuff you don't want with that, THEN see what RipBot does, OR you could run only the video track thru RipBot and mux it back with ToolNix, later,
Use ToolNix to demux the video track, then import it into RB.
guest
8th November 2022, 04:19
Hello,
For anyone that's confused how to get Distributed Encoding up and running.
Here's a good tutorial (not created by me), hopefully this will help.
You can either download the clip, or view in on YouTube.
https://www.mediafire.com/file/zq7q060voq5nc15/RipBot264_Distributed_Encoding_Setup.mp4/file
OR
https://www.youtube.com/watch?v=tftERYq94GE
guest
8th November 2022, 06:13
This time it's almost the whole thing, you will see when you unpack it.
Simply overwrite what you already have, although I would recommend creating another RipBot264 folder, and copy your particular files into it.
This will make the other updates, etc, now redundant, so they will be removed.
There has been a bit more "tidy up" with this build, plus more info, instructions & tutorials.
As always, read the changelog.txt.
EDIT:- I kind of stuffed up yesterday, there was some items that I had forgotten to clean out before posting, so this is a newer, cleaner build, sorry.
https://www.mediafire.com/file/b2nljjt86dl7nx5/RipBot264_PD+(08-11-22).7z/file
Noisrevid
9th November 2022, 06:29
@Atak_Snajpera or anyone who might know,
First question: I have 9 servers setup for Distributing Encoding... i'm using 2-pass encoding.. Does the FIRST pass of the encode take account of ALL chunks as a combined single source to know where to allocate bitrate or does it only do 1 pass against a single chunk and treat them individually?
Second question: One of my server for distributed encoding is problematic where it can't seem to always encode a chunk.. it only happens on one server and the error log says "Cannot open input file" over and over.. I'm assuming there's something strangely off with that one machine and hopefully it's an easy fix.
Third, not a question but a report that if you UNCHECK "Use Fast first pass in 2-pass mode" as in wanting to use a slow first pass, it completely breaks distributed encoding, all encoding servers throw an error of "Invalid argument, FPS 24" or something similar.. tried on two different input video files and breaks on both so assuming it's not my input files since re-checking "use fast 2pass" works fine again.
Thanks!
guest
9th November 2022, 07:33
@Atak_Snajpera or anyone who might know,
First question: I have 9 servers setup for Distributing Encoding... i'm using 2-pass encoding.. Does the FIRST pass of the encode take account of ALL chunks as a combined single source to know where to allocate bitrate or does it only do 1 pass against a single chunk and treat them individually?
Second question: One of my server for distributed encoding is problematic where it can't seem to always encode a chunk.. it only happens on one server and the error log says "Cannot open input file" over and over.. I'm assuming there's something strangely off with that one machine and hopefully it's an easy fix.
Third, not a question but a report that if you UNCHECK "Use Fast first pass in 2-pass mode" as in wanting to use a slow first pass, it completely breaks distributed encoding, all encoding servers throw an error of "Invalid argument, FPS 24" or something similar.. tried on two different input video files and breaks on both so assuming it's not my input files since re-checking "use fast 2pass" works fine again.
Thanks!
Hmm, well, as I don't use 2 pass (waste of time), I can't comment on that.
However, 9 servers !!! Are they all basically the same ??
The one that throws up the error, what is it ?? Would it be an older type ??
Are ALL the RipBot versions the same, and everything they need to run, installed ??
Having said that, in reality, the servers really only need EncodingServer.exe, but it's easier to have RipBot installed, on auto start with Windows, to bring the Encoding Servers online.
Atak_Snajpera
9th November 2022, 11:07
@Atak_Snajpera or anyone who might know,
First question: I have 9 servers setup for Distributing Encoding... i'm using 2-pass encoding.. Does the FIRST pass of the encode take account of ALL chunks as a combined single source to know where to allocate bitrate or does it only do 1 pass against a single chunk and treat them individually?
Second question: One of my server for distributed encoding is problematic where it can't seem to always encode a chunk.. it only happens on one server and the error log says "Cannot open input file" over and over.. I'm assuming there's something strangely off with that one machine and hopefully it's an easy fix.
Third, not a question but a report that if you UNCHECK "Use Fast first pass in 2-pass mode" as in wanting to use a slow first pass, it completely breaks distributed encoding, all encoding servers throw an error of "Invalid argument, FPS 24" or something similar.. tried on two different input video files and breaks on both so assuming it's not my input files since re-checking "use fast 2pass" works fine again.
Thanks!
1) https://forum.doom9.org/showthread.php?p=1729404#post1729404
2) check manually if you can open files stored in shared folder from that pc
3) I will check that this friday. Thanks.
Ryushin
9th November 2022, 13:06
Hi Atak,
I've been holding out upgrading to 1.26.2 as when I initial did it performance went way down and I reverted back to 1.26.1 as I did not have time to debug it.
I was able to clear out my queue and I decided to dig into the problem.
I enabled auto updates and let RB upgrade to the latest version. I created a 3 minute 4K test encode. Initially running it results in something like .26fps and it was going to take 90 minutes or so to complete the chunk.
Opening up the Encoding Server it shows that AVISynth prefetch threads was set to 24 (half of the 48 in the system) even though the Global variable has limit of 14 set. I had to modify the Encoder Server parameters and I added: /avisynth-prefetch-threads 14 to the settings and everything seems to be good again.
So my 3 minute encode time results with using SMDegrain Medium using the avisynth-prefetch-threads switch for v1.26.2:
v1.26.1: 6m:53s (global switch is working)
v1.26.2: 7m:00s (avisynth-prefetch-threads set)
So similar encode times between the versions when manually configuring the switch.
So the bug is the global thread setting not being honored in v1.26.2.
Noisrevid
9th November 2022, 16:03
1) https://forum.doom9.org/showthread.php?p=1729404#post1729404
2) check manually if you can open files stored in shared folder from that pc
3) I will check that this friday. Thanks.
Thanks Atak;
As far as number 1, the link you provided back from 2015 says BDO strength is default of 2 but it looks like the newest version caps at 1 (I can only go down from a max of 1). Was there a reason you capped it at 1 since then?
Number 2 is resolved, I believe there was a Windows issue that was resolved after a fresh install of Win11 - thanks.
Thanks,
Jay
gabbett1
9th November 2022, 20:05
OK, well that is pretty much exactly the same as the first error msg you posted, so at least it's consistent !!!
Are you having problems with other demuxing ???
Maybe there is something wrong with this particular file.
Would you be able to upload a sample ??
May I suggest that you run this thru MKVToolNix, and remove all the stuff you don't want with that, THEN see what RipBot does, OR you could run only the video track thru RipBot and mux it back with ToolNix, later,
Use ToolNix to demux the video track, then import it into RB.
It does look like it's only that rip I'm having issues with demuxing.
guest
10th November 2022, 00:57
Hi Atak,
I've been holding out upgrading to 1.26.2 as when I initial did it performance went way down and I reverted back to 1.26.1 as I did not have time to debug it.
I was able to clear out my queue and I decided to dig into the problem.
I enabled auto updates and let RB upgrade to the latest version. I created a 3 minute 4K test encode. Initially running it results in something like .26fps and it was going to take 90 minutes or so to complete the chunk.
Opening up the Encoding Server it shows that AVISynth prefetch threads was set to 24 (half of the 48 in the system) even though the Global variable has limit of 14 set. I had to modify the Encoder Server parameters and I added: /avisynth-prefetch-threads 14 to the settings and everything seems to be good again.
So my 3 minute encode time results with using SMDegrain Medium using the avisynth-prefetch-threads switch for v1.26.2:
v1.26.1: 6m:53s (global switch is working)
v1.26.2: 7m:00s (avisynth-prefetch-threads set)
So similar encode times between the versions when manually configuring the switch.
So the bug is the global thread setting not being honored in v1.26.2.
Now I'm not sure if this is exclusively for Ryzen CPU's, but you could try the Affinity command line option, if it works, it will probably be better than either of the other options, IMO.
guest
10th November 2022, 02:44
Hey guys,
I have a bit of a bonus for those of you that still prefer to use Atak's RipBot264 :)
I have compiled a collection of the main components of the App.
https://www.mediafire.com/file/xan2vqtc6z3zch4/RipBot264_%2528std%2529_Updates.7z/file
Updated the following :- (all are the latest currently available)
7z
Avisynth
AVSMeter
FFMpeg
L-Smash
Mediainfo
MKVToolNix
MPC
Tsmuxer
x264
x265
All you need to do is simply unpack the .7z, copy & overwrite ALL the folders & files into the Tools folder.
If you want to be pedantic, you could make a copy of the Tools folder before copying the above into it, just for safety's sake.
Once installed, you can confirm the new version info by going to the "Tools" tab under "Settings".
Tried & tested, ENJOY :)
I forgot to mention....
WARNING: "Auto updates" will play havoc with these updates, so just keep that in mind !!!
guest
10th November 2022, 02:48
So for the ppl that are brave & willing enough to give my builds a try, here's a small update for the build I posted just yesterday.
https://www.mediafire.com/file/xryk2hdls7n0wse/L-Smash_%2526_X265.7z/file
L-Smash & x265
Simply unpack the .7z, and copy the folders & files into the Tools folder.
guest
10th November 2022, 02:50
It does look like it's only that rip I'm having issues with demuxing.
Well, keep us posted, if you get it processed to your liking.
Oh, and how you got it done.
Atak_Snajpera
11th November 2022, 08:53
Thanks Atak;
As far as number 1, the link you provided back from 2015 says BDO strength is default of 2 but it looks like the newest version caps at 1 (I can only go down from a max of 1). Was there a reason you capped it at 1 since then?
Number 2 is resolved, I believe there was a Windows issue that was resolved after a fresh install of Win11 - thanks.
Thanks,
Jay
Re-scaled to safe limits.
Ryushin
11th November 2022, 13:24
Hi Atak,
Small feature request. Can you provide an option in the ini file to move the location of the Custom Scripts folder? I'd like to put it in the base of the RB folder instead of several folders deep. Also make things easier to deal with when using PD's tools folder.
Have you thought about updating the thread title to reflect your current RB version.
Atak_Snajpera
11th November 2022, 13:43
Hi Atak,
Have you thought about updating the thread title to reflect your current RB version.
After some time (5 years?) this forum locks title of the thread for good. I can't change it :(
Custom folder has to be in Tools folder for Distributed Encoding Mode. The same reason why I moved 3dlut folder from Profiles to AVScube.
guest
11th November 2022, 13:59
After some time (5 years?) this forum locks title of the thread for good. I can't change it :(
What if you "retired" this thread, and started a new one, with an updated name ???
Atak_Snajpera
11th November 2022, 14:29
What if you "retired" this thread, and started a new one, with an updated name ???
Just for a title? No...
Ryushin
11th November 2022, 14:35
After some time (5 years?) this forum locks title of the thread for good. I can't change it :(
Custom folder has to be in Tools folder for Distributed Encoding Mode. The same reason why I moved 3dlut folder from Profiles to AVScube.
Understandable. Maybe some future update can move the Scripts folder to the base of Tools then. It's just so many levels deep that unless you know exactly were it is, it is hard to find.
guest
11th November 2022, 14:55
Understandable. Maybe some future update can move the Scripts folder to the base of Tools then. It's just so many levels deep that unless you know exactly were it is, it is hard to find.
Just create a shortcut on the desktop for it.
kingpin
12th November 2022, 20:25
I found an issue with RipBot264 :
1. If the File name contains this symbol " – " (it's called En-dash as per
Google), then ripbot doesn't detect the Audio of the video file.
It says "No Audio" .
2. But If I remove the " – " from the file name, it starts
detecting the Audio.
guest
13th November 2022, 00:49
I found an issue with RipBot264 :
1. If the File name contains this symbol " – " (it's called En-dash as per
Google), then ripbot doesn't detect the Audio of the video file.
It says "No Audio" .
2. But If I remove the " – " from the file name, it starts
detecting the Audio.
Screenshots are attached as proof...Please fix this.
I bet you signed up, just to comment on this known problem.
You'll probably find that there are many other symbols/characters that will cause issues.
I doubt that it can be "fixed" within RipBot, however, you've already figured out how to work around this, so just go with that, and edit any file names with these symbols...easy peasy.
And, BTW, FYI, because you're new here, any attachments take "forever" to be approved, you would be a lot better off to use site's like "Imgur" or similar to post screenshots, etc.
kingpin
13th November 2022, 16:30
I bet you signed up, just to comment on this known problem.
You'll probably find that there are many other symbols/characters that will cause issues.
I doubt that it can be "fixed" within RipBot, however, you've already figured out how to work around this, so just go with that, and edit any file names with these symbols...easy peasy.
And, BTW, FYI, because you're new here, any attachments take "forever" to be approved, you would be a lot better off to use site's like "Imgur" or similar to post screenshots, etc.
Thanks for the Info. Yes, I am new here.
First, I was like, maybe it doesn't support some audio types or maybe something is wrong with these video files, so I tried to process them using other softwares then Ripbot. Then after a month of this, suddenly I figured out it was because of "File Name" ... I was like what a waste..lol.
Is there a section where I can find all the known issues ??
Also thanks for the "Imgur" tip, I will use that.
guest
14th November 2022, 01:00
Thanks for the Info. Yes, I am new here.
First, I was like, maybe it doesn't support some audio types or maybe something is wrong with these video files, so I tried to process them using other softwares then Ripbot. Then after a month of this, suddenly I figured out it was because of "File Name" ... I was like what a waste..lol.
Is there a section where I can find all the known issues ??
Also thanks for the "Imgur" tip, I will use that.
Hello, again,
You're welcome :)
So even though you're new to the forum, how long have you been using RipBot ??
Are you using Atak's original build's, or are you trying Pauly Dunne's ??
The latter is very update, & has many, many filtering options, I can fully recommend it.
As for a section on "known issues", sadly there really isn't one, and searching this thread looking for specific info is pretty time consuming.
Fortunately though, there aren't too many issues with RipBot, but there's ALWAY's room for improvement.
There is some info on the builds & some feedback comments here:-
https://www.videohelp.com/software/RipBot264/version-history#changelog
and here:-
https://www.videohelp.com/software/RipBot264
Good luck.
guest
14th November 2022, 02:59
Here we go yet again...
There has been a few new components become available in the 24 hours or so..
https://www.mediafire.com/file/c5tzrl0jkzy3mts/RipBot264_PD+Tools+(14-11-22).7z/file
So for the ppl that use my build, simply unpack, and overwrite ALL the files & folders, they will find their own "home".
And here's a twist, Atak had released an autoupdate, updating several components, BUT they are STILL not the latest available :(
So if anyone downloaded & installed the update package, for Atak's version, I posted a few days ago, you might have to repeat the process, IF you've allowed the autoupdate, if not, then it's not a problem.
Also, for those using Atak's build, there are some files in this update, that you can copy over.
eg:- MKVToolNix, MPC & x265, but that's ALL !!!!
PS:- I had a problem with the autoupdate download for Atak's version, there was/is a network problem somewhere, and I could not get it to download, even manually, and I still MANY times. (ffmpeg)
http://atak-snajpera.5v.pl/ripbot264update, doesn't reflect the latest version numbers & dates... :confused:
gabbett1
14th November 2022, 16:09
OK, well that is pretty much exactly the same as the first error msg you posted, so at least it's consistent !!!
Are you having problems with other demuxing ???
Maybe there is something wrong with this particular file.
Would you be able to upload a sample ??
May I suggest that you run this thru MKVToolNix, and remove all the stuff you don't want with that, THEN see what RipBot does, OR you could run only the video track thru RipBot and mux it back with ToolNix, later,
Use ToolNix to demux the video track, then import it into RB.
So it looks like it's any newer movie that it's having trouble demuxing. Not sure what to do.
guest
15th November 2022, 00:53
So it looks like it's any newer movie that it's having trouble demuxing. Not sure what to do.
Hi gabbett,
I recall another user was having an issue with something very similar to this, and I think he found a workaround...
Have a look here, and several posts after it...might help.
https://forum.doom9.org/showthread.php?p=1972082#post1972082
I think you will find that it's a problem with eac3to, not RipBot.
Ryushin
15th November 2022, 15:23
So it looks like it's any newer movie that it's having trouble demuxing. Not sure what to do.
If you are pulling in a 4K UHD ripped source then you will have to use the eac3to that comes with Atak's build. The newer versions of eac3to don't seem to work. It could be there is a new command line option that isn't being used by RB that is causing the error. Either way, rolling back to RB's eac3to version allows it to work fine.
gabbett1
15th November 2022, 17:07
If you are pulling in a 4K UHD ripped source then you will have to use the eac3to that comes with Atak's build. The newer versions of eac3to don't seem to work. It could be there is a new command line option that isn't being used by RB that is causing the error. Either way, rolling back to RB's eac3to version allows it to work fine.
No, I'm not doing 4K UHD disks.
guest
16th November 2022, 00:45
I downloaded Pauly's and I am getting this error now.
eac3to v3.34
command line: "C:\Users\Plex Server\Desktop\Dunne Ripbot\Tools\eac3to\eac3to.exe" "D:\Rip\BULLET_TRAIN" 1) 2: "C:\Temp\RipBot264temp\job1\video.mkv" -seekToIFrames 3: "C:\Temp\RipBot264temp\job1\audio_1_English.dtsma.w64" -down16 -dcadec 10: "C:\Temp\RipBot264temp\job1\10_subtitles_English_1080.sup" 11: "C:\Temp\RipBot264temp\job1\11_subtitles_English_1080.sup" 12: "C:\Temp\RipBot264temp\job1\12_subtitles_Chinese_1080.sup" 13: "C:\Temp\RipBot264temp\job1\13_subtitles_Chinese_1080.sup" 14: "C:\Temp\RipBot264temp\job1\14_subtitles_French_1080.sup" 15: "C:\Temp\RipBot264temp\job1\15_subtitles_Korean_1080.sup" 16: "C:\Temp\RipBot264temp\job1\16_subtitles_Portuguese_1080.sup" 17: "C:\Temp\RipBot264temp\job1\17_subtitles_Spanish_1080.sup" 18: "C:\Temp\RipBot264temp\job1\18_subtitles_Thai_1080.sup" 19: "C:\Temp\RipBot264temp\job1\19_subtitles_French_1080.sup" 20: "C:\Temp\RipBot264temp\job1\20_subtitles_English_1080.sup" 21: "C:\Temp\RipBot264temp\job1\21_subtitles_Chinese_1080.sup" 22: "C:\Temp\RipBot264temp\job1\22_subtitles_Korean_1080.sup" 23: "C:\Temp\RipBot264temp\job1\23_subtitles_Portuguese_1080.sup" 24: "C:\Temp\RipBot264temp\job1\24_subtitles_Spanish_1080.sup" 25: "C:\Temp\RipBot264temp\job1\25_subtitles_Thai_1080.sup" 1: "C:\Temp\RipBot264temp\job1\chapters.txt" -progressnumbers -log="C:\Temp\RipBot264temp\job1\demuxlog.txt"
------------------------------------------------------------------------------
M2TS, 1 video track, 7 audio tracks, 16 subtitle tracks, 2:06:32, 24p /1.001
1: Chapters, 17 chapters
2: h264/AVC, 1080p24 /1.001 (16:9)
3: DTS Master Audio, English, 5.1 channels, 16 bits, 48kHz
(core: DTS, 5.1 channels, 1509kbps, 48kHz)
4: AC3, English, 5.1 channels, 384kbps, 48kHz, -8ms
5: DTS Master Audio, French, 5.1 channels, 16 bits, 48kHz
(core: DTS, 5.1 channels, 1509kbps, 48kHz)
Just re-visiting this post, now I know my eyesight isn't that good anymore, but where is the actually error ??
One thing I've just noticed is the version number of eac3to, I'm pretty sure that Pauly's should be v3.36 ?? :confused:
And if you're not ripping UHD disc's, you must be getting them another way (won't say what way that is), but of course they would have been ripped to start with.
Did any of my suggestions work, meaning running it thru MKVToolNix first ??
Would you able to upload a sample of the movie you're having trouble with ??
You can do this with MKVToolNix if you want, just load the file, then go to the "Output" tab, choose the "splitting" option, and select or add the length or size you want it split to, then run it until it's completed at least one "chunk", then you can stop it.
Upload to Mediafire or similar.
Anyway, the choice is yours, if you have found a "workaround", then you're set to go, with future problems.
Cheers
guest
16th November 2022, 00:47
If you are pulling in a 4K UHD ripped source then you will have to use the eac3to that comes with Atak's build. The newer versions of eac3to don't seem to work. It could be there is a new command line option that isn't being used by RB that is causing the error. Either way, rolling back to RB's eac3to version allows it to work fine.
The mystery deepen's...
Problem is, he gets the same error with either Atak's or Pauly's, but I've just noticed an eac3to version discrepancy...(see my post, above)
gabbett1
16th November 2022, 05:17
Just re-visiting this post, now I know my eyesight isn't that good anymore, but where is the actually error ??
One thing I've just noticed is the version number of eac3to, I'm pretty sure that Pauly's should be v3.36 ?? :confused:
And if you're not ripping UHD disc's, you must be getting them another way (won't say what way that is), but of course they would have been ripped to start with.
Did any of my suggestions work, meaning running it thru MKVToolNix first ??
Would you able to upload a sample of the movie you're having trouble with ??
You can do this with MKVToolNix if you want, just load the file, then go to the "Output" tab, choose the "splitting" option, and select or add the length or size you want it split to, then run it until it's completed at least one "chunk", then you can stop it.
Upload to Mediafire or similar.
Anyway, the choice is yours, if you have found a "workaround", then you're set to go, with future problems.
Cheers
I don't know about the error. I'm not a code person. I just linked what the ripbot error displayed. I don't even know what version of eac3to I have. I'm assuming it came with the ripbot zip folder originally because I don't remember installing it. I did try to download a newer version. That did nothing. Assuming I even installed it properly.
I'm ripping Blueray's, not UHD's.
I really would prefer to fix my issue than to have some other workarounds. That's what I got this software for. It was an all in one.
guest
16th November 2022, 05:55
I don't know about the error. I'm not a code person. I just linked what the ripbot error displayed. I don't even know what version of eac3to I have. I'm assuming it came with the ripbot zip folder originally because I don't remember installing it. I did try to download a newer version. That did nothing. Assuming I even installed it properly.
I'm ripping Blueray's, not UHD's.
I really would prefer to fix my issue than to have some other workarounds. That's what I got this software for. It was an all in one.
OK, so there shouldn't be problem with Bluray's, then.
Yes, eac3to DOES come with RipBot, and if you want to update it yourself, you need get the download, https://www.videohelp.com/software/eac3to (unpack it, and then copy it into the "eac3to" folder inside RipBot, under the "Tools" folder, overwriting everything in there.)
What are you using to rip the disc's ??
What version of Windows are you running ??
Just trying to help :D
darkio
16th November 2022, 11:13
How ripbot264 correct colorimetry when upscaling dvd contents to 720p/1080p contents?
mediainfo report itu bt 601 after conversion from NTSC dvd for color matrix, transfer and colorprim.
I've forced in custom box x265 --colorprim bt709 --transfer bt709 --colormatrix bt709 but red is over satured.
No change in auto script from ripbot, no color conversion.
guest
16th November 2022, 11:28
How ripbot264 correct colorimetry when upscaling dvd contents to 720p/1080p contents?
mediainfo report itu bt 601 after conversion from NTSC dvd for color matrix, transfer and colorprim.
I've forced in custom box x265 --colorprim bt709 --transfer bt709 --colormatrix bt709 but red is over satured.
No change in auto script from ripbot, no color conversion.
Not 100% sure how to interpret what you want here...
You asked about LUT's 12 months or so ago, you could use a LUT, maybe.
https://forum.doom9.org/showthread.php?p=1951599#post1951599
Or under the Avisynth settings, go to the "Colours" setting, click on the and choose "ON", then a "Tweak" option will appear, where you can manually change the appropriate option, and test.
There's also an "ON (3DLUT)", where you can import a LUT.
darkio
16th November 2022, 11:40
yes you are right I asked for the luts about a year ago and it works very well, of that I am very happy.
What I ask now instead is how does ripbot264 correct the colorimetry after a dvd to hd conversion.
log file report:
1.26.0
Fixed: Correct colorimetry for DVD sources (ntsc->smpte170m,pal->bt470bg)
ok, sound is good, let's try!
After upscaling conversion, do not convert to itu bt 709 Rec. https://en.wikipedia.org/wiki/Rec._709, color space is the same of source.
guest
16th November 2022, 12:38
yes you are right I asked for the luts about a year ago and it works very well, of that I am very happy.
What I ask now instead is how does ripbot264 correct the colorimetry after a dvd to hd conversion.
log file report:
1.26.0
Fixed: Correct colorimetry for DVD sources (ntsc->smpte170m,pal->bt470bg)
ok, sound is good, let's try!
After upscaling conversion, do not convert to itu bt 709 Rec. https://en.wikipedia.org/wiki/Rec._709, color space is the same of source.
I'm pretty sure that RipBot does not this "automatically", you'd probably have to create a special custom filter, or use a suitable LUT.
Other than that, there is only the Colours setting I mentioned in the previous post.
darkio
16th November 2022, 13:01
HD itu 709 rec. example from mediainfo:
Color range : Limited
Colori primari : BT.709
Caratteristiche trasferimento : BT.709
Coefficienti matrici : BT.709v
SD content:
Color range : Limited
Colori primari : BT.601 NTSC
Caratteristiche trasferimento : BT.601
Coefficienti matrici : BT.601
Lut are unnecessary for colorimetry correction.
I'm asking conversion from bt 601 (smtpe170m/bt470bg) to itu 709 Rec. after upscaling. http://avisynth.nl/index.php/ColorMatrix
It seams ripbot simply "copy" source information in to converted dest. file.
When you use ripbot to convert uhd disk (hdr) to standard video (sdr), it can convert hdr signal itu bt 2020 rec to normal signal into itu bt 709 rec. When using dvd upscaling ripbot do not convert colorapace.
guest
16th November 2022, 13:06
When you use ripbot to convert uhd disk (hdr) to standard video (sdr), it can convert hdr signal itu bt 2020 rec to normal signal into itu bt 709 rec. When using dvd upscaling ripbot do not convert colorapace.
Yes, that is correct, and unless you can create your own special custom script that could do this conversion, you're out of luck, I'm afraid. :(
darkio
16th November 2022, 13:21
I'm hope atak fix this issue as soon as possible!
However, avisynth can do colormatrix conversion.
Thanks for your reply, friend. :)
edit: tmpgenc mast. work 7 can import ripbot264 avs file and transform colormatrix into itu bt 709.
https://i.postimg.cc/5QtLmRgB/Immagine.jpg (https://postimg.cc/5QtLmRgB)
guest
16th November 2022, 13:39
I'm hope atak fix this issue as soon as possible!
However, avisynth can do colormatrix conversion.
Thanks for your reply, friend. :)
I'm sure it can be done, I will have a look at it soon, and see what I can find.
You're welcome.
EDIT:- Good 'ole TMPGENC, I used to use that all the time, back in the day (earlier versions of cause.)
I think I may have found something that might do the job, I'll get back to you.
darkio
16th November 2022, 14:03
I have always considered doom9 a bible of useful encoding information and many good users available.
I think tmpgenc changes and adjusts the colorimetry automatically from the resolution of the input video.
Edit: rec 709 use full range (0-255), not limited like mpeg2 range (16-255).
Video
Formato : HEVC
Formato/Informazioni : High Efficiency Video Coding
Profilo formato : Main 10@L3.1@Main
Larghezza : 960 pixel
Altezza : 720 pixel
Rapporto aspetto visualizzazione : 4:3
Frame rate : 23,976 (24000/1001) FPS
Spazio colore : YUV
Croma subsampling : 4:2:0
Profonditā bit : 10 bit
Compressore : x265 3.5+9-bf91444e0:[Windows][GCC 10.2.0][64 bit] 10bit
Impostazioni compressione : cpuid=1111039 / frame-threads=3 / numa-pools=12 / wpp / no-pmode / no-pme / no-psnr / no-ssim / log-level=2 / input-csp=1 / input-res=960x720 / interlace=0 / total-frames=35208 / level-idc=0 / high-tier=1 / uhd-bd=0 / ref=4 / no-allow-non-conformance / no-repeat-headers / annexb / no-aud / no-eob / no-eos / no-hrd / info / hash=0 / no-temporal-layers / open-gop / min-keyint=24 / keyint=240 / gop-lookahead=0 / bframes=6 / b-adapt=2 / b-pyramid / bframe-bias=0 / rc-lookahead=25 / lookahead-slices=4 / scenecut=40 / hist-scenecut=0 / radl=0 / no-splice / no-intra-refresh / ctu=16 / min-cu-size=8 / rect / no-amp / max-tu-size=16 / tu-inter-depth=1 / tu-intra-depth=1 / limit-tu=0 / rdoq-level=2 / dynamic-rd=0.00 / no-ssim-rd / signhide / no-tskip / nr-intra=0 / nr-inter=0 / no-constrained-intra / strong-intra-smoothing / max-merge=3 / limit-refs=3 / limit-modes / me=3 / subme=3 / merange=9 / temporal-mvp / no-frame-dup / no-hme / weightp / no-weightb / no-analyze-src-pics / deblock=1:1 / sao / no-sao-non-deblock / rd=4 / selective-sao=4 / no-early-skip / rskip / no-fast-intra / no-tskip-fast / no-cu-lossless / no-b-intra / no-splitrd-skip / rdpenalty=0 / psy-rd=0.40 / psy-rdoq=1.00 / no-rd-refine / no-lossless / cbqpoffs=0 / crqpoffs=0 / rc=crf / crf=18.0 / qcomp=0.60 / qpstep=4 / stats-write=0 / stats-read=0 / vbv-maxrate=4096 / vbv-bufsize=4096 / vbv-init=0.9 / min-vbv-fullness=50.0 / max-vbv-fullness=80.0 / crf-max=0.0 / crf-min=0.0 / ipratio=1.40 / pbratio=1.30 / aq-mode=3 / aq-strength=0.90 / cutree / zone-count=0 / no-strict-cbr / qg-size=16 / no-rc-grain / qpmax=69 / qpmin=0 / no-const-vbv / sar=1 / overscan=0 / videoformat=5 / range=0 / colorprim=6 / transfer=6 / colormatrix=6 / chromaloc=0 / display-window=0 / cll=0,0 / min-luma=0 / max-luma=1023 / log2-max-poc-lsb=8 / vui-timing-info / vui-hrd-info / slices=1 / no-opt-qp-pps / no-opt-ref-list-length-pps / no-multi-pass-opt-rps / scenecut-bias=0.05 / hist-threshold=0.03 / no-opt-cu-delta-qp / no-aq-motion / no-hdr10 / no-hdr10-opt / no-dhdr10-opt / no-idr-recovery-sei / analysis-reuse-level=0 / analysis-save-reuse-level=0 / analysis-load-reuse-level=0 / scale-factor=0 / refine-intra=0 / refine-inter=0 / refine-mv=1 / refine-ctu-distortion=0 / no-limit-sao / ctu-info=0 / no-lowpass-dct / refine-analysis-type=0 / copy-pic=1 / max-ausize-factor=1.0 / no-dynamic-refine / no-single-sei / no-hevc-aq / no-svt / no-field / qp-adaptation-range=1.00 / scenecut-aware-qp=0conformance-window-offsets / right=0 / bottom=0 / decoder-max-rate=0 / no-vbv-live-multi-pass
Color range : Limited
Colori primari : BT.601 NTSC
Caratteristiche trasferimento : BT.601
Coefficienti matrici : BT.601
Wrong color space conversion.
Atak_Snajpera
16th November 2022, 17:32
Try this for now...
1) Add --colorprim bt709 --transfer bt709 --colormatrix bt709 to your encoding profile
2) Download ColorMatrix Plugin https://www.mediafire.com/file/aj88vdobroxjbkd/ColorMatrix26.7z/file
3) extract to Tools\AviSynth plugins folder
4) Add following lines to your script under #ColorSpace
#ColorSpace
LoadPlugin("C:\RipBot264\Tools\AviSynth plugins\ColorMatrix26\ColorMatrix64.dll")
ColorMatrix(mode="Rec.601->Rec.709")
darkio
16th November 2022, 17:41
Hi atak,
thanks for you reply.
As mentioned before, I've already edited my profile box with --colorprim bt709 --transfer bt709 --colormatrix bt709.
The main problem after conversion are over satured colours (especially red).
I hope to see little enanchement with color matrix conversion from bt 601/bt 709 and viceversa or other color space in the next update.
I will try to use exteenal plugin too.
:thanks:
Atak_Snajpera
16th November 2022, 17:58
You must use colormatrix as well not only switches for an encoder.
darkio
16th November 2022, 18:12
Video
Formato : HEVC
Formato/Informazioni : High Efficiency Video Coding
Profilo formato : Main 10@L3.1@Main
Larghezza : 960 pixel
Altezza : 720 pixel
Rapporto aspetto visualizzazione : 4:3
Frame rate : 23,976 (24000/1001) FPS
Spazio colore : YUV
Croma subsampling : 4:2:0
Profonditā bit : 10 bit
Compressore : x265 3.5+9-bf91444e0:[Windows][GCC 10.2.0][64 bit] 10bit
Impostazioni compressione : cpuid=1111039 / frame-threads=3 / numa-pools=12 / wpp / no-pmode / no-pme / no-psnr / no-ssim / log-level=2 / input-csp=1 / input-res=960x720 / interlace=0 / total-frames=35208 / level-idc=0 / high-tier=1 / uhd-bd=0 / ref=4 / no-allow-non-conformance / no-repeat-headers / annexb / no-aud / no-eob / no-eos / no-hrd / info / hash=0 / no-temporal-layers / open-gop / min-keyint=24 / keyint=240 / gop-lookahead=0 / bframes=6 / b-adapt=2 / b-pyramid / bframe-bias=0 / rc-lookahead=25 / lookahead-slices=4 / scenecut=40 / hist-scenecut=0 / radl=0 / no-splice / no-intra-refresh / ctu=16 / min-cu-size=8 / rect / no-amp / max-tu-size=16 / tu-inter-depth=1 / tu-intra-depth=1 / limit-tu=0 / rdoq-level=2 / dynamic-rd=0.00 / no-ssim-rd / signhide / no-tskip / nr-intra=0 / nr-inter=0 / no-constrained-intra / strong-intra-smoothing / max-merge=3 / limit-refs=3 / limit-modes / me=3 / subme=3 / merange=9 / temporal-mvp / no-frame-dup / no-hme / weightp / no-weightb / no-analyze-src-pics / deblock=1:1 / sao / no-sao-non-deblock / rd=4 / selective-sao=4 / no-early-skip / rskip / no-fast-intra / no-tskip-fast / no-cu-lossless / no-b-intra / no-splitrd-skip / rdpenalty=0 / psy-rd=0.40 / psy-rdoq=1.00 / no-rd-refine / no-lossless / cbqpoffs=0 / crqpoffs=0 / rc=crf / crf=18.0 / qcomp=0.60 / qpstep=4 / stats-write=0 / stats-read=0 / vbv-maxrate=4096 / vbv-bufsize=4096 / vbv-init=0.9 / min-vbv-fullness=50.0 / max-vbv-fullness=80.0 / crf-max=0.0 / crf-min=0.0 / ipratio=1.40 / pbratio=1.30 / aq-mode=3 / aq-strength=0.90 / cutree / zone-count=0 / no-strict-cbr / qg-size=16 / no-rc-grain / qpmax=69 / qpmin=0 / no-const-vbv / sar=1 / overscan=0 / videoformat=5 / range=0 / colorprim=1 / transfer=1 / colormatrix=1 / chromaloc=0 / display-window=0 / cll=0,0 / min-luma=0 / max-luma=1023 / log2-max-poc-lsb=8 / vui-timing-info / vui-hrd-info / slices=1 / no-opt-qp-pps / no-opt-ref-list-length-pps / no-multi-pass-opt-rps / scenecut-bias=0.05 / hist-threshold=0.03 / no-opt-cu-delta-qp / no-aq-motion / no-hdr10 / no-hdr10-opt / no-dhdr10-opt / no-idr-recovery-sei / analysis-reuse-level=0 / analysis-save-reuse-level=0 / analysis-load-reuse-level=0 / scale-factor=0 / refine-intra=0 / refine-inter=0 / refine-mv=1 / refine-ctu-distortion=0 / no-limit-sao / ctu-info=0 / no-lowpass-dct / refine-analysis-type=0 / copy-pic=1 / max-ausize-factor=1.0 / no-dynamic-refine / no-single-sei / no-hevc-aq / no-svt / no-field / qp-adaptation-range=1.00 / scenecut-aware-qp=0conformance-window-offsets / right=0 / bottom=0 / decoder-max-rate=0 / no-vbv-live-multi-pass
Color range : Limited
Colori primari : BT.709
Caratteristiche trasferimento : BT.709
Coefficienti matrici : BT.709
Colormatrix is ok,
testing better later
Atak_Snajpera
16th November 2022, 18:17
Limited is correct. HD footage always uses limited.
darkio
16th November 2022, 18:24
yes, of course, I'm wrong.
I have to add the setting to the script for each job queued manually and the commands from cli to do upscaling, right?
I hope it can be added later in the interface.
thanks for the help
guest
17th November 2022, 03:49
Try this for now...
1) Add --colorprim bt709 --transfer bt709 --colormatrix bt709 to your encoding profile
2) Download ColorMatrix Plugin https://www.mediafire.com/file/aj88vdobroxjbkd/ColorMatrix26.7z/file
3) extract to Tools\AviSynth plugins folder
4) Add following lines to your script under #ColorSpace
#ColorSpace
LoadPlugin("C:\RipBot264\Tools\AviSynth plugins\ColorMatrix26\ColorMatrix64.dll")
ColorMatrix(mode="Rec.601->Rec.709")
I have been playing around with this, and it seems to be very particular on the colorspace of the video being processed.
requirements:
YV12 & YUY2 Colorspace
And I was also having a problem with this call:-
ColorMatrix(mode="Rec.601->Rec.709")
shouldn't it be
video=ColorMatrix(video,mode="Rec.601->Rec.709")
like ALL the other RipBot scripts/calls ??
Ryushin
17th November 2022, 12:53
Hi Atak,
I'd like to submit a feature request for the batch processing. I use the batch a lot to pull in TV Episodes that I've used MakeMKV to rip the episodes from disks. I'd like to attach a cover to a batch import. I'd run one batch for season 1 and attach one cover to that, another batch and another cover, etc. Thanks Atak.
gabbett1
17th November 2022, 15:43
OK, so there shouldn't be problem with Bluray's, then.
Yes, eac3to DOES come with RipBot, and if you want to update it yourself, you need get the download, https://www.videohelp.com/software/eac3to (unpack it, and then copy it into the "eac3to" folder inside RipBot, under the "Tools" folder, overwriting everything in there.)
What are you using to rip the disc's ??
What version of Windows are you running ??
Just trying to help :D
And I greatly appreciate your help.
I'm running Windows 7. I'm using AnyDVD to rip the disks. I don't know if I copied the eac3to properly so I'm going to give that a try.
Thanks
Atak_Snajpera
17th November 2022, 19:17
And I greatly appreciate your help.
I'm running Windows 7. I'm using AnyDVD to rip the disks. I don't know if I copied the eac3to properly so I'm going to give that a try.
Thanks
Can you upload whole blu-ray folder somewhere? Obviously you would have to manually losslessly reduce size of each .m2ts file to something around 50-100MiB. You may try DGSplit of something similar.
guest
18th November 2022, 01:20
And I greatly appreciate your help.
I'm running Windows 7. I'm using AnyDVD to rip the disks. I don't know if I copied the eac3to properly so I'm going to give that a try.
Thanks
Hello again, gabbett1,
So before you do what Atak has suggested, I'd like to suggest that you use a different app to rip your disk's, just to be sure.
Also, is your Bluray optical drive in good condition, newish & "clean" inside ??
I would suggest that you try MakeMKV to rip your disc's...another user I know uses MakeMKV, and he hasn't reported any issues, and I know he's ripped 100's, if not 1,000's of Bluray's.
Maybe there's something about the newer disc's that AnyDVD is having a problem with, if as you say, the older disc's seem to be fine.
If you're interested in using MakeMKV, (latest build with registration)
https://www.mediafire.com/file/nq9e10egfb9qn76/MakeMKV.1.17.2.7z/file
Anyway, that's my 2 cents....I hated ripping Bluray's !!!!
Ryushin
18th November 2022, 13:14
And I greatly appreciate your help.
I'm running Windows 7. I'm using AnyDVD to rip the disks. I don't know if I copied the eac3to properly so I'm going to give that a try.
Thanks
I have used AnyDVD to rip thousands of discs and I've used MakeMKV to rip 1000's of discs. I've worn out three optical drives. :(
I do remember a few times with a few ripped discs, that they must have mastered it wrong in some manner, as RB (eac3to) could not demux it properly and RB always gave an error when it had finished ripping the disc. The way around this was to use MakeMVK to convert the main feature (or episodes) into mkv files which RB imported without issue.
You can use MakeMVK for free if you don't mind updating each 30 days with the key he provides. Though the software is so inexpensive, I would buy it as well. Both AnyDVD and MakeMKV have their places.
MakeMKV can't do DVD backups, but AnyDVD can. MakeMKV can rip the files into mkvs, but AnyDVD cannot. There are a few other differences between them that make owning both of them essential if you use optical media.
guest
18th November 2022, 13:24
I have used AnyDVD to rip thousands of discs and I've used MakeMKV to rip 1000's of discs. I've worn out three optical drives. :(
I do remember a few times with a few ripped discs, that they must have mastered it wrong in some manner, as RB (eac3to) could not demux it properly and RB always gave an error when it had finished ripping the disc. The way around this was to use MakeMVK to convert the main feature (or episodes) into mkv files which RB imported without issue.
You can use MakeMVK for free if you don't mind updating each 30 days with the key he provides. Though the software is so inexpensive, I would buy it as well. Both AnyDVD and MakeMKV have their places.
MakeMKV can't do DVD backups, but AnyDVD can. MakeMKV can rip the files into mkvs, but AnyDVD cannot. There are a few other differences between them that make owning both of them essential if you use optical media.
Nicely explained,
and it's always good to have a couple of different ways of doing the same process.
jlpsvk
21st November 2022, 01:37
any way to use ffmsindex instead lsmash???
guest
21st November 2022, 05:08
any way to use ffmsindex instead lsmash???
there certainly is :)
overwrite this field in RipBot264.ini if you want to use FFMS2 instead of L-Smash
Note that IF you do any changes within RipBot, and press APPLY, this will be overwritten, but all you'll need to do is copy it back :)
[DefaultVideoDecoder]
MPEG-2=FFMS2
VC-1=FFMS2
AVC=FFMS2
HEVC=FFMS2
OTHER=FFMS2
Is there any specific reason you don't want to use L-Smash ???
JThomasG
25th November 2022, 20:41
hi
is it possible to add a crop command line in ripbot, do i don't have to go in manually for each encode if i know they will all be the same.
lets say 10 left 10 right ?
if so how would the command line look like, and will i add it to the profile settings?
Thanks
guest
26th November 2022, 00:36
hi
is it possible to add a crop command line in ripbot, do i don't have to go in manually for each encode if i know they will all be the same.
lets say 10 left 10 right ?
if so how would the command line look like, and will i add it to the profile settings?
Thanks
So are you wanting to add this to the x264 and/or x265 profiles themselves ??
Not in the encoding script ??
If you want x264 or x265 to do it, go here, search & read :-
http://www.chaneru.com/Roku/HLS/X264_Settings.htm
https://x265.readthedocs.io/en/master/cli.html
eg: crop
Syntax: crop:left,top,right,bottom
in the avisynth script it looks like this :-
#Crop
video=Crop(video,10,0,-10,-0)
red is "left", green is "right"
You could create a custom script and add the above call, then you could access & change it to suit your needs, and leave the x264/x265 profiles alone.
guest
26th November 2022, 00:52
Hold the phone, we have a nice autoupdate :)
v1.26.3
Added: 7.1 AAC encoding via FFMPEG (new profile will show up after you manually delete Audio.txt file in Profile folder)
Added: Cover art can be also added in BATCH MODE
Added: Automatic color conversion rec.601->rec.709 when upscaling from SD to HD
Fixed: Main application RipBot264.exe was launching EncodingServer.exe without proper /avisynth-prefetch-threads switch
EDIT:- I have a couple of questions about this update.
Added: 7.1 AAC encoding via FFMPEG (new profile will show up after you manually delete Audio.txt file in Profile folder)
When I remove this, adding a new job it stalls at "Gathering Information", and any other queued Job won't open as it can't find the "audio.txt".
EDIT #2:- I started from scratch with RipBot264, deleted the "Audio.txt", it created a new "Audio.txt", but it was the same settings, do I need to create a job with 7.1 audio to start with ??
EDIT #3:- It's updated now :)
2.0 OPUS CODEC 64 kbps [abr]
2.0 OPUS CODEC 96 kbps [abr]
2.0 OPUS CODEC 128 kbps [abr]
5.1 OPUS CODEC 160 kbps [abr]
5.1 OPUS CODEC 240 kbps [abr]
5.1 OPUS CODEC 320 kbps [abr]
7.1 OPUS CODEC 224 kbps [abr]
7.1 OPUS CODEC 336 kbps [abr]
7.1 OPUS CODEC 448 kbps [abr]
2.0 FHG AAC-HE 64 kbps [abr]
2.0 FHG AAC-LC 96 kbps [abr]
2.0 FHG AAC-LC 128 kbps [abr]
5.1 FHG AAC-HE 192 kbps [abr]
5.1 FHG AAC-LC 256 kbps [abr]
5.1 FHG AAC-LC 320 kbps [abr]
7.1 FFMPEG AAC 384 kbps [abr]
7.1 FFMPEG AAC 448 kbps [abr]
7.1 FFMPEG AAC 640 kbps [abr]
2.0 FFMPEG AC3 192 kbps [cbr]
2.0 FFMPEG AC3 224 kbps [cbr]
2.0 FFMPEG AC3 256 kbps [cbr]
5.1 FFMPEG AC3 384 kbps [cbr]
5.1 FFMPEG AC3 448 kbps [cbr]
5.1 FFMPEG AC3 640 kbps [cbr]
Now all we need is 5.1 E-AC3 conversion with FFMPEG, up to 1536 kbps, and 7.1 AC3 !!!
Added: Automatic color conversion rec.601->rec.709 when upscaling from SD to HD
Where is this option ??
guest
26th November 2022, 02:58
For those users that want a clean install of the latest build provided by Atak, without having to start from scratch with v1.26.0, and then update it.
https://www.mediafire.com/file/c1rko1406yev7jl/RipBot264v1.26.3_%2528virgin%2529.7z/file
All you need to do is keep your RipBot264.ini & EncodingClient.ini from your working/current version.
guest
26th November 2022, 03:13
This will bring you up to date to v1.26.3
And an Avisynth update as well (read the changelog)
simply unpack, and overwrite the folders & files !!
https://www.mediafire.com/file/1grrvr360fgpk30/RipBot264_PD+(26-11-22).7z/file
Ryushin
26th November 2022, 13:45
Thank Atak for the update and the new features. I appreciate it.
If you have time would be nice to have SMDegrain replace MDegrain. The results are just staggering and I resisted doing it for so long because I thought MDegrain did such a good job it could not really improve that much with SMDegrain. SMDegrain's output is so much improved it's staggering. It's like the difference MDegrain made over HQDN3D and that I would never go back to HQDN3D after seeing the results for MDegrain. Now SMDegrain has made MDegrain obsolete.
Now I'm at the point where the output is so clean with SMDegrain I think something must be wrong as the file sizes are so much smaller and I must have lost detail. Every detailed comparison I've made shows that I was wrong and the output from SMDegrain has not only removed the grain, but since the grain is removed, details actually stand out and everything appears crisper. I've actually started re-encoding older films and watching them again such as The Terminator, The Edge, etc. just because the difference in detail is so dramatic it is like experiencing the film all over again and it is a joy to watch.
SMDegrain also does not produce the detail blur I saw with MDegrain3 in a characters face when they turned their head.
The only tweak I have started doing is blksize=8 when dealing with video that has a lot of dark scenes in it.
Please replace MDegrain with the following SMDegrain strength settings:
Light: SMDegrain(video,tr=2,thSAD=200,thSADC=100,contrasharp=true,prefilter=0,refinemotion=true)
Medium: SMDegrain(video,tr=4,thSAD=400,thSADC=200,contrasharp=true,prefilter=1,refinemotion=true)
Strong: SMDegrain(video,tr=8,thSAD=800,thSADC=400,contrasharp=true,prefilter=2,refinemotion=true)
Thanks again Atak for everything.
JThomasG
26th November 2022, 18:01
Hi,
just an fyi
i got unable to open input file <-> from all encodingservers
i can open shared location from remote site
i have pinpointed the error to this (that i suspect), when i render subs in avisynth tab (it's a very small sub) it doesn't seem to generate the 1080_1080_sub file i seen from other encodes.
when i removed render subs from this encode it starts to work again and error was gone.
could be that the sub is not valid or something not sure but it was demuxed from source, i think "render subs" should be automatically disabled if this occur?
thanks.
guest
27th November 2022, 04:48
Thank Atak for the update and the new features. I appreciate it.
If you have time would be nice to have SMDegrain replace MDegrain. The results are just staggering and I resisted doing it for so long because I thought MDegrain did such a good job it could not really improve that much with SMDegrain. SMDegrain's output is so much improved it's staggering. It's like the difference MDegrain made over HQDN3D and that I would never go back to HQDN3D after seeing the results for MDegrain. Now SMDegrain has made MDegrain obsolete.
Now I'm at the point where the output is so clean with SMDegrain I think something must be wrong as the file sizes are so much smaller and I must have lost detail. Every detailed comparison I've made shows that I was wrong and the output from SMDegrain has not only removed the grain, but since the grain is removed, details actually stand out and everything appears crisper. I've actually started re-encoding older films and watching them again such as The Terminator, The Edge, etc. just because the difference in detail is so dramatic it is like experiencing the film all over again and it is a joy to watch.
SMDegrain also does not produce the detail blur I saw with MDegrain3 in a characters face when they turned their head.
The only tweak I have started doing is blksize=8 when dealing with video that has a lot of dark scenes in it.
Please replace MDegrain with the following SMDegrain strength settings:
Light: SMDegrain(video,tr=2,thSAD=200,thSADC=100,contrasharp=true,prefilter=0,refinemotion=true)
Medium: SMDegrain(video,tr=4,thSAD=400,thSADC=200,contrasharp=true,prefilter=1,refinemotion=true)
Strong: SMDegrain(video,tr=8,thSAD=800,thSADC=400,contrasharp=true,prefilter=2,refinemotion=true)
Thanks again Atak for everything.
Ryushin,
Hmmm, there IS a lot more to "Dogways" SMDegrain than those simple scripts/calls, that's just scratching the surface.
There are a total of 9 different "pre filter" options.
And there are MANY other functions that can be used, as well, most are rather "specialized"
And your examples are NOT the whole script/call, there's all the dependancies that are required.
But anyway, the following....
prefilter=-1 standard basic SMDegrain, which would still be better than MDegrain.
prefilter=0 1st of the Minblur options
prefilter=1 2nd of the Minblur options
prefilter=2 3rd of the Minblur options
prefilter=3 which uses FluxSmooth
prefilter=4 which uses Dfttest
prefilter=5 which uses KNLMeansCL
prefilter=6 which uses BM3D, (CUDA or CPU)
prefilter=7 which uses DGDenoise (nVidia based)
So there might users out there that would appreciate CUDA or nVidia based filters...
I would also like to say a BIG :thanks: to you for "pushing" these requests, especially after it took a while for me to convince you to try it, so that in itself is quite an achievement, for me :thanks:
Even tho I don't get any feedback, I hope other users are having a similar experience. :cool:
Ryushin
27th November 2022, 14:32
Ryushin,
Hmmm, there IS a lot more to "Dogways" SMDegrain than those simple scripts/calls, that's just scratching the surface.
There are a total of 9 different "pre filter" options.
And there are MANY other functions that can be used, as well, most are rather "specialized"
And your examples are NOT the whole script/call, there's all the dependancies that are required.
But anyway, the following....
prefilter=-1 standard basic SMDegrain, which would still be better than MDegrain.
prefilter=0 1st of the Minblur options
prefilter=1 2nd of the Minblur options
prefilter=2 3rd of the Minblur options
prefilter=3 which uses FluxSmooth
prefilter=4 which uses Dfttest
prefilter=5 which uses KNLMeansCL
prefilter=6 which uses BM3D, (CUDA or CPU)
prefilter=7 which uses DGDenoise (nVidia based)
So there might users out there that would appreciate CUDA or nVidia based filters...
I would also like to say a BIG :thanks: to you for "pushing" these requests, especially after it took a while for me to convince you to try it, so that in itself is quite an achievement, for me :thanks:
Even tho I don't get any feedback, I hope other users are having a similar experience. :cool:
I know there are a lot more options available. But for the vast majority of users, the three options I quoted work wonderfully for almost all content. It's nice that SMDegrain has the contrasharp option to use after the Minblur (prefilter1-3) options. To blur your video without sharpening would just soften the whole video and that would not be good.
I scan my jacket disc covers in and the final step I do in GIMP is a Selective Gaussian Blur to remove the dithering/halftone in the printed image and then a unsharp (oxymoron there) to sharpen the image and the result comes out excellent. The options with SMDegrain give us similar improvement.
Since MDegrain is now obsolete, RB should adopt SMDegrain. It's not good to have new users to have to download RB, and then have to download Pauly Dunne's patch, then have to learn how to use Custom scripts to get good results, much less, learn all the options in each script. Take me for example. For me to switch to SMDegrain, I did days of learning and testing. At first SMDegrain did not impress me and it gave me worse results than MDegrain and I was ready to pack it in and keep using MDegrain. But I kept with it and once I found the right options, it quickly became far superior to MDegrain.
The advantage to RB is that it's generally easy to use and users like that. It's not as daunting as Staxrip or other programs that simple give way to many options or dumb it down so much that there are almost no options available. In addition RB gives distributed encoding. Can't beat that.
guest
27th November 2022, 15:10
I know there are a lot more options available. But for the vast majority of users, the three options I quoted work wonderfully for almost all content. It's nice that SMDegrain has the contrasharp option to use after the Minblur (prefilter1-3) options. To blur your video without sharpening would just soften the whole video and that would not be good.
I scan my jacket disc covers in and the final step I do in GIMP is a Selective Gaussian Blur to remove the dithering/halftone in the printed image and then a unsharp (oxymoron there) to sharpen the image and the result comes out excellent. The options with SMDegrain give us similar improvement.
Since MDegrain is now obsolete, RB should adopt SMDegrain. It's not good to have new users to have to download RB, and then have to download Pauly Dunne's patch, then have to learn how to use Custom scripts to get good results, much less, learn all the options in each script. Take me for example. For me to switch to SMDegrain, I did days of learning and testing. At first SMDegrain did not impress me and it gave me worse results than MDegrain and I was ready to pack it in and keep using MDegrain. But I kept with it and once I found the right options, it quickly became far superior to MDegrain.
The advantage to RB is that it's generally easy to use and users like that. It's not as daunting as Staxrip or other programs that simple give way to many options or dumb it down so much that there are almost no options available. In addition RB gives distributed encoding. Can't beat that.
I would suggest that anyone "new" to RipBot would have a learning curve, to figure out what option did what, same with PD's build's, just because the majority of the SMDegrain filter options can only be accessed in the Custom drop down, (and by adding different scripts into the Custom folder itself), it would still quite the learning curve.... as you stated, you ARE a very experienced RipBot user, and I guess the dramatic change to the process, really stumped you for a while, but now you're reaping the benefits.
As for patching, if the user downloads the PD complete build, it's ready to fly, you don't have to get the "vanilla" version first, and then add PD's stuff to it, the only "patching" is the way the updates are implemented...manually !!!
Ripbot needs to step up, as Staxrip & Handbrake don't seem to be getting the attention they used to, and RipBot is almost in that same boat....app's like Hybrid, are WAY over the top !!!
But you're correct in saying that the DE function is a game changer...how come no one else has figured it out, kind of rewilders me.
Ryushin
27th November 2022, 15:31
I would suggest that anyone "new" to RipBot would have a learning curve, to figure out what option did what, same with PD's build's, just because the majority of the SMDegrain filter options can only be accessed in the Custom drop down, (and by adding different scripts into the Custom folder itself), it would still quite the learning curve.... as you stated, you ARE a very experienced RipBot user, and I guess the dramatic change to the process, really stumped you for a while, but now you're reaping the benefits.
When Atak first implemented MDegrain2, it did not take all the long to find out which options to tweak. Really only one. SMDegrain on the other hand is like a swiss army knife. There are so many options available that it's daunting.
Those three SMDegrain lines I posted are pretty much all I use now with the exception of adding blksize=8 for video with lots of dark scenes.
So I guess ideally, RB SMDegrain options would be a pull down labeled Strength with Light, Medium Hard, and then a pull down next to it with Blocksize with a default of 16 and an option to make it 8. It little mouse over popup over a "?" would say 8 is good for darker sources but takes 4 times more work to complete.
guest
28th November 2022, 02:06
OK, with all the conversation of late, I decided to build a "Lite" version of my somewhat popular build's (the only way I know this is the amount of downloads on Mediafire, as I don't get ANY feedback from the 100's of users, so thanks for that) ;)
This build ONLY has a select few SMDegrain based script options, & the required dependencies & NOTHING else!
I have chosen the scripts that my friend Ryushin has recommended (the only user that gives me feedback, both good & bad).
This build (as with the full blown builds) is ready to go, as is, no patching of updates, it's just all there !!!
For more info & details, please read the changlog.txt, included.
And while I'm at it, Atak, IF you are contemplating an SMDegrain implementation, this is ALL you need as far as scripts & dependencies, you would ONLY need to "work your magic" to add it in your code, so it has its own location, within RipBot.
Good luck, and enjoy :D
Ryushin
28th November 2022, 13:02
Hi Atak,
Probably just a typo in the code some where, but muxing the encoded job results in an error:
Error: The file 'D:\Temp\RipBot264temp\job41\Encoded_Audio_1.ac3' could not be opened for reading: open file error.
There is an Encoded_Audio_1.aac file in the job folder. So the typo might be the ac3 instead of aac for 7.1.
Modifying the job41_MuxFiles.json and replacing ac3 with aac results in the job muxing correctly.
I also wanted to mention that I do not get that frozen floating grain with SMDegrain like I did with MDegrain. If there is any grain left over from SMDegrain it looks like natural grain from the film.
Pauly Dunne: Thank you for the lite build, I appreciate it. It will make it easier for those new users to integrate into RBs official build and leave auto update turned on. Even though Atak has not been updating x265 and other dependencies that often. I don't think I've given you bad feedback. Just feedback on possible improvements or changes and you have always been accommodating in wanting to improve your builds. Your builds have always been appreciated. I'm just sorry I waited almost a year (probably) to start try them out.
Ryushin
28th November 2022, 13:25
Atak, since you control your updates, do you know about how many active users of RB there are in the world? Just curious.
guest
28th November 2022, 13:36
Pauly Dunne: Thank you for the lite build, I appreciate it. It will make it easier for those new users to integrate into RBs official build and leave auto update turned on. Even though Atak has not been updating x265 and other dependencies that often. I don't think I've given you bad feedback. Just feedback on possible improvements or changes and you have always been accommodating in wanting to improve your builds. Your builds have always been appreciated. I'm just sorry I waited almost a year (probably) to start try them out.
Interesting find with the bug :)
I had to say "good & the bad" feedback, and yes, I don't think you actually have given any bad, as you say....
If you download the "Lite" build, the changelog.txt, will explain the changes a lot more than I mentioned here, on the Forum.
It should be the same to use as "standard" RB, just with the SMDegrain scripts available to use, without any "fiddling", and I also mention that Autoupdates could probably be enabled, without any effect on what I've added.
And yes, it would be interesting to know how many RB downloads have been accessed from Mediafire...it would have to be substantial.
Just in the time I've been posting stuff, there would be a total of many, many hundreds of downloads...
cypher007
28th November 2022, 14:23
ok tried again to use the working hours function, this time with a fresh install of win 10. it shutsdown but still doesnt wake up. i can wake it using wol but ripbot sits there saying its waiting till the time set to start encoding, which has already passed.
cypher007
28th November 2022, 18:33
the machine will wake if i press a key on the keyboard. how does ripbot schedule the shutdown and startup?
guest
29th November 2022, 01:38
the machine will wake if i press a key on the keyboard. how does ripbot schedule the shutdown and startup?
You must have a short memory, approx 4 months ago, you asked the same question(s).
https://forum.doom9.org/showthread.php?p=1972932#post1972932
Atak actually tried to help, a lot, with all sorts of suggestions, and even a "special" fix.
And now, here "we" are again...
Clearly there is something about your setup, motherboard BIOS settings, Windows power settings, etc.
Atak provides these services that I'm sure he tests thoroughly, BUT just because it works on his setup, doesn't mean it will on someone else's !!!
https://forum.doom9.org/showthread.php?p=1973545#post1973545
AGAIN, if you can't get it to work, then you'll just have to find some other way to do what you're expecting this to do.
Atak_Snajpera
29th November 2022, 12:29
ok tried again to use the working hours function, this time with a fresh install of win 10. it shutsdown but still doesnt wake up. i can wake it using wol but ripbot sits there saying its waiting till the time set to start encoding, which has already passed.
try this
1) Change system date format to YYYY/MM/DD
2) open ripbot264 (do not click on settings!)
3) open WorkHours.csv in notepad
4) add start and end time. for example.
"2022-11-29 12:00";"2022-11-29 12:01"
"2022-11-29 12:02";"2022-11-29 12:03"
5) Save file.
6) Run some encoding
if everything goes well encoding will start automatically at 12:00 and pc will go to sleep mode at 12:01. Then at 12:02 PC will weak up automatically. At 12:03 PC will shut down again.
guest
29th November 2022, 13:25
try this
1) Change system date format to YYYY/MM/DD
2) open ripbot264 (do not click on settings!)
3) open WorkHours.csv in notepad
4) add start and end time. for example.
"2022-11-29 12:00";"2022-11-29 12:01"
"2022-11-29 12:02";"2022-11-29 12:03"
5) Save file.
6) Run some encoding
if everything goes well encoding will start automatically at 12:00 and pc will go to sleep mode at 12:01. Then at 12:02 PC will weak up automatically. At 12:03 PC will shut down again.
So what I would like to know is, when using this feature, what happens to the progress of the encode, when it turns itself off ??
If you were using DE, then whatever chunk(s) is being processed, would be lost, when the pc shuts down, and hopefully, when it starts again, it would start on the next chunk (the one that was not completed, when it shutdown), but if you weren't using DE, then the whole encode would be lost.
I really can't understand why this is a good idea.....
darkio
30th November 2022, 10:20
thanks a lot for automatic colormatrix conversion!
I hope to see in nesr future dehalo (some stupid avsi svript), dering, deband and derainbow filter with good settings.
Some old anime can benefit it.
Manual import of these script or load plugin works well edit ripbot script.
cypher007
30th November 2022, 11:16
You must have a short memory, approx 4 months ago, you asked the same question(s).
https://forum.doom9.org/showthread.php?p=1972932#post1972932
Atak actually tried to help, a lot, with all sorts of suggestions, and even a "special" fix.
And now, here "we" are again...
Clearly there is something about your setup, motherboard BIOS settings, Windows power settings, etc.
Atak provides these services that I'm sure he tests thoroughly, BUT just because it works on his setup, doesn't mean it will on someone else's !!!
https://forum.doom9.org/showthread.php?p=1973545#post1973545
AGAIN, if you can't get it to work, then you'll just have to find some other way to do what you're expecting this to do.
its not quite the same as this time im using windows 10 rather than windows server 2022. i thought i would eliminate the OS doing odd stuff.
rlev11
30th November 2022, 20:22
Trying out the new PD-Lite version as I would like to start doing some smdegrain comparisons, but having issues with the scripts.
when ever I choose a smdegrain custom script, when it goes to start decoding I immediately get a :
temp\ripbot264temp\job1\info.txt does not exist
and the encode immediately aborts. Not sure what is going on, I first thought the plugins variable wasn't set correctly so i changed all the call outs to the hardcoded path to the avisynth plugins folder. That changed nothing.
Any thoughts?? choosing mdegrain like normal works fine, just the custom smdegrain scripts
I checked and something in the smdegrain script is keeping the info.txt from being generated. It is there if I don;t choose a smdegrain script, but as soon as I do it dissapears in the job folder.
it is definately something with the last line:
video=SMDegrain(video,tr=2,thSAD=200,thSADC=100,contrasharp=true,prefilter=0,refinemotion=true,blksize=8)
if I remove this from the script leaving all the loadPlugin and Import lines the encode does at least runs although it doesn't really do anything.
cypher007
30th November 2022, 23:42
try this
1) Change system date format to YYYY/MM/DD
2) open ripbot264 (do not click on settings!)
3) open WorkHours.csv in notepad
4) add start and end time. for example.
"2022-11-29 12:00";"2022-11-29 12:01"
"2022-11-29 12:02";"2022-11-29 12:03"
5) Save file.
6) Run some encoding
if everything goes well encoding will start automatically at 12:00 and pc will go to sleep mode at 12:01. Then at 12:02 PC will weak up automatically. At 12:03 PC will shut down again.
Ok tried it. Clicked start on the encode then ticked work hours and it shutdown straightaway then didnt wake up.
guest
1st December 2022, 02:33
Trying out the new PD-Lite version as I would like to start doing some smdegrain comparisons, but having issues with the scripts.
when ever I choose a smdegrain custom script, when it goes to start decoding I immediately get a :
temp\ripbot264temp\job1\info.txt does not exist
and the encode immediately aborts. Not sure what is going on, I first thought the plugins variable wasn't set correctly so i changed all the call outs to the hardcoded path to the avisynth plugins folder. That changed nothing.
Any thoughts?? choosing mdegrain like normal works fine, just the custom smdegrain scripts
I checked and something in the smdegrain script is keeping the info.txt from being generated. It is there if I don;t choose a smdegrain script, but as soon as I do it dissapears in the job folder.
it is definately something with the last line:
video=SMDegrain(video,tr=2,thSAD=200,thSADC=100,contrasharp=true,prefilter=0,refinemotion=true,blksize=8)
if I remove this from the script leaving all the loadPlugin and Import lines the encode does at least runs although it doesn't really do anything.
Have sent a couple of PM's...
Will be posting a revised, updated build, shortly.
guest
1st December 2022, 02:54
Have made a few changes (hopefully for the better).
Please read the changelog, as there are some prerequisites that need to be installed !!!
https://www.mediafire.com/file/vszi5sgort8vx53/RipBot264_PD_Lite_%252801-12-22%2529.7z/file
guest
1st December 2022, 03:31
Trying out the new PD-Lite version as I would like to start doing some smdegrain comparisons, but having issues with the scripts.
when ever I choose a smdegrain custom script, when it goes to start decoding I immediately get a :
temp\ripbot264temp\job1\info.txt does not exist
and the encode immediately aborts. Not sure what is going on, I first thought the plugins variable wasn't set correctly so i changed all the call outs to the hardcoded path to the avisynth plugins folder. That changed nothing.
Any thoughts?? choosing mdegrain like normal works fine, just the custom smdegrain scripts
I checked and something in the smdegrain script is keeping the info.txt from being generated. It is there if I don;t choose a smdegrain script, but as soon as I do it dissapears in the job folder.
it is definately something with the last line:
video=SMDegrain(video,tr=2,thSAD=200,thSADC=100,contrasharp=true,prefilter=0,refinemotion=true,blksize=8)
if I remove this from the script leaving all the loadPlugin and Import lines the encode does at least runs although it doesn't really do anything.
Can you post your full script ??
rlev11
1st December 2022, 03:38
#MT
#VideoSource
LoadPlugin("C:\Users\rleva\Desktop\RipBot-Lite\Tools\AviSynth plugins\lsmash\LSMASHSource.dll")
video=LWLibavVideoSource("D:\MKV\From Here to Eternity (1953) 4k\From Here to Eternity (1953) (1).mkv",cachefile="D:\Temp\RipBot264temp\job1\From Here to Eternity (1953) (1).mkv.lwi")
#Deinterlace
#Decimate
#Crop
#Downscale
#Tonemap
#Levels
#Colours
#Denoise
#Custom
LoadPlugin("C:\Users\rleva\Desktop\RipBot-Lite\Tools\AviSynth plugins\masktools\masktools2.dll")
LoadPlugin("C:\Users\rleva\Desktop\RipBot-Lite\Tools\AviSynth plugins\mvtools\mvtools2.dll")
LoadPlugin("C:\Users\rleva\Desktop\RipBot-Lite\Tools\AviSynth plugins\RgTools\RgTools.dll")
LoadPlugin("C:\Users\rleva\Desktop\RipBot-Lite\Tools\AviSynth plugins\PD_TOOLS\MedianBlur2\MedianBlur2.dll")
Import("C:\Users\rleva\Desktop\RipBot-Lite\Tools\AviSynth plugins\PD_TOOLS\EXTOOLS\ExTools.avs")
Import("C:\Users\rleva\Desktop\RipBot-Lite\Tools\AviSynth plugins\PD_TOOLS\LSF-PLUS\LSFplus.avs")
Import("C:\Users\rleva\Desktop\RipBot-Lite\Tools\AviSynth plugins\PD_TOOLS\SHARPENERS-PACK\Sharpeners Pack.avs")
Import("C:\Users\rleva\Desktop\RipBot-Lite\Tools\AviSynth plugins\PD_TOOLS\SMDEGRAIN\SMDegrain cpu.avs")
Import("C:\Users\rleva\Desktop\RipBot-Lite\Tools\AviSynth plugins\PD_TOOLS\Zs_RF_Shared\Zs_RF_Shared.avs")
video=SMDegrain(video,tr=2,thSAD=200,thSADC=100,contrasharp=true,prefilter=0,refinemotion=true)
#Prefetch
#After_Prefetch_Denoise
#After_Prefetch_Custom
#Sharpen
#Upscale
#Borders
#Subtitles
#AudioSource
Import("D:\Temp\RipBot264temp\job1\job1_a1.avs")
#Triming
#AVSameLength
#ColorSpace
#Return
guest
1st December 2022, 03:56
Originally Posted by rlev11
Thanks
Umm, can you please try something...
I have my RipBot folder directly on my C:\ drive, could you unpack the latest build, then copy it to the root of C:\.
I'm not sure if a longer path is what the problem is....I'm grasping at straws now, as I am NOT having any problems !!!
rlev11
1st December 2022, 04:20
No change, paths in the script changed to the corrected ones automatically with the variable and are correct. Even tried re-running the 4 installs again from the new c:\Ripbot264 folder and no difference.
guest
1st December 2022, 04:33
No change, paths in the script changed to the corrected ones automatically with the variable and are correct. Even tried re-running the 4 installs again from the new c:\Ripbot264 folder and no difference.
Yeah, like I said, I'm clutching at straws..
I even copied my RipBot folder to the desktop, and it still worked.
So unfortunately, I have no more suggestions...I know that it works perfectly for me, both the "full" & "lite" builds, and because of that I can't reproduce your problem.
Have you got any unique permissions or anything setup ??
I'm pretty sure you're going to keep at it, and I'm sorry I can't help.
One last idea, this is the script in the build:-
#Custom
LoadPlugin("%AVISYNTHPLUGINS%\masktools\masktools2.dll")
LoadPlugin("%AVISYNTHPLUGINS%\mvtools\mvtools2.dll")
LoadPlugin("%AVISYNTHPLUGINS%\RgTools\RgTools.dll")
LoadPlugin("%AVISYNTHPLUGINS%\PD_TOOLS\MedianBlur2\MedianBlur2.dll")
Import("%AVISYNTHPLUGINS%\PD_TOOLS\EXTOOLS\ExTools.avs")
Import("%AVISYNTHPLUGINS%\PD_TOOLS\LSF-PLUS\LSFplus.avs")
Import("%AVISYNTHPLUGINS%\PD_TOOLS\RESIZERS-PACK\Resizers Pack.avs")
Import("%AVISYNTHPLUGINS%\PD_TOOLS\SHARPENERS-PACK\Sharpeners Pack.avs")
Import("%AVISYNTHPLUGINS%\PD_TOOLS\SMDEGRAIN\SMDegrain cpu.avs")
Import("%AVISYNTHPLUGINS%\PD_TOOLS\Zs_RF_Shared\Zs_RF_Shared.avs")
video=SMDegrain(video,tr=2,thSAD=200,thSADC=100,thSCD1=400,thSCD2=130,contrasharp=true,prefilter=0,str=1.2,refinemotion=true)
What if you edited the script's "%AVISYNTHPLUGINS% with your whole path...
LoadPlugin("%AVISYNTHPLUGINS%\masktools\masktools2.dll") changed to LoadPlugin("C:\Users\rleva\Desktop\RipBot-Lite\Tools\AviSynth plugins\masktools\masktools2.dll")
rlev11
1st December 2022, 04:37
will try again tomorrow, but that is one of the first things I tried earlier today
guest
1st December 2022, 04:56
will try again tomorrow, but that is one of the first things I tried earlier today
I'm really sorry about this, but there is clearly something unique going on with your systems.
But it might be something really simple.
I have sent a PM to another user that uses my build's, without issue...so I'm hoping that he might have a "lightbulb moment".
But it would be really great if someone else is having similar issues, would leave a comment.
Ryushin
1st December 2022, 13:36
OK, with all the conversation of late, I decided to build a "Lite" version of my somewhat popular build's
https://www.mediafire.com/file/orr7krjsn5buqtu/RipBot264_PD_Lite+(28-11-22).7z/file
Good luck, and enjoy :D
I tried to download the lite version but the link does not seem to be working. I was going to see if there was something wrong so I could help rlev11.
rlev11: Have you tried just setting a custom script using the default mdegrain options, just to make sure custom scripts are working:
#Custom
Loadplugin("C:\Program Files\RipBot264\Tools\AviSynth plugins\mvtools\mvtools2.dll")
super=MSuper(video,pel=2)
bv1=MAnalyse(super,blksize=8,isb=true,delta=1,overlap=4)
bv2=MAnalyse(super,blksize=8,isb=true,delta=2,overlap=4)
fv1=MAnalyse(super,blksize=8,isb=false,delta=1,overlap=4)
fv2=MAnalyse(super,blksize=8,isb=false,delta=2,overlap=4)
video=MDegrain2(video,super,bv1,fv1,bv2,fv2,thSAD=200)
If that works, then try:
#Custom
LoadPlugin("%AVISYNTHPLUGINS%\masktools\masktools2.dll")
LoadPlugin("%AVISYNTHPLUGINS%\mvtools\mvtools2.dll")
LoadPlugin("%AVISYNTHPLUGINS%\RgTools\RgTools.dll")
LoadPlugin("%AVISYNTHPLUGINS%\PD_TOOLS\MedianBlur2\MedianBlur2.dll")
Import("%AVISYNTHPLUGINS%\PD_TOOLS\EXTOOLS\ExTools.avs")
Import("%AVISYNTHPLUGINS%\PD_TOOLS\LSF-PLUS\LSFplus.avs")
Import("%AVISYNTHPLUGINS%\PD_TOOLS\RESIZERS-PACK\Resizers Pack.avs")
Import("%AVISYNTHPLUGINS%\PD_TOOLS\SHARPENERS-PACK\Sharpeners Pack.avs")
Import("%AVISYNTHPLUGINS%\PD_TOOLS\SMDEGRAIN\SMDegrain cpu.avs")
Import("%AVISYNTHPLUGINS%\PD_TOOLS\Zs_RF_Shared\Zs_RF_Shared.avs")
Video=SMDegrain(video,tr=4,thSAD=400,thSADC=200,contrasharp=true,prefilter=1,refinemotion=true)
I'm using the full tools folder currently as I could not download the light and test that. Also try changing my last line and remove all options so SMDegrain uses the default:
Video=SMDegrain(video)
If there are any errors in the script or plugins being called, missing or in the wrong order, then you get the error you were seeing. It would be nice if there was some kind of debug output in RB so you could see what is happening.
Atak, that would be a nice feature to add. avisynth debugging/logging.
Ryushin
1st December 2022, 17:56
Trying out the new PD-Lite version as I would like to start doing some smdegrain comparisons, but having issues with the scripts.
when ever I choose a smdegrain custom script, when it goes to start decoding I immediately get a :
temp\ripbot264temp\job1\info.txt does not exist
I'm digging into this now. I can confirm it also does not work.
Though I went a different route. First I downloaded Atak's 1.26.0 build and moved the Tools folder into my RB folder. This way I have a stock RB Tools folder. I turned on auto update and let it run two rounds of updates until the Tools folder was updated as Atak intended.
When Pauly Dunne made his light version it still had the entire tools folder in it. So I stripped it down to just the files that should be needed, PD_Tools and the Custom scripts.
So I made a feather weight version that weighs in at 272KB and you can just copy that into the RB folder and it won't overwrite a single file:
Though it does not work. I'm going to do the same thing with PDs full build, though I suspect there is a newer component that has overwritten a RB file.
Ryushin
1st December 2022, 20:12
The problem with the PD Lite version was that it was missing the Resizers Pack.
I've added the RESIZERS-PACK folder to PD_Tools and modified the scripts to add this line:
Import("%AVISYNTHPLUGINS%\PD_TOOLS\RESIZERS-PACK\Resizers Pack.avs")
I stripped down the Lite version so you can just paste the Tools folder into the RB folder it it will merge into the Tools folder without overwriting any RB files. So you can leave RB's auto update turned on.
https://cloud.chrisdos.com/s/5B8sYfgSL8oTwQR (Zip file is only 287KB in size)
I also did the same for the full tools that Pauly released on November 8th and stripped it down so it only contains PD_Tools files and scripts. I applied the two PD updates released in November to the that folder as well:
https://cloud.chrisdos.com/s/MQBEqcEENLZffAr (7z file is only 32.6MB in size)
Pauly, I personally prefer your versions like this. So they don't overwrite any of Atak's files. Though it would be nice if Atak updates x265 and perhaps a few other tools more often. But he has to support his build, so I understand if he is hesitant to upgrade the packages every release. Through quarterly or twice yearly would be nice.
I'm switching to the Full build that is stripped. I do like the possibilities of using your other tools and scripts such as the debanding and such.
rlev11
1st December 2022, 20:31
So I was using a 4k source file for my testing. I guess I should have tried another file. I tried some 1080 and 720p stuff an I did get it working now using the smdegrain scripts. I have tried a couple different 4k mkv's and they still fail. Have only tried a couple of files so far so not 100% sure I have this completely figured out yet, but i am making some headway.
I did have to copy the PD-Lite version to my servers and start the encoding server from that PDLite folder for the encoding servers to work. I guess that makes sense that the encoding servers would need some of the dependencies
rlev11
1st December 2022, 20:39
Ryushin,
so what you are saying is that if I already have a fully updated 1.26.3 Atak release, all I should have to do is download the lite zip file, copy it into the correct folder and I should be good to go??
any benefit to merging the larger zip from the nov 8 and just copying the scripts from the latest lite version?
Update: So this is what I did, just merge the full tools folder from the zip download and then added the scripts from the lite download.
It's working now (allbeit slower than expected), even for 4k stuff. Only thing I have to figure out is 1 of the 2 current encoding servers is not working. I did just merge the tools folder on the encoding server but I have to figure this out before I add in the other 7 encoding servers
Ryushin
1st December 2022, 21:09
Ryushin,
so what you are saying is that if I already have a fully updated 1.26.3 Atak release, all I should have to do is download the lite zip file, copy it into the correct folder and I should be good to go??
any benefit to merging the larger zip from the nov 8 and just copying the scripts from the latest lite version?
Yes, download either version, extract the Tools folder, then just drag and drop the Tools folder into the RB folder (which also has a Tools folder) and it will merge and not overwrite any of the original Atak provided RB files.
The larger 7z file is if you want access to all of Pauly Dunne's many different scripts and plugins. If you just want SMDegrain, then the lite version is all you need.
I'm running the larger stripped version now with RB's auto updates turned on.
rlev11
1st December 2022, 21:52
Found for the encoding servers, just merging the tools folder does NOT allow the encoding server to work, (these are copies of the latest Atak version as well) I had to copy the "important to install" folder from the PD-Lite version download and I did the Vcdist,avisynth, and Libfftw3f-3 installs from that folder. This allowed the encoding servers to actually work and not throw an error that it could not open the chunk. Avisynth was installed from the windows installer that pops the first time you open the excodingserver.exe
The "important to install" folder from the PD-Lite version download was done on my client yesterday during troubleshooting so I am not sure if that would also need to be done to an Atak version as well in addition to just merging the Tools folder, my best guess would be YES it would.
guest
2nd December 2022, 00:20
The problem with the PD Lite version was that it was missing the Resizers Pack.
I've added the RESIZERS-PACK folder to PD_Tools and modified the scripts to add this line:
Import("%AVISYNTHPLUGINS%\PD_TOOLS\RESIZERS-PACK\Resizers Pack.avs")
Hi, yeah, the reasoning behind leaving out that, was the file I was testing with, didn't "call" for it, unfortunately, it wasn't a 4K test file :(
guest
2nd December 2022, 00:27
Yes, download either version, extract the Tools folder, then just drag and drop the Tools folder into the RB folder (which also has a Tools folder) and it will merge and not overwrite any of the original Atak provided RB files.
The larger 7z file is if you want access to all of Pauly Dunne's many different scripts and plugins. If you just want SMDegrain, then the lite version is all you need.
I'm running the larger stripped version now with RB's auto updates turned on.
Well, you 2 guys have been busy, while I've been asleep (time difference), and now there's a whole new build, so now I will have to re-evaluate this project, as any future builds, I can't call my own, anymore :(
I will "study" what you've done with the stripped down builds, and go from there.
But at this stage, it seems like both the "Lite" & full builds are "fixed".
EDIT:- I've just noticed a glaring oversight with this..this very important folder "SMDEGRAIN Scripts (& others)" is missing from the stripped down "full" build.
This folder contains ALL the scripts that can be copied to the Custom folder, so they can be used in RB.
The "Lite" build does not require that folder, as the dependencies aren't included, hence "Lite"
guest
2nd December 2022, 00:31
Found for the encoding servers, just merging the tools folder does NOT allow the encoding server to work, (these are copies of the latest Atak version as well) I had to copy the "important to install" folder from the PD-Lite version download and I did the Vcdist,avisynth, and Libfftw3f-3 installs from that folder. This allowed the encoding servers to actually work and not throw an error that it could not open the chunk. Avisynth was installed from the windows installer that pops the first time you open the excodingserver.exe
The "important to install" folder from the PD-Lite version download was done on my client yesterday during troubleshooting so I am not sure if that would also need to be done to an Atak version as well in addition to just merging the Tools folder, my best guess would be YES it would.
You 2 guys have been busy, and it sounds like between the 2 of you, you have sorted it out, and had some success :)
I was pretty confident that Ryushin would get to the bottom of this.
Sorry I couldn't chime in, as I was asleep (time difference).
Well done to you both :)
guest
2nd December 2022, 01:56
Hey guys,
Due to recent findings & problems with my builds, for some users (at least the users that inform me of problems, thanks mainly to rlev11), I will be pulling ALL my current builds, until further notice.
Thanks for your support :o
But don't forget this one, v1.26.3 (virgin) build :-
https://www.mediafire.com/file/c1rko1406yev7jl/RipBot264v1.26.3_%2528virgin%2529.7z/file
cypher007
2nd December 2022, 13:51
got a question. when i do a 2 pass hvec 265 encode ive noticed the bit rate on the second pass steadily increases and the frame rate drops steadily also. surely the bit rate would vary depending on the action or not in the movie?
guest
2nd December 2022, 14:06
got a question. when i do a 2 pass hvec 265 encode ive noticed the bit rate on the second pass steadily increases and the frame rate drops steadily also. surely the bit rate would vary depending on the action or not in the movie?
Not sure why you're doing a 2 pass..
Are you referring to the encoding "speed" shown at the bottom of the encoder window.
It will vary depending on what it has to encode at that time...
cypher007
2nd December 2022, 14:35
the fps and kbps at the bottom. doing a 2 pass as want it to fir a bdr size in case later on i start freeing up space.
18266
guest
2nd December 2022, 14:45
the fps and kbps at the bottom. doing a 2 pass as want it to fir a bdr size in case later on i start freeing up space.
18266
It's best if you do not attach files like this, they take a long time to be approved, you're better off using a site like Imgur or something, and posting the link.
rlev11
2nd December 2022, 15:25
Ryushin and Pauly,
Looks like to get the encoding servers on an bare updated install to work with the SMdegrain scripts, all that needs to be done is the libfftw3f-3 dll install from the "Important to Install" folder. I didn't have to do anything else install wise or merge in the Tools folder. AVIsynth was already installed from the windows installer the first time the encoding server started up.
Currently testing a full frame 4k grainy source to do a speed comparison. Doing just an Mdegrain3-300 I was getting about 28fps will my whole farm active. Doing it with the SMDegrain medium script it is running around 42fps. That's like a 50% increase in speed, WOW!.
I still have to affinity mask the 16 core Ryzens down to 12 with SMdegrain, but even with all 16 cores active, the performance does not drop off the cliff like it does with just MDegrain. CPU usage on the 16 core Ryzens also is much less with SMDegrain, so I think with them firing up a second server instance will be really beneficial. Will probably play with the affinity mask and activate the 4 unused cores from server1 and use them on server 2 to balance things out a bit.
Ryushin
2nd December 2022, 15:36
Hey guys,
Due to recent findings & problems with my builds, for some users (at least the users that inform me of problems, thanks mainly to rlev11), I will be pulling ALL my current builds, until further notice.
Thanks for your support :o
But don't forget this one, v1.26.3 (virgin) build :-
https://www.mediafire.com/file/c1rko1406yev7jl/RipBot264v1.26.3_%2528virgin%2529.7z/file
Please don't take down your builds. Without your builds we would not have SMDegrain and other tools. These are still your builds. I did not create them, you did. I just stripped down the files to the core of what you created. My links are purposely only valid until the end of January. If I've offended you by posting them I'll take then down now if you like. These are based on your work of course.
Might I suggest three builds.
SMDegrain Only: Stripped down so it does not overwrite any RB files and is a tiny download.
PD Tools and Scripts: Stripped down so it does not overwrite any RB files.
Full PD Tools and Updated Tools: Your full build that replaces the RB Tools folder.
It would also be interesting for you to see what build users pick. I think the SMDegrain only will be fairly static and not have to be updated often. The other two builds will require more of your meticulous attention.
I would use your "PD Tools and Scripts" version as I focus more on "It just works" kind of thing. Not overwriting any RB files will minimize problems. But I also don't get the improvements either. It would be nice if Atak keeps x265 and other important tools updated more often.
Please don't be discouraged. You've added a lot to RB and it is greatly appreciated.
Ryushin
2nd December 2022, 15:43
Ryushin and Pauly,
Looks like to get the encoding servers on an bare updated install to work with the SMdegrain scripts, all that needs to be done is the libfftw3f-3 dll install from the "Important to Install" folder. I didn't have to do anything else install wise or merge in the Tools folder. AVIsynth was already installed from the windows installer the first time the encoding server started up.
Currently testing a full frame 4k grainy source to do a speed comparison. Doing just an Mdegrain3-300 I was getting about 28fps will my whole farm active. Doing it with the SMDegrain medium script it is running around 42fps. That's like a 50% increase in speed, WOW!.
I still have to affinity mask the 16 core Ryzens down to 12 with SMdegrain, but even with all 16 cores active, the performance does not drop off the cliff like it does with just MDegrain. CPU usage on the 16 core Ryzens also is much less with SMDegrain, so I think with them firing up a second server instance will be really beneficial. Will probably play with the affinity mask and activate the 4 unused cores from server1 and use them on server 2 to balance things out a bit.
Very good to know. We bought new parts for our Desktop computer with the cyber monday sales. The desktop is currently running a first gen Ryzen 7 1800x and we have bought the Ryzen 9 7950x, which should come today, but the other parts won't get here until next week. I'll have to look at the affinity mask and see how I'm going to set it up.
rlev11
2nd December 2022, 15:52
On this grainy 4k source I'm running now(most cpu intensive), a single encoding server was around 6fps, 2 combined is around 9fps. This is on my 7950x.
OMG, going from an 1800x to a 7950x, you are in for quite a ride performance wise....
guest
3rd December 2022, 01:22
Please don't take down your builds. Without your builds we would not have SMDegrain and other tools. These are still your builds. I did not create them, you did. I just stripped down the files to the core of what you created. My links are purposely only valid until the end of January. If I've offended you by posting them I'll take then down now if you like. These are based on your work of course.
Might I suggest three builds.
SMDegrain Only: Stripped down so it does not overwrite any RB files and is a tiny download.
PD Tools and Scripts: Stripped down so it does not overwrite any RB files.
Full PD Tools and Updated Tools: Your full build that replaces the RB Tools folder.
It would also be interesting for you to see what build users pick. I think the SMDegrain only will be fairly static and not have to be updated often. The other two builds will require more of your meticulous attention.
I would use your "PD Tools and Scripts" version as I focus more on "It just works" kind of thing. Not overwriting any RB files will minimize problems. But I also don't get the improvements either. It would be nice if Atak keeps x265 and other important tools updated more often.
Please don't be discouraged. You've added a lot to RB and it is greatly appreciated.
Hey Ryushin, don't worry too much that I have temporarily taken them down, it doesn't mean yours will suddenly stop working :rolleyes:
Having said that, I did decide to do that before I downloaded and unpacked your stripped down options, upon opening, I realised I was kind of wrong for thinking that, as I really couldn't see any changes, but one major omission in the "full" build.
See, this is why feedback is SO important, out of the 100's of downloads, hardly anybody leaves feedback..... are they having problems or not, who knows, so if rlev11 hadn't commented on the setup problems he was having, I would never have known,
as I haven't had these problems, and tbh, I can't figure out why he had problems with the "full" build a couple of weeks ago.
I know why he had certain problems with the "lite" build, but that was my fault for not testing with a 4K clip.
What needs to be done is a very thorough set of install instructions for first timers (and experienced users), so that will take a little time to get right. rlev11 has even offered to help with that, if needed.
As for 3 variants, I think that is a little bit of overkill, I think that a revised "Lite" build is good for ppl that only want the basic SMDegrain experience, and then the "full" build is for the user that wants to try & use MANY, MANY filter options, with no real limits.
As for overwriting the original RipBot folders & files, this IS necessary for the "full" build to be able to use all the resources that SMDegrain requires, and up to date as possible.
So many components within RipBot are very old, and some are probably even redundant.
As I've said many times before, my builds do NOT require the original RipBot to be downloaded or "installed", they are standalone builds !!!
I don't know what more I can say.
But one thing I will say, is, I am working on more "special" filters, I added 3 yesterday, and probably a couple more today, so I haven't given up, I just need to rehash the current process.
guest
3rd December 2022, 01:40
Very good to know. We bought new parts for our Desktop computer with the cyber monday sales. The desktop is currently running a first gen Ryzen 7 1800x and we have bought the Ryzen 9 7950x, which should come today, but the other parts won't get here until next week. I'll have to look at the affinity mask and see how I'm going to set it up.
Wow, I'm impressed to know that you've lashed out and got a 7950X :cool:
We'll have to compare notes..
There's is a folder in my builds that has the Affinity options all written up, so it won't be hard to implement (thanks again to rlev11 for that)
guest
4th December 2022, 05:19
v1.26.3
Added: 7.1 AAC encoding via FFMPEG (new profile will show up after you manually delete Audio.txt file in Profile folder)
Added: Cover art can be also added in BATCH MODE
Added: Automatic color conversion rec.601->rec.709 when upscaling from SD to HD
Fixed: Main application RipBot264.exe was launching EncodingServer.exe without proper /avisynth-prefetch-threads switch
Fixed: PC didn't automatically wake up at scheduled time if system date format was different than YYYY-MM-DD
Thanks Atak
FYI:- This is only significant IF the user uses the "Work Hours" function.
Fixed :)
cypher007
4th December 2022, 18:49
ok ive tried today with my laptop to use work hours and it still doesnt work. its obviously an issue with windows 10 and this feature.
it will always shutdown at the correct time but then never wakes.
i would like to get this working as i have a 4kwp solar array and electric is now Ģ0.40 per kwh in the UK or $0.48 in US equivalent. so not small beans.
Atak_Snajpera
4th December 2022, 19:40
I do not have access to physical Windows 10 machine. Only Win7 and virtual win11. It works 100% on my win7 even with non-standard date format like MM-DD-YYYY. Maybe other users could test if this is a problem indeed related with win10/11.
rlev11
4th December 2022, 20:22
ok ive tried today with my laptop to use work hours and it still doesnt work. its obviously an issue with windows 10 and this feature.
it will always shutdown at the correct time but then never wakes.
i would like to get this working as i have a 4kwp solar array and electric is now Ģ0.40 per kwh in the UK or $0.48 in US equivalent. so not small beans.
Couple things to maybe try. First in the advanced settings of the power plan, make sure that allow wake timers is enabled.
If that doesn't work, Google how to wake your computer using windows task scheduler. You could then make the task scheduler wake the computer a couple minutes before you have set whatever you have in ripbot and see if that makes things work.
guest
5th December 2022, 00:09
I do not have access to physical Windows 10 machine. Only Win7 and virtual win11. It works 100% on my win7 even with non-standard date format like MM-DD-YYYY. Maybe other users could test if this is a problem indeed related with win10/11.
Atak, PLEASE explain how this works, so "we" all know...
So what I would like to know is, when using this feature, what happens to the progress of the encode, when it turns itself off ??
If you were using DE, then whatever chunk(s) is being processed, would be lost, when the pc shuts down, and hopefully, when it starts again, it would start on the next chunk (the one that was not completed, when it shutdown), but if you weren't using DE, then the whole encode would be lost.
guest
5th December 2022, 00:26
ok ive tried today with my laptop to use work hours and it still doesnt work. its obviously an issue with windows 10 and this feature.
it will always shutdown at the correct time but then never wakes.
i would like to get this working as i have a 4kwp solar array and electric is now Ģ0.40 per kwh in the UK or $0.48 in US equivalent. so not small beans.
Come on cypher, I think it's time you gave up on this...
I have a 5.2kW solar array, and my power is approx $0.38 per kwh, but my "rule", if the solar isn't generating enough power so I can encode for "free", I don't do any, and with the weather in my area being really crappy for months & months, I don't get much done :(, and time's running out.
I would think that if there were other users that use this function, you would have had some replies, but in my way of thinking, as you haven't, no body uses it !!!!
If Atak would explain what it does to encodes in progress, then it's probably not a really economical process, as you would be losing encodes, everytime it shuts down !!!
As rlev11 suggested, maybe you should set up a Windows Task to shut down & wake up the laptop, but then that wouldn't restart the interrupted encode, would it :(
slalom
5th December 2022, 10:23
Thank Atak for the update and the new features. I appreciate it.
If you have time would be nice to have SMDegrain replace MDegrain. The results are just staggering and I resisted doing it for so long because I thought MDegrain did such a good job it could not really improve that much with SMDegrain. SMDegrain's output is so much improved it's staggering. It's like the difference MDegrain made over HQDN3D and that I would never go back to HQDN3D after seeing the results for MDegrain. Now SMDegrain has made MDegrain obsolete.
Now I'm at the point where the output is so clean with SMDegrain I think something must be wrong as the file sizes are so much smaller and I must have lost detail. Every detailed comparison I've made shows that I was wrong and the output from SMDegrain has not only removed the grain, but since the grain is removed, details actually stand out and everything appears crisper. I've actually started re-encoding older films and watching them again such as The Terminator, The Edge, etc. just because the difference in detail is so dramatic it is like experiencing the film all over again and it is a joy to watch.
SMDegrain also does not produce the detail blur I saw with MDegrain3 in a characters face when they turned their head.
The only tweak I have started doing is blksize=8 when dealing with video that has a lot of dark scenes in it.
Please replace MDegrain with the following SMDegrain strength settings:
Light: SMDegrain(video,tr=2,thSAD=200,thSADC=100,contrasharp=true,prefilter=0,refinemotion=true)
Medium: SMDegrain(video,tr=4,thSAD=400,thSADC=200,contrasharp=true,prefilter=1,refinemotion=true)
Strong: SMDegrain(video,tr=8,thSAD=800,thSADC=400,contrasharp=true,prefilter=2,refinemotion=true)
Thanks again Atak for everything.
What about the speed?
What's the difference in speed between SMDegrain & MDegrain at those 3 settings you suggest?
guest
5th December 2022, 12:35
What about the speed?
What's the difference in speed between SMDegrain & MDegrain at those 3 settings you suggest?
Hi slalom,
https://forum.doom9.org/showthread.php?p=1979320#post1979320
cypher007
5th December 2022, 13:09
Come on cypher, I think it's time you gave up on this...
I have a 5.2kW solar array, and my power is approx $0.38 per kwh, but my "rule", if the solar isn't generating enough power so I can encode for "free", I don't do any, and with the weather in my area being really crappy for months & months, I don't get much done :(, and time's running out.
I would think that if there were other users that use this function, you would have had some replies, but in my way of thinking, as you haven't, no body uses it !!!!
If Atak would explain what it does to encodes in progress, then it's probably not a really economical process, as you would be losing encodes, everytime it shuts down !!!
As rlev11 suggested, maybe you should set up a Windows Task to shut down & wake up the laptop, but then that wouldn't restart the interrupted encode, would it :(
if i wasnt on such crap money i would just let it run, but im now looking at using works pc to do the encodes. the problem i have is a typical 2hr movie takes about 24hrs on my i5 10th gen.
Ryushin
5th December 2022, 15:39
What about the speed?
What's the difference in speed between SMDegrain & MDegrain at those 3 settings you suggest?
Well, thing is, SMDegrain and MDegrain are so different from one another the speed should not be comparable. SMDegrain calls a lot more functions and I would think it would be vastly slower, but it's not. SMDegrain is comparable in speed to MDegrain. All depends on functions used.
Generally, and I don't know why, SMDegrain Light and Medium is faster than equivalent MDegrain. While SMDegrain Hard is about 20-30% slower than MDegrain. SMDegrain gives vastly improved visuals over MDegrain. Just as MDegrain gave huge improved visuals over HQDN3D.
Edit: blksize=8 drops the speed down by half, which is okay as it's processing four times as many blocks. I use this to prevent "blotchy" in content that the background is almost dark, or having two similar colors, such as in Untouchables, where Sean Connery is wearing a navy blue uniform at night on the bridge. Though I have to zoom up on the image to notice it.
Atak_Snajpera
5th December 2022, 17:10
if i wasnt on such crap money i would just let it run, but im now looking at using works pc to do the encodes. the problem i have is a typical 2hr movie takes about 24hrs on my i5 10th gen.
Can you check if WAKE function even works on your PC?
Try this
1) open Task Scheduler
2) create new task
https://i.postimg.cc/ht4x1w9S/Untitled-1.png
3) Type WorkHours as name
https://i.postimg.cc/MpsBPDD1/Untitled-2.png
4) Click triggers tap -> new -> specify time
https://i.postimg.cc/wvNsBddk/Untitled-3.png
5) Actions -> start program -> rundll32.exe
https://i.postimg.cc/mrJHRgKD/Untitled-4.png
6) Conditions -> Wake the computer ...
https://i.postimg.cc/FzQkdnrX/Untitled-5.png
Now suspend your PC.
guest
8th December 2022, 02:31
This is targeted at the standard version(s)...
This will update the main components of the program, and nothing else.
https://www.mediafire.com/file/x110q55ub25wm47/update+package+for+RipBot264.7z/file
please read the two included .txt files.
Stay tuned for updated & revised PD builds, coming soon..
Ryushin
8th December 2022, 12:50
So I got the Ryzen 7950x installed in the computer on Monday night I've been testing RB against it using many different threading options which I'll post at the end of the message.
Instead of reading through all the options, my threading options (for me) are as follows:
Two Encoding Servers
Set x264/x265 threads to 16: /x265-threads 16 /x264-threads 16 (RB default is 16 for the 7950x)
Set Avisynth Threads to 12: (In settings, use multiple processing threads) (RB default is 16 for the 7950x)
Last night I down clocked the Ryzen 7950x to all cores at 4700Mhz based on this information:
https://www.youtube.com/watch?v=7JiYAwKIHRY
My silicon is probably not as good as the one in the video or my motherboard and memory (running at 6000Mhz) won't me reach the same as the video. Though I might just have to do some more tuning. Right now I'm giving up 7% of the processors power to save more than double the power savings. AMD (and Intel for that matter) are really chasing every last bit of performance no matter the power costs.
Stock Power Consumption and Temperature:
Idle: 38 watts, 46 Celsius
Full Load:175 watts, 94.5 Celsius
Underclocked Power Consumption and Temperature:
Clock Speed: 4700 Mhz, Voltage: 1.005 volts
Idle: 8 watts, 40 Celsius,
Full Load: 88 watts, 58 Celsius
So essentially, in my case, I loose 7% of the maximum performance of the CPU, to save double the power savings at full load and five times the power savings at idle. I also noticed, at default power settings, full load had half of the cores at 5.1Ghz, while other half was at 4.8Ghz. I have not done any RB thread testing under the Underclocked settings yet as I still want to do some more tweaking and I'm hoping to hit that 4.8Ghz at 0.985 volts, the same as the video. I'm only encouraged going down this route.
BTW, the 7950x requires a 360mm or larger AIO (All In One) Cooler to stay within it's thermal limits. I chose the Fractal Design Celsius S36 360mm for my system, based on cost. But a 420mm cooler would be best:
https://www.youtube.com/watch?v=8kckURYqTKI
I had to buy a Phanteks Enthoo Primo PH-ES813P_SWT case to hold my four optical drives and provide enough room to go up to 420mm cooler. I still chose the 360mm based on cost. I thought the 360mm would be plenty. But there is still headroom that the 420mm gives you if you are going to run it at full tilt. With me underclocking the CPU, the 360mm is more than adequate. But still the 420 is the best option.
Here are all my RipBot thread tests and notes I wrote during testing:
RipBot264 default threads for Ryzen 7950x:
x264/x265 threads: 16
Avisynth Threads: 16
Encoding used for all tests: CQ18
4K Tests:
Source 3 Minutes: Top Gun Maverick 4K with changing aspect ratios (7:00 to 10:00)
No Degraining
One Encoding Server
x265 16 Threads: 5m:32s (13.01 fps)
x265 24 Threads: 4m:20s (16.62 fps)
x265 32 Threads: 4m:10s (17.28 fps)
Source 6 Minutes: Top Gun Maverick 4K with changing aspect ratios (7:00 to 13:00)
No Degraining
Two Encoding Servers
x265 16 Threads: 8m:7s (17.74 fps)
Source 3 Minutes: Top Gun Maverick 4K with changing aspect ratios (7:00 to 10:00)
SMDegrain Medium Setting: SMDegrain(video,tr=4,thSAD=400,thSADC=200,contrasharp=true,prefilter=1,refinemotion=true)
x264/x265 Threads: 16
Single Encoding Server and single chunk.
06 Avisynth Threads: 8m:04s (8.92 fps)
07 Avisynth Threads: 7m:20s (9.82 fps)
08 Avisynth Threads: 6m:45s (10.67 fps)
10 Avisynth Threads: 6m:46s (10.64 fps)
12 Avisynth Threads: 6m:36s (10.90 fps)
14 Avisynth Threads: 6m:33s (10.99 fps)
16 Avisynth Threads: 12m:30s (5.73 fps)
Noticed the CPU usage had been climbing from 50% for 8 threads to 100% for 16 threads. 16 threads also showed fluctuations from 30-100%. Theory is some threads are waiting on other threads to finish processing before they can continue.
Source 6 Minutes: Top Gun Maverick 4K with changing aspect ratios (7:00 to 13:00)
SMDegrain Medium Setting: SMDegrain(video,tr=4,thSAD=400,thSADC=200,contrasharp=true,prefilter=1,refinemotion=true)
x264/x265 Threads: 16
Two Encoding Servers and two chunks (3 minutes each).
06 Avisynth Threads: 12m:09s (11.85 fps)
07 Avisynth Threads: 12m:09s (11.85 fps)
08 Avisynth Threads: 12m:13s (11.79 fps)
10 Avisynth Threads: 12m:55s (11.15 fps)
12 Avisynth Threads: 12m:51s (11.21 fps)
14 Avisynth Threads: 13m:15s (10.87 fps)
16 Avisynth Threads: 14m:37s (9.85 fps)
Not much of an improvement compared to single threads, even starting from 6 threads.
Source 3 Minutes: Top Gun Maverick 4K with changing aspect ratios (7:00 to 10:00)
SMDegrain Medium Setting: SMDegrain(video,tr=4,thSAD=400,thSADC=200,contrasharp=true,prefilter=1,refinemotion=true)
Set x264/x265 threads to 32: /x265-threads 32 /x264-threads 32
Single Encoding Server and single chunk.
08 Avisynth Threads: 7m:45s (9.29 fps)
10 Avisynth Threads: 7m:04s (10.19 fps)
12 Avisynth Threads: 6m:50s (10.54 fps)
13 Avisynth Threads: 7m:00s (10.29 fps)
14 Avisynth Threads: 6m:53s (10.56 fps)
16 Avisynth Threads: 10m:45s (6.70 fps)
Source 3 Minutes: Top Gun Maverick 4K with changing aspect ratios (7:00 to 10:00)
SMDegrain Medium Setting: SMDegrain(video,tr=4,thSAD=400,thSADC=200,contrasharp=true,prefilter=1,refinemotion=true)
Set x264/x265 threads to 24: /x265-threads 24 /x264-threads 24
Single Encoding Server and single chunk.
08 Avisynth Threads: 7m:35s (9.49 fps)
10 Avisynth Threads: 6m:57s (10.40 fps)
12 Avisynth Threads: 6m:40s (10.80 fps)
14 Avisynth Threads: 6m:25s (11.22 fps)
16 Avisynth Threads: 10m:56s (6.59 fps)
Summary Best 4K Results:
Two Encoding Servers with 16 x264/x265 threads and 6-8 Avisynth threads. Note using the RipBot default of 16 avisynth threads is the slowest with all tests.
1080P Tests:
Source 6 Minutes: Cast Away HD (23:07 to 29:17)
No Degraining
Two Encoding Servers
x265 16 Threads: 3m:29s (42.49 fps)
Source 6 Minutes: Cast Away HD (23:07 to 29:17)
SMDegrain Hard Setting: SMDegrain(video,tr=8,thSAD=800,thSADC=400,contrasharp=true,prefilter=2,refinemotion=true)
Set x264/x265 threads to 16: /x265-threads 16 /x264-threads 16
Two Encoding Servers and two chunks (3m:0s first, 3m:10s second).
06 Avisynth Threads: 11m:51s (12.49 fps)
08 Avisynth Threads: 10m:05s (14.68 fps)
10 Avisynth Threads: 9m:58s (14.85 fps)
12 Avisynth Threads: 8m:50s (16.75 fps)
14 Avisynth Threads: 8m:48s (16.82 fps)
16 Avisynth Threads: 8m:56s (16.57 fps)
Atak's x265 Benchmark Tool:
Ryzen 1800x: encoded 2500 frames in 108.78s (22.98 fps), 7025.74 kbps, Avg QP:37.21
Ryzen 7950x: encoded 2500 frames in 21.74s (115.00 fps), 7025.74 kbps, Avg QP:37.21
guest
8th December 2022, 13:10
So I got the Ryzen 9750x installed in the computer on Monday night
Hi Ryushin,
So there is SO much info here, and tbh, I don't understand much of it.
But I have to confess, I have not used my 7950X yet :eek:
But these Avisynth Thread settings & x264/x265 Threads settings, are they the new option in the Encoder command line ??
I have been using the Affinity settings on the 3950X & 5950X, that rlev11 documented a while back.
So, I'm going to have to look into this, soon, I guess.
Ryushin
8th December 2022, 13:25
Hi Ryushin,
First of all mate, you need to stop calling it a 9750X.
So there is SO much info here, and tbh, I don't understand much of it.
But I have to confess, I have not used my 7950X yet :eek:
But these Avisynth Thread settings & x264/x265 Threads settings, are they the new option in the Encoder command line ??
I have been using the Affinity settings on the 3950X & 5950X, that rlev11 documented a while back.
So, I'm going to have to look into this, soon, I guess.
Fixed the 9750x to 7950x in my post. Not sure why I kept saying that. LOL
I'm not using any of the affinity settings, just the thread settings. So the x264/x265 threads settings is in the Encoding server command line options.
Essentially, using the default RB Avisynth threads of 16 for the 7950x has the FPS fall off a cliff with 4K content. Dialing it back to 12 gives the best overall performance with 4K and 1080p content.
The underclocking might be of serious interest for those running solar or off grid.
guest
8th December 2022, 14:04
Fixed the 9750x to 7950x in my post. Not sure why I kept saying that. LOL
I'm not using any of the affinity settings, just the thread settings. So the x264/x265 threads settings is in the Encoding server command line options.
Essentially, using the default RB Avisynth threads of 16 for the 7950x has the FPS fall off a cliff with 4K content. Dialing it back to 12 gives the best overall performance with 4K and 1080p content.
The underclocking might be of serious interest for those running solar or off grid.
You must have quoted my post while I edited mine...
Have you read my 7950X post ??
https://forum.doom9.org/showthread.php?p=1979340#post1979340
So the Affinity settings do the same thing, setting it back to 12 cores, but I guess if you want to do it that way, that's your choice :)
So you must be using this setting :-
Server1CommandLine=/port 1000 /priority normal /restart-if-no-progress /avisynth-prefetch-threads 12
And with the settings on the Main page :-
Use multiple processing threads..."0" ??
Limit to following filters only (checked or unchecked) ??
Ryushin
8th December 2022, 16:04
You must have quoted my post while I edited mine...
Have you read my 7950X post ??
https://forum.doom9.org/showthread.php?p=1979340#post1979340
So the Affinity settings do the same thing, setting it back to 12 cores, but I guess if you want to do it that way, that's your choice :)
So you must be using this setting :-
Server1CommandLine=/port 1000 /priority normal /restart-if-no-progress /avisynth-prefetch-threads 12
And with the settings on the Main page :-
Use multiple processing threads..."0" ??
Limit to following filters only (checked or unchecked) ??
Atak fixed that bug, so setting Use multiple processing threads to 12 sets the avisynth-prefetch-threads 12 in the Encoding Servers Wrench.
Setting the encoder threads this way I have 16 x264/x265 threads and 12 avisynth threads. I think this gave me the best results. Though I did not test limiting to 12 threads for x264/x265 as that that seems to like threading.
guest
9th December 2022, 04:29
Atak fixed that bug, so setting Use multiple processing threads to 12 sets the avisynth-prefetch-threads 12 in the Encoding Servers Wrench.
Setting the encoder threads this way I have 16 x264/x265 threads and 12 avisynth threads. I think this gave me the best results. Though I did not test limiting to 12 threads for x264/x265 as that that seems to like threading.
I sent you a PM regarding this, but I think I have now figured it out...
So something like this, then :-
Server1CommandLine=/port 1000 /priority normal /restart-if-no-progress /avisynth-prefetch-threads 12 /x264-threads 16 /x265-threads 16
Server2CommandLine=/port 2000 /priority normal /restart-if-no-progress /avisynth-prefetch-threads 12 /x264-threads 16 /x265-threads 16
OR
Server1CommandLine=/port 1000 /priority normal /restart-if-no-progress /avisynth-prefetch-threads 12 /x264-threads 12 /x265-threads 12
Server2CommandLine=/port 2000 /priority normal /restart-if-no-progress /avisynth-prefetch-threads 12 /x264-threads 12 /x265-threads 12
guest
9th December 2022, 05:40
Well, after about a week of re-hashing, re-configuring & updating the builds, they are ready to go...again :eek:
Lot's of important installation instruction's & hint's.
So PLEASE read them, it can prevent any problems.
More Filter's in the "full" PD build than before, including :-
Anime filters
Debanding filters
Dehaloing filters
De-interlacing filters
Derainbowing filters
Deringing filters
Resizing filters
Sharpening filters
and some special combo filter scripts, mainly for Anime type video's..
https://www.mediafire.com/file/bdkj1cwr91scg2u/RipBot264_PD+(08-12-22).7z/file (500Mb)
More info in the changelog.txt
Please Note:-
The PD_Lite build, has many component updates, but limited SMDegrain filter scripts available, ready to use, and that's all you get. :p
https://www.mediafire.com/file/bz3tmk78srl2wqq/RipBot264_PD_Lite_%252808-12-22%2529.7z/file (410Mb)
More info in the changelog.txt
Good luck..
Ryushin
9th December 2022, 10:04
I sent you a PM regarding this, but I think I have now figured it out...
So something like this, then :-
Server1CommandLine=/port 1000 /priority normal /restart-if-no-progress /avisynth-prefetch-threads 12 /x264-threads 16 /x265-threads 16
Server2CommandLine=/port 2000 /priority normal /restart-if-no-progress /avisynth-prefetch-threads 12 /x264-threads 16 /x265-threads 16
OR
Server1CommandLine=/port 1000 /priority normal /restart-if-no-progress /avisynth-prefetch-threads 12 /x264-threads 12 /x265-threads 12
Server2CommandLine=/port 2000 /priority normal /restart-if-no-progress /avisynth-prefetch-threads 12 /x264-threads 12 /x265-threads 12
The first one:
Server1CommandLine=/port 1000 /priority normal /restart-if-no-progress /avisynth-prefetch-threads 12 /x264-threads 16 /x265-threads 16
Server2CommandLine=/port 2000 /priority normal /restart-if-no-progress /avisynth-prefetch-threads 12 /x264-threads 16 /x265-threads 16
I was surprised at first with the testing as I thought I could use just one encoding server instead of two. For 4K sources, one encoding server is nearly adequate. But with HD sources, two encoding servers needed to be used.
guest
9th December 2022, 10:51
The first one:
Server1CommandLine=/port 1000 /priority normal /restart-if-no-progress /avisynth-prefetch-threads 12 /x264-threads 16 /x265-threads 16
Server2CommandLine=/port 2000 /priority normal /restart-if-no-progress /avisynth-prefetch-threads 12 /x264-threads 16 /x265-threads 16
I was surprised at first with the testing as I thought I could use just one encoding server instead of two. For 4K sources, one encoding server is nearly adequate. But with HD sources, two encoding servers needed to be used.
Thanks,
I will give that a try, when I get around to firing up the 7950X.
rlev11
9th December 2022, 16:53
So a quick test comparing fps on 4k stuff using either the affinity mask or the avisynth-prefetch-threads setting them to 12 on my 16 core ryzens (1-3950x,3-5950x,1-7950x). About halfway thru a 4k movie once everything settles out, the total fps showing on the distributed encoding window are very similar between them. Within a couple fps in the 70-72 fps range. If these numbers hold up for 1080p stuff, this will help me out as I won't have to have 2 separate command batch files for the encoding servers and switch between them when doing 4k and anything else. I can just start everything with the prefetch numbers and be done with it. (720 and 1080 stuff runs much faster without the affinity mask set to 12 cores)
I encode everything to 10bit HEVC using default encoder settings with a CRF of 18
I have now switched over to using 3 SMDegrain scripts. In the past I was using just mdegrain3 with strengths of 200 for clean sources, 300 for light grain sources, and 400 for grainy sources. I did some testing and specifically comparing final file sizes, I now use the following SMDegrain scripts:
Clean sources - video=SMDegrain(video,tr=3,thSAD=300,thSADC=150,contrasharp=true,prefilter=1,refinemotion=true)
Light grain - video=SMDegrain(video,tr=4,thSAD=400,thSADC=200,contrasharp=true,prefilter=1,refinemotion=true)
Grainy - video=SMDegrain(video,tr=6,thSAD=600,thSADC=300,contrasharp=true,prefilter=2,refinemotion=true)
As I said, the end files sizes are very close to the corresponding mdegrain3 settings I had been using.
The biggest difference is in the speed increase using SMDegrain. I am seeing about a 40 - 60 % increase in fps using SMDegrain over mdegrain using comparable settings. 4k Forrest Gump with mdegrain was around 49-50 fps and with SMDegrain is 73-75 fps.
I did come across 1 movie that just would not run using SMDegrain, but did run using mdegrain, not sure what was up with that, so mdegrain is not completely dead
guest
10th December 2022, 00:50
So a quick test comparing fps on 4k stuff using either the affinity mask or the avisynth-prefetch-threads setting them to 12 on my 16 core ryzens (1-3950x,3-5950x,1-7950x). About halfway thru a 4k movie once everything settles out, the total fps showing on the distributed encoding window are very similar between them. Within a couple fps in the 70-72 fps range. If these numbers hold up for 1080p stuff, this will help me out as I won't have to have 2 separate command batch files for the encoding servers and switch between them when doing 4k and anything else. I can just start everything with the prefetch numbers and be done with it. (720 and 1080 stuff runs much faster without the affinity mask set to 12 cores)
I encode everything to 10bit HEVC using default encoder settings with a CRF of 18
I have now switched over to using 3 SMDegrain scripts. In the past I was using just mdegrain3 with strengths of 200 for clean sources, 300 for light grain sources, and 400 for grainy sources. I did some testing and specifically comparing final file sizes, I now use the following SMDegrain scripts:
Clean sources - video=SMDegrain(video,tr=3,thSAD=300,thSADC=150,contrasharp=true,prefilter=1,refinemotion=true)
Light grain - video=SMDegrain(video,tr=4,thSAD=400,thSADC=200,contrasharp=true,prefilter=1,refinemotion=true)
Grainy - video=SMDegrain(video,tr=6,thSAD=600,thSADC=300,contrasharp=true,prefilter=2,refinemotion=true)
As I said, the end files sizes are very close to the corresponding mdegrain3 settings I had been using.
The biggest difference is in the speed increase using SMDegrain. I am seeing about a 40 - 60 % increase in fps using SMDegrain over mdegrain using comparable settings. 4k Forrest Gump with mdegrain was around 49-50 fps and with SMDegrain is 73-75 fps.
I did come across 1 movie that just would not run using SMDegrain, but did run using mdegrain, not sure what was up with that, so mdegrain is not completely dead
Hi rlev11,
It's great to know that you seem to have sussed it out, and are very happy with the results, both in quality & encoding speed :)
I will be interested in hearing your thoughts, once you've tried the "non" affinity option, and how your 720p & 1080p encodes perform without changing your settings...
I also noticed that you've "bumped up" the strength of the script for "clean" sources....interesting !!
I would be very interested to know what the movie was that SMDegrain didn't like.
Sometimes (well, nearly always) I will run a movie thru MKVToolNix just to gut out all the stuff that I don't want, (less work & time for RB) and then run it thru RB, sometimes that will "fix" any problems.
But as I have said many times, when it comes to 4K stuff, I run it thru MKVToolNix, and just get the video track, and run that thru RB, and most of the time, it's also in 20 - 30 minute "chunks", so I don't have to run the encoding process ALL day.
guest
10th December 2022, 06:08
Hey guy's,
I have a couple of small, but important updates.
Dogway just never stops "fiddling" :eek:
So here's the update for the PD "full" build :-
https://www.mediafire.com/file/j50eci9sylgoanm/PD_TOOLS_%2528full%2529.7z/file 148kb
and for the "Lite" build :-
https://www.mediafire.com/file/ma59vay8gszq1v6/PD_TOOLS_%2528lite%2529.7z/file 90kb
Simply unpack, and copy into the PD_Tools folder...that's it :)
rlev11
10th December 2022, 16:10
Hi rlev11,
It's great to know that you seem to have sussed it out, and are very happy with the results, both in quality & encoding speed :)
I will be interested in hearing your thoughts, once you've tried the "non" affinity option, and how your 720p & 1080p encodes perform without changing your settings...
I also noticed that you've "bumped up" the strength of the script for "clean" sources....interesting !!
I would be very interested to know what the movie was that SMDegrain didn't like.
Sometimes (well, nearly always) I will run a movie thru MKVToolNix just to gut out all the stuff that I don't want, (less work & time for RB) and then run it thru RB, sometimes that will "fix" any problems.
But as I have said many times, when it comes to 4K stuff, I run it thru MKVToolNix, and just get the video track, and run that thru RB, and most of the time, it's also in 20 - 30 minute "chunks", so I don't have to run the encoding process ALL day.
I do the same thing, run everything through MKVToolNix and strip out everyhting but the videoand audio tracks and a subtitle if needed for foreign language. The movie was Iron Man 3
So it looks like I have to re-evaluate my earlier belief that with 720 and 1080 sources run better on the 16 core Ryzen's running full bore. I did a somewhat controlled test with a 720 and a 1080 source. I used the exact same settings and smdegrain script EXCEPT either running the 16 core Ryzen's in my farm full out, 12core using affinity mask, or just changing the avisynth prefetch settings to 12. My results were quite surprising to me.
I am just using the fps number at the bottom of the distributed encoding window when the last chunk gets to 25% so it is at the same point in each test. This is running my full farm of encoding servers with a single thread on everything except the 7950x which I have 2 servers active.
With the 16 core Ryzen's running at full bore the 720 ran at 530fps and the 1080 227fps
Running the Ryzens at 12 cpu with affinity mask setting the 720 ran at 560 and the 1080 at 218
Running the 16 core Ryzens just adding the avisynth prefetch threads set to 12 the 720 ran at 535 and the 1080 at 225
This is combined with earlier tests that doing 4k running the 16 core Ryzens full bore drops fps off the cliff, the end result as I can see is it doesn't matter too much weather you use affinity mask or prefetch threads set to 12, you should just use one of them and leave everything alone regardless of what resolution you are encoding. YMMV
Ryushin
12th December 2022, 12:59
Hi Atak,
I've been having this annoying problem on one particular machine. RB won't start up automatically on boot. It's been doing this for a couple of years not, but I just have not been able to get it resolved.
I checked the box to start automatically, but it does not seem to take. Going right back into settings shows the box as unchecked.
RB used to start up fine on this machine, until I had to recreate my Windows User Profile after it got some weird corruption that was preventing a program from working and that only way to solve it was to create a fresh profile. I copied what I could from the old profile into the new profile so I didn't have to start from scratch.
I've tried going through the registry and deleted RB entries at one point but that did not solve the problem. Any insight into what registry keys I need to delete so RB can start back up on windows startup?
rlev11
12th December 2022, 21:16
Hi Atak,
I've been having this annoying problem on one particular machine. RB won't start up automatically on boot. It's been doing this for a couple of years not, but I just have not been able to get it resolved.
I checked the box to start automatically, but it does not seem to take. Going right back into settings shows the box as unchecked.
RB used to start up fine on this machine, until I had to recreate my Windows User Profile after it got some weird corruption that was preventing a program from working and that only way to solve it was to create a fresh profile. I copied what I could from the old profile into the new profile so I didn't have to start from scratch.
I've tried going through the registry and deleted RB entries at one point but that did not solve the problem. Any insight into what registry keys I need to delete so RB can start back up on windows startup?
Another option you could try which is similar to how I auto start the encoding server on my 8 servers is just right click ripbot264.exe and create a shortcut (on win11 you have to first click "show more options").
Then right click start button and click run, enter in shell:startup , and drag the shortcut you just created into the folder that opens up. next time you reboot it should start up
Ryushin
13th December 2022, 13:38
Oh yea, I can do the other approaches. It's not hard at all to use a vbscript and the shell to start it. This is a bandaid though. I'd like fix the root cause of it and Atak should know what that might be.
slalom
13th December 2022, 15:36
What's this error about?
Encoding started...
""\\PAVLOS-PC\Ripbot264temp\Tools\ffmpeg\bin\ffmpeg.exe" -loglevel panic -i "\\PAVLOS-PC\RipBot264temp\job209\Chunks\4.avs" -strict -1 -f yuv4mpegpipe -
| "\\PAVLOS-PC\Ripbot264temp\tools\x264\x264_x64.exe" --seek 24 --colorprim bt709 --transfer bt709 --colormatrix bt709 --bitrate 4869 --fps 24000/1001
--force-cfr --min-keyint 24 --keyint 240 --frames 1443 --sar 1:1 --level 4.0 --aud --nal-hrd vbr --vbv-bufsize 25000 --vbv-maxrate 25000 --b-pyramid none --stdin y4m --threads 10
--output "\\PAVLOS-PC\RipBot264temp\job209\Chunks\4.264" -"
y4m [error]: bad sequence header magic
x264 [error]: could not open input file `-'
clients are starting and stopping
SKPN
13th December 2022, 16:18
I discovered what appears to be a bug with special (accented) characters in the filename. When trying to batch process files with accented characters, the program just skips over them entirely. No errors, just bypasses the file.
Atak_Snajpera
13th December 2022, 16:45
What's this error about?
Encoding started...
""\\PAVLOS-PC\Ripbot264temp\Tools\ffmpeg\bin\ffmpeg.exe" -loglevel panic -i "\\PAVLOS-PC\RipBot264temp\job209\Chunks\4.avs" -strict -1 -f yuv4mpegpipe -
| "\\PAVLOS-PC\Ripbot264temp\tools\x264\x264_x64.exe" --seek 24 --colorprim bt709 --transfer bt709 --colormatrix bt709 --bitrate 4869 --fps 24000/1001
--force-cfr --min-keyint 24 --keyint 240 --frames 1443 --sar 1:1 --level 4.0 --aud --nal-hrd vbr --vbv-bufsize 25000 --vbv-maxrate 25000 --b-pyramid none --stdin y4m --threads 10
--output "\\PAVLOS-PC\RipBot264temp\job209\Chunks\4.264" -"
y4m [error]: bad sequence header magic
x264 [error]: could not open input file `-'
clients are starting and stopping
Open \\PAVLOS-PC\RipBot264temp\job209\Chunks\4.avs file in MPC-HC and see what happens.
slalom
13th December 2022, 17:40
It says
LWLibavVideoSource: failed to get the video track
E:\Temp\RipBot264temp\job209\Chunks\4.avs, line 6
4.avs
#MT
#PREFETCH_LIMIT=0
#VideoSource
LoadPlugin("D:\DirectCD\Program Setup Files\RipBot264v1.26.0\Tools\AviSynth plugins\lsmash\LSMASHSource.dll")
video=LWLibavVideoSource("\\PAVLOS-PC\RipBot264temp\job209\video.mkv",threads=0,cachefile="C:\Users\Pavlos\AppData\Local\Temp\EncodingServer2\video.mkv.lwi")
#Deinterlace
#Decimate
#Crop
#Downscale
#Tonemap
#Levels
#Colours
#Denoise
#Custom
#Prefetch
video=Prefetch(video,10)
#After_Prefetch_Denoise
#After_Prefetch_Custom
#Sharpen
#Upscale
LoadPlugin("D:\DirectCD\Program Setup Files\RipBot264v1.26.0\Tools\AviSynth plugins\ColorMatrix\ColorMatrix64.dll")
LoadPlugin("D:\DirectCD\Program Setup Files\RipBot264v1.26.0\Tools\AviSynth plugins\Plugins_JPSDR\Plugins_JPSDR.dll")
video=Spline36ResizeMT(video,1920,1080)
#Borders
Import("D:\DirectCD\Program Setup Files\RipBot264v1.26.0\Tools\AviSynth plugins\Scripts\AutoBorders.avs")
video=AutoBorders(video,16.0/9.0)
#Subtitles
#AudioSource
#Triming
#AVSameLength
video=Trim(video,4279,5769)
#ColorSpace
#Return
return video
cypher007
13th December 2022, 23:12
Can you check if WAKE function even works on your PC?
Try this
1) open Task Scheduler
2) create new task
3) Type WorkHours as name
4) Click triggers tap -> new -> specify time
5) Actions -> start program -> rundll32.exe
6) Conditions -> Wake the computer ...
Now suspend your PC.
that worked first time, even on server 2022, though on server i had to use psshutdown64 tool to put the server to sleep.
guest
14th December 2022, 05:18
What's this error about?
Encoding started...
""\\PAVLOS-PC\Ripbot264temp\Tools\ffmpeg\bin\ffmpeg.exe" -loglevel panic -i "\\PAVLOS-PC\RipBot264temp\job209\Chunks\4.avs" -strict -1 -f yuv4mpegpipe -
| "\\PAVLOS-PC\Ripbot264temp\tools\x264\x264_x64.exe" --seek 24 --colorprim bt709 --transfer bt709 --colormatrix bt709 --bitrate 4869 --fps 24000/1001
--force-cfr --min-keyint 24 --keyint 240 --frames 1443 --sar 1:1 --level 4.0 --aud --nal-hrd vbr --vbv-bufsize 25000 --vbv-maxrate 25000 --b-pyramid none --stdin y4m --threads 10
--output "\\PAVLOS-PC\RipBot264temp\job209\Chunks\4.264" -"
y4m [error]: bad sequence header magic
x264 [error]: could not open input file `-'
clients are starting and stopping
Hi,
I sometimes get this error, and most of the time it's either a Avisynth or vc_redist problem.
Or
It can be something has changed with the script or the codec being used.
Does it happen with everything, or just certain "job's" ??
Are you using the very latest RB ??
guest
14th December 2022, 05:20
I discovered what appears to be a bug with special (accented) characters in the filename. When trying to batch process files with accented characters, the program just skips over them entirely. No errors, just bypasses the file.
This IS a common and known issue, and the best way to "fix" this is to simply rename the file(s)...I know it's PITA, but what can you do ?
There is generally a work-around for most problems ;)
guest
14th December 2022, 05:23
Oh yea, I can do the other approaches. It's not hard at all to use a vbscript and the shell to start it. This is a bandaid though. I'd like fix the root cause of it and Atak should know what that might be.
There is a good chance that Atak won't be able to replicate this problem.
There is clearly a very specific reason for this not to be working for you, on this particular machine, and a "band-aid" solution might be all you can do...
cypher007
14th December 2022, 12:03
on an OS note. which is quicker at encoding on 12th gen laptop H processors? win 10 or 11?
Ryushin
14th December 2022, 12:24
There is a good chance that Atak won't be able to replicate this problem.
There is clearly a very specific reason for this not to be working for you, on this particular machine, and a "band-aid" solution might be all you can do...
True. But before I go down the road of using a Band-Aid, if Atak can let me know what are the registry keys that need deleting, I'll go with that first. Or he can let me know which method RB uses to auto start. I believe that Windows has four different methods to auto start programs.
slalom
14th December 2022, 14:18
Hi,
I sometimes get this error, and most of the time it's either a Avisynth or vc_redist problem.
Or
It can be something has changed with the script or the codec being used.
Does it happen with everything, or just certain "job's" ??
Are you using the very latest RB ??
Yes RB is the latest. How do you solve the problem?
I will re-download from first page and update and see what happens
Atak_Snajpera
14th December 2022, 14:29
True. But before I go down the road of using a Band-Aid, if Atak can let me know what are the registry keys that need deleting, I'll go with that first. Or he can let me know which method RB uses to auto start. I believe that Windows has four different methods to auto start programs.
I use Task Scheduler. When You check that checkbox and click APPLY this entry should show up
https://i.postimg.cc/ZK3g7BZn/Capture.png
Atak_Snajpera
14th December 2022, 14:30
Yes RB is the latest. How do you solve the problem?
I will re-download from first page and update and see what happens
What does mediainfo say about that video.mkv file?
Atak_Snajpera
14th December 2022, 14:31
on an OS note. which is quicker at encoding on 12th gen laptop H processors? win 10 or 11?
CPU does calculation not OS.
cypher007
14th December 2022, 15:24
re the test. have you figured why ripbot doesnt wake but entering a schedule manually does?
slalom
14th December 2022, 16:46
What does mediainfo say about that video.mkv file?
General
Unique ID : 25515269669631658090640402085016664335 (0x13320FEBA81D9A5F1118F5C2163E790F)
Complete name : H:\___Kingslayer.2022\Kingslayer.2022.mkv
Format : Matroska
Format version : Version 4
File size : 22.9 GiB
Duration : 1 h 37 min
Overall bit rate mode : Variable
Overall bit rate : 33.7 Mb/s
Movie name : Kingslayer (2022)
Encoded date : UTC 2022-11-28 17:46:14
Writing application : mkvmerge v72.0.0 ('Minuano (Six-eight)') 64-bit
Writing library : libebml v1.4.4 + libmatroska v1.7.1
IMDB : tt10352594
TMDB : movie/991247
Video
ID : 1
Format : AVC
Format/Info : Advanced Video Codec
Format profile : High@L4.1
Format settings : CABAC / 4 Ref Frames
Format settings, CABAC : Yes
Format settings, Reference frames : 4 frames
Format settings, GOP : M=1, N=12
Codec ID : V_MPEG4/ISO/AVC
Duration : 1 h 37 min
Bit rate mode : Constant
Bit rate : 31.1 Mb/s
Nominal bit rate : 33.0 Mb/s
Width : 1 920 pixels
Height : 1 080 pixels
Display aspect ratio : 16:9
Frame rate mode : Constant
Frame rate : 23.976 (24000/1001) FPS
Color space : YUV
Chroma subsampling : 4:2:0
Bit depth : 8 bits
Scan type : Progressive
Bits/(Pixel*Frame) : 0.626
Stream size : 21.1 GiB (92%)
Default : Yes
Forced : No
Audio
ID : 2
Format : DTS XLL
Format/Info : Digital Theater Systems
Commercial name : DTS-HD Master Audio
Codec ID : A_DTS
Duration : 1 h 37 min
Bit rate mode : Variable
Bit rate : 2 520 kb/s
Channel(s) : 6 channels
Channel layout : C L R Ls Rs LFE
Sampling rate : 48.0 kHz
Frame rate : 93.750 FPS (512 SPF)
Bit depth : 24 bits
Compression mode : Lossless
Stream size : 1.71 GiB (7%)
Title : DTS-HD MA 5.1
Language : English
Default : Yes
Forced : No
Text
ID : 3
Format : PGS
Codec ID : S_HDMV/PGS
Codec ID/Info : Picture based subtitle format used on BDs/HD-DVDs
Duration : 1 h 32 min
Bit rate : 34.5 kb/s
Frame rate : 0.373 FPS
Count of elements : 2059
Stream size : 22.7 MiB (0%)
Title : English (SDH)
Language : English
Default : No
Forced : No
Menu
00:00:00.000 : en:Chapter 1
00:10:08.066 : en:Chapter 2
00:19:09.315 : en:Chapter 3
00:28:47.893 : en:Chapter 4
00:38:36.189 : en:Chapter 5
00:50:17.640 : en:Chapter 6
00:59:25.312 : en:Chapter 7
01:06:12.677 : en:Chapter 8
01:10:42.655 : en:Chapter 9
01:17:52.001 : en:Chapter 10
01:26:47.494 : en:Chapter 11
01:33:26.976 : en:Chapter 12
slalom
14th December 2022, 22:00
Looks like I'll have to reload some jobs
Today's added jobs are encoding just fine
Ryushin
15th December 2022, 00:21
I use Task Scheduler. When You check that checkbox and click APPLY this entry should show up
Perfect. Thank you. I exported the Task from another server, imported it, set the current user as the owner and it works like a charm. Thanks again.
guest
15th December 2022, 01:44
Perfect. Thank you. I exported the Task from another server, imported it, set the current user as the owner and it works like a charm. Thanks again.
Like so many things, once you know how it works, it's "simple" :D
guest
15th December 2022, 02:21
I thought I'd post this link to a great little utility that is the successor to "Process Hacker".
https://systeminformer.sourceforge.io/
Even has Dark Theme for W10 & W11 :)
SKPN
15th December 2022, 05:39
This IS a common and known issue, and the best way to "fix" this is to simply rename the file(s)...I know it's PITA, but what can you do ?
There is generally a work-around for most problems ;)
Thanks for the heads up! I had already renamed the files and moved on, but didn't know it was already a known issue. Just wanted to report it so it didn't go under the radar.
guest
21st December 2022, 03:12
Atak, is there some way another app can be implemented ?
I find that MPC-HC has a LOT of trouble playing 4K content with heavy filters.
guest
21st December 2022, 03:27
I have noticed when loading HDR 4K content, that even tho I have this option disabled, it is still wanting to downconvert, if you check the script.
ForceHDRtoSDRconversion=0
The "Tonemap" setting as "ON" downconverts, "OFF" doesn't.
#Tonemap
Loadplugin("C:\RipBot264\Tools\AviSynth plugins\HDRTools\hdrtools.dll")
Import("C:\RipBot264\Tools\AviSynth plugins\Scripts\HDRtoSDR.avs")
video=HDRtoSDR(video,"PQ")
I'm sure it hasn't been like this before :confused:
cypher007
21st December 2022, 14:07
I use Task Scheduler. When You check that checkbox and click APPLY this entry should show up
https://i.postimg.cc/ZK3g7BZn/Capture.png
is this what ripbot uses for work hours? as it seems its not able to insert the schedule into windows 10/server 2022. as the test you gave me to do worked, but when i use work hours i dont see it adding anything to the task scheduler.
chainring
21st December 2022, 18:43
Hey all,
I've decided to dip my toes into the SMDegrain world and I've tried to do so with the Lite package posted by Ryushin, here: https://forum.doom9.org/showthread.php?p=1979287#post1979287
Looking in the various .avs files created for the job, it appears the plugins and scripts are being loaded and imported correctly since there's entries in #Custom. Problem is, RB dumps out immediately after starting the job. Interestingly, no info.txt is created. Where would I start looking to solve this?
Note: RB is fully up to date from Atak's latest releases. Also, encoding without the custom scripts works fine.
cypher007
22nd December 2022, 01:09
ok got another issue. tried ripbot on my new 12700h laptop and x265 just maxes the E cores. im running a clean install of win 10 instead of the win 11 that it came with, all drivers are installed.
Emulgator
22nd December 2022, 01:25
Although the link is about a famous audio app, the problems and solutions are the same: Set Thread affinity, see:
https://helpcenter.steinberg.de/hc/en-us/articles/8412891538066-Performance-issues-on-Intel-Core-12th-gen-or-newer-hybrid-architecture-CPUs
It is also described here in this subforum, IIRC.
guest
22nd December 2022, 01:26
ok got another issue. tried ripbot on my new 12700h laptop and x265 just maxes the E cores. im running a clean install of win 10 instead of the win 11 that it came with, all drivers are installed.
So what's the issue ??
You need to provide way more info...when RipBot is encoding, it's just like a stress test that can last for hours & hours, and it's pretty normal for it "max out" the CPU!!!
Have to be honest, tho, these "E" & "P" cores....I'm an AMD user.
Emulgator
22nd December 2022, 01:36
And for completeness sake:
https://www.bollyinside.com/articles/how-to-force-apps-to-use-specific-cpu-cores-using-processor-affinity/
guest
22nd December 2022, 12:27
Hey all,
I've decided to dip my toes into the SMDegrain world and I've tried to do so with the Lite package posted by Ryushin, here: https://forum.doom9.org/showthread.php?p=1979287#post1979287
Looking in the various .avs files created for the job, it appears the plugins and scripts are being loaded and imported correctly since there's entries in #Custom. Problem is, RB dumps out immediately after starting the job. Interestingly, no info.txt is created. Where would I start looking to solve this?
Note: RB is fully up to date from Atak's latest releases. Also, encoding without the custom scripts works fine.
WTAF, it's good to know you want to try SMDegrain, but unfortunately you have gone about it the wrong way
Ryushin's link is kind of redundant, due to it not having everything that is required, as you've discovered, the hard way.
You need to do a bit more reading, the series of posts after that link, will provide the solution to your problems.
But you really need to focus on Pauly Dunne's posts and download links.
Good luck.
cypher007
22nd December 2022, 12:38
And for completeness sake:
https://www.bollyinside.com/articles/how-to-force-apps-to-use-specific-cpu-cores-using-processor-affinity/
thanks for the info. ive found a cmd trick that turns off cpu throttling for a specific exe. which ive set as x265_x64.exe:
POWERCFG /POWERTHROTTLING DISABLE /PATH "C:\Users\user\Downloads\RipBot264v1.26.0\Tools\x265\x265_x64.exe"
that gets me to a 85-95% cpu usage. apparently the reason its doing this is because of an old version of thread director in win 10 that microsoft dont seem to want to update. the odd thing is if i bench the processor with cpuid it maxes to 100%.
for now im going to try win 11 :( .
@TDS sorry not enough info but basically its when its encoding with x265.
guest
22nd December 2022, 13:11
thanks for the info. ive found a cmd trick that turns off cpu throttling for a specific exe. which ive set as x265_x64.exe:
POWERCFG /POWERTHROTTLING DISABLE /PATH "C:\Users\user\Downloads\RipBot264v1.26.0\Tools\x265\x265_x64.exe"
that gets me to a 85-95% cpu usage. apparently the reason its doing this is because of an old version of thread director in win 10 that microsoft dont seem to want to update. the odd thing is if i bench the processor with cpuid it maxes to 100%.
for now im going to try win 11 :( .
@TDS sorry not enough info but basically its when its encoding with x265.
Thats good that you have found a "fix", and how W11 will "treat" you, is yet to be determined, I guess.
But I have to ask, why are you so concerned about 100% CPU usage ??
Is the laptop overheating or something ??
cypher007
23rd December 2022, 00:27
Thats good that you have found a "fix", and how W11 will "treat" you, is yet to be determined, I guess.
But I have to ask, why are you so concerned about 100% CPU usage ??
Is the laptop overheating or something ??
actually the cooling on my new laptop seems very effective, i suppose its designed for the gpu and cpu to be adding heat but at the mo its only the cpu. it was more to speed up the encoding to the max.
today ive installed win 11 and its about the same as win 10 with the tweak, but ill see how things go as watched some youtubes where it was found 12th gen and up with hybrid cores work better on win 11.
chainring
23rd December 2022, 01:43
WTAF, it's good to know you want to try SMDegrain, but unfortunately you have gone about it the wrong way
Ryushin's link is kind of redundant, due to it not having everything that is required, as you've discovered, the hard way.
You need to do a bit more reading, the series of posts after that link, will provide the solution to your problems.
But you really need to focus on Pauly Dunne's posts and download links.
Good luck.
I went backwards from Ryushin's post to see rlev11 had the same issue, who then fixed it later by copying libfftw3f-3.dll to their appropriate system directories.
All good now.
guest
23rd December 2022, 02:13
I went backwards from Ryushin's post to see rlev11 had the same issue, who then fixed it later by copying libfftw3f-3.dll to their appropriate system directories.
All good now.
Good to know...however. :cool:
https://forum.doom9.org/showthread.php?p=1979533#post1979533
chainring
23rd December 2022, 02:46
Good to know...however. :cool:
https://forum.doom9.org/showthread.php?p=1979533#post1979533
I saw those and have them downloaded. I was more interested in a very limited scope test of SMDegrain and the stripped PD build from Ryushin accomplished the goal, albeit with a simple problem to overcome.
Thanks!
guest
23rd December 2022, 05:09
I saw those and have them downloaded. I was more interested in a very limited scope test of SMDegrain and the stripped PD build from Ryushin accomplished the goal, albeit with a simple problem to overcome.
Thanks!
Fair enough ;)
Well, once you've got it figured out, I don't think you will be disappointed.
Will be interested in your thoughts, soon.
frencher
23rd December 2022, 19:58
Hello all,
I'm building my new PC and looking for the best performing CPU under Ripbot264 (Today i7 3930k)
I hesitate between the intel i9 13900K or the Ryzen 9 7950X
Which one will have the most fps in 4K h265 encoding ?
Thank you.
guest
24th December 2022, 00:30
Hello all,
I'm building my new PC and looking for the best performing CPU under Ripbot264 (Today i7 3930k)
I hesitate between the intel i9 13900K or the Ryzen 9 7950X
Which one will have the most fps in 4K h265 encoding ?
Thank you.
Hi, as you can see from my "sig" that I have AMD's.
I was thinking of a 13900K, but I'm still not convinced about the "E" & "P" cores, whereas the 7950X is ALL cores.
As the pricing of the CPU's is very similar, it's up to you to which way to go, I doubt you would be disappointed in either.
If money is a factor, you should be able to build a 13900K system a fair bit cheaper, if you went for a motherboard that supports DDR4, as DDR5 is pretty expensive, and let's face it, you're ONLY after the encoding power of the CPU.
Having said that, AMD & Intel are soon to release even faster versions of there CPU's, a 7950X3D, and the i9-13900KS (I think it's called).
I know I'm very happy with my 7950X, and I know a couple of other users that feel the same....there hasn't been any comments from anyone using a 13900K, yet, which would be interesting.
Good Luck
PS:- and then there's the new "gen" Threadrippers...:D
frencher
24th December 2022, 15:55
Hi, as you can see from my "sig" that I have AMD's.
I was thinking of a 13900K, but I'm still not convinced about the "E" & "P" cores, whereas the 7950X is ALL cores.
As the pricing of the CPU's is very similar, it's up to you to which way to go, I doubt you would be disappointed in either.
If money is a factor, you should be able to build a 13900K system a fair bit cheaper, if you went for a motherboard that supports DDR4, as DDR5 is pretty expensive, and let's face it, you're ONLY after the encoding power of the CPU.
Having said that, AMD & Intel are soon to release even faster versions of there CPU's, a 7950X3D, and the i9-13900KS (I think it's called).
I know I'm very happy with my 7950X, and I know a couple of other users that feel the same....there hasn't been any comments from anyone using a 13900K, yet, which would be interesting.
Good Luck
PS:- and then there's the new "gen" Threadrippers...:D
Thank you for the feedback, and what does the 7950X do in h265 in 4K encoding, I am at 3 fps with my old dinosaur i7 3930k
PS: Threadrippers Jeeez, price :D
guest
24th December 2022, 16:19
Thank you for the feedback, and what does the 7950X do in h265 in 4K encoding, I am at 3 fps with my old dinosaur i7 3930k
PS: Threadrippers Jeeez, price :D
You can't simply ask that, as it varies heaps with what filter is being used...too many variables !!!!
frencher
24th December 2022, 19:03
You can't simply ask that, as it varies heaps with what filter is being used...too many variables !!!!
So with "x265_FHD_Benchmark" > https://forum.pclab.pl/topic/1184884-x265-fhd-benchmark/
https://i.postimg.cc/HkBHBd39/x265-FHD-Benchmark.jpg (https://postimages.org/)
rlev11
24th December 2022, 20:37
Thank you for the feedback, and what does the 7950X do in h265 in 4K encoding, I am at 3 fps with my old dinosaur i7 3930k
PS: Threadrippers Jeeez, price :D
This is doing Casino 4k (1:2.35 aspect ration) right now. This is a fairly grainy movie, so doing a pretty heavy degraining.
Doing a MA10 HEVC encode, default profile settings, CRF 18,
SMDegrain(video,tr=4,thSAD=400,thSADC=200,contrasharp=true,prefilter=1,refinemotion=true)
Nothing else set. encoding servers on 16 core cpu's set to all cores active, 12 avisynth threads
7950x 2 encoding server windows active 15fps combined (single instance would do 11-12fps)
5950x 8.6 fps
5900x 7.6fps
3950x 6.8fps
3900x 6.5fps
i9-10850k 5.2fps
Doing more full frame aspect ratios (1.85 or 1.78) will slow the numbers down considerably. Also it depends on how much it has to degrain, and what level degraining you set, will change these numbers drastically. Less degraining needed will speed the numbers up quickly as well. Like TDS said, there are lots of variables to come up with a number that says this CPU does this fps numbers. It is more of a percentage comparison between different cpu's.
A year or so ago I had a 10th gen 6 core i5 in my farm and if I remember it was about half the speed of my i9. That is the closest I can remember with something that compares to your i7. Bottom line is either a 7950x or an i9-1300k should blow what you have out of the water speed wise.
cypher007
24th December 2022, 21:39
18273
guest
25th December 2022, 00:28
So with "x265_FHD_Benchmark" > https://forum.pclab.pl/topic/1184884-x265-fhd-benchmark/
https://i.postimg.cc/HkBHBd39/x265-FHD-Benchmark.jpg (https://postimages.org/)
That's an old chart :(
Check out this link from Ryushin :-
https://forum.doom9.org/showthread.php?p=1979495#post1979495
Take note of the info right at the bottom of the page :D
guest
25th December 2022, 00:32
18273
So that CPU is a 14 core "E" & "P" type, isn't it ??
We may never get to see that attachment, approval takes forever.
You need to use something like Imgur...
guest
25th December 2022, 05:32
This is doing Casino 4k (1:2.35 aspect ration) right now. This is a fairly grainy movie, so doing a pretty heavy degraining.
Doing a MA10 HEVC encode, default profile settings, CRF 18,
SMDegrain(video,tr=4,thSAD=400,thSADC=200,contrasharp=true,prefilter=1,refinemotion=true)
Nothing else set. encoding servers on 16 core cpu's set to all cores active, 12 avisynth threads
7950x 2 encoding server windows active 15fps combined (single instance would do 11-12fps)
5950x 8.6 fps
5900x 7.6fps
3950x 6.8fps
3900x 6.5fps
i9-10850k 5.2fps
Doing more full frame aspect ratios (1.85 or 1.78) will slow the numbers down considerably. Also it depends on how much it has to degrain, and what level degraining you set, will change these numbers drastically. Less degraining needed will speed the numbers up quickly as well. Like TDS said, there are lots of variables to come up with a number that says this CPU does this fps numbers. It is more of a percentage comparison between different cpu's.
A year or so ago I had a 10th gen 6 core i5 in my farm and if I remember it was about half the speed of my i9. That is the closest I can remember with something that compares to your i7. Bottom line is either a 7950x or an i9-1300k should blow what you have out of the water speed wise.
So just to compare our processes,
This is what I would use for a grainy movie :-
video=SMDegrain(video,tr=6,thSAD=600,thSADC=300,thSCD1=400,thSCD2=130,contrasharp=true,prefilter=2,str=1.2,refinemotion=true)
or even:-
video=SMDegrain(video,tr=8,thSAD=800,thSADC=400,thSCD1=400,thSCD2=130,contrasharp=true,prefilter=2,str=1.2,refinemotion=true)
x265 profile :- --level 6.2 --profile main10 --hdr10 --hdr10-opt --output-depth 10 --ctu 64 --merange 57 --high-tier --vbv-bufsize 800000 --vbv-maxrate 800000
And using CRF 14 - 16.
And last but by no means least:-
Server1CommandLine=/port 1000 /priority normal /restart-if-no-progress /avisynth-prefetch-threads 12 /x264-threads 16 /x265-threads 16
Server2CommandLine=/port 2000 /priority normal /restart-if-no-progress /avisynth-prefetch-threads 12 /x264-threads 16 /x265-threads 16
I'm also currently using "Chunk Size #2" (basically 2 minute chunks), it gives the illusion that it's not going to take as long, but I think it might also let the CPU's "settle in" to the encode.
So my encoding speeds will be very different.
cypher007
27th December 2022, 03:25
So that CPU is a 14 core "E" & "P" type, isn't it ??
We may never get to see that attachment, approval takes forever.
You need to use something like Imgur...
yes with 6 hyperthreads.
45.3 fps using that fhd test.
guest
27th December 2022, 04:31
yes with 6 hyperthreads.
45.3 fps using that fhd test.
Interesting...
https://ark.intel.com/content/www/us/en/ark/products/132228/intel-core-i712700h-processor-24m-cache-up-to-4-70-ghz.html
Total Cores 14
# of Performance-cores 6
# of Efficient-cores 8
Total Threads 20
So how do you get it to use the other cores, like I said, I'm an AMD user, so these "P" & "E" cores confuses me a little.
Does RipBot use ALL cores/threads ??
Atak_Snajpera
27th December 2022, 16:06
Interesting...
https://ark.intel.com/content/www/us/en/ark/products/132228/intel-core-i712700h-processor-24m-cache-up-to-4-70-ghz.html
Total Cores 14
# of Performance-cores 6
# of Efficient-cores 8
Total Threads 20
So how do you get it to use the other cores, like I said, I'm an AMD user, so these "P" & "E" cores confuses me a little.
Does RipBot use ALL cores/threads ??
https://i.imgur.com/woc1DFC.png
In windows 7 P-cores and E-Cores are detected as multi-socket CPUs. They are sitting in different NUMA nodes (NUMA0 = P-CORES ,NUMA1 = E-CORES). So in order to use all cores with non nuna aware software like x264 you must use two instances locked to each NUMA node. In Windows 10/11 they are seen as single NUMA node and thus you do not have to do anything special. Windows Scheduler does all the magic.
PS. x265 is numa aware so it should work fine also on windows 7.
guest
28th December 2022, 00:20
In windows 7 P-cores and E-Cores are detected as multi-socket CPUs. They are sitting in different NUMA nodes (NUMA0 = P-CORES ,NUMA1 = E-CORES). So in order to use all cores with non nuna aware software like x264 you must use two instances locked to each NUMA node. In Windows 10/11 they are seen as single NUMA node and thus you do not have to do anything special. Windows Scheduler does all the magic.
PS. x265 is numa aware so it should work fine also on windows 7.
I wasn't expecting a very informative response from the "OG", nice :thanks:
Not too sure about the screenshots, looked a little dated and almost irrelevant to the subject, however, W7 does show the single CPU as 2 CPU's.
I was reading somewhere yesterday, that Windows 11 22H2 is even more optimized for this.
cypher007
29th December 2022, 01:11
I wasn't expecting a very informative response from the "OG", nice :thanks:
Not too sure about the screenshots, looked a little dated and almost irrelevant to the subject, however, W7 does show the single CPU as 2 CPU's.
I was reading somewhere yesterday, that Windows 11 22H2 is even more optimized for this.
yes ive had to switch back to win 11 from win 10 as the scheduler on win 10 still hasnt been updated for the new tech, hence the fudge i had to use with win 10. some think its a way for microsoft to push people onto win 11.
cypher007
29th December 2022, 01:15
@Atak_Snajpera
if the way your work hours works on win 7 is via the task scheduler would it be possible for me to let ripbot do the sleep and task scheduler do the wake? or is there a way i can import the csv into task scheduler some how?
guest
2nd January 2023, 13:15
OK, I'm happy to be the first post here for 2023 :)
I am having a problem with the MPC-HC preview playback of HDR content.
When playing the preview, it looks VERY different to if you play the same clip with VLC, or PotPlayer, and on the LG 4K TV.
It makes it almost impossible to do any colour or contrast adjustments.
This post sort of connects with :-
https://forum.doom9.org/showthread.php?p=1980007#post1980007
I'm sure I'm not the only one that has this dilemma.
Cheers & Happy New Year.
rlev11
4th January 2023, 21:14
OK, I'm happy to be the first post here for 2023 :)
I am having a problem with the MPC-HC preview playback of HDR content.
When playing the preview, it looks VERY different to if you play the same clip with VLC, or PotPlayer, and on the LG 4K TV.
It makes it almost impossible to do any colour or contrast adjustments.
This post sort of connects with :-
https://forum.doom9.org/showthread.php?p=1980007#post1980007
I'm sure I'm not the only one that has this dilemma.
Cheers & Happy New Year.
I had to change the vlc tone-mapping to Reinhard to get hdr stuff to not look completely washed out on my 1440p non hdr monitors. In reality, being so outdated i am surprised that MPC player even plays 4k hdr stuff.
guest
5th January 2023, 00:58
I had to change the vlc tone-mapping to Reinhard to get hdr stuff to not look completely washed out on my 1440p non hdr monitors. In reality, being so outdated i am surprised that MPC player even plays 4k hdr stuff.
Hi rlev11, well the problem is that MPC-HC, IS the default video preview player in RipBot, I'm sure you noticed that I have commented on this problem, to Atak, so who knows if it will be addressed.
Like you mentioned, it is oldish, and obviously not really up to the task of 4K HDR content, it's the legacy of when RipBot was first created :(
But like I said, it's really difficult to get the results you're after, when each player displays it differently.
You can update RipBot's MPC manually if you want...
https://github.com/clsid2/mpc-hc/releases/
Atak_Snajpera
5th January 2023, 03:17
IT does not matter what player is being used because decoding and color conversion is done by avisynth plugins you use in script
guest
5th January 2023, 06:19
IT does not matter what player is being used because decoding and color conversion is done by avisynth plugins you use in script
I'm confused, if the MPC-HC preview doesn't reflect the script, then what's the point.
Surely you don't have to encode the whole video to "preview" the result's of the script ??
What I've started doing is creating 5 minute "samples" of the video's that need some "work", and encoding them.
But HDR, can be a bit of a problem :(, and I'm sure nobody wants to convert back to SDR bt709, especially when they have a HDR compliant TV or monitor.
Atak_Snajpera
5th January 2023, 13:41
Re-read my answer again.
guest
5th January 2023, 14:12
Re-read my answer again.
I have, several times !!!
So, if you're implying that the preview represents the script, then how come the final encode can look VERY different, especially with HDR, to what MPC-HC display's ??
You make adjustments so that it looks OK in the preview, but...
And why does the video will look different with VLC, or PotPlayer, or on a TV !!
Atak_Snajpera
5th January 2023, 14:18
I have, several times !!!
So, if you're implying that the preview represents the script, then how come the final encode can look VERY different, especially with HDR, to what MPC-HC display's ??
You make adjustments so that it looks OK in the preview, but...
And why does the video will look different with VLC, or PotPlayer, or on a TV !!
Because without tonemapping in script you get raw unprocessed picture in MPC-HC. VLC most likely tonemaps your encoded HDR video. Simple.
rlev11
5th January 2023, 22:43
I have, several times !!!
So, if you're implying that the preview represents the script, then how come the final encode can look VERY different, especially with HDR, to what MPC-HC display's ??
You make adjustments so that it looks OK in the preview, but...
And why does the video will look different with VLC, or PotPlayer, or on a TV !!
The way I see it, the tone mapping from hdr to sdr would have to be done outside of ripbot and incorporated directly into MPC-HC. Not sure if you would ever get it quite right doing HDR color correction in a avisynth script sent to MPC player that then has to do a tone mapping for monitor display, then have what you see on the monitor be what you see on an hdr TV that doesn't have to do any tone mapping. Plus the general color calibrations between different displays not being a perfect match.
Might have to try incorporating something like madvr as the renderer for MPC-HC. lots of info on google about it. Lots of variables trying to do color calibration between many different parts
guest
6th January 2023, 00:23
Because without tonemapping in script you get raw unprocessed picture in MPC-HC. VLC most likely tonemaps your encoded HDR video. Simple.
Under the Avisynth "Tonemap" options, there's "ON" & "OFF" !!
ON, is no conversion, keeps the original content.
OFF, is a HDR to SDR "PQ" conversion. (Has it always been like that ??)
But under the "MAIN" tab, there's the option to "Force HDR to SDR...."
So does that change the "ON" option ??
I don't want to convert from HDR to SDR !!
It's just so frustrating that there are all these variations between viewing options.
guest
6th January 2023, 00:31
The way I see it, the tone mapping from hdr to sdr would have to be done outside of ripbot and incorporated directly into MPC-HC. Not sure if you would ever get it quite right doing HDR color correction in a avisynth script sent to MPC player that then has to do a tone mapping for monitor display, then have what you see on the monitor be what you see on an hdr TV that doesn't have to do any tone mapping. Plus the general color calibrations between different displays not being a perfect match.
Might have to try incorporating something like madvr as the renderer for MPC-HC. lots of info on google about it. Lots of variables trying to do color calibration between many different parts
But if you don't want to convert to SDR.
I actually tried that madVR thing with MPC-HC, I don't think it made all that much difference, but I try it again.
Play HDR video
This requires using madVR or MPC Video Renderer.
After installation these renderers can be selected here:
Options > Playback > Output
Also, I'm curious about something you mentioned in your previous post, "vlc tone-mapping to Reinhard", I could not find where to change that :(
But I did stumble across some "nightly" builds of VLC 4.xx, and it supports W10 & W11 Dark Theme :)
https://nightlies.videolan.org/
rlev11
6th January 2023, 00:48
Under the Avisynth "Tonemap" options, there's "ON" & "OFF" !!
ON, is no conversion, keeps the original content.
OFF, is a HDR to SDR "PQ" conversion. (Has it always been like that ??)
But under the "MAIN" tab, there's the option to "Force HDR to SDR...."
So does that change the "ON" option ??
I don't want to convert from HDR to SDR !!
It's just so frustrating that there are all these variations between viewing options.
So if I load up a hdr movie with "Force HDR to SDR: checked, tonemap defaults to ON in avisynth panel. With it unchecked it defaults to OFF. Which is exactly the way I would expect it to be. If you don't want to do a hdr to sdr tonemap conversion "IN THE ENCODE" Tonemap should stay off, period. That is what I have been using and the hdr info sticks with the newly encoded video.
As I said, you don't want to do any tone mapping in avisynth for HDR if you want to keep the HDR intact. You just have to do the "correct" tone mapping in whatever program you are using to view the output on your PC which is where you will need a renderer for MPC-HD that can do the tone mapping in the player
rlev11
6th January 2023, 00:52
But if you don't want to convert to SDR.
I actually tried that madVR thing with MPC-HC, I don't think it made all that much difference, but I try it again.
Also, I'm curious about something you mentioned in your previous post, "vlc tone-mapping to Reinhard", I could not find where to change that :(
But I did stumble across some "nightly" builds of VLC 4.xx, and it supports W10 & W11 Dark Theme :)
https://nightlies.videolan.org/
In VLC Tools\preferences\show settings to all(bottom left)\video\output modules\OpenGL
Change tone mapping algorithm to Reinhard. I would not say it is perfect, but it took care of the washed out picture on my monitors
guest
6th January 2023, 01:13
In VLC Tools\preferences\show settings to all(bottom left)\video\output modules\OpenGL
Change tone mapping algorithm to Reinhard. I would not say it is perfect, but it took care of the washed out picture on my monitors
Thanks for that, but I don't like it, but I am playing it on a 4K HDR monitor.
I'm trying the madVR setting again, might be OK...
rlev11
6th January 2023, 01:27
My monitors are not 4k hdr, which is why I have to do the tone mapping in vlc to do the BT2020 to 709 conversion with reinhard.
frencher
6th January 2023, 19:59
Thanks ;)
So I got the Ryzen 7950x installed in the computer on Monday night I've been testing RB against it using many different threading options which I'll post at the end of the message.
Instead of reading through all the options, my threading options (for me) are as follows:
Two Encoding Servers
Set x264/x265 threads to 16: /x265-threads 16 /x264-threads 16 (RB default is 16 for the 7950x)
Set Avisynth Threads to 12: (In settings, use multiple processing threads) (RB default is 16 for the 7950x)
Last night I down clocked the Ryzen 7950x to all cores at 4700Mhz based on this information:
https://www.youtube.com/watch?v=7JiYAwKIHRY
My silicon is probably not as good as the one in the video or my motherboard and memory (running at 6000Mhz) won't me reach the same as the video. Though I might just have to do some more tuning. Right now I'm giving up 7% of the processors power to save more than double the power savings. AMD (and Intel for that matter) are really chasing every last bit of performance no matter the power costs.
Stock Power Consumption and Temperature:
Idle: 38 watts, 46 Celsius
Full Load:175 watts, 94.5 Celsius
Underclocked Power Consumption and Temperature:
Clock Speed: 4700 Mhz, Voltage: 1.005 volts
Idle: 8 watts, 40 Celsius,
Full Load: 88 watts, 58 Celsius
So essentially, in my case, I loose 7% of the maximum performance of the CPU, to save double the power savings at full load and five times the power savings at idle. I also noticed, at default power settings, full load had half of the cores at 5.1Ghz, while other half was at 4.8Ghz. I have not done any RB thread testing under the Underclocked settings yet as I still want to do some more tweaking and I'm hoping to hit that 4.8Ghz at 0.985 volts, the same as the video. I'm only encouraged going down this route.
BTW, the 7950x requires a 360mm or larger AIO (All In One) Cooler to stay within it's thermal limits. I chose the Fractal Design Celsius S36 360mm for my system, based on cost. But a 420mm cooler would be best:
https://www.youtube.com/watch?v=8kckURYqTKI
I had to buy a Phanteks Enthoo Primo PH-ES813P_SWT case to hold my four optical drives and provide enough room to go up to 420mm cooler. I still chose the 360mm based on cost. I thought the 360mm would be plenty. But there is still headroom that the 420mm gives you if you are going to run it at full tilt. With me underclocking the CPU, the 360mm is more than adequate. But still the 420 is the best option.
Here are all my RipBot thread tests and notes I wrote during testing:
RipBot264 default threads for Ryzen 7950x:
x264/x265 threads: 16
Avisynth Threads: 16
Encoding used for all tests: CQ18
4K Tests:
Source 3 Minutes: Top Gun Maverick 4K with changing aspect ratios (7:00 to 10:00)
No Degraining
One Encoding Server
x265 16 Threads: 5m:32s (13.01 fps)
x265 24 Threads: 4m:20s (16.62 fps)
x265 32 Threads: 4m:10s (17.28 fps)
Source 6 Minutes: Top Gun Maverick 4K with changing aspect ratios (7:00 to 13:00)
No Degraining
Two Encoding Servers
x265 16 Threads: 8m:7s (17.74 fps)
Source 3 Minutes: Top Gun Maverick 4K with changing aspect ratios (7:00 to 10:00)
SMDegrain Medium Setting: SMDegrain(video,tr=4,thSAD=400,thSADC=200,contrasharp=true,prefilter=1,refinemotion=true)
x264/x265 Threads: 16
Single Encoding Server and single chunk.
06 Avisynth Threads: 8m:04s (8.92 fps)
07 Avisynth Threads: 7m:20s (9.82 fps)
08 Avisynth Threads: 6m:45s (10.67 fps)
10 Avisynth Threads: 6m:46s (10.64 fps)
12 Avisynth Threads: 6m:36s (10.90 fps)
14 Avisynth Threads: 6m:33s (10.99 fps)
16 Avisynth Threads: 12m:30s (5.73 fps)
Noticed the CPU usage had been climbing from 50% for 8 threads to 100% for 16 threads. 16 threads also showed fluctuations from 30-100%. Theory is some threads are waiting on other threads to finish processing before they can continue.
Source 6 Minutes: Top Gun Maverick 4K with changing aspect ratios (7:00 to 13:00)
SMDegrain Medium Setting: SMDegrain(video,tr=4,thSAD=400,thSADC=200,contrasharp=true,prefilter=1,refinemotion=true)
x264/x265 Threads: 16
Two Encoding Servers and two chunks (3 minutes each).
06 Avisynth Threads: 12m:09s (11.85 fps)
07 Avisynth Threads: 12m:09s (11.85 fps)
08 Avisynth Threads: 12m:13s (11.79 fps)
10 Avisynth Threads: 12m:55s (11.15 fps)
12 Avisynth Threads: 12m:51s (11.21 fps)
14 Avisynth Threads: 13m:15s (10.87 fps)
16 Avisynth Threads: 14m:37s (9.85 fps)
Not much of an improvement compared to single threads, even starting from 6 threads.
Source 3 Minutes: Top Gun Maverick 4K with changing aspect ratios (7:00 to 10:00)
SMDegrain Medium Setting: SMDegrain(video,tr=4,thSAD=400,thSADC=200,contrasharp=true,prefilter=1,refinemotion=true)
Set x264/x265 threads to 32: /x265-threads 32 /x264-threads 32
Single Encoding Server and single chunk.
08 Avisynth Threads: 7m:45s (9.29 fps)
10 Avisynth Threads: 7m:04s (10.19 fps)
12 Avisynth Threads: 6m:50s (10.54 fps)
13 Avisynth Threads: 7m:00s (10.29 fps)
14 Avisynth Threads: 6m:53s (10.56 fps)
16 Avisynth Threads: 10m:45s (6.70 fps)
Source 3 Minutes: Top Gun Maverick 4K with changing aspect ratios (7:00 to 10:00)
SMDegrain Medium Setting: SMDegrain(video,tr=4,thSAD=400,thSADC=200,contrasharp=true,prefilter=1,refinemotion=true)
Set x264/x265 threads to 24: /x265-threads 24 /x264-threads 24
Single Encoding Server and single chunk.
08 Avisynth Threads: 7m:35s (9.49 fps)
10 Avisynth Threads: 6m:57s (10.40 fps)
12 Avisynth Threads: 6m:40s (10.80 fps)
14 Avisynth Threads: 6m:25s (11.22 fps)
16 Avisynth Threads: 10m:56s (6.59 fps)
Summary Best 4K Results:
Two Encoding Servers with 16 x264/x265 threads and 6-8 Avisynth threads. Note using the RipBot default of 16 avisynth threads is the slowest with all tests.
1080P Tests:
Source 6 Minutes: Cast Away HD (23:07 to 29:17)
No Degraining
Two Encoding Servers
x265 16 Threads: 3m:29s (42.49 fps)
Source 6 Minutes: Cast Away HD (23:07 to 29:17)
SMDegrain Hard Setting: SMDegrain(video,tr=8,thSAD=800,thSADC=400,contrasharp=true,prefilter=2,refinemotion=true)
Set x264/x265 threads to 16: /x265-threads 16 /x264-threads 16
Two Encoding Servers and two chunks (3m:0s first, 3m:10s second).
06 Avisynth Threads: 11m:51s (12.49 fps)
08 Avisynth Threads: 10m:05s (14.68 fps)
10 Avisynth Threads: 9m:58s (14.85 fps)
12 Avisynth Threads: 8m:50s (16.75 fps)
14 Avisynth Threads: 8m:48s (16.82 fps)
16 Avisynth Threads: 8m:56s (16.57 fps)
Atak's x265 Benchmark Tool:
Ryzen 1800x: encoded 2500 frames in 108.78s (22.98 fps), 7025.74 kbps, Avg QP:37.21
Ryzen 7950x: encoded 2500 frames in 21.74s (115.00 fps), 7025.74 kbps, Avg QP:37.21
guest
7th January 2023, 02:14
Thanks ;)
Hi, you probably didn't really need to quote Ryushin's huge complete post just to say thanks (just sayin')
So have you made your decision on what CPU you're going with ??
If it IS a 7950X, maybe you could wait a few more weeks and get the soon to be released 7950X3D.
frencher
8th January 2023, 20:59
Hello everyone,
TDS, i've already cracked, too bad for the 3D version
Test with R9 7950X :eek:
Motherboard Asus prime X670E-Pro Wifi
Kingston FURY Renegade 2x16GB DDR5 6000MHz Silver KF560C32RSAK2-32
AMD Ryzen 9 7950X 16-Core @ 4.49GHz ( 16C / 32T )
y4m [info]: 1920x1080 fps 50/1 i420p8 sar 1:1 unknown frame count
raw [info]: output file: NUL
x265 [info]: HEVC encoder version 2.2+15-a18ab7656c30
x265 [info]: build info [Windows][GCC 6.2.0][64 bit] 8bit
x265 [info]: using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX AVX2 FMA3 LZCNT BMI2
x265 [info]: Main Still Picture profile, Level-4.1 (Main tier)
x265 [info]: Thread pool created using 32 threads
x265 [info]: Slices : 1
x265 [info]: frame threads / pool features : 6 / wpp(17 rows)
x265 [info]: Coding QT: max CU size, min CU size : 64 / 8
x265 [info]: Residual QT: max TU size, max depth : 32 / 1 inter / 1 intra
x265 [info]: ME / range / subpel / merge : hex / 57 / 2 / 2
x265 [info]: Keyframe min / max / scenecut / bias: 50 / 500 / 40 / 5.00
x265 [info]: Lookahead / bframes / badapt : 20 / 4 / 2
x265 [info]: b-pyramid / weightp / weightb : 1 / 1 / 0
x265 [info]: References / ref-limit cu / depth : 3 / on / on
x265 [info]: AQ: mode / str / qg-size / cu-tree : 1 / 1.0 / 32 / 1
x265 [info]: Rate Control / qCompress : CRF-28.0 / 0.60
x265 [info]: tools: rd=3 psy-rd=2.00 rskip signhide tmvp strong-intra-smoothing
x265 [info]: tools: lslices=6 deblock sao
encoded 2500 frames in 20.45s (122.22 fps), 7025.74 kbps, Avg QP:37.21
https://i.postimg.cc/mD6L2dqR/x265-FHD-Benchmark-R9-7950-X.jpg (https://postimages.org/)
So with "x265_FHD_Benchmark" > https://forum.pclab.pl/topic/1184884-x265-fhd-benchmark/
https://i.postimg.cc/HkBHBd39/x265-FHD-Benchmark.jpg (https://postimages.org/)
guest
9th January 2023, 01:34
Hello everyone,
AMD Ryzen 9 7950X 16-Core @ 4.49GHz ( 16C / 32T )
y4m [info]: 1920x1080 fps 50/1 i420p8 sar 1:1 unknown frame count
raw [info]: output file: NUL
x265 [info]: HEVC encoder version 2.2+15-a18ab7656c30
x265 [info]: build info [Windows][GCC 6.2.0][64 bit] 8bit
x265 [info]: using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX AVX2 FMA3 LZCNT BMI2
x265 [info]: Main Still Picture profile, Level-4.1 (Main tier)
x265 [info]: Thread pool created using 32 threads
x265 [info]: Slices : 1
x265 [info]: frame threads / pool features : 6 / wpp(17 rows)
x265 [info]: Coding QT: max CU size, min CU size : 64 / 8
x265 [info]: Residual QT: max TU size, max depth : 32 / 1 inter / 1 intra
x265 [info]: ME / range / subpel / merge : hex / 57 / 2 / 2
x265 [info]: Keyframe min / max / scenecut / bias: 50 / 500 / 40 / 5.00
x265 [info]: Lookahead / bframes / badapt : 20 / 4 / 2
x265 [info]: b-pyramid / weightp / weightb : 1 / 1 / 0
x265 [info]: References / ref-limit cu / depth : 3 / on / on
x265 [info]: AQ: mode / str / qg-size / cu-tree : 1 / 1.0 / 32 / 1
x265 [info]: Rate Control / qCompress : CRF-28.0 / 0.60
x265 [info]: tools: rd=3 psy-rd=2.00 rskip signhide tmvp strong-intra-smoothing
x265 [info]: tools: lslices=6 deblock sao
encoded 2500 frames in 20.45s (122.22 fps), 7025.74 kbps, Avg QP:37.21
TDS, i've already cracked, too bad for the 3D version
Test with R9 7950X :eek:
Motherboard Asus prime X670E-Pro Wifi
Kingston FURY Renegade 2x16GB DDR5 6000MHz Silver KF560C32RSAK2-32
OK, well you won't be disappointed, and you probably saved a fair bit of money ()...
-------------------------------------------------------------------------------
So I thought I would run Atak's x265 benchmark, as I never have bothered before, so I have 2 results :-
This is with the default (very old) x265 in this app.
AMD Ryzen 9 7950X 16-Core @ 4.5GHz ( 16C / 32T )
y4m : 1920x1080 fps 50/1 i420p8 sar 1:1 unknown frame count
raw [info]: output file: NUL
x265 [info]: HEVC encoder version 2.2+15-a18ab7656c30
x265 [info]: build info [Windows][GCC 6.2.0][64 bit] 8bit
x265 [info]: using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX AVX2 FMA3 LZCNT BMI2
x265 [info]: Main Still Picture profile, Level-4.1 (Main tier)
x265 [info]: Thread pool created using 32 threads
x265 [info]: Slices : 1
x265 [info]: frame threads / pool features : 6 / wpp(17 rows)
x265 [info]: Coding QT: max CU size, min CU size : 64 / 8
x265 [info]: Residual QT: max TU size, max depth : 32 / 1 inter / 1 intra
x265 [info]: ME / range / subpel / merge : hex / 57 / 2 / 2
x265 [info]: Keyframe min / max / scenecut / bias: 50 / 500 / 40 / 5.00
x265 [info]: Lookahead / bframes / badapt : 20 / 4 / 2
x265 [info]: b-pyramid / weightp / weightb : 1 / 1 / 0
x265 [info]: References / ref-limit cu / depth : 3 / on / on
x265 [info]: AQ: mode / str / qg-size / cu-tree : 1 / 1.0 / 32 / 1
x265 [info]: Rate Control / qCompress : CRF-28.0 / 0.60
x265 [info]: tools: rd=3 psy-rd=2.00 rskip signhide tmvp strong-intra-smoothing
x265 [info]: tools: lslices=6 deblock sao
encoded 2500 frames in 20.43s (122.39 fps), 7025.74 kbps, Avg QP:37.21
And this is with the latest available x265 :-
There's a nice improvement ;)
AMD Ryzen 9 7950X 16-Core @ 4.5GHz ( 16C / 32T )
y4m [info]: 1920x1080 fps 50/1 i420p8 sar 1:1 unknown frame count
raw [info]: output file: NUL
x265 [info]: HEVC encoder version 3.5+83-53121f949
x265 [info]: build info [Windows][GCC 12.2.0][64 bit] 8bit+10bit+12bit
x265 [info]: using cpu capabilities: MMX2 SSE2Fast LZCNT SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
x265 [info]: Main Still Picture profile, Level-4.1 (Main tier)
x265 [info]: Thread pool created using 32 threads
x265 [info]: Slices : 1
x265 [info]: frame threads / pool features : 5 / wpp(17 rows)
x265 [info]: Coding QT: max CU size, min CU size : 64 / 8
x265 [info]: Residual QT: max TU size, max depth : 32 / 1 inter / 1 intra
x265 [info]: ME / range / subpel / merge : hex / 57 / 2 / 3
x265 [info]: Keyframe min / max / scenecut / bias : 50 / 500 / 40 / 5.00
x265 [info]: Lookahead / bframes / badapt : 20 / 4 / 2
x265 [info]: b-pyramid / weightp / weightb : 1 / 1 / 0
x265 [info]: References / ref-limit cu / depth : 3 / off / on
x265 [info]: AQ: mode / str / qg-size / cu-tree : 2 / 1.0 / 32 / 1
x265 [info]: Rate Control / qCompress : CRF-28.0 / 0.60
x265 [info]: tools: rd=3 psy-rd=2.00 early-skip rskip mode=1 signhide tmvp
x265 [info]: tools: b-intra strong-intra-smoothing lslices=6 deblock sao
encoded 2500 frames in 19.43s (128.67 fps), 10890.80 kbps, Avg QP:35.84
I will be very interested to see how this compares to the i9-13900KF.
EDIT:- OK, got the Raptor up and running, and this is bog standard settings:-
13th Gen Intel Core i9-13900KF @ 3GHz ( 24C / 32T )
y4m [info]: 1920x1080 fps 50/1 i420p8 sar 1:1 unknown frame count
raw [info]: output file: NUL
x265 [info]: HEVC encoder version 3.5+74-d2bd97437
x265 [info]: build info [Windows][GCC 12.2.0][64 bit] 8bit+10bit+12bit
x265 [info]: using cpu capabilities: MMX2 SSE2Fast LZCNT SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
x265 [info]: Main Still Picture profile, Level-4.1 (Main tier)
x265 [info]: Thread pool created using 32 threads
x265 [info]: Slices : 1
x265 [info]: frame threads / pool features : 5 / wpp(17 rows)
x265 [info]: Coding QT: max CU size, min CU size : 64 / 8
x265 [info]: Residual QT: max TU size, max depth : 32 / 1 inter / 1 intra
x265 [info]: ME / range / subpel / merge : hex / 57 / 2 / 3
x265 [info]: Keyframe min / max / scenecut / bias : 50 / 500 / 40 / 5.00
x265 [info]: Lookahead / bframes / badapt : 20 / 4 / 2
x265 [info]: b-pyramid / weightp / weightb : 1 / 1 / 0
x265 [info]: References / ref-limit cu / depth : 3 / off / on
x265 [info]: AQ: mode / str / qg-size / cu-tree : 2 / 1.0 / 32 / 1
x265 [info]: Rate Control / qCompress : CRF-28.0 / 0.60
x265 [info]: tools: rd=3 psy-rd=2.00 early-skip rskip mode=1 signhide tmvp
x265 [info]: tools: b-intra strong-intra-smoothing lslices=6 deblock sao
encoded 2500 frames in 22.15s (112.85 fps), 10890.80 kbps, Avg QP:35.84
EDIT #2:-Although it's a little slower with Atak's x265 tool, it's noticeably faster in Cinebench R23.2, and CPU-Z Bench...will just have to see how it goes doing and actual encode, but WOW it's get's [I]HOT !!! (99° C), and that's using a full custom loop, water cooling system, with a big fat 360mm rad, and push/pull fans, early day's, tho !!
I would have liked to compare this with the 5950X, but it's currently in pieces :(
apol847
9th January 2023, 17:19
@Atak_Snajpera:
Hello, I saw that in RipBot264 the component "DetectBorders" is used. I hope that you are also the author of this little tool. Is it possible that you compile a Linux binary of it? I want to use detectdorders on Linux. I don't use Windows anymore because I am switched to Linux completely. Using wine to run detectborders.exe is not an option. I need a native binary if possible.
I would be very happy to receive a reply. Thank you.
Atak_Snajpera
9th January 2023, 22:55
I can send you a source code. However You will have to manually port delphi7 code on your own using Lazarus (Linux version).
apol847
10th January 2023, 19:23
Nice to see that Delphi is still used for program development nowadays. I learned Pascal ages back in school. The last project I was involved in was written in Delphi 5.
I have heard positive things about Lazarus. The IDE is supposed to be pretty good. Also, some Delphi 7 apps have been successfully ported with Lazarus.
Sounds good to me. Would be nice if you could send me the source code.
PM for details. Thanks.
guest
11th January 2023, 00:09
Nice to see that Delphi is still used for program development nowadays. I learned Pascal ages back in school. The last project I was involved in was written in Delphi 5.
I have heard positive things about Lazarus. The IDE is supposed to be pretty good. Also, some Delphi 7 apps have been successfully ported with Lazarus.
Sounds good to me. Would be nice if you could send me the source code.
PM for details. Thanks.
Couldn't you setup a dual boot, Windows/Linux, or a VM ??
apol847
11th January 2023, 20:35
Couldn't you setup a dual boot, Windows/Linux, or a VM ??
Yes, that's true I could setup a dual boot system. But this did not solve the initial problem!
Now it is going slightly off-topic:
[off-topic] People complain: I can't use Linux! There is no e.g. Photoshop available. I still need to use Windows. If there was a Linux Photoshop version I could switch to Linux. Adobe says: There is no need of a Photoshop Linux version because only 1 or 2% of the users are using Linux, development for Linux is not worth it. It's like the hen and egg problem. I switched to Linux 3 years ago privately. First with dual boot option Windows/Linux and since last year to Linux only as main OS. I am happy with it and I found replacement apps for my used Windows applications. But there are a few apps where no Linux version is available. There is a little video toolset I want to use with Linux. Most binaries in this toolset are also available for Linux. The toolset uses DetectBorders.exe and some Windows Batch Scripts to call the Windows binaries. I need a native Linux binary so I can use DetectBorders from the RipBot project with some shell scripts on Linux. So I will take the chance and try to port the DetectBorders Windows Tool to Linux. It's a start and more Windows only applications will be available for additional platforms Some people here in the forums said earlier that they can't use the toolset on their Linux systems because it's Windows only at the moment. I think they would also be happy if there is a Linux version available later. :) [/off-topic]
Sorry, for the long explanation and off-topic but I had a reason to ask for a native Linux version... If not, I wouldn't have asked for it...
guest
12th January 2023, 02:45
Yes, that's true I could setup a dual boot system. But this did not solve the initial problem!
Now it is going slightly off-topic:
[off-topic] People complain: I can't use Linux! There is no e.g. Photoshop available. I still need to use Windows. If there was a Linux Photoshop version I could switch to Linux. Adobe says: There is no need of a Photoshop Linux version because only 1 or 2% of the users are using Linux, development for Linux is not worth it. It's like the hen and egg problem. I switched to Linux 3 years ago privately. First with dual boot option Windows/Linux and since last year to Linux only as main OS. I am happy with it and I found replacement apps for my used Windows applications. But there are a few apps where no Linux version is available. There is a little video toolset I want to use with Linux. Most binaries in this toolset are also available for Linux. The toolset uses DetectBorders.exe and some Windows Batch Scripts to call the Windows binaries. I need a native Linux binary so I can use DetectBorders from the RipBot project with some shell scripts on Linux. So I will take the chance and try to port the DetectBorders Windows Tool to Linux. It's a start and more Windows only applications will be available for additional platforms Some people here in the forums said earlier that they can't use the toolset on their Linux systems because it's Windows only at the moment. I think they would also be happy if there is a Linux version available later. :) [/off-topic]
Sorry, for the long explanation and off-topic but I had a reason to ask for a native Linux version... If not, I wouldn't have asked for it...
Hi, well at least you tried the dual boot option.
It's your choice to what OS you want to run, that's why there are several to choose from, myself, I have ONLY used Windows, with a curiosity "fiddle" with Hackintosh (still have one, but it's a few versions old, now).
I'm actually rather impressed that Atak is willing to share his code with you...
So if you can port DetectBorders, to be able to use it, then that's certainly an achievement, and you could share it with the Linux Community.
Good Luck.
guest
12th January 2023, 03:00
In reference to my post, https://forum.doom9.org/showthread.php?p=1980881#post1980881
Is there a chance that the x265 benchmark is not able to recognize these new "hybrid" "E" & "P" core Intel CPU's, correctly ??
Why would an i9-13900KF be "only" a 3GHz, when the "old fashion" Ryzen's are 4.5GHz...doesn't seem right.
Why would they be slower than a 7950X with this, but in CB 23.2, they are noticeably faster in both single & multi core tests.
Might need a re-hash.
Atak_Snajpera
12th January 2023, 09:06
In reference to my post, https://forum.doom9.org/showthread.php?p=1980881#post1980881
Is there a chance that the x265 benchmark is not able to recognize these new "hybrid" "E" & "P" core Intel CPU's, correctly ??
Why would an i9-13900KF be "only" a 3GHz, when the "old fashion" Ryzen's are 4.5GHz...doesn't seem right.
Why would they be slower than a 7950X with this, but in CB 23.2, they are noticeably faster in both single & multi core tests.
Might need a re-hash.
It is just a base clock
https://www.intel.com/content/www/us/en/products/sku/230497/intel-core-i913900kf-processor-36m-cache-up-to-5-80-ghz/specifications.html
guest
12th January 2023, 10:17
It is just a base clock
https://www.intel.com/content/www/us/en/products/sku/230497/intel-core-i913900kf-processor-36m-cache-up-to-5-80-ghz/specifications.html
I concur...
Since posting this, I have done a LOT of Googling, and testing, and these things are just a "furnace" to try and cool, with default BIOS settings, it hits 100°C with CB 23.2 Multicore test, almost instantly, and then thermal throttles, and that's with a custom loop.
Adjusting the PL1 & PL2 in the BIOS to Intel specs, drop's the performance a LOT, as well as the temps.
So I would think that overclocking would be a BIG no, no.
Yet to do any encoding, I have my doubts that it will be as good as the 7950X....but it shouldn't be too far behind.
Will definitely post my findings...
PetBel
12th January 2023, 13:40
Hi all
is there a command line option to set the number of encoding threads for EncodingServer?
guest
12th January 2023, 14:18
Hi all
is there a command line option to set the number of encoding threads for EncodingServer?
Do you mean something like these options :-
https://i.imgur.com/mLmikgC.jpg
Click on the "spanner" icon to get to this menu
rlev11
12th January 2023, 15:56
Hi all
is there a command line option to set the number of encoding threads for EncodingServer?
To directly answer your question, YES
encodingserver /restart-if-no-progress /priority normal /affinity 3FFC3FFC
The affinity uses a hex number to enable/disable specific cores. You can use a site like (bitsum.com/tools/cpu-affinity-calculator) to get the hex number you desire.
If you are asking this to knock down say a 16 core ryzen that falls off a cliff when doing 4k encoding, you can use the above affinity switch or I have found that the following command lines works actually a tiny bit better. This also doesn't change regular 1080 and 720 encoding speeds.
encodingserver /priority normal /restart-if-no-progress /avisynth-prefetch-threads 12 /x264-threads 16 /x265-threads 16
The avisynth-prefetch-threads is what actually kills the 16 core ryzens when doing 4k encoding for whatever reason if you do not knock them down to 12
This works best regardless of what you are encoding and is what I use on all my 16 core ryzens
Ryushin
15th January 2023, 14:28
Yes, that's true I could setup a dual boot system. But this did not solve the initial problem!
Now it is going slightly off-topic:
[off-topic] People complain: I can't use Linux! There is no e.g. Photoshop available. I still need to use Windows. If there was a Linux Photoshop version I could switch to Linux. Adobe says: There is no need of a Photoshop Linux version because only 1 or 2% of the users are using Linux, development for Linux is not worth it. It's like the hen and egg problem. I switched to Linux 3 years ago privately. First with dual boot option Windows/Linux and since last year to Linux only as main OS. I am happy with it and I found replacement apps for my used Windows applications. But there are a few apps where no Linux version is available. There is a little video toolset I want to use with Linux. Most binaries in this toolset are also available for Linux. The toolset uses DetectBorders.exe and some Windows Batch Scripts to call the Windows binaries. I need a native Linux binary so I can use DetectBorders from the RipBot project with some shell scripts on Linux. So I will take the chance and try to port the DetectBorders Windows Tool to Linux. It's a start and more Windows only applications will be available for additional platforms Some people here in the forums said earlier that they can't use the toolset on their Linux systems because it's Windows only at the moment. I think they would also be happy if there is a Linux version available later. :) [/off-topic]
Sorry, for the long explanation and off-topic but I had a reason to ask for a native Linux version... If not, I wouldn't have asked for it...
Kudos for attempting to port it. I've been driving Linux as my main desktop since '97. Been using the same Debian install from Potato until today on my Thinkpad P17 Gen2. My main RB install is running in a VM on my Linux Server. I use Linux for just about everything and for the most part there is *nix software for everything I want to do. I also have a soft spot for FreeBSD. I also know Solaris quite well, though I don't care for it I has to dump half of GNU on it to make it usable. LOL
All my physical servers run ZFS as a file system including my laptop (has three M.2 NVMEs). I even take care of large installs of ZFS over 2PB with 232 hard drives and 100TB of NVME Cache (L2ARC). ZFS is almost unbelievable in what it can do.
So yea, I belong to the cult of the Penguin. :D
guest
16th January 2023, 03:20
I stumbled across something today, and for those of you that are lucky enough to own one on the AWESOME CPU's.
Add this command to your x265 profile:- --asm avx512
Too bad for you 13th Gen Intel owners :angry:
JThomasG
16th January 2023, 14:11
Hi,
quick question, im using an intel i9-12900KF,
will i see a performance benefit if i use the prefetch option below.
looking at cpu performance all cores seems to works at mostly 100%
To directly answer your question, YES
encodingserver /restart-if-no-progress /priority normal /affinity 3FFC3FFC
The affinity uses a hex number to enable/disable specific cores. You can use a site like (bitsum.com/tools/cpu-affinity-calculator) to get the hex number you desire.
If you are asking this to knock down say a 16 core ryzen that falls off a cliff when doing 4k encoding, you can use the above affinity switch or I have found that the following command lines works actually a tiny bit better. This also doesn't change regular 1080 and 720 encoding speeds.
encodingserver /priority normal /restart-if-no-progress /avisynth-prefetch-threads 12 /x264-threads 16 /x265-threads 16
The avisynth-prefetch-threads is what actually kills the 16 core ryzens when doing 4k encoding for whatever reason if you do not knock them down to 12
This works best regardless of what you are encoding and is
what I use on all my 16 core ryzens
Ryushin
16th January 2023, 14:28
I stumbled across something today, and for those of you that are lucky enough to own one on the AWESOME CPU's.
Add this command to your x265 profile:- --asm avx512
Too bad for you 13th Gen Intel owners :angry:
Now I'll have to do more testing. :)
Found this:
https://www.hwcooling.net/en/intel-avx-512-tested-in-x265-how-to-enable-it-and-does-it-help/
Not sure if the power consumption is going to be worth slightly increased performance. AMDs implementation is double pumped compared to Intels 12th gen. I'm running a test now against a entire 4K movie (Puss in Boots) so I'll report back with the times to encode both with or without.
Unfortunately, I won't be able to use it for my set up as one of my two servers does not have AVX-512 and the X265 options is added to the main x265 settings. But perhaps x265 will just ignore the option if it's not available to use. I'll test that too.
Ryushin
16th January 2023, 14:39
Hi,
quick question, im using an intel i9-12900KF,
will i see a performance benefit if i use the prefetch option below.
looking at cpu performance all cores seems to works at mostly 100%
Those are the results of the tests I ran for the 7950x which has 16 cores. Even though you will see 100% usage, it does not mean it is encoding as it's best efficiency. You might have to make a sample and run some tests. What I found is that you will want to set your avisynth-prefetch-threads to about 3/4 of that your x265 threads would be. Otherwise what I noticed is you will have threads waiting for other threads to be finished before they can continue.
What I've discovered is that you will want to see is your CPU usage bouncing between 85-100%.
So leave off the "/x264-threads 16 /x265-threads 16" and see what your Encoding Server shows as the default threads. Then just set the avisynth-prefetch-threads to about 3/4 of what it shows.
rlev11
16th January 2023, 22:30
The only time in my experience that you have to worry about knocking down cpu cores or avisynth threads is when you start getting into doing 4k encoding and specifically 4k encodes that are full screen aspect ratio (1.78:1 or even 1.85:1). There is something with encoding all those extra bits that I have found that the 16 core Ryzens really have an issue with those. I can't speak to the latest Intel i-9's as I don't have any of those. Not sure how the whole P and E cores effect encoding 4k, you may have to just do some testing.
When doing those 4k encodes with everything set full out on a 3950/5950/7950, The encoding speed takes a nose-dive to point where they are about 1/2 the speed of a 12 core 3900x or 5900x. Something gets overloaded with all those threads and they just can't handle it. This is where using either affinity mask or avi-synth thread setting knocking them down to only use 12 cores or threads is necessary. Even with cores or threads turned off, they will still out-perform their 12 core brothers.
I posted some quick tests a while ago that showed me that once I set the avisynth prefetch to 12, that it did not slow down or speed up doing regular 1080 or 720 encoding, but made the 4k stuff run as they should which is why I just use that setting now for everything.
guest
17th January 2023, 00:30
Now I'll have to do more testing. :)
Found this:
https://www.hwcooling.net/en/intel-avx-512-tested-in-x265-how-to-enable-it-and-does-it-help/
I found that site, yesterday :
Unfortunately, this has old info, and it only shows 11th Gen Intel & 5000 Series Ryzen's....it clearly shows that the Ryzen's DO NOT support avx 512 but the the Intel chips do, with a small increase in speed.
However, 12th & 13th Gen Intel chips with their "E" & "P" cores do not. although it has been suggested that with some motherboards, there is an option to enable it (I haven't got a motherboard that has that), also it has been suggested that turning off the "E" cores with enable avx 512 support, again, I haven't got that option, either :(
Not sure if the power consumption is going to be worth slightly increased performance. AMDs implementation is double pumped compared to Intels 12th gen. I'm running a test now against a entire 4K movie (Puss in Boots) so I'll report back with the times to encode both with or without.
Unfortunately, I won't be able to use it for my set up as one of my two servers does not have AVX-512 and the X265 options is added to the main x265 settings. But perhaps x265 will just ignore the option if it's not available to use. I'll test that too.
On CPU's that don't support avx 512, the x265 encoder will simply show a message...[warning]: AVX512 is not supported, and then continue's.
So I did a lot of frustrating testing yesterday, and there doesn't appear to be that much benefit, but it's nice be able to enable it, and it's just another feather in AMD's cap.
TBBH, I'm not all that impressed with the 13900KF, it run's as hot as a furnace, and is slower than the 7950X !!!!! (which is also a "cooler" furnace)
I am running a "budget" B660 MSI motherboard, but the "grunt" of the 13900KF should still be fully enabled, I think spending another couple of $100's wouldn't make much difference, and overclocking would just create a LOT more unwanted heat !!!
I will be interested in your test results :)
guest
17th January 2023, 00:47
Hi,
quick question, im using an intel i9-12900KF,
will i see a performance benefit if i use the prefetch option below.
looking at cpu performance all cores seems to works at mostly 100%
Hi JThomasG,
In my limited experience with my new 13900KF, this prefetch option doesn't seem to be as "important" with the Intel chips, as it is with the 16 core Ryzen's.
I did some tests using 3 different command line's, and there was little difference,
encodingserver /priority normal /restart-if-no-progress /avisynth-prefetch-threads 12 /x264-threads 16 /x265-threads 16
encodingserver /priority normal /restart-if-no-progress /avisynth-prefetch-threads 14 /x264-threads 16 /x265-threads 16
encodingserver /priority normal /restart-if-no-progress /avisynth-prefetch-threads 16 /x264-threads 16 /x265-threads 16
However, I did notice that if these commands are not included, the speed drops noticeably :(
As rlev11 mentioned, it does also depend on the "size" of the video being encoded, and of course what filters are being used. specifically 4k encodes that are full screen aspect ratio (1.78:1 or even 1.85:1)
Good luck..
LigH
17th January 2023, 01:51
Add this command to your x265 profile:- --asm avx512
:o
Guys, there is a good reason why this option has to be enabled manually and is not enabled when its CPU support is autodetected:
There is no certain advantage in it. Not as much between AVX2 and AVX512 as there is between AVX and AVX2.
It may execute some calculations faster in net CPU time. But gross CPU time can still be worse, because switching between a more basic CPU mode and the AVX512 context requires clearing more CPU registers which must be loaded again, and the power consumption is so much higher that the temperature rises much faster so that the CPU must be cooled with more efforts, up to throttling down the CPU clock. This may also worsen the durability of the whole CPU.
I don't want to discourage you from the start. Yes, try it. But take all the side effects into account.
guest
17th January 2023, 02:06
:o
Guys, there is a good reason why this option has to be enabled manually and is not enabled when its CPU support is autodetected:
There is no certain advantage in it. Not as much between AVX2 and AVX512 as there is between AVX and AVX2.
It may execute some calculations faster in net CPU time. But gross CPU time can still be worse, because switching between a more basic CPU mode and the AVX512 context requires clearing more CPU registers which must be loaded again, and the power consumption is so much higher that the temperature rises much faster so that the CPU must be cooled with more efforts, up to throttling down the CPU clock. This may also worsen the durability of the whole CPU.
I don't want to discourage you from the start. Yes, try it. But take all the side effects into account.
https://forum.doom9.org/showthread.php?p=1981275#post1981275
Ryushin
18th January 2023, 17:33
Now I'll have to do more testing. :)
Not sure if the power consumption is going to be worth slightly increased performance. AMDs implementation is double pumped compared to Intels 12th gen. I'm running a test now against a entire 4K movie (Puss in Boots) so I'll report back with the times to encode both with or without.
So I finished testing the AVX-512 testing and I also tested against underclocking the 7950x.
What I found, as others have found, there was no improvement in enabling AVX-512. In fact it was ever so slightly slower when using AVX-512.
Underclocking the 7950x resulted in a nice discovery. I have my 7950x underlocked to all cores at 4900MHz using 1.08 volts.
So the 7950x at the default frequencies took 1:24m:28s to run the encode while averaging 210 watts of energy. The 7950x underclocked took 1h:26m:58s while averaging 140 watts of energy. So underclocked it was 2.3% slower than the default frequencies and the 7950x uses 50% more electricity at the default frequencies. Pretty amazing how well the 7950x performs when underclocked slightly. So yea, the 7950x is not so much a furnace if you underclock it.
Testing Detail:
AVX-512 X265 Instruction set test. AMD 7950x with default frequencies.
Source: Puss In Boots 4K - 1h:30m:35s
AIO 420mm Cooler
CQ16
Without AVX-512:
Time to encode: 1:24m:28s
Avg Temp: 85 Celsius
Avg Power Package Watts: 210
Avg Power Cores Watts: 145
With AVX-512:
Tiem to Encode: 1h:25m:44s
Avg Temp: 89 Celsius
Underclocked to 4.9GHz (1.08v)
Without AVX-512
Time to encode: 1h:26m:58s
Avg Temp: 60 Celsius
Avg Power Package Watts: 140
Avg Power Cores Watts: 85
rlev11
18th January 2023, 21:30
Those are great numbers on under-clocking the 7950x. 2.3% performance drop is basically nothing for the huge power savings. This is something I am going to have to seriously consider.
I will probably also look into and see if doing the same with the 5950x results in a similar small performance hit with a big power savings as well.
Just did a quick test with my 7950x. All I did was go into Ryzen Master and in the Basic View changed the profile from Default to Eco Mode. This knocks the 7950x down to 65watt maximum. My CPU temp went from 85c to 63c. CPU Power via Ryzen Master showed a drop from 140w down to appx 55watt. Clock Speeds dropped about a 1,000 Mhz. FPS showed in the Encoding Client in default mode was about 26-27 fps on a 1080p encode. After ECO Mode the fps only dropped 1.5 to 3fps. next up will put a Kill-a-watt meter on at the wall and see what real world power drop is.
Looks like on the 7950x you can change the mode on the fly in Ryzen Master. No reboot required, just click ECO Mode and hit apply.
guest
19th January 2023, 01:04
So I finished testing the AVX-512 testing and I also tested against underclocking the 7950x.
Well, first of all, maybe I should offer a bit of an apology for introducing the AVX512 option, I guess I was "sucked in" by the hype that AVX2 & AVX512 was a bit of a game changer, but it's clearly hyped BS !!
I have also tried supposed AVX2 optimised x265's, and there's no significant improvement.
It might be advantageous in some scenarios, but not this.
It's also a shame that some of us spend our hard-earned money on "top of the line" hardware (eg:- 7950X's, and 13900K's), only to find they use SO much power, and produce SO much heat, that "we" go to great lengths to "hobble" them, to make them more acceptable...it's almost pointless, really.
But having said that, is underclocking the way to go, or is undervolting & overclocking the new thing ??
I was watching a YT clip of JayzTwoCents where he undervolted an Intel CPU, and was also able to overclock it, so more speed, less volts, less power use, less heat.
https://www.youtube.com/watch?v=4jjopjkJzxA
And a couple of other clips on undervolting 7950X's..
https://www.youtube.com/watch?v=1pizvaYiVbk
https://www.youtube.com/watch?v=7JiYAwKIHRY
And now back to your tests:-
Those encoding time's for "Puss In Boot's", that's encoding the movie in less time that it takes to watch it !!!
Are you using any filters, or is it only CQ 16 ??
And as for power usage, that fortunately isn't that much of an issue for me, as I only encode when the Solar Panels are generating enough, and I don't do any "overnight" encoding, been there, done that, was very disappointing, most of the time :(
guest
19th January 2023, 01:24
Those are great numbers on under-clocking the 7950x. 2.3% performance drop is basically nothing for the huge power savings. This is something I am going to have to seriously consider.
I will probably also look into and see if doing the same with the 5950x results in a similar small performance hit with a big power savings as well.
Just did a quick test with my 7950x. All I did was go into Ryzen Master and in the Basic View changed the profile from Default to Eco Mode. This knocks the 7950x down to 65watt maximum. My CPU temp went from 85c to 63c. CPU Power via Ryzen Master showed a drop from 140w down to appx 55watt. Clock Speeds dropped about a 1,000 Mhz. FPS showed in the Encoding Client in default mode was about 26-27 fps on a 1080p encode. After ECO Mode the fps only dropped 1.5 to 3fps. next up will put a Kill-a-watt meter on at the wall and see what real world power drop is.
Looks like on the 7950x you can change the mode on the fly in Ryzen Master. No reboot required, just click ECO Mode and hit apply.
That's all very interesting as well, I think I've tried a few of these settings, but it's just killing the powerhouse that the 7950X is.
You'll probably see a much bigger decrease when encoding 4K, with strong filters :(
I've gone back to some pretty basic BIOS settings, a small negative curse optimiser, and left almost everything else as default, it's running at approx 95- 96°C, on a hot day (but it doesn't seem to matter what the ambient is), and it's around 5100 - 5400MHz, when encoding 4K.
rlev11
19th January 2023, 02:44
Yea I'm not completely sold on ECO Mode. It was just a "Let's see what happens" and I was really surprised that the performance was as good as it was. It something I might enable on the fly if I que up a bunch of stuff to do overnight and don't really care when it gets done.
Ryushin
19th January 2023, 14:07
It's also a shame that some of us spend our hard-earned money on "top of the line" hardware (eg:- 7950X's, and 13900K's), only to find they use SO much power, and produce SO much heat, that "we" go to great lengths to "hobble" them, to make them more acceptable...it's almost pointless, really.
Those encoding time's for "Puss In Boot's", that's encoding the movie in less time that it takes to watch it !!!
Are you using any filters, or is it only CQ 16 ??
And as for power usage, that fortunately isn't that much of an issue for me, as I only encode when the Solar Panels are generating enough, and I don't do any "overnight" encoding, been there, done that, was very disappointing, most of the time :(
Not using any filters for those tests, just CQ16. I can run the same tests but I think the results will be similar.
I think both AMD and Intel are chasing every last bit of performance they can to one up each other. The amount of heat/watts consumed by the new Intel 13900K is staggering (yea, that is a furnace):
https://www.youtube.com/watch?v=P40gp_DJk5E&t=364s
The 13900K seems very bursty in the way it was designed and it throttles back in only a few seconds. The 7950x seems to go to it's limit and hold there. I'm curious, since you have both CPUs, you should run a test and let us know which CPU wins (regardless of power used). I think you'll need to disable the GPU portion though so it runs all CPU.
So even though the chips can eek out more performance by pushing them to their max, I don't think for real world use it's necessary. Even for us that torture the CPUs for encoding, underlocking them ever so slightly produces great performance. And if I want to get 2.3% more performance for 50% more power I can. :)
guest
19th January 2023, 14:17
Not using any filters for those tests, just CQ16. I can run the same tests but I think the results will be similar.
I think both AMD and Intel are chasing every last bit of performance they can to one up each other. The amount of heat/watts consumed by the new Intel 13900K is staggering (yea, that is a furnace):
https://www.youtube.com/watch?v=P40gp_DJk5E&t=364s
The 13900K seems very bursty in the way it was designed and it throttles back in only a few seconds. The 7950x seems to go to it's limit and hold there. I'm curious, since you have both CPUs, you should run a test and let us know which CPU wins (regardless of power used). I think you'll need to disable the GPU portion though so it runs all CPU.
So even though the chips can eek out more performance by pushing them to their max, I don't think for real world use it's necessary. Even for us that torture the CPUs for encoding, underlocking them ever so slightly produces great performance. And if I want to get 2.3% more performance for 50% more power I can. :)
OK, well those times make more sense, now that you've confirmed your settings.
I wonder if when using a filter, you might get different results ??
The 13900KF, is the non GPU variant :cool:
I'm going to try an older x265 build that's supposed to be optimised for AMD & Intel chips...not sure if it's going to yield better results.
And you're correct, that the Ryzen seems to get to it's limit, and stay's there, and the 13900 does indeed throttle back and forth, sadly.
But the Ryzen has the advantage, most definitely.
Atak_Snajpera
19th January 2023, 14:43
The only time in my experience that you have to worry about knocking down cpu cores or avisynth threads is when you start getting into doing 4k encoding and specifically 4k encodes that are full screen aspect ratio (1.78:1 or even 1.85:1). There is something with encoding all those extra bits that I have found that the 16 core Ryzens really have an issue with those. I can't speak to the latest Intel i-9's as I don't have any of those. Not sure how the whole P and E cores effect encoding 4k, you may have to just do some testing.
When doing those 4k encodes with everything set full out on a 3950/5950/7950, The encoding speed takes a nose-dive to point where they are about 1/2 the speed of a 12 core 3900x or 5900x. Something gets overloaded with all those threads and they just can't handle it. This is where using either affinity mask or avi-synth thread setting knocking them down to only use 12 cores or threads is necessary. Even with cores or threads turned off, they will still out-perform their 12 core brothers.
I posted some quick tests a while ago that showed me that once I set the avisynth prefetch to 12, that it did not slow down or speed up doing regular 1080 or 720 encoding, but made the 4k stuff run as they should which is why I just use that setting now for everything.
I wonder what happens if you downgrade your 7950 to 7700 by disabling one CCD in BIOS. Will you still experience the same problem with 4k working terrible with 8 threads (or 16)?
guest
20th January 2023, 01:29
I wonder what happens if you downgrade your 7950 to 7700 by disabling one CCD in BIOS. Will you still experience the same problem with 4k working terrible with 8 threads (or 16)?
That is an unusual suggestion, it's cutting the CPU in half :scared:
If it turned out similar to do what disabling all the "E" Cores on a 13900KF, then it's just SLOW !!
We buy these CPU's for the power, not to "cut them in half" !!
As rlev11, Ryushin & myself have determined, the sweet spot for the 7950X, is this (with about 95% of encodes) :-
/avisynth-prefetch-threads 12 /x264-threads 16 /x265-threads 16
As for the 13900KF, still not too sure what it likes, I might need to try the "Affinity" command line.
I am going to do some tests with an older x265 build, that is supposed to be optimised for different CPU's, so I will post some results, soon
guest
20th January 2023, 05:43
These results are from Atak's x265 Benchmark app :-
With updated x265 builds.
with default included x265 - encoded 2500 frames in 20.75s (120.51 fps), 7025.74 kbps, Avg QP:37.21
x265 r74 - encoded 2500 frames in 19.89s (125.71 fps), 10890.80 kbps, Avg QP:35.84
x265 r83 - encoded 2500 frames in 19.83s (126.07 fps), 10890.80 kbps, Avg QP:35.84
x265 r85 - encoded 2500 frames in 19.72s (126.76 fps), 10890.80 kbps, Avg QP:35.84
x265 v3.5+67-aMod-gcc12.2.1 - encoded 2500 frames in 19.77s (126.46 fps), 10891.97 kbps, Avg QP:35.84
x265-x64-v3.5+67-aMod-gcc12.2.1 failed
x265-3.5+84-5d8f209_vs2022 - encoded 2500 frames in 19.78s (126.39 fps), 10890.80 kbps, Avg QP:35.84
x265-3.5+84-5d8f209_vs2022-AVX2 - encoded 2500 frames in 19.84s (126.01 fps), 10890.80 kbps, Avg QP:35.84
x265-3.5+84-5d8f209_gcc122-AVX2 - encoded 2500 frames in 19.67s (127.07 fps), 10891.97 kbps, Avg QP:35.84
x265-3.5+84-5d8f209_gcc122 - encoded 2500 frames in 19.62s (127.40 fps), 10890.80 kbps, Avg QP:35.84 fastest
Patman builds failed this test :(
------------------------------------------
I have removed most of this post, as it was no longer relevant, after today's testing (21-01-23) :(
Ryushin
20th January 2023, 14:19
OK, well those times make more sense, now that you've confirmed your settings.
I wonder if when using a filter, you might get different results ??
Ran the tests using SMDegrain Hard. The underclocked took three minutes longer, which was 1.4% slower. So I'll take that for 50% of the power savings.
Power Tests:
Source: Puss In Boots 4K - 1h:30m:35s
AIO 420mm Cooler
CQ16
SMDegrain Hard: SMDegrain(video,tr=8,thSAD=800,thSADC=400,contrasharp=true,prefilter=2,refinemotion=true)
7950x Default Frequencies: 3h:26m:08s
7950x Underclocked 4.9GHz at 1.08v: 3h:29m:50s
rlev11
20th January 2023, 15:59
I wonder what happens if you downgrade your 7950 to 7700 by disabling one CCD in BIOS. Will you still experience the same problem with 4k working terrible with 8 threads (or 16)?
I sure wouldn't want to do that as part of my regular workflow, but sometime this weekend I'll give it a try and see what happens for a test. Who knows, the results may be surprising.
It would be nice if we all could figure out exactly what is the hangup when doing 4k once it appears you start going over 12 cores. There must be some program buffer that just gets overloaded with all that extra information contained in each frame
Atak_Snajpera
20th January 2023, 16:19
I sure wouldn't want to do that as part of my regular workflow, but sometime this weekend I'll give it a try and see what happens for a test. Who knows, the results may be surprising.
It would be nice if we all could figure out exactly what is the hangup when doing 4k once it appears you start going over 12 cores. There must be some program buffer that just gets overloaded with all that extra information contained in each frame
Who knows maybe communication between CCDs is the problem in 7950? That's why I asked you if you could check if single CCD also shows this behavior. Intel despite having two different CPU architectures under one roof is immune to excess number of threads.
guest
21st January 2023, 01:25
Who knows maybe communication between CCDs is the problem in 7950? That's why I asked you if you could check if single CCD also shows this behavior. Intel despite having two different CPU architectures under one roof is immune to excess number of threads.
I thought I'd try Atak's suggestion, I am yet to run a "proper" encode, but in the mean time, I ran his x265 benchmark app, and comparing it to here :-
https://forum.doom9.org/showthread.php?p=1980881#post1980881
I think you will see a HUGE difference :(
AMD Ryzen 9 7950X 16-Core @ 4.5GHz ( 8C / 16T )
y4m [info]: 1920x1080 fps 50/1 i420p8 sar 1:1 unknown frame count
raw [info]: output file: NUL
x265 [info]: HEVC encoder version 3.5+85-c2e8e8d13
x265 [info]: build info [Windows][GCC 12.2.0][64 bit] 8bit+10bit+12bit
x265 [info]: using cpu capabilities: MMX2 SSE2Fast LZCNT SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
x265 [info]: Main Still Picture profile, Level-4.1 (Main tier)
x265 [info]: Thread pool created using 16 threads
x265 [info]: Slices : 1
x265 [info]: frame threads / pool features : 4 / wpp(17 rows)
x265 [info]: Coding QT: max CU size, min CU size : 64 / 8
x265 [info]: Residual QT: max TU size, max depth : 32 / 1 inter / 1 intra
x265 [info]: ME / range / subpel / merge : hex / 57 / 2 / 3
x265 [info]: Keyframe min / max / scenecut / bias : 50 / 500 / 40 / 5.00
x265 [info]: Lookahead / bframes / badapt : 20 / 4 / 2
x265 [info]: b-pyramid / weightp / weightb : 1 / 1 / 0
x265 [info]: References / ref-limit cu / depth : 3 / off / on
x265 [info]: AQ: mode / str / qg-size / cu-tree : 2 / 1.0 / 32 / 1
x265 [info]: Rate Control / qCompress : CRF-28.0 / 0.60
x265 [info]: tools: rd=3 psy-rd=2.00 early-skip rskip mode=1 signhide tmvp
x265 [info]: tools: b-intra strong-intra-smoothing lslices=6 deblock sao
encoded 2500 frames in 35.68s (70.07 fps), 10890.80 kbps, Avg QP:35.84
I will run a short encode, and post those results. Not looking good, tho :(
OK, have run a test (same as yesterday, above), and using this :-
Tested a 5 minute 4K clip, using 1 x 6 minute chunk size, CQ 16, no filters !!
Time taken FPS
x265 v3.5+85.1 Mod by Patman clang-AVX2 with AVX512 9:30 12.66 (yesterday, using this command-- /avisynth-prefetch-threads 12 /x264-threads 16 /x265-threads 16)
x265 v3.5+85.1 Mod by Patman clang-AVX2 with AVX512 13:14 9.08 (today, with ONLY half the 7950X enabled, using this command-- /avisynth-prefetch-threads 12 /x264-threads 16 /x265-threads 16)
and last but not least, with the latest x265 build, released yesterday:-
x265 v3.5+87 with AVX512 13:50 8.69 (today, with ONLY half the 7950X enabled, using this command-- /avisynth-prefetch-threads 12 /x264-threads 16 /x265-threads 16)
Oh, and btw, the CPU was running in the high 80°C's, even with half disabled.
So the next step is doing this on the 13900KF...
rlev11
21st January 2023, 17:57
So I ran a whole slew of tests to try to answer Atak's question about turning the 7950x into a 7900x in the bios and see what happens when doing 4k encoding. I also did some runs doing a 1080p encode for comparisons to try to figure out if there was one setting that worked best for both.
For the 4k encode, I did Animal House starting 30 minutes in and just used the ending fps of the first chunk for each encoding server. Ran the same smdegrain heavy grain script. This way for each run, the same encoding server did the same chunk each time for control purposes. As a reference, a 12 core 5900x averaged 5.28 fps for all the runs.
First up is running the 7950x and 5950x servers with no extra settings, so they were running full out max cores and threads.
7950x single server - 4.5 fps
5950x single server - 3.95 fps
5950x dual svr - 6.52 fps combined
7950x with CCD1 disabled in bios, so running as a 7700x - 4.97fps, so in essence a 7700x is 10 percent faster that a 7950x
Next up was running the 7950x and 5950x with: /avisynth-prefetch-threads 12 /x264-threads 16 /x265-threads 16
7950x Dual svr - 8.27 fps combined
7950x single server - 6.95 fps
5950x single server - 5.52 fps
5950x dual svr - 6.89 fps combined
Next up was running the 7950x and 5950x with: /affinity 3FFC3FFC for all encoding servers, essentially running them as 12 core cpus
7950x Dual svr - 8.41 fps combined
7950x single server - 7.06 fps
5950x single server - 5.39 fps
5950x dual svr - 6.99 fps combined
Then I thought lets run the 5950x and 7950x as 2 separate 8 core machines using an affinity mask of FFFF0000 on 1 server and 0000FFFF on the other. So a dual 7700x and a dual 5700x
7950x Dual svr - 9.73 fps combined
5950x dual svr - 7.14 fps combined
Finally I tried on the 7950x running as two 7900x like above, but running 2 server with each affinity mask, so 4 total servers running
7950x quad server - 9.16 fps combined
So this is great, running especially the 7950x as 2 separate 7900x showed a significant improvement, but how does that work when doing 1080p stuff. So I re-ran the tests using where eagles dare using the same heavy smdegrain script as above. the 5900x averaged out at 19.75 fps through all the runs.
First up is running the 7950x and 5950x servers with no extra settings, so they were running full out max cores and threads.
7950x dual svr - 35.71 fps
5950x single server - 19.43 fps
5950x dual svr - 29.24 fps combined
Then running the prefetch 12 setting
7950x dual svr - 35.48 fps
5950x dual svr - 29.11 fps combined
Then running the both servers with the /affinity 3FFC3FFC
7950x dual svr - 34.2 fps
5950x dual svr - 27.92 fps combined
Then using an affinity mask of FFFF0000 on 1 server and 0000FFFF on the other. So a dual 7700x and a dual 5700x. This was the fastest for 4k
7950x dual svr - 25.72 fps
5950x dual svr - 22.2 fps combined
Well this stinks, fastest for 4k , but slowest for lower res by a good bit
Finally running the 7950x with 4 servers as above
7950x quad server - 36.17 fps combined
So my take on this is basically what we already know. Unless you do something to knock down the core counts on the 16 core Ryzens, they are horrible at doing 4k encoding, but once you do, they scale back up quickly and fall in line with what you would expect as they are still faster than their 12 core brothers. The fact that a 7950x cut in half is faster than stock by 10% is really telling.
My best guess is that ffmpeg is the culprit here once the core count goes above 12 in 4k. When running the 16 cores at default max. when I watch the green and blue encoding graph at the bottom of the encoding window, it's the Decoder that is having the most issues and that cpu usage corresponds to ffmpeg in task manager. The green decoder is constantly bouncing up and down with many times there is no blue encoding going on. When encoding is going as it should with reduced threads, the decoding and encoding graph move across the graph in a very steady state, It's the difference between the Plains and the Swiss Alps. The only time I see it wildly bouncing is running all 16 cores maxed out on the 39,59,79 50x's.
Atak_Snajpera
21st January 2023, 22:36
How about setting ffmpeg.exe affinity to CCD0 and x265.exe to CCD1 manually in task manager?
guest
22nd January 2023, 00:34
How about setting ffmpeg.exe affinity to CCD0 and x265.exe to CCD1 manually in task manager?
I just had a look at this, and it seems that RB would have to be doing something for ffmpeg & x265 to be present in Task Manager, to be able to set the Affinity, and then isn't there a good chance that once RB has finished, those settings will be lost ??
EDIT:- I just did a simple test with RipBot264.exe in Task Manager, and it indeed loses any settings applied, when app is closed.
Is there somewhere else that FFmpeg could be changed ??
Some option within RB, maybe ??
As x265 could be changed in its command line/instructions.
I did a bit of Googling earlier, and it definitely appears that this IS an issue with FFmpeg :(
guest
22nd January 2023, 00:39
So I ran a whole slew of tests to try to answer Atak's question about turning the 7950x into a 7900x in the bios and see what happens when doing 4k encoding.
My best guess is that ffmpeg is the culprit here once the core count goes above 12 in 4k.
Wow...so we definitely have a far different approach to testing.
But in the big picture, "we're" only chasing small differences.
Ryushin
22nd January 2023, 14:53
I should also point out that the threading issue is really related to high core counts and not just the 7950x. My Intel Xeon system passes 24 cores and 48 threads to my KVM VM. My tests in the past showed 14 avisynth threads with two encoding servers (24 x264/x265 threads) to be optimum for my setup on that system.
Atak: There is also a little bug in the Audio Description setting if I use the same audio track more than once. When using a 7.1 audio track, I've been setting the Audio1 Description to be something like "AAC 7.1" and using FFMPEG 7.1, then Audio2 I use xcopy stream along with a description like "Dolby TrueHD with Dolby Atmos 7.1". The bug is it will apply a single description to both Audio1 and Audio2.
Output from mediainfo:
Audio #1
ID : 2
Format : AAC LC
Format/Info : Advanced Audio Codec Low Complexity
Codec ID : A_AAC-2
Duration : 1 h 30 min
Bit rate : 641 kb/s
Channel(s) : 8 channels
Channel layout : C L R Ls Rs Lw Rw LFE
Sampling rate : 48.0 kHz
Frame rate : 46.875 FPS (1024 SPF)
Compression mode : Lossy
Stream size : 415 MiB (7%)
Title : DTS-HD (X11 X) 7.1
Language : English
Default : Yes
Forced : No
Audio #2
ID : 3
Format : DTS XLL X
Format/Info : Digital Theater Systems
Commercial name : DTS-HD Master Audio
Codec ID : A_DTS
Duration : 1 h 30 min
Bit rate mode : Variable
Bit rate : 4 445 kb/s
Channel(s) : 8 channels
Channel(s)_Original : Object Based
ChannelLayout_Original : Object Based
Sampling rate : 48.0 kHz
Frame rate : 93.750 FPS (512 SPF)
Bit depth : 24 bits
Stream size : 2.81 GiB (46%)
Title : DTS-HD (X11 X) 7.1
Language : English
Default : No
Forced : No
Atak_Snajpera
22nd January 2023, 16:32
I should also point out that the threading issue is really related to high core counts and not just the 7950x. My Intel Xeon system passes 24 cores and 48 threads to my KVM VM. My tests in the past showed 14 avisynth threads with two encoding servers (24 x264/x265 threads) to be optimum for my setup on that system.
Atak: There is also a little bug in the Audio Description setting if I use the same audio track more than once. When using a 7.1 audio track, I've been setting the Audio1 Description to be something like "AAC 7.1" and using FFMPEG 7.1, then Audio2 I use xcopy stream along with a description like "Dolby TrueHD with Dolby Atmos 7.1". The bug is it will apply a single description to both Audio1 and Audio2.
Output from mediainfo:
Audio #1
ID : 2
Format : AAC LC
Format/Info : Advanced Audio Codec Low Complexity
Codec ID : A_AAC-2
Duration : 1 h 30 min
Bit rate : 641 kb/s
Channel(s) : 8 channels
Channel layout : C L R Ls Rs Lw Rw LFE
Sampling rate : 48.0 kHz
Frame rate : 46.875 FPS (1024 SPF)
Compression mode : Lossy
Stream size : 415 MiB (7%)
Title : DTS-HD (X11 X) 7.1
Language : English
Default : Yes
Forced : No
Audio #2
ID : 3
Format : DTS XLL X
Format/Info : Digital Theater Systems
Commercial name : DTS-HD Master Audio
Codec ID : A_DTS
Duration : 1 h 30 min
Bit rate mode : Variable
Bit rate : 4 445 kb/s
Channel(s) : 8 channels
Channel(s)_Original : Object Based
ChannelLayout_Original : Object Based
Sampling rate : 48.0 kHz
Frame rate : 93.750 FPS (512 SPF)
Bit depth : 24 bits
Stream size : 2.81 GiB (46%)
Title : DTS-HD (X11 X) 7.1
Language : English
Default : No
Forced : No
Thank you! Fixed via auto update.
apol847
22nd January 2023, 19:34
@Atak_Snajpera: Any news regarding the source code for detectborders? Have you seen my private message?
rlev11
22nd January 2023, 19:45
Wow...so we definitely have a far different approach to testing.
But in the big picture, "we're" only chasing small differences.
I agree, over an entire encode, are those few percentage points really making a big difference in total time.
I guess my goal is just to find an encoding server setting that seems to work best for ALL encoding jobs. There is still so many variables in play even with my testing to say that a particular server profile is best for a given resolution. Even saying a 7950x run as 2 7700x's is best for the Animal House (1:1.85 AR), doesn't mean that setting would be BEST for a 1:2.40 AR encode or a 1:1.78 AR encode. Add in maybe different degraining scripts might also make a difference. I just want to find a setting for the 16 core Ryzens (I have 5 of them)that runs well with whatever I throw at it even if it may not be the best setting for that particular encode. As of now it seems to me still that adding the avisynth prefetch set to 12 is a happy medium.
I mean right now I am able to encode 4k with 15 servers active with some aggressive smdegraining somewhere between 60 and 80 fps depending on the aspect ratio, so things aren't all that bad.
I haven't tried it, but i am wondering if we are hard limited to 16 encoding servers in distributed mode. I am 1 more upgrade away from pushing past that.
guest
22nd January 2023, 23:50
I should also point out that the threading issue is really related to high core counts and not just the 7950x. My Intel Xeon system passes 24 cores and 48 threads to my KVM VM. My tests in the past showed 14 avisynth threads with two encoding servers (24 x264/x265 threads) to be optimum for my setup on that system.
So can I interpret this as being like this:-
/avisynth-prefetch-threads 14 /x264-threads 24 /x265-threads 24
It makes you wonder how Threadripper's & multi-core Xeon's would co-operate with this situation.
guest
23rd January 2023, 00:01
I agree, over an entire encode, are those few percentage points really making a big difference in total time.
I guess my goal is just to find an encoding server setting that seems to work best for ALL encoding jobs. There is still so many variables in play even with my testing to say that a particular server profile is best for a given resolution. Even saying a 7950x run as 2 7700x's is best for the Animal House (1:1.85 AR), doesn't mean that setting would be BEST for a 1:2.40 AR encode or a 1:1.78 AR encode. Add in maybe different degraining scripts might also make a difference. I just want to find a setting for the 16 core Ryzens (I have 5 of them)that runs well with whatever I throw at it even if it may not be the best setting for that particular encode. As of now it seems to me still that adding the avisynth prefetch set to 12 is a happy medium.
I mean right now I am able to encode 4k with 15 servers active with some aggressive smdegraining somewhere between 60 and 80 fps depending on the aspect ratio, so things aren't all that bad.
I haven't tried it, but i am wondering if we are hard limited to 16 encoding servers in distributed mode. I am 1 more upgrade away from pushing past that.
Yeah, there are so many variables that can affect the encoding speeds, that a "happy medium" is probably the best result.
I would think that adding more DE servers would have to be up to Atak, as he is the ONLY one with the code.
I'm sure that if asked nicely, he might consider adding more DE servers, maybe up to 20, or 24, or maybe an option for the user to add or subtract how many are available, and displayed in a "resizable window".
I have more than enough machines to occupy more than 16 servers, but ttytt, most of them are too old & now underpowered to warrant their use, and power consumption, and if you have slow PC's "helping" they are just holding up the fast ones, and end up holding up the whole process. :(
Having said that, I would be interested to know what you've got going on there, with your 15 servers? (maybe a PM) sent, thanks.
guest
23rd January 2023, 07:36
I have also removed ALL the info here, as it's also irrelevant, and besides, there's a "copy" of it on rlev11's post, below.
Boulder
23rd January 2023, 11:20
When you figure out these slowdowns with high thread amounts, have you made sure that Avisynth is not running out of cache memory?
Atak_Snajpera
23rd January 2023, 13:21
@Atak_Snajpera: Any news regarding the source code for detectborders? Have you seen my private message?
Sorry for delay. I completely forgot about that.
https://www.mediafire.com/file/r2hmt95asxynruz/DetectBorders_Delphi7_Source.7z/file
Atak_Snajpera
23rd January 2023, 13:46
When you figure out these slowdowns with high thread amounts, have you made sure that Avisynth is not running out of cache memory?
Or changing SetCacheMode
http://avisynth.nl/index.php/Internal_functions#SetCacheMode
Guys add that at the top of your script and see if this fixes that performance drop on 7850 with 16 prefetch threads with active MDegrain/SMdegrain
SetCacheMode(1)
guest
23rd January 2023, 13:51
Or changing SetCacheMode
http://avisynth.nl/index.php/Internal_functions#SetCacheMode
Guys add that at the top of your script and see if this fixes that performance drop on 7850 with 16 prefetch threads with active MDegrain/SMdegrain
SetCacheMode(1)
Be nice if this was the "magic" formula...will definitely test this tomorrow.
:goodpost:
EDIT:- What a shame it wasn't :( :(
rlev11
23rd January 2023, 21:29
So using the exact same test file as the 7950X tests.
Tested a 5 minute 4K clip, using 1 x 6 minute chunk size, CQ 16, no filters !!
using this x265 Profile:-
--level 6.2 --profile main10 --hdr10 --hdr10-opt --output-depth 10 --ctu 64 --high-tier --vbv-bufsize 800000 --vbv-maxrate 800000 --asm avx512 (note:- the avx512 command is ignored by the 13900KF)
/avisynth-prefetch-threads 12 /x264-threads 16 /x265-threads 16 Time Taken 10:07 @ 11.88fps
/avisynth-prefetch-threads 14 /x264-threads 16 /x265-threads 16 Time Taken 10:04 @ 11.95fps
/avisynth-prefetch-threads 16 /x264-threads 16 /x265-threads 16 Time Taken 10:39 @ 11.29fps
but then I thought I'd try some Affinity tests (no prefetch) :-
/affinity 3FFC3FFC (which equates to 12 threads, but displays as 24 in the Encoder Server window) Time Taken 08:29 @ 14.16fps
/affinity 3FFFFFFC (which equates to 14 threads, but displays as 28 in the Encoder Server window) Time Taken 08:15 @ 14.57fps
/affinity FFFFFFFF (which equates to 16 threads, but displays as 32 in the Encoder Server window) Time Taken 08:04 @ 14.92fps (fastest)
then no special "instructions", (which equates to 16 threads, but displays as 32 in the Encoder Server window) Time Taken 08:06 @ 14.85fps
xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
So what I would now like to know is, if the 7950X was the Client machine, to the 13900KF being a Server, do the Encoder command line settings get transferred
from the Client to the Server, meaning that the above settings would revert back to :-
/avisynth-prefetch-threads 12 /x264-threads 16 /x265-threads 16.
OR
Does each PC use it's own particular Encoder settings ??
So it appears that Affinity has a very different influence on the 13900KF, over 16 core Ryzen's.
I guess the next "test" is a proper encoding job, with 2 or so DE Servers working.
so I set the client machine encoding servers in the ripbot264.ini by just using this:
Server1CommandLine=/port 1000 /priority normal /restart-if-no-progress /avisynth-prefetch-threads 12 /x264-threads 16 /x265-threads 16
Server2CommandLine=/port 2000 /priority normal /restart-if-no-progress /avisynth-prefetch-threads 12 /x264-threads 16 /x265-threads 16
All my encoding servers are set by a windows batch file that sits on the desktop and also a shortcut is added to the startup folder so when a server is booted, it loads automatically and is ready to go. I have this in the /bat file for the 16 core Ryzens:
encodingserver /port 1000 /priority normal /restart-if-no-progress /avisynth-prefetch-threads 12 /x264-threads 16 /x265-threads 16
and just this in the 12 and 10 core boxes:
encodingserver /restart-if-no-progress /priority normal
So as far as I know the client does not "push" its encoding server settings to the servers
rlev11
23rd January 2023, 22:27
Or changing SetCacheMode
http://avisynth.nl/index.php/Internal_functions#SetCacheMode
Guys add that at the top of your script and see if this fixes that performance drop on 7850 with 16 prefetch threads with active MDegrain/SMdegrain
SetCacheMode(1)
I want to setup my somewhat controlled test that I did over this past weekend to really look at this which I will get to later in the week.
My initial "way too early" observation is that it does make a difference, but I am not sure it is the magic pill yet. On the 7950x and 5950x the utilization graph is a lot more stable across the board, not the constant wild swings in the decoder utilization. There are still some points during the middle of a chunk where the encoder drops out and the decoder takes a dive for 10-15 seconds. Then it goes back to a stabilized somewhat flat bar. Running at 12 core the bar is stable the whole way across the chunk. FPS are definitely better coming close to the 5900x numbers, but not as high as they should be.
One thing I did notice was I opened a second encoding window on the 7950x at full cores, and performance dropped a little bit combined vs single. When I did this on the 5950x, both encoding windows puked their guts out.
Will post back when I look more thoroughly at it later this week
guest
24th January 2023, 00:19
so I set the client machine encoding servers in the ripbot264.ini by just using this:
Server1CommandLine=/port 1000 /priority normal /restart-if-no-progress /avisynth-prefetch-threads 12 /x264-threads 16 /x265-threads 16
Server2CommandLine=/port 2000 /priority normal /restart-if-no-progress /avisynth-prefetch-threads 12 /x264-threads 16 /x265-threads 16
All my encoding servers are set by a windows batch file that sits on the desktop and also a shortcut is added to the startup folder so when a server is booted, it loads automatically and is ready to go. I have this in the /bat file for the 16 core Ryzens:
encodingserver /port 1000 /priority normal /restart-if-no-progress /avisynth-prefetch-threads 12 /x264-threads 16 /x265-threads 16
and just this in the 12 and 10 core boxes:
encodingserver /restart-if-no-progress /priority normal
So as far as I know the client does not "push" its encoding server settings to the servers
I know I should have known about this, having used RB long enough.
I guess I just wanted another user's confirmation.
Thanks
Now onto more testing..
guest
24th January 2023, 07:11
So I did a lot more testing earlier today, and posted a rather large page of info.
But then I started to do some "proper" encodes, and the whole process went out the window, it just wasn't relevant, so I deleted the post :(
You can test all you like, and maybe the "test" file isn't too complex, so it doesn't really reflect what you will encounter with any other encode.
I added SetCacheMode(1) to the script of the encode I was going to do, and tbh, I don't think it makes much, if any difference, but having said that, it might as well added to any "custom" script, just in case.
So all the info I have posted over the last couple of days if kinda moot. :angry:, and I might even delete it..we'll see.
Anyway, I did a 4K encode with some different settings, and the 13900KF was actually faster than the 7950X (for the first time), but then when I went onto the next job, the 13900KF "fell off a cliff", and the 7950X , "went to the moon".
So about all I can say is I am currently using these command line's :-
/avisynth-prefetch-threads 12 /x264-threads 16 /x265-threads 32
for the 7950X, & 3950X.
&
/avisynth-prefetch-threads 16 /x264-threads 16 /x265-threads 32
for the 13900KF.
I even tried this x265 command :-
--level 6.2 --profile main10 --hdr10 --hdr10-opt --output-depth 10 --ctu 64 --high-tier --vbv-bufsize 800000 --vbv-maxrate 800000 --asm avx512 --pools 32
Note:- as I haven't been doing any x264 stuff, that number hasn't changed, but it might.
rlev11
24th January 2023, 17:27
I ran through the same tests and setup as this past weekend except this time i added the "SetCacheMode(1)" to the top of the avisynth script.
What I can basically say is that it made little to no difference on any of the tests as before. If anything the 5950x's trended a little better and the 7950x trended a little worse, but all by very small percentages. This was for both the 4k and 1080p runs
It definitely did not take care of the issue with 4k encodes running full out on the 5950x and 7950x, but it was worth a shot trying it, thanks...
I did one last test on the 4k Animal House, this time not using any avisynth script or settings, just load it and go. This results in no decoding going on and just showing encoder cpu time. The 7950x running at all 16 cores was by far the fastest, followed by the 5950x at all 16 cores, and then I tried with the 7950x with 12 core using affinity mask and that was slower than the others which I expected.
This makes me convinced the issue has to be with the relationship between ffmpeg and it using the avisynth script as the input and with avisynth sending more information to ffmpeg than it can handle when the size of the stream gets to a certain point with 4k. The hose between them just isn't big enough and it may just mean that the hose can't get any larger.
Boulder
24th January 2023, 18:51
Be nice if this was the "magic" formula...will definitely test this tomorrow.
:goodpost:
EDIT:- What a shame it wasn't :( :(
Then check how much memory one Avisynth related process consumes. The thing is that by default, the amount of cache is restricted to 4GB for 64-bit Avisynth. When you set threads=x in Prefetch, Avisynth+ will then set frames=x*2 as prefetched frames by default. This can easily kill performance (by eating way too much memory + overhead is bigger) so it's better to set the amount of frames manually. For my 5950X, threads=32, frames=12 works best but with RB it's different if you launch multiple encodes on the same machine.
A 4K encode can easily take over 4GB of cache memory. Some scripts I've used, have taken almost 20GB :devil: You'll need SetMemoryMax to raise the amount if the default is not enough.
Atak_Snajpera
24th January 2023, 20:30
I ran through the same tests and setup as this past weekend except this time i added the "SetCacheMode(1)" to the top of the avisynth script.
What I can basically say is that it made little to no difference on any of the tests as before. If anything the 5950x's trended a little better and the 7950x trended a little worse, but all by very small percentages. This was for both the 4k and 1080p runs
It definitely did not take care of the issue with 4k encodes running full out on the 5950x and 7950x, but it was worth a shot trying it, thanks...
I did one last test on the 4k Animal House, this time not using any avisynth script or settings, just load it and go. This results in no decoding going on and just showing encoder cpu time. The 7950x running at all 16 cores was by far the fastest, followed by the 5950x at all 16 cores, and then I tried with the 7950x with 12 core using affinity mask and that was slower than the others which I expected.
This makes me convinced the issue has to be with the relationship between ffmpeg and it using the avisynth script as the input and with avisynth sending more information to ffmpeg than it can handle when the size of the stream gets to a certain point with 4k. The hose between them just isn't big enough and it may just mean that the hose can't get any larger.
Try now with
SetMemoryMax(16384)
rlev11
24th January 2023, 21:22
Tried earlier with SetMemoryMax(8192) along with the cache setting and saw no difference. My only question with that is where would I see the memory being used by avisynth. It does not show up in task manager anywhere that I can see. ffmpeg with and without the 8192 setting was at around 5.5 gig memory used in task Manager. I will try setting it to 16 tomorrow sometime. In the middle of something (work) at the moment. Only problem i could see if 16gig works is some of my servers only have 16 in them (the majority are 32) and that setting would to push out to all the servers since it is in the avisynth script (but we would be closer to solving the mystery).
Also Atak, can we and what would be the correct way to set the frames for avisynth referenced by Boulder above for some testing. Would it be "/avisynth-prefetch-threads 16 frames 16" or "/avisynth-prefetch-threads 16 /avisynth-prefetch-frames 16"
guest
25th January 2023, 02:49
Tried earlier with SetMemoryMax(8192) along with the cache setting and saw no difference. My only question with that is where would I see the memory being used by avisynth. It does not show up in task manager anywhere that I can see. ffmpeg with and without the 8192 setting was at around 5.5 gig memory used in task Manager. I will try setting it to 16 tomorrow sometime. In the middle of something (work) at the moment. Only problem i could see if 16gig works is some of my servers only have 16 in them (the majority are 32) and that setting would to push out to all the servers since it is in the avisynth script (but we would be closer to solving the mystery).
Also Atak, can we and what would be the correct way to set the frames for avisynth referenced by Boulder above for some testing. Would it be "/avisynth-prefetch-threads 16 frames 16" or "/avisynth-prefetch-threads 16 /avisynth-prefetch-frames 16"
I have tried a couple of attempts of the "frames" setting, with no success.
Am currently trying SetMemoryMax(16384), & SetMemoryMax(24576), and this, SetMemoryMax(32768), failed, I only have 32Gb of system memory.
It's starting to be a PITA :mad:
EDIT:- So how I'm "testing" today is actually doing a "proper" encode, and stopping after each completed chunk, for adjustments, and I have tried different SetMemoryMax(), and it doesn't make any significant difference, sadly.
I think that it might be best practice to just run one DE Server per PC (which sounds like a waste), but the single chunk encoding speeds a really up there :), I am using a 2 minute chunk, but it might be worth using 3 or 4 minute chunks, so the CPU has a chance to "get its teeth into it", and it would also "trick" us into thinking that it's not a big job, as there are way less chunks in the list.
rlev11
25th January 2023, 04:32
I've always used a chunk size of 2. The problem with going larger especially with distributed encoding is inevitably your slowest server or both chunks of a server running 2 encoders will end up being the last couple chunks to finish up. Add that to the last chunk sometimes being close to double it's size. An encoding job could end up being 20-30 minutes longer depending on how those last couple of chunks line up.
And that brings up another variable in all of this is total time for an encoding job. Just looking a FPS is only half the story. One could look at 2 similar length jobs and 1 could be significantly faster running 2 encoding windows per server, and the other could be significantly faster running just 1 encoding window per server depending on how things line up and there is no way to tell ahead of time. There is no way to really get around this, it is just the nature of the beast. Eventually I guess it would all even out.
Don't get me wrong, I am really pleased with the performance of the 59 and 79 50's once I get them setup properly. Right now this whole thing of why we have to knock down the 16 core Ryzens is more of an itch I keep scratching. Even though if we do eventually figure out what is going on, I doubt the performance increase would be all that much more than what we are getting now. It's more a curiosity now.
guest
25th January 2023, 05:06
I've always used a chunk size of 2. The problem with going larger especially with distributed encoding is inevitably your slowest server or both chunks of a server running 2 encoders will end up being the last couple chunks to finish up. Add that to the last chunk sometimes being close to double it's size. An encoding job could end up being 20-30 minutes longer depending on how those last couple of chunks line up.
Yes, there's that problem, and that has been debated a bit over the years, that why the last chunk had to be bigger, instead of possibly very small.
But one possible advantage of less chunks is the "waiting time" between chunks, sometimes it can take a reasonable amount of time for the processing to start.
And that brings up another variable in all of this is total time for an encoding job. Just looking a FPS is only half the story. One could look at 2 similar length jobs and 1 could be significantly faster running 2 encoding windows per server, and the other could be significantly faster running just 1 encoding window per server depending on how things line up and there is no way to tell ahead of time. There is no way to really get around this, it is just the nature of the beast. Eventually I guess it would all even out.
Absolutely, you don't know what you're in for, when EVERY job.
Don't get me wrong, I am really pleased with the performance of the 59 and 79 50's once I get them setup properly. Right now this whole thing of why we have to knock down the 16 core Ryzens is more of an itch I keep scratching. Even though if we do eventually figure out what is going on, I doubt the performance increase would be all that much more than what we are getting now. It's more a curiosity now.
Unfortunately my 5950X is down, as I used some "important" items to build the 13900KF, and it won't be back online 'til at least mid to late February :(, but I do have another "little" 16 core, in the 3950X.
I wonder if there are many users out there that have Threadripper's doing RB, they would have to have interesting problems with 64 cores etc....
Boulder
25th January 2023, 06:03
Tried earlier with SetMemoryMax(8192) along with the cache setting and saw no difference. My only question with that is where would I see the memory being used by avisynth.
If ffmpeg is the one doing the frameserving (and possibly encoding too), its memory consumption is the one to look at. I always use the Details tab in Task Manager to see things better.
guest
25th January 2023, 06:31
If ffmpeg is the one doing the frameserving (and possibly encoding too), its memory consumption is the one to look at. I always use the Details tab in Task Manager to see things better.
Hi Boulder, thanks for your help...
I just checked 2 of my PC's, (that were currently encoding) and they are using between 5,200,000 & 5,450,000 K.
Ryushin
25th January 2023, 13:29
It's my theory that the avisynth threads is waiting on frames when using SMDegrain/MDegrain. During my testing I watched the CPU performance during each increase in threading of avisynth threads. As long as I left a bit of headroom for the CPU to bounce between 85-100% usage everything worked great. But as soon as I increased the avisynth threads to high, the CPU went to and stayed at a 100%, everything drastically slowed down. And yea, this seem more pertaining to 4K content and not 1080p as matching 16 avisynth threads to 16 x264/x265 with 1080p was humming right along. So it's a bit of a balancing act to feed two different processes that can process data at different rates that rely on each other.
guest
25th January 2023, 13:57
It's my theory that the avisynth threads is waiting on frames when using SMDegrain/MDegrain. During my testing I watched the CPU performance during each increase in threading of avisynth threads. As long as I left a bit of headroom for the CPU to bounce between 85-100% usage everything worked great. But as soon as I increased the avisynth threads to high, the CPU went to and stayed at a 100%, everything drastically slowed down. And yea, this seem more pertaining to 4K content and not 1080p as matching 16 avisynth threads to 16 x264/x265 with 1080p was humming right along. So it's a bit of a balancing act to feed two different processes that can process data at different rates that rely on each other.
Glad you've joined the discussion, again :)
So, interesting you say that, I did a run this afternoon, upscaling a 1080p to 4K, using a deep_size script, as well as a tr=4 strength filter, and I also changed it to 3 minute chunks, (the last chunk was only about 800 frames bigger) and ONLY 1 DE server per PC, had 4 PC's going, and the speeds were really good, and like you said, with the CPU usage bouncing between 80% & 100% or so, things were running sweet :)
The 7950X & the 13900KF were swapping fastest FPS's all the way thru, they are SO, SO close to each other.
I have changed my encoder command lines a fair bit, they are a little different on each PC, and for now, seems to be working the best.
Atak_Snajpera
25th January 2023, 14:06
My last idea. Have you tried changing process priority once encoding is running for ffmpeg.exe from default to for example HIGH. x265.exe keep as is. You can use Process Hacker/Explorer for that.
guest
25th January 2023, 14:33
My last idea. Have you tried changing process priority once encoding is running for ffmpeg.exe from default to for example HIGH. x265.exe keep as is. You can use Process Hacker/Explorer for that.
I haven't, but wouldn't you have to change this every time you start RB ??
What about the encoder "priority" setting in RB, would that make any difference ??
Also, Process Hacker has been superceded...
https://www.systeminformer.com/
UPDATE:- You CAN set this to a HIGH priority with System Informer (Process Hacker), but to set it permanently, you need to have the app set up as Administrator (install it with Admin rights)
apol847
25th January 2023, 21:24
Sorry for delay. I completely forgot about that.
https://www.mediafire.com/file/r2hmt95asxynruz/DetectBorders_Delphi7_Source.7z/file
No problem. I was also busy. Thank you. Let's see if I get this converted to Linux.
guest
26th January 2023, 01:16
Atak, I have a simple request that will make it a lot easier for us "old fart's" that have poor eyesight, and can't be bothered wearing their glasses.
Could you please change the colour of the text in most windows (Job Queue, Encoder Server, etc) from what seems to be a grey / dark grey, to just plain black, especially the Server name in Encoder Client.
archiel
9th February 2023, 19:30
If I use the resize option in batch, it is failing on videos with a 2:1 ratio (becoming more common on streaming platforms) and will interpret as 1.85:1. The same if I choose resize via the AviSynth options.
I know I can always run a batch file to fix after the conversion, but is there somewhere (and where do I find it) to add 2:1 as a recognised aspect ratio?
Thanks, Archiel
guest
10th February 2023, 00:59
If I use the resize option in batch, it is failing on videos with a 2:1 ratio (becoming more common on streaming platforms) and will interpret as 1.85:1. The same if I choose resize via the AviSynth options.
I know I can always run a batch file to fix after the conversion, but is there somewhere (and where do I find it) to add 2:1 as a recognised aspect ratio?
Thanks, Archiel
That's an odd size, what is an example of a video of that ratio ??
So, here's a suggestion, load the offending video "normally", and go into the Avisynth settings and adjust & test different ratio's using the preview, until you've got it the way you want, then copy the script to notepad, and save it as a Custom Script, then you can "call" it within batch. (If it's in the Custom folder)
#Custom
LoadPlugin("D:\RipBot264\Tools\AviSynth plugins\ColorMatrix\ColorMatrix64.dll")
LoadPlugin("D:\RipBot264\Tools\AviSynth plugins\Plugins_JPSDR\Plugins_JPSDR.dll")
video=Spline64ResizeMT(video,3840,2076)
rlev11
10th February 2023, 01:40
That's an odd size, what is an example of a video of that ratio ??
So, here's a suggestion, load the offending video "normally", and go into the Avisynth settings and adjust & test different ratio's using the preview, until you've got it the way you want, then copy the script to notepad, and save it as a Custom Script, then you can "call" it within batch. (If it's in the Custom folder)
#Custom
LoadPlugin("D:\RipBot264\Tools\AviSynth plugins\ColorMatrix\ColorMatrix64.dll")
LoadPlugin("D:\RipBot264\Tools\AviSynth plugins\Plugins_JPSDR\Plugins_JPSDR.dll")
video=Spline64ResizeMT(video,3840,2076)
Agree with TDS here. Anytime that I have had to batch something with with a resize, I always make a custom script for that ratio (and level of degraining). I am assuming that you are downsizing from 4k to 1080p (doesn't really matter, the process is the same).
Load the video up as a single job. go into avisynth, do an auto-crop, it will tell you the aspect ratio. for your case being a 2:1 aspect. in the resize do a custom, put in 1920x960 or 1280x640, then do whatever else you want to do to that batch. before you then hit OK, click on "show video script" and copy everything in there. go to the tools\avisynth plugins\scripts\custom folder open up notepad and paste that in. then do a file-save as, change the save as type to all files *.*. put in the filename you want with a .avs extension.
to do the batch then, add in the files you want to use that same script on, click "autocrop" then choose your new custom script in the dropdown and hit start.
I have a bunch of custom scripts I use depending on the aspect ratio and degraining for batch processing. I just load up the videos, choose the correct script and go.
guest
10th February 2023, 03:19
Agree with TDS here. Anytime that I have had to batch something with with a resize, I always make a custom script for that ratio (and level of degraining). I am assuming that you are downsizing from 4k to 1080p (doesn't really matter, the process is the same).
Load the video up as a single job. go into avisynth, do an auto-crop, it will tell you the aspect ratio. for your case being a 2:1 aspect. in the resize do a custom, put in 1920x960 or 1280x640, then do whatever else you want to do to that batch. before you then hit OK, click on "show video script" and copy everything in there. go to the tools\avisynth plugins\scripts\custom folder open up notepad and paste that in. then do a file-save as, change the save as type to all files *.*. put in the filename you want with a .avs extension.
to do the batch then, add in the files you want to use that same script on, click "autocrop" then choose your new custom script in the dropdown and hit start.
I have a bunch of custom scripts I use depending on the aspect ratio and degraining for batch processing. I just load up the videos, choose the correct script and go.
Thanks for the backup, "R" :cool:
Yes, once you've figured out how to create & save Custom scripts, "the skies the limit", and one VERY handy extra about that is you can now use with in batch, as batch is rather limited, unfortunately.
archiel
10th February 2023, 11:20
Thank you TDS and rlev11 this gives me something to work on as an interim solution.
FWIW 2:1 is also known as Univisium and has been around as a option for both movies and tv since the late 1990s.
What I would really like to understand what is causing the mistranslation from 2:1 to 1.85:1 and whether it can be fixed. Ideally I want to be able to take a mixed bag of avc videos (different sizes and ratios) and convert them to hevc with a fairly standard size (e.g Auto Height: 1280). While this works fine for more common formats, it fails on 2:1, so these need to be identified separately and either run through a custom script in advance or re-sized afterwards. I am also curious as to how the Auto Height option works and whether there could also be an Auto Width version.
guest
10th February 2023, 12:01
Thank you TDS and rlev11 this gives me something to work on as an interim solution.
FWIW 2:1 is also known as Univisium and has been around as a option for both movies and tv since the late 1990s.
What I would really like to understand what is causing the mistranslation from 2:1 to 1.85:1 and whether it can be fixed. Ideally I want to be able to take a mixed bag of avc videos (different sizes and ratios) and convert them to hevc with a fairly standard size (e.g Auto Height: 1280). While this works fine for more common formats, it fails on 2:1, so these need to be identified separately and either run through a custom script in advance or re-sized afterwards. I am also curious as to how the Auto Height option works and whether there could also be an Auto Width version.
Is there any chance that you could upload a sample or full episode of one of these 2:1 clips ???
I don't think I have had anything like this, some OLD DVD type TV episodes can have a fussy resizing issue.
There is a filter/script that can auto resize clips to a preset width, and auto calculates the height, called "Deep Resize", but it can't be used with standard RipBot.
You could also check this info out, and see if you can do something with it ...
http://avisynth.nl/index.php/SimpleResize
rlev11
10th February 2023, 14:18
Seems like some of the new streaming series are using that 2:1 aspect ratio. I know 1883,For All Mankind, and The Right Stuff used it. I saw that The Santa Clauses series used an oddball 2.2:1 aspect which I don;t remember seeing before
guest
10th February 2023, 14:31
Seems like some of the new streaming series are using that 2:1 aspect ratio. I know 1883,For All Mankind, and The Right Stuff used it. I saw that The Santa Clauses series used an oddball 2.2:1 aspect which I don;t remember seeing before
I'll have to see if I can find an episode or two of them, thanks for that ;)
Edit:- 1883 is 1920 x 960.....
archiel
10th February 2023, 19:29
While we can use custom scripts to pass the correct aspect ratio, the core question seems to be around where Ripbot264 is deriving and storing the Aspect Ratio in the first place and I am guessing that this may be a question for Atak. The Aspect Ratio is only applied once Resize is called as both the mkvinfo.txt and {filename}.lwi show the correct source dimensions. I am assuming that if this could be corrected (ideal) and/or exposed and overridden then Resize would be able use the correct ratio when calculating the inputs for Spline.
guest
11th February 2023, 01:50
While we can use custom scripts to pass the correct aspect ratio, the core question seems to be around where Ripbot264 is deriving and storing the Aspect Ratio in the first place and I am guessing that this may be a question for Atak. The Aspect Ratio is only applied once Resize is called as both the mkvinfo.txt and {filename}.lwi show the correct source dimensions. I am assuming that if this could be corrected (ideal) and/or exposed and overridden then Resize would be able use the correct ratio when calculating the inputs for Spline.
Yes, at it might be the only option, if you haven't noticed, Atak doesn't seem to be doing much with his creation, of late, so any fixes, may not come, but we live in hope.
Having said that, it maybe an Avisynth "thing", and Atak has NO control over that !!!!
EDIT:- I've been informed that this is NOT an Avisynth issue !!
So, I got me an episode or "1883", (which is this 2:1 ratio, 1920 x 960) and indeed, when loaded into RB, and you set it to 1280 x 720, it displays @ 1280 x 692, and setting @ 1920 x 1080, it displays @ 1920 x 1038.
And, as expected, Custom (Auto Height) in batch does the exact same thing...if there was a "manual" Custom setting in batch, then that would solve the whole problem !!!!
What to do :confused::confused::confused:
guest
12th February 2023, 01:30
While we can use custom scripts to pass the correct aspect ratio, the core question seems to be around where Ripbot264 is deriving and storing the Aspect Ratio in the first place and I am guessing that this may be a question for Atak. The Aspect Ratio is only applied once Resize is called as both the mkvinfo.txt and {filename}.lwi show the correct source dimensions. I am assuming that if this could be corrected (ideal) and/or exposed and overridden then Resize would be able use the correct ratio when calculating the inputs for Spline.
We've had an autoupdate today (yesterday), that has corrected this ratio issue.
So, Core (1.26.3), Encoding Client (1.18.2) & Encoding Server (1.18.1) have had an update, all are now at 11/02/23.
And it also appears that my request for darker text in Encoding Client & Encoding Server has been approved & accepted :) (my eyes thankyou)
:thanks:
rlev11
12th February 2023, 03:45
Yep, paused a batch encode, then restarted everything and the update showed up. The darker font color is very nice indeed, Thanks Atak!
archiel
12th February 2023, 17:21
We've had an autoupdate today (yesterday), that has corrected this ratio issue.
So, Core (1.26.3), Encoding Client (1.18.2) & Encoding Server (1.18.1) have had an update, all are now at 11/02/23.
And it also appears that my request for darker text in Encoding Client & Encoding Server has been approved & accepted :) (my eyes thankyou)
:thanks:
Did you test this? I ask because I have also had the update, but when running a batch (auto-height) against 2.00:1 I am still getting an 1.85:1 ratio. The same if I just load the file in Add and go to resize, I either have 1.85 or custom
In case it was something odd in my Ripbot folder, I deleted it, re-downloaded, configured and upgraded, but still1.85:1.
What should I try next - running Windows 11 Pro 22H2.
guest
12th February 2023, 17:38
Did you test this? I ask because I have also had the update, but when running a batch (auto-height) against 2.00:1 I am still getting an 1.85:1 ratio. The same if I just load the file in Add and go to resize, I either have 1.85 or custom
In case it was something odd in my Ripbot folder, I deleted it, re-downloaded, configured and upgraded, but still1.85:1.
What should I try next - running Windows 11 Pro 22H2.
I did test it, and it seemed to work alright for me on the clip I had.
I'm also running 22H2, but I'm happy to test it again and get back to you, later.
guest
13th February 2023, 02:59
As Atak has been so kind as to provide some nice little updates to his app, recently, I thought it was time for this :-
https://www.mediafire.com/file/rj8i9eycmsktxgu/RipBot264v1.26.3+(virgin+13-02-23).7z/file
For those users that want a clean install of the very latest build provided by Atak, without having to start from scratch with v1.26.0, and then update it.
ALL updates have been integrated, but this also includes a copy of ALL the current updates from v1.26.0 (in a separate folder)
All you need to do is keep your RipBot264.ini & EncodingClient.ini from your working/current version.
Enjoy :cool:
guest
13th February 2023, 03:06
And while I'm here, I know it's been a while since I posted any of my custom builds.
Rest assured that I have been busy updating both the Lite & full PD builds, and they are nearly ready for release...just a lot of testing of all the new filters & scripts.
Too many changes to keep track of.
I have to add, that I am shocked that in the last couple of days there has been over 40 downloads of the currently available "full" build from MediaFire :eek:
Cheers.
guest
13th February 2023, 03:36
Did you test this? I ask because I have also had the update, but when running a batch (auto-height) against 2.00:1 I am still getting an 1.85:1 ratio. The same if I just load the file in Add and go to resize, I either have 1.85 or custom
In case it was something odd in my Ripbot folder, I deleted it, re-downloaded, configured and upgraded, but still1.85:1.
What should I try next - running Windows 11 Pro 22H2.
Hi archiel
As I said, I was going to test for you:-
This is importing that 1920 x 960 clip of "1883" TV series:-
Below is what is displayed in the Avisynth "Show Video Script" window
Direct adding this as a job:-
#Upscale
LoadPlugin("C:\RipBot264_PD (01-02-23)\Tools\AviSynth plugins\ColorMatrix\ColorMatrix64.dll")
LoadPlugin("C:\RipBot264_PD (01-02-23)\Tools\AviSynth plugins\Plugins_JPSDR\Plugins_JPSDR.dll")
video=Spline36ResizeMT(video,1920,960)
Direct adding this as a job:-
#Downscale
LoadPlugin("C:\RipBot264_PD (01-02-23)\Tools\AviSynth plugins\ColorMatrix\ColorMatrix64.dll")
LoadPlugin("C:\RipBot264_PD (01-02-23)\Tools\AviSynth plugins\Plugins_JPSDR\Plugins_JPSDR.dll")
video=Spline36ResizeMT(video,1280,640)
Direct adding this as a batch job @ 1280 x 720:-
#Downscale
LoadPlugin("C:\RipBot264_PD (01-02-23)\Tools\AviSynth plugins\ColorMatrix\ColorMatrix64.dll")
LoadPlugin("C:\RipBot264_PD (01-02-23)\Tools\AviSynth plugins\Plugins_JPSDR\Plugins_JPSDR.dll")
video=Spline36ResizeMT(video,1280,640)
Direct adding this as a batch job @ Auto height (1280):-
#Downscale
LoadPlugin("C:\RipBot264_PD (01-02-23)\Tools\AviSynth plugins\ColorMatrix\ColorMatrix64.dll")
LoadPlugin("C:\RipBot264_PD (01-02-23)\Tools\AviSynth plugins\Plugins_JPSDR\Plugins_JPSDR.dll")
video=Spline36ResizeMT(video,1280,640)
Direct adding this as a batch job @ 1280 x 720, using the very latest standard RipBot:-
#Downscale
LoadPlugin("F:\RipBot264v1.26.3\Tools\AviSynth plugins\ColorMatrix\ColorMatrix64.dll")
LoadPlugin("F:\RipBot264v1.26.3\Tools\AviSynth plugins\Plugins_JPSDR\Plugins_JPSDR.dll")
video=Spline36ResizeMT(video,1280,640)
Atak has made some interesting "under the hood" changes for this :)
The only thing I would change is Spline36ResizeMT to Spline64ResizeMT..:sly:
This should also allow you to add any size clip, (in Batch) and it will "keep" the correct ratio, from now on. NICE.
archiel
13th February 2023, 12:08
The only thing I would change is Spline36ResizeMT to Spline64ResizeMT..:sly:
This should also allow you to add any size clip, (in Batch) and it will "keep" the correct ratio, from now on. NICE.
Thanks for the results, I need to do do some more testing this evening. In regard to changing Spline32ResizeMT to Spline64ResizeMT, is this something that can be done globally, or were you suggesting it as an option?
guest
13th February 2023, 12:16
Thanks for the results, I need to do do some more testing this evening. In regard to changing Spline32ResizeMT to Spline64ResizeMT, is this something that can be done globally, or were you suggesting it as an option?
You're welcome, and I hope you get it working.
No, this is not a global option, it would have to be done on a per job basis, unless again, you created your own scripts.
It would be nice if it was an option, OR changed by default, as I've read that 64 IS better than 36.
Atak_Snajpera
13th February 2023, 12:54
Because We all know that higher number is better... Right?
guest
13th February 2023, 13:33
Because We all know that higher number is better... Right?
Well, official documentation says so...
http://avisynth.nl/index.php/Resize#Spline_based_resizers
Spline64Resize may be the most accurate of the Resize filters.
Spline16Resize is sharper and rings just a bit (which may be desirable with soft sources),
and looks pleasing to the eye when enlarging or reducing in moderate amounts.
Spline36Resize is somewhere in between the other two.
Atak_Snajpera
13th February 2023, 14:35
Do some real tests first. Spline64Resize for example is ~20% slower than Spline36Resize without any noticeable by humans difference.
Like you mentioned Spline36Resize is a good compromise between speed and overall quality of scaling. Do not expect miracles using spline64. You won't get extra details like with some AI powered stuff.
archiel
13th February 2023, 16:46
Problem solved, for some reason Updater did not update RipBot264.exe. Second clean install and now 2.00:1 is working
rlev11
13th February 2023, 22:38
All I know is I have done a bunch of downsizing of 4k to 1080 for a friend of mine with "I guess" Spline36Resize, never paid attention to that, and I have always had great results. Everything looks fine to me . I don't use ripbot to upscale anything, If I need to upscale 480p stuff I run that through Topaz Video Enhance AI before I convert back to x265.
guest
14th February 2023, 03:39
I thought it was time to make an updated build of this, for those who use Atak's RipBot, and would like the latest available for the main components.
Moved, and updated.
Glarioo
15th February 2023, 19:45
I thought it was time to make an updated build of this, for those who use Atak's RipBot, and would like the latest available for the main components.
https://www.mediafire.com/file/9sktobrp6k23yww/update+package+for+RipBot264+(14-02-23).7z/file
Thank you, Pauly!
guest
16th February 2023, 01:51
Atak, as you well know, several years ago you made the decision to change the default video decoder from FFMS2 to the then fairly new Lsmash, mainly for frame accuracy, I believe.
But there is no option (other than to do it manually in the .ini file), to change this back to FFMS2.
I'm sure it wouldn't be too difficult for you to re-instate this as a user option, so at least they had an easy choice.
There have been several FFMS2 updates recently, so maybe update it in RB at the same time :o
https://forum.doom9.org/showthread.php?p=1983002#post1983002
There have also been some new updates for avsresize as well...
https://forum.doom9.org/showthread.php?p=1982991#post1982991
But, as always, this is entirely up to you, so please consider.
:thanks:
guest
16th February 2023, 03:36
Do some real tests first. Spline64Resize for example is ~20% slower than Spline36Resize without any noticeable by humans difference.
Like you mentioned Spline36Resize is a good compromise between speed and overall quality of scaling. Do not expect miracles using spline64. You won't get extra details like with some AI powered stuff.
Just thought I'd report back with some results:-
A 5 minute 1080p clip @ Spline32 took 3:28..size was 126,016Kb
Same 5 min clip @ Spline64 took 4:48. and was 125,935Kb
Couldn't tell any difference on 27" 4K monitor, but maybe on 4K TV :rolleyes:
Have started using Topaz Video Enhance AI :o
Atak_Snajpera
16th February 2023, 16:40
Atak, as you well know, several years ago you made the decision to change the default video decoder from FFMS2 to the then fairly new Lsmash, mainly for frame accuracy, I believe.
But there is no option (other than to do it manually in the .ini file), to change this back to FFMS2.
I'm sure it wouldn't be too difficult for you to re-instate this as a user option, so at least they had an easy choice.
There have been several FFMS2 updates recently, so maybe update it in RB at the same time :o
https://forum.doom9.org/showthread.php?p=1983002#post1983002
There have also been some new updates for avsresize as well...
https://forum.doom9.org/showthread.php?p=1982991#post1982991
But, as always, this is entirely up to you, so please consider.
:thanks:
FFMS2 after all those years still has the same problems. Corrupted frames and frames returned in wrong order
https://i.postimg.cc/Cxk5v1G5/seek.png
https://i.postimg.cc/PqHx0jy4/seek2.png
Do you really want that kind of problems after encoding in distributed encoding mode?
AMED
17th February 2023, 01:56
I'm trying to use Ripbot264 on a Dell Poweredge R510 and it seems to be stuck opening after I have installed the OpenCL runtimes for the Xeon CPUs. The OpenCLinfo.cmd step seems to keep dumping info in to OpenCLinfo.txt and doesn't seem to finish (been waiting 30mins). The OpenCLinfo.txt file is currently 72MB in size and still increasing.
Platform 0.
Name : Intel(R) CPU Runtime for OpenCL(TM) Applications
Vendor : Intel(R) Corporation
Version : OpenCL 2.1 WINDOWS
Profile : FULL_PROFILE
Extensions : cl_khr_icd cl_khr_global_int32_base_atomics cl_khr_global_int32_extended_atomics cl_khr_local_int32_base_atomics cl_khr_local_int32_extended_atomics cl_khr_byte_addressable_store cl_khr_depth_images cl_khr_3d_image_writes cl_intel_exec_by_local_thread cl_khr_spir cl_khr_dx9_media_sharing cl_intel_dx9_media_sharing cl_khr_d3d11_sharing cl_khr_gl_sharing cl_khr_fp64 cl_khr_image2d_from_buffer cl_intel_vec_len_hint
0.0 Device name :
Hardware version :
Software version :
OpenCL C version :
Compute units : 0
......................................
Then lots of empty entries.
......................................
0.555005 Device name :
Hardware version :
Software version :
OpenCL C version :
Compute units : 0
0.555006 Device name :
Hardware version :
Software version :
OpenCL C version :
Compute units :
I think I've found a workaround. I made a copy of OpenCLinfo.cmd and edited it like below, ran the script and then changed OpenCLinfo.txt to read only. now no more delay opening Ripbot264
"D:\Storage\RipBot264v1.26.3\tools\OpenCLinfo\OpenCLinfo.exe" /cpu >> "D:\Storage\RipBot264v1.26.3\tools\OpenCLinfo.txt"
guest
17th February 2023, 02:26
FFMS2 after all those years still has the same problems. Corrupted frames and frames returned in wrong order
Do you really want that kind of problems after encoding in distributed encoding mode?
Thanks for the detailed reply, but those test files are from pretty old movies, is this very current testing ??
I have been using FFMS2 & DE for a couple of weeks, and I haven't noticed any processing or playback problems.
But if you think it's mainly a problem for DE, I'm sure there are MANY users who can't or don't use DE.
NOTE:- and for you users that aren't aware, Distributed Encoding CAN be used on a single pc !!!, and there are benefits of doing so !!
guest
17th February 2023, 02:32
I'm trying to use Ripbot264 on a Dell Poweredge R510 and it seems to be stuck opening after I have installed the OpenCL runtimes for the Xeon CPUs. The OpenCLinfo.cmd step seems to keep dumping info in to OpenCLinfo.txt and doesn't seem to finish (been waiting 30mins). The OpenCLinfo.txt file is currently 72MB in size and still increasing.
I think I've found a workaround. I made a copy of OpenCLinfo.cmd and edited it like below, ran the script and then changed OpenCLinfo.txt to read only. now no more delay opening Ripbot264
"D:\Storage\RipBot264v1.26.3\tools\OpenCLinfo\OpenCLinfo.exe" /cpu >> "D:\Storage\RipBot264v1.26.3\tools\OpenCLinfo.txt"
It seems that you are, or have been a long term Staxrip user, so welcome here :)
So, it might be an idea to add a basic AMD or nVidia GPU to use OpenCL better.
But if you've found a workaround, that might be all it needs.
I have several Dell & SMC server's and haven't had too much success with Intel OpenCL stuff, so I have just added a GPU.
Good Luck.
LigH
17th February 2023, 08:07
:eek: Page 1000, wow... :cool:
Atak_Snajpera
17th February 2023, 12:46
Thanks for the detailed reply, but those test files are from pretty old movies, is this very current testing ??
I have been using FFMS2 & DE for a couple of weeks, and I haven't noticed any processing or playback problems.
But if you think it's mainly a problem for DE, I'm sure there are MANY users who can't or don't use DE.
NOTE:- and for you users that aren't aware, Distributed Encoding CAN be used on a single pc !!!, and there are benefits of doing so !!
Because You are not using FFMS2 in Distributed encoding mode.
Just check 1.avs file in Chunks folder.
guest
17th February 2023, 13:07
Because You are not using FFMS2 in Distributed encoding mode.
Just check 1.avs file in Chunks folder.
So you're saying that despite decoding with FFMS2, DE is using Lsmash :confused:
It also shows in the video script.
I will check that tomorrow. DONE !!
EDIT:- I have checked 1.avs in the Chunks folder, and this is what it shows :-
#VideoSource
LoadPlugin("\\RYZEN-9-7950X\RipBot264temp\Tools\AviSynth plugins\ffms\ffms_latest\x64\ffms2.dll")
video=FFVideoSource("\\RYZEN-9-7950X\RipBot264temp\job1\video.mkv",threads=0,cachefile="\\RYZEN-9-7950X\RipBot264temp\job1\video.mkv.ffindex")
I'm going to find your "SeekTester", and do some tests myself !!!
Ryushin
17th February 2023, 14:30
FFMS2 after all those years still has the same problems. Corrupted frames and frames returned in wrong order
Do you really want that kind of problems after encoding in distributed encoding mode?
And actually this is very important for Dolby Vision. The encoded frame count has to be the same as the source frame count.
guest
18th February 2023, 03:13
Like I said, I was going to do some tests of my own, and here are the results !!
Nothing is perfect, it seems :(
Removed screen shot, as it has been copied in Atak's reply, below.
That's just a bit too random IMO.
AFAIC, if you don't have any encoding & playback problems, who gives a toss about "test's".
guest
18th February 2023, 06:13
Hey guy's,
I have 2 new re-hashed builds for you to try.
If you want a simpler experience, with a few Custom SMDegrain scripts ready to go, then the "Lite" build will be for you.
https://forum.doom9.org/showthread.php?p=1983764#post1983764
If you what to boggle your mind with almost endless possibilities, then the full build is for you.
It's only limited by your imagination, experience & requirements.
There are some very exciting new filters & scripts to explore.
https://forum.doom9.org/showthread.php?p=1983764#post1983764
Not sure what else to say, the ppl that already use these builds, (and I know there's 100's of you), will know what to do.
Newbies just need to unpack the .7z, do not rename the extracted folder, and put it where you want (preferably in the root of C:\ drive), read the instructions & install everything, and it should be up and running in no time.
Set your .ini files or use you existing files.
Good luck.
MCFish
18th February 2023, 09:23
Hey guy's,
I have 2 new re-hashed builds for you to try.
Thx mr. dunne
Atak_Snajpera
18th February 2023, 16:21
Like I said, I was going to do some tests of my own, and here are the results !!
Nothing is perfect, it seems :(
https://i.imgur.com/XoKVmvK.jpg
That's just a bit too random IMO.
AFAIC, if you don't have any encoding & playback problems, who gives a toss about "test's".
With FFMS2 YOU WILL DEFINETELY have problems at split point in DE mode!
Trust me! I've been there and I was extremely frustrated with FFMS2 until I switched to LSmash. All my problems were gone when I dumped FFM2S! Older users of DE mode can testify how buggy was FFMS2. Corrupted frame when chunk starts, duplicated frames at chunks start and so on...
Missing frame means that frame for some reason was not extracted for testing. Maybe ffmpeg.exe crashed... Maybe you ran out of memory because UHD consumes a lot especially with 32 thread CPU! On my 16 thread CPU memory consumption reaches 18 GiB!
Focus on CORRUPTED FRAME ERROR and FRAME INSERTED ERROR
vBulletin® v3.8.11, Copyright ©2000-2026, vBulletin Solutions Inc.