RipBot264 v1.18.3 - Simple and easy to use GUI -> IPOD . PSP . CONSOLES . BLURAY

[FuzzyNutz]

An error appears in every activation cycle in my update log:

2019-08-24 12:55:57 : =========================[UPDATER ACTIVATED]=========================
2019-08-24 12:55:57 : Looking for correct UUID link in
2019-08-24 12:55:57 : [ERROR] NO CONNECTION with
2019-08-24 12:55:57 : Searching for UUID link with DuckDuckGo...
2019-08-24 12:55:57 : Search results...
2019-08-24 12:55:57 : http://pastebin.com/FC9zCf0D
2019-08-24 12:55:57 : Looking for correct UUID link in http://pastebin.com/FC9zCf0D
2019-08-24 12:55:58 : [SUCCESS] http://pastebin.com/FC9zCf0D has correct UUID link 6c966b28-e0dd-48f6-b1c7-a56e8a275ec0
2019-08-24 12:55:58 : No results.

My Windows 10 (Pro) firewall includes exceptions for RipBot264 and it's updater, that I added.

[slalom]

You can change the default decoder in the settings (Main) from LSmash to FFMS2 for all codecs or just the ones you want, or you can even do it after the fast if you right click on a job and select FFMS2.
I changed everything to FFMS2 too. I hope there are no problems

[Atak_Snajpera]

An error appears in every activation cycle in my update log:

2019-08-24 12:55:57 : =========================[UPDATER ACTIVATED]=========================
2019-08-24 12:55:57 : Looking for correct UUID link in
2019-08-24 12:55:57 : [ERROR] NO CONNECTION with
2019-08-24 12:55:57 : Searching for UUID link with DuckDuckGo...
2019-08-24 12:55:57 : Search results...
2019-08-24 12:55:57 : http://pastebin.com/FC9zCf0D
2019-08-24 12:55:57 : Looking for correct UUID link in http://pastebin.com/FC9zCf0D
2019-08-24 12:55:58 : [SUCCESS] http://pastebin.com/FC9zCf0D has correct UUID link 6c966b28-e0dd-48f6-b1c7-a56e8a275ec0
2019-08-24 12:55:58 : No results.

My Windows 10 (Pro) firewall includes exceptions for RipBot264 and it's updater, that I added.

Replace old updater.exe with this
https://www.mediafire.com/file/0744wilxt2e7wlv/updater.exe/file

[Atak_Snajpera]

I changed everything to FFMS2 too. I hope there are no problems

FFMS2 is not perfect either
https://forum.doom9.org/showthread.php?p=1881599#post1881599

I would at least use LSMASH for MPEG-2. I have few sample where FFMS2 mpeg-2 decoder acts weird.

[FuzzyNutz]

Replace old updater.exe with this
https://www.mediafire.com/file/0744wilxt2e7wlv/updater.exe/file

Thank you.

[slalom]

FFMS2 is not perfect either
https://forum.doom9.org/showthread.php?p=1881599#post1881599

I would at least use LSMASH for MPEG-2. I have few sample where FFMS2 mpeg-2 decoder acts weird.
LSMASH takes at least twice the time. I can use it for MPEG-2, there are very few of them

[byteshare]

FFMS2 is not perfect either
https://forum.doom9.org/showthread.php?p=1881599#post1881599

I would at least use LSMASH for MPEG-2. I have few sample where FFMS2 mpeg-2 decoder acts weird.
Thank you for the note on MPEG-2. I had LSmash only set for VC-1.

No LSmash/FFMS2 setting exists on my UI, "main".
What is the "fast"?
What is the "it" in "I confirmed it"?
You're not on the most recent version if you don't see that in the main section of your settings.
"fast"...*fact (typo)
"it" confirming the issue wasn't happening

[Atak_Snajpera]

Do not use lsmash for vc1!!! IT is totally broken!!!

[FuzzyNutz]

Once RB treats me to the update that adds the setting for selecting LSmash, should I use it for MPEG-2 sources only?

[slalom]

@Atak
I wanted to ask something regarding which server runs the CombineAllChunks.cmd
Is it the one who finishes the last chunk?

[Atak_Snajpera]

None. Encodindclient.exe executes that command file.

[byteshare]

Do not use lsmash for vc1!!! IT is totally broken!!!
Ah, okay...I did NOT remember that correctly. Thank you.

Once RB treats me to the update that adds the setting for selecting LSmash, should I use it for MPEG-2 sources only?
It isn't RB if you've edited the update.ini file, but to answer your question: You can use it for LSmash for all except VC-1 or just MPEG-2, up to you.

[byteshare]

I've been having some slowness issues and I thought it was more to do with LSmash but it doesn't seem to be...
I get about 1FPS using SMD in DE mode (1 encoding server) but about 7 FPS in non-DE mode with the exact same job. My SMD code:video=video.SMDegrain(tr=3,thSAD=400,thSADC=150,refinemotion=false,contrasharp=true,plane=4,pel=2,prefilter=4,
Truemotion=False,chroma=true,hpad=32,vpad=32,str=2,amp=1) (added line-break to help with horizontal scrolling
One thing I've noticed that the encoding server is spending most of the time in decoding mode and doesn't actually encode very much and if I have 2 encoding servers at some point it is common for them both to stall and just do decoding but at a reduced amount of CPU.
I'd post about this before and thought it was to do with QTGMC and SMD not playing well together but when I switch to non-DE mode I'm also seeing an increase in FPS for encoding.

Is there something I could do to help DE mode be faster?
I don't have to be in DE mode but I use it for two reasons to normally get slightly faster FPS (using more CPU) and so if I need to "Pause" during a job I can turn off the encoding server, or even reboot if need be.

[Atak_Snajpera]

Network bottleneck.

[byteshare]

Network bottleneck.
Gigabit LAN but just one Encoding Server and it is local (all on the same machine as the main RipBot), so that seems like an issue with what the Encoding Server is doing, no?
-I don't recall seeing the same issues if I don't use filters, specifically MDegrain, SMDegrain, and QTGMC slower preset.

I'd have to go back and test with an older version of RipBot but at some point this started happening because I remember doing a lot of tests with Prefilter 3 and 4 on SMDegrain (CPU (3) and GPU (4)) and getting roughly the same speeds I'm getting now in non-DE mode that I was getting in DE mode with the older version.

[FuzzyNutz]

It isn't RB if you've edited the update.ini file, but to answer your question: You can use it for LSmash for all except VC-1 or just MPEG-2, up to you.

I have core 08-23 and updater 08-24, yet changing to an older date in the updater.ini file still doesn't get me LSmash settings after many runs of RB as administrator or not. I'm still getting flickering frames.

[Atak_Snajpera]

What does updater log say?

[FuzzyNutz]

What does updater log say?

2019-08-25 13:09:38 : =========================[UPDATER ACTIVATED]=========================
2019-08-25 13:09:38 : Looking for correct UUID link in http://forum.doom9.org/showthread.php?t=127611
2019-08-25 13:09:39 : [SUCCESS] http://forum.doom9.org/showthread.php?t=127611 has correct UUID link 6c966b28-e0dd-48f6-b1c7-a56e8a275ec0
2019-08-25 13:09:39 : Downloading update file http://atak-snajpera.5v.pl/ripbot264update/update.zip
2019-08-25 13:09:39 : [SUCCESS] C:\Program Files (x86)\RipBot264\Updates\update.zip saved!
2019-08-25 13:09:39 : CRC32 value has not changed for [core]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [Aften]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [avs2pipemod]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [avs2yuv]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [AVSMeter]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [BDSup2Sub]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [ChapterXtractor]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [dgindex]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [DownloadPoster]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [eac3to]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [ffmpeg]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [fhgaacenc]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [MediaInfo]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [mkvtoolnix]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [ModifyChapters]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [mp4box]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [mpc]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [opus-tools]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [PgcDemux]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [remuxtool]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [SetACL]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [ssatosrt]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [tsmuxer]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [vjoin]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [VSRip]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [wolcmd]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [x264]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [x265]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [AutoCrop]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [ffms]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [flash3kyuu_deband]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [hqdn3d]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [Scripts]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [TIVTC]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [VSFilter]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [Yadif]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [KNLMeansCL]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [OpenCLinfo]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [masktools]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [mvtools]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [nnedi3]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [DetectBorders]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [AviSynth]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [RawSourcePlus]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [RgTools]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [NicAudio]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [Plugins_JPSDR]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [WaitForProcess]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [avsresize]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [DGTonemap]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [lsmash]. Update is not required.
2019-08-25 13:09:39 : CRC32 value has not changed for [7z]. Update is not required.
2019-08-25 13:09:39 : Downloading finished.

[Atak_Snajpera]

You are fully updated. End of story.

[FuzzyNutz]

You are fully updated. End of story.

Why don't I see the option for LSmash under settings and I don't have the ability to choose it when right-clicking loading jobs as described by "byteshare"?

-And I'm still getting frame flickering.

[Atak_Snajpera]

Don't know.

[FuzzyNutz]

Don't know.

Please upload a screenshot of the LSmash setting.

[slalom]

Why don't I see the option for LSmash under settings and I don't have the ability to choose it when right-clicking loading jobs as described by "byteshare"?

-And I'm still getting frame flickering.
Download the file from the first page and update that

[FuzzyNutz]

Download the file from the first page and update that

It worked. Thanks.

[FuzzyNutz]

I get flickering frames using LSmash on AVC sources, but not with FFSM2.

[BLKMGK]

Upgraded, had to reinstall to get it but I've got it :)

The weird behavior with chunks and indexing is gone - whew! However I'm back to my issues with KNLMeansCL - ugh! At first even my desktop that was able to run this code was giving me errors about not being able to access a "file". I switched settings such that both X264 and KNLMeansCL devices were set to the onboard Intel CPU, much to my surprise both my desktop and a client with a GeForce 680 began working - albeit VERY slow. If I stop the desktop and switch it to use the GTX 1070 for KNLMeansCL then the desktop begins working (about double speed) and the remote client begins failing! It looks like settings on the hosting machine affect clients and the client being set to use it's onboard card aren't obeyed :( Currently the single machine can beat the efforts of both machines working together so I'm leaving it alone (lol) but I'd appreciate some insight.

Setting the X265 accel to "none" results in both failing too... I'm also finding that aborting a job midway through no longer saves the completed blocks - that's a huge bummer! It might be because I'm swapping acceleration devices around? This job is FFMS2 based indexing BTW. I'm going to look for a post you made a bit ago that showed a commandline for specifying OpenCL hardware ID numbers. I'm betting that this isn't being drawn from the local machine doing encoding but from the server handing out the jobs. Maybe manually speccing it will help? On the tasking desktop the hardware ID I want is 2 so if it's sending a hardware ID to the other clients it'll be wrong depending on the machine - the 8700K I'm using as a slave doesn't have good enough video encoding on it's CPU apparently? The 3900X I've got but am not currently using has no video in the CPU so it's OpenCL ID will be 1 as well vs the 2 my tasking machine is using.

EDIT: Manually setting the device ID, to the one already set in RipBot on my slave encoder, got it working - whew! Now I want my 3900X back to fix it too lol. Hopefully this helps someone else out. Is there documentation somewhere on the various commandline switches?

P.S. a bug I think I have nailed down... Whenever you abort a job the next time you start it up it will fail. It fails because the tools folder is erased but not copied. The second time after an abort that you start it will work because it copies the tools over to the folder. So to test this I must abort 2x before I can get a good test.

[Atak_Snajpera]

Hopefully this helps someone else out. Is there documentation somewhere on the various commandline switches?
https://i.imgsafe.org/3b/3b7fc0cfd6.png

[byteshare]

I get flickering frames using LSmash on AVC sources, but not with FFSM2.
Well, at least it works with FFSM2 for you now.

P.S. a bug I think I have nailed down... Whenever you abort a job the next time you start it up it will fail. It fails because the tools folder is erased but not copied. The second time after an abort that you start it will work because it copies the tools over to the folder. So to test this I must abort 2x before I can get a good test.
Oh, nice find. That explains some of the weird behavior I've seen when I was using DE mode, but I'm on non-DE mode right now since I have issues with things running slower in that mode.

[FuzzyNutz]

When was LSmash introduced to RB? -So I know how far back to redo my collection with FFSM2.

[byteshare]

When was LSmash introduced to RB? -So I know how far back to redo my collection with FFSM2.

v1.25 Aug. 1st
https://forum.doom9.org/showpost.php?p=1880784&postcount=17063

[FuzzyNutz]

v1.25 Aug. 1st
https://forum.doom9.org/showpost.php?p=1880784&postcount=17063

Thanks. If only I knew when my RB updated to it. First video I recall exhibiting flickering frames was mid August.

[byteshare]

Thanks. If only I knew when my RB updated to it. First video I recall exhibiting flickering frames was mid August.
I believe the x265 version changed too, so you could tell by that if you're encoding into x265.

[byteshare]

Newer QTGMC v3.358s
Supports KNLMeansCL as a denoiser and 16B
There are some bug fixes as well but from testing I'm not seeing much of a difference if using just using Medium preset.
http://avisynth.nl/index.php/QTGMC

[PLOPZA]

I've noticed that in windows 10, running Ripbot in D.E. mode, that windows built-in antivirus and anti-malware is scanning the chunks as they're sent to each server while using L-Smash. And I switched L-smash to ffms2 looks like my encodes are back to acceptable completion times (120-150 fps first pass, 30-34 fps second pass) across 4 PC's

Edit - I would also note all computers, and the bandwidth usage spikes when intercepted by the scanner, scanner does it's thing and then ripbot shows it's encoding and the bandwidth drops to normal 60-110 megabits per second

[Ryushin]

So I just got hit by the random frames bug and I'm using DE. Seems to happen a couple of seconds after a minute mark for 2-5 seconds. I looked at a 4K and HD encode I did with MDegrain2 and at first glance, it seems fine. I have a 3h:17m source that I ran MDegrain2 on and at the 13 minute mark, random frames occur for about 2-10 seconds. It happens to most of the minute marks after that. Going to run the same source through again without the MDegrain2 and see what happens.

[byteshare]

So I just got hit by the random frames bug and I'm using DE. Seems to happen a couple of seconds after a minute mark for 2-5 seconds. I looked at a 4K and HD encode I did with MDegrain2 and at first glance, it seems fine. I have a 3h:17m source that I ran MDegrain2 on and at the 13 minute mark, random frames occur for about 2-10 seconds. It happens to most of the minute marks after that. Going to run the same source through again without the MDegrain2 and see what happens.
Which decoder are you using? (LSmash or FFMS2)

[Atak_Snajpera]

Also what codec is used in source video?

[Ryushin]

Also what codec is used in source video?

From the m2ts source:
Video
ID : 4113 (0x1011)
Menu ID : 1 (0x1)
Format : AVC
Format/Info : Advanced Video Codec
Format profile : High@L4.1
Format settings : CABAC / 4 Ref Frames
Format settings, CABAC : Yes
Format settings, ReFrames : 4 frames
Codec ID : 27
Duration : 3 h 17 min
Bit rate mode : Variable
Maximum bit rate : 38.0 Mb/s
Width : 1 920 pixels
Height : 1 080 pixels
Display aspect ratio : 16:9
Frame rate : 23.976 (24000/1001) FPS
Color space : YUV
Chroma subsampling : 4:2:0
Bit depth : 8 bits
Scan type : Progressive


The second run through without MDegrain2 shows no random frames at least at first glance as I looked at a couple dozen minute mark locations where the randomness occurred before.

The decoder was LSmash.
#VideoSource
LoadPlugin("C:\Program Files\RipBot264\Tools\AviSynth plugins\lsmash\LSMASHSource.dll")

I'm encoding to x265.

[Ryushin]

I looked at a 4K and HD encode I did with MDegrain2 and at first glance, it seems fine.

I typed this wrong. I did a 4K and HD (Godzilla: King of the Monsters) WITHOUT MDegrain and at first glance, it seems fine.

[Atak_Snajpera]

From the m2ts source:
Video
ID : 4113 (0x1011)
Menu ID : 1 (0x1)
Format : AVC
Format/Info : Advanced Video Codec
Format profile : High@L4.1
Format settings : CABAC / 4 Ref Frames
Format settings, CABAC : Yes
Format settings, ReFrames : 4 frames
Codec ID : 27
Duration : 3 h 17 min
Bit rate mode : Variable
Maximum bit rate : 38.0 Mb/s
Width : 1 920 pixels
Height : 1 080 pixels
Display aspect ratio : 16:9
Frame rate : 23.976 (24000/1001) FPS
Color space : YUV
Chroma subsampling : 4:2:0
Bit depth : 8 bits
Scan type : Progressive


The second run through without MDegrain2 shows no random frames at least at first glance as I looked at a couple dozen minute mark locations where the randomness occurred before.

The decoder was LSmash.
#VideoSource
LoadPlugin("C:\Program Files\RipBot264\Tools\AviSynth plugins\lsmash\LSMASHSource.dll")

I'm encoding to x265.

Change default decoders like in this screenshot
https://i.imgsafe.org/91/91d45bdc49.png

[kempodragon]

I've finally found out why the encoding client couldn't find the index file it was looking for. First, I went back to v 1.24 to confirm my test files hadn't got corrupted since I had already encoded them before with it. Everything worked smoothly and that when I noticed the message "Indexing file, please wait" right after demuxing. I then was able to encode with no problems. Afterwards, I upgraded to 1.25.0, and retested. The message never appeared, only "Gathering information, please wait". Task manager showed ffprobe.exe running. When I tried to run the encoding client, the missing index file message appeared again. I then opened the job folder and spotted IndexStreams.cmd . Running it created the missing index file. For some reason, Ripbot is skipping creating an index file, even when the decoder is set to ffms.

I found another bug in the encoding client. In 1.24, I had 4 servers created in the settings tab and it activated and ran all of them with no problems. In the newest version, I had to manually activate and connect each server. On the plus side, Atak's code improvement actually dropped the cpu usage down to where I could activate a 5th server on my Threadripper. :D

For the record, my first test file is a game capture with UtVideo as the video codec,1080p60 and PCM as audio. My second file is from my camcorder, with 1080p60 and Dolby 5.1 audio.

[Ryushin]

Hi Atak,

So I've been assuming something and it came back to bit me and I'm wondering if it is by design or not.

So I make 720p versions of all my 4K/HD sources to store on mobile devices and for streaming. So I normally I just select the "HD Ready 1280x720" option creating the small version. The behavior I just noticed is that it will add borders to make it 16x9 when I have a video that is already cropped.

When I first started doing this, I don't remember it behaving in this way. I thought it was the 1280 or the 720 to scale the video to it's longest dimension. I.e. 2.4:1 - 1920x960 becomes 1280x640 and 4:3 - 1440x1080 becomes 960x720.

Now to get the behavior I want, I have to select Custom [X,XX:1]. It's easier If I select HD Ready first and then select Custom so I don't need to type in the dimension.

Can a option be added to not add borders when resizing video?

[Atak_Snajpera]

use Custom preset with aspect ratio in brackets (for example Custom [2,40:1])

[Ryushin]

use Custom preset with aspect ratio in brackets (for example Custom [2,40:1])

That will only work on sources that are exactly that aspect ratio. I was looking for a more general solution that I can just select HD Ready and it will scale the video appropriately without adding borders that were not there before.

[Pino72]

Change default decoders like in this screenshot
https://i.imgsafe.org/91/91d45bdc49.png

Setting FFMS2 option for HEVC solved all my problems I had when using LSMASH! Thanks Atak for making this available so easily.

[stryker412]

Atak, quick question. I purchased a BD of the old Scooby Doo series. I tried to make h265 encodes of the first disc. I normally don't do h265 because my computer is older and takes forever, but these are short episodes so I thought I'd try. I get the following error on each episode.

D:\>"D:\Tools\RipBot264v1.22.0\tools\mkvtoolnix\mkvmerge.exe" -o "D:\S01E02.mkv" --compression 0:none --title "S01E02" --default-duration 0:24000/1001fps "D:\Temp\RipBot264temp\video.265" --chapters "D:\Temp\RipBot264temp\job2\chapters.txt"
mkvmerge v35.0.0 ('All The Love In The World') 64-bit
Error: Unknown chapter file format in 'D:\Temp\RipBot264temp\job2\chapters.txt'. It does not contain a supported chapter format.

These are direct rips from the BD using MakeMKV. I've never once had an issue with that software. Any idea why RipBot doesn't like it? I'm on v1.25.

Edit: I just noticed too that there's no audio picked up in RipBot, even though the file has a stereo track. Could this be another 1.25 bug?

[Atak_Snajpera]

Have you checked that chapters.txt file?

[stryker412]

Yes

Error: (mkvextract) This file could not be opened or parsed.


Here is the Mediainfo for this file.

Format : Matroska
Format version : Version 2
File size : 1.67 GiB
Duration : 22 min 15 s
Overall bit rate mode : Variable
Overall bit rate : 10.8 Mb/s
Movie name : Scooby-Doo™, Where Are You! Disc 1
Encoded date : UTC 2019-09-06 22:15:49
Writing application : MakeMKV v1.14.4 win(x64-release)
Writing library : libmakemkv v1.14.4 (1.3.5/1.4.7) win(x64-release)

Video
ID : 1
ID in the original source medium : 4113 (0x1011)
Format : AVC
Format/Info : Advanced Video Codec
Format profile : High@L4.1
Format settings : CABAC / 4 Ref Frames
Format settings, CABAC : Yes
Format settings, RefFrames : 4 frames
Format settings, GOP : M=1, N=12
Codec ID : V_MPEG4/ISO/AVC
Duration : 22 min 15 s
Bit rate mode : Variable
Bit rate : 10.6 Mb/s
Maximum bit rate : 11.0 Mb/s
Width : 1 920 pixels
Height : 1 080 pixels
Display aspect ratio : 16:9
Frame rate mode : Constant
Frame rate : 23.976 (24000/1001) FPS
Color space : YUV
Chroma subsampling : 4:2:0
Bit depth : 8 bits
Scan type : Progressive
Bits/(Pixel*Frame) : 0.212
Stream size : 1.64 GiB (98%)
Language : English
Default : No
Forced : No
Original source medium : Blu-ray

Audio
ID : 2
ID in the original source medium : 4352 (0x1100)
Format : AC-3
Format/Info : Audio Coding 3
Codec ID : A_AC3
Duration : 22 min 15 s
Bit rate mode : Constant
Bit rate : 192 kb/s
Channel(s) : 2 channels
Channel positions : Front: L R
Sampling rate : 48.0 kHz
Frame rate : 31.250 FPS (1536 SPF)
Bit depth : 16 bits
Compression mode : Lossy
Stream size : 30.6 MiB (2%)
Title : Stereo
Language : English
Service kind : Complete Main
Default : Yes
Forced : No
Original source medium : Blu-ray

Menu
00:00:00.000 : en:Chapter 01
00:01:05.857 : en:Chapter 02
00:06:28.513 : en:Chapter 03
00:10:51.275 : en:Chapter 04
00:16:01.669 : en:Chapter 05
00:21:07.140 : en:Chapter 06

[slalom]

LSMASH did great today on mpeg2. No delays

[lemaireus]

Here is a copy of the error log I got:


E:\>"C:\Program Files (x86)\RipBot264\Tools\ffmpeg\bin\ffmpeg.exe" -loglevel panic -i "E:\Temp\RipBot264temp\job9\job9.avs" -strict -1 -f yuv4mpegpipe - | "C:\Program Files (x86)\RipBot264\tools\x265\x265_x64.exe" --colorprim bt709 --transfer bt709 --colormatrix bt709 --pass 1 --bitrate 2320 --stats "E:\Temp\RipBot264temp\job9\job9.stats" --fps 24000/1001 --min-keyint 24 --keyint 240 --frames 172056 --sar 1:1 --profile main10 --output-depth 10 --ctu 32 --no-slow-firstpass --y4m --output NUL -
y4m [info]: 1920x800 fps 24000/1001 i420p8 sar 1:1 unknown frame count
raw [info]: output file: NUL
x265 [info]: HEVC encoder version 3.1+14-f08461fdae33
x265 [info]: build info [Windows][MSVC 1900][64 bit] 10bit+8bit
x265 [info]: using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX
x265 [info]: Main 10 profile, Level-4 (Main tier)
x265 [info]: Thread pool created using 4 threads
x265 [info]: Slices : 1
x265 [info]: frame threads / pool features : 2 / wpp(25 rows)
x265 [info]: Coding QT: max CU size, min CU size : 32 / 8
x265 [info]: Residual QT: max TU size, max depth : 32 / 1 inter / 1 intra
x265 [info]: ME / range / subpel / merge : dia / 57 / 2 / 1
x265 [info]: Keyframe min / max / scenecut / bias: 24 / 240 / 40 / 5.00
x265 [info]: Lookahead / bframes / badapt : 20 / 4 / 2
x265 [info]: b-pyramid / weightp / weightb : 1 / 1 / 0
x265 [info]: References / ref-limit cu / depth : 1 / off / on
x265 [info]: AQ: mode / str / qg-size / cu-tree : 2 / 1.0 / 32 / 1
x265 [info]: Rate Control / qCompress : ABR-2320 kbps / 0.60
x265 [info]: tools: rd=2 psy-rd=2.00 early-skip rskip signhide tmvp b-intra
x265 [info]: tools: fast-intra strong-intra-smoothing lslices=5 deblock sao
x265 [info]: tools: stats-write

x265 [info]: frame I: 2080, Avg QP:20.15 kb/s: 14026.26
x265 [info]: frame P: 39753, Avg QP:21.44 kb/s: 4995.98
x265 [info]: frame B: 130223, Avg QP:25.09 kb/s: 1219.70
x265 [info]: Weighted P-Frames: Y:7.9% UV:6.7%
x265 [info]: consecutive B-frames: 9.2% 4.1% 6.6% 26.3% 53.8%

encoded 172056 frames in 18344.01s (9.38 fps), 2247.02 kb/s, Avg QP:24.18

E:\>"C:\Program Files (x86)\RipBot264\Tools\ffmpeg\bin\ffmpeg.exe" -loglevel panic -i "E:\Temp\RipBot264temp\job9\job9.avs" -strict -1 -f yuv4mpegpipe - | "C:\Program Files (x86)\RipBot264\tools\x265\x265_x64.exe" --colorprim bt709 --transfer bt709 --colormatrix bt709 --pass 2 --bitrate 2320 --stats "E:\Temp\RipBot264temp\job9\job9.stats" --fps 24000/1001 --min-keyint 24 --keyint 240 --frames 172056 --sar 1:1 --profile main10 --output-depth 10 --ctu 32 --y4m --output "E:\Temp\RipBot264temp\video.265" -
y4m [info]: 1920x800 fps 24000/1001 i420p8 sar 1:1 unknown frame count
raw [info]: output file: E:\Temp\RipBot264temp\video.265
x265 [info]: HEVC encoder version 3.1+14-f08461fdae33
x265 [info]: build info [Windows][MSVC 1900][64 bit] 10bit+8bit
x265 [info]: using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX
x265 [info]: Main 10 profile, Level-4 (Main tier)
x265 [info]: Thread pool created using 4 threads
x265 [info]: Slices : 1
x265 [info]: frame threads / pool features : 2 / wpp(25 rows)
x265 [info]: Coding QT: max CU size, min CU size : 32 / 8
x265 [info]: Residual QT: max TU size, max depth : 32 / 1 inter / 1 intra
x265 [info]: ME / range / subpel / merge : hex / 57 / 2 / 3
x265 [info]: Keyframe min / max / scenecut / bias: 24 / 240 / 40 / 5.00
x265 [info]: Lookahead / bframes / badapt : 20 / 4 / 2
x265 [info]: b-pyramid / weightp / weightb : 1 / 1 / 0
x265 [info]: References / ref-limit cu / depth : 3 / off / on
x265 [info]: AQ: mode / str / qg-size / cu-tree : 2 / 1.0 / 32 / 1
x265 [info]: Rate Control / qCompress : ABR-2320 kbps / 0.60
x265 [info]: tools: rd=3 psy-rd=2.00 early-skip rskip signhide tmvp b-intra
x265 [info]: tools: strong-intra-smoothing lslices=5 deblock sao stats-read

x265 [info]: frame I: 2080, Avg QP:19.54 kb/s: 16468.27
x265 [info]: frame P: 39753, Avg QP:22.03 kb/s: 5039.21
x265 [info]: frame B: 130223, Avg QP:25.85 kb/s: 1261.56
x265 [info]: Weighted P-Frames: Y:4.3% UV:3.6%
x265 [info]: consecutive B-frames: 9.2% 4.1% 6.6% 26.3% 53.8%

encoded 172056 frames in 19715.15s (8.73 fps), 2318.21 kb/s, Avg QP:24.89

E:\>"C:\Program Files (x86)\RipBot264\tools\mkvtoolnix\mkvmerge.exe" -o "E:\New Rips\Ripbot\Olympus Has Fallen.mkv" --compression 0:none --title "Olympus Has Fallen" --default-duration 0:24000/1001fps "E:\Temp\RipBot264temp\video.265" --compression 0:none --language 0:eng "E:\Temp\RipBot264temp\job9\Encoded_Audio_1.ac3" --default-track 0:yes --forced-track 0:yes --language 0:eng -s 0 -D -A "E:\Temp\RipBot264temp\job9\6_subtitles_English_FORCED_1080.sup" --default-track 0:no --language 0:eng -s 0 -D -A "E:\Temp\RipBot264temp\job9\6_subtitles_English_1080.sup" --chapters "E:\Temp\RipBot264temp\job9\chapters.txt" --attachment-mime-type image/jpeg --attachment-description Cover --attachment-name Cover --attach-file "E:\Temp\RipBot264temp\job9\cover.jpg"
mkvmerge v37.0.0 ('Leave It') 64-bit
Error: The file 'E:\Temp\RipBot264temp\job9\Encoded_Audio_1.ac3' could not be opened for reading: open file error.
-------------------------

Elapsed Time: 10h:34m:44s

[lemaireus]

I have already copied the error log above, at the bottom of page 865.

I encode into x265, two passes, and always encode multichannel lossless master audio tracks into 640k AC3.

It's very frustrating getting that kind of an error at the end of 10:34 hours of work. This is the third file on which I am getting that error. Apparently the audio encoder does not encode DTS-MA track into AC3, which is why mkvmerge cannot find that track. Yes, I have checked the job folder each time, and there has never been an 'Encoded_Audio_1.ac3' file in the folder each time I get this error.

If Ripbot had not immediately deleted the encoded video, then I would have encoded and muxed the audio track myself in cases of such errors.

Atak, would you please consider that option: leave the encoded video intact in the job folder, and delete that only when all the temporary files are deleted? Such a simple option can save hours and hours of work going to waste in case of an error such as the one I posted above, and also in cases where the error is 'video.265 could not be opened.' (I used to get that sometimes in the past, not anymore).

Please leave the encoded video intact in the job folder for the file being encoded, for a user to delete as and when they please.

[slalom]

If Ripbot had not immediately deleted the encoded video, then I would have encoded and muxed the audio track myself in cases of such errors.
Run CombineAllChunks.cmd in chunks folder to get the video

[stryker412]

I posted my error log on the previous page too. Not sure why all the sudden I'm getting no audio and the chapters cannot be read.

[slalom]

Download the file from the first page and update that
That's what I do when I have trouble. Replace your files except .ini's

[GZZ]

Cosmetic Change. Can the text in the DE window be breaked into 2 lines or can the window be enlarged. As some of the text is truncated until I resize the column on every DE start.

https://imgur.com/YMFB3tb

[lemaireus]

Run CombineAllChunks.cmd in chunks folder to get the video

Thank you, Slalom. The question for a relative novice with cmd is 'how'?

May I assume that by 'chunks folder' you mean the job folder, thus, for example, 'job1'? How to I run 'CombineAllChunks.cmd' in that folder. A run down in three to four steps will be very helpful, and much appreciated.

Thanks a lot for what I hope will soon become a working suggestion.

[stryker412]

Atak, any suggestions?

https://forum.doom9.org/showthread.php?p=1884279#post1884279

[Atak_Snajpera]

Atak, any suggestions?

https://forum.doom9.org/showthread.php?p=1884279#post1884279

https://forum.doom9.org/showthread.php?p=1884278#post1884278

[lemaireus]

Run CombineAllChunks.cmd in chunks folder to get the video

Slalom, I did a bit of work on your suggestion, and there is an issue. I think you are working with the assumption that I am using distributed encoding. I am not. I am encoding my video on the one machine I have.

Atak, would you please consider the option of leaving the encoded video intact in the job folder, and delete that only when all the temporary files are deliberately deleted by a user? Such a simple option can save hours and hours of work from going to waste in case of an audio or video muxing error (Encoded_Audio_1.ac3 cannot be opened, or video.265 cannot be opened).

Here are references back to my previous two posts on the issue, with the first showing the error log:
https://forum.doom9.org/showthread.php?p=1884332#post1884332
https://forum.doom9.org/showthread.php?p=1884333#post1884333

[slalom]

Slalom, I did a bit of work on your suggestion, and there is an issue. I think you are working with the assumption that I am using distributed encoding. I am not. I am encoding my video on the one machine I have.
Actually, yes I was :o

[stryker412]

https://forum.doom9.org/showthread.php?p=1884278#post1884278


Yes the contents of that file were in my post.

[GZZ]

I see FFMS2 Video decoder is default. What is the difference and benefits from one another FFMS2 vs. LSMASH ?

[lemaireus]

This is becoming routine, and therefore very, very frustrating. Got the error once again today; each time I have to encode DTS/DTS-MA audio into AC3, at the end of a two-pass encode I get the message:

Error: The file 'E:\Temp\RipBot264temp\job2\Encoded_Audio_1.ac3' could not be opened for reading: open file error.

I can copy the entire log file, if you like.

Atak, the solution I have suggested is really a straightforward one, even if it takes time writing some fresh code, but it will save a lot of people a lot of frustration if they could simply pick up the encoded video and mux is manually in case of these errors, rather than having to do the entire encode from scratch.

Please allow Ripbot to leave the encoded video in the job folder, till a user deletes that job folder manually. That is all it will take to save hours and hours of encoding from being flushed down the drain.

Keeping my fingers crossed for a positive response from you.

[byteshare]

I see FFMS2 Video decoder is default. What is the difference and benefits from one another FFMS2 vs. LSMASH ?
LSMASH is the newer one added to RipBot, so if you never had any issues with FFMS2 I'd use that, but LSMASH works differently so that if you have issues with frame accuracy on a source such as MPEG2 then use that one.

This is becoming routine, and therefore very, very frustrating. Got the error once again today; each time I have to encode DTS/DTS-MA audio into AC3, at the end of a two-pass encode I get the message:

Error: The file 'E:\Temp\RipBot264temp\job2\Encoded_Audio_1.ac3' could not be opened for reading: open file error.

I can copy the entire log file, if you like.

Atak, the solution I have suggested is really a straightforward one, even if it takes time writing some fresh code, but it will save a lot of people a lot of frustration if they could simply pick up the encoded video and mux is manually in case of these errors, rather than having to do the entire encode from scratch.

Please allow Ripbot to leave the encoded video in the job folder, till a user deletes that job folder manually. That is all it will take to save hours and hours of encoding from being flushed down the drain.

Keeping my fingers crossed for a positive response from you.
Have you posted a sample of the source here?
Does it happen consistently on the same source, aka if you ran a sample that had an issue again and again does it happen each time?

[lemaireus]

LSMASH is the newer one added to RipBot, so if you never had any issues with FFMS2 I'd use that, but LSMASH works differently so that if you have issues with frame accuracy on a source such as MPEG2 then use that one.

Have you posted a sample of the source here?
Does it happen consistently on the same source, aka if you ran a sample that had an issue again and again does it happen each time?

The fist section of the reply was to GZZ, but in my case, I never had problems of the kind I do before the move to LSMASH. Frame accuracy was never an issue with me. My sources are usually BD/BDRemuxes and never did I ever have a problem with FFMS2 in any audio conversions.

The issue has been coming up since the move to LSMASH. I have had the error thrice since that shift, with three difference sources. Common to these three sources was a DTS audio track: lossless DTS-MA tracks in two sources, and 1504k DTS track in the third source. I haven't yet tried converting .thd audio. Will give that a run through and post an update.

I shall do a thorough test tomorrow of samples with three different kinds of audios: DTS-MA, DTS, and TrueHD. Shall post the results after that, and will upload a sample in case that is necessary for analysis.

More tomorrow. Desperately looking for a solution to this because the problem is intensely frustrating: it ruins the encode right at the end of two passes, when it's time to mux the audio-video streams.

[stryker412]

Ripbot (newest version) is not picking up the audio track or the chapter files in my latest TV show rip. The tracks are indeed there as listed in MediaInfo and using VLC. Anyone else seeing this?

[GZZ]

The fist section of the reply was to GZZ, but in my case, I never had problems of the kind I do before the move to LSMASH. Frame accuracy was never an issue with me. My sources are usually BD/BDRemuxes and never did I ever have a problem with FFMS2 in any audio conversions.


Thanks for the explanation, though there was some extra decoding speed hidden in LSMASH, but if it just an alternative to those who have frame accuracy issue, then I leave it a FFMS2 as it has worked fine so far.

[sneaker_ger]

You will always find samples that make problems in L-SMASH but work fine in ffms2 and vice versa. You can't win.

[duffbeer]

99.9% of the time FFMS2 works perfectly. LSMASH has caused massive problems.

[Atak_Snajpera]

99.9% of the time FFMS2 works perfectly. LSMASH has caused massive problems.

Ffms2 is more broken than i thought. Latest version of lsmash
(Not included in ripbot) fixed vc1 decoding and that random skips in avc and hevc. Just test your files in my tool seektester to see what i mean.

[lemaireus]

Update regarding the following posts:

https://forum.doom9.org/showthread.php?p=1884332#post1884332
https://forum.doom9.org/showthread.php?p=1884333#post1884333
https://forum.doom9.org/showthread.php?p=1884690#post1884690
https://forum.doom9.org/showthread.php?p=1884700#post1884700

I ran the tests and here are the results: every encode that involved audio encoding on a setting other than 'copy stream' failed. None of the job folders of the encodes which gave the error contained the new encoded audio file which should have been there. The inference was obvious: that EAC3 wasn't kicking in at the start of the encoding process because, most likely, the file with the command line code meant to start EAC3 might have become corrupted.

Once the problem was diagnosed, it was the small matter of testing a solution. I downloaded a fresh copy of Ripbot, updated it, and ran the test encodes again, and everything is now working fine.

Essentially, I went through all the frustration I did because of the corruption of the file with the command line that was meant to start EAC3 for encoding audio, and which stopped working at some stage.

Thank you very much for your suggestions, and I'll keep my fingers crossed that the encodes proceed smoothly hereafter.

[byteshare]

Ffms2 is more broken than i thought. Latest version of lsmash
(Not included in ripbot) fixed vc1 decoding and that random skips in avc and hevc. Just test your files in my tool seektester to see what i mean.
I'd be willing to try LSmash again once the new version is added to RB, if it fixed the seek/frame issues that were happening before.
How is FFMS2 broken? I'm not seeing issues with it at the moment.

[Atak_Snajpera]

I'd be willing to try LSmash again once the new version is added to RB, if it fixed the seek/frame issues that were happening before.
How is FFMS2 broken? I'm not seeing issues with it at the moment.

https://forum.doom9.org/showthread.php?p=1884507#post1884507

[stryker412]

Tried a number of different things such as older versions of RipBot, manually updating eac3to/mkvtoolnix/etc. Nothing has worked. Been using RipBot for years and now it won't load any audio tracks from this rip. Of all things... It's the recent Scooby Doo BD release. The audio tracks are there (they play fine in VLC). At a loss here.

[cypher007]

hello, awesome program been using it for years.

but I have one feature request. if I have an MKV with a DTS-MA sound track I would like to be able to recode it with just DTS core. I can do this with a pure blu ray using ripbot as it will let me select core. but it seems I have no options like this when dealing with MKV's.

[slalom]

Use tsMuxer to get the core

Once the problem was diagnosed, it was the small matter of testing a solution. I downloaded a fresh copy of Ripbot, updated it, and ran the test encodes again, and everything is now working fine.

Essentially, I went through all the frustration I did because of the corruption of the file with the command line that was meant to start EAC3 for encoding audio, and which stopped working at some stage.

Thank you very much for your suggestions, and I'll keep my fingers crossed that the encodes proceed smoothly hereafter.
Told you! :D

[Viper714]

So, I just finished encoding a 4K movie, The Mummy 3" and it took 6 hours and 40 minutes to encode in x265. Should I do 264 instead. That is way to looong with four machines running in DE. I can normally do 1080 blu rays in x264 in about 45-60 minutes. I just encode video and do a copy stream on audio. What is the best setting for encoding 4K movies? Any suggestions are helpful...

Below is a sample of my conversion times. Disregard the Aquaman times it was a test only.
https://i.imgur.com/DpV4AFR.png

[Atak_Snajpera]

There is no best settings ... 4x pixels to encode plus x265 Has to take a long time.

[stryker412]

Atak, I downloaded Staxrip and was able to load up the source files without problem. Any idea why Ripbot cannot pull up the audio or chapters for these?

https://forum.doom9.org/showpost.php?p=1884279&postcount=17298
https://forum.doom9.org/showpost.php?p=1884823&postcount=17324

[Atak_Snajpera]

Maybe filename Has some non standard (unicode)characters.

[byteshare]

Maybe filename Has some non standard (unicode)characters.
Yeah, I setup a regex batch (antRenamer) to strip those from my files before I add them to RipBot.

[emmaurilio]

Hi all!

I´m having some problems with encoding with RipBot1.21 and above. I tried to find a topic about this problem without success. The solution may be quite simple, but I don't know a lot about the details of the encoder plugins. That´s why I ask your help.

The files bellow will show better what is happening, but in short the final file had a green frame added after each normal frame of the original video.

https://www.dropbox.com/sh/a2eu6dlanqr2plh/AAD3TpZg-Xls2EkTlwcFVxY_a?dl=0

The encoding is working well until version 1.20. I suspect that the problem is occurring with the AviSynth.

Can someone help me?

[Atak_Snajpera]

Hi all!

I´m having some problems with encoding with RipBot1.21 and above. I tried to find a topic about this problem without success. The solution may be quite simple, but I don't know a lot about the details of the encoder plugins. That´s why I ask your help.

The files bellow will show better what is happening, but in short the final file had a green frame added after each normal frame of the original video.

https://www.dropbox.com/sh/a2eu6dlanqr2plh/AAD3TpZg-Xls2EkTlwcFVxY_a?dl=0

The encoding is working well until version 1.20. I suspect that the problem is occurring with the AviSynth.

Can someone help me?

Will be fixed in next auto update. Be patient.

Temporary hack -> rename .mpg to .ts

[emmaurilio]

Will be fixed in next auto update. Be patient.

Temporary hack -> rename .mpg to .ts


Thanks for the answer!

I'm patient :) , but just to understand how it works... is there a prediction or even vague idea of the timing of this next update? I am using version 1.20, so I disabled autoupdate and because that I will not know when it occurs. :/

Thanks.

[emmaurilio]

Will be fixed in next auto update. Be patient.

Temporary hack -> rename .mpg to .ts


It works!!! Thanks!

[POTI]

I have an odd one. It just started happening yesterday. I am running win 10 all up to date. I started getting this error.
AVC Import results: 159138 samples (481657 NALUs) - Slices: 1460 I 53052 P 104626 B - 160553 SEI - 1414 IDR
Stream uses forward prediction - stream CTS offset: 2 frames
Opening file C:\Temp\RipBot264temp\job1\Encoded_Audio_1.aac failed
Error importing C:\Temp\RipBot264temp\job1\Encoded_Audio_1.aac:lang=und: Requested URL is not valid or cannot be found

I checked to make sure that the temp folder is shared and it is. The Encoded_Audio_1.aac is missing. I can go in and play the job and it all appears and sounds ok. Anything else you need from me to look into this? Happening on multiple encodes.

[ReinerSchweinlin]

I noticed machines running WIn10 slow down encoding when headless left alone. As soon as I log into them with Remote Desktop, the pace steps up. If I manually set the priority of ffmpeg/x265 to "above normal" - I get full usage of CPU - until the next chunk and it all slows down again.
Win7 machines in my swarm don't show this behaviour.
The win10 Machines are already cleaned from most background processes.

I tried setting "priority above normal" in the server settings, but this doesn´t seem to change anything.

Any advice?

[byteshare]

I noticed machines running WIn10 slow down encoding when headless left alone. As soon as I log into them with Remote Desktop, the pace steps up. If I manually set the priority of ffmpeg/x265 to "above normal" - I get full usage of CPU - until the next chunk and it all slows down again.
Win7 machines in my swarm don't show this behaviour.
The win10 Machines are already cleaned from most background processes.

I tried setting "priority above normal" in the server settings, but this doesn´t seem to change anything.

Any advice?
Leave them logged in? I just leave mine logged in (not locked) and don't see an issue with the CPU like that.

[Atak_Snajpera]

I noticed machines running WIn10 slow down encoding when headless left alone. As soon as I log into them with Remote Desktop, the pace steps up. If I manually set the priority of ffmpeg/x265 to "above normal" - I get full usage of CPU - until the next chunk and it all slows down again.
Win7 machines in my swarm don't show this behaviour.
The win10 Machines are already cleaned from most background processes.

I tried setting "priority above normal" in the server settings, but this doesn´t seem to change anything.

Any advice?

Maybe it is some power saving strategy in win10? I can't help here because I'm using only win7.
https://www.thewindowsclub.com/power-throttling-windows-10

[ReinerSchweinlin]

Thanx to both of you for replying.
@byteshare
I can´t leave all of them logged in, so this sadly is no option for me.
@Atak
Would it be possible to implement "priority above normal" for the startup of the servers`?

[Atak_Snajpera]

Just use Process Hacker and save process priority for ffmpeg.exe and x264.exe/x265.exe
https://i.imgsafe.org/9f/9f77c38193.png

[silentstrife]

Hello,

I am a long time user/reader, first time poster. Great program, have been using it for a very long time. I just got the recent update and after processing a movie, I have no video, just a cover picture, and audio only. I have tried using both of the 2 new encoders and set them across the board for the options. Has any one had this happen or reported yet? I haven't seen anything in the last few pages.

Also, when i tried to use DE, it failed on all of my video conversion attempts. Unfortunately i didn't screen shot or see any error logs to provide.

Error Log:
D:\>"D:\Blu Ray Tools\RipBot264v1.24.0\EncodingClient.exe" "D:\Temp\RipBot264temp\job1\job1_EncodingClient.meta"

D:\>"D:\Blu Ray Tools\RipBot264v1.24.0\tools\mkvtoolnix\mkvmerge.exe" -o "D:\video.mkv" --compression 0:none --title "video" --default-duration 0:24000/1001fps "D:\Temp\RipBot264temp\video.265" --compression 0:none --language 0:eng --aac-is-sbr 0:0 "D:\Temp\RipBot264temp\job1\Encoded_Audio_1.aac" --chapters "D:\Temp\RipBot264temp\job1\chapters.txt"
mkvmerge v37.0.0 ('Leave It') 64-bit
Error: The file 'D:\Temp\RipBot264temp\video.265' could not be opened for reading: open file error.
-------------------------

Elapsed Time: 02h:58m:03s

Manually combine the chuncks, ran Job1_MuxFiles.bat, found output video at expected location, opened to find no video at all but has audio.

RB Ssettings:
MPEG-2 and Other set to LSMASH, the others are set to FFMS2.

[Atak_Snajpera]

Try again with new fresh job .

[ReinerSchweinlin]

Hey Atak,

thank you for the suggestion, didn´t know that process hacker can do that. A first quick try didn´t help though. Still dropping CPU Usage when left alone.. For some reason I cannot change the power scheme permanently, Windows always reverts it after a few hours. Seems to be a standard behaviour, since I discovered this on several WIN10 machines which are completely different (win64/32/home/pro/etc, different CPUs..). I will have to do more investigation on this.

[Atak_Snajpera]

I hope you left process hacker running in background because otherwise those processes will run with standard normal priority.

[silentstrife]

Try again with new fresh job .

Hi Atk,

Yes that was a fresh job. The only thing i know happened was the update from version 1.24 to 1.25. I might just go back to 1.24 and disable the auto-update. If you can think of any info i can provide to help fix this issue please let me know.

RB Job Settings - Profile - MA10 X.X 10 bit progressive HEVC, CQ 20, Denoise - MDegrain2 + KNLMeansCL, audio 2.0

Basic System info:
Windows 10 Pro V.1903
CPU - i7-5960x
RAM - 32GB
GFX - RTX 2070

[LigH]

@ReinerSchweinlin: Microsoft SysInternals' "ProcessExplorer" can do that too. It is my default Task Manager now.

[Atak_Snajpera]

Hi Atk,

Yes that was a fresh job. The only thing i know happened was the update from version 1.24 to 1.25. I might just go back to 1.24 and disable the auto-update. If you can think of any info i can provide to help fix this issue please let me know.

RB Job Settings - Profile - MA10 X.X 10 bit progressive HEVC, CQ 20, Denoise - MDegrain2 + KNLMeansCL, audio 2.0

Basic System info:
Windows 10 Pro V.1903
CPU - i7-5960x
RAM - 32GB
GFX - RTX 2070

Compress whole job folder (without big files like video.mkv or audio files) and send IT to me. I will take a look...

[ReinerSchweinlin]

I hope you left process hacker running in background because otherwise those processes will run with standard normal priority.

Of course
@LigH
Thanx for the info.

[Atak_Snajpera]

Of course
@LigH
Thanx for the info.

Have you verified that process in fact gets higher priority?

[silentstrife]

Compress whole job folder (without big files like video.mkv or audio files) and send IT to me. I will take a look...

Sorry to have troubled you. I re-installed my codec pack and that seems to have fixed what ever was causing my issue.

Have a good day.

[byteshare]

New x265 3.2
https://bitbucket.org/multicoreware/x265/raw/353572437201d551381002aebf20d244bd49ef17/doc/reST/releasenotes.rst
Version 3.2
===========

Release date - 25th September, 2019.

New features
------------
1. 3-level hierarchical motion estimation using :option:`--hme` and :option:`--hme-search`.
2. New AQ mode (:option:`--aq-mode` 4) with variance and edge information.
3. :option:`selective-sao` to selectively enable SAO at slice level.

Enhancements to existing features
---------------------------------
1. New implementation of :option:`--refine-mv` with 3 refinement levels.

Encoder enhancements
--------------------
1. Improved quality in the frames following dark scenes in ABR mode.

API changes
-----------
1. Additions to x265_param structure to support the newly added features :option:`--hme`, :option:`--hme-search` and :option:`selective-sao`.

Bug fixes
---------
1. Fixed encoder crash with :option:`--zonefile` during failures in encoder_open().
2. Fixed JSON11 build errors with HDR10+ on MacOS high sierra.
3. Signalling out of range scaling list data fixed.
4. Inconsistent output fix for 2-pass rate-control with cutree ON.

Known issues
------------
1. Build dependency on changeset cf37911 of SVT-HEVC.
Update: Thank you for updating RB!

[byteshare]

I have been having some slowness issues when doing any filters with my GPU, such as KNLmeans.
Looking at Process Explorer a bit more I realized that FFMpeg didn't show any GPU usage (GPU, GPU System Bytes, GPU Dedicated Bytes, GPU Committed Bytes)
If I run the RipBot script in AVSPmod I do see GPU System Bytes, GPU Dedicated Bytes, and GPU Committed Bytes showing usage.
The AVS Meter also behaves strangely, where the text fields go over the line and I have to scroll down to see all of the data.
The script runs in RipBot (just using the Adaptive KNLMeansCL in RipBot to test with) and a job will complete. The output looks like I expect just very slow to get it.
When running a job using KNLmeans I can't get a lot of CPU usage because my guess is the decoder (FFMpeg) can't supply enough to process). If I use a non-GPU filter the CPU can basically max out. Using non-DE mode at the moment.
Any ideas what is happening?

[Atak_Snajpera]

I have been having some slowness issues when doing any filters with my GPU, such as KNLmeans.
Looking at Process Explorer a bit more I realized that FFMpeg didn't show any GPU usage (GPU, GPU System Bytes, GPU Dedicated Bytes, GPU Committed Bytes)
If I run the RipBot script in AVSPmod I do see GPU System Bytes, GPU Dedicated Bytes, and GPU Committed Bytes showing usage.
The AVS Meter also behaves strangely, where the text fields go over the line and I have to scroll down to see all of the data.
The script runs in RipBot (just using the Adaptive KNLMeansCL in RipBot to test with) and a job will complete. The output looks like I expect just very slow to get it.
When running a job using KNLmeans I can't get a lot of CPU usage because my guess is the decoder (FFMpeg) can't supply enough to process). If I use a non-GPU filter the CPU can basically max out. Using non-DE mode at the moment.
Any ideas what is happening?
Run Process Explorer as Administrator to see GPU usage on ffmpeg.exe. You most likely have bottleneck on GPU. KNLMeansCL is extremely intensive even for most modern GPUs.

[byteshare]

Run Process Explorer as Administrator to see GPU usage on ffmpeg.exe. You most likely have bottleneck on GPU. KNLMeansCL is extremely intensive even for most modern GPUs.
Running it as Admin does show the bytes used.
Hmmm...now to figure out why I'm getting ~1-2FPS with a Geforce 980 and Ryzen 1700. I get without the GPU filter ~20FPS with the same x265 settings. I'm using about 1.7GB of GPU memory (of 4GB) from FFMpeg but the GPU core load (using Open Hardware Monitor) bounces between 0-13%.
I've been working "around" it by using other encoders to use more CPU on sources that don't need filters. I would use DE mode but the second server usually never starts.
I don't have an older version of RB to try, I think 1.23 but up to some point in 1.24 before something was changed. Is the one linked on the first page the first version of 1.24? I recall getting 8-12FPS with the same settings, granted different sources, but getting 1-2FPS on several sources with the most recent version of RBk./.
I'll try updating my drivers for now. update: didn't seem to make a different. I also changed the following to no avail: my power profile to high performance and same for the Nvidia Control Panel "Power management mode" to "Perfer maximum performance".

[Atak_Snajpera]

How many FPS do you get in avsmeter with only knlmeans enabled? 2fps on 1920x1080 is indeed very slow. I also get 2fps but on GeForce 710 (99% gpu usage)

[byteshare]

How many FPS do you get in avsmeter with only knlmeans enabled? 2fps on 1920x1080 is indeed very slow. I also get 2fps but on GeForce 710 (99% gpu usage)

With AVSMeter
KNLmeansCL h=2 27FPS 90-95% GPU
KNLmeansCL Adaptive h=2 ??FPS 80-90% GPU (AVSMeter shows the information scrolling so I can't see true FPS)
KNLmeansCL Adaptive + MD2 h=2 ??FPS 0-20% GPU (AVSMeter shows the information scrolling so I can't see true FPS)

In the OpenCL setup, I have x264 OpenCL acceleration set to no (none) device and KNLMeansCL set to Geforce GTX 980
Turning that on for x264 doesn't seem to help, but it does seem worse getting ~0.7 FPS.

Running same HEVC (not with AVSmeter) with just these filters: `FastLineDarkenMOD4().LSFmod()` (video is in the actual script, so I didn't forget that :D ) I'm getting ~12 FPS

[Atak_Snajpera]

Mdegrain2 running on CPU is a real bottleneck in your case. How many FPS do you get with mdegrain2 only?

[duffbeer]

I'm having an issue encoding audio to AC3 at the moment.
For some reason, RipBot produces an error any time I re-encode the audio to AC3. The error report states that the encoded audio file cannot be found.
My sources are either full disc structure or MKV. Sometimes with DTS audio and sometimes Dolby Atmos.
It always used to work perfectly so I'm not sure what has changed or whether it may be a local problem for me. Any ideas Atak?

[Atak_Snajpera]

I'm having an issue encoding audio to AC3 at the moment.
For some reason, RipBot produces an error any time I re-encode the audio to AC3. The error report states that the encoded audio file cannot be found.
My sources are either full disc structure or MKV. Sometimes with DTS audio and sometimes Dolby Atmos.
It always used to work perfectly so I'm not sure what has changed or whether it may be a local problem for me. Any ideas Atak?

You may try running manually jobx_EncodeAudioAll.cmd and then see what happens. I recommend doing this manually via console (cmd.exe) instead of just clicking on .cmd file.

[byteshare]

Mdegrain2 running on CPU is a real bottleneck in your case. How many FPS do you get with mdegrain2 only?
Can't get Mdegrain2 to work with AVSMeter, having the scrolling issue for some reason.
Had to run a job, used the same job that was getting ~12 FPS with these filters: `FastLineDarkenMOD4().LSFmod()`
Found I was only getting ~2FPS, so yeah, Mdegrain is the slow down (I was wrong, wasn't to do with my GPU, sorry), but (not using DEmode) only using ~33% (20%-40% seems to be the range) of the CPU during encode, so it seems the multiple processing threads isn't working for some reason? I have the "Limit to following filters only" unchecked.

[Atak_Snajpera]

Show me your full script

[byteshare]

Show me your full script

I ran it on a Ryzen 1700. I ran a similar test on a Ryzen 2700x and it is using more CPU ~60% in AVSmeter, which is showing correctly (not scrolling the data).
Update: Re-ran the above test after another reboot and an update to RB the AVSmeter isn't scrolling and not sure what you changed but it is using way more CPU and I'm getting ~9 FPS now!
Awesome, thank you!

[byteshare]

Something I'm noticing with the new update (now that my jobs are going faster!) is most of the jobs are failing at the remux step.
I don't think it is the filename, unless it is the "-" and if I manually run the batch file to make the video.265 it works fine and the video looks good.
I have at least 4 others I am able to see this happening on and two others that worked correctly. I am only encoding the video (skipping the demux step in the options to skip audio)

Update: Set my last update time to 2016, don't see any new updates, my Core is 2019.09.30.
Added a job that was failing again, and it failed again. only characters not ABC123, were brackets and a dash: "[" "]" "-"

[duffbeer]

How does RipBot handle HDR10+? Does it get passed through to the encoded MKV file or is it converted to HDR10?

[Atak_Snajpera]

No. You have to pass that data on your own.

[cypher007]

Noticed when encoding some anime, using very slow and animation tunes, that my intel i5 9100f doesn’t use 100% cpu. It seems to max 2 cores and about 70-80% the other 4 cores.

The result is 2-4fps. But if I open taskmgr it will then creep upto 16fps, this is on the first pass of a 2 pass encode.

So when I left some encodes to run 2 took nearly 3 hrs for 23min of video. But then the last 2 took 45mins. As I think I checked the cpu usage.

It’s like rip bot is dozing until the pc is used.

[Atak_Snajpera]

Most likely win10 is doing something "Smart". Change power profile to high performance

[userx]

Hello
Is there any possibility to automatically delete source file after successful end of job?

[Atak_Snajpera]

Hello
Is there any possibility to automatically delete source file after successful end of job?

Not yet. Maybe in next update.

[slalom]

There is a problem

If I run a job again, the program doesn't overwrite the previous file. I have to rename the old, for the new to be created

EDIT

To be more precise, running CombineAllChunks.cmd, doesn't overwrite existing video.264/5 in jobx folder

EDIT 2

Delete previous line

Something else is happening and overwrite doesn't work

[Ryushin]

Just wanted to bring this up again. I don't know how it would just be me though. I installed fresh versions of Ripbot264 a month or so ago and the 4K seamless branching is still causing issues. From a previous post:

I rip a 4K disc to the hard drive that has seamless branching, such as Incredibles 2. I then use Ripbot to pull in the movie and process it. The output will have out of sync audio towards the end of the movie. I think this only happens on 4K discs that are towards 2 hours or longer. Just had to go through this with Ralph Breaks the Internet and Snow White and the Huntsman Extended edition.

The work around I've been doing is to use MakeMKV to create a video file from the same source and then pull that into Ripbot to process it and it comes out fine.

This time the 4K disc in question is Ratatouille.

Is anyone else experiencing this?

[byteshare]

Just wanted to bring this up again. I don't know how it would just be me though. I installed fresh versions of Ripbot264 a month or so ago and the 4K seamless branching is still causing issues. From a previous post:

I rip a 4K disc to the hard drive that has seamless branching, such as Incredibles 2. I then use Ripbot to pull in the movie and process it. The output will have out of sync audio towards the end of the movie. I think this only happens on 4K discs that are towards 2 hours or longer. Just had to go through this with Ralph Breaks the Internet and Snow White and the Huntsman Extended edition.

The work around I've been doing is to use MakeMKV to create a video file from the same source and then pull that into Ripbot to process it and it comes out fine.

This time the 4K disc in question is Ratatouille.

Is anyone else experiencing this?
Which decoder are you using? And what is your Core version?

[Ryushin]

Which decoder are you using? And what is your Core version?

FFMS2 for the decoder and v1.25. Under tools, Core says 2019.09.01.

[byteshare]

FFMS2 for the decoder and v1.25. Under tools, Core says 2019.09.01.
You're using an old version, should be 2019.09.30 for the core

[cypher007]

Most likely win10 is doing something "Smart". Change power profile to high performance

I’ll try putting it on high performance and see what happens.

[GZZ]

Just wanted to bring this up again. I don't know how it would just be me though. I installed fresh versions of Ripbot264 a month or so ago and the 4K seamless branching is still causing issues. From a previous post:

I rip a 4K disc to the hard drive that has seamless branching, such as Incredibles 2. I then use Ripbot to pull in the movie and process it. The output will have out of sync audio towards the end of the movie. I think this only happens on 4K discs that are towards 2 hours or longer. Just had to go through this with Ralph Breaks the Internet and Snow White and the Huntsman Extended edition.

The work around I've been doing is to use MakeMKV to create a video file from the same source and then pull that into Ripbot to process it and it comes out fine.

This time the 4K disc in question is Ratatouille.

Is anyone else experiencing this?

Be carefull with MakeMKV, it has issues with Disney/Pixar Animation. I think its because of the seamless branching. I had alot of issue where ripbot will reject it saying it didnt have any audio. It turned out that MakeMKV does a poor job and there was a glitch in the movie and audio. I then switched to MKVToolNix to rip the main movie and it seem to do a proper job and havent got any AV sync issues.

[Ryushin]

You're using an old version, should be 2019.09.30 for the core
Updated to the latest version and it is still doing the same thing.


Be carefull with MakeMKV, it has issues with Disney/Pixar Animation. I think its because of the seamless branching. I had alot of issue where ripbot will reject it saying it didnt have any audio. It turned out that MakeMKV does a poor job and there was a glitch in the movie and audio. I then switched to MKVToolNix to rip the main movie and it seem to do a proper job and havent got any AV sync issues.
I'll keep an eye out for that. I'm using the MakeMKV for Linux and at least for me, it is making mkv files that are synced correctly and I import those into RipBot and I get the good output that is synced.

This only seems to occur on 4K content. Blu-ray seamless branching seems to work great and I have no issues.

[GZZ]

This only seems to occur on 4K content. Blu-ray seamless branching seems to work great and I have no issues.

I only had issue with Disney/Pixar and MakeMKV, I use it for all other movies without issue. So thinking its the way Disney/Pixar 4k UHD is created.

[byteshare]

There is a problem

If I run a job again, the program doesn't overwrite the previous file. I have to rename the old, for the new to be created

EDIT

To be more precise, running CombineAllChunks.cmd, doesn't overwrite existing video.264/5 in jobx folder

EDIT 2

Delete previous line

Something else is happening and overwrite doesn't work
For me it seems if I open RB, start jobs, abort, and then without restarting RB start the jobs again at the end of a job it won't mux.
--Update, might be more to it but I'm having the issue on more than one machine for jobs not muxing at the end (was only using one for a bit), so two separate machines with different sources running DE mode locally.
Running The batch CombineAllChunks then job1_MuxFiles works fine when I do it manually, so for now I'm run the combineallchunks then the jobxx_muxfiles batch manually. :/
"Z:\Temp\RipBot264temp\job1\video.265"
mkvmerge v37.0.0 ('Leave It') 64-bit
Error: The file 'Z:\Temp\RipBot264temp\job1\video.265' could not be opened for reading: open file error.

Side thing: I see .lwi files being made even though I have it set to FFMS2, is that intentional and if so why?

[Atak_Snajpera]

.lwi file is always created in order to avoid huge delay when you decide to switch from ffms2 to lsmash (indexing may take few minutes)

[byteshare]

.lwi file is always created in order to avoid huge delay when you decide to switch from ffms2 to lsmash (indexing may take few minutes)
Oh, didn't realize that was happening, but I also didn't realize that each job was getting muxed twice until with a more recent version it started breaking on me....
The more you know :D
Thank you for answering.
--To be clear the muxing issue isn't all of the time. If I can get it to work once then the following jobs keep working. Right now I've been restarting a job until it doesn't fail and then the jobs after work...then I don't touch anything because even adding more jobs seems to have a possibility of breaking it again.

[slalom]

For me it seems if I open RB, start jobs, abort, and then without restarting RB start the jobs again at the end of a job it won't mux.
--Update, might be more to it but I'm having the issue on more than one machine for jobs not muxing at the end (was only using one for a bit), so two separate machines with different sources running DE mode locally.
Running The batch CombineAllChunks then job1_MuxFiles works fine when I do it manually, so for now I'm run the combineallchunks then the jobxx_muxfiles batch manually. :/
"Z:\Temp\RipBot264temp\job1\video.265"
mkvmerge v37.0.0 ('Leave It') 64-bit
Error: The file 'Z:\Temp\RipBot264temp\job1\video.265' could not be opened for reading: open file error.

Side thing: I see .lwi files being made even though I have it set to FFMS2, is that intentional and if so why?
When the DE finishes, the next job starts. At least the files are there to do it manually

[userx]

Can report same behavor. CombineAllChunks.cmd has to be started manually. D:\Temp\RipBot264temp\job8\video.264 is not created before job8_MuxFiles.cmd is executed.
Very annoying. Some jobs succeeded and after any point all jobs finish with ERROR and no output files is created.

[mparade]

Your program is what I have been looking for in the past…
thank you very much!

In the past I used DGDecNV for video decoding, which is the preferred (most reliable if I can say something like this) one in Ripbot?

I think sometimes I would like to use some denoiser on my sources (very rarely when bitrates are getting higher very much). Do you have some guidelines when to use which?
I am reencoding only high bitrate HD sources but sometimes grain, noise doesn't let me reduce the bitrate in the amount I would like to.

Distributed encoding is just amazing on my 32 cores! I have never seen anything like this in other programs.

Thank you very much for your amazing program.

[Atak_Snajpera]

In the past I used DGDecNV for video decoding, which is the preferred (most reliable if I can say something like this) one in Ripbot?
LSMASH

I think sometimes I would like to use some denoiser on my sources (very rarely when bitrates are getting higher very much). Do you have some guidelines when to use which?
Just activate MDegrain2

[byteshare]

If anyone missed it. New update to x265 (3.2+5), MKVtoolnix (38.0.0), and Core (2019.10.06)
Thank you for the update.

How do we use the "Run Script after finished job"?

[Atak_Snajpera]

How do we use the "Run Script after finished job"?
What do you mean?

[byteshare]

What do you mean?
I don't see an option/where to define what script it will run, unless it is an internal script?
I can check it but I don't see what it does, so I don't know how to use it.
--Oh, thank you for adding GPU as a option in the settings for decoders and not just a right click option. Other than needing Intel or NVidia to use, any downsides to it over FFMS2 or LSMASH?

[Atak_Snajpera]

I don't see an option/where to define what script it will run, unless it is an internal script?
Just check Job finished successfully.cmd and Job finished with error.cmd

[byteshare]

Just check Job finished successfully.cmd and Job finished with error.cmd
Ah, thank you!

[Dhry]

I'm also encountering the video.265 could not be opened for reading: open file error issue. Started after a recent update, everything worked perfectly fine for months before, through multiple previous updates. And I too discovered that running the CombineAllChunks then then jobx_MuxFiles scripts manually will complete the process. Please fix.

Also, separate question: Are there any plans for a Linux encodingserver? I have a couple of Linux machines that I'd like to throw into the farm.

Thanks for the software, it's fantastic!
Dhry

[Atak_Snajpera]

Install windows (win10 works without activation forever) on virtual machine and you are good to go.

[mparade]

should I ignore it?:

x264 [warning]: OpenCL: not compiled with OpenCL support, disabling

[byteshare]

I'm also encountering the video.265 could not be opened for reading: open file error issue. Started after a recent update, everything worked perfectly fine for months before, through multiple previous updates. And I too discovered that running the CombineAllChunks then then jobx_MuxFiles scripts manually will complete the process. Please fix.

Make sure you're on core 2019.10.06 and you should be good to go. I suspect you're on an older version.

[LigH]

should I ignore it?:

Possibly yes. Your x264 build does not support hardware acceleration (if there is a speed-up at all), but that doesn't keep it from finishing its job correctly with usual CPU routines only.

There may be x264 builds out there which can use some OpenCL functions of a modern GPU. So you might replace xour x264 executable; but I won't guarantee that they work correctly with RipBot264, they might interfere with other filters using the GPU too, even. Test and get experienced.

[mparade]

Thank you very much.

DTS-HD MA 5.1 audio track was identified as 2.0 by Ripbot.
After reading input stream only stereo profiles were available from the list.

[Dhry]

Make sure you're on core 2019.10.06 and you should be good to go. I suspect you're on an older version.

That was correct. However, this morning it auto-updated, I tried a test 265 encode and it worked fine. Cheers!

[byteshare]

That was correct. However, this morning it auto-updated, I tried a test 265 encode and it worked fine. Cheers!
You should re-create the jobs if it just updated (the ones that haven't been processed).

[Dhry]

You should re-create the jobs if it just updated (the ones that haven't been processed).

No need. For the jobs that died, the folders are still there and all I need to do is to manually run the two existing scripts to combine and remux and all's well.

[Dhry]

Feature request: I have a 4-server distributed rendering setup. I notice that when a job is near the end, two of my machines remain idle (having completed their assigned work) while the last two (or one) complete their render pieces. In order to avoid servers being idle for periods of time like this, could we have the next job start while servers in the farm are still completing the last chunks of the previous job, so that no servers are idle at any time?

Cheers
Dhry

[Atak_Snajpera]

Feature request: I have a 4-server distributed rendering setup. I notice that when a job is near the end, two of my machines remain idle (having completed their assigned work) while the last two (or one) complete their render pieces. In order to avoid servers being idle for periods of time like this, could we have the next job start while servers in the farm are still completing the last chunks of the previous job, so that no servers are idle at any time?

Cheers
Dhry

No... Too much hassle ,too little benefit...

[byteshare]

You should re-create the jobs if it just updated (the ones that haven't been processed).

No need. For the jobs that died, the folders are still there and all I need to do is to manually run the two existing scripts to combine and remux and all's well.

The jobs that haven't run should be re-created but you can roll the dice ;)

[byteshare]

Feature request: I have a 4-server distributed rendering setup. I notice that when a job is near the end, two of my machines remain idle (having completed their assigned work) while the last two (or one) complete their render pieces. In order to avoid servers being idle for periods of time like this, could we have the next job start while servers in the farm are still completing the last chunks of the previous job, so that no servers are idle at any time?
If the computers are similar in performance you should try having the jobs split into 1 part per server/encoding server and set the priority to variable.
Or, have a 2nd application on each computer encoding a low priority video.
The feature was something I thought I wanted a while ago but with faster computers now I'm only seeing one to a few min. of lost time which only would add up if I was doing this for years and profit.

[Atak_Snajpera]

Variable priority makes only sense If you run multiple encoding servers on single pc. (For example to get 100% CPU usage)

[byteshare]

Variable priority makes only sense If you run multiple encoding servers on single pc. (For example to get 100% CPU usage)
Oh, okay. I remembered it wrong. I haven't used it in a while. So if you have more than 1 machine, not using only 2 chunks, and/or aren't using more than 1 encoding server it won't make sense, got it.
I stopped using it because using only 2 chunks didn't give me a good way to "pause" encodes. I usually stop 1 or more servers to either lower usage or "pause" an encode.

[Pauly Dunne]

Feature request: I have a 4-server distributed rendering setup. I notice that when a job is near the end, two of my machines remain idle (having completed their assigned work) while the last two (or one) complete their render pieces. In order to avoid servers being idle for periods of time like this, could we have the next job start while servers in the farm are still completing the last chunks of the previous job, so that no servers are idle at any time?

Cheers
Dhry

No... Too much hassle ,too little benefit...

I have to agree with this request....

I to have a multi pc server farm, and I get very frustrated at the wasted resources between encodes...if you are encoding a 4K movie, when it gets to the muxing stage, ONLY 1 pc is working on that, ALL the other's a twiddling their thumbs, for an extended period, could be 20 - 30 minutes !!! So over several movies in a queue, that's hour's wasted !!!

Just because you don't have a set up like this, you think it's a waste of time.

[Pauly Dunne]

How do we use the "Run Script after finished job"?

What do you mean?

Just check Job finished successfully.cmd and Job finished with error.cmd

I don't see an option/where to define what script it will run, unless it is an internal script?
I can check it but I don't see what it does, so I don't know how to use it.
--Oh, thank you for adding GPU as a option in the settings for decoders and not just a right click option. Other than needing Intel or NVidia to use, any downsides to it over FFMS2 or LSMASH?

Also, you add these new features, and don't give any explanation on what they are for, or how to enable/use them....

And what about us users that have AMD GPU's ???

And here's another feature request..

How about displaying the Core version on the main gui page, so it's there for everyone to see, instead of looking for it.

And another suggestion (that has been asked for before), wouldn't it be beneficial to change the build number by a .1 for EVERY auto update, that too would help keep track of build's/version's.

And while I'm at it, a changelog would be good, too.

[Atak_Snajpera]

I have to agree with this request....

I to have a multi pc server farm, and I get very frustrated at the wasted resources between encodes...if you are encoding a 4K movie, when it gets to the muxing stage, ONLY 1 pc is working on that, ALL the other's a twiddling their thumbs, for an extended period, could be 20 - 30 minutes !!! So over several movies in a queue, that's hour's wasted !!!

Just because you don't have a set up like this, you think it's a waste of time.

I'm honestly surprised that muxing in your case takes 30 min. On cheap sata3 SSD muxing 10 GiB files should take 1-2 minutes.

.And what about us users that have AMD GPU's ???
AMD despite my sympathy is still a dick and does not allow 3rd party developers access to their video engine. For example NVIDIA Has cuvid API and Intel Has quicksync.

[Pauly Dunne]

I'm honestly surprised that muxing in your case takes 30 min. On cheap sata3 SSD muxing 10 GiB files should take 1-2 minutes.

OMG, well clearly you don't have much experience with high bitrate 4K muxing !!

10Gb for a 4K movie !!, more like 60 - 80Gb !!

Admittedly I'm not using SSD's, only 7200rpm spinners.

[Atak_Snajpera]

OMG, well clearly you don't have much experience with high bitrate 4K muxing !!

10Gb for a 4K movie !!, more like 60 - 80Gb !!

Admittedly I'm not using SSD's, only 7200rpm spinners.

OMG, I'm sorry for not reading your mind correctly! Unfortunately my crystal ball is currently under inspection. Maybe it is time to buy some crappy sata3 ssd just for muxing? Assuming that copying speed on sata3 ssd is around 0.25GiB/s ,your big ass 80 GiB file would be muxed in ~5 minutes. Furthermore on decent NVMe SSD this would be reduced to ~1 minute.

[Pauly Dunne]

OMG, I'm sorry for not reading your mind correctly! Unfortunately my crystal ball is currently under inspection. Maybe it is time to buy some crappy sata3 ssd just for muxing? Assuming that copying speed on sata3 ssd is around 0.25GiB/s ,your big ass 80 GiB file would be muxed in ~5 minutes. Furthermore on decent NVMe SSD this would be reduced to ~1 minute.

Well, my crystal ball doesn't seem to work, and my mind reading isn't up to scratch, either.

I will dig out a "crappy ssd", and try a "big ass 80Gb" encode, with the latest build of RB, and see just how long it does take....

[Atak_Snajpera]

I will dig out a "crappy ssd", and try a "big ass 80Gb" encode, with the latest build of RB, and see just how long it does take....
If it still takes long time then I will rethink your request. Just give me some hard numbers.

[SKPN]

I'm having two issues with my latest set of encodes. The source, according to MediaInfo, has a 1s audio delay relative to the video. This delay is not being copied over, causing the audio to be slightly ahead of the video track. Is there a way for the timing to be picked up automatically by RipBot?

I've tried using the DelayAudio option in the AVS script, but that didn't seem to work, and I would ideally like to not have to do anything custom because I have over a hundred videos to do with the same issue.

The second issue is that the aspect ratio on the encoded video is incorrect. The source videos are 1440x1080 with a 4:3 DAR. For some reason, the encoded videos are being given a DAR of 16:9. I'm not using any custom scripts or anything that would change this, and I can't figure out why it's not just using the source DAR.

For this, I've tried using --sar 4:3 in the encoding settings, but the DAR is still 16:9 in the resulting video. I've also tried using a custom resize option, setting it to 1440 width with a 1.33:1 ratio.

Any help would be greatly appreciated.

[sneaker_ger]

1440x1080 with 4:3 DAR means --sar 1:1

(sar is sample aspect ratio)

[Atak_Snajpera]

For this, I've tried using --sar 4:3 in the encoding settings, but the DAR is still 16:9 in the resulting video. I've also tried using a custom resize option, setting it to 1440 width with a 1.33:1 ratio.
You should use --sar 1:1

[SKPN]

1440x1080 with 4:3 DAR means --sar 1:1

(sar is sample aspect ratio)
You should use --sar 1:1

Thank you! I don't know why I couldn't figure that out. Is there any reason it wouldn't do that automatically though? I'm not sure why it was setting it to 16:9 by default when the source video is 4:3.

In any case, that's one issue solved. Any suggestions for the audio sync issue by chance?

[Atak_Snajpera]

Do you re-encode audio or just remux? How many audio sources does your file have?

[SKPN]

Do you re-encode audio or just remux? How many audio sources does your file have?

Just remuxed, and just one audio source. I did figure out how to fix it for my one test video, but it involved a manual edit for the audio delay. That would normally be a good enough solution, but I have more than a hundred videos, and if the delay isn't the same on all of them, I'll have to go through each one individually to fix them unless I can figure out a way to have it read that delay by default.

[Atak_Snajpera]

Is delay always 1000ms?

[SKPN]

Is delay always 1000ms?

That I'm not sure of. It is on the few I've spot-checked, so I may be able to just run it with that delay, and fix the ones I come across that are wrong, but ideally I would be able to just have it use the same settings that are in the source file.

One other question: When doing a batch, is there a way to select which subtitles to render? When doing individual encodes, I can obviously select which subtitle track I want to burn in, but when I tested with the batch option on a file that had two subtitle tracks, it didn't burn either into the video; it just dropped them both from the resulting file altogether.

[Atak_Snajpera]

One other question: When doing a batch, is there a way to select which subtitles to render? When doing individual encodes, I can obviously select which subtitle track I want to burn in, but when I tested with the batch option on a file that had two subtitle tracks, it didn't burn either into the video; it just dropped them both from the resulting file altogether.
subtitle must be in the same folder as video file and have the same name to be automatically burned in. For example
C:\Folder\video.mkv
C:\Folder\video.srt

[byteshare]

I to have a multi pc server farm, and I get very frustrated at the wasted resources between encodes...if you are encoding a 4K movie, when it gets to the muxing stage, ONLY 1 pc is working on that, ALL the other's a twiddling their thumbs, for an extended period, could be 20 - 30 minutes !!! So over several movies in a queue, that's hour's wasted !!!
Just because you don't have a set up like this, you think it's a waste of time.
As already pointed out using an SSD as your mux drive (temp drive and end point for encodes) would speed things up, but you could alternatively have a lower priority encode with HandBrake or something on each to fill that time. (more to manage I know)
Also, you add these new features, and don't give any explanation on what they are for, or how to enable/use them....
And what about us users that have AMD GPU's ???
And here's another feature request..
How about displaying the Core version on the main gui page, so it's there for everyone to see, instead of looking for it.
And another suggestion (that has been asked for before), wouldn't it be beneficial to change the build number by a .1 for EVERY auto update, that too would help keep track of build's/version's.
And while I'm at it, a changelog would be good, too.
-While you can't use AMD GPUs for decode you can use them for some filters that use OpenCL GPU, such as KNLMeansCL.
-I would like a better way of knowing which version I'm actually on and what was changed but that is up to the dev so I understand if they don't want to spend more time/energy changing the version every release or changing the way the release is shown (with the core version) and giving detailed notes of the changes. I've become accustomed to looking for changes or asking and I almost always get a response.
OMG, well clearly you don't have much experience with high bitrate 4K muxing !!
Maybe it is just me but this comes off a little hostile. This is a free program and it is both the encoding app I use mostly and my preferred--I would say it isn't perfect but the best for experienced users that want AVISynth.

[byteshare]

That I'm not sure of. It is on the few I've spot-checked, so I may be able to just run it with that delay, and fix the ones I come across that are wrong, but ideally I would be able to just have it use the same settings that are in the source file.
If you mux in the audio from the source (manually) to the encoded file does it keep the timing? I can't remember if it does.
If it does, you could skip audio in RB and just use a bactch file to copy the audio at the end to all of your encoded files from the source files.

[SKPN]

subtitle must be in the same folder as video file and have the same name to be automatically burned in. For example
C:\Folder\video.mkv
C:\Folder\video.srt

The subtitles are embedded in the source file. Do I need to extract and rename them for it to work properly?

If you mux in the audio from the source (manually) to the encoded file does it keep the timing? I can't remember if it does.
If it does, you could skip audio in RB and just use a bactch file to copy the audio at the end to all of your encoded files from the source files.

I will give that a try.

Edit: It does keep the original timing if I mux the source audio in manually. I guess I will need to figure out how to write a batch file to extract the audio from the source and mux it into the encoded file.

[Atak_Snajpera]

The subtitles are embedded in the source file. Do I need to extract and rename them for it to work properly?
1) Run batch mode but select Prepare all jobs and wait for user
2) Demuxed subtitles should be in Job folder. Now you will have to copy selected subtitles to folder like I mentioned in previous post
3) Run again batch mode.

I guess I will need to figure out how to write a batch file to extract the audio from the source and mux it into the encoded file.
If you are familiar with batch scripting then you could remux encoded file with correct audio delay using Job finished successfully.cmd

[SKPN]

If you are familiar with batch scripting then you could remux encoded file with correct audio delay using Job finished successfully.cmd

How do I make use of the Job Finished Successfully cmd? Where is that located? I was able to create a batch file to fix the audio delay, but I'm not familiar with post-processing with RipBot.

I also solved my subtitle problem by just extracting them with MKVCleaver and doing a bulk rename to match the originals, so thank you for your help there!

[Atak_Snajpera]

If you have latest version then it should be located in the same folder as RipBot264.exe

[byteshare]

Edit: It does keep the original timing if I mux the source audio in manually. I guess I will need to figure out how to write a batch file to extract the audio from the source and mux it into the encoded file.
I haven't figured out "Job finished successfully.cmd" completely but also I have issues with names matching up since RipBot takes out the "." (I know I could manually remove it on my sources first, but haven't yet)
That said, but this in a "File.bat" and adjust the directories as needed (Assuming your MKVMerge is where I put it as well):

@echo off
FOR %%A IN (*.mkv) DO "C:\Program Files\MKVToolNix\mkvmerge.exe" -o ".\Muxed\%%A" "%%A" -D -S --no-global-tags "C:\Source\%%A"
pause

You'd run the batch file where the output (encoded file) is.
If you use the "Job finished successfully.cmd" you could have this be "automated", downside would be it would remux all previous encoded files unless you had those automatically deleted/moved.

[Atak_Snajpera]

I haven't figured out "Job finished successfully.cmd" completely
It is very simple. Let's say you want to delete original file after successful conversion.
This is how to do it.

@REM *********** SUPPORTED EXTRA VARIABLES ***********
@REM * *
@REM * %RIPBOT264TEMP% = e.g. c:\Temp\Ripbot264temp *
@REM * %JOB% = e.g. Job1 *
@REM * %INPUTFILEDIR% = e.g. C:\SourceVideos *
@REM * %OUTPUTFILEDIR% = e.g. C:\EncodedVideos *
@REM * %INPUTFILENAME% = e.g. MySourceVideo *
@REM * %OUTPUTFILENAME% = e.g. MyEncodedVideo *
@REM * %INPUTFILEEXT% = e.g. avi *
@REM * %OUTPUTFILEEXT% = e.g. mkv *
@REM * %YEAR% = e.g. 2019 *
@REM * %MONTH% = e.g. 01 *
@REM * %DAY% = e.g. 31 *
@REM * %HOUR% = e.g. 23 *
@REM * %MINUTE% = e.g. 59 *
@REM * %SECOND% = e.g. 00 *
@REM * %MILLISECOND% = e.g. 999 *
@REM * *
@REM *************************************************
del %INPUTFILEDIR%\%INPUTFILENAME%.%INPUTFILEEXT%

[SKPN]

If you have latest version then it should be located in the same folder as RipBot264.exe

That would explain why I can't find it. I'm still on v1.24.1. I remember trying out v1.25.0 and it being considerably slower than 1.24, so I went back.

[byteshare]

It is very simple. Let's say you want to delete original file after successful conversion.
This is how to do it.

@REM *********** SUPPORTED EXTRA VARIABLES ***********
@REM * *
@REM * %RIPBOT264TEMP% = e.g. c:\Temp\Ripbot264temp *
@REM * %JOB% = e.g. Job1 *
@REM * %INPUTFILEDIR% = e.g. C:\SourceVideos *
@REM * %OUTPUTFILEDIR% = e.g. C:\EncodedVideos *
@REM * %INPUTFILENAME% = e.g. MySourceVideo *
@REM * %OUTPUTFILENAME% = e.g. MyEncodedVideo *
@REM * %INPUTFILEEXT% = e.g. avi *
@REM * %OUTPUTFILEEXT% = e.g. mkv *
@REM * %YEAR% = e.g. 2019 *
@REM * %MONTH% = e.g. 01 *
@REM * %DAY% = e.g. 31 *
@REM * %HOUR% = e.g. 23 *
@REM * %MINUTE% = e.g. 59 *
@REM * %SECOND% = e.g. 00 *
@REM * %MILLISECOND% = e.g. 999 *
@REM * *
@REM *************************************************
del %INPUTFILEDIR%\%INPUTFILENAME%.%INPUTFILEEXT%


Ah, okay. I thought maybe I needed to define the extra variables. I thought they were all examples of what they could equal. Didn't realize they were pulling information such as the %INPUTFILEDIR% from the job itself.

[byteshare]

That would explain why I can't find it. I'm still on v1.24.1. I remember trying out v1.25.0 and it being considerably slower than 1.24, so I went back.
Two things have changed since then that might have been why it was slow for you:
1. LSmash doesn't have to be default
2. there was a fix for using some of the filters with multi-threading

[byteshare]

Would something like this work for the "Job finished successfully.bat":
"C:\Program Files\MKVToolNix\mkvmerge.exe" -o "%OUTPUTFILEDIR%\Muxed\%INPUTFILENAME%.mkv" "%OUTPUTFILEDIR%\%OUTPUTFILENAME%.%OUTPUTFILEEXT%" -D -S --no-chapters --no-global-tags "%INPUTFILEDIR%\%INPUTFILENAME%.%INPUTFILEEXT%"
timeout 5
MOVE %OUTPUTFILEDIR%\%OUTPUTFILENAME%.%OUTPUTFILEEXT% "%OUTPUTFILEDIR%\Hold"
Did the last MOVE rather than del encase something went wrong or maybe someone would still want it until they verified the output (Muxed) folder.

Will RipBot be waiting to do the next job while the "Job finished successfully.bat" is done running?

[Atak_Snajpera]

.Will RipBot be waiting to do the next job while the "Job finished successfully.bat" is done running?

No...

[Pauly Dunne]

As already pointed out using an SSD as your mux drive (temp drive and end point for encodes) would speed things up,

I will definitely be trying that...

-I would like a better way of knowing which version I'm actually on and what was changed but that is up to the dev so I understand if they don't want to spend more time/energy changing the version every release or changing the way the release is shown (with the core version) and giving detailed notes of the changes. I've become accustomed to looking for changes or asking and I almost always get a response.

I'm sure it would only take a couple of minutes..

Maybe it is just me but this comes off a little hostile. This is a free program and it is both the encoding app I use mostly and my preferred--I would say it isn't perfect but the best for experienced users that want AVISynth.

I know that my reply might seem a bit like that, but it was in response to the previous post, which was rather irrelevant to high bitrate 4K content. I do recall that the dev mentioned (albeit a while back) that he had no, to limited access to 4K material.

Thank you for your input :)

[byteshare]

No...
Awesome. I was worried that it would slow down jobs.
I'll run some tests on it now. I have the "keep jobs after successful conversion" not checked. Need to see if the job folder is removed before or after the script because I was realizing that I could copy most of what i need from the video.mkv directly since it still have audio, subs, and things and is on my SSD scratch drive already rather than the physical HD I use for storing sources.

[Atak_Snajpera]

Awesome. I was worried that it would slow down jobs.
I'll run some tests on it now. I have the "keep jobs after successful conversion" not checked. Need to see if the job folder is removed before or after the script because I was realizing that I could copy most of what i need from the video.mkv directly since it still have audio, subs, and things and is on my SSD scratch drive already rather than the physical HD I use for storing sources.

Like I said code in ripbot does not wait for cmd script so job folder will be deleted anyway. I predict that your script will block files and you will end up with some files still present in job folder.

[duffbeer]

I'm still seeing very slow performance when setting up an encode since the update to 1.25 and none of the small updates since have solved the problems for me.
It takes around 20 mins to demux and index my source and then another 10 mins to use the auto crop. After the auto crop has finished it takes another 10 mins to return to the main menu where I can start the job queue.

40+ mins for each job is really frustrating and I can't see any obvious reason that this has now changed. If I go back to 1.24.1, everything works within a few seconds.

Does anyone have any idea what may be happening here?

[forkicks]

Hello.

I am running rb updated (just did a recheck for updates after running rb for 3 days).

I got this on a few jobs (with different files):
----------[2019-10-09 20:54:26]----------

File: Y:\batch1\les.sauvages.s01e01.french.1080p.hdtv.x264-hybris.mkv
FFAudioSource: Audio format change detected. This is currently unsupported. Channels: 6 -> 2; Sample rate: 48000 -> 48000; Sample format: fltp -> fltp
(C:\Temp\RipBot264temp\job16\getinfo.avs, line 4)


Most of the files encoded properly, but these few failed with this error. The thing is, in my job definition, i have Rb set to copy the audio track, not encode it at all, so i don't understand why it's trying to check this.

Thanks,
fK

[Atak_Snajpera]

Your file has not been correctly encoded. Most likely there is still audio related with advertisements. You need to manually cut out those left overs.

[Atak_Snajpera]

I'm still seeing very slow performance when setting up an encode since the update to 1.25 and none of the small updates since have solved the problems for me.
It takes around 20 mins to demux and index my source and then another 10 mins to use the auto crop. After the auto crop has finished it takes another 10 mins to return to the main menu where I can start the job queue.

40+ mins for each job is really frustrating and I can't see any obvious reason that this has now changed. If I go back to 1.24.1, everything works within a few seconds.

Does anyone have any idea what may be happening here?

Try again in safe mode without any antiviruses active and other apps.

[byteshare]

I'm still seeing very slow performance when setting up an encode since the update to 1.25 and none of the small updates since have solved the problems for me.
It takes around 20 mins to demux and index my source and then another 10 mins to use the auto crop. After the auto crop has finished it takes another 10 mins to return to the main menu where I can start the job queue.

40+ mins for each job is really frustrating and I can't see any obvious reason that this has now changed. If I go back to 1.24.1, everything works within a few seconds.

Does anyone have any idea what may be happening here?
Did you change the decoder from LSmash to FFMS2?

[byteshare]

Like I said code in ripbot does not wait for cmd script so job folder will be deleted anyway. I predict that your script will block files and you will end up with some files still present in job folder.
So, the problem I'm seeing now (changed things up) is once the job is removed RB loses the ability to use the variables such as %INPUTFILENAME%
example:
MOVE "%INPUTFILEDIR%\%INPUTFILENAME%.mkv" "C:\done\%INPUTFILENAME%.mkv"
When the script runs it doesn't have an input name. The work around is to not automatically delete jobs when successful.
Would it be possible for the next job to start but not delete the job folder until after the script runs?
Or is there a good way to automatically remove a job via the bat file, and by not just deleting the %Job% folder?

[Atak_Snajpera]

Would it be possible for the next job to start but not delete the job folder until after the script runs?
I will think about it... Shouldn't be too difficult to implement.

[slalom]

After yesterdays Windows Update for 7, I get an error

List index out of bounds (130)

I press OK, and the program opens and some jobs are missing, but they are in my Temp folder

It's not the app, I unzipped and updated the files in the first post, same thing

[duffbeer]

Try again in safe mode without any antiviruses active and other apps.

I'll give it a go but I only have standard Windows 10 Anti Virus and no other apps running. This is a dedicated encoding PC.

[duffbeer]

Did you change the decoder from LSmash to FFMS2?

Yes I had to. LSMASH makes it even slower.

[Atak_Snajpera]

After yesterdays Windows Update for 7, I get an error

List index out of bounds (130)

I press OK, and the program opens and some jobs are missing, but they are in my Temp folder

It's not the app, I unzipped and updated the files in the first post, same thing

Delete job.list file

[byteshare]

I will think about it... Shouldn't be too difficult to implement.
Thank you, and if you think of a better solution I'm all for it. Just the things I thought about in the moment.

Yes I had to. LSMASH makes it even slower.
Is your Temp drive for RipBot an SSD? I use a physical drive for storing my sources and an SSD for the Temp drive (jobs) and adding new jobs isn't that slow for me on the latest version.

[Pauly Dunne]

Is your Temp drive for RipBot an SSD? I use a physical drive for storing my sources and an SSD for the Temp drive (jobs) and adding new jobs isn't that slow for me on the latest version.

Speaking of taking time...it took 27 minutes to "prepare" a 4K movie, copying from a spinner (main movie) to an SSD temp drive, (just like you, byteshare) with Lsmash.

It was John Wick 3, @ approx 65 Gb.

And yes, I am yet to complete my "muxing" test, that will be in a few days, will be interesting if SSD's make much difference to large files.

[Atak_Snajpera]

I do not get IT. Are you encoding 60gib movie to 60gib file? In your earlier post you mentioned that muxing takes long time because your final encoded file was 60-80gib.

[Pauly Dunne]

I do not get IT. Are you encoding 60gib movie to 60gib file? In your earlier post you mentioned that muxing takes long time because your final encoded file was 60-80gib.

I didn't think you would, but this particular movie is approx 65Gb, has a 63.5Mb/s bitrate.

I simply want to strip stuff out, redo audio, as most 4K movies are TrueHD, and my tv doesn't support that. So I have to convert it either with RB, or eac3to.

Also some filtering, subtitling, etc, if required.

So I am aiming to do the majority of the 4K movies I have @ a 60Mb/s bitrate, that will increase some, and decrease others.

So I do things differently to most...so what !!!!

[LigH]

So you want to do more than just remultiplexing.

I simply want to strip stuff out, redo audio, as most 4K movies are TrueHD, and my tv doesn't support that. So I have to convert it either with RB, or eac3to.

Up to this point, the video may be left unchanged, all operations can be fast.

Also some filtering, subtitling, etc, if required.

This possibly requires recoding the video (especially if "subtitling" means permanently encoding = "burning" subtitles into the video stream). That will take a lot of time in 4K resolution.

[Pauly Dunne]

So you want to do more than just remultiplexing.

Up to this point, the video may be left unchanged, all operations can be fast.

This possibly requires recoding the video (especially if "subtitling" means permanently encoding = "burning" subtitles into the video stream). That will take a lot of time in 4K resolution.

I think I will use RB to change the bitrate, but use other software to convert the TrueHD audio, I also have to convert subtitles to .srt (because that's what my tv requires), so use Subtitle Edit to do that.

Unfortunately, RB can't convert TrueHD to DTS, or subtitles to .srt :(

Once the audio & sub's have been converted, and RB has done it's thing on the video (only), will reconstruct it all back together with MKVToolnix.

Admittedly, if I left the original bitrate, then the process would be a little different..

A LOT of work, but that's what I want.

[slalom]

Why don't you buy an android TV box and play the file with Kodi?

Delete job.list file
Nothing happened, same error

[Pauly Dunne]

Why don't you buy an android TV box and play the file with Kodi?

Been there, done that....not impressed !!!!

[SKPN]

I didn't think you would, but this particular movie is approx 65Gb, has a 63.5Mb/s bitrate.

I simply want to strip stuff out, redo audio, as most 4K movies are TrueHD, and my tv doesn't support that. So I have to convert it either with RB, or eac3to.

Also some filtering, subtitling, etc, if required.

So I am aiming to do the majority of the 4K movies I have @ a 60Mb/s bitrate, that will increase some, and decrease others.

So I do things differently to most...so what !!!!

I'm confused at why you are re-encoding the video at all based on what you're describing. Why not just extract the audio and subtitles, convert them using the other applications you mentioned, then mux them back in with the original video? Even if you want to cut out some fluff like credits, you can do that without re-encoding the video. If you're not rendering the subtitles and you're not trying to compress the video, what is the purpose of re-encoding it?

[slalom]

Been there, done that....not impressed !!!!
Did you try an HTPC too?

[Pauly Dunne]

I'm confused at why you are re-encoding the video at all based on what you're describing. Why not just extract the audio and subtitles, convert them using the other applications you mentioned, then mux them back in with the original video? Even if you want to cut out some fluff like credits, you can do that without re-encoding the video. If you're not rendering the subtitles and you're not trying to compress the video, what is the purpose of re-encoding it?

Admittedly, some 4K movies could be done an easier way, but on some where I want to increased (or decrease) the bitrate, I have to re encode it.

Not trying to compress !!, mind you, I really haven't looked into that, too much.

[Pauly Dunne]

Did you try an HTPC too?

No I haven't !!

HTPC and/or streaming doesn't suit me, I don't like the idea of having a pc running, just to watch movies.

[SKPN]

Admittedly, some 4K movies could be done an easier way, but on some where I want to increased (or decrease) the bitrate, I have to re encode it.

Not trying to compress !!, mind you, I really haven't looked into that, too much.

Why would you want to increase the bitrate?

[Atak_Snajpera]

Why would you want to increase the bitrate?

Because increasing bitrate also automagically increases quality ;) doh

[byteshare]

Speaking of taking time...it took 27 minutes to "prepare" a 4K movie, copying from a spinner (main movie) to an SSD temp drive, (just like you, byteshare) with Lsmash.

It was John Wick 3, @ approx 65 Gb.

And yes, I am yet to complete my "muxing" test, that will be in a few days, will be interesting if SSD's make much difference to large files.
I almost never use LSmash, so I don't see those delays with large files.
Sorry. Try FFMS2 or GPU decode (if applicable). The LSmash slowness issues isn't RB's fault.

I didn't think you would, but this particular movie is approx 65Gb, has a 63.5Mb/s bitrate.

I simply want to strip stuff out, redo audio, as most 4K movies are TrueHD, and my tv doesn't support that. So I have to convert it either with RB, or eac3to.

Also some filtering, subtitling, etc, if required.

So I am aiming to do the majority of the 4K movies I have @ a 60Mb/s bitrate, that will increase some, and decrease others.

So I do things differently to most...so what !!!!
Try Foobar2000 if you just want to process audio.
Are you encoding to HEVC/x265? If so your files should be smaller and still look the same even if you're using CRF18.
As pointed out, it sounds like you're doing a lot of work for just getting your TV to play a file when you wouldn't have to do all of that if you got a stand alone set-top box like an Nvida Shield TV (don't need a PC to use Plex) or Mi Box (~$50 USD).

Because increasing bitrate also automagically increases quality ;) doh
LOL

[mparade]

According to Windows scheduler it seems that Ripbot is not able to saturate my 1950X even in distributed encoding mode.
Processor utilization fluctuates between 78-85% with any number of encodes started.Ripbot sees only Numa node 0 with 32 threads instead of 0 and 1 with 16 each. Is this the problem?

Interestingly, my 2990WX is fully saturated with it's 32 cores while all 4 nodes being correctly identified by Ripbot.

Any help would be appreciated.

[Atak_Snajpera]

1950x by default works in Uma mode (can be changed in bios) while 2990wx only supports NUMA mode.

[mparade]

1950x by default works in Uma mode (can be changed in bios) while 2990wx only supports NUMA mode.

Thanks.

In UMA mode my 1950x seems to be like "turtle" compared to 2990wx. Is it possible that 1950x is not correctly recognized by Ripbot? My 2990wx is recognized as "AMD-2990wx" in distributed encoding window while my 1950x is not as something like "AMD-1950x". If I change my 1950x to NUMA mode Ripbot tells it still has only one node. I am going to play with my 1950x tomorrow to find out why it is slow and cannot saturate the cores using Ripbot.

[Atak_Snajpera]

Does task manager also see single node?

[mparade]

Sorry for the question but where is this presented in task manager? :)

Anyway, it is like magic "transcoding" movies with "placebo" settings using Ripbot! :)

[Atak_Snajpera]

Right Click on CPU graph and select NUMA nodes.

[mparade]

Now both Windows task manager and Ripbot shows 2 nodes...sorry...I must have been drunk.
Now I am on 100% with my 1950x as well...just need to enter NUMA mode. Thank you.

[Atak_Snajpera]

Now both Windows task manager and Ripbot shows 2 nodes...sorry...I must have been drunk.
Now I am on 100% with my 1950x as well...just need to enter NUMA mode. Thank you.

I suppose that intensive (latency/bandwith)communication between dies prevents you from 100% CPU usage. In NUMA mode both dies work on separated data.

[Pauly Dunne]

Because increasing bitrate also automagically increases quality ;) doh

Ha, so sarcasm aside...prove me wrong !!!

Someone provide me with some proven 4K settings to equal original video quality, at a much lower bitrate & file size !!

[byteshare]

Ha, so sarcasm aside...prove me wrong !!!

Someone provide me with some proven 4K settings to equal original video quality, at a much lower bitrate & file size !!
Well, more bitrate than the original doesn't mean better quality, since there are plenty of ways to increase a bitrate but still get garbage quality. When dealing with x264/x265 there are a lot of complicated settings you can tweak, but usually either you're going for 1:1 quality with the original or some balance of quality with size. I prefer the later. If I want 1:1 I'll just copy the video and not process it.
I've encoded enough video to know there is no perfect settings for all videos of all types. You can get good general settings but for better results you'll need to tweak settings per video.

[Pauly Dunne]

Well, more bitrate than the original doesn't mean better quality, since there are plenty of ways to increase a bitrate but still get garbage quality. When dealing with x264/x265 there are a lot of complicated settings you can tweak, but usually either you're going for 1:1 quality with the original or some balance of quality with size. I prefer the later. If I want 1:1 I'll just copy the video and not process it.
I've encoded enough video to know there is no perfect settings for all videos of all types. You can get good general settings but for better results you'll need to tweak settings per video.

So I have been doing some more "research", and it seems that a bitrate of around 55 - 60Mb/s is the high end of 4K HEVC encodes.

Some, are higher, and some are lower.

With some of my recent encodes I have used a 1 pass with a bitrate set @ 60,000kbp/s (in the RB setting's).

Some might use a CRF (CQ) number of say 18 or 16 to get a good result.

With maybe a Slow preset...I'm not using any preset's at this stage.

So not knowing what your experience is with 4K movies, can you suggest a starting point ??

[byteshare]

So I have been doing some more "research", and it seems that a bitrate of around 55 - 60Mb/s is the high end of 4K HEVC encodes.

Some, are higher, and some are lower.

With some of my recent encodes I have used a 1 pass with a bitrate set @ 60,000kbp/s (in the RB setting's).

Some might use a CRF (CQ) number of say 18 or 16 to get a good result.

With maybe a Slow preset...I'm not using any preset's at this stage.

So not knowing what your experience is with 4K movies, can you suggest a starting point ??
As for general settings, presets aren't a bad place start depending on your needs. I don't use straight presets myself because I want a balanced encode and no preset can keep reasonable quality and size and speed for my tastes.
It isn't clear what you're trying to do to me. If I were to guess it just seems like you want to keep the quality the same as the source, no?
If you want that and aren't doing filters than I'd just use Ultra-Fast downscale a lot and then at the end copy back in the source video.
If you want to keep quality close to the source but still using filters, which filters are you using? Once you're using filters it really changes things. I tend to not like grain so I reduce that with some careful settings.

[Pauly Dunne]

As for general settings, presets aren't a bad place start depending on your needs. I don't use straight presets myself because I want a balanced encode and no preset can keep reasonable quality and size and speed for my tastes.
It isn't clear what you're trying to do to me. If I were to guess it just seems like you want to keep the quality the same as the source, no?
If you want that and aren't doing filters than I'd just use Ultra-Fast downscale a lot and then at the end copy back in the source video.
If you want to keep quality close to the source but still using filters, which filters are you using? Once you're using filters it really changes things. I tend to not like grain so I reduce that with some careful settings.

Well, as I said, I'd like to have my 4K's at a "standard" of 60Mps, and again, as I've said, some have lower than that, some are higher, so for that I need to run them thru RB, even if it's video only.

For what I want & need to do to audio, can be dealt with other app's, as too, the subtitles.

I have to agree, I don't like grain either, but fortunately most 4K's aren't very "noisy", so not a lot of filtering required.

I know I need to try a few different options, but it's the time factor that's my main concern...imagine doing a high bitrate 4K HEVC, on a Slow preset, using MDGrain2....day's :( even with my "farm".

But the other time waster is between when the encode is completed, and the start of the next job in queue...meaning the muxing, etc...it leaves a lot of resources doing nothing. :(, but having said that, I am yet to test this again, after putting some SSD's in the mix.

One thing I would like to get around to doing is upscaling some 1080p to 4K, but do any filtering, etc, still @ 1080p, then once satisfied, do a 4K HEVC encode, and see how it turns out.

But just imagine the time & resources involved when 8K is a lot more common place.

[skylinekiller]

I am trying to edit the font when I hardcode subtitle into my encode, but it doesn't seem to be working. I edited the notepad file in Tools\AviSynth plugins\VSFilter\Default.style with the parameters below.

Style: Default,Univers CE 45 Light,41,16777215,0,16777215,0,-1,0,2,1,2,20,20,20,0,0

what it looks like with the above settings in RipBot https://ibb.co/S7xFvpn


This is what it should look like.. The resolution is not as good but trust me, the font is not accepting the setttings
https://ibb.co/92VB0Xt


This is the setting from srt2ssa

Synch Point: Side 1 0m00s
Collisions: Normal
Timer: 100.0000
Style: Default,Univers CE 45 Light,41,16777215,0,16777215,0,-1,0,2,1,2,20,20,20,0,0


Why am I getting a shadow

[mparade]

I suppose that intensive (latency/bandwith)communication between dies prevents you from 100% CPU usage. In NUMA mode both dies work on separated data.

Under heavy load my Windows on 2990WX used to reset itself randomly without any error message in ripbot however my temperatures are ok in amd ryzen master. 1950x doesn't do it at all even under heavy load...it happens both with encoding 4K and HD.
I am using 4x8GB memory in quad channel layout in both. Power supply units are also powerful enough in both and both are using same type of liquid cooling.
Do you have any suggestion? I would really appreciate that.

[Atak_Snajpera]

Normally when PC shutdowns or resets I blame power supply. Especially when shutdowns/resets happen during heavy load (high power consumption). For testing purposes I would swap power supplies 1950x<->2990wx.

[mparade]

thx!!

[Atak_Snajpera]

Maybe you have activated PBO on 2990wx and hence too high power consumption for your power supply. 0.5kW is just insane.
https://cdn.mos.cms.futurecdn.net/Hx27r3x3yh4r5jJkbiCetS-650-80.png

[mparade]

If I set 8 servers for job 1 in the queue, will the following jobs be using the same servers and threads I assigned to them in job1 automatically for encoding?

[mparade]

Maybe you have activated PBO on 2990wx and hence too high power consumption for your power supply.
https://cdn.mos.cms.futurecdn.net/Hx27r3x3yh4r5jJkbiCetS-650-80.png

Yes, I do (am). :)

[Atak_Snajpera]

All jobs will use the same server configuration.

Yes, I do.
So now you know what to do ;) BTW. Overclocking AMD cpus do not make sense these days.

[mparade]

All jobs will use the same server configuration.

Super-good! Thank you very much!

[mparade]

All jobs will use the same server configuration.


So now you know what to do ;) BTW. Overclocking AMD cpus do not make sense these days.

Does chunk size affect encoding quality more than negligibly? Maybe it is not required at all to set chunk size according to duration of each source.
I would like to saturate my cores using 8 servers almost always that would give very fast encodes.

[Atak_Snajpera]

Does chunk size affect encoding quality more than negligibly?

In CRF mode there is zero quality degradation. In 2-pass degradation is negligible. Also each chunk starts at key-frame.
Use default 1 minute if you are going to use 1950x and 2990wx at the same time.

[mparade]

In CRF mode there is zero quality degradation. In 2-pass degradation is negligible. Also each chunk starts at key-frame.
Use default 1 minute if you are going to use 1950x and 2990wx at the same time.

WOW! I am in CRF mode. Thank you! I am, one from home, the other from workplace…:)

[Atak_Snajpera]

WOW! I am in CRF mode. Thank you! I am, one from home, the other from workplace…:)

With decent internet connection (10Mbps+ upload) and VPN you can use other PC as well.

[mparade]

What is required to use both machines at the same time for the same job? Do you have a tutorial? At the moment I am using them separately with locally set servers.
Please help. Internet connection shouldn't be a problem. Both have Ripbot installed. I can set them up separately now. There is 2 km distance between them. :)

[Atak_Snajpera]

What is required to use both machines at the same time for the same job? Do you have a tutorial? At the moment I am using them separately with locally set servers.
Please help.

You will have to create VPN network on work PC and then connect to that network from home PC. This way shared folder will be visible like on normal LAN. Some users already are using this method to distribute encoding work across internet. It is definitely possible with good internet connection.

https://www.pcworld.com/article/210562/how-set-up-vpn-in-windows.html

[mparade]

Thank you very much!
Source material should be only on home PC, right?
Work PC with VPN network just need to be on with Ripbot installed right? Or should I set somthing more on work pc? Sorry for being noob in this thema.

[Atak_Snajpera]

1) Source files are on your home PC.
2) Work PC just needs EncodingServer.exe running!
3) The idea is that you connect via VPN to work PC and then Work PC sees shared folder (for example \\HOME-PC\RipBot264temp) on Home PC.

[mparade]

I have to accomplish this! I will let you know if get stuck with something (I am sure I will :))

[mparade]

how is the exact number of --seek parameter is specified on x264 command line, may I ask?

thank you for for the help in advance

[Atak_Snajpera]

seek = StartKeyFrameIndex - PreviousKeyFrameIndex

[mparade]

1) Source files are on your home PC.
2) Work PC just needs EncodingServer.exe running!
3) The idea is that you connect via VPN to work PC and then Work PC sees shared folder (for example \\HOME-PC\RipBot264temp) on Home PC.

both work and home pc should be connected via VPN, right?
work pc at the moment cannot because refering to closed port
I have to ask local admin at company

[mparade]

seek = StartKeyFrameIndex - PreviousKeyFrameIndex

thx!!

[Atak_Snajpera]

both work and home pc should be connected via VPN, right?
work pc at the moment cannot because refering to closed port
I have to ask local admin at company

Your admin should know what to do.
https://www.youtube.com/watch?v=Mk_XYuzQ8jA

Ports to open
https://social.technet.microsoft.com/Forums/Azure/en-US/0fff3b48-7615-45ea-817e-5afaad972c43/vpn-ports-to-open?forum=winservergen