PDA

View Full Version : RipBot264 v1.18.3 - Simple and easy to use GUI -> IPOD . PSP . CONSOLES . BLURAY


Pages : 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 [67] 68 69 70 71

byteshare
23rd December 2018, 15:55
Not applicable when clicking "remove" and doesn't address non-use of recycle bin.
Then don't remove the job? I am not sure why you'd want to keep temp files since you should still have the source video and if you wanted to re-encode the same thing you can use the same job after it is done if you don't remove it.
I don't see why you'd want to move temp files to the recycle bin rather then remove them.

FuzzyNutz
23rd December 2018, 23:29
Then don't remove the job? I am not sure why you'd want to keep temp files since you should still have the source video and if you wanted to re-encode the same thing you can use the same job after it is done if you don't remove it.
I don't see why you'd want to move temp files to the recycle bin rather then remove them.

Job folder creation is time intensive. The contents have value. It's wasteful to permanently delete them when the recycle bin is available.
RipBot, like other software running in windows, should allow users the second-chance afforded by the recycle bin.

FuzzyNutz
24th December 2018, 00:24
When loading blu-ray structure jobs with HD audio that will be re-encoded to AC3 or AAC, does selecting "demux" enable the least steps or is wave creation an inevitable intermediate, hence the reason "wave" is the default?

If the HD audio track in the above example is 7.1 and "wave" is selected, what difference does it make if the "5.1" box is checked, given that the AC3 and AAC choices don't exceed 5.1?

Ryushin
24th December 2018, 02:10
When loading blu-ray structure jobs with HD audio that will be re-encoded to AC3 or AAC, does selecting "demux" enable the least steps or is wave creation an inevitable intermediate, hence the reason "wave" is the default?

If the HD audio track in the above example is 7.1 and "wave" is selected, what difference does it make if the "5.1" box is checked, given that the AC3 and AAC choices don't exceed 5.1?

If I want to keep the original audio of the movie, I select Core and then x.x Copy Stream when selecting audio for the encoding settings. With the exception of TrueHD tracks, when using those, I have to select Demux. I essentially never use Wave unless its forced to because the audio is a PCM track. So essentially, use Core for everything except TrueHD tracks, and then you can select what you want in the encoding settings. I.e. Original, AC3, AAC, etc.

Ryushin
24th December 2018, 02:18
Job folder creation is time intensive. The contents have value. It's wasteful to permanently delete them when the recycle bin is available.
RipBot, like other software running in windows, should allow users the second-chance afforded by the recycle bin.

I can understand the idea behind this. Only problem is, the job has a number associated with it. Restoring it simply from Recycle Bin does not mean the job will be able to be re-integrated back into RB. Atak would have to actually create a restore job from Recycle Bin and then changed everything about it to have a new job number.

In many ways, think of deleting the job from RB as emptying the recycle bin. Only delete it once you are sure your created file is what you want.

My master server actually runs on a virtual machine on top of linux running ZFS. The master server never does any encoding itself, it just controls the slaves.

Twice I need to recover about a 50-150 jobs. I shutdown the VM. Created a clone from a snapshot of VM's drive, booted the VM with the cloned drive, did my work that I needed to do with the jobs, and then shut it back down and destroyed the clone and restored the original VM's drive and picked up where I left off.

FuzzyNutz
24th December 2018, 03:20
If I want to keep the original audio of the movie, I select Core and then x.x Copy Stream when selecting audio for the encoding settings. With the exception of TrueHD tracks, when using those, I have to select Demux. I essentially never use Wave unless its forced to because the audio is a PCM track. So essentially, use Core for everything except TrueHD tracks, and then you can select what you want in the encoding settings. I.e. Original, AC3, AAC, etc.

None of which address my questions.

Unrelated: You might have overlooked that TrueHD tracks in blu-ray structures often contain a selectable core. Also, using HD cores to re-encode to AC3 or AAC is not preferred practice.

FuzzyNutz
24th December 2018, 03:29
Only problem is, the job has a number associated with it. Restoring it simply from Recycle Bin does not mean the job will be able to be re-integrated back into RB. Atak would have to actually create a restore job from Recycle Bin and then changed everything about it to have a new job number.


Reinstating removed jobs wasn't my focus, but I appreciate that the issues associated with restoring job folders are likely why the recycle bin isn't employed.

Ryushin
24th December 2018, 05:27
None of which address my questions.

You might have overlooked that TrueHD tracks in blu-ray structures often contain selectable cores. Also, using HD cores to re-encode to AC3 or AAC is not preferred practice.

If I use Core on a TrueHD track, it will extract the AC3 from it. I have yet to see a DTS track in a TrueHD stream. I prefer to to re-encode if necessary. If that AC3 track exists, I copy the stream. If it is DTS, I re-encode to AC3. Selecting Core gives me the most options what to do with the audio track.

legend
24th December 2018, 17:58
Update not working ????

gabbett1
27th December 2018, 16:08
I recently updated my Ripbot and am having issues getting it to complete a job. I'm getting an error text created instead of the video file. The text says this:

"
C:\>"F:\Blue Ray Ripping\EncodingClient.exe" "D:\Temp\RipBot264temp\job1\job1_EncodingClient.meta"

C:\>"F:\Blue Ray Ripping\tools\mp4box\mp4box.exe" -tmp "D:\Temp\RipBot264temp" -add "D:\Temp\RipBot264temp\video.264":name="Pirates Of The Caribbean The Curse Of The Black Pearl" -fps 23.976 -add "D:\Temp\RipBot264temp\job1\Encoded_Audio_1.aac":lang=eng -mpeg4 -chap "D:\Temp\RipBot264temp\job1\chapters.txt" -new "D:\New Uncopied\Pirates Of The Caribbean The Curse Of The Black Pearl\Pirates Of The Caribbean The Curse Of The Black Pearl.mp4"
Cannot find file D:\Temp\RipBot264temp\video.264
Error importing D:\Temp\RipBot264temp\video.264:name=Pirates Of The Caribbean The Curse Of The Black Pearl: Requested URL is not valid or cannot be found
-------------------------

Elapsed Time: 00h:24m:04s"

oRAirwolf
30th December 2018, 14:19
Is anybody else having problems launching the encoding server after updating to 1.23.1? I have tried on 2 different machines, which are both running the latest version of VMware ESXi 6.7 on both Windows 10 1809, Server 2016, and Server 2019. I try to launch the encoding server and nothing happens. No error. It just doesn't open.

ReinerSchweinlin
30th December 2018, 15:03
Did you look up the taskmanager if any old instances of any ripbot part are still active?

slalom
30th December 2018, 15:46
Anyone having problems with auto shut down?
Has already happeden 2 times on one PC

GZZ
30th December 2018, 21:59
My suggestions of building a simple remuxing tool, that also offers some filtering, denoising, & DE, would be very welcome, as most 4K movies probably don't require encoding, and I'm not too interested in reducing file size.

Not possible!

You cant create a remux tool that will apply filters to the video without reencoding it. Its like changing the content of a encrypted zip file without open it! Its the same with video, you need to decode it (unzip), then modify the content and encode it again (zipping). Where zipping is mustly relying on the speed of your hdd and not so much the cpu power. Encoding on the other hand is much more relying on the cpu rather then the hdd and thats why a remuxing tool with those filters is not possible and thats where ripbot264 comes into the picture.

gabbett1
31st December 2018, 03:48
delete

howzz
31st December 2018, 03:57
hi, please excuse me for not reading the entire 820 pages of thread. i've bounced between Handbrake and Ripbot back and forth for the last 10 years. recently looking to come back to Ripbot again due to somewhere i read that Ripbot now supports full front to back H265 HDR UDH 10bit workflow. is that true?

the problem with Handbrake currently is that even though it'll allow you to chose H265 10bit, and it'll take H265 10 bit input, but it still converts it to 8 bit first. so essentially it's still a 8 bit workflow, so missing a lot of the color information. one of their main devs confirmed that the full 10 bit pipeline is still in the works, and likely will not be completely overhauled for a while.

so does Ripbot fully support UHD 10 bit H265 now that it doesn't convert to 8 bit during the conversion? i downloaded the latest version of 1.23.1, and it indeed has the H265 10 bit function, just like Handbrake does, but i just want to confirm with someone, perhaps the dev, that there's no 8 bit process involved in-between if i chose the H265 10 bit option.

thanks

GZZ
31st December 2018, 07:21
hi, please excuse me for not reading the entire 820 pages of thread. i've bounced between Handbrake and Ripbot back and forth for the last 10 years. recently looking to come back to Ripbot again due to somewhere i read that Ripbot now supports full front to back H265 HDR UDH 10bit workflow. is that true?

the problem with Handbrake currently is that even though it'll allow you to chose H265 10bit, and it'll take H265 10 bit input, but it still converts it to 8 bit first. so essentially it's still a 8 bit workflow, so missing a lot of the color information. one of their main devs confirmed that the full 10 bit pipeline is still in the works, and likely will not be completely overhauled for a while.

so does Ripbot fully support UHD 10 bit H265 now that it doesn't convert to 8 bit during the conversion? i downloaded the latest version of 1.23.1, and it indeed has the H265 10 bit function, just like Handbrake does, but i just want to confirm with someone, perhaps the dev, that there's no 8 bit process involved in-between if i chose the H265 10 bit option.

thanks

Yes it does everything in 10bit including filters, but be aware if you use at custom filter.

howzz
31st December 2018, 18:43
Yes it does everything in 10bit including filters, but be aware if you use at custom filter.

thanks!. this is what i was looking for. appreciate it.

nekrosoft13
1st January 2019, 18:37
on a dual Xeon system, how can I activate Numa Node 1?

[SYSTEM] CPU Name = Genuine Intel(R) CPU @ 2.00GHz
[SYSTEM] NUMA Nodes = 2
[SYSTEM] CPU Cores Per Node = 12
[SYSTEM] CPU Threads Per Node = 24
[SERVER] Encoding NUMA Node = 0
[SERVER] Encoding Affinity Mask = 000000001111111111111111
[SERVER] Encoding Priority = normal
[OPENCL] GPU device id 0 = GeForce GT 610 (1CU)
[AVISYNTH] Prefetch Threads = 8
[ADAPTER0] A0-36-9F-A1-21-3D = 192.168.1.102

[2019-01-01 12:40:44] Waiting for connection...

when ever I select Numa node 1 in additional servers and click activate I always end up on Numa node 0

nekrosoft13
1st January 2019, 18:57
If I go into task manager and manually set affinity it uses the cores correctly.

But then when encode task is done, it goes back to node 0 only.

https://forum.doom9.org/attachment.php?attachmentid=16636&stc=1&d=1546368891

circled areas are when I manually set affinity, and you can see it in task manager too, when affinity was set, node 1 (second cpu) also turned on.

slalom
1st January 2019, 19:30
on a dual Xeon system, how can I activate Numa Node 1?

[SYSTEM] CPU Name = Genuine Intel(R) CPU @ 2.00GHz
[SYSTEM] NUMA Nodes = 2
[SYSTEM] CPU Cores Per Node = 12
[SYSTEM] CPU Threads Per Node = 24
[SERVER] Encoding NUMA Node = 0
[SERVER] Encoding Affinity Mask = 000000001111111111111111
[SERVER] Encoding Priority = normal
[OPENCL] GPU device id 0 = GeForce GT 610 (1CU)
[AVISYNTH] Prefetch Threads = 8
[ADAPTER0] A0-36-9F-A1-21-3D = 192.168.1.102

[2019-01-01 12:40:44] Waiting for connection...

when ever I select Numa node 1 in additional servers and click activate I always end up on Numa node 0
Check this page and the next
https://forum.doom9.org/showthread.php?p=1849899#post1849899

check your BIOS settings too

nekrosoft13
1st January 2019, 20:37
Check this page and the next
https://forum.doom9.org/showthread.php?p=1849899#post1849899

check your BIOS settings too


Numa nodes already seem to be active according to task manager

https://forum.doom9.org/attachment.php?attachmentid=16637&stc=1&d=1546375018

And i tried
EncodingServer.exe /node 0
EncodingServer.exe /node 1

still can't get the node 1 active

LigH
1st January 2019, 22:29
@nekrosoft13: Please do not attach images to your posts, their approval takes time until a moderator notices. Instead, upload it to a free image hoster (e.g. frupic, tinypic, imgur ...).

nekrosoft13
2nd January 2019, 00:44
@LigH didn't know

Here are the images again
img 1 https://ibb.co/GxJ5VJt
img 2 https://ibb.co/w6xR6B9

Atak_Snajpera
2nd January 2019, 11:30
For testing purposes check if this works
EncodingServer.exe /node 1 /affinity 1

nekrosoft13
2nd January 2019, 15:56
For testing purposes check if this works
EncodingServer.exe /node 1 /affinity 1

so i tried creating a custom shortcut

with ""C:\Program Files (x86)\RipBot264\EncodingServer.exe" EncodingServer.exe /node 1 /affinity 1"

also tried editing RipBot264.ini
with
UseDistributedEncoding=1
ActivateServers=2
Server1CommandLine=EncodingServer.exe /node 0 /affinity 0 /port 1000 /minimize
Server2CommandLine=EncodingServer.exe /node 1 /affinity 1 /port 2000 /minimize
Server3CommandLine=/port 3000 /minimize /priority low
Server4CommandLine=/port 4000 /minimize /priority low
Server5CommandLine=/port 5000 /minimize /priority low
Server6CommandLine=/port 6000 /minimize /priority low
Server7CommandLine=/port 7000 /minimize /priority low
Server8CommandLine=/port 8000 /minimize /priority low
Server9CommandLine=/port 9000 /minimize /priority low
Server10CommandLine=/port 10000 /minimize /priority low
Server11CommandLine=/port 11000 /minimize /priority low
Server12CommandLine=/port 12000 /minimize /priority low
Server13CommandLine=/port 13000 /minimize /priority low
Server14CommandLine=/port 14000 /minimize /priority low
Server15CommandLine=/port 15000 /minimize /priority low
Server16CommandLine=/port 16000 /minimize /priority low
PreferredLanguage=[eng] English


nothing... maybe i'm not doing it in right place?

This is Server 2019 btw.

Atak_Snajpera
2nd January 2019, 16:05
so i tried creating a custom shortcut

with ""C:\Program Files (x86)\RipBot264\EncodingServer.exe" EncodingServer.exe /node 1 /affinity 1"

also tried editing RipBot264.ini
with
UseDistributedEncoding=1
ActivateServers=2
Server1CommandLine=EncodingServer.exe /node 0 /affinity 0 /port 1000 /minimize
Server2CommandLine=EncodingServer.exe /node 1 /affinity 1 /port 2000 /minimize
Server3CommandLine=/port 3000 /minimize /priority low
Server4CommandLine=/port 4000 /minimize /priority low
Server5CommandLine=/port 5000 /minimize /priority low
Server6CommandLine=/port 6000 /minimize /priority low
Server7CommandLine=/port 7000 /minimize /priority low
Server8CommandLine=/port 8000 /minimize /priority low
Server9CommandLine=/port 9000 /minimize /priority low
Server10CommandLine=/port 10000 /minimize /priority low
Server11CommandLine=/port 11000 /minimize /priority low
Server12CommandLine=/port 12000 /minimize /priority low
Server13CommandLine=/port 13000 /minimize /priority low
Server14CommandLine=/port 14000 /minimize /priority low
Server15CommandLine=/port 15000 /minimize /priority low
Server16CommandLine=/port 16000 /minimize /priority low
PreferredLanguage=[eng] English


nothing... maybe i'm not doing it in right place?

This is Server 2019 btw.

WRONG!

It should be without EncodingServer.exe!
My example was for pure command line in case if want to manually run server outside ripbot264.
https://i.imgsafe.org/ce/ce241d9f7e.png

slalom
2nd January 2019, 16:52
@Atak
v. 1.24.0 looks very nice
Can you please explain the colors green, blue and grey on the graphic?

https://i.ibb.co/SPHZ7Ds/enc.jpg (https://imgbb.com/)

Both are suppesed to work at 100%

What is the button next to the OFF?

Atak_Snajpera
2nd January 2019, 16:59
@Atak
v. 1.24.0 looks very nice
Can you please explain the colors green, blue and grey on the graphic?

https://i.ibb.co/SPHZ7Ds/enc.jpg (https://imgbb.com/)

Both are suppesed to work at 100%

What is the button next to the OFF?

Regarding colors answer is in EncodingServer app ;)
Button next to off button is for auto-reconnection.

nekrosoft13
2nd January 2019, 17:09
CMD didn't work
https://i.ibb.co/HHL0DX5/Untitled3.jpg (https://ibb.co/2k0w75G)

slalom
2nd January 2019, 17:32
Regarding colors answer is in EncodingServer app ;)
Oh, I see what you mean, encoder, decoder and other :thanks:

nekrosoft13
2nd January 2019, 17:56
and the results of .ini file.

https://i.ibb.co/KL9tFDt/Untitled4.jpg (https://ibb.co/qWRHkCH)

Atak_Snajpera
2nd January 2019, 18:14
Can you check how EncodingServer.exe processes were assigned in Task Manager?
https://i.imgsafe.org/cf/cff6f372f6.png

Could you also reduce number of active cores per CPU from 12 to 8 in BIOS and then check if numa node is detected correctly?

nekrosoft13
2nd January 2019, 19:06
with those settings one exe got assigned
NODE 0 from CPU 0 to CPU 23
second EXE got assigned
NODE 0 from CPU 0 to CPU 16

nothing on node 1

can't change BIOS settings at the moment, i'm remoting in at the moment.

Atak_Snajpera
2nd January 2019, 19:13
can't change BIOS settings at the moment, i'm remoting in at the moment.
Let me know once you can do this test. I have some suspicion about 32 thread limit in 32 bit process (EncodingServer.exe) using windows GetNumaProcessorNode (https://docs.microsoft.com/en-us/windows/desktop/api/winbase/nf-winbase-getnumaprocessornode)function.

byteshare
3rd January 2019, 04:50
Loving the new Encoding Server and Encoding Client windows. Thank you very much :)

Wishbringer
3rd January 2019, 10:25
Quotes are necessay to get history of conversation:

Only a remark how good or bad is --opencl in x264:

I am encoding in DE mode.
Two Ryzen 2700X with RX550 and DDR4-3200

using placebo preset...

With opencl enabled for RX550 I get around 13 fps alltogether, but cpu-utilization is around 45%,
when opencl is disabled cpu-utilization increases to 100%, but encoding fps only increases to 19 fps.
(this means higher wattage for CPU but lower demands for GPU)

With opencl enabled and using two encodingservers per Client cpu-utilization stays at around 45%, no increase of encoding fps.
(so opencl at RX550 seems to be the bottleneck, I am curious that opencl at RX550 seems to be slower than without on Ryzen 2700X)

Is there a possible option to enable x264 opencl for the first encodingserver per client and disable for the second one?

Have you checked GPU usage in Task Manager? This would clearly show if GPU is a bottleneck here.


Not yet but I will add this to my short to do list.

UPDATE: Have tried adding incorrect device id to disable opencl acceleration?
/x264-opencl-device-id 9

with "/x264-opencl-device-id 9" at second encodingserver now I got 100% CPU usage.
So your suggestion works. That x264 task from 2nd encodingserver has 0% GPU usage.
Thanks!


now the weird ones:
with one encodingserver using opencl and one encodingserver not using opencl I got per client 100% CPU usage an 2% GPU usage (GPU usage is unexpected low!)
with both encodingservers using opencl per client I got again around 45% CPU usage and 40-60% GPU usage (again unexpected low, expected 100%)
But the difference in GPU usage between one and two servers is remarkable, and curious.

HDD usage can't be the reason: using 1TB 970 Evo M.2 NVMe with around 3.5 GB/Sek reading and 2 GB/Sek writing.
RAM is 64GB DDR4-3200-16-16-18-38
Network is 1GBit per client over HPE 1920S-48 switch (at moment only 3 pcs on it)

the only result I got like expected :
Both encodingservers without opencl gave 100% CPU and 0% GPU usage.

What happens with CPU and GPU usage if you run single encodingserver with opencl ON and then during conversion activate extra server with Opencl OFF?

Not possible at moment, am now at vacation. Around 02.01.19 back.

New test was only with one PC, but with two encodingservers on that client.

Running one encodingserver (with opencl) I got 45% CPU usage, 2% GPU usage and around 5.82 fps average.
Running one encodingserver (without opencl) I got 100% CPU usage, 0% GPU usage and around 8.94 fps average.
Running first opencl EC and then later adding EC without opencl, I got 100% CPU usage, 2% GPU usage and around 7.67 fps average
= less than one EC without opencl, but more than one EC with opencl

In taskmanager x264 task without opencl was allway higher in CPU %, regardless if I changed priority from low to normal of x264-task with opencl enabled.
(so maybe it's a hint that x264 CPU task waiting for opencl GPU part)

Haven't checked powerconsumtion of different usage cases, but it seems, not using opencl is with my config (2700X and RX550) better for performance.

Don't know if other GPUs cause similar results.

byteshare
4th January 2019, 16:32
--asm avx512 used to enable AVX-512 in x265. Default disabled.
For 4K main10 high-quality encoding, we are seeing good gains; for other resolutions and presets, we donít recommend using this setting for now.
was added in HEVC 2.8. I've seen some talk about 4K, wasn't sure if people already were trying this
https://x265.readthedocs.io/en/default/releasenotes.html#version-2-8

pepeq
5th January 2019, 14:07
I discovered RipBot264 in the last days, it's a great piece of software.
Thanks @Atak, I have donated you with a few bucks...:thanks:

The most useful feature for me is the HDR to SDR conversion for UHD, so I can view my UHD-rips on my 4K-capable, but non-HDR-TV (LG 79UF8609 from 2015, 3D was more in the focus than HDR).
it is amazing to do only one click in settings and the HDR2SDR-process is enabled.

The network encoding is also a very nice and unique feature.

In the past I've done my encodings with Handbrake and there the Nvidia NVenc option for encoding gives things a boost.

Question: Is it possible to add the Nvidia NVenc/H265 as an encoder option to RipBot264?
Than it would be perfect for me!

Thank you,
Peter

Ryushin
8th January 2019, 00:15
Can the HQDN3D denoiser be added back? Only one of my four encoding machines even has a video card that can do OpenCL. Everything else is CPU only.

For shows that have every noise, I've been using mdegrain2 and hqdn3d with 4,4,2,2 or something similar. Ad add the temporal at half or less then half of the chroma and mono.

Also found something out with the Numa support. If I disabled memory interleaving to enable Numa, the processors would only be partially utilized when running MDegrain. Turning off Numa then the processors would be fully utilized. So I've disabled Numa for myself.

Atak_Snajpera
8th January 2019, 11:45
Also found something out with the Numa support. If I disabled memory interleaving to enable Numa, the processors would only be partially utilized when running MDegrain. Turning off Numa then the processors would be fully utilized. So I've disabled Numa for myself.
I suppose your issue may be similar to necrosoft's https://forum.doom9.org/showthread.php?p=1861681#post1861681

Ryushin
8th January 2019, 13:19
I suppose your issue may be similar to necrosoft's https://forum.doom9.org/showthread.php?p=1861681#post1861681

Actually, it did not look that way. Each numa node showed about 30% utilization. Maybe mdegrain2 runs better when it sees many cores instead of numa nodes? This was from two Dell R710s.

When I was first setting up the numa I had the same thing happen to me about both going to the same node. Just closed everything again and the problem never returned.

Atak_Snajpera
8th January 2019, 13:34
I have no access to dual socket machines so I can't help here. I can only infer that more available CPU threads means smaller bottleneck while serving frames to encoder.
Basically single 6 core cpu with mdegrain2 is too slow to feed fast enough x264/x265 encoder. In latest version you have a nice graph in encoding server showing how much of cpu time is spent for each process. I predict that x264/x265 uses less cpu time than decoder.

Ryushin
8th January 2019, 13:47
Can the HQDN3D denoiser be added back? Only one of my four encoding machines even has a video card that can do OpenCL. Everything else is CPU only.

Maybe it would be best to HQDN3D out since it is not 10bit (from my understanding) and just add mdegrain3 as you will not have to add any other tools, and just change the options generated in the video script.

Actually, that sounds like a good idea to me. If possible, can you change the denoiser to allow selecting mdegrain, then the toggle arrows to select mdegrain1-6 (if using 2.7) and defaulting to mdegrain2 and adding the toggle arrows or a input box for the thSAD= parameter with a default of 200. If toggle arrows, change the amount by increments of 25.
I'm almost always having to change the thSAD value anytime I choose to use mdegrain. Super heavy noise such as in Blade Runner 4K, I choose 600. For light denoising I'll choose 100. Normal denoising for most content I choose 150-200.

I really think only mdegrain2-3 is necessary. But I'm sure, someone down the line, will ask for 4+

Oh, and add mdegrain* to the advanced setting "Limit to the following filters only"

Ryushin
8th January 2019, 13:53
I have no access to dual socket machines so I can't help here. I can only infer that more available CPU threads means smaller bottleneck while serving frames to encoder.
Basically single 6 core cpu with mdegrain2 is too slow to feed fast enough x264/x265 encoder. In latest version you have a nice graph in encoding server showing how much of cpu time is spent for each process. I predict that x264/x265 uses less cpu time than decoder.

You are probably right there. This is old hardware anyway. It should be up to us choose the right options for our hardware.

BTW, big thumbs up on the new Encoding Client and Encoding Server UI. Very impressed.

Oh, and I cannot begin to tell you how much I like being able to move jobs around in the queue. Especially with my queue being 50-100 jobs deep most of the time.

Balthazar2k4
10th January 2019, 16:04
I've recently got back into doing some encoding and RipBot264 is always my first choice. I am presently setup to use my three machines on my wired LAN to utilize distributed encoding. I do a lot of 4K HDR to 1080P SDR conversions so I need all the speed I can get. That said I am perplexed by the amount of time lost demuxing, indexing, copying to shared folder, and indexing again to use distributed encoding. It seems to me that there could be a real improvement in efficiency by consolidating some of this work in the first pass. 4K HDR files sourced from 4K BD are rather big and on a gigabit network connection still takes a rather significant amount of time to move that volume of data. In this case we are touching the data twice. Would it be possible to streamline this so that if we enable distributed encoding that RipBot264 handles the entire demux/copy to shared folder step in one pass?

Atak_Snajpera
10th January 2019, 16:18
You may try enabling "Move video file to shared folder" in Distributed Encoding tab. This will speedup work only if files are stored locally.

Balthazar2k4
10th January 2019, 16:35
You may try enabling "Move video file to shared folder" in Distributed Encoding tab. This will speedup work only if files are stored locally.

Thanks Atak. I'll give that a try and report back.

UPDATE: This doesn't seem to be any faster, in fact, it's slower. It is simply moving the video to the shared folder which then has to be moved back. I have all of my videos housed on a server which is on my wired network. I am beginning to think that is not 'local' enough.

Is it possible to have the demux process also copy the video stream when it is processing the audio and sub tracks during the initial load?

slalom
10th January 2019, 19:23
UPDATE: This doesn't seem to be any faster, in fact, it's slower. It is simply moving the video to the shared folder which then has to be moved back. I have all of my videos housed on a server which is on my wired network. I am beginning to think that is not 'local' enough.
Obviously, that's not local, that's on the network

Atak_Snajpera
10th January 2019, 19:53
UPDATE: This doesn't seem to be any faster, in fact, it's slower. It is simply moving the video to the shared folder which then has to be moved back. I have all of my videos housed on a server which is on my wired network. I am beginning to think that is not 'local' enough.

Is it possible to have the demux process also copy the video stream when it is processing the audio and sub tracks during the initial load?
By saying locally I meant on the same machine.

Balthazar2k4
10th January 2019, 20:30
Obviously, that's not local, that's on the network

By saying locally I meant on the same machine.

Fair point. I wasn't really quite awake this morning when I was working on it. After a couple cups of coffee it is far more obvious.

pepeq
10th January 2019, 20:45
...

In the past I've done my encodings with Handbrake and there the Nvidia NVenc option for encoding gives things a boost.

Question: Is it possible to add the Nvidia NVenc/H265 as an encoder option to RipBot264?
Than it would be perfect for me!


@Atak: do you think my proposal can be realized?
Or do you think it makes no sense?

Balthazar2k4
11th January 2019, 00:29
I am not sure what happened, but the latest Encoding Server will no longer open on my 9900K. It was working just fine until I rebooted the machine and now the process just hangs. Tried additional reboots with no success so I rolled back to 1.12.5.0 and it works fine. Anyone else experienced this?

Atak_Snajpera
11th January 2019, 10:58
@Atak: do you think my proposal can be realized?
Or do you think it makes no sense?

I do not own nvidia card and chances I will have one in near future are almost zero.

pepeq
11th January 2019, 12:37
I do not own nvidia card and chances I will have one in near future are almost zero.

oh, that are bad news for me...
But I understand, without testing it isn't possible to implement.
If you think I can test something for you, please respond. I will be willing to do so.

pepeq
11th January 2019, 12:55
I am not sure what happened, but the latest Encoding Server will no longer open on my 9900K. It was working just fine until I rebooted the machine and now the process just hangs. Tried additional reboots with no success so I rolled back to 1.12.5.0 and it works fine. Anyone else experienced this?

I had the same problem when EncodingServer.exe changed from 1.12.6 to 1.13.0. And the problem existed also with 1.14.0.

I have 4 PCs (3x Win10 Pro and 1x Win7) and only one of my Win10-PCs had this problem.
EncodingServer.exe was started, the process existed, but no GUI/Window was displayed. It blocked also RipBot264.exe, when I tried to exit Ripbot264.exe.

I analyzed with Windows-taskmanager and found, that an already started process everything.exe (a fast NTFS-searchtool, see voidtools.com) blocked EncodingServer.exe. EncodingServer.exe was waiting for a not longer responding everything.exe process.
I don't know why, because the same everything.exe runs on all of my PCs and made no problem with EncodingServer.exe below 1.13.0.
I killed everything.exe and then EncodingServer.exe continued to run and its window came up.

The strange thing was, that this problem did not alway arise, but in about 90% of the calls to EncodingServer.exe. Maybe a Window-update changed somthing.

I updated everything.exe to the latest version and the problem has gone (until now).

Taskmanager showed the process-queue, see attachment.
Now EncodingServer.exe does not wait for another process and is ok.
I have no picture which showed the blockin queue, because the problem is gone now.

Conclusion: check with taskmanager if some other process is blocking the stalled EncodinServer.exe in your case.

Hope that helps.

Peter

Atak_Snajpera
11th January 2019, 13:27
oh, that are bad news for me...
But I understand, without testing it isn't possible to implement.
If you think I can test something for you, please respond. I will be willing to do so.

I'm not interested in hardware encoding at all because hardware encoders suck in fine detail retention at low bitrates. Another problem. Hardware encoding will also be less useful in Distributed encoding mode where most laptops/pcs use non nvidia GPUs.

Summary

I do not have nvidia GPU and my next GPU will be for 100% AMD navi
Hardware encoders produce noticeable more blurry image at lower bitrates
Many machines in DE mode could not be used for encoding due to incompatible gpu.

Balthazar2k4
11th January 2019, 14:20
I'm not interested in hardware encoding at all because hardware encoders suck in fine detail retention at low bitrates. Another problem. Hardware encoding will also be less useful in Distributed encoding mode where most laptops/pcs use non nvidia GPUs.

Summary

I do not have nvidia GPU and my next GPU will be for 100% AMD navi
Hardware encoders produce noticeable more blurry image at lower bitrates
Many machines in DE mode could not be used for encoding due to incompatible gpu.


To back Atak's point, I have tried GPU encoding for several years. Each year the quality does improve, but the overall image is still nowhere near what traditional CPU encoding can do. Often the image is softer with more compression artifacts and larger file size. The only win is the speed. I can encode 1080p at >200fps on my 2080ti which makes the need for distributed encoding null in my opinion, but the result is so underwhelming that I can't justify it. Also, as soon as you throw any additional filters in the mix such as denoise or tonemapping you lose the speed anyways. I'll stick with distributed encoding for now.

byteshare
11th January 2019, 14:51
Maybe it would be best to HQDN3D out since it is not 10bit (from my understanding) and just add mdegrain3 as you will not have to add any other tools, and just change the options generated in the video script.

Actually, that sounds like a good idea to me. If possible, can you change the denoiser to allow selecting mdegrain, then the toggle arrows to select mdegrain1-6 (if using 2.7) and defaulting to mdegrain2 and adding the toggle arrows or a input box for the thSAD= parameter with a default of 200. If toggle arrows, change the amount by increments of 25.
I'm almost always having to change the thSAD value anytime I choose to use mdegrain. Super heavy noise such as in Blade Runner 4K, I choose 600. For light denoising I'll choose 100. Normal denoising for most content I choose 150-200.

I really think only mdegrain2-3 is necessary. But I'm sure, someone down the line, will ask for 4+

Oh, and add mdegrain* to the advanced setting "Limit to the following filters only"
You can already use the other MDegrain modes. I use MDegrain3 a lot. The only catch is you need to add it as a custom script. I've posted such scripts several times in this thread.

Balthazar2k4
11th January 2019, 15:14
Thanks @pepeq. I have a pretty deep queue processing right now so I'll take a look at it again when it wraps.

UPDATE: Analyzed the wait chain as you suggested and sure enough it was the Discord applet in my Logitech Gaming software that was the hold up. Killed the applet and 'Voila!' loaded right up. What I can't figure out is why it worked the first time and then none of the subsequent. Weird, but problem solved. Thanks again @pepeq.

GZZ
12th January 2019, 14:07
You can already use the other MDegrain modes. I use MDegrain3 a lot. The only catch is you need to add it as a custom script. I've posted such scripts several times in this thread.

I use the MDegrain1 for light Degrain as a custom script, maybe it could be added to the program? I sometimes use MDegrain(1-3) to bring down the size of reencode. MDegrain3 must be heavy denoise, if MDegrain1 is light and MDegrain2 is "normal".

MDegrain1 script

Loadplugin("\RipBot264temp\Tools\AviSynth plugins\mvtools\mvtools2.dll")
super=MSuper(video,pel=2)
fv1=MAnalyse(super,isb=false,delta=1,overlap=4)
bv1=MAnalyse(super,isb=true,delta=1,overlap=4)
video=MDegrain1(video,super,bv1,fv1,thSAD=400)

GZZ
12th January 2019, 20:23
I have a small request.

Will it be possible in the Batch process to save templates with names. Rigth now I can set all the fields and press "Save Default", but I have different settings for reencoding Bluray and encoding 4k movies. Instead of a Save Default it will ask for a template name, then from a Dropdown it will be possible to load a template by its name.

GZZ
13th January 2019, 07:20
Possible small bug:
When I encode a movie and if finish the queue window change the line from: "[JobXX]: Input Filename -> Output Filename" to "*hh:mm:ss* [JobXX]: Input Filename -> Output Filename". But if you check Shutdown Client + Shutdown Server and the next day boot up the computer and go into RipBot264 the encoded jobs still looks like they are stilled queued without a finish time.

Balthazar2k4
13th January 2019, 07:30
I am running into discs as being rejected in batch mode due to no audio track being found despite the title having a track and verifying it does indeed work. Is there some way to correct the issue? These are all titles with Atmos audio.

GZZ
13th January 2019, 08:23
I am running into discs as being rejected in batch mode due to no audio track being found despite the title having a track and verifying it does indeed work. Is there some way to correct the issue? These are all titles with Atmos audio.

I have seen the same issue, especially on Cartoon movies. Examples below. Taken from the JobsRejected file.

Workaround for me has been to disable audio in makemkv, so you get a file without audio and then load and encode this file and then manual remux the audio from the original disc using mkvtoolnix.


File: E:\UHD_mkv\Cars_3_t00.mkv
FFAudioSource: No audio track found
(E:\Temp\RipBot264temp\job95\getinfo.avs, line 4)

File: E:\UHD_mkv\Coco_t00.mkv
FFAudioSource: No audio track found
(E:\Temp\RipBot264temp\job100\getinfo.avs, line 4)

File: E:\UHD_mkv\The_Incredibles_t01.mkv
FFAudioSource: No audio track found
(E:\Temp\RipBot264temp\job7\getinfo.avs, line 4)

File: E:\UHD_mkv\Incredibles 2_t00.mkv
FFAudioSource: No audio track found
(E:\Temp\RipBot264temp\job27\getinfo.avs, line 4)

File: E:\UHD_mkv\Wreck-It Ralph_t01.mkv
FFAudioSource: No audio track found
(E:\Temp\RipBot264temp\job48\getinfo.avs, line 4)

Atak_Snajpera
13th January 2019, 12:41
I am running into discs as being rejected in batch mode due to no audio track being found despite the title having a track and verifying it does indeed work. Is there some way to correct the issue? These are all titles with Atmos audio.

Can you provide a sample? 100-200 mkv should be ok. I will try to find a workaround.

Balthazar2k4
13th January 2019, 18:30
I have seen the same issue, especially on Cartoon movies. Examples below. Taken from the JobsRejected file.

Workaround for me has been to disable audio in makemkv, so you get a file without audio and then load and encode this file and then manual remux the audio from the original disc using mkvtoolnix.

Discovered something interesting today. I decided to take a different approach and re-ripped one of the offenders straight to folder using DeUHD and then process the files with MKVtoolnix directly. That resulting file worked fine in RipBot. Now I'm suspect of MakeMKV as the culprit. I am going to reach out to Mike Chen and see if he has some thoughts on the matter.

GZZ
13th January 2019, 19:04
Can you provide a sample? 100-200 mkv should be ok. I will try to find a workaround.

PM send with link.

GZZ
13th January 2019, 19:06
Discovered something interesting today. I decided to take a different approach and re-ripped one of the offenders straight to folder using DeUHD and then process the files with MKVtoolnix directly. That resulting file worked fine in RipBot. Now I'm suspect of MakeMKV as the culprit. I am going to reach out to Mike Chen and see if he has some thoughts on the matter.


I ran the test sample I made through MkvToolNix and it still reject it.

Balthazar2k4
13th January 2019, 20:59
I ran the test sample I made through MkvToolNix and it still reject it.

What was the original source file?

GZZ
13th January 2019, 21:38
What was the original source file?

Source is UHD

Balthazar2k4
13th January 2019, 21:57
Source is UHD

I meant is this a fresh rip not sourced from MakeMKV? I have now done all three of the titles I have run into with the audio issue via the DeUHD to Folder and MKVtoolnix method successfully.

GZZ
13th January 2019, 22:11
I meant is this a fresh rip not sourced from MakeMKV? I have now done all three of the titles I have run into with the audio issue via the DeUHD to Folder and MKVtoolnix method successfully.

it is sources from MakeMKV. It might be a fault of MakeMKV or maybe mkvtoolnix kills something in the stream.

Ryushin
14th January 2019, 13:35
You can already use the other MDegrain modes. I use MDegrain3 a lot. The only catch is you need to add it as a custom script. I've posted such scripts several times in this thread.

I just replace the MDegrain2 code in the video script with one of my note examples:

The parameter that controls the denoising strength is thSAD. The default of 400 too strong for most sources and 200 seems like a better default. Max seems to be about 800. Does not seem to be any imporovement passed 800. Very minor between 600-800.

#Denoise MDegrain1 Modified
Loadplugin("C:\Program Files\RipBot264\Tools\AviSynth plugins\mvtools\mvtools2.dll")
super=MSuper(video,pel=2)
bv1=MAnalyse(super,blksize=8,isb=true,delta=1,overlap=4)
fv1=MAnalyse(super,blksize=8,isb=false,delta=1,overlap=4)
video=MDegrain1(video,super,bv1,fv1,thSAD=400)

#Denoise MDegrain2 Modified
Loadplugin("C:\Program Files\RipBot264\Tools\AviSynth plugins\mvtools\mvtools2.dll")
super=MSuper(video,pel=2)
bv1=MAnalyse(super,blksize=8,isb=true,delta=1,overlap=4)
bv2=MAnalyse(super,blksize=8,isb=true,delta=2,overlap=4)
fv1=MAnalyse(super,blksize=8,isb=false,delta=1,overlap=4)
fv2=MAnalyse(super,blksize=8,isb=false,delta=2,overlap=4)
video=MDegrain2(video,super,bv1,fv1,bv2,fv2,thSAD=400)

#Denoise MDegrain3 Modified
Loadplugin("C:\Program Files\RipBot264\Tools\AviSynth plugins\mvtools\mvtools2.dll")
super=MSuper(video,pel=2)
bv1=MAnalyse(super,blksize=8,isb=true,delta=1,overlap=4)
bv2=MAnalyse(super,blksize=8,isb=true,delta=2,overlap=4)
bv3=MAnalyse(super,blksize=8,isb=true,delta=3,overlap=4)
fv1=MAnalyse(super,blksize=8,isb=false,delta=1,overlap=4)
fv2=MAnalyse(super,blksize=8,isb=false,delta=2,overlap=4)
fv3=MAnalyse(super,blksize=8,isb=false,delta=3,overlap=4)
video=MDegrain3(video,super,bv1,fv1,bv2,fv2,bv3,fv3,thSAD=400)


blksize : Size of a block (horizontal). It's either 4, 8, 16 or 32 (default is 8).
Larger blocks are less sensitive to noise, are faster, but also less accurate.

overlap: block overlap value (horizontal). Must be even and less than block size (up to blksize/2 for MCompensate). The step between blocks for motion estimation is equal to (blksize-overlap). N blocks cover the size ((blksize-overlap)*N + overlap) on frame. Try use overlap value from blksize/4 to blksize/2. The greater overlap, the more blocks number, and the lesser the processing speed. Default value is 0.

Atak_Snajpera
14th January 2019, 14:43
Ryushin why don't you just create your own MDegrain presets as custom scripts?

byteshare
14th January 2019, 16:01
I use the MDegrain1 for light Degrain as a custom script, maybe it could be added to the program? I sometimes use MDegrain(1-3) to bring down the size of reencode. MDegrain3 must be heavy denoise, if MDegrain1 is light and MDegrain2 is "normal".

MDegrain1 script

Like Atak_Snajpera said to Ryushin: "why don't you just create your own MDegrain presets as custom scripts?" Then you can just select it from the batch screen or the avisynth settings after you add a job.

As for MDegrain 1-6 it isn't about grain alone but how much detail is looked at before removing something. the higher the number of MDegrain it is doing more steps to compare details before deciding if something should be removed or not. There are other settings in the selection process as well.
For how much grain to remove that is primarily based on the SAD value, with higher meaning more grain removal.

GZZ
14th January 2019, 19:16
Like Atak_Snajpera said to Ryushin: "why don't you just create your own MDegrain presets as custom scripts?" Then you can just select it from the batch screen or the avisynth settings after you add a job.

As for MDegrain 1-6 it isn't about grain alone but how much detail is looked at before removing something. the higher the number of MDegrain it is doing more steps to compare details before deciding if something should be removed or not. There are other settings in the selection process as well.
For how much grain to remove that is primarily based on the SAD value, with higher meaning more grain removal.

I do use custom scripts and it workes just fine. Was just thinking why they arent default part of ripbot.

skylinekiller
15th January 2019, 10:47
I have searched the threads about this, but none of the questions were answered. Is it possible to change the font, size, color, and position to the subtitles that are burned in for foreign speaking parts? If not, is there a way to load/use a .ssa file and have it hardcoded? Amazing program, I wish it will get a little more development on subtitle options.

Any assistance is greatly appreciated.

Atak_Snajpera
15th January 2019, 13:31
I have searched the threads about this, but none of the questions were answered. Is it possible to change the font, size, color, and position to the subtitles that are burned in for foreign speaking parts? If not, is there a way to load/use a .ssa file and have it hardcoded? Amazing program, I wish it will get a little more development on subtitle options.

Any assistance is greatly appreciated.

Edit in notepad file Tools\AviSynth plugins\VSFilter\Default.style

Ryushin
15th January 2019, 14:30
Ryushin why don't you just create your own MDegrain presets as custom scripts?

Since I'm always adjusting the strength value, it is just easier to select mdegrain2 from avisynth menu, then just edit the script and change the value. It's rare that I need mdegrain3, and when I do, I just copy and replace the part in the script.

My suggestions for changes were mostly to help others, and to maybe make it look more streamlined and easy to use.

skylinekiller
16th January 2019, 01:12
Is it possible to create an .mp4 output with 5.1 ac3. I would prefer to encode it with aften

skylinekiller
16th January 2019, 08:50
Thank you for the tip on the subtitle, I changed it and will give it a test.

LigH
16th January 2019, 09:00
... 5.1 ac3. I would prefer to encode it with aften

The AC3 encoder in ffmpeg is already superior in quality.

Nevertheless, Atak_Snajpera would decide about the support in RipBot264.

Atak_Snajpera
16th January 2019, 10:53
Is it possible to create an .mp4 output with 5.1 ac3. I would prefer to encode it with aften

Aften is outdated. FFmpeg offers better quality. Why do you need ac3 in mp4? mkv is basically a world wide standard now. Even cheap tv have no problems with this container. mp4 is dead for me. (too limited)

jlpsvk
16th January 2019, 11:03
Aften is outdated. FFmpeg offers better quality. Why do you need ac3 in mp4? mkv is basically a world wide standard now. Even cheap tv have no problems with this container. mp4 is dead for me. (too limited)

because it's possible to mux Two-layer Dolby Vision (on UHD BD) to One-Layer Dolby Vision into MP4, which is playable on TV's from USB and playing Dolby Vision too. :) That's why.

skylinekiller
16th January 2019, 11:36
Well, unfortunately, Apple is always complicated with their formats. I cannot create an MKV encoded at High@L4 with ac3 and drag it to an ipad or other Apple Products, I can drag an .mp4 with ac3.

I'm not the individual who got sucked into the Apple eco prison with its simpleton limitations, but many others have and MKV is not friendly. Am I encoding it wrong? I would like to strictly encode to mkvs but this is an issue

Atak_Snajpera
16th January 2019, 13:15
use aac then.

skylinekiller
16th January 2019, 13:19
I'm not sure that would work either, I can drag an .mp4 with ac3 file just fine on Apple device. I will give it a shot though. I haven't heard of an MKV using aac, usually, it's ac3, but I will give it a go. From what I have read, aac for 5.1 isn't the greatest compared to AC3. Not sure if that's true, but I will see.

Atak_Snajpera
16th January 2019, 15:32
I'm not sure that would work either, I can drag an .mp4 with ac3 file just fine on Apple device. I will give it a shot though. I haven't heard of an MKV using aac, usually, it's ac3, but I will give it a go. From what I have read, aac for 5.1 isn't the greatest compared to AC3. Not sure if that's true, but I will see.

Yeah. AAC 5.1 is so bad that it can produce excellent quality at just 320 kbps. You should definitely stick with ultra old (from mid 90s) ac3.

pepeq
16th January 2019, 15:36
After a nearly complete run RB crashed during combining the chunks. I copied the Chunks-dir to a save place, started RB and restarted the job again..

But now RB started the whole encoding process from the beginning, which takes hours. The newly processed chunk-files are overwritten from the new processes (so I am glad to have saved the Chunks-dir)

Question:
I have all chunks (*.265 files) and audio- and subtitle tracks.
Can I restart RB with combining the chunks?
Or how can I combine the chunks manually to the video.265 file used for the final muxing?

Then I can manually mux with mkvtoolnix.

Thanks.

EDIT:
I found the script CombineAllChunks.cmd in the Chunks-dir. I think that will do the job, right?

GZZ
16th January 2019, 16:27
Well, unfortunately, Apple is always complicated with their formats. I cannot create an MKV encoded at High@L4 with ac3 and drag it to an ipad or other Apple Products, I can drag an .mp4 with ac3.

I'm not the individual who got sucked into the Apple eco prison with its simpleton limitations, but many others have and MKV is not friendly. Am I encoding it wrong? I would like to strictly encode to mkvs but this is an issue

Use VLC Player app, then you can download the mkv from your local network and play it back in VLC player. Works fine on my Ipad Air 2.

GZZ
16th January 2019, 16:29
After a nearly complete run RB crashed during combining the chunks. I copied the Chunks-dir to a save place, started RB and restarted the job again..

But now RB started the whole encoding process from the beginning, which takes hours. The newly processed chunk-files are overwritten from the new processes (so I am glad to have saved the Chunks-dir)

Question:
I have all chunks (*.265 files) and audio- and subtitle tracks.
Can I restart RB with combining the chunks?
Or how can I combine the chunks manually to the video.265 file used for the final muxing?

Then I can manually mux with mkvtoolnix.

Thanks.

EDIT:
I found the script CombineAllChunks.cmd in the Chunks-dir. I think that will do the job, right?

Its the one, just view it in notepad to see what it does. Maybe if failed because a chunk is missing.

skylinekiller
16th January 2019, 19:33
Yeah. AAC 5.1 is so bad that it can produce excellent quality at just 320 kbps. You should definitely stick with ultra old (from mid 90s) ac3.

By no means am I claiming it's better, I just heard. I am always open to advise from the experts. By no means am I an expert in this area. Sine acc is better, why is it not used in all the other mkv releases?

So in your opinion, an MKV with acc is the optimal video file for a balanced quality and file size output? And as far as MKV not being able to be played on the Apple device, is that a bad encode setting or no matter what setting Apple will not allow an MKV? Would encoding at "Main 3.1" work? If so, would it be of lesser quality or are there any downsides?

Ryushin
16th January 2019, 19:48
Yeah. AAC 5.1 is so bad that it can produce excellent quality at just 320 kbps. You should definitely stick with ultra old (from mid 90s) ac3.

The main issue is that that vast majority of AV receivers cannot process AAC 5.1. Most can only do 2.1. From other sources I read:
"AC3 is the lowest discrete format for true surround sound."
"AAC 5.1 isn't a format that can be sent over SPDIF/HDMI to a receiver for decoding."
Another thread: https://forum.kodi.tv/showthread.php?tid=330738

So around 2012 I had to give up using AAC and switched everything to AC3 640 or pass through the native AC3 stream. No doubt that AAC is a better audio compression format in every way compared to AC3, but AV receivers cannot process it without converting it to PCM or something like plex transcoding it to AC3 before sending it to the device.

Sucks really.

skylinekiller
16th January 2019, 19:56
so pretty much aac useless for using traditional receivers? My main use of my encodes are for my plex server for others to watch. Of course, people will have their various sound systems, I happen to have a wireless JBL 5.1 system, others have receivers.

slalom
16th January 2019, 19:58
EDIT:
I found the script CombineAllChunks.cmd in the Chunks-dir. I think that will do the job, right?
That is the one, and then run jobxx_MuxFiles.cmd

You don't need mkvmerge

sneaker_ger
16th January 2019, 20:11
So around 2012 I had to give up using AAC and switched everything to AC3 640 or pass through the native AC3 stream. No doubt that AAC is a better audio compression format in every way compared to AC3, but AV receivers cannot process it without converting it to PCM or something like plex transcoding it to AC3 before sending it to the device.
Converting to PCM isn't a problem when using HDMI. Only SPDIF is typically limited to 2 channel PCM.

skylinekiller
17th January 2019, 20:39
Currently, I have my windows explorer column to show frame width so I can easily see what movie file is at a particular resolution without having to use MediaInfo. I have obtained some mkv files from other sources and have encoded my own with RipBot. My encodes do not show the frame width while the other version does. What do I need to change in my encode for this to become visible? If you see anything else that is off or out of date please let me know

General
UniqueID/String : 324392580738058457477731156267646206380 (0xF40BBD0E3544AE646381156E034E41AC)
CompleteName : I:\Longmire s06e01.mkv
Format : Matroska
Format_Version : Version 4 / Version 2
FileSize/String : 1.03 GiB
Duration/String : 59 min 14 s
OverallBitRate_Mode/String : Variable
OverallBitRate/String : 2 497 kb/s
Movie : Longmire s06e01
Encoded_Date : UTC 2019-01-17 16:21:39
Encoded_Application/String : mkvmerge v29.0.0 ('Like It Or Not') 64-bit
Encoded_Library/String : libebml v1.3.6 + libmatroska v1.4.9

Video
ID/String : 1
Format : AVC
Format/Info : Advanced Video Codec
Format_Profile : High@L4.1
Format_Settings : CABAC / 4 Ref Frames
Format_Settings_CABAC/String : Yes
Format_Settings_RefFrames/String : 4 frames
CodecID : V_MPEG4/ISO/AVC
Duration/String : 59 min 14 s
BitRate_Mode/String : Variable
BitRate/String : 2 048 kb/s
BitRate_Maximum/String : 62.5 Mb/s
Width/String : 1 280 pixels
Height/String : 720 pixels
DisplayAspectRatio/String : 16:9
FrameRate_Mode/String : Constant
FrameRate/String : 23.976 (24000/1001) FPS
ColorSpace : YUV
ChromaSubsampling/String : 4:2:0
BitDepth/String : 8 bits
ScanType/String : Progressive
Bits-(Pixel*Frame) : 0.093
StreamSize/String : 867 MiB (82%)
Encoded_Library/String : x264 core 157 r2935 545de2f
Encoded_Library_Settings : cabac=1 / ref=3 / deblock=1:0:0 / analyse=0x3:0x113 / me=hex / subme=7 / psy=1 / psy_rd=1.00:0.00 / mixed_ref=1 / me_range=16 / chroma_me=1 /
trellis=1 / 8x8dct=1 / cqm=0 / deadzone=21,11 / fast_pskip=1 / chroma_qp_offset=-2 / threads=18 / lookahead_threads=3 / sliced_threads=0 / nr=0 / decimate=1 / interlaced=0 /
bluray_compat=0 / constrained_intra=0 / bframes=3 / b_pyramid=2 / b_adapt=1 / b_bias=0 / direct=1 / weightb=1 / open_gop=0 / weightp=2 / keyint=240 / keyint_min=24 / scenecut=40 /
intra_refresh=0 / rc_lookahead=40 / rc=2pass / mbtree=1 / bitrate=2048 / ratetol=1.0 / qcomp=0.60 / qpmin=0 / qpmax=69 / qpstep=4 / cplxblur=20.0 / qblur=0.5 / vbv_maxrate=62500 /
vbv_bufsize=62500 / nal_hrd=vbr / filler=0 / ip_ratio=1.40 / aq=1:1.00
Default/String : Yes
Forced/String : No
colour_range : Limited
colour_primaries : BT.709
transfer_characteristics : BT.709
matrix_coefficients : BT.709

Audio
ID/String : 2
Format : AC-3
Format/Info : Audio Coding 3
CodecID : A_AC3
Duration/String : 59 min 14 s
BitRate_Mode/String : Constant
BitRate/String : 448 kb/s
Channel(s)/String : 6 channels
ChannelPositions : Front: L C R, Side: L R, LFE
SamplingRate/String : 48.0 kHz
FrameRate/String : 31.250 FPS (1536 SPF)
BitDepth/String : 16 bits
Compression_Mode/String : Lossy
StreamSize/String : 190 MiB (18%)
Language/String : English
ServiceKind/String : Complete Main
Default/String : Yes
Forced/String : No

Menu
00:00:00.000 : en:Chapter 01
00:06:24.134 : en:Chapter 02
00:15:23.089 : en:Chapter 03
00:23:34.038 : en:Chapter 04
00:32:55.307 : en:Chapter 05
00:40:53.034 : en:Chapter 06
00:47:19.170 : en:Chapter 07
00:58:15.283 : en:Chapter 08

Metalfan
17th January 2019, 22:40
Last week I installed RipBot264 to do some HEVC 10bit HDR encoding, which works really fine. During installation updater.exe was moved to quarantine on all our computers by Microsoft antivirus. As some other users also reported this issue in this forum I uploaded the updater.exe version 1.0.2 and 1.0.3 to Microsoft and reported the false positive detection within our software assurance support contract. I was informed after analysis that the files are now excluded from the antivirus database and will no longer be falsely detected as a trojan when using the latest signatures from Windows update. I can confirm that RipBot264 updater now runs without problems. Keep up the great work, thank you.

Privateer5000
19th January 2019, 11:48
Hi, after last Update DE is broken for me. I use 2 machines, connected over Gigabit LAN. The Encoding Server on the second machine does not start encoding, it say that it cannot find the chunk File. Here the output of the encosing server window:

[2019-01-19 12:43:32] Client established connection with server.
[2019-01-19 12:43:32] Command "CONNECT" received from client.
[2019-01-19 12:43:32] Connecting with client... (192.168.0.101:1002)
[2019-01-19 12:43:32] Established connection with client. (192.168.0.101:1002)
[2019-01-19 12:43:33] ERROR! File \\VIPER\RipBot264temp\job4\Chunks\17.cmd does not exist!
[2019-01-19 12:43:33] Encoding terminated.


[2019-01-19 12:43:33] Connection Closed Gracefully.

any idea how to solve this?

Edit:
Forget my post, Last Windows Update reenabled password protected network access on my main machine...... deactivated and it runs again

light5out
19th January 2019, 16:52
I am trying to encode a .TS that is mpeg2. It was recorded from an OTA broadcast in the US. THe video is 29.97 but ripbot has the deinterlace option greyed out. Any idea why this would be?
https://imgur.com/a/GREKgvz

Atak_Snajpera
19th January 2019, 17:25
Upload 100-200 MB sample. I will take a look.

light5out
19th January 2019, 17:36
Upload 100-200 MB sample. I will take a look.

I don't know how to cut the file. I don't currently have a tuner to record a small sample it is coming in the mail. I sent the other one back.

Atak_Snajpera
19th January 2019, 17:53
I don't know how to cut the file. I don't currently have a tuner to record a small sample it is coming in the mail. I sent the other one back.

https://www.softpedia.com/get/System/File-Management/DGSplit.shtml

byteshare
19th January 2019, 18:46
I've brought it up before, but is it possible in the batch mode to set a custom crop?
I've been using the auto crop, but it doesn't always get it right.

Right now I have about 78 files that should all have a crop of L 240 and a R 240 but many (not all) are L238 R240 and all of those have a small black line on the left side, so I'm having to go through each job and check manually, which IMO defeats the purpose of the autocrop.

light5out
19th January 2019, 18:48
https://www.softpedia.com/get/System/File-Management/DGSplit.shtml

For some reason I can't load the download page, getting an error.

pepeq
19th January 2019, 19:11
you can download DGsplit from here:

http://rationalqm.us/mine.html

light5out
19th January 2019, 19:21
https://www.softpedia.com/get/System/File-Management/DGSplit.shtml

Thank man!

https://ufile.io/gj8t7

Here you go OP, hopefully that site works never used it before.

light5out
23rd January 2019, 16:13
Thank man!

https://ufile.io/gj8t7

Here you go OP, hopefully that site works never used it before.

I recorded the same show and have the same problem, I did a test of a random recording and it worked on that one, any idea why.

Again the options to deinterlace are greyed out.

Atak_Snajpera
23rd January 2019, 16:37
Option is greyed out because your video does not have constant frame rate. Detected FPS has to be 29.97 or 25.

BTW. I'm shocked that big broadcasters in USA still use MPEG-2 format for HD content. In EU only MPEG-4 AVC is used in HD (and probably in SD as well).

LigH
23rd January 2019, 23:36
Germany still uses MPEG-2 for SD broadcasts via DVB-S.

light5out
24th January 2019, 05:19
Option is greyed out because your video does not have constant frame rate. Detected FPS has to be 29.97 or 25.

BTW. I'm shocked that big broadcasters in USA still use MPEG-2 format for HD content. In EU only MPEG-4 AVC is used in HD (and probably in SD as well).

Ok, so what do you recommend I do with it, I notice when I did an encode it came out at like 25.3 fps or something. (and it was way out of sync) Basically I just want to shrink it down.

Wishbringer
24th January 2019, 06:59
Anyone having problems with auto shut down?
Has already happeden 2 times on one PC

Received yesterday a new core update for RB 1.24.0.
Was hoping that issue with non-closing/ non-responding application would be solved.

Issue is still there: When trying to close RB (manuell or per checkbox after completing encode), window closes, but RB still shows up in taskbar, but isn't responding anymore.
So autoshutdown doesn't happen too.

New start of RB isn't possible except i kill task in taskmanager before.

Atak_Snajpera
24th January 2019, 12:03
Germany still uses MPEG-2 for SD broadcasts via DVB-S.

In Poland only MPEG-4 AVC exists even in SD.

light5out
24th January 2019, 15:28
Ok, so what do you recommend I do with it, I notice when I did an encode it came out at like 25.3 fps or something. (and it was way out of sync) Basically I just want to shrink it down.

Also can someone help me understand how to identify that it is variable framerate?

byteshare
24th January 2019, 15:41
Received yesterday a new core update for RB 1.24.0.
Was hoping that issue with non-closing/ non-responding application would be solved.

Issue is still there: When trying to close RB (manuell or per checkbox after completing encode), window closes, but RB still shows up in taskbar, but isn't responding anymore.
So autoshutdown doesn't happen too.

New start of RB isn't possible except i kill task in taskmanager before.
Which Windows Version are you on? Do you have antivirus or anything running? I haven't had this issue in Windows 7 or Windows 10.

Ok, so what do you recommend I do with it, I notice when I did an encode it came out at like 25.3 fps or something. (and it was way out of sync) Basically I just want to shrink it down.

Sometimes Media info can help see if the file is a variable FPS, or if you look at the FPS info while playing the file, if your video player shows the FPS in realtime.

As for syncing up the audio/video, have you tried TimeCodes?

https://forum.doom9.org/showthread.php?p=1849546&highlight=timecodes#post1849546

...try copying the timestamp file from source to your encoded file. This is especially helpful with variable frame rate files.

Extracting timecodes (windows batch file):
Code:
FOR %%A IN (*.mkv) DO "C:\Program Files\MKVToolNix\mkvextract.exe" timecodes_v2 "%%A" "0:%%A_timecodes.txt"
^^ The above is for running the batch file in the same folder as the video files that you want to extract the timestamp info from (source)

Batch importing with Encoded files in the same folder as the extracted timecodes .txt files(windows batch file)
Code:
FOR %%A IN (*.mkv) DO "C:\Program Files\MKVToolNix\mkvmerge.exe" -o "%%~A-fixed.mkv" --timecodes "0:%%A_timecodes.txt" "%%~A"
If you're working with something other than MKVs you'd want to change that in the scripts.

The above has the batch version but you can do this with MKVExtract and the GUI.

byteshare
24th January 2019, 15:44
HEVC 3.0 stable is out:
3.0+1-ed72af8
http://msystem.waw.pl/x265/

Release notes:
https://bitbucket.org/multicoreware/x265/commits/a6a12bc3ccf4b3138f1d62b2a81c9c40c3c88d62#chg-doc/reST/releasenotes.rst
+New features
+-------------
+1. option:: '--dolby-vision-profile <integer|float>' generates bitstreams confirming to the specified Dolby Vision profile. Currently profile 5, profile 8.1 and profile 8.2 enabled, Default 0 (disabled)
+
+2. option:: '--dolby-vision-rpu' File containing Dolby Vision RPU metadata. If given, x265's Dolby Vision metadata parser will fill the RPU field of input pictures with the metadata
+ read from the file. The library will interleave access units with RPUs in the bitstream. Default NULL (disabled).
+
+3. option:: '--zonefile <filename>' specifies a text file which contains the boundaries of the zones where each of zones are configurable.
+
+4. option:: '--qp-adaptation-range' Delta-QP range by QP adaptation based on a psycho-visual model. Default 1.0.
+
+5. option:: '--refine-ctu-distortion <0/1>' store/normalize ctu distortion in analysis-save/load. Default 0.
+
+6. Experimental feature option:: '--hevc-aq' enables adaptive quantization
+ It scales the quantization step size according to the spatial activity of one coding unit relative to frame average spatial activity. This AQ method utilizes
+ the minimum variance of sub-unit in each coding unit to represent the coding unit’s spatial complexity.
+
+Encoder enhancements
+--------------------
+1. Preset: change param defaults for veryslow and slower preset. Replace slower preset with defaults used in veryslow preset and change param defaults in veryslow preset as per experimental results.
+2. AQ: change default AQ mode to auto-variance
+3. Cutree offset reuse: restricted to analysis reuse-level 10 for analysis-save -> analysis-load
+4. Tune: introduce --tune animation option which improves encode quality for animated content
+5. Reuse CU depth for B frame and allow I, P frame to follow x265 depth decision
+
+Bug fixes
+---------
+1. RC: fix rowStat computation in const-vbv
+2. Dynamic-refine: fix memory reset size.
+3. Fix Issue #442: linking issue on non x86 platform
+4. Encoder: Do not include CLL SEI message if empty
+5. Fix issue #441 build error in VMAF lib

light5out
24th January 2019, 17:30
Which Windows Version are you on? Do you have antivirus or anything running? I haven't had this issue in Windows 7 or Windows 10.



Sometimes Media info can help see if the file is a variable FPS, or if you look at the FPS info while playing the file, if your video player shows the FPS in realtime.

As for syncing up the audio/video, have you tried TimeCodes?

https://forum.doom9.org/showthread.php?p=1849546&highlight=timecodes#post1849546



The above has the batch version but you can do this with MKVExtract and the GUI.
I have not done that and thank you. I am a noob when it comes to encoding. I am looking for an easy way to shrink DVR recordings. I have used ripbot in the past and like it, but the interlaced thing always seems to be a headache. I don't even need to deinterlace if there is a way to shrink the file but keep all that the same. Because the mpeg2's look great, they are just too big.

Wishbringer
24th January 2019, 20:39
@byteshare:
Three z270, 7700k, 64gb ram, 2tb 970 Evo, vega64 with Win10pro 17763.292 (at home)
Two x470, 2700x, 64gb, 1tb 960 Evo, RX550 with Win10pro 17134.xxx (at work)
Only ms defender as av.
Issue with each of them. One z270 has a fresh reinstall today (17763.107 iso + Cu292) + drivers.
Does not happen with an old local install of RB1.23.

LigH
24th January 2019, 20:56
@byteshare: It's not the HEVC standard, but the x265 encoder, which reached version 3.0.

Ryushin
25th January 2019, 01:18
When using using hevc, and clicking on the profile ... button, and selecting a tune, such as animation, the DE Client just keeps starting the servers over and over with no progress. Changing it back to default (removes the --tune option) allows it to work again.

The encoding server says:
x265 [error]: preset or tune unrecognized

LigH
25th January 2019, 07:13
Don't assume that x265 provides all the same tunings as x264; that's not true.

Ryushin
25th January 2019, 14:45
Don't assume that x265 provides all the same tunings as x264; that's not true.

Actually, that is an option provided by Atak in the hevc settings.

Looking at: https://x265.readthedocs.io/en/default/presets.html
Also shows the --tune animation option there.

Just bringing this to Atak's attention.

chainring
25th January 2019, 17:57
I've had the same error occur as Ryushin, and only when DE is active. Single machine processing, no problem.

Adding to this, another problem only in DE mode is, anytime I attempt to de-noise with KNLMeansCL (any mode, including adaptive), the encoding on remote servers stalls. All remote servers (two of them) have dedicated GPUs, and both show OpenCL to be active. I've installed all the Visual C++ runtimes via a repack from repacks.net. De-noising with only MDegrain2 works perfectly in DE mode, if it matters.

chainring
25th January 2019, 18:04
Separate issue from the DE enabled encoding above...

What's the proper way to add an Avisynth plugin? I'm trying to use AutoAdjust from LaTo at: https://forum.doom9.org/showthread.php?t=167573 . I've manually loaded the .dll in the script, and it shows to be shared when looking at the .avs in the chunks directory, yet encoding fails. I've tried both the 32 and 64 bit versions.

Thanks!

Atak_Snajpera
25th January 2019, 18:32
Separate issue from the DE enabled encoding above...

What's the proper way to add an Avisynth plugin? I'm trying to use AutoAdjust from LaTo at: https://forum.doom9.org/showthread.php?t=167573 . I've manually loaded the .dll in the script, and it shows to be shared when looking at the .avs in the chunks directory, yet encoding fails. I've tried both the 32 and 64 bit versions.

Thanks!

Have you copied all files to own folder in Tools\AviSynth plugins

chainring
25th January 2019, 19:47
Have you copied all files to own folder in Tools\AviSynth plugins
I did. Specifically, within \Tools\Avisynth plugins, I've created an AutoAdjust folder, then within that is the AutoAdjust.dll. I've tried both the 32 and 64 bit version.

Atak_Snajpera
25th January 2019, 19:56
Open 1.avs from server side in some media player and check an error message.

byteshare
25th January 2019, 20:25
@byteshare:
Three z270, 7700k, 64gb ram, 2tb 970 Evo, vega64 with Win10pro 17763.292 (at home)
Two x470, 2700x, 64gb, 1tb 960 Evo, RX550 with Win10pro 17134.xxx (at work)
Only ms defender as av.
Issue with each of them. One z270 has a fresh reinstall today (17763.107 iso + Cu292) + drivers.
Does not happen with an old local install of RB1.23.
Hmm, I can't think of what is common between both of your machines, and what is different about my 4 boxes that I'm not having that issue with. Maybe Atak might have an idea.


@byteshare: It's not the HEVC standard, but the x265 encoder, which reached version 3.0.
I didn't intend to make that claim, but yes, I agree with you and thank you for mentioning that if anyone was confused by that.
I can understand HEVC/x265 being confused, as I did...since they are synonymous to me at this point.

GZZ
26th January 2019, 08:21
Enlighten me on this one.

What is needed to reencode a movie including Dolby Vision, seeing the new x265 3.0 support several dolby vision profiles? A tool to extract the dolby vision data from a UHD in order to process it ?

Ryushin
27th January 2019, 15:36
The last few days I've had artifact issues with encoding a VC-1 blu-ray source. I must have re-encoded a dozen times with different settings trying to figure out what was wrong. Even tried handbrake to no avail. Eventually I tried a lossless h.264 encode using CRF 0 and I still had the artifacts. Googling seems to point to a decoding issue:
https://forum.videohelp.com/threads/388829-Annoying-Pixelating-Blocking-After-Encoding-in-Handbrake

So I installed XMedia Recode and I selected the DXVA decoder for VC-1 in the settings and I'm now saving it as a lossless jpeg. The preview did not show any artifacts. If it remains clean I'll use RB to encode that to x265.

Atak, I never knew of this issue with VC-1. Reading the thread says using the MS decoder solves the problem. Is it possible to implement a solution that solves the decoder problems for all VC-1 sources. Looks like ffmpeg might have just fixed this bug very recently as well.

Spasm
27th January 2019, 19:24
with those settings one exe got assigned
NODE 0 from CPU 0 to CPU 23
second EXE got assigned
NODE 0 from CPU 0 to CPU 16

nothing on node 1

can't change BIOS settings at the moment, i'm remoting in at the moment.
Let me know once you can do this test. I have some suspicion about 32 thread limit in 32 bit process (EncodingServer.exe) using windows GetNumaProcessorNode (https://docs.microsoft.com/en-us/windows/desktop/api/winbase/nf-winbase-getnumaprocessornode)function.

Any progress? I have dual 14-core CPUs and I don't get anything on Node 1 either.

I'll try disabling cores, though not sure how.

Ryushin
28th January 2019, 12:35
The last few days I've had artifact issues with encoding a VC-1 blu-ray source.

So I installed XMedia Recode and I selected the DXVA decoder for VC-1 in the settings and I'm now saving it as a lossless jpeg. The preview did not show any artifacts. If it remains clean I'll use RB to encode that to x265.


Had to end up doing a lossless H.265 encode as input to RB as RB did not understand the lossless jpeg. The issue was very much the decoder.

Atak, let me know if you need the problem sample source.

Atak_Snajpera
28th January 2019, 12:58
Had to end up doing a lossless H.265 encode as input to RB as RB did not understand the lossless jpeg. The issue was very much the decoder.

Atak, let me know if you need the problem sample source.

Check this build
https://www.mediafire.com/file/2y243yl482bz47h/ffms2-20181016-f3c6b00-win64.7z/file

Extract files to Tools\AviSynth plugins\ffms\x64

Atak_Snajpera
28th January 2019, 12:59
Any progress? I have dual 14-core CPUs and I don't get anything on Node 1 either.

I'll try disabling cores, though not sure how.

No because I have no physical access to dual cpu machine.

Ryushin
28th January 2019, 17:31
Check this build
https://www.mediafire.com/file/2y243yl482bz47h/ffms2-20181016-f3c6b00-win64.7z/file

Extract files to Tools\AviSynth plugins\ffms\x64

This fixed the problem. Thanks so much.

Atak_Snajpera
28th January 2019, 19:02
This fixed the problem. Thanks so much.

Do not get to excited too early! Make sure that this version is frame accurate first! In other words check if chunks start from correct frame! There is good reason why I use two versions of ffms2 plugin in RipBot264.

Ryushin
28th January 2019, 20:13
Do not get to excited too early! Make sure that this version is frame accurate first! In other words check if chunks start from correct frame! There is good reason why I use two versions of ffms2 plugin in RipBot264.

Oh, I think I remember the other bug now about it being frame accurate. You fixed that last time I found an issue.

I guess I'll need to watch a large portion of it to be sure.

What about using a different decoder for vc-1 sources?

Atak_Snajpera
28th January 2019, 20:19
Oh, I think I remember the other bug now about it being frame accurate. You fixed that last time I found an issue.

I guess I'll need to watch a large portion of it to be sure.

What about using a different decoder for vc-1 sources?

Other decoders are not frame accurate. Especially those using DirectShowSource interface.

Ryushin
28th January 2019, 21:12
Other decoders are not frame accurate. Especially those using DirectShowSource interface.

Yep, 4 minutes in, corruption. So I'll revert that.

Maybe another way around this is to have an option to convert from VC-1 to h.264/5 lossless using a single machine and then encode from that. The user would have to know his source would grow much larger then the original.

byteshare
30th January 2019, 02:54
In the bottom right of the "RipBot264 Encoding Client" what does the button that looks like a yellow triangle with an exclamation mark in the middle do?
when I click it, I'm not really seeing much happen.
Update: Oh, got it...opens the EncodingClientLog.txt

NiGHTsC
30th January 2019, 03:26
Off-Topic

Jan 23,2019
Anyone ever noticed this...
So grateful you're still working on RB, Atak_Snajpera

jlpsvk
30th January 2019, 21:12
any plans to implement nvencc64?

BLKMGK
31st January 2019, 04:36
May have found a bug, I've only been able to repro it 2x although I'm nervous I may have accidentally triggered it far more often. Scenario is that I'm converting many TV shows one after another. Occasionally I will have batch added a series of shows and decide I need to add others and prioritize them higher than existing jobs. So I batch add those and slide them to the top to be processed ahead of the previously added batches. On at LEAST two occasions upon doing this I've reviewed the results and found a show with a different show's soundtrack muxxed in. Unfortunately finding these screwed up episodes is going to be nearly impossible considering the volume I'm working with :( I'm not sure this error is consistent, I sure hope not, but if I can reproduce it I will save the job files. I'm on v1.24.0 right now...

byteshare
31st January 2019, 08:09
any plans to implement nvencc64?
The dev can speak to this but unless something changed there aren't plans.

pepeq
31st January 2019, 12:14
any plans to implement nvencc64?

I asked Atak the same question,
see Ataks answer here:

https://forum.doom9.org/showthread.php?p=1862510#post1862510

forkicks
1st February 2019, 20:17
May have found a bug, I've only been able to repro it 2x although I'm nervous I may have accidentally triggered it far more often. Scenario is that I'm converting many TV shows one after another. Occasionally I will have batch added a series of shows and decide I need to add others and prioritize them higher than existing jobs. So I batch add those and slide them to the top to be processed ahead of the previously added batches. On at LEAST two occasions upon doing this I've reviewed the results and found a show with a different show's soundtrack muxxed in. Unfortunately finding these screwed up episodes is going to be nearly impossible considering the volume I'm working with :( I'm not sure this error is consistent, I sure hope not, but if I can reproduce it I will save the job files. I'm on v1.24.0 right now...

I can confirm this. In my case, i narrowed it down to a couple of files that i was trying to convert from avc to 265. The extraction phase could not get the video file from it, and would (wrongly) use the video265 file that was leftover on the Temp folder from the previous conversion, resulting in a file with the correct output name, wrong video track and correct audio track. Also, ripbot showed no error.

In my view, this could be fixed in one of two ways:
1 (and best): before every new file, clear all existing items in the temp folder. This way it would fail and detect the fail because no previous file would exist that could be reused

2: Try to detect when video track extraction fails better. No idea what was causing it to fail in the first place, the file read perfectly fine, no errors, no sync problems, nothing reported wrong at all by other programs (mkvtoolnix, for example).

This is a really big problem because i also run several dozen file batches per day, and now i can't be sure if my previous conversions are right or not. This is silent data corruption at its worst, and in my case, i caught it completely by chance. I'm running the latest version (could not find any updates just now).

Thank your for your time,
fK

GZZ
1st February 2019, 22:15
Tune --Animation isnt working. I have a Ma10 profile where tune is on default, chaning ot to animation and the encoding wont start. In DE mode it will just throggle between encoding and idle forever, chaning it to default and its all working again. Maybe its a bad command.

From the Profiles folder:
"--profile main10 --output-depth 10 --tune animation" - not working
"--profile main10 --output-depth 10" - Working fine.

activoice
2nd February 2019, 01:36
Posting this here to help anyone out who might find this useful.

RunCommandSuccess and RunCommandError were added to RipBot264.ini with version 1.24 and here is how I am using it to receive a notification on my phone whenever an encoding job completes

I have these 2 lines added to RipBot264.ini
RunCommandSuccess="C:\Scripts\RipbotSuccess.cmd" %JOB%
RunCommandError="C:\Scripts\RipbotError.cmd" %JOB%

In C:\Scripts\ I have curl.exe and the 2 batch files below
RipbotSuccess.cmd
c:\scripts\curl.exe -u {pushbullet token}: https://api.pushbullet.com/v2/pushes -d type=note -d title="Ripbot264" -d body=%1+"Job Completed Succesfully"

RipbotError.cmd
c:\scripts\curl.exe -u {pushbullet token}: https://api.pushbullet.com/v2/pushes -d type=note -d title="Ripbot264" -d body=%1+"Job Failed"

So with PushBullet installed on my phone I now get notifications whenever an encoding job completes

https://imgur.com/9utHM5s

BLKMGK
2nd February 2019, 04:58
I can confirm this. In my case, i narrowed it down to a couple of files that i was trying to convert from avc to 265. The extraction phase could not get the video file from it, and would (wrongly) use the video265 file that was leftover on the Temp folder from the previous conversion, resulting in a file with the correct output name, wrong video track and correct audio track. Also, ripbot showed no error.

In my view, this could be fixed in one of two ways:
1 (and best): before every new file, clear all existing items in the temp folder. This way it would fail and detect the fail because no previous file would exist that could be reused

2: Try to detect when video track extraction fails better. No idea what was causing it to fail in the first place, the file read perfectly fine, no errors, no sync problems, nothing reported wrong at all by other programs (mkvtoolnix, for example).

This is a really big problem because i also run several dozen file batches per day, and now i can't be sure if my previous conversions are right or not. This is silent data corruption at its worst, and in my case, i caught it completely by chance. I'm running the latest version (could not find any updates just now).

Thank your for your time,
fK

Well, at least it isn't just me! Sadly unlike when I was creating files with no soundtrack (don't check the "skip demuxing" box!) I cannot easily find the files with bad data. I am HOPING I caught it early by happenstance and got lucky as spot checking a pile of files didn't find bad ones but that would be a miracle if true!

byteshare
2nd February 2019, 08:27
Tune --Animation isnt working. I have a Ma10 profile where tune is on default, chaning ot to animation and the encoding wont start. In DE mode it will just throggle between encoding and idle forever, chaning it to default and its all working again. Maybe its a bad command.

From the Profiles folder:
"--profile main10 --output-depth 10 --tune animation" - not working
"--profile main10 --output-depth 10" - Working fine.

If using x265 the tune animation isn't working because the x265 needs to be updated.

GZZ
2nd February 2019, 10:31
If using x265 the tune animation isn't working because the x265 needs to be updated.

It have several tune, normally I use default, but I had a animation movie, not sure how much different the animation vs default will do.

I see its version x265 2.9+14 and Animation is first supported in 3.0. Then it makes sense.

Atak_Snajpera
2nd February 2019, 16:50
I can confirm this. In my case, i narrowed it down to a couple of files that i was trying to convert from avc to 265. The extraction phase could not get the video file from it, and would (wrongly) use the video265 file that was leftover on the Temp folder from the previous conversion, resulting in a file with the correct output name, wrong video track and correct audio track. Also, ripbot showed no error.

In my view, this could be fixed in one of two ways:
1 (and best): before every new file, clear all existing items in the temp folder. This way it would fail and detect the fail because no previous file would exist that could be reused

2: Try to detect when video track extraction fails better. No idea what was causing it to fail in the first place, the file read perfectly fine, no errors, no sync problems, nothing reported wrong at all by other programs (mkvtoolnix, for example).

This is a really big problem because i also run several dozen file batches per day, and now i can't be sure if my previous conversions are right or not. This is silent data corruption at its worst, and in my case, i caught it completely by chance. I'm running the latest version (could not find any updates just now).

Thank your for your time,
fK

Done!

byteshare
3rd February 2019, 15:33
In one of the most recent updates the "Abort" / "Start" stopped working properly for me under these conditions:
1. I start a job and at some "Abort" the job.
2. I try to "Start" the jobs again.
3. A job will never start, rather it gets stuck on the "Please Wait....Gathering information..." and also gets stuck "Aborting..."

I have to kill the Encoding Client, close RipBot and restart RipBot to get a job to start again.

Done!
Awesome and thank you, that was a long standing issue...I don't know why I didn't mention it myself :)

jlpsvk
3rd February 2019, 20:20
Another suggestion. :)

Possibility to set HDR10+ metadata file for include in encode. Or better to check source for HDR10+ metadata, if present, extract and include in encode automatically. :)

forkicks
4th February 2019, 11:24
Done!

Thanks!

Also, i just noticed the program has problems when converting files with "+" in the filename ("This fileSOMETHING+OTHER.mkv" -OR- "+" in the track name ("DD+" in audio track for example). Those are valid filenames and track names, so should be supported, or renamed as a preprocessing step.

Thank you for your time,
fK

byteshare
5th February 2019, 15:42
Thank you for updating the x265 version.

byteshare
7th February 2019, 15:34
Really a small thing but on Windows 7 and Windows 10, I've noticed if you tab through the crop settings (to manually adjust), the Tab key goes from Top > Bottom > Right. Left is being skipped. I noticed if I click into left and hit Tab it goes to the ">" key, so it is out of order in some why.
I noticed this after going through dozens of files having to make small corrections, otherwise I'd probably have missed it because normally I'd just use the mouse.

byteshare
9th February 2019, 11:34
I lost power on a machine and all of the jobs are still in the temp folder but for some reason the jobs.list and jobs.state are gone.
I would guess this might have happened because the jobs.list is held open directly/constantly rather than being accessed when needed?
I don't think there is an easy way to restore the jobs.list without just re-adding all of the jobs.

Atak_Snajpera
9th February 2019, 11:53
I lost power on a machine and all of the jobs are still in the temp folder but for some reason the jobs.list and jobs.state are gone.
I would guess this might have happened because the jobs.list is held open directly/constantly rather than being accessed when needed?
I don't think there is an easy way to restore the jobs.list without just re-adding all of the jobs.

Do not touch anything (or copy temp folder to other location). I will try to implement automatic recovery for this case.

byteshare
9th February 2019, 12:42
Other decoders are not frame accurate. Especially those using DirectShowSource interface.
I have it backed up for now.

I've brought it up before, but is it possible in the batch mode to set a custom crop?
I've been using the auto crop, but it doesn't always get it right.

Right now I have about 78 files that should all have a crop of L 240 and a R 240 but many (not all) are L238 R240 and all of those have a small black line on the left side, so I'm having to go through each job and check manually, which IMO defeats the purpose of the autocrop.
I was trying to batch edit the crop with the jobxxxx.avs and jobxxxx.ini, but that doesn't seem to be enough because the crop isn't taking for during the encode. After editing the two files if I go into the AviSynth Filters the crop setting is still set to Do not crop, however if I look at the script "Show Video Scrpit" I do see my crop settings.
Is there another location I need to edit?

Atak_Snajpera
9th February 2019, 12:47
Right now I have about 78 files that should all have a crop of L 240 and a R 240 but many (not all) are L238 R240 and all of those have a small black line on the left side, so I'm having to go through each job and check manually, which IMO defeats the purpose of the autocrop.
Can you upload some problematic samples. I will try to adjust autocrop algorithm.

byteshare
9th February 2019, 14:18
Can you upload some problematic samples. I will try to adjust autocrop algorithm.
Sure, I'll do that and PM you the link once it is done...slow upload, sorry.
The ones that I originally was having issues with I already finished and have moved on, but I have some new issue ones.
But, IMO, being able to define the crop in batch mode would be more helpful because 9 out of time times it works but it leaves me still having to check every single job.

Atak_Snajpera
9th February 2019, 15:09
Sure, I'll do that and PM you the link once it is done...slow upload, sorry.
The ones that I originally was having issues with I already finished and have moved on, but I have some new issue ones.
But, IMO, being able to define the crop in batch mode would be more helpful because 9 out of time times it works but it leaves me still having to check every single job.

I prefer to improve autocrop...

byteshare
9th February 2019, 15:52
I prefer to improve autocrop...
PM Sent with test files

Atak_Snajpera
9th February 2019, 16:20
PM Sent with test files

None of your files have horizontal bars.

Right now I have about 78 files that should all have a crop of L 240 and a R 240 but many (not all) are L238 R240 and all of those have a small black line on the left side, so I'm having to go through each job and check manually, which IMO defeats the purpose of the autocrop.

byteshare
9th February 2019, 16:40
None of your files have horizontal bars.
I don't have the old files anymore, but the ones I sent also aren't working correctly. I was quoting my old message because to me I'm having the same issue, which is auto crop isn't working correctly.
In the batch I sent, some have horizontal, some vertical, and some both.
Black Jack file has horizontal bars.

Atak_Snajpera
9th February 2019, 16:42
I don't have the old files anymore, but the ones I sent also aren't working correctly. I was quoting my old message because to me I'm having the same issue, which is auto crop isn't working correctly.
In the batch I sent, some have horizontal, some vertical, and some both.
Black Jack file has horizontal bars.

My mistake ,I meant vertical bars.

byteshare
9th February 2019, 17:24
My mistake ,I meant vertical bars.
Crest.of.the.Stars.(Seikai.no.Monshou).08 has a vertical bar, or do you mean more standard 4:3 in a 16:9 file?

Atak_Snajpera
9th February 2019, 17:38
Crest.of.the.Stars.(Seikai.no.Monshou).08 has a vertical bar, or do you mean more standard 4:3 in a 16:9 file?

works fine

https://i.imgsafe.org/f1/f1004a0946.png

byteshare
9th February 2019, 17:53
works fine

https://i.imgsafe.org/f1/f1004a0946.png

Huh, didn't for me:
https://i.imgur.com/4KUtLRu.jpg

What about Cryon Shin 02?
https://i.imgur.com/AL09gTX.jpg

Did all 31 files work for you?

Atak_Snajpera
9th February 2019, 18:12
Because You use non standard DPI scaling. My app was designed for default 100%. BTW. scaling in win10 works differently than in win7. Win10 resamples content of the window and hence everything looks correctly. On other hand win7 only increased system UI elements like buttons and so on. Rest remains untouched and looks weird like you see.

What about Cryon Shin 02?
Autocrop does not crop this black line because top/bottom line is not fully covered.
https://i.postimg.cc/5yghCJxQ/Crayon-Shin-chan-02abc-English-Vitello-dub-ATTKC-AE9068-BE-002.png

byteshare
9th February 2019, 18:16
Because You use non standard DPI scaling. My app was designed for default 100%. BTW. scaling in win10 works different than in win7. Win10 resamples content of the window and hence everything looks correct. On other win7 only increased system UI elements like buttons and so on. Rest remains untouched and looks weird like you see.
Okay, so it is working as intended, because you prefer not to crop unbalanced? ie, not -4,0,0,2?
I can check on another machine that I don't have the scaling above 100% but I had a similar problem with them not cropping out the black bars, I'll look at that now.

I was trying to batch edit the crop (with notepad++) with the jobxxxx.avs and jobxxxx.ini, but that doesn't seem to be enough because after editing the two files if I go into the AviSynth Filters the crop setting is still set to Do not crop, however if I look at the script "Show Video Scrpit" I do see my crop settings.
Is there another location I need to edit?

Update (from my win10 machine):
https://i.imgur.com/3F2HkHh.jpg

Atak_Snajpera
9th February 2019, 18:23
Is there another location I need to edit?
Jobx.ini

Btw. I've uploaded new version. Check if your older jobs can now be restored.

byteshare
9th February 2019, 18:31
Jobx.ini
Btw. I've uploaded new version. Check if your older jobs can now be restored.
Thank you...I over looked that file. [update] Works great :)
Wow, the update fixed the joblist!!! Thank you again, awesome work.

byteshare
10th February 2019, 22:13
Because You use non standard DPI scaling. My app was designed for default 100%. BTW. scaling in win10 works differently than in win7. Win10 resamples content of the window and hence everything looks correctly. On other hand win7 only increased system UI elements like buttons and so on. Rest remains untouched and looks weird like you see.


Autocrop does not crop this black line because top/bottom line is not fully covered.
https://i.postimg.cc/5yghCJxQ/Crayon-Shin-chan-02abc-English-Vitello-dub-ATTKC-AE9068-BE-002.png

At least in that photo it should on the right side IMO.
To me if it is partial it should get cropped, probably why I always want the manual crop option in the batch mode...using notepad++ and doing a batch edit after the fact isn't perfect but much more work able than clicking through each job.
Next time I get the auto crop to not work correctly when it is a solid black line I'll send you some samples again.

PetBel
12th February 2019, 09:07
Since I have installed the new 1.24 version, after indexing I get the following Error on most jobs (8 of 10 last time) added in batch mode:
File e:\temp\Ripbot264temp\job1\video.mkv.ffindex_track00.kf.txt does not exist!

When checking the files in the job folders there is a video.mkv.ffindex_track01.kf.txt in every folder (number after track is different).

Is there a bug in the new RipBot version or is something wrong with my mkv source files?

Atak_Snajpera
12th February 2019, 13:39
upload some samples.

PetBel
12th February 2019, 14:13
After checking some working source files and some source files with error here is what I found:

In working source files the track order is video track (id 0), audio track (id 1), subtitle track (id 2) and charter. In sources with error the audio track is first (id 0) and the video track is second (id 1). For me it looks like that this is the problem. After changing the track order of a file with error Ripbot encoded it without a problem.

byteshare
12th February 2019, 15:29
After checking some working source files and some source files with error here is what I found:

In working source files the track order is video track (id 0), audio track (id 1), subtitle track (id 2) and charter. In sources with error the audio track is first (id 0) and the video track is second (id 1). For me it looks like that this is the problem. After changing the track order of a file with error Ripbot encoded it without a problem.

Should send some sample files to the dev so he can fix this for everyone, just my two cents.

Really a small thing but on Windows 7 and Windows 10, I've noticed if you tab through the crop settings (to manually adjust), the Tab key goes from Top > Bottom > Right. Left is being skipped. I noticed if I click into left and hit Tab it goes to the ">" key, so it is out of order in some why.
I noticed this after going through dozens of files having to make small corrections, otherwise I'd probably have missed it because normally I'd just use the mouse.

Noticed this got fixed as well. Thank you!

forkicks
12th February 2019, 15:30
After checking some working source files and some source files with error here is what I found:

In working source files the track order is video track (id 0), audio track (id 1), subtitle track (id 2) and charter. In sources with error the audio track is first (id 0) and the video track is second (id 1). For me it looks like that this is the problem. After changing the track order of a file with error Ripbot encoded it without a problem.

Just diagnosed this myself. This only became obvious when the program started clearing the video265 file. On the down side, this also means that any file where the video track was not the first one before was being incorrectly encoded (ie, it had the wrong video) before last ripbot version.

fK

PetBel
12th February 2019, 18:57
I donít know if it's necessary to send a sample because it's easy to create such a file. Simply create a mkv with one video and one audio track, set the order of the video and audio track so that audio is the first and video is the second track. Now try to encode it in distributed encoding (Like this I can reproduce the error with every mkv). I don't know if this also happens in single PC encoding.

I also donít know if this is a bug in RipBot. At the moment I write a script to demux and remux my mkv's in the right track order (video first, audio second). But I think if it's possible to create such a file with mkvtoolnix (I think mkvtoolnix creates only mkv's in a correct way) any software should handle this file without an error.

Someone knows if it's possible to do this (change track order) without demux/remux the mkv? I tried to do it with mkvpropedit without success until now.

@Atak_Snajpera
But anyway, I really love Ripbot especially the distributed encoding.

Atak_Snajpera
12th February 2019, 19:47
I donít know if it's necessary to send a sample because it's easy to create such a file. Simply create a mkv with one video and one audio track, set the order of the video and audio track so that audio is the first and video is the second track. Now try to encode it in distributed encoding (Like this I can reproduce the error with every mkv). I don't know if this also happens in single PC encoding.

I also donít know if this is a bug in RipBot. At the moment I write a script to demux and remux my mkv's in the right track order (video first, audio second). But I think if it's possible to create such a file with mkvtoolnix (I think mkvtoolnix creates only mkv's in a correct way) any software should handle this file without an error.

Someone knows if it's possible to do this (change track order) without demux/remux the mkv? I tried to do it with mkvpropedit without success until now.

@Atak_Snajpera
But anyway, I really love Ripbot especially the distributed encoding.

Do not bother! It should be already fixed in next auto-update.

SKPN
14th February 2019, 12:18
Hello,

I started using RipBot about a week ago, and am loving the distributed encoding feature. However, the last two days, I've been getting errors at the end of the encoding process that causes the entire job to fail.

Here is the most recent error file:


B:\>"B:\Installs\TV Stuff\RipBot264v1.24.0\EncodingClient.exe" "C:\Temp\RipBot264temp\job1\job1_EncodingClient.meta"

mkvmerge v31.0.0 ('Dolores In A Shoestand') 64-bit
Error: The file 'C:\Temp\RipBot264temp\video.265' could not be opened for reading: open file error.
-------------------------

Elapsed Time: 05h:35m:39s


When I look in the temp folder, the video.265 file does not exist, so it seems to be an error creating that file. I've tried changing the location of the temp folder, thinking it might be a permissions issue on C, but still receive the same error. It also occurs regardless of which PC I initiate the job from. The strange part is that it doesn't happen on every attempt. But my last three tries of encoding a 4K movie, I've received that error. It's very frustrating, especially since it doesn't happen until after the several hours of encoding are completed, and the progress is lost, forcing me to start over.

Does anyone know what might be causing this? Any help would be greatly appreciated.

Atak_Snajpera
14th February 2019, 12:42
Hello,

I started using RipBot about a week ago, and am loving the distributed encoding feature. However, the last two days, I've been getting errors at the end of the encoding process that causes the entire job to fail.

Here is the most recent error file:



When I look in the temp folder, the video.265 file does not exist, so it seems to be an error creating that file. I've tried changing the location of the temp folder, thinking it might be a permissions issue on C, but still receive the same error. It also occurs regardless of which PC I initiate the job from. The strange part is that it doesn't happen on every attempt. But my last three tries of encoding a 4K movie, I've received that error. It's very frustrating, especially since it doesn't happen until after the several hours of encoding are completed, and the progress is lost, forcing me to start over.

Does anyone know what might be causing this? Any help would be greatly appreciated.

1) Verify that all X.265 files have been created in RipBot264temp\jobX\Chunks
2) If yes then execute via console RipBot264temp\jobX\Chunks\CombineAllChunks.cmd
3) If video.265 has been created then execute RipBot264temp\jobX\jobX_MuxFiles.cmd

PetBel
14th February 2019, 12:57
Looks like the stability of the 1.24 is not yet as good as with 1.23. From time to time I have the problem that encoding stops. When checking the Encoding Client window it looks like in the attachement.

After aborting encoding in the RipBot window Encoding Client window looks normal with text "Aborting..." in the top left corner but its frozen. I have to kill the encoding client task to close the window.

I'm not sure yet but at the moment I think this happens if a Server PC is for example turned off (connection to server is lost) while encoding.

Are there any log files I can check to get more information about what happens?

16729

byteshare
14th February 2019, 13:33
I'm having an issue with a set of video files but not others...
The issue is I add the job fine, AVISynth Preview even works, and a 10s clip also encodes (auto-switches to non-DE mode).
When I try to encode the whole file or a 122s clip (tries DE mode) the file never encodes.
I noticed the video.mkv never gets made in the job folder. I tried manually adding that but that didn't help. The RipBot264 Encoding Server errors:
Encoding started...
""\\ComputerName\Ripbot264temp\Tools\ffmpeg\bin\ffmpeg.exe" -loglevel panic -i "\\ComputerName\RipBot264temp\job34\Chunks\2.avs" -strict -1 -f yuv4mpegpipe - | "\\ComputerName\Ripbot264temp\tools\x265\x265_x64.exe" --colorprim bt709 --transfer bt709 --colormatrix bt709 --crf 22 --fps 25 --min-keyint 25 --keyint 250 --frames 1500 --sar 1:1 --profile main10 --output-depth 10 --aq-mode 3 --ref=5 --bframes=8 --rc-lookahead=60 --max-merge=5 --limit-refs=0 --no-weightp --weightb --b-intra --psy-rd=1.5 --ctu 32 --y4m --pools "+" --output "\\ComputerName\RipBot264temp\job34\Chunks\2.265" -"
The system cannot find the path specified.

122s sample file that errors: https://mega.nz/#!BoxXAIxC!TBj0NpDhEmvRuNu7clrHOe3-obmwzpkpO4refLDrbcU

Isn't happening on all jobs but is with a few files like the one linked.

byteshare
14th February 2019, 13:36
Looks like the stability of the 1.24 is not yet as good as with 1.23. From time to time I have the problem that encoding stops. When checking the Encoding Client window it looks like in the attachement.

After aborting encoding in the RipBot window Encoding Client window looks normal with text "Aborting..." in the top left corner but its frozen. I have to kill the encoding client task to close the window.

I'm not sure yet but at the moment I think this happens if a Server PC is for example turned off (connection to server is lost) while encoding.

Are there any log files I can check to get more information about what happens?

16729
1.24 has more logging, but I can't see your picture. Generally better to post a link from an image hosting site than attaching here.

It sounds like it might be like this issue I reported:
In one of the most recent updates the "Abort" / "Start" stopped working properly for me under these conditions:
1. I start a job and at some "Abort" the job.
2. I try to "Start" the jobs again.
3. A job will never start, rather it gets stuck on the "Please Wait....Gathering information..." and also gets stuck "Aborting..."

I have to kill the Encoding Client, close RipBot and restart RipBot to get a job to start again.
This issue has been fixed from what I can test at some point in 1.24.

Atak_Snajpera
14th February 2019, 14:02
I'm having an issue with a set of video files but not others...
The issue is I add the job fine, AVISynth Preview even works, and a 10s clip also encodes (auto-switches to non-DE mode).
When I try to encode the whole file or a 122s clip (tries DE mode) the file never encodes.
I noticed the video.mkv never gets made in the job folder. I tried manually adding that but that didn't help. The RipBot264 Encoding Server errors:

122s sample file that errors: https://mega.nz/#!BoxXAIxC!TBj0NpDhEmvRuNu7clrHOe3-obmwzpkpO4refLDrbcU

Isn't happening on all jobs but is with a few files like the one linked.

Temporary solution is to remove + from file name.

PetBel
14th February 2019, 14:45
I don't click the Abort button. Encoding simply stops and the Encoding Client window looks like this:

https://imgur.com/a/xVQ3qpd

Then I click the Abort button in Ripbot window -> Encoding Client window changes to normal view with Aborting... message but its frozen and I have to kill it's task to close the window.

byteshare
14th February 2019, 15:53
Temporary solution is to remove + from file name.
I didn't even think about the filename, I guess it is like the files with Japanese in them. Thank you. I'll do that for now.

byteshare
14th February 2019, 15:54
I don't click the Abort button. Encoding simply stops and the Encoding Client window looks like this:

https://imgur.com/a/xVQ3qpd

Then I click the Abort button in Ripbot window -> Encoding Client window changes to normal view with Aborting... message but its frozen and I have to kill it's task to close the window.

Have you tried the newest version? I used to have issues with encoding stopping.

Atak_Snajpera
14th February 2019, 16:07
I didn't even think about the filename, I guess it is like the files with Japanese in them. Thank you. I'll do that for now.

Next update will fix that.

PetBel
14th February 2019, 18:13
Have you tried the newest version? I used to have issues with encoding stopping.

Yes, I use the newest version.

Since last "crash" encoding is running with deactivated restart function (this is the third button after the On and Off at each server. Right?). Until now it's working. Maybe there is the problem. Will have a look at that for the next days.

byteshare
18th February 2019, 06:15
Yes, I use the newest version.

Since last "crash" encoding is running with deactivated restart function (this is the third button after the On and Off at each server. Right?). Until now it's working. Maybe there is the problem. Will have a look at that for the next days.
I haven't had that issue on any of my machines, so it could be a bug specific to your setup...or I'm just getting lucky :)
Hope you find the cause.

PetBel
20th February 2019, 10:21
Yes, I use the newest version.

Since last "crash" encoding is running with deactivated restart function (this is the third button after the On and Off at each server. Right?). Until now it's working. Maybe there is the problem. Will have a look at that for the next days.

After 5 days of distributed encoding with deactivated restart function without any crash I think there is the problem.

Don't know if there is something special with my configuration (I don't think so) or there is a bug in the restart function. I simply use it with deactivated restart function now and I am happy like this :)

@Atak_Snajpera
If there is a problem in restart function let me know if I can help you by doing some tests.

Wishbringer
21st February 2019, 13:00
Some issues with DE:
When activating the buttons for auto-reconnect near on/off in DE Client, Client becomes unresponsitive when one of the DE Servers crashes or becomes unresponsitive.
Even closing DE Server and restarting doesn't brings a solution. Client doesn't react anymore.
Closing client task in taskmanager doesn't allow a restart of client. At restart Client stays at collecting data.
Only restart of PC helps.

sometimes (but in each DE encoding job more than one time) one of the DE server becomes unresponsitive.
For example x264/x265 stays at last frame (e.g. 2887/2888). Decoder processor usage stays at around 5%, x264/x265 at 0.1%
So maybe a AviSynth-Problem? Happens with Denoise and without.

I have one DE Client on a i7-7700K machine (with one DE Server enabled) and four Ryzen 2700x as DE Servers.
All of them are Win10 Pro 17763.292/316 pure with AviSynth+ and Ripbot is actual.

Atak_Snajpera
21st February 2019, 13:57
Some issues with DE:
When activating the buttons for auto-reconnect near on/off in DE Client, Client becomes unresponsitive when one of the DE Servers crashes or becomes unresponsitive.
Even closing DE Server and restarting doesn't brings a solution. Client doesn't react anymore.
Closing client task in taskmanager doesn't allow a restart of client. At restart Client stays at collecting data.
Only restart of PC helps.
I'm working on it right now... I've just noticed that I have some deadlocks in code.

sometimes (but in each DE encoding job more than one time) one of the DE server becomes unresponsitive.
For example x264/x265 stays at last frame (e.g. 2887/2888). Decoder processor usage stays at around 5%, x264/x265 at 0.1%
So maybe a AviSynth-Problem? Happens with Denoise and without.
Yes, you are right. Something is wrong on AviSynth side. I suspect some problem with ffms2 plugin. Maybe it incorrectly reports number of frames to avisynth.

Ryushin
21st February 2019, 16:39
Is there an option to only extract subtitles in a certain language? For me, it would be nice to extract subtitles that are my local languge and unknown.

Maybe a box in settings where you can add which subtitles languages to extract.

egres
21st February 2019, 17:12
It might sound like a stupid question, how do you rip a 3D movie and get a 3D rendered MKV ?

byteshare
21st February 2019, 17:53
Is there an option to only extract subtitles in a certain language? For me, it would be nice to extract subtitles that are my local languge and unknown.

Maybe a box in settings where you can add which subtitles languages to extract.

If you have all copy automatically you can setup your video player to play your preferred language first.

Ryushin
21st February 2019, 18:34
It might sound like a stupid question, how do you rip a 3D movie and get a 3D rendered MKV ?

It depends. For me, I rip the 3D using MakeMKV and using my Oppo UPD-203 to play the file back in 3D.

Only other methods I've seen need to use side by side or top and bottom frame. Essentially, you will need to encode two frames to get your 3D image. There were only a couple of software packages that I saw that could do this. Clown_BD was one and the other was DVDFab.

I may revisit this again if I can find a software package that will make x265 3D T&B files.

Edit: Looks like BD3D2MK3D will do what I need now. Time to try Top And Bottom frame encoding again.

Ryushin
21st February 2019, 18:36
If you have all copy automatically you can setup your video player to play your preferred language first.

Rather not clutter up the mkv file. I can still select manually as I'm doing now.

byteshare
21st February 2019, 21:07
Rather not clutter up the mkv file. I can still select manually as I'm doing now.
Can also select all then after encoding set a batch to strip the extras you don't want. Doing it that way saves you some manual work.

slalom
22nd February 2019, 10:16
What is this?

y4m [error]: bad sequence header magic
x264 [error]: could not open input file `-'

One server is starting and stopping

forkicks
22nd February 2019, 12:04
All my servers except the main one running side-by-side on the same machine with ripbot have started to fail with:

Encoding started...
""\\PCNAME\Ripbot264temp\Tools\ffmpeg\bin\ffmpeg.exe" -loglevel panic -i "\\PCNAME\Ripbot264temp\job1\Chunks\36.avs" -strict 1 -f yuv4mpegpipe - | "\\PCNAME\Ripbot264temp\tools\x265\x265_x64.exe" --seek 176 --colorprim bt709 --transfer bt709 --colormatrix bt709 --crf 18 --fps 24000/1001 --min-keyint 24 --keyint 240 --frames 1613 --sar 1:1 --profile main10 --output-depth 10 --tune psnr --ctu 16 --max-tu-size 16 --qg-size 16 --y4m --pools "+" --output "\\PCNAME\Ripbot264temp\job1\Chunks\36.265" -"
x265: [error]: unable to open input file <->
(this is just an example, its the same for other jobs/chunks)
Also, running this command from the command line produces the same result. (I couldn't copy paste the error, so i typed it in here, please attribute any typo to my fingers :-) )

after i updated my main ripbot with the latest update and started new batches.

This happens on all files, while encoding to 265 mkvs.

I have tried updating all the servers also to latest version, same result (initally had only the main one updated to absolute last version)

Atak_Snajpera
22nd February 2019, 12:44
open \\PCNAME\Ripbot264temp\job1\Chunks\36.avs in MPC-HC and see what error message you get.

forkicks
22nd February 2019, 14:44
open \\PCNAME\Ripbot264temp\job1\Chunks\36.avs in MPC-HC and see what error message you get.

The first error i get when doing what you say is:
"Cannot load a 64 bit DLL in 32 bit Avisynth: '//PCName/Ripbot264temp/tools/avisynth plugins/ffms/x64/ffms2.dll'. (\\PCName\Ripbot264temp\job4\Chunks\6.avs, line 6)


So i tried to "fix" it by changing the x64 to x86, then it fails with:
FFVideoSource: Failed to open 'Y:\filename.mkv' (\\PCNAME\RipBot264temp\job4\Chunks\6.avs, line 7)

(this was on a different block, but was the same problem).

"Y:" there refers to a path on the system where ripbot is running, its not valid for the DE servers.


(edit: Ignore the part about the x64/x86 difference, that is fine in the script, its the other path that is the problem.)

Ryushin
22nd February 2019, 15:01
I've normally had convert sup to sub for my settings since the beginning. But I've been see some sup that are different colors other than white, turn to a different color in sub.

For example, I have a sup that is yellow but turn red after conversion to sub. I've seen grey turn to near black.

I'm encoding only in x265 now and I've just turned off convert sup to sub so the subtitles look correct. Selecting rendering subtitles always converts to sub it seems. Can rendering subtitles not work with sup?

Question, is sub generally better supported and is that why we should use that instead? All of my players now have no problems play sup, so I'll just go with that for now on.

Atak_Snajpera
22nd February 2019, 15:35
Question, is sub generally better supported and is that why we should use that instead? All of my players now have no problems play sup, so I'll just go with that for now on.
Yes. Stick with original subtitles because support for BD subtitles is much better these days.

byteshare
22nd February 2019, 16:44
I was playing around with some filters for "fun"....boring life I suppose...
Anyways, I noticed that not all filters seem to work with the same syntax and I was wondering if anyone knew or could better describe AviSynth syntax/format in RipBot for me?

Why do some filters seem to work with video=Filter and others video=video.filter? Is it just because some are "built-in" to RipBot?
for example: video=QTGMC(Settings) works but FK3DB needs video=video.fk3db(settings)

Are the filters taken in order of the jobsxxx.avs file (top to bottom)?
for example: Deinterlace would go before Decimate? I don't think this is happening since Crop is 3rd from VideoSource, but custom would go last?

If I string them in a row with a "." they are done one at a time from left to right, yes?
for example: video=video.filter01(settings).filter02(settings) > filtero1 is processed, then filter02
or if I did them:
video=video.filter01(settings)
video=video.filter02(settings)
Would it be the same as stringing them together with "."?

egres
22nd February 2019, 17:01
Just started a job after latest update...... Nothing happens.... All encoders on all the remote pc's just do nothing...

https://ibb.co/Gv2963T

The chunk directories is like this...

https://i.ibb.co/VjMYw4L/Capturedir.png

byteshare
22nd February 2019, 17:23
Just started a job after latest update...... Nothing happens.... All encoders on all the remote pc's just do nothing...

https://ibb.co/Gv2963T

The chunk directories is like this...

https://i.ibb.co/VjMYw4L/Capturedir.png

What is are your encoding settings?
I'm seeing: --output NUL -
at the end of the Encoding Server here: https://ibb.co/Gv2963T
That doesn't seem normal to me, for me it looks like:
--output "\\compname\ripbot264temp\jobxx\chunks\xx.265" -
or try creating a new job and seeing if it does the same thing, cause right now it doesn't seem to be pointing the output correctly.

egres
22nd February 2019, 17:26
I have got 2 other jobs which worked yesterday and not working today. Did not change anything to my setup, except updating core !!

egres
22nd February 2019, 17:27
By the way, --output NUL - is normal in a 2 pass setting

byteshare
22nd February 2019, 17:29
By the way, --output NUL - is normal in a 2 pass setting

Oh, okay. Did you try making a new job to see if you got the same issue? (after closing and re-opening RipBot)
Cause on CRF it is working for me.

egres
22nd February 2019, 17:31
Yes.... I started a new job, same parameters, all encoders just sit there doing nothing. Then try one of the 2 older job, same result !!
Even the local encoder just sits there, with the command line....

byteshare
22nd February 2019, 17:33
Yes.... I started a new job, same parameters, all encoders just sit there doing nothing. Then try one of the 2 older job, same result !!
Even the local encoder just sits there, with the command line....
Not sure then, but maybe Atak_Snajpera or someone else might now why. It is working for me with CRF after update both old jobs and new jobs.

egres
22nd February 2019, 17:38
Just tried it with CRF.... same issue..

byteshare
22nd February 2019, 17:41
Just tried it with CRF.... same issue..

Something else is going on then. Have you tried a reboot just to eliminate that?
Have you checked any of the log files?

Atak_Snajpera
22nd February 2019, 17:46
I was playing around with some filters for "fun"....boring life I suppose...
Anyways, I noticed that not all filters seem to work with the same syntax and I was wondering if anyone knew or could better describe AviSynth syntax/format in RipBot for me?

Why do some filters seem to work with video=Filter and others video=video.filter? Is it just because some are "built-in" to RipBot?
for example: video=QTGMC(Settings) works but FK3DB needs video=video.fk3db(settings)

Are the filters taken in order of the jobsxxx.avs file (top to bottom)?
for example: Deinterlace would go before Decimate? I don't think this is happening since Crop is 3rd from VideoSource, but custom would go last?

If I string them in a row with a "." they are done one at a time from left to right, yes?
for example: video=video.filter01(settings).filter02(settings) > filtero1 is processed, then filter02
or if I did them:
video=video.filter01(settings)
video=video.filter02(settings)
Would it be the same as stringing them together with "."?

Syntax is like this
video=Filter(video,settings)

you can create chain of filter like this
video=Filter(video,settings).FilterB(settings).FilterC(settings)

Just remember that first filter will need clip name!

Atak_Snajpera
22nd February 2019, 17:54
I have got 2 other jobs which worked yesterday and not working today. Did not change anything to my setup, except updating core !!

Smells like your antivirus/firewall is just doing some weird stuff in background. In last update I just fixed few deadlocks (when user clicked abort client randomly hung) in code and I didn't mess with other parts of the code. I'm still investigating that auto-connecting bug...

egres
22nd February 2019, 18:02
Hum, just checked firewall rules... green light on encoder and Ripbot264. Even the local encoder just sits there with the command line.... nothing happens...

Atak_Snajpera
22nd February 2019, 18:03
Hum, just checked firewall rules... green light on encoder and Ripbot264. Even the local encoder just sits there with the command line.... nothing happens...

Check if script can be opened in MPC-HC.

egres
22nd February 2019, 18:04
I will reinstall the original RipBot264v1.24.0 and try that

byteshare
22nd February 2019, 18:05
Syntax is like this
video=Filter(video,settings)

you can create chain of filter like this
video=Filter(video,settings).FilterB(settings).FilterC(settings)

Just remember that first filter will need clip name!
Oh! I think I wasn't seeing the video in the settings:
video=Filter(video,settings) on the default ones...
So video=video.filter is working because I'm just saying to AviSynth do:
video then the filter and the filter is using the video from the first "command", which is just video.

Are the custom scripts getting the "video" from the other parts of the jobxx.avs after their AVISynth scripts (assuming there are some) or should I be putting everything like QTGMC into the custom script, except for crop?

I had in the past only been using a custom script.

egres
22nd February 2019, 18:06
Check if script can be opened in MPC-HC.

I am rather new at using your wonderful software... Could you elaborate :)

egres
22nd February 2019, 18:16
Just did a fresh reinstall of RipBot264v1.24.0.7z making sure update flag was set to 0. Works like a charm

byteshare
22nd February 2019, 18:17
I am rather new at using your wonderful software... Could you elaborate :)

Click on the Job > Edit > AviSynth > Preview Script

egres
22nd February 2019, 18:18
I left encoder v1.14.2.0 on all the remote PC's, and it works

egres
22nd February 2019, 18:20
Click on the Job > Edit > AviSynth > Preview Script

I will try that when job concludes. Thanks

Atak_Snajpera
22nd February 2019, 18:26
Oh! I think I wasn't seeing the video in the settings:
video=Filter(video,settings) on the default ones...
So video=video.filter is working because I'm just saying to AviSynth do:
video then the filter and the filter is using the video from the first "command", which is just video.

Are the custom scripts getting the "video" from the other parts of the jobxx.avs after their AVISynth scripts (assuming there are some) or should I be putting everything like QTGMC into the custom script, except for crop?

I had in the past only been using a custom script.

It does not matter where you put your code.

egres
22nd February 2019, 18:27
Just killed the job.... went in Click on the Job > Edit > AviSynth > Preview Script

https://i.ibb.co/VWSxyF9/preview.png

I never had a chance to use this before, but that dont look ok !!

Atak_Snajpera
22nd February 2019, 18:29
Basically What you see here is what you will get in encoded file.

egres
22nd February 2019, 18:31
As I said, never used this > Edit > AviSynth > Preview Script and all my jobs worked fine. The mkv was just fine

egres
22nd February 2019, 18:34
This is my Video script:

#AudioSource
LoadPlugin("C:\Users\Serveur\Desktop\Video\RipBot264\tools\AviSynth plugins\NicAudio\NicAudio.dll")
audio=NicDTSSource("D:\Temp\RipBot264temp\job32\audio_1_English.core.dts")
audio=ResampleAudio(audio,48000)
#DownMix



#Delay
audio=DelayAudio(audio,0)


#Tempo



#Normalize



#AudioDub
AudioDub(video,audio)

egres
22nd February 2019, 18:36
I meant audio... this is my video script...

#MT



#VideoSource
LoadPlugin("C:\Users\Serveur\Desktop\Video\RipBot264\Tools\AviSynth plugins\ffms\x64\ffms2.dll")
video=FFVideoSource("D:\Temp\RipBot264temp\job32\video.mkv",cachefile = "D:\Temp\RipBot264temp\job32\video.mkv.ffindex")
#Deinterlace



#Decimate



#Crop



#Resize



#Tonemap



#Levels



#Colours



#Denoise



#Custom



#Prefetch



#After_Prefetch_Denoise



#After_Prefetch_Custom



#Subtitles



#AudioSource
Import("D:\Temp\RipBot264temp\job32\job32_a1.avs")


#Triming



#AVSameLength



#ColorSpace



#Return

Atak_Snajpera
22nd February 2019, 18:41
Maybe reinstall GPU driver.

egres
22nd February 2019, 18:44
https://i.ibb.co/pw4KhkD/gpu.png

Do I need to set x264 OpenCl acceleration to my gpu ?

Atak_Snajpera
22nd February 2019, 18:46
no...

egres
22nd February 2019, 18:47
So you think it my be my GPU drivers... I will try that. Thanks for your help

forkicks
22nd February 2019, 20:11
All my servers except the main one running side-by-side on the same machine with ripbot have started to fail with:

Encoding started...
""\\PCNAME\Ripbot264temp\Tools\ffmpeg\bin\ffmpeg.exe" -loglevel panic -i "\\PCNAME\Ripbot264temp\job1\Chunks\36.avs" -strict 1 -f yuv4mpegpipe - | "\\PCNAME\Ripbot264temp\tools\x265\x265_x64.exe" --seek 176 --colorprim bt709 --transfer bt709 --colormatrix bt709 --crf 18 --fps 24000/1001 --min-keyint 24 --keyint 240 --frames 1613 --sar 1:1 --profile main10 --output-depth 10 --tune psnr --ctu 16 --max-tu-size 16 --qg-size 16 --y4m --pools "+" --output "\\PCNAME\Ripbot264temp\job1\Chunks\36.265" -"
x265: [error]: unable to open input file <->
(this is just an example, its the same for other jobs/chunks)
Also, running this command from the command line produces the same result. (I couldn't copy paste the error, so i typed it in here, please attribute any typo to my fingers :-) )

after i updated my main ripbot with the latest update and started new batches.

This happens on all files, while encoding to 265 mkvs.

I have tried updating all the servers also to latest version, same result (initally had only the main one updated to absolute last version)

I managed to get my DE servers to work again by mounting a share on each of them so that the path that is set on the avs file is the same locally for each of them.

Basically, in the avs file, on each DE server,
FFVideoSource: Failed to open 'Y:\filename.mkv' (\\PCNAME\RipBot264temp\job4\Chunks\6.avs, line 7)
the "Y:" is wrong, it should be \\PCNAME\(...)". The path that is set in the avs file is only valid in the machine running ripbot.

My fix was making that path also valid on each DE server by sharing and mapping the share so that it matches.

This only happens since the last version, this was working fine previously, but the problem is definitly that.

fK

DG74
22nd February 2019, 20:30
I still have the problem with a hanging task of RipBot, so no shutdown is possible. Any solution there?

pepeq
22nd February 2019, 23:06
I still have the problem with a hanging task of RipBot, so no shutdown is possible. Any solution there?

see post #16556 for a workaround. it helped me and some others...

DG74
23rd February 2019, 11:40
see post #16556 for a workaround. it helped me and some others...

Thank you very much! This solution helped in my case, too. It's the Logitech_discord.exe process, installed by Logitech Gaming Software, that caused hanging of RipBot.

slalom
24th February 2019, 09:59
Did we fix the start-stop problem of the servers?

Ryushin
24th February 2019, 12:36
The last few days I've had artifact issues with encoding a VC-1 blu-ray source. I must have re-encoded a dozen times with different settings trying to figure out what was wrong. Even tried handbrake to no avail. Eventually I tried a lossless h.264 encode using CRF 0 and I still had the artifacts. Googling seems to point to a decoding issue:
https://forum.videohelp.com/threads/388829-Annoying-Pixelating-Blocking-After-Encoding-in-Handbrake

Atak, I never knew of this issue with VC-1. Reading the thread says using the MS decoder solves the problem. Is it possible to implement a solution that solves the decoder problems for all VC-1 sources. Looks like ffmpeg might have just fixed this bug very recently as well.

Atak, it looks like the current version of ffmpeg that is included can handle the VC-1 encoding. I ran this:
"C:\Program Files\RipBot264\Tools\ffmpeg\bin\ffmpeg.exe" -i video.mkv -c:v libx264 -preset ultrafast -crf 0 output_x264_ultrafast_lossless.mkv

and the file did not show any artifacts. Huge file size though:
Original: 9.07GB
Lossless: 45.16GB

Would it be possible to add an option to add another step to the demuxing process to transcode VC-1 sources to x264 lossless? With any VC-1 source I have to do this extra step now. Thanks much.

sneaker_ger
24th February 2019, 12:43
ffmpeg fixed the problems in April 2018. And since 1.2.0 HandBrake is ffmpeg based so if you tested it in January and had problems you were probably still on an old version.

I'm not sure what exactly RipBot did in your case (I see no log) but I assume the problem is probably with either ffms2 or l-smash plugins still being based on the old ffmpeg version.

Ryushin
24th February 2019, 21:23
ffmpeg fixed the problems in April 2018. And since 1.2.0 HandBrake is ffmpeg based so if you tested it in January and had problems you were probably still on an old version.

I'm not sure what exactly RipBot did in your case (I see no log) but I assume the problem is probably with either ffms2 or l-smash plugins still being based on the old ffmpeg version.

On the latest version 1.24.0 with the latest updates. So most likely ffms2 is still based on the old ffmpeg version. Good to know once that is updated I won't need to do lossless transcoding any longer for VC-1 sources.

katodevin
25th February 2019, 03:39
I managed to get my DE servers to work again by mounting a share on each of them so that the path that is set on the avs file is the same locally for each of them.

Basically, in the avs file, on each DE server,
FFVideoSource: Failed to open 'Y:\filename.mkv' (\\PCNAME\RipBot264temp\job4\Chunks\6.avs, line 7)
the "Y:" is wrong, it should be \\PCNAME\(...)". The path that is set in the avs file is only valid in the machine running ripbot.

My fix was making that path also valid on each DE server by sharing and mapping the share so that it matches.

This only happens since the last version, this was working fine previously, but the problem is definitly that.

fK

I can confirm that I'm seeing the same behavior on the latest version making distributed encoding not possible. Swapped back to the version from end of 2018, and everything works fine. Hopefully this gets seen/addressed as the distributed encoding is the most enticing feature of RipBot264 for me.