ONNX models to use with avs-mlrt

[kedautinh12]

Originally Posted by FranceBB

Does it also happen with fp16=true?
I also have 8GB GDDR5 in my NVIDIA Quadro P4000 and I had to add that to compensate 'cause otherwise it would perform calculations in 32bit float and run out of memory.

Yes, the 32bit is very strong for even with 8gb vram GPU in 480p video

[Arx1meD]

Originally Posted by FranceBB

Does it also happen with fp16=true?

Yes. When fp16=true also appears errors.
I also noticed when the models are converted in the chaiNNer program with the selection fp32 everything works fine (for ESRGAN architecture models), and appears errors for the same model with the selection fp16.

[Stereodude]

FWIW, mlrt_ort using CUDA is faster than mlrt_ncnn to run an ONNX model (Dotzilla) on a RTX 3070Ti using a DVD source. I think it was 24fps vs. 18fps.

[takla]

Posting this example script here, so I don't forget to set colorspace stuff again...

Also, Cuda is waay slower for me, barely reaching 1/3 of the speed I get with DML.
This has also been shown by other to be the case.

With Hardware-accelerated GPU scheduling enabled, GPU usage often gets stuck at 80%.
If you run into this issue, you can disable it under Windows settings "System > Display > Graphics >> Advanced graphic settings"
Edit: Someone else ran into the same issue.

LWLibavVideoSource("C:\Users\ULTRA\Downloads\ffmpeg\INPUT.mkv").Prefetch(0)
z_ConvertFormat(pixel_type="RGBPS", colorspace_op="709:709:709:limited=>rgb:709:709:full", dither_type="error_diffusion", cpu_type="avx2", use_props=0).Prefetch(0)
mlrt_ort(network_path="C:\Program Files (x86)\AviSynth+\plugins64+\mlrt_ort_rt\models\2x_Ani4Kv2_G6i2_Compact_107500_fp32.onnx", builtin=False, provider="DML", fp16=True, num_streams=1).Prefetch(2)
z_ConvertFormat(pixel_type="YUV420P8", colorspace_op="rgb:709:709:full=>709:709:709:limited", dither_type="error_diffusion", cpu_type="avx2", use_props=0).Prefetch(0)