Memory issue with high resolution and tesa

[Zanthra]

x264

I have a 3 and a half minute video at 1600x1200 resolution. The number of frames is low enough I would like to encode it with tesa and all other settings maxed, but it crashes each time I try.

With tesa enabled it uses 1.6GB initially (Virtual Size is 1.9GB) and crashes when it goes up to 1.9. I have a 64bit OS, and tried the 64bit x264, but I can't find the 64bit avisynth ;(. Any reccomendations? I have never been impressed with UMH on very high resolution videos.

[Sharktooth]

TESA = placebo...

[LoRd_MuldeR]

Indeed. I doubt you will see a difference with ESA (or even TESA) over UMH. You may be better off by using UMH and raising "--merange" a bit for HD stuff.

[kemuri-_9]

I have a 64bit OS, and tried the 64bit x264, but I can't find the 64bit avisynth ;(. Any reccomendations? I have never been impressed with UMH on very high resolution videos.

avisynth x64 can be found at squid_80's site at http://members.optusnet.com.au/squid_80/
however, many plugins have not been compiled for the x64 version due to several reasons.

another option would be to use avs2yuv to pipe from avs x86 to x264 x64.

since you did mention avisynth, what is your avs script exactly?

I have had issues with avisynth caching too much of the file and crashing
x264 due to the memory limitations of x86 addressing, even with scripts that only open files.
adding SetMemoryMax(512) to the script has worked in those cases for me....

[Zanthra]

The issue is not whether tesa is better or worse, it's that I have no reason not to use it except for that fact that x264 can't allocate enough memory.

I have not heard anyone provide any suggestion that tesa will provide a lower quality or less compressed video than UMH, the CPU cycles may be wasted, but it does not matter, my computer is off or idle much of the time.

It's just a load and trim script. I have FFDShow x64 for decoding the HuffYUV, and I don't know another way to get the video to x264


#Hodir-HardMode.avs

DirectShowSource("S:\Hodir_20090514_005137.avi", audio=false).trim(37526, 42668)


PS: SetMaxMemory(512) did not help.

[Snowknight26]

except for that fact that x264 can't allocate enough memory.

Use 64-bit x264 inconjunction with avs2yuv and 32-bit avisynth.

[LoRd_MuldeR]

The issue is not whether tesa is better or worse, it's that I have no reason not to use it except for that fact that x264 can't allocate enough memory.

If it is MUCH slower than UMH, but not noticeable better, than that is your "reason not to use it" ;)

But if you want to waste your time, we can't prevent you from doing so. Anyway, you could use that time better for other things, like higher "--merange" or slower pre-processing.

[Dark Shikari]

Yes, esa/tesa use a ton of memory.

Yes, you probably need 64-bit for very high resolution encoding with esa/tesa.

[kemuri-_9]

It's just a load and trim script. I have FFDShow x64 for decoding the HuffYUV, and I don't know another way to get the video to x264

why are you using DirectShowSource() on a huffyuv file?
you should enable ffdshow vfw for huffyuv and use AVISource() not DirectShowSource().

like i said earlier,
you should either take the avs2yuv piping route
or use avs x64 directly (as simple as your script is, this will be the easier choice IMO)

either way, it does appear x264 needs more memory than x86 addressing allows so you do need to use the x64 version.

[Zanthra]

I tried AVIsource, but it would not load ffdshow to do the decoding. DirectShowSource would. Also how do I do the avs2yuv?

[Dark Shikari]

I tried AVIsource, but it would not load ffdshow to do the decoding.That's because you didn't enable HuffYUV decoding in VFW FFDshow.

[kemuri-_9]

Also how do I do the avs2yuv?

how to use it was talked about in the x264 windows x64 thread around here (http://forum.doom9.org/showthread.php?t=143539&page=5)

[LoRd_MuldeR]

how to use it was talked about in the x264 windows x64 thread around here (http://forum.doom9.org/showthread.php?t=143539&page=5)

I even put together a simply GUI for that purpose:

http://forum.doom9.org/showthread.php?t=144140