HCenc 025

[colinhunt]

Originally Posted by Groucho2004

Any chance you can cut a sample from that file?

I'm not allowed, sorry :/ ... but I can create one with exactly same specs this weekend, if that helps any.

[colinhunt]

Here's a link to a file with the same codec, bitrate and resolution: http://www.sendspace.com/file/rvmjv8

It's a 1080p24 ProRes HQ .mov file, 7.5 seconds and 151 MB.

Happy testing!

[Groucho2004]

Originally Posted by colinhunt

Here's a link to a file with the same codec, bitrate and resolution: http://www.sendspace.com/file/rvmjv8

It's a 1080p24 ProRes HQ .mov file, 7.5 seconds and 151 MB.

Happy testing!

I get about 40 FPS with my i5 2500K @ 4GHz, 4 threads, ffms2.
It appears that Quicktime decoding is simply sloooow.

[colinhunt]

Originally Posted by Groucho2004

I get about 40 FPS with my i5 2500K @ 4GHz, 4 threads, ffms2.
It appears that Quicktime decoding is simply sloooow.

Well, ProRes HQ 220, but yes, so it would seem. So who do I approach with a donation to write a much faster decoder?

[Quarkboy]

Hey everyone, I was wondering if someone could help here although maybe only Hank would know...

I'm trying to compile my own custom matrix.dll for experimental purposes on windows, but it looks like I need the Intel fortran compiler...
I tried using gfortran and made the .dll, but the encoder gives an error saying it can't find the EXTMATRIX function.

Looking into the DLL I realized that gfortran uses different conventions when it comes to function name exports and the exported function was being lowercased to extmatrix...

Does anyone know how to successfully compile a matrix.dll on windows? Maybe I could use C++ or some other language?

[manono]

What's a Matrix.dll? A quantisation matrix isn't a DLL. The ones in HCEnc are all CQMs. Or am I misunderstanding you? Care to show us the matrix you created? There are already quite a few available in HCEnc.

If you're looking to create custom matrices, maybe LigH's Custom Quantization Matrix Editor will prove useful:

http://forum.doom9.org/showthread.php?p=469040

Or maybe the Rockas Rebuilder Matrix Editor will do:

http://www.jdobbs.com/Pages/Downloads.htm

[Quarkboy]

Originally Posted by manono

What's a Matrix.dll? A quantisation matrix isn't a DLL. The ones in HCEnc are all CQMs. Or am I misunderstanding you? Care to show us the matrix you created? There are already quite a few available in HCEnc.

If you're looking to create custom matrices, maybe LigH's Custom Quantization Matrix Editor will prove useful:

http://forum.doom9.org/showthread.php?p=469040

Or maybe the Rockas Rebuilder Matrix Editor will do:

http://www.jdobbs.com/Pages/Downloads.htm

Read the last pages of hcenc's manual.
There is an option to manipulate the matrices procedurally based on the motion and luminosity per GOP. To do this you need to compile a custom dll. Sample fortran code is provided for this.

[manono]

Oh, OK then. Sorry.

[techreactor]

Originally Posted by hank315

Still investigating but I have to admit my time for it is very scarce ATM

MPEG analyser Pro is a pretty old program which I still use to analyse MPEG2 streams.
Development has stopped AFAIK, developer is Jean-Luc Pons, I don't know if it's available for download.

@hank, any updates for HCenc in the planning.

Are you planning to integrate Intel Quick Sync Video in HC Enc by using the Intel's Media SDK for its 4th gen processor, Intel claims that by using this, the video creation and conversion is 17x faster since its uses the dedicated media processing which is built right into their processor.

Handbrake started using it (in Beta) and some commercial converters are already on it.

[hank315]

I've recently started again doing some work on HCenc after not seeing the code for about 2 years.
Until now some small improvements are done.

Things I'm also thinking about:
- 64 bit version
It will improve speed, not because its 64 bit but more 128 registers available to work with.
This will take a while, all hand written assembler code has to updated and optimized.
- 4:4:4 color space
- Update bitrate and VBV control
For some high bitrate encodes this could be better...
- Trellis quantization
The articles I've read about it clearly show a full trellis will be slow as hell, if I ever finish it it will probably be some kind of pseudo-trellis.

And now find some time for it

Originally Posted by techreactor

Are you planning to integrate Intel Quick Sync Video in HC Enc by using the Intel's Media SDK for its 4th gen processor, Intel claims that by using this, the video creation and conversion is 17x faster since its uses the dedicated media processing which is built right into their processor.

This isn't easy to use/implement, also don't know if this will really improve performance.
Some dedicated asm code using the latest SIMD SSE/AVX instructions will probably be a better choice for HCenc.

[manolito]

Hi Hank,

good to see you back after such a long time...
I already thought you had abandoned HCenc for good.

HCenc 0.26 Beta is in almost daily use here - I only use it for DVD output, no problems whatsoever (I even hexedited out the 'Beta' from the title bar).


Welcome back!
manolito

[Sparktank]

Wonderful to see you are well (enough to post).

I had wondered about updated instruction sets for AVX.
My current machine I use HCenc on (mostly) has AVX instrcution set but SSE4 (4.2) is used instead.

64bit would make for an interesting update to play with.

Question regarding 64x HCenc: If the input is an AVS script, would the AVS version have to be x64 as well?

[techreactor]

Originally Posted by hank315

This isn't easy to use/implement, also don't know if this will really improve performance.
Some dedicated asm code using the latest SIMD SSE/AVX instructions will probably be a better choice for HCenc.

Good to know that some changes are in the offing.

Currently the following converter are using it as per Intel:

Arcsoft MediaConverter
Arcsoft MediaImpression
Badaboom Media Converter
Corel Digital Studio
CyberLink MediaEspresso
CyberLink PowerDirector
MainConcept
Movavi Video Converter
Roxio Creator

along with freeware's like Mediacode HQ and Handbrake, I personally have not used any of the above commercial softwares but reading the feedback posted by some endusers definitely mention the gains in terms of speed and time. Dvdfab has posted this comparison sheet on their website.

You are the best judge of what will work better for HCenc.

[Sparktank]

Might I ask but a humble request for any future considerations?

Request:
If the source is an AVS script, would it be possible to copy the script to the designated *LOGFILE?

It would come in handy when doing multiple samples with different AVS scripting; such as, brightness tweaking, etc.

[Fishman0919]

Originally Posted by hank315

I've recently started again doing some work on HCenc after not seeing the code for about 2 years.
Until now some small improvements are done.

Things I'm also thinking about:
- 64 bit version
It will improve speed, not because its 64 bit but more 128 registers available to work with.
This will take a while, all hand written assembler code has to updated and optimized.
- 4:4:4 color space
- Update bitrate and VBV control
For some high bitrate encodes this could be better...
- Trellis quantization
The articles I've read about it clearly show a full trellis will be slow as hell, if I ever finish it it will probably be some kind of pseudo-trellis.

And now find some time for it



This isn't easy to use/implement, also don't know if this will really improve performance.
Some dedicated asm code using the latest SIMD SSE/AVX instructions will probably be a better choice for HCenc.

Oh yeah... nice to see around again.

[ChiDragon]

All of a sudden I'm getting a crazy Visual Fortran popup window when I try to encode more than 961 frames with HCenc 0.26 beta.

[EDIT: Err. I figured out the issue. The drive I'm writing to ran out of space. Perhaps this could be handled with a more elegant message.]

"Visual Fortran run-time Error

forrtl: severe (27): too many records in I/O statement, unit -5, file
Internal Formatted Write
Image PC Routine Line Source
HCenc.exe 00593B5A Unknown Unknown Unknown

Stack trace terminated abnormally."

Also, HCgui 0.26 crashes upon attempting to open a script whose return value is not a video clip (undefined), rather than rendering an error message.

Example:

BlankClip(30,720,480,"YV12",30000,1001)
X = 0

[Sparktank]

Is there any simple math to calculate the *LOSSLESS temp file?

I'd like to better guess a better place for it instead of going to largest place (usually USB 2.0 external with at least 500GB free space).
I use anamorphic resolution (NTSC) 704x480.

[hank315]

The size of the lossless file can't be calculated exactly, the size is variable, it depends on the compressibility of the source.

In your case (YV12 color space):
each plane:
704 x 480 = 337920 bytes (Y plane)
2 x 352 x 240 = 168960 bytes (UV planes)
total per plane: 506880 bytes
per minute:
23.976 x 60 x 506880 = 730 MB

Each frame is compressed, average compression: 40 - 50%, so per minute the file size will be approx. 330 MB.

[Sparktank]

Thank you, this should be plenty enough to work with.