View Single Post
Old 28th October 2004, 15:35   #13  |  Link
708145
Professional Lemming
 
708145's Avatar
 
Join Date: Dec 2003
Location: Stuttgart, Germany
Posts: 359
Quote:
Originally posted by Mug Funky
hooray! it's nice.

i assume you've noticed, but num_shift wont go above 8, though adaptive shift will try to make it do so when quant is high enough.
The current formula for adaptiveshift is just an example. It will take some experience and testing with the filter and its behaviour to find out a good formula.

Anyways, I cannot spot a mistake about the range here:
num_shift=2+quant/5;
Thus even for quant 31 it should yield 8.2 which is 8 in (int).

Quote:

also, if possible, DCT precision might need to be increased - there's some posterization happening (maybe changing the matrix would fix this too?)
I will exchange my own quant code with XviD's. Solving two problems in one turn:
a) bugs (XviD is well tested)
b) speed (it's faster than my code)

bis besser,
Tobias
__________________
projects page: ELDER, SmoothD, etc.
708145 is offline   Reply With Quote