What source filter / decoder are you using for the avs script?
AVISource() using the fraps decoder will be RGB (0-255), if you use converttoyv12() it will default to rec601 (Y' 16-235)
FFVideoSource() will decode using full range YUV (Y' 0-255)
Also , The method in which you take screenshots will affect the appearance (ie. which matrix did you use to convert YUV data to RGB for the screenshot)
See
http://forum.doom9.org/showthread.php?t=157941