Its impossible to match the frames to the input timestamps, because the decoder does not let me know if it dropped a frame to avoid artifacts (after seeks, when a reference frame is missing), so it would end up in a desync.
People should just use a software codec for MPEG4-ASP.
Also, if files contain fake header infos, i consider those broken files, and will not spend time trying to fix them.
I'm open to suggestions, but a simple FIFO doesn't work, because of the problem mentioned above.