I'll try to explain better:
given: log data describes movement
assume movement applies to image center exactly
find 3d rotation for entire projection which results in given movement of the center pixel.
Hope it makes sense now
edit:
Again, more precise way which I did not finish:
given: array of motion vectors
find 3d rotation which minimizes all(most) vectors