I think it is because you did not convert your movie to Square Pixel (PAR: 1x1)
Add this Filter and it will probably solve your issue
The other alternative is to edit the MP4 settings before you export it (my example of 2048 is of a source of 720x576 with PAR: 16x15 4:3 when i upscaled to 1080p)