This happens because the bit rate (video quality) is very less to make it smaller size..

I m assuming that you are facing this problem on vlc player...

Try opening that specific video on Windows media player (WMP).,, it might work properlly there (it does for me) as WMP does the buffering so will not feel that it is skipping pixels..