No, they did not move sideways. Just forward gazing with one eye through the gun sight (that's what you do with a rifle too, don't you?). It is not by accident that the gunsight in German fighters is just at the same lateral distance from the centre as your eye from your nose.

thegermanpilotdidnotleantotherightthegermanpilotdi dnotleantotherightthegermanpilotdidnotleantotherig htthegerman ...