I just started using a straight razor as well and found I have run into this issue a few times as well (particularly under the nose). For me this seems to be a combination of angle and razor...