Too much pressure is the likely culprit. Lighten up on your pressure and see if that doesn't help. Try to imagine you are only shaving off the lather, just the lightest touch.
Good luck.

Also,...