Did you try any post shave balms? Nivea sensitive skin is great for me.

It could be sensitivity to shave soap.

Your angle or pressure could be off. Pressure should be light and the spine should...