What angle are you holding the razor to your face? If you're holding it too flat on a with the grain stroke it could ride more on the spine and never get the edge to an actual cutting position...