Yes sounds like you are too timid. You want smooth and confident strokes but not applying pressure. And it takes time to build the muscle memory for that.
You should have some momentum to the razor,...