You need some pressure, but keep the pressure downwards, not into your skin. Use short confident strokes.
Your lather may be a bit too thick as well, if you feel it sucking the razor to your face.