Yeah I made that mistake with an aggressive face scrub the wife had...
I just use Noxema if I am going to shave before a shower, seems to work pretty good, and I can't beat the price....