defintily wait until the irritation passes
i agree with the making sure to use hot water, at the barbers that do hot-toweled, it feels way smoother

the soaking in hot towel may be excessive, but...