I am a hobbyist barber and I use a product called Tend Skin for friends and family that have issues with shave bumps and ingrown hairs. Its has worked reasonably well.

From the sound of it you...