Ingrown hairs can be itchy, painful and cause redness and swelling. Learn more about ingrown hairs, how to treat them and how to prevent them when shaving. We all want healthy looking skin after shaving. However, shaving can also lead to razor burn, skin irritation and ingrown hairs. Ingrown hairs can occur after you shave and are the result of cut hair curling back into the skin.