An ingrown hair cyst looks like a small red bump and often causes no pain. You can treat ingrown hair cysts at home by keeping the area clean and using a warm compress. Irritation from shaving is a ...