I would think that part of it is a reflection from the bright color of the clothes. The solution is to change the clothes.
Part of good portrait photography, is dictating the clothing that your subjects are wearing. Bright colors & busy patterns are usually bad choices because they make for distracting elements in a photo.
Also, in your example photo, the saturation looks to have been cranked up. Usually for portraits, you want to limit the saturation. Too much saturation (especially red tones) tends to make skin look less than ideal.