I'm no expert, but I'd say it's because soap is alkaline by nature. The alkalinity affects your skin. The skin on your face may be extra sensitive to alkaline substances. And, just like acidic products, alkaline products will also hurt if you apply them to broken skin.