I actually talked to a dermatologist about this today.

The verdict: Go ahead and do it if it makes you feel good but it is not something a medical doctor would suggest you do. Like Bornyo said, a mild soap, water and a wash cloth do the job fine.