Don't let your skin stay oily. Wash your face twice a day with a gentle face wash, (or water if the face wash dries out your skin).
If you’re outside, use a face mist and dab your face with tissue to get rid of the oil. This makes for great skin hygiene, while keeping acne and other skin infections at bay.