How to get rid of dry skin?

I've been using Clinique Acne Solutions for oily skin for the past four days. It made my skin look amazing the first two days. Then yesterday my face began to sting and get a little dry after using the moisturizer and I woke up this morning with insanely dry skin. My face hurts and feels scaly. It looks terrible. I don't know what to do. My forehead and nose even got shiny today after I didn't use the product this morning. I don't want oily skin again but I can deal with this scaly, dry skin. HELP! How do I get rid of this?