I have advice for you because I was at the same case with you.
Before making up, you should put on some vitamin E cream and let it dry, this might help your skin to be dry and keep the oil...