gas vs electric
I have not personally ever had oil heating but some people swear by it. Temptation would be to leave it in place, esp. if it's brand new. Natural gas is great, but I hear gas could be going up (maybe 60%) this winter here (Colorado)--so it too has its occasional (market-based) drawbacks).
I like natural gas for the water heater and stove...in fact, had a gas line run for the stove recently. It's just a superior cooktop fuel.
As for the dryer, we have an electric dryer and it's OK. Natural gas probably would be better but it's probably not worth replacing...unless you use quite a bit.
So I guess you gather that I'm not a big fan of changing stuff just for the sake of changing it. My opinion: run the gas line to the cooktop/range, and use the money you saved to pay down your mortgage.