Steve has some good ideas but, you might want to try one more thing as well.
Mechanics waterless hand cleaner (DL for example). Being a petrolium product, I don't know why it would not work to break the oil down when rubbed on a rock any different than on your hands.
The one thing that you want to make sure you do is to rinse off the area compleatly after you try one method before you try the next.