When silicone caulk doesn't stick, it doesn't stick at all. When it sticks, the only way to remove silicone is to cut it away. Be careful and make your first cut as close to the wood as possible, even to the point of shaving a thin layer away in the process. If you "saw" it off leaving a jagged surface, it will be a real mess to even out. Silicone on glass or metal is easier to scrape off with a razor blade. You can't sand or wire brush it away very effectively. There may be a silicone solvent out there but I have never heard of it. If you get it on something very porous such as brick, it cannot be removed.

Sorry I can't be of more help.