removing toilet paper holder

i want to remove a toilet paper holder from my wall ( drywall) i thought it was just simply screwed in but when i unscrew it, it seems stuck - to an anchor maybe? i havnt ever had to remove a screw like this - i try to yank it out, but that doesnt work either. Can anyone PlS HELP? :) thx