If it is on the wall tight I say leave it there. If it was applied to the wall without painting or sizing then you will tear up the walls and will end up having to skim out the entire wall to get it smooth again and this is most likely the reason why the paper has been painted over.