Clay base wallpaper glue

We just removed some vinyl wallpaper which was a breeze, but underneath was the glue...It's a clay base glue that has proven very difficult to remo...