its not easy, but sometimes a wide bladed sharp chisel and hammer are the only ways. I like the use and ergonomics of the long handled tile scraper found in the tile aisle of the home centers.
You will definately have asbestos in that flooring, so be advised.