The black mastic is tough, but can be chipped off with a heavy, sharp floor scraper. If you are adding cement board underlayment you probably can get away with less than perfect removal as long as the loose materials and signficant ridges are removed.