Try renting an electric chipping hammer with a 2" spade on it. I have to caution that it can gouge the floor somewhat and may not get all the thinset up. The only sure fire way is to use a grinding machine which may be cost prohibitive.