Thomas, if it is oil based paint, then a heat gun and putty knife is about the only way. But since it is on concrete, are you sure that it is oil based? I am guessing that you are talking about something like a basement floor and if I were doing a basement floor, I would do it in an epoxy based paint. Tell us more and we might be of more help. Henry