It can be a challenge to remove paint from brick without causing damage. Your best bet is to apply a paint removing gel or paste with fabric strips. The process involves saturating a soft fabric with the gel, then placing it over the brick. Allow the product to stand as long as the manufacturer recommends, then when you peel off the fabric—the paint should peel away too. Clean remaining residue with a stiff nylon-bristle brush.