I've removed all the fireplace ash that I can by sweeping with a broom. There is still a trace of ash. Will it hurt my vacuum cleaner (upright with a bag) to vacuum up this ash? I'm worried about clogging the works up. Thanks.