As a rule all of the wasps will be in the nest and don't come out until it heats up.
Spraying the nest with a brand name spray is the best and most will spray a distance of about 20 feet. Although, I would try to spray into the hole/entrance to stop them from coming out. The ones that do, will be pretty slow and would have been exposed to the spray and will die, leaving none behind to rebuild.
Again, use caution and follow the instructions on the can and wear eye protection and a mask. If you do not feel comfortable doing this, get a friend to do it.