... Is that it's a wave, and waves tend to bounce off 'things'.
The more solid the 'material' you use for a fence, the better protection you'll get. There are materials specifically designed to absorbe sound but they're mainly for indoor use.
At worst, I guess the thought of moving to another home has entered your mind. My best to ya and hope this helps.