When in doubt use a primer. I have never regretted using a primer and often regretted having to prepare for re-painting surfaces that were not primed. Primer will help the paint adhere and prepare the surface sealing in the salts and tannins.
One coat of weatherbeater would not do the job anyway. Get your primer tinted close to the finish color.