Primer makes a surface HOLD paint better, but doesn't do anything to make the surface smooth.
Go get your wall smooth you either need to get rid of the glue (scrape, melt, etc.), or put a "skim coat" on the wll to smooth it. A skim coat is a thin coat of drywall compound (or the like) which, when sanded smooth, makes your wall smooth.