It all depends on what sort of appearance you want to end up with. If a hit-or-miss surface is OK with you, then go ahead prime and paint. Why was texture material used in the first place? I hate to see it on ceilings, much less on walls. It is usually used as an expedient to help hide poorly finished drywall seams & corners.