My husband recently installed and mudded new drywall. While we were priming the drywall, I noticed there is a fine crack along the top corner of the walls. Do we need to remove the tape and retape/remud the entire top section?

You could just remud and then prime over that to take care of the problem.