Angie, you will have a much better paint or paper job if you get it all off and no worries about paint problems in the future. You might add a couple of drops of dishwashing liquid to water, water and vinegar or water and D-I-F to do this. When the walls are CLEAN, be sure to use a primer before you paint. The prep work is more work than painting and more important. Henry in MI