spring tail insects

We have lived in our home for 2 years now. It was built in 1991. Since we moved here, I always see spring tails near the windows - inside the house. I have done a lot of research regarding these tiny bugs and have my home exterminated regularly but they continue to be a nuisance. They are even on the second floor which is unusual for them. My question - We need new windows (very drafty) would this resolve the problem? Open to any and all suggestions or help you can provide for both - the spring tail problem and purchase of new windows (I have read most of your information about purchasing windows)!!!

Thanks, Jodi