Frost forms when your windows are exposed to moist air inside your home and cold air outside. It can be beautiful, but also damaging. Proper weatherization and the right balance of heat and humidity can go a long way toward minimizing window frost. If all else fails, and if you still have single-paned windows, you might want to replace them with double-paned.
Related—How To: Avoid Frost on Windows