For cleaning the window glass of everything other than water soluable dirt, a single edged razor blade is usually pretty handy. You will want to use these in either a metal holder or in a plastic holder that goes by the trade name Widget. These are good for removing paint also. The kind of dirt or other stuff can make a difference on what works best for something like this.