Your bad tasting ice may be the result of algae in your lines and a symptom that your system needs flushed and treated. I treat my well once a year to keep the water fresh and clean. You may call a qualified company to come out and clean your system for a reasonable price.
So there is the question, do you have well water or city water?