They were put there for a reason! I would NOT remove them! You could cover them with a variety of things. Could hide the flashing with evergreens. You have many options for cosmetic improvements. I would do something like the flashing you describe to prevent further water damage!!! Fix the problems first, then work on cosmetics! Enjoy!