Sunlight is not the friend of stored water (algae). If your tap water is up to snuff, I wouldn't put anything in it. I prefer a variety of relatively small containers that one can easily move about. Glass is heavy and can break but is inert; plastic can leach which may or not be an issue - an old goat like myself can drink stuff I would not give to my child, although I think leaching is an overrated problem.

As far as I know, the color of the container is not particularly significant, although darker colors should inhibit sunlight.

It certainly can't hurt to change water periodically when you need to water your plants. If any water is growing stuff when an emergency happens or you have any suspicions, just treat (boil) it. Another reason for small containers and variety.