I always store water containers full. If they need to be cleaned, I flush with Hydrogen Peroxide. For long term storage of "bags", I put a tablespoon of H202 and fill it up. For short term, a month or two, I add nothing. Prior to the trip, dump and refill.

This eliminates the "taste" of the container.