Yep, that is why I have my own containers and refill them regularly. I do like most of the Reliance water containers. Some are a bit fragile if you are moving them around a lot, but there are a couple of styles that are very durable and a good size for moving them around.

Jumbo-Tainer 7 gallon

Rhino