I would return it, and among other considerations look for a design that won't stress handles or joints or seams when you move the container. I did have an issue with 2 blue jugs leaking several years ago, although I have no idea if its related to your experience. But consider - 6 gallons of water weighs 48 pounds. Ever time you pick up a full container, you're putting 48 lbs of pressure on the handle, seams etc. My blue jugs failed along seams running down and under. I like this 5 gallon design better than the blue jugs, and have had no water storage issues. I think I own 6 of them right now. Solid construction for the plastic age. http://beprepared.com/product.asp_Q_pn_E_WS%20J100_A_name_E_5%20Gallon%20Water%20Jug.

That said, I also have (plastic) barrels full of water, 15 30 and 55 gallons. I move those on a hand truck and dump them in the yard and refill every year or two. The 5 gallon jugs I rotate on the same schedule. Between them I have water intended to stay in place, and other water I might take and go. Even a 15 gallon barrel I might move, if there's time to load it in my car.