Absolutely. My preferred canteen is a 32 oz Gatorade bottle- light, strong, and durable. a few year ago, Gatorade was sold in gallon containers that made perfect large canteens,perfect for kayak camping and storage. I wish I had more of those.

Typically, large containers of two liters or more are rinsed out, filled with water,and stored away in various spots to add to my emergency water supply.