I've heard that most plastic garbage cans and most of the larger plastic bags that would fit inside one will leach "stuff" into water stored in it.

HOWEVER, I would not hesitate to collect rainwater in a [new] plastic garbage can in an emergency, and repot it into something safer.

Sue