Does anyone know if that nasty plastic water bottle taste means that the water is bad for you?

This overpriced Culligan 5gallon dispenser I just got two weeks ago is already producing "plastic" tasting water, and I'm wondering if it's safe to drink, or if I need to pitch it.