I think the water that is coming out of the tap is probably not different at all from that which many people across your city drink daily, from a quality perspective. So, plenty of people are drinking the stuff that comes out of your tap. The building's piping could make a difference, but that's not that likely.

If you are really worried, get a pitcher of some type, stick in the water boil it, use the microwave, and save it for you.