Ray Mears shows an improvised water column filter i.e. PET bottle with the cut top off stuffed with charcoal, sand, peat and sphagnum moss etc. This is reduce a lot of chemical contamination.

http://www.youtube.com/watch?v=6TvE5jv4KPo

Boiling the water afterwards takes care of any of the nasties that are left.