Funny, I switched from Nalgene HDPE bottles to Lexan because of the odour issue. (Though curiously, when I catch a whiff of those old bottles, it instantly conjures up good backpacking and camping memories. I guess I wouldn't entirely mind going back to HDPE.)
I'm still going to use my Nalgene Lexans for trips. But I won't let water sit in them for longer than I can help. I won't use them for everyday drinking containers at home. And I'm going to relegate my older, scuffed-up ones to "handwashing and emergency" use. Apparently they release more BPA as they get older.
I picked up a nice 750ml stainless steel bottle from MEC a couple of weeks ago. No heavier than a Nalgene, and it can be turned into a water boiler if necessary. Under $10, so no problem with cost.
BTW: There's also some buzz about #1 plastics, PETE, the water bottle stuff. Some say it should not be reused since it too can release a questionable chemical as it degrades. Not sure if this is truth or hype.