I don't like to wear hats, either. Normally it's just a hooded parka for me.

If it's really cold, meaning below 0F, it'll be wool watch cap plus hood. If there's a strong wind plus sub 0F, I'll switch to the fleese OR balaclava. That actually makes cold wind almost fun, but if worn in normal weather would probably prompt a visit from the local SWAT team.