Let me rephrase the question. What's preventing you from living in your ideal location?
I'm in a pretty good place already, all things considered.
Otherwise- risk aversion, lack of imagination, tolerance for sub-optimal conditions (such as work), and 35 years of accumulated stuff in the house have their effects.
I'd revisit the question after a house fire I think....