Here's what you do to really screw your sense of direction over. Go from living on the east coast of a big country in the southern hemisphere to living on the west coast of another big country in the northern hemisphere.
Have the climate and the vegetation and the terrain and the houses/buildings and the people be almost exactly the same, and you sometimes snap to attention thinking, "Wait a minute. Where the hail am I?!"