Here's what you do to really screw your sense of direction over. Go from living on the east coast of a big country in the southern hemisphere to living on the west coast of another big country in the northern hemisphere.
Have the climate and the vegetation and the terrain and the houses/buildings and the people be almost exactly the same, and you sometimes snap to attention thinking, "Wait a minute. Where the hail am I?!"
Yes, I had that problem when I went to Zimbabwe. Had no sense of direction what so ever.
Most disorientating parts were:
Sun tracking across the skye to the North instead of the South.
The stars were completely different.
Serious sense of
We Are Not In Kansas Anymore Toto......