I think in most terrain the landscape will matter more than which hand the finger you prefer to pick your nose with is on.
You might want to walk in circles but hills, swamps and other obstacles are going to guide most people into definite paths.

It can be very easy to get turned around in forests though. Even a mild overcast of cloud defeats the sun as a direction guide.

It might be good to ask how you steer your course with no compass.
If you have no GPS or compass how do you keep your heading under various conditions.

(P.S. A compass only gives you a bearing, it does not directly give you a location. The only way to get a position fix with just a compass is by sighting bearings on objects that you know the location of.)