Or to walk at least 10 yards in some straight direction
GPS should be quite accurate for small, short, changes of position. Most of the error terms vary relatively slowly. 1 yard is plenty in my experience. For me orientation has always been a non-issue.
Lucky you

I rarely have the GPS location precision better than 5 meters (yards) while hiking in the woods with any of my GPSes. Maybe you're confused with the car navigation devices and software? They have a special algorithm which adjusts your position to the road, so its readings looks stable, continuous, and with very small error. IMHO, that's a plain profanation of reliable navigation principles.