I once read somewhere that you need to be moving at least 5 mph (a good fast walk will do) to get a decent directional reading using purely the GPS positional information.

For finding directions I still prefer a good magnetic compass that I can play around with without worrying about the batteries draining. <img src="/images/graemlins/smirk.gif" alt="" />