It sounds like it would be worth it to check out the eTrex H. It seems like it would provide the basics (keeping track of where you've been & figuring out where you are) at a very reasonable cost; locally they are running $90.

Honestly, this is a fair bit less than I originally thought you'd need to spend to get into a decent GPS for hiking.
_________________________
Victory awaits him who has everything in order — luck, people call it. Defeat is certain for him who has neglected to take the necessary precautions in time; this is called bad luck. Roald Amundsen