Yes, I always prefer to use both if possible. I use a Garmin GPSmap 60csx and the batteries last a long time, but I do not use it for constant navigation.

And to Jeanette, I normally use the sun and other celestial objects to maintain orientation, but they are not as precise as a compass unless you have other instruments, and the compass is much easier than those other devices. For general direction and maintaining a general heading the sun works just fine.