Our trick is just to line the bucket with plastic bags (there are special potty bags made just for that purpose). That way you can remove a bag, tie it (tightly), store it until convenient to dispose of, and put in a new one. Between changings, a little PineSol in the bag helps with odor control.

Another little goodie that helps women "look for Indians" is the Lady J , a female funnel if you will. My wife can use that and an empty milk jug with a minumum of exposure...