Are you planning on protecting yourself from yourself, or from others?

I suppose you could make an argument for gloves to avoid what others may leave you. But, really, are your hands going to be touching the toilet, or other's feces or urine? If you're washing your hands, you're already taking care of the contamination problem. If you're wearing gloves because you're worried about what you may be carrying, then it's already too late.

About the only thing I can think of that you'd be realistically concerned about is flushing, which is really the only time you touch the toilet with your hands. Use a paper towel or some T.P. if you're that concerned, then just wash on the way out.