Great topic. I keep a pair of lightweight Mechanix gloves in my EDC bag. They are thin and light, made for abrasion protection but not insulation. They sit flat in the bottom of the bag. I have a pair of traditional leather gloves in the car.
Fit is important, and different pairs of the same brand/model/size can fit differently. Try on a bunch to find the ones that fit you best.