Actually silk underwear holds moisture (I've never worn silk underwear but I know they are better for warmer climate). Wear loose boxers to keep your balls cooler.
Also wear longer sleeves on shirts to cover the back of your hands from sun and carry a wool watchcap because it packs small and when the weather drops dramatically it's very efficient in conserving body heat.
Frankie