I have microfleece pants and waterproof-breathable rain/windwear I can put over that.

That being said, I've never used either of those on a hike. Even when it's chilly my legs stay warm in synthetic shorts if I'm moving, maybe with the legs zipped on in windy conditions. I don't go hiking when it's bitter cold. I never wear cotton (jeans or shirts) when hiking, even in the warm. Only synthetics. Weather can change too fast.