A light weight bivvy sack would be very handy for an impromptu overnighter. Something like:
https://www.surviveoutdoorslonger.com/shelters/survive-outdoors-longer-emergency-bivvy.htmlThis same company has additional bivys, somewhat warmer and more expensive, and others produce similar products. In mild conditions, with a bit of extra clothing, this is all you need.