Use gaffer's tape instead of duct tape. gaffer's tape is very similar to duct tape except that gaffer's tape can be lifted and reused a few times and does not leave a residue on whatever you adhere it to. The only gotcha is that a lot of gaffer's tape for sale is not very good quality. Buy a reputable brand like 3M.
Word! Gaffer's tape is also available in low-temperature versions that will retain more stickiness in cold weather.