A couple items that might help are outlet insulation (~1/8" thick precut foam to stop drafts) and window film (similar to plastic wrap) that is taped in & contracts with a hairdryer to be almost invisible.