Old type battery lanterns that use 6 volt batteries, fit an LED bulb and a modern battery for DOZENS of hours bright run time.
Oil lanterns, both wick type hurricane lamps and pressure lanterns.

Sometimes, good quality wool blankets.

BTW, the term "thrift store" is very little used here, "charity shop" is pretty much the same thing.