Consider reversing a flashlight battery, the easiest one to get to and turn around, to cut the electrical circuit during storage.

Consider adding the rechargeable lights that come on only when there is a power outage.

Consider sets of rechargeable batteries left in a charger rather than in flashlights.

Consider the combination.