I try to pick up 1 little extra thing each time I go to a store. What I get depends on what kind of store I have gone to each time. Today, I picked up 2 large bottles of coal oil for my Hurricane Lamps. At food stores, I pickup dry goods and my spouse picks up c-rats. I save condiment packs from the different burger / taco joints that I stop at here & there. Every 3 months I throw some gasoline in my truck & go get the cans refilled & stabilized.
If you are in the habit of doing a little here & a little there, neighbors don't notice anything & you keep a low profile.