I really like the idea of keeping it in the pantry - will start doing that myself. What about other stuff that you use up when camping, etc. ? How much does your BOB weigh when it's fully loaded?

Because packing all the right food for a camping trip usually takes a bit of time, and many times I just want to get out of town on a spur of the moment thing, I keep a Rubbermaid bin filled with camp food that I can just throw in the car at a moments notice. Its like a mobile pantry with all the stuff I normally eat plus some extras. Not as tidy as a fully loaded BOB but I figure (if I'm not taking the car) it would take less than 5 minutes to pack the contents into my large backpack.

I do similar too, when we do go camping then I'll pack things from the kitchen too, but usually items that need more work than whats in my bob. Things like the hotdogs and hamburgers into the cooler. My bob has things like breakfast bars, pop tarts, etc. Stuff that doesn't weigh much, doesn't require cooking, could eat while driving or walking, etc.
I have a similar setup in the garage where I have built shelves along one wall and have some camping gear that isn't in the truck. My ammo boxes and such are there too. Depending on the amount of notice if I were to bug out then I just open the garage door and tailgate and toss stuff in. After we get moved and I build some shelves in our new house I'm going to build one at the same height as the tailgate/bed of the truck and build a small wheeled cart so I can slide them on it and roll it out and slide off into the truck making less trips.
So my bob is part of my whole system, I have my get home bag in the truck, its enough for a night or two stay in the truck or a hotel/motel. Then the bob contains more items for if we would bug out from the house with more food/water/gear to supplement the GHB. Then the camping gear is more longer term. I have a tall cap on the truck so there is enough room we could sleep in it if needed.

IMO
To serve in these capacities I think you will need an internal frame pack.