If it makes you feel any better, my son, who is 4 1/2, goes with me into the woods behind our house and there we do "fun" things like build an improvised shelter, find edible plants and, of course, we build fires. He often pretends to hunt for deer, which we "cook" over our fires. We do this not just in good weather, when it's easy - we were out there in the snow just the other day, where I showed him how to look UP for dry fire wood, how to deal with keeping a fire going in snowy & rainy & windy conditions, how to make tinder, and how to keep a fire under control. We've build dakota fire holes, we've dug burn pits, we've tried every technique we founf in the US Army FM-261. We've lit fires with tiny sparks and pocket fuzz and we've lit fires with Trioxane tabs. We've lit fires with steel wool and a "D" battery. We've used antiseptic towlettes to kindle a fire. He's got his little swiss army knife with him all the time, has a small first aid kit in his little backpack and I'm damn proud of the fact that he knows all about tinder, kindling and firewood - AND how to use them (with some help from Dad, of course).
So, it's not everyone...just most.