Mark, the challenge with trying to do it all yourself is that there are a lot of people who will let you and it'll burn you out. The problem with not stepping up, though, is that the program can easily fall apart with someone to take the lead. It sounds to me like you've got the perfect attitude and just need more support.
Getting the other parents more involved is a great idea, though often a daunting challenge. I've seen that it works best to start them off with small, one-off tasks and the gradually build on that. We have the same challenge in our group. The few of us that have taken on leadership often get saddled with running the show, often with with all the sections, and particularly when we're all together. Some aren't really passionate about the group as a whole and just wear the shirt to be with their kids and help us make up the ratios. Sometimes it's like pulling teeth to get them out of their camp chairs so we just keep giving them little jobs to get them involved. I'd suggest finding out what interests each of your prospective leaders and try to work with that. If you can find something that they're passionate about and willing to share with the youth, they'll be more likely to sink their teeth into it.
You're so right about us having huge competition outside of Scouts. Once we've got them, we need to hold their attention. Another idea is to get the youth involved in planning. Find out what they're interested in and build your programs around those things. Providing them with lots of well-rounded opportunities will go a long way towards achieving your goal of making them want to come back. Over-planning, by having lots of alternative activities, will help you avoid the cursed "now what?" moments.
You're right, that we don't want to them ever be bored. Downtime at camp is fine as long as they're doing something and enjoying themselves without getting into trouble. Kids need unstructured time to over the course of a weekend but in controlled doses.
They need to go home with great memories, a hunger for more, and asking mom and dad to let them have it! Not a small order these days!
It sounds to me like you're on the right track. Don't get discouraged. There's lots of people out there like airballrad and one of them is bound to make an appearance. Heck, they may already be there and just be waiting to be asked!
Oh, and airballrad.... Go for it! You'll never regret it the memories you'll make with your son!