I posted on this topic about a year or so back. What you are looking for is a Messenger Bag. Here's the website:

http://everestbags.com/

I have been wearing one for almost 4 years now??? It is still in great shape, cost me less than $20 new, and holds all my EDC items, save my keys. It has room for other odds and ends I need from time to time as well. There are many variations, so look at the inventory.

Mine's come with me to Iraq, up to elk camp (I have another one just for hunting, especially useful for muzzleloading), out on fishing excursions, just about anywhere I go. It could be called a "Man Purse" but I just call it a shoulder bag, or occasionally a Messenger bag. No one ever ribs me about having it, so I guess it is an acceptable male accoutrement.