IMHO, based upon decades of poor fashion choices:
I believe that the load-bearing vest falls into the same general category as headlamps and protective eyewear: useful but too ugly/uncomforatble/geeky-looking to use in any but the worst possible conditions. But, I am a vest guy, married to a dw who tolerates my u/u/gl behaviors. Therefore I have some experience with the following:

Filson vests:
Several varieties, several pockets, durable enough to be part of your estate.
http://www.mnworkwear.com/Merchant2/merchant.mv?Screen=CTGY&Store_Code=MNW&Category_Code=FV

Safari photography/travel vests;
More pockets. geekier. cheaper. less durable, worn by journalists on assignment in Baghdad. looks good on them. Does not look good worn anywhere else.
http://walkabout.com/shop/coat-ff-vest.asp?gclid=CJrluO2XkpICFShMGgod6xRE_Q

Tactical vests:
Worn by LEO enforcing warrants and military personnel. looks good on them. Does not look good worn anywhere else.
http://www.tactical-store.com/ts-t5-tv-80001.html

Fishing vess:
Used by fisherman to carry equipment while wading. Tackle boxes tend to float way.looks good on them. Does not look good worn anywhere else.
http://www.sierratradingpost.com/d/204_Fishing-Vests-and-Jackets.html

Mountain/fleece/insulated vest.
Fashion accessories. People actually wear these in social circumstance.
http://www.cabelas.com/prod-1/0047901920565a.shtml

The theory is that vests store items for immediate access, and can be worn all the time. Rucks, fanny packs, briefcases and purses store things in a less accessible fashion, and are more likely to be separated from the user. One does not look sleek in a load-bearing vest, and one does looks like a 'person of interest' to leos in when they are worn out of their context.
The ideal container for survival equipment is probably a laptop computer case: lots of them around, lots of pockets, and they do not look threatening.
I have acquired each of these vets at one point or another, and have gotten actual use out of the first and last categories. Filson vests are suitable for business wear, and fleece/down vests for casual wear. Most can bear some load. Disclaimer: I have never sold a vest,and have no commercial interest in any of the vendors listed.