I have quite a few roof racks for my vehicles, and like anything else, there are different racks for different purposes, it really depends on what you're carrying and how much you're want to spend.
What you are probably seeing on the road are just factory roof racks which are just like you said, basically a fence to keep the stuff on the roof and give you a place to strap things to. IMO, they're useful for a quick trip to Home depot or to strap something on short term, but more for looks than utility.
Then there are the cargo baskets by Thule, Yakima, and many other which use the factory roof rails. I keep a small yakima basket on my daily driver because it's relatively unobtrusive and I rarely have a need for it, but I like it there just in case. Most of the time I'll use it for stuff that's large and bulky, or if I'm transporting things I don't want in my car (i.e. leaky trash bags, fuel, or other smelly items, etc). It's small enough that I don't notice any drop in fuel economy or stability issues, but since it uses the factory rails it is only as strong as the factory rack.
A couple of examples of a cargo basket
Yakima Basket Rola Basket Thule Basket At the upper end are the heavy duty roof racks that you'll see on a lot of off road vehicles. INTI makes a really good roof rack of this style, or the (now discontinued) Con Ferr is probably the most common I've seen. These racks are very large and heavy (75lb-100lbs or more), putting them on is at least a two person job. These racks will hold anything you can put on top of it, including a couple of guys standing on it while loading. I rarely use mine because you can really feel the weight up there while driving, your gas mileage drops by quite a bit, and personally I just don't like having that much stuff on the roof. But when I need to carry a lot of stuff over long distances, that's the rack I use. I have exceeded the factory weight limit many times, though I think that's more of a legal disclaimer than actual rating. A vehicles roof should be able to support the entire weight of the car if loaded properly, but the stability while driving will suffer even with a minor load up there.
Examples of a heavy duty roof rack
INTI roof rack Con-Ferr roof rack One reason I do not like to use roof racks is there is really no way to secure anything up there short of having a cargo box, and even then those boxes aren't that secure. Plus you really have to be careful about low overhangs and parking. structures. I only use it if I'm absolutely crammed full inside the car, and only then I'll try and put the bulky, non-important items up there.