"Man-bag" sounds like it is over-compensating. It's a bit like "social science" - you just know that no subject with "science" in its name is a real science. Proper science subjects have names like "biology" or "physics".

I call mine a waist-pack or sometimes a shoulder-bag.