In the UK a purse is usually a very small thing mostly used by women for coins and cash. Larger things are called hand bags or shoulder bags.

Personally I think "man bag" smacks of latent homosexuality.