While you point out the fallacy in taking isolated cases to make a general point (anecdotal evidence), the fallacy that you are falling to is to assume that most members of a group will have the typical characteristics of that group (the ecological fallacy). Both will get you into trouble.

There's just too much overlap between characteristics and behavior of men an women for these distinctions to be useful.