I'm going with the theory that by being near the fight, you swell the perception of numbers of the group, causing the troublemakers to get bolder, the responders to think they have to respond harder (possibly catching you in the net as well) and greatly increase your odds of getting caught up in the fight. By clearing away from the fight, the troublemakers are more easily isolated and dealt with.