Agreed, you responded appropriately.
The temptation to bash heads together is strong in the moment; but that puts you square in the middle of a situation with dynamics you know nothing about. Too often these messes span many generations. And the bashing, while initially satisfying, may not in fact be the most helpful move in the long run.
That said, as a citizen of a democracy, it's your right and responsibility to speak up when wrongs are being committed. IMHO, if you shirk the responsibility, you erode the right.
If nothing else, it's worth building a paper trail on these characters. We all can guess where they're headed. It gives the police and the courts a better picture of the pattern of behaviour (i.e., a slick lawyer couldn't argue that it's an accidental, one-time thing that won't happen again).