Hey Desperado, since I'm non practicing (not shunned) Amish I'll try to answer, even though I wasn't there. It was probably one of 2 things:

1- Words or actions that placed them in an uncomfortable spot(aggressive/adversarial), more discomfort than shame or embarassment, they just want to be left alone and avoid aggression and confrontation.

2- English butting in, even against other English. Probably have too many gawkers and hecklers already, and suspect everyone's motives.