Aaaah-
Little known fact-

I was told as a child Amish men don't wear mustaches because of the association with military men in the era when they fled their homelands.

So there you go- you may have inadvertently represented a group that the particular order you interacted with still have ambivalent feelings towards...........

It's all a guess on my part, I know plenty of Amish folks that have continued to change with the times, as much as their belief system will allow, and also know many that hang on doggedly to the status quo.