I carry a military style pack EVERY day (Eagle Becker Patrol Pack) - sometimes wear a plain OD Army jacket - used to wear cammo occasionally - never had problems except when a co worker said that if I was going to blouse my sleaves, do it RIGHT, and he showed me how (Ex tread head Major) - My reply "Yes SIR"
I still wear a civilian pattern of cammo jacket on rainy days - it's my best goretex