Having worn a knee brace made of neoprene and velcro for a period of 3 months, I can state this as fact:
You are not going to be comfortable wearing that contraption.
Period.
Rethink your concept, I am sure someone here can help.