Yes there is a concern with using sanitzers too often. I only use them when I cannot wash my hands regularly; like on a backpacking trip. Also good when traveling.
But most of the time regular, old fashioned, non antibacterial soap is the best way to go.