I have carried a full sized 1911 (Wilson CQB) every day for about 12 years now. I've never had a problem with it in an IWB holster @ 5 o'clock. I usually carry 2 mags on my left side for it. This is with jeans, cargo pants, shorts, etc. The only exception is on my bike when I carry an XD in a fanny pack instead.

Hard to beat a single action trigger, full sized sight radius and less recoil. I think you will be pleased with the step up. With the right holster you probably won't notice the difference.