"I wear larger shoes but the pinky still rub the shoe leather."

Find a genuine cobbler's shop. Not many of them around any more. Like everything else shoes have become disposable and generally not worth repairing. But cobblers are handy to have around.

They have a specialized device known as a shoe stretcher that they can use to stretch the leather in the offending area to get you a little more room. Last time I had it done it took all of ten minutes and cost me five bucks. A persistent issue that had been bothering me all day and likely would have taken a few more days to clear up on its own was quickly made right at a reasonable cost.

Lacking a friendly cobbler I have resorted to doing the job myself. I have had good results using a damp cloth to moisten the offending area and then using a rounded object to stretch the leather from the inside. I had luck using a hickory hammer handle. Once it was stretched I packed the interior with newspaper overnight so it wouldn't shrink back.

Not quite as quick and effective as what the cobbler did but it made a world of difference.