I avoid this by having vehicle keys on their own key ring ... just the vehicle key & the fob (if applicable). I then carry my other keys & a couple EDC items (flashlight & whistle) on separate key rings. I can still carry it all together using a small carabiner, but can easily separate off the vehicle keys and use them to operate the vehicle without the rest banging around.

Another advantage is that this way I'm also only carrying around the keys for the vehicle I am actually using - in some cases none at all - instead of keys for all I own.