How would I kill a zombie?

Well, zombies are already dead, so the question is moot. The real question would be how to stop a zombie. My answer would be selective shots to the head using small caliber weapons.

Why small caliber - it's cheap, plentiful and there are no next day recoil bruises.

Shoot em in the head, makes them dead dead dead. Rather than just undead.