I have heard that using a pellet rifle will work well, though as has been said before, a shot to the body will not kill them immediately, so I have heard.

I have a cactus in my backyard that has some bird holes in them. I have stuffed a oily rag in them so it funks the enclosed area up without damaging the cactus.