Fish are a great idea. You could build a koi pond or similar and stock it with cat fish, they can't blame you if you happen to like ugly fish.

Also, no one's mentioned ducks. They've got plenty of fat and meat on them and they'll keep you're garden free of slugs and other pests. Noisier then chickens, but more like pets then livestock.