I haven't seen barbed nails as such, but I've seen flooring nails that have conical ridges running up the length of them, kinda like a stack of funnels that don't quite nest all the way. My experience with them is that once you've hammered them in, you will not get them out again without destroying the wood around them. However, that is not what I would recommend. I prefer to notch a burr into the side of the nail with a file sufficiently to make it reasonably lodge upon attempting extraction. If you pull with enough force it will tear out, but not so likely on a small animal or fish. The barb in this case is not nearly as radical as a gigging barb. Having 3 or 4 on lashed around the end of a stick or pole about 3/4 to 1 inch diameter ought to fairly well secure whatever you can stick with it.
_________________________
The ultimate result of shielding men from the effects of folly is to fill the world with fools.
-- Herbert Spencer, English Philosopher (1820-1903)