One other point: one problem with small hooks is that they don't hook well. Because of the small gap, they may fail to bite properly, and either not hook the fish or tear loose easily. To help prevent this, use pliers to offset the point or open the hook gap slightly. With very small hooks, offsetting the point is better imo than opening the gap.

I do this with every hook I use. There's no doubt you get fewer missed strikes, and I'd apply the same thinking to fishing with a trotline.

And while we're on the topic, use sharp hooks -- if they aren't sharp, you will miss fish. Chemically sharpened hooks (Gamakatsu, Tiemco, Daiichi, etc.) are more expensive but they're razor sharp out of the box, while good old Mustads often need sharpening. But chemically sharpened hooks are more brittle and may break when you take the pliers to them to open the gap.