Good for you.

I have never been in a traffic accident where wearing a seat belt made any difference what so ever to the outcome. Ever. I still wear seat belts when I'm driving.

I probably can't match your level of boating experience, but personally, I've never fell out of a boat. Ever. I still urge people to use PFD's and kill-switches, in particular when alone. An entry ladder seems like a good idea, too.