Agreed! I bought the digital camera I did (Minolta DiMage x20) mostly because it was the smallest camera I could find that would still take commonly available batteries.
In addition to having a limited life due to recharging (number of charge / discharge cycles), I've also heard that LiIon batteries have a shelf life as well, and it's not nearly as long as CR123-type lithium batteries. I still have a Bear Cat Scanner I bought 15 years ago. I've replaced the NiCd batter pack, and the thing still works. Will I still be able to find these custom LiIon packs in 15 years? Doubt it.