The UPS's inverter will draw some power like you said. Your other option is to fix up a low voltage UPS. For example my router takes 12v in from a little 12v 1A transformer. So its pretty easy to run from a 12v SLA battery eliminating the inverter loss of an off the shelf ups.