Take 4 AA batteries down to your local hardware store to use as a guide and buy a piece of PVC or CPVC pipe, a glue on end cap for one end and a screw on end cap for the other.  The store will cut the pipe for you and probably glue it up for you and you won't even have to buy glue. Between PVC and CPVC there is a size for every type of battery.