One measures voltage across the terminals of the battery. If the voltage under load is close to the same as when it isn't under load, your battery is in pretty good shape.

Battery testers that do not measure under load are pretty common, but unfortunately aren't particularly useful. Good battery testers always introduce a load.