It's a good question. How far away does a person have to run to no longer be a threat? Outside? Down the street? Just out of sight? At what point are you sure that the bad guy isn't just doubling around the back side to come at you again?
I still have enough faith in my police to call them. I'll put down my weapon when they are knocking on the door.