The only flaw I see is that being the small wimp that you imply, you might need the gun to defend yourself, while a bigger & stronger intruder/bad guy might not. He can beat you to death with most any blunt object or even with his fists if he's of a mind. Your handgun may be the only thing you have to prevent that from happening. By giving the bad guy an unloaded gun you've just donated a blunt object for him to use.

If you have the mindset, a gun is a great equalizer and can help you to prevent blunt objects from coming into use. It's all about mindset. Either use the gun as Sam Colt intended, or lock it in a safe and forget it's there.

BTW, after he's finished with you, he can always get some ammo and make the gun usable again. Maybe not against you, but his next victim will have you to thank. Some people really do need to be shot, think of it as a community service. $.02