Not giving out your number doesn't prevent someone from being able to dial it. Many spammers simply automate starting at "0000“ and increment calling each until someone answers. Once you answer they know it's a real person.