Don't take this personally...

So what happens when your neighbors tell you NO, go away? Won't your plan will fail immediately since you cannot force yourself on other people or their property when YOU decide it's time to take their space? Better have a backup plan.

Bringing up matters like this to neighbors would have to be done very cautiously, or they may take it as irrational paranoia when talk of defensive positioning, etc are discussed.