Actually, my understanding is that those prisoners who say that solitary won't bother them are usually the first to go around the bend. But even they know that there are other people around, even if they don't get to interact with them. Humans are social animals, if you know that there is NO ONE for miles, and no way to change that, you'll not be in such a healthy place after a while.