It means that some people prefer to have peace and quiet in their neighborhoods or on their streets, or wish to protect the value of their investment. Some sympathize with the plight of the homeless, others not so much. "Not In My Back Yard"