There's a difference between the droning white noise of conversations not fighting for your attention and having people pester you directly because they want to ask you a question and have zero respect for your zone.  Your coffee shop is an example of the former, but I believe the parent to your post is talking about the latter.