so, what we need to do is to generalize and there is a notion of so called soft margin svm which allows mistakes, so they can be a few of the positive examples and the negative side of the boundary and a few negative examples of the positive side of the boundary.