This makes sense if there is a button labeled "off", but in this case the middle of the slider is unlabeled.  The part you interact with (at least if the slider were a physical object) is different from the part that displays the state, which sidesteps this ambiguity in a pretty clever way.