Down-voting for disagreement vs objection is one of the issues at play.  Previously, we were encouraged to down-vote for disagreement but as the masses came, the use of down-voting as a punishment less harsh than flagging started to become more common.