Downvoting is enabled once you hit 500 karma, a policy presumably meant to ensure that those most likely to contribute to a quality discussion are also the most likely to have good judgement in downvoting less quality discussion.