There's an important distinction to be made here between public and private colleges.  Can't private colleges, being private entities, restrict speech however they see fit, in the same way that your company can?