The relative temperature is part of it. Though, the cold shock itself doesn't much change the physical damage, but how much, or rather how little, moisture that cool air holds sure does.

One of the huge reasons smoking is harmful is because it is so dry. Warm temps retain more moisture so a warm water hit keeps your throat well moistened too. 

It's less shockingly irritating and keeps your oral region better hydrated.