This one is simple. The more difference in temperature you have, the faster the liquid is cooled down. This means that you should first let the tea cool by itself for 5 minutes,  then to cool it with milk to get the colder version.