You have to check for every class.
Make sure to keep the same ratio between the two sets. For example if you have a training set that contains whole class 1,2,3,4,5 and a validation that contains whole class 6,7 it could lead to bad classification