ImageFolder creates the class index in these lines of code 186.
To get your class mapping, you could try to add leading zeros to your folders so that the sorting will match your order or try to implement your own Dataset.