@Oli  I checked. Yes it is 5,000. Thanks for your precious help:pray:
By the way, with this implementation does the trainloader picks random 500 samples during each epoch or it is sampled only once at start?