The torchvision classification models should have been trained on ILSVRC2012 86, so you could download the dataset using the provided link.
Did you use the ImageNet example code from the PyTorch repository or how did you calculate the accuracy for Tiny-ImageNet?