I do not know exactly why this approach is chosen, but it solved my problem even on huge datasets like Places with about 1.8 million images. I augmented it 6x bigger and everything seems fine!
Maybe if you explain your question more specifically, one of PyTorch developers answer you.
Good luck mate