In that case you could:

manually crop at a specific location only
use FiveCrop and just return a single location (randomly selected or fixed)
reduce the batch size by a factor of ~5 and collapse the crops into the batch size to get ~128 samples per batch