DALI example is based on an older version of PyTorch APEX example - https://github.com/NVIDIA/apex/tree/master/examples/imagenet 101. You can try to run it as well to check if this may be the DALI fault.