Could you check, if you have multiple PyTorch installations on your system and if so delete them and only install the desired one?
What’s your use case that you want to install an older PyTorch version and want to use apex?
Note that PyTorch 1.6 ships with native mixed-precision training via torch.cuda.amp and is the recommended approach.