Your local CUDA installation won’t be used, if you install the conda binaries with cudatoolkit.
What’s your use case that you need such an old PyTorch and CUDA version?
I would generally recommend to install the latest version of both libs to avoid already fixed bugs and get new features and utilities.
EDIT: seems to be a double post from here 1 with a solution.