The system Python will use it’s own “system environment” (or a pip virtual env), while conda uses its base env or any other which you’ve created.
You would have to make sure to use the PyTorch installed in conda e.g. by activating the environment it was installed in.
If you don’t need the legacy 1.0.0 installation, you could of course also remove it.