So I tried to run cmake both the ways I mentioned above (after deleting CMakeCache.txt and CMakeFiles) and I got the same Torch_DIR error:
Could not find a package configuration file provided by "Torch" with any of
  the following names:

    TorchConfig.cmake
    torch-config.cmake