I was able to resolve this issue. I actually was running each environment as a kernel in Jupyter notebook so as to easily switch environment. I had to install captum in the base environment as well to make this work.