So, this is a compute node in our HPC cluster, which I cannot access directly. NVIDIA-SMI is able to see 2 GPUs (I am using this module 1 to get the available GPUs).
This is my first time trying to leverage both the GPUs, so I am not sure how I can test that both are getting used.