Hi,
Your assumption is correct:

num_workers will set the number of processes (EDITED thanks @SimonW)   used to load and preprocess data in the dataloader
set_num_threads sets the number of threads that can be used to perform cpu operations like conv or mm (usually used by OpenMP or MKL).