Are you seeing some GPU activity?
If so, could you run the model training in isolation using random input data as well as the data loading in isolation without the training to narrow down, which part of the code uses all CPUs?