Yes, this might be expected and depends on the actual model, data shapes, as well as the general memory requirement of the training script. You could compare it to your normal workstation, which could also run e.g. Firefox without filling all RAM.