Could you post the loss calculation and in particular how the average loss per voxel is calculated?
You can sometimes observe a higher training loss compared to the validation loss, if e.g. dropout is used and the training model has thus less capacity.
However, a 10x increase seems too large.