No the model is not wrapped in DataParallel (or anything else).
Which details do you need? I can’t publish the model code (yet) unfortunately, sorry.
It’s a deep model using multiple custom layers performing lots of sum, matmul, exp, einsum and log operations. Nothing fancy per se. We mainly use pytorch to obtain the gradients via autograd.