You could register the nn.Sequential container directly using self.W_di = nn.Sequential(...), which will thus register all internal parameters.
I’m not sure, if I understand the use case correctly, but if you need to get only this subset of parameters, you could call:
model.W_di.parameters()

Would that work for you or do you need to handle these parameters somehow differently?