thanks, it seems like a very useful addition and I may end up working on it if ModuleList doesn’t accomplish what I need and no progress has been made.

Now that I that I think about it, this would be very useful in the case of multitask learning. Say you had a ModuleDict that contained multiple output layers, each with a key for the particular task. You could then apply a loss based upon groups of key values, removing the need to infer the position in a list. Hmmm…