Solved by ptrblck in post #3 
              
              
                You are missing the __init__ call in super: 
# yours
super(ModelParallelModel, self)
# fix to
super(ModelParallelModel, self).__init__()

However, I’m currently not sure, why you are deriving from nn.Sequential instead of nn.Module, as you are not using any attributes from nn.Sequential.