Ok, I tried to change a few things in the DataParallel 9 example like setting the fc layer in an OrderedDict or in a list and the example stopped working. I guess the problem is caused by the fact that the layers in the decoder of my previous post are stored in an OrderedDict.