If you have named the output layers, maybe you can segregate the layers based on that while doing
the back-propagation yourself.
for name, param in model.named_parameters():
    print name, param.data