I see, that explanation about the encoding makes a lot of sense. Are there any resources describing the parallelization of CNNs in PyTorch? I couldn’t find anything in the documentation other than resources talking about general parallelization using some specific PyTorch modules.
Thanks again for the help, my model loss is decreasing steadily now - just have to beat some loss plateaus. I also now understand the implementation of the architecture much better!