Ok, so I think I’ve found what I was doing wrong, embedding_networks was a python list and instead it should have been a torch.nn.ModuleList (https://pytorch.org/docs/stable/nn.html#torch.nn.ModuleList 238)
It seems to work once I made that change, still need to validate that it’s actually training (as in, that the backwards prop graph has the correct linking inside of it), but barring that, just by printing the parameters it looks fine.