Okay, I think I see the problem: pretty large embeddings, you could try if each model fits separately on your GPU and then just write their outputs into a .csv file and use these outputs to train your own model.