Hi there,
I have a simple RNN model, that has another pre-trained RNN for an encoder and a pretty simple decoder with attention.
I runs with batch=1, but anything bigger than that fails.
I tried to use nn.DataParallell, but it consistently hangs (PyTorch 0.4) (note: I can never get all GPUs fully free - usually someone is running stuff too on the cluster)
I can’t really reduce my model parameters further due to the pre-trained tensor dimensions.
Any advice on what else can be done? Thanks!