Any progress on this? I am running into the same issue. I am trying to dynamically increase the examples for negative pairing in a NCE loss using a memory bank that collects sample latent embeddings so I can reduce the mini batch size that is passed through the model.