Thank you for your message, Bram. I have put the models back to CPU after generating the embeddings, only the index is on the GPU.
It seems that the index is very large: ~27.1GB. Moreover, when I run htop, the process has 27.1GB on resident memory, which I suppose will be transferred to the GPU which leads to the RunTimeError above.