Thanks. I use the model as it is without fine tuning. I use beam number 16, with max_len of 256 to reduce the text generation time. I also use cpu for the faiss, so the whole service can fit to my 8GB GPU ram. Actually it needs now only 5GB gpu ram instead of 13GB when I used gpu for the faiss index.