Hi @the-pale-king , did you test successfully by using --do_predict? I failed to use --do_predict to test neither CNNDM nor XSUM, as the out-of-memory problem even I set the test batch size to 1. I use the latest transformers 4.4.0-dev