@the-pale-king Yes, even I use 48G ram GPU, it still suffers from out of memory problems when I try to test the bart-large model. Anyway, thank you for your advice! I’m trying to test BART-large on the XSUM dataset on CPU now, it seems ok, but takes 3 hours.