And, yes, regarding these student models, I have looked at them, like this one:

  
      huggingface.co
  
  
    

sshleifer/student_pegasus_xsum_16_4 · Hugging Face 13



  
  
    
    
  
  


But again, it looks like these student models have already been fine-tuned, for example here, seems to be fine-tuned on xsum.