To answer your second questions,
the student models are a smaller version of the finetuned-pegasus models, created by choosing alternating layers from the decoder. This method is described in the Pre-trained Summarization Distillation 18. To use these models you should fine-tune them