I’ll try to get an example written today!
If it helps, the models I was trying to evaluate are fairseq-based (I had to dive a bit to get the actual nn.Module out from underneath the tasks…) and are loaded using Model.from_pretrained(...).