At the line trainer.predict, you get the predictions from your model. Or maybe the pred_list obtained at the line after, I’m not familiar with what align_predictions do. Get those for you two trainers and average them, then feed that and the labels to the function used to compute the metrics.