Deep Learning, Machine Learning, Pytorch Lightning, Metrics, AI.
different number of possible candidates. For this reason, IR metrics feature an additional argument called indexes that say to which query a prediction refers to. In the end, all query-document pairs are grouped by query index and then the final result is computed as the average of the metric over