I want to implement a function for computing metrics and pass it to the Trainer. In the doc, EvalPrediction has 2 attributes: predictions and label_ids. It is written that both of them are of type ndarray but this is not the case for me.
The label_ids have is correct. It is ndarray and has shape (4, seqlen) where 4 is the number of samples in my validation. However, the attribute predictions are a tuple?
At index 0, I have an array of sizes (3, 4, 56, 32104). 4 again is the number of samples 56 is the sequence length and 32104 is the vocabulary size but what is the 3 then?
At index 1 I have first a tuple/list of tuples with size 4,6 and then an array of 4, 8, 56, 64
And at index 2 I have an array of size 4, 78, 512.
What are all these arrays actually? I think this should be clarified in the documentation.
Thanks for your help!