Hi,
What models in the Transformers library output are called logits (they are called predictions in your case), these are the unnormalized scores for each class, for every example in a batch. You can turn them into probabilities by applying a softmax operation on the last dimension, like so:
import tensorflow as tf

probabilities = tf.math.softmax(predictions, axis=-1)
print(probabilities)