huggingface.co
  

  
    

Fine-tuning with custom datasets 1

  This tutorial will take you through several examples of using 🤗 Transformers models with your own datasets. The guide shows one of many valid workflows for u...


  

  
    
    
  

  


i followed token classification tutorial on above link trained completed successufully then i predicted
model = DistilBertForTokenClassification.from_pretrained('./results/checkpoint-500', num_labels=len(unique_tags))
trainer = Trainer(
    model=model,                         # the instantiated 🤗 Transformers model to be trained
)

res = trainer.predict(new_dataset)
predictions = res.predictions```
 
i am getting an numpy array of d dimension how to convert predicted values to its corresponding tokens and i am assuming that res.predictions is numerical value of tags not tokens if i am wrong correct me