Hi @lewtun ,
thanx for you cool input  
unfortunately, I am not able to use Datasets because its not installed in my target environment - I usually use Pandas or Spark there - is it possible to substituete Datasets with Pandas or Spark based on direct access to trains.csv and test.csv in your notebook?
I also do not have an Internet Connection in this target environment (for security reasons) which is why I cannot use a direct download link from GitHub or anywhere else  We  have transformers v4.2.1 installed and so I am bound to this version as well.
Would you be able to adjust your sample notebook to these requirements:

use Pandas or Spark for data retrieval
Access data from file system rather than retrieval through Internet connection as I want to replace this later with my own data in our private environment
Use transformers version v4.2.1

Sorry to be such a pain about it…       …but I hope its easy to meet these requirements as I imagine many others working in similarly locked down environments …
Thanx Dirk
PS.: I have found a notebook in the transformers community (after unsucessfully testing 3 others) which seems to meet my requirements (but is much more complex as your approach) but appears to work with transformers 4.2.1 <=> 4.3.3:
  
      github.com
  
  
    DhavalTaunk08/NLP_scripts/blob/master/Transformers_multilabel_distilbert.ipynb 45
{
  "nbformat": 4,
  "nbformat_minor": 0,
  "metadata": {
    "colab": {
      "name": "Transformers_multilabel_distilbert.ipynb",
      "provenance": [],
      "collapsed_sections": [],
      "toc_visible": true,
      "mount_file_id": "15ZXLCtJmBmByqWLkJsyuRuidGunSQt3c",
      "authorship_tag": "ABX9TyMYFn2H5CH0K8Hce4nsXrwt",
      "include_colab_link": true
    },
    "kernelspec": {
      "name": "python3",
      "display_name": "Python 3"
    },
    "accelerator": "GPU"
  },
  "cells": [


  This file has been truncated. show original