hey @olaffson you can load your pandas dataframe as a datasets.Dataset as follows:
from datasets import Dataset

df = ... # your dataframe
dset = Dataset.from_pandas(df)

from here it should be straightforward to adapt the code in the course lesson to fine-tune a model on your data 
you can find more information on loading from pandas in the docs