Hi @lewtun ,
Is it possible to skip the load_dataset() step and just convert a list of dict in python that we have created on our own to <class ‘datasets.arrow_dataset.Dataset’>.
For example, I loaded the imdb dataset using
raw_datasets = load_dataset(“imdb”)
Then type(raw_datasets[‘train’]) is a  <class ‘datasets.arrow_dataset.Dataset’> which upon printing is a list of dictionaries like:
print(raw_datasets[‘train’][0]) gives -
{‘text’: ‘Bromwell High is a cartoon comedy. h. A classic line…What a pity that it isn’t!’, ‘label’: 1}
So if we have created a list of such dict in python and have a list for train and test cases, then is there a way to just convert these list of dict to <class ‘datasets.arrow_dataset.Dataset’>
Thanks,
-V