Hello everyone,
Datasets provide this great feature of formatting datasets using set_format and then choosing the desired format (numpy, torch etc). The encoded dataset I prepared has columns/features of various data types (int32, int8 etc) but HF models require all features to be dtype torch.long/int64. Is there a simple trick to convert all features to torch.long tensors when selecting torch format?
I understand that I could have prepared the dataset with int64 type but that significantly increases the dataset file size footprint.
Thanks,
Vladimir