hello i have some problmes with the code if anyone may help
train_dataset = train_dataset.map(
preprocess_function,
batch_size=10,
batched=True,
num_proc=4
)
eval_dataset = eval_dataset.map(
preprocess_function,
batch_size=10,
batched=True,
num_proc=4
)
i have the console output
83         if status.IsInvalid():
—> 84             raise ArrowInvalid(message)
85         elif status.IsIOError():
86             # Note: OSError constructor is
ArrowInvalid: Can only convert 1-dimensional array values