i had a quick look at how the from_pandas method works and you can see here that it’s calling InMemoryTable.from_pandas: datasets/arrow_dataset.py at 3fc744abbef13468fa1f42cf4738e5267234549b · huggingface/datasets · GitHub 3
interestingly, InMemoryTable has a from_arrays method (link) so it might be not be much work to expose this to the Dataset class - i’d definitely open up an issue for this as a feature request!