The skorch.dataset.Dataset implementation is not the same as torch.utils.data.Dataset as described here 227. Could you try to wrap your data in the skorch implementation and pass it to the fit function?