I’m using skorch for a regression problem. I find it great and I’m using it because it implements cross validation automatically. My project should be simple I have 3 features and I’m predicting one single continuous value. My problem is that whatever I do and even using regularisation with weight_decay, my validation loss increase rapidly while my training loss is near zero. I know that my model is overfiting but how can I prevent this ? I even tried batch normalization but it also didn’t work. any thoughts ?? I would apreciate it if someone guide me on this. Thanks in advance