Solved by ptrblck in post #2 
              
              
                skorch is a sikit-learn compatible PyTorch wrapper, which should allow you to apply the scikit-learn cross-validation utilities directly.