Many thanks for your input @ptrblck. I had a look at skorch and if I am not mistaken, skorch implements sklearn-compatible APIs for “PyTorch models”, and not the other way round, ie. implement “sklearn models” for PyTorch, which is what I am after.
I guess I will have to google around more to see what I can find. Some folks over at reddit have suggested a few ideas which might work too.