Hello :
I am encountering the same challenges at this moment working on spark data and need to feed it in Pytorch model.
I am wondering if there has been a solution for this common problem after all this time?
thanks