Solved by ptrblck in post #2 
              
              
                You could try to profile the code and determine where the bottleneck is at the moment. 
E.g. if the data loading is the bottleneck, you could potentially increase the number of workers, if that’s not already done. I don’t know what kind of systems are used on Kaggle, so I cannot comment on the data …