Solved by ptrblck in post #2 
              
              
                Fast.ai performed some interesting experiments with super-convergence and released a blog post about it here. Maybe it could also be applicable to your use case.