Solved by shartzog in post #2 
              
              
                Hi @Paze! 
I think you might actually BE training on your GPU, but because you have your batch size set to 1, your algorithm is spending most of its time passing data to and from the GPU memory instead of actually doing the calculations. Have you tried a larger batch size? 
If you’d like to see what…