Have a look at @Thomas_Wolf’s blog post 247, where he explains the memory usage of the different devices and how to reduce the imbalance.


Do you mean the performance regarding the model accuracy or throughput?