Machine Learning, AI, Self Driving Cars, Robotics, Artificial Intelligence.
global training can make progress e.g. MultiWorkerMirroredStrategy in Tensorflow. This can lead to deadlocks if there are multiple partially scheduled jobs on the cluster. Consider this example: There are 4 GPUs available. There are 2 pending jobs, each requiring 4 GPUs. Each job got 2 workers