Many thanks @kulin_seth for your clarification, I will max out the number of GPU cores on M1 Max and also the RAM probably for TensorFlow training.



 kulin_seth:

Tensorflow Metal plugin utilizes all the core of M1 Max GPU. It appears as a single Device in TF which gets utilized fully to accelerate the training


Regarding Federated ML, which might be unrelated to this thread top, it appears to me Apple M1 chip doesn’t support JAX with GPU 7 yet and probably also not for FedJAX. Currently, there is also an issue with TensorFlow Federated on M1 18.
Can TensorFlow team share some timeline regarding the support of TensorFlow Federated on M1 Max/Pro?
Is there any way to do Federated ML effectively on M1 Max/Pro with GPU cores?  Many thanks in advance.