What sort of cluster management system do you have? Such integrations usually rely on the kind of cluster management systems you use. For example there is a pytoch kubernetes operator: GitHub - kubeflow/pytorch-operator: PyTorch on Kubernetes 7