Data, Data Engineer, Open Source, Spark, Kubernetes.
allocation. This happens due to either fast downscaling or external killing on pod while it was still coming up. So the driver thinks there is an exec but that never came up and hence did not signal about it being removed. One way to fix this is to adjust the downscaling rate while using DRA. Error