Engineering.
when writing controllers as well. If possible, build a framework for authoring controllers that export all the standard metrics automatically. Logs Logs from most Kubernetes components such as kube-controller-manager, kubelet are useful. Reading and understanding logs of software you did not author