title: Prometheus storage on Kubernetes
body: <p>Kubernetes Version: 1.10</p>
  
  <p>We are running Prometheus on a Kubernetes cluster(running on Bare metal). Kubernetes is running with only one POD. </p>
  
  <p>ISSUE - Prometheus metrics are not persisted if it's POD restarts. We also tried to configure <strong>persistence volume</strong> as <strong>local</strong>. Now if that pod is rescheduled to any other Node of the cluster then It loses all previous data which was persisted on the previous node. We also tried to configure Prometheus remote storage to read and write but It didn't work because it was quite slow. Is there any other option to persist data on Kubernetes on Bare metal?</p>