Answers: <p>I think what you are looking for is an Open Source project that can take inputs from both <a href="https://aws.amazon.com/cloudwatch/" rel="noreferrer">Amazon CloudWatch</a> and <a href="https://cloud.google.com/stackdriver/" rel="noreferrer">Google StackDriver</a>; there isn't a huge amount out there at the moment, but I will detail what I know.</p>
  
  <p>I have made the assumption that you know how to import your application telemetry into the solutions below.</p>
  
  <h2>Open Source</h2>
  
  <p>Open source solutions to this problem have been lagging behind as late due to favourable prices of SaaS and built-in solutions.  The products below are constantly evolving so if they don't do what you need now they may be in the future.</p>
  
  <ul>
  <li><a href="https://www.elastic.co/products" rel="noreferrer"><strong>Elastic Stack</strong></a>, formerly known as the ELK stack is made up of three individual products from Elastic.co: ElasticSearch, LogStash and Kibana.  It is possible to ingest data from CloudWatch <a href="https://github.com/logstash-plugins/logstash-input-cloudwatch" rel="noreferrer">with a plugin</a> and to export StackDriver data <a href="https://cloud.google.com/logging/docs/export/using_exported_logs" rel="noreferrer">to Google Pub/Sub</a> and then <a href="https://github.com/Wondermall/logstash-input-google-cloud-pubsub" rel="noreferrer">ingest into LogStash</a>.</li>
  <li><a href="https://grafana.com/" rel="noreferrer"><strong>Grafana</strong></a>, is slightly better than Kibana at displaying time-series data. However, dosn't have as robust an ecosystem around it.  Grafana has built in support for <a href="http://docs.grafana.org/features/datasources/cloudwatch/" rel="noreferrer">Amazon CloudWatch</a>, Google StackDriver is <a href="https://github.com/grafana/grafana/issues/6733" rel="noreferrer">not supported</a> as yet. However, someone is working on it in the form of a plugin.</li>
  </ul>
  
  <h2>Software as a Service (SaaS)</h2>
  
  <p>Software as a Service monitoring solutions is a multi-billion dollar market, as large enterprises will readily pay for a SaaS or off-the-shelf solution to their dashboarding challenge.</p>
  
  <ul>
  <li><a href="https://newrelic.com/" rel="noreferrer"><strong>New Relic</strong></a>, a very mature product with extensive cloud support, including <a href="https://newrelic.com/plugins/new-relic-platform-team/58" rel="noreferrer">ingesting of CloudWatch metrics</a> and <a href="https://newrelic.com/plugins/jstech/220" rel="noreferrer">Google Cloud Storage Metrics</a>.</li>
  <li><a href="https://www.splunk.com/" rel="noreferrer"><strong>Splunk</strong></a>, a bit more focused on logs than metrics, however, has good support for <a href="https://www.splunk.com/blog/2017/02/03/how-to-easily-stream-aws-cloudwatch-logs-to-splunk.html" rel="noreferrer">AWS CloudWatch</a> and <a href="https://splunkbase.splunk.com/app/3088/" rel="noreferrer">Google Cloud Platform</a>.</li>
  <li><a href="https://cloud.google.com/stackdriver/" rel="noreferrer"><strong>Google Stackdriver</strong></a>, obviously has good support for Google Cloud Platform, also it is capable of <a href="https://aws.amazon.com/solutions/case-studies/stackdriver/" rel="noreferrer">reading performance metrics</a> in from AWS.</li>
  <li><a href="https://www.datadoghq.com/" rel="noreferrer"><strong>DataDog</strong></a> is my personal favourite, it has a <a href="https://www.datadoghq.com/product/integrations/" rel="noreferrer">vast range of integrations</a> including support for <a href="http://docs.datadoghq.com/integrations/aws/" rel="noreferrer">Amazon Web Services</a> and <a href="http://docs.datadoghq.com/integrations/gcp/" rel="noreferrer">Google Cloud Platform</a>. </li>
  </ul>
  
  <h2>Single Pane of Glass</h2>
  
  <p>In the last three years, various products have gone to market providing a <a href="https://www.opsview.com/resources/blog/three-keys-monitoring-it-single-pane-glass" rel="noreferrer">"Single Pane of Glass"</a>.  The advantages of these products are:</p>
  
  <ul>
  <li><strong>Heterogeneous Platforms</strong> - you can use many different monitoring tools and products and then unify them with a Single Pane of Glass.</li>
  <li><strong>Data Normalization</strong> - most monitoring tools have idiosyncrasies in the way they present data a Single Pane of Glass helps to normalise these so that metrics from Google, Amazon and your App make sense when displayed in the same graph.</li>
  <li><strong>Business View</strong> - a Single Pane of Glass usually has the capability to integrate with non-technical data sources.  As an example displaying data from financial tools to show a measure of business success.  This view makes for some compelling C-Level dashboards that demonstrate how technology is providing value to the firm.</li>
  </ul>
  
Answers: CC BY-SA 3.0
Answers: 2017-04-17T21:21:23.700Z
Answers: May worth looking at Prometheus, I'm far unsure it can fit somewhere in your post or fit the answer, but I didn't see it and I found it promising on AWS
Answers: Tensibai
Answers: CC BY-SA 3.0
Answers: 2017-04-17T21:22:57.850Z
Answers: Aww, and timelion in kibana/elasticsearch5 start to be competing with Grafana in term of timeseries representation
Answers: Tensibai
Answers: CC BY-SA 3.0
Answers: 2017-04-17T11:15:51.337Z
Answers: 2017-04-17T11:15:51.337Z
Answers: Richard Slater
Body: <p>I'm looking for a single product or service which can be used as a centralized dashboard to monitor cloud infrastructure provide by Amazon Web Services and Google Cloud Platform in addition to the application.</p>
  
  <p>I'm looking at few options like sensu which support all of the <a href="https://github.com/sensu-plugins/sensu-plugins-aws" rel="nofollow noreferrer">services in Amazon Web Services</a>, but I didn't find any plugins to monitor Google Cloud Platform.</p>
  
  <p>Are there any other services or products that allow me to create this, my preference is Open Source?</p>
  
  <p>Note: Everyone has access to GCP and AWS and if anyone launches something it will be easy to have one dashboard for monitoring.</p>
  
Comments: CC BY-SA 3.0
Comments: 2017-04-17T10:28:25.863Z
Comments: I've tidied up the post a little, please do read over and edit/revert if you are not happy.
Comments: Richard Slater
Comments: CC BY-SA 3.0
Comments: 2017-04-17T10:46:12.080Z
Comments: Just wondering, why do you want a centralized dashboard?  What's stopping you from have 2 : `Cloudwatch` + a similar service of GCE ?  [Just being curious :) ]
Comments: Dawny33
Comments: CC BY-SA 3.0
Comments: 2017-04-17T11:04:12.243Z
Comments: @Dawny33 Everyone has access to GCP and AWS and if anyone launches something it will be easy to have one dashboard for monitoring
Comments: ck reddy
Tags: <amazon-web-services><monitoring><google-cloud-platform>
Title: How to create a centralised dashboard to monitor multiple cloud (Amazon and Google)?
UserDisplayName: ck reddy
ThreadText: # How to create a centralised dashboard to monitor multiple cloud (Amazon and Google)?
  
  (Asked by: username_0 on 2017-04-17)
  
  I'm looking for a single product or service which can be used as a centralized dashboard to monitor cloud infrastructure provide by Amazon Web Services and Google Cloud Platform in addition to the application.
  
  I'm looking at few options like sensu which support all of the [services in Amazon Web Services](https://github.com/sensu-plugins/sensu-plugins-aws), but I didn't find any plugins to monitor Google Cloud Platform.
  
  Are there any other services or products that allow me to create this, my preference is Open Source?
  
  Note: Everyone has access to GCP and AWS and if anyone launches something it will be easy to have one dashboard for monitoring.
  
  **Tags:** amazon-web-services, monitoring, google-cloud-platform
  
  > **Comments:**
  > **username_1**: I've tidied up the post a little, please do read over and edit/revert if you are not happy.  
  > **username_2**: Just wondering, why do you want a centralized dashboard?  What's stopping you from have 2 : `Cloudwatch` + a similar service of GCE ?  [Just being curious :) ]  
  > **username_0**: @username_2 Everyone has access to GCP and AWS and if anyone launches something it will be easy to have one dashboard for monitoring  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2017-04-17. Score: 14 | Accepted answer
  
  I think what you are looking for is an Open Source project that can take inputs from both [Amazon CloudWatch](https://aws.amazon.com/cloudwatch/) and [Google StackDriver](https://cloud.google.com/stackdriver/); there isn't a huge amount out there at the moment, but I will detail what I know.
  
  I have made the assumption that you know how to import your application telemetry into the solutions below.
  
  ## Open Source
  
  Open source solutions to this problem have been lagging behind as late due to favourable prices of SaaS and built-in solutions. The products below are constantly evolving so if they don't do what you need now they may be in the future.
  
  * [**Elastic Stack**](https://www.elastic.co/products), formerly known as the ELK stack is made up of three individual products from Elastic.co: ElasticSearch, LogStash and Kibana. It is possible to ingest data from CloudWatch [with a plugin](https://github.com/logstash-plugins/logstash-input-cloudwatch) and to export StackDriver data [to Google Pub/Sub](https://cloud.google.com/logging/docs/export/using_exported_logs) and then [ingest into LogStash](https://github.com/Wondermall/logstash-input-google-cloud-pubsub).
  * [**Grafana**](https://grafana.com/), is slightly better than Kibana at displaying time-series data. However, dosn't have as robust an ecosystem around it. Grafana has built in support for [Amazon CloudWatch](http://docs.grafana.org/features/datasources/cloudwatch/), Google StackDriver is [not supported](https://github.com/grafana/grafana/issues/6733) as yet. However, someone is working on it in the form of a plugin.
  
  ## Software as a Service (SaaS)
  
  Software as a Service monitoring solutions is a multi-billion dollar market, as large enterprises will readily pay for a SaaS or off-the-shelf solution to their dashboarding challenge.
  
  * [**New Relic**](https://newrelic.com/), a very mature product with extensive cloud support, including [ingesting of CloudWatch metrics](https://newrelic.com/plugins/new-relic-platform-team/58) and [Google Cloud Storage Metrics](https://newrelic.com/plugins/jstech/220).
  * [**Splunk**](https://www.splunk.com/), a bit more focused on logs than metrics, however, has good support for [AWS CloudWatch](https://www.splunk.com/blog/2017/02/03/how-to-easily-stream-aws-cloudwatch-logs-to-splunk.html) and [Google Cloud Platform](https://splunkbase.splunk.com/app/3088/).
  * [**Google Stackdriver**](https://cloud.google.com/stackdriver/), obviously has good support for Google Cloud Platform, also it is capable of [reading performance metrics](https://aws.amazon.com/solutions/case-studies/stackdriver/) in from AWS.
  * [**DataDog**](https://www.datadoghq.com/) is my personal favourite, it has a [vast range of integrations](https://www.datadoghq.com/product/integrations/) including support for [Amazon Web Services](http://docs.datadoghq.com/integrations/aws/) and [Google Cloud Platform](http://docs.datadoghq.com/integrations/gcp/).
  
  ## Single Pane of Glass
  
  In the last three years, various products have gone to market providing a ["Single Pane of Glass"](https://www.opsview.com/resources/blog/three-keys-monitoring-it-single-pane-glass). The advantages of these products are:
  
  * **Heterogeneous Platforms** - you can use many different monitoring tools and products and then unify them with a Single Pane of Glass.
  * **Data Normalization** - most monitoring tools have idiosyncrasies in the way they present data a Single Pane of Glass helps to normalise these so that metrics from Google, Amazon and your App make sense when displayed in the same graph.
  * **Business View** - a Single Pane of Glass usually has the capability to integrate with non-technical data sources. As an example displaying data from financial tools to show a measure of business success. This view makes for some compelling C-Level dashboards that demonstrate how technology is providing value to the firm.
  
  > **Comments:**
  > **username_3**: May worth looking at Prometheus, I'm far unsure it can fit somewhere in your post or fit the answer, but I didn't see it and I found it promising on AWS  
  > **username_3**: Aww, and timelion in kibana/elasticsearch5 start to be competing with Grafana in term of timeseries representation  
  
  ---
  
  