Answers: <p>Yes. And there are tools out there covering this piece of functionality. </p>
  
  <p>Probably the most popular one is <a href="https://kubernetes.io/" rel="nofollow noreferrer">kubernetes</a> (see also <a href="/questions/tagged/kubernetes" class="post-tag" title="show questions tagged &#39;kubernetes&#39;" rel="tag">kubernetes</a>):</p>
  
  <blockquote>
    <p><a href="https://kubernetes.io/docs/concepts/overview/what-is-kubernetes/" rel="nofollow noreferrer">Kubernetes (k8s)</a> is an open-source system for automating
    deployment, scaling, and management of containerized applications.</p>
  </blockquote>
  
  <p>Depending on the provider for your deployment environment the actual orchestration tool/service may be already included and all you'd provide would be your desired scalability configuration. For example when deploying on the Google App Engine Flexible environment the <a href="https://cloud.google.com/appengine/docs/flexible/python/reference/app-yaml#services" rel="nofollow noreferrer">service scaling settings</a> could look like this:</p>
  
  <blockquote>
  <pre><code>automatic_scaling:
    min_num_instances: 1
    max_num_instances: 15
    cool_down_period_sec: 180
    cpu_utilization:
      target_utilization: 0.6
  </code></pre>
  </blockquote>
  
Answers: CC BY-SA 4.0
Answers: 2019-02-16T15:24:04.267Z
Answers: 2019-02-16T15:24:04.267Z
Answers: Dan Cornilescu
Body: <p>I have a stateless web service running in a Docker container. The web service is single threaded.</p>
  
  <p>We would like to span new instances of the service when the load reaches a given threshold. Is that a job for an orchestration tool?</p>
  
Tags: <docker><culture><autoscaling>
Title: Do I need an orchestration tool to autoscale/scale on demand my web service?
UserDisplayName: Sylvain Leroux
ThreadText: # Do I need an orchestration tool to autoscale/scale on demand my web service?
  
  (Asked by: username_0 on 2019-02-16)
  
  I have a stateless web service running in a Docker container. The web service is single threaded.
  
  We would like to span new instances of the service when the load reaches a given threshold. Is that a job for an orchestration tool?
  
  **Tags:** docker, culture, autoscaling
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2019-02-16. Score: 1 | Accepted answer
  
  Yes. And there are tools out there covering this piece of functionality.
  
  Probably the most popular one is [kubernetes](https://kubernetes.io/) (see also [kubernetes](/questions/tagged/kubernetes "show questions tagged 'kubernetes'")):
  
  > [Kubernetes (k8s)](https://kubernetes.io/docs/concepts/overview/what-is-kubernetes/) is an open-source system for automating
  > deployment, scaling, and management of containerized applications.
  
  Depending on the provider for your deployment environment the actual orchestration tool/service may be already included and all you'd provide would be your desired scalability configuration. For example when deploying on the Google App Engine Flexible environment the [service scaling settings](https://cloud.google.com/appengine/docs/flexible/python/reference/app-yaml#services) could look like this:
  
  > ```
  > automatic_scaling:
  >   min_num_instances: 1
  >   max_num_instances: 15
  >   cool_down_period_sec: 180
  >   cpu_utilization:
  >     target_utilization: 0.6
  >
  > ```
  
  
  ---
  
  