Answers: <p>Test Kitchen? Your requirements are huge and vague but it's probably your best bet.</p>
  
Answers: CC BY-SA 3.0
Answers: 2017-06-08T14:12:39.947Z
Answers: Sorry for being vague. The product we want to test has components that span many platforms both physical and virtual and so we are searching for a framework that we can use to manage testing across those platforms.
Answers: X_Trust
Answers: CC BY-SA 3.0
Answers: 2017-06-08T15:16:08.110Z
Answers: When you get to something that complex, the chances of finding something perfect off-the-shelf drops asymptotically to zero.
Answers: coderanger
Answers: CC BY-SA 3.0
Answers: 2017-06-08T15:50:54.043Z
Answers: I can't imagine we're the only ones who are having this issue so I figure it was worth asking. Thank you for your feedback!
Answers: X_Trust
Answers: CC BY-SA 3.0
Answers: 2017-06-08T17:19:24.613Z
Answers: The problem is "this issue" in the general case is very different from your specific mix of tools and environments.
Answers: coderanger
Answers: CC BY-SA 3.0
Answers: 2017-06-07T20:04:27.433Z
Answers: 2017-06-07T20:04:27.433Z
Answers: coderanger
Answers: <p>So you are looking for a software which is resource agnostic</p>
  
  <ul>
  <li>provision any resource type </li>
  <li>configure any resource type </li>
  <li>execute on any resource</li>
  </ul>
  
  <p>I am biased but you can look at some <a href="https://en.wikipedia.org/wiki/List_of_job_scheduler_software" rel="nofollow noreferrer">job schedulers</a>. We are currently using ProActive from Activeeon which should answer your needs but other may have similar behaviors.</p>
  
Answers: CC BY-SA 3.0
Answers: 2017-06-19T20:29:39.997Z
Answers: 2017-06-19T20:29:39.997Z
Answers: XYZ123
Body: <p>I'm searching for a framework for running system tests. The requirement are:</p>
  
  <ul>
  <li>Able to manage provisioning to multiple physical machine</li>
  <li>Able to manage provisioning to multiple virtual environments (AWS, Azure, etc)</li>
  <li>Able to run tests on a given machine be it physical or virtual.</li>
  <li>Not bound to a single language or platform. We wish to at least test against Linux, Windows at least.</li>
  </ul>
  
  <p>Is there anything that meets those requirements?</p>
  
  <p>Thank you!</p>
  
Tags: <testing><systems><control-framework>
Title: System test frameworks for scale testing on physical and virtual systems
UserDisplayName: X_Trust
ThreadText: # System test frameworks for scale testing on physical and virtual systems
  
  (Asked by: username_0 on 2017-06-06)
  
  I'm searching for a framework for running system tests. The requirement are:
  
  * Able to manage provisioning to multiple physical machine
  * Able to manage provisioning to multiple virtual environments (AWS, Azure, etc)
  * Able to run tests on a given machine be it physical or virtual.
  * Not bound to a single language or platform. We wish to at least test against Linux, Windows at least.
  
  Is there anything that meets those requirements?
  
  Thank you!
  
  **Tags:** testing, systems, control-framework
  
  
  ---
  
  ## 2 answers
  
  ### Answer by username_1 on 2017-06-07. Score: 1
  
  Test Kitchen? Your requirements are huge and vague but it's probably your best bet.
  
  > **Comments:**
  > **username_0**: Sorry for being vague. The product we want to test has components that span many platforms both physical and virtual and so we are searching for a framework that we can use to manage testing across those platforms.  
  > **username_1**: When you get to something that complex, the chances of finding something perfect off-the-shelf drops asymptotically to zero.  
  > **username_0**: I can't imagine we're the only ones who are having this issue so I figure it was worth asking. Thank you for your feedback!  
  > **username_1**: The problem is "this issue" in the general case is very different from your specific mix of tools and environments.  
  
  ---
  
  ### Answer by username_2 on 2017-06-19. Score: 0
  
  So you are looking for a software which is resource agnostic
  
  * provision any resource type
  * configure any resource type
  * execute on any resource
  
  I am biased but you can look at some [job schedulers](https://en.wikipedia.org/wiki/List_of_job_scheduler_software). We are currently using ProActive from Activeeon which should answer your needs but other may have similar behaviors.
  
  
  ---
  
  