Answers: <p>First, DevOps is a journey, not a destination.  Not every organization approaches similar problems with the same solution; while automation is a component of a DevOps platform, it's not the single defining characteristic.</p>
  
  <p>The role and responsibilities of QA professionals haven't really changed; they're still responsible for validating that code is ready for release.  What HAS changed is the focus on both automation and smaller releases.  Much like operational roles, QA staff should now have the opportunity to focus on adding <a href="http://www.softwaretestinghelp.com/types-of-software-testing/" rel="nofollow noreferrer">additional automatic quality checks</a> into the development life cycle.</p>
  
  <p>In a shop with a mature CI/CD pipeline, QA becomes more about designing great tests, and letting the software do the actual heavy lifting. As <a href="https://devops.stackexchange.com/users/13/tensibai">Tensibai</a> commented above, "some QA tests can't be automated" (yet), so there will still need to be some engineering responsibilities, but the goal should be to utilize automation in every aspect of delivery in order to facilitate adding additional quality.</p>
  
Answers: CC BY-SA 3.0
Answers: 2018-02-27T14:43:42.803Z
Answers: 2018-02-27T14:43:42.803Z
Answers: Stuart Ainsworth
Answers: <p>This is an open-ended question, which is why the following answer is an opinion.</p>
  
  <p>The focus of QA (quality assurance) in the DevOps field is to monitor the deployment metrics to ensure that faults are caught before they can manifest. The most direct metrics of application health include application availability and errors. These can be directly extracted from error logs and automated monitoring of served web pages (that status code 200 or the login form are always returned).</p>
  
  <p>The next level allows you to anticipate errors, bottlenecks and resource usage. This is very deployment specific. In some cases you may have a micro service that receives a high load or in others a single page may make several database queries. Monitoring your servers' CPU load and memory usage can also be used as metrics. These may act as key indicators to your applications' health.</p>
  
  <p>Other aspects delve into feature and device usage which enable you to make informed decisions about depreciating these in order to limit your application's <a href="https://uta.influuent.utsystem.edu/en/publications/the-relationship-between-software-bug-type-and-number-of-factors-" rel="nofollow noreferrer">complexity</a>. Since complexity is directly linked to bugs and development velocity, it makes sense to limit it where possible.</p>
  
  <p>Sources: <a href="https://www.telerik.com/blogs/application-metrics-you-should-monitor-constantly" rel="nofollow noreferrer">Telerik</a> and <a href="https://stackify.com/web-performance-monitoring-guide-developers/" rel="nofollow noreferrer">Stackify</a></p>
  
Answers: CC BY-SA 3.0
Answers: 2018-01-27T16:34:25.400Z
Answers: 2018-01-27T16:34:25.400Z
Answers: Moritz
Answers: <p>The key aspect in a Dev(Sec)Ops-oriented organisation is the inter-field communication and collaboration. From this perspective, the QA role can include activities such as:</p>
  
  <ul>
  <li>continuous improvement of automated QA coverage/effectiveness, reliability, performance (which ideally should target CI/CD, but not always is/can be)</li>
  <li>direct, active/constant involvement with Development:
  
  <ul>
  <li>for TDD-based development</li>
  <li>for reproducing difficult customer-found defects, developing strategies for verifying their fixes and plugging the holes that allowed such bugs to reach the customer</li>
  </ul></li>
  <li>feature, roadmap, resource planning, in which all fields should be involved</li>
  </ul>
  
  <p>For organisations building software delivered for deployment and operation by 3rd party customers (like IT infrastructure equipment or consumer products, for example) the QA role could bring their expertise (ideally alongside Development) in customer-facing interactions (maybe just in an assisting role) to improve the understanding of how the customer is using the product and the challenges they face and bring that feedback into the aspects of the product lifecycle under their influence.</p>
  
  <p>For organisations which also deploy and operate the software being produced the QA role may extend to/blend into the Security/Operations field while closing the loop back towards Development and itself, for example: </p>
  
  <ul>
  <li>ensuring the product quality matches expectations</li>
  <li>managing SLAs</li>
  <li>constantly aiming for reducing deltas between the production environment and the Development/QA one(s), regardless of them being inside of the CI/CD pipeline or not</li>
  </ul>
  
Answers: CC BY-SA 3.0
Answers: 2018-02-27T02:43:44.283Z
Answers: 2018-02-27T02:43:44.283Z
Answers: Dan Cornilescu
Body: <p>One of views on DevOps is to say that it combines fileds of Development, Operations and Quality Assurance.</p>
  
  <p>Now many DevOps roles have focus either </p>
  
  <ul>
  <li>on development with the left shift in terms of operations awareness (up to a No-Ops full stack, <em>you build it - you run it</em> (c) Besos, Amazon's CTO), </li>
  <li>or a sysadmin who is expected to write CaSC (Configurarion as Code), IaC (infrastructure as code) and automation codes to reduce work required in operations.</li>
  </ul>
  
  <p>In both cases you see lots of tools typical for these roles with and without DevOps context.</p>
  
  <p>What does QA DevOps roles do today as a formal commitment? Test automation always has been there, for example. Is QA just meant here to support CI/CD infrastructure and teams working on it, or something else?</p>
  
Comments: CC BY-SA 3.0
Comments: 2018-01-25T08:57:54.443Z
Comments: Some QA tests can't be automatized, checking the overall look of a web application is still ok and usable on different browser size for exemple.
Comments: Tensibai
Comments: CC BY-SA 3.0
Comments: 2018-01-25T09:40:23.917Z
Comments: so manual compatibility tests is the type of QA meant/scoped by DevOps?
Comments: Ta Mu
Comments: CC BY-SA 3.0
Comments: 2018-01-25T09:49:25.070Z
Comments: Not by devops, that's part of what is expected by the people more oriented QA test in a devops team along with advice/help in writing the test scenarios for automated tests and referencing test cases, they are usually coming from the final users more than dev or sysadmin area, but the responsibility can be shared on multiple persons. Devops aim at breaking silos by bringing in the same team (and usually location) people from all necessary fields for the software lifecycle.
Comments: Tensibai
Tags: <culture><methodology><job-role>
Title: Does QA in DevOps roles means CI/CD or more?
UserDisplayName: Ta Mu
ThreadText: # Does QA in DevOps roles means CI/CD or more?
  
  (Asked by: username_0 on 2018-01-25)
  
  One of views on DevOps is to say that it combines fileds of Development, Operations and Quality Assurance.
  
  Now many DevOps roles have focus either
  
  * on development with the left shift in terms of operations awareness (up to a No-Ops full stack, *you build it - you run it* (c) Besos, Amazon's CTO),
  * or a sysadmin who is expected to write CaSC (Configurarion as Code), IaC (infrastructure as code) and automation codes to reduce work required in operations.
  
  In both cases you see lots of tools typical for these roles with and without DevOps context.
  
  What does QA DevOps roles do today as a formal commitment? Test automation always has been there, for example. Is QA just meant here to support CI/CD infrastructure and teams working on it, or something else?
  
  **Tags:** culture, methodology, job-role
  
  > **Comments:**
  > **username_1**: Some QA tests can't be automatized, checking the overall look of a web application is still ok and usable on different browser size for exemple.  
  > **username_0**: so manual compatibility tests is the type of QA meant/scoped by DevOps?  
  > **username_1**: Not by devops, that's part of what is expected by the people more oriented QA test in a devops team along with advice/help in writing the test scenarios for automated tests and referencing test cases, they are usually coming from the final users more than dev or sysadmin area, but the responsibility can be shared on multiple persons. Devops aim at breaking silos by bringing in the same team (and usually location) people from all necessary fields for the software lifecycle.  
  
  ---
  
  ## 3 answers
  
  ### Answer by username_2 on 2018-02-27. Score: 2
  
  First, DevOps is a journey, not a destination. Not every organization approaches similar problems with the same solution; while automation is a component of a DevOps platform, it's not the single defining characteristic.
  
  The role and responsibilities of QA professionals haven't really changed; they're still responsible for validating that code is ready for release. What HAS changed is the focus on both automation and smaller releases. Much like operational roles, QA staff should now have the opportunity to focus on adding [additional automatic quality checks](http://www.softwaretestinghelp.com/types-of-software-testing/) into the development life cycle.
  
  In a shop with a mature CI/CD pipeline, QA becomes more about designing great tests, and letting the software do the actual heavy lifting. As [username_1](https://devops.stackexchange.com/users/13/username_1) commented above, "some QA tests can't be automated" (yet), so there will still need to be some engineering responsibilities, but the goal should be to utilize automation in every aspect of delivery in order to facilitate adding additional quality.
  
  
  ---
  
  ### Answer by username_3 on 2018-01-27. Score: 1
  
  This is an open-ended question, which is why the following answer is an opinion.
  
  The focus of QA (quality assurance) in the DevOps field is to monitor the deployment metrics to ensure that faults are caught before they can manifest. The most direct metrics of application health include application availability and errors. These can be directly extracted from error logs and automated monitoring of served web pages (that status code 200 or the login form are always returned).
  
  The next level allows you to anticipate errors, bottlenecks and resource usage. This is very deployment specific. In some cases you may have a micro service that receives a high load or in others a single page may make several database queries. Monitoring your servers' CPU load and memory usage can also be used as metrics. These may act as key indicators to your applications' health.
  
  Other aspects delve into feature and device usage which enable you to make informed decisions about depreciating these in order to limit your application's [complexity](https://uta.influuent.utsystem.edu/en/publications/the-relationship-between-software-bug-type-and-number-of-factors-). Since complexity is directly linked to bugs and development velocity, it makes sense to limit it where possible.
  
  Sources: [Telerik](https://www.telerik.com/blogs/application-metrics-you-should-monitor-constantly) and [Stackify](https://stackify.com/web-performance-monitoring-guide-developers/)
  
  
  ---
  
  ### Answer by username_4 on 2018-02-27. Score: 1
  
  The key aspect in a Dev(Sec)Ops-oriented organisation is the inter-field communication and collaboration. From this perspective, the QA role can include activities such as:
  
  * continuous improvement of automated QA coverage/effectiveness, reliability, performance (which ideally should target CI/CD, but not always is/can be)
  * direct, active/constant involvement with Development:
    + for TDD-based development
    + for reproducing difficult customer-found defects, developing strategies for verifying their fixes and plugging the holes that allowed such bugs to reach the customer
  * feature, roadmap, resource planning, in which all fields should be involved
  
  For organisations building software delivered for deployment and operation by 3rd party customers (like IT infrastructure equipment or consumer products, for example) the QA role could bring their expertise (ideally alongside Development) in customer-facing interactions (maybe just in an assisting role) to improve the understanding of how the customer is using the product and the challenges they face and bring that feedback into the aspects of the product lifecycle under their influence.
  
  For organisations which also deploy and operate the software being produced the QA role may extend to/blend into the Security/Operations field while closing the loop back towards Development and itself, for example:
  
  * ensuring the product quality matches expectations
  * managing SLAs
  * constantly aiming for reducing deltas between the production environment and the Development/QA one(s), regardless of them being inside of the CI/CD pipeline or not
  
  
  ---
  
  