{"id":415,"date":"2015-05-09T00:00:00","date_gmt":"2015-05-09T00:00:00","guid":{"rendered":"http:\/\/www.scmgalaxy.com\/tutorials\/2015\/05\/09\/qa-roles-and-levels-in-continous-delivery-model\/"},"modified":"2017-12-21T04:17:54","modified_gmt":"2017-12-21T04:17:54","slug":"qa-roles-and-levels-in-continous-delivery-model","status":"publish","type":"post","link":"https:\/\/www.devopsschool.com\/blog\/qa-roles-and-levels-in-continous-delivery-model\/","title":{"rendered":"QA Roles and Levels in Continuous Delivery Model | Software Testing"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-3464 aligncenter\" src=\"http:\/\/www.scmgalaxy.com\/tutorials\/wp-content\/uploads\/2015\/05\/qa-roles-and-levels.png\" alt=\"qa-roles-and-levels\" width=\"600\" height=\"400\" srcset=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2015\/05\/qa-roles-and-levels.png 600w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2015\/05\/qa-roles-and-levels-300x200.png 300w\" sizes=\"auto, (max-width: 600px) 100vw, 600px\" \/><\/p>\n<p><strong>0 \u2013 Manual compilation, no unit tests, manual testing by QA<\/strong><br \/>\nBefore we all recoil in horror it\u2019s worth recalling the pure horror of how things used to be with an enormous gulf between developers and QA. Thankfully this approach is lost in the mist of time for almost everyone but if has not, you have my deepest sympathies.<\/p>\n<p><strong>1 \u2013 Automated compilation, some unit tests by dev, manual testing by QA<\/strong><br \/>\nWe start to see the process become more agile. Build scripts have made their appearance. Life is a bit easier for developers with the introduction of Continuous Integration but not much different to QA who are left out in the cold.<\/p>\n<p><strong>2 \u2013 Automated compilation, high standard unit tests by dev, automation of manual testing by QA<\/strong><br \/>\nBuild frameworks that allow failing a build process that successfully compiled but did not pass the unit tests are now used. QA are using tools which theoretically allow them to sign off individual user stories while still being able to quickly regression test the entire application to ensure that no new errors have been introduced. However, the separation of dev and QA ensures that almost every change by developers results in failing QA tests. The only way to get all the tests to pass is to either stop development or to fork the codebase so that the QA\u2019s can work on stable code. Bugs are fed back into the development code branch and promoted to the QA branch. Congratulations for reinventing waterfall and for ensuring that the ratio between developers and QA remains 1:1.<\/p>\n<p><strong>3 \u2013 Automated compilation, high standard unit tests by dev, integration tests by dev, automated testing by QA using better tools<\/strong><br \/>\nSome of the QA workload is taken over by developers who automate obvious integration points with the rest of the system. Some more load is taken off the QA who can re-use tests with tools like Fitnesse but the phrase \u201cdev complete\u201d is still heard. Developers may provide QA with test utilities and abstractions like Stubs and Fakes to make testing easier and more deterministic. It\u2019s almost inevitable that every team\u2019s story board will have 3 or 4 times as many stories waiting for QA than are either \u201cIn Development\u201d or \u201cUndergoing QA\u201d. You can do Continuous Delivery at this stage but everyone wonders why it\u2019s so painful and costs so much in time and effort.<\/p>\n<h3><strong>What do we really need?<\/strong><\/h3>\n<p>For us to ship reliable quality code, we have to change not just the tooling but how the delivery organisation is structured. When manual testing was the norm, a separate QA organisation existed because it was more efficient and more effective to have non-developers test the code. With the levels of automation now available a separate QA organisation is an anachronism which should no longer exist. So what do we really need?<\/p>\n<p><strong>4 \u2013 Automated compilation, high standard unit tests by dev, integration tests by dev, agile testing by dev, sign-off by QA<\/strong><br \/>\nThe role of the QA has mutated to that of QABA (aka \u2018a bloody good BA\u2019) \u2013 domain experts that represent the business in the delivery team but who are also responsible for creating the acceptance criteria for user stories where the acceptance criteria are expressed as scenarios that can be easily converted into actual test code. Developers write the application code and the code that tests it, including creating any tooling. The QABA can then sign off the story on completion without having to go back to the business. Business still see new features and capabilities at weekly demos and show\u2019n\u2019tells but are rarely involved with the delivery team on a regular basis. If you are B2C, even better is where new code is released into production without being signed off but hidden behind feature throttles that stop the new functionality from being seen outside of the company network. That way the entire company gets to do UAT on new functionality before it hits the customers.<br \/>\nA fundamental pillar of continuous delivery is that all* your tests must be automated. To achieve this the QA organisation should be in the business of writing the test scenarios that the code needs to be evaluated against and for signing off that the code does this. Test code should be a first class citizen of the application and should be written by people who\u2019s primary job is writing code \u2013 the developers. I will say it again \u2013\u00a0<em>QA should not be in the business of writing test code.<\/em><br \/>\nDevelopers are responsible for quality and should act like it. Sometimes that means taking responsibility from the QA organisation that should never should have been given to them. Quality is too important to leave to QA. Developers need to take full responsibility for the quality of their code and they should be in the firing line if something is broken. The role of the QA is to keep the developers on the straight and narrow and the most effective way of doing this is to get them to apply their confrontational mindset to the code via the acceptance criteria used to sign off the new functionality. Those of you familiar with BDD are probably nodding your heads right now but I\u2019m not sure that BDD is the answer. It\u2019s the right approach from the perspective of test case creation but the tooling is currently a zero sum game \u2013 the effort you save by having natural language test descriptions run is equivalent to the amount of effort you have to expend in extending your tooling to support your test cases in all bar the most trivial cases.<br \/>\nIf you take a look at a company that prioritizes the ability to ship code, e.g. Facebook, you will see the developer taking far more responsibility for QA than is seen in the rest of the industry. It\u2019s time for the rest of us to catch up.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>0 \u2013 Manual compilation, no unit tests, manual testing by QA Before we all recoil in horror it\u2019s worth recalling the pure horror of how things used to be with an enormous gulf between developers and QA. Thankfully this approach is lost in the mist of time for almost everyone but if has not, you&#8230;<\/p>\n","protected":false},"author":1,"featured_media":3464,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_kad_post_transparent":"","_kad_post_title":"","_kad_post_layout":"","_kad_post_sidebar_id":"","_kad_post_content_style":"","_kad_post_vertical_padding":"","_kad_post_feature":"","_kad_post_feature_position":"","_kad_post_header":false,"_kad_post_footer":false,"_kad_post_classname":"","_joinchat":[],"footnotes":""},"categories":[2],"tags":[1691,1690,1689,1692,1687,1688,1694,1693,1697,1696,1695,779],"class_list":["post-415","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorised","tag-cd","tag-continuous-delivery","tag-levels","tag-model","tag-qa","tag-qa-roles","tag-qa-teams","tag-quality-management","tag-role-of-testing","tag-software-testing","tag-testers","tag-testing"],"_links":{"self":[{"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/posts\/415","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/comments?post=415"}],"version-history":[{"count":2,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/posts\/415\/revisions"}],"predecessor-version":[{"id":3466,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/posts\/415\/revisions\/3466"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/media\/3464"}],"wp:attachment":[{"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/media?parent=415"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/categories?post=415"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/tags?post=415"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}