Reflection on Learning launch

Asia Ibrahim, 19.04.2021

Challenge:

As a test consultant in a multinational : leader in electronic payment systems, among my main  objectives is to ensure the quality of the delivered product, a good product  is tested by the  customer himself in a pre-production environment and its efficient by the end and respects the  customer’s requirements shared at the beginning of Software development process, we sent to  the customer a detailed and ordered  mail for the operational features to test them in pre- production with a lot steps to execute by order, to ensure by himself the quality of the product  , we noticed by the end that the access to our mails was limited also, the customers didn’t  execute all steps  especially the mandatory ones and they executed the steps arbitrarily so they  founds many of bugs, which directly impacts their satisfaction with the product

Selection:

As a team we came up with many possibilities to start tackling this issue, but we are uncertain  about it ,we are launching out there into the unknown ,until we decide to adopt the learning  launch tool , it was a great idea to save money and time , it allows us to test very quickly  whether  if we are in the right track or not, and before decisions with big financial impact are  done , This tool will help us go through an iterating process that will may improve on our  solution or pivot completely our thinking

Application:

During our first meeting with customers we analyze users stories, and requirements for  validity and feasibility, after that we prepare test scenarios using a test management system to   manage, plan, run, and report test, each tester for us has his own account in order to access to  write test cases, run them  and report the final result (success or fail),our hypothesis was that  the text in the mail was too long and people didn’t make effort of reading it through, based on  this assumption we decided to create a step plan for customers like the test plan we use on our  test management system, our first lunch its was sending a step plan by mail to our customers  to follow the steps and execute the tests, we were hoping to see a lot of people clicking  through to the step plan but the click was very low ;

Our second launch was to create for each customer his account  to access to our test  management system, and send the link by mail, once the customer clicks on the link he has  access to the test plan, because our assumption was that customers considered this mails as  spam, the link is automatically sent to the customer once his account has been created , the  result was satisfactory , customers were visiting the test plan, execute the steps because our  tool offers a great IHM and they import /export test results, , generate a test report, see the test  coverage

Once the customer finds a bug, he writes us an email to report the problem but without a  detailed description of the issue, so we decide to create for each customer an account on our  bug tracking system to make them reporting the issue and link the test case to the ticket  containing the bug description, we received automatically a notification about the all process

The final result was great, the customer executes the test plan, report the issue once found and  see the test coverage, their feedback was great and that help us to improve software quality.

Insight:

By applying the learning tool, we designed and tested our solutions. Through the learning  process we got to improve our process and communication with customers, it is through this  process we realized that the customers were more comfortable with the step plan in a whole a  sophisticated tool, implemented this process helped us save time and deliver sprints faster

Approach:

The learning launch is the appropriate tool for our business. We need as a team to review the  insight gained from our first two launches and incorporate this insight into future launch  designs as this is the most effective and ideal way of approaching and implementing solutions,  this process has been adopted by the company and applied to all of the projects

