The client is a global leader in providing cloud-based iPad point-of-sale (POS) systems.
Challenge
The client needed a QA environment to simulate and test integrations across platforms (web client, mobile application) & devices to cover real-world use cases as well as performance loads. They wanted to utilize testing automation within the QA environment for each user story after deployment to ensure that acceptance tests were completed by the end of each sprint.
Solution
The Orion team followed a behavior-driven development approach of discovery, formulation & automation. In the discovery phase, the team collected technical requirements from the business stakeholders. The formulation phase involved redefining those requirements in terms of a user story containing detailed acceptance criterion. In the automation phase, the team created custom acceptance tests and automated them to support regression testing and continuous delivery.
The team analyzed software and hardware requirements, defining how each component of the solution was designed to respond, then created scenarios of regular actions across all related products and automated them. They automated unit level, component level and feature level tests and integrated all of them in a CI/CD (Continuous Integration / Continuous Deployment) pipeline to be triggered on every change. The team also refactored the code to conform to the acceptance criteria. The system needed to meet non-functional requirements in terms of performance & security so Orion performed quality tests at the system level. The team executed system-level acceptance tests (automated and manual) to ensure and validate that the behavior of the entire system aligned with the functionality requirements.
The tools used included:
- Ranorex
- Apache JMeter
- Postman
- Jenkins
Impact
The automated and agile testing approach deployed by Orion delivered faster time-to-market and ensured bug-free releases. The Orion developed test framework has been confirmed by the client to be far superior to the previously used framework and has since been deployed for subsequent test automation.
