SENSOR INTELLIGENCE COMPANY REALIZES A REDUCTION IN MANUAL TESTING OVERHEAD BY 200% WHILE INCREASING PERFORMANCE COVERAGE

CASE STUDY

Industry – Automation Machinery Manufacturing

Location – Minneapolis, USA

Services Offered – Test Automation, Performance Testing

TEST AUTOMATION & PERFORMANCE OPTIMIZATION CASE STUDY

Using Zuci’s test automation service, the world’s leading sensor intelligence company reduced manual testing overheard by 200%, upsized the scope of their automation efforts, and optimized the application’s performance.

TEST AUTOMATION & PERFORMANCE OPTIMIZATION CASE STUDY

Using Zuci’s test automation service, the world’s leading sensor intelligence company reduced manual testing overheard by 200%, upsized the scope of their automation efforts, and optimized the application’s performance.

Our client is one of the world’s leading solutions providers for sensor-based applications in the industrial sector. From factory automation to logistics and process automation, their solutions create the basis for securely and efficiently controlling processes, protecting individuals from accidents, and preventing environmental damage.

ABOUT CUSTOMER

Our client is one of the world’s leading solutions providers for sensor-based applications in the industrial sector. From factory automation to logistics and process automation, their solutions create the basis for securely and efficiently controlling processes, protecting individuals from accidents, and preventing environmental damage.

PROBLEM STATEMENT

The customer’s IT delivery team identified an urgent need to improve their regression automation efficiency since they entirely relied on time consuming tests that required frequent manual intervention.

Their current testing practices did not offer them the desired automation coverage they aimed for and optimize their system for crash-proof performance. Their installer application was complex and unusual given the integration of hardware and software elements, where tools like Selenium cannot be used.

The client was looking for automated testing experts who could help them with testing their installer applications and bail them out of this complexity.

Therefore, when evaluating quality assurance service providers, the client’s head of testing opted for Zuci as the primary and only partner in delivering quality assurance functions, based on our core principle: “Seivana Thirundhach sei” (Whatever you do, do it with perfection)

BUSINESS GOALS

Help with tools for test automation

Ramp up automation for the following:

Windows full installation
Windows uninstall
Windows custom installation
Linux full installation
Linux custom installation

Achieve 90% in-sprint automation coverage

BUSINESS GOALS

Help with tools for test automation

Ramp up automation for the following:

Windows full installation
Windows uninstall
Windows custom installation
Linux full installation
Linux custom installation

Achieve 90% in-sprint automation coverage

Verify data accuracy & optimize the performance of the web
application

Push SVP XMLs over TCP with all required dynamic
data/unique data

Push images using FTP and have image names sent
in SVP XMLs

Have configurable tests with setup & tear-down methods

BUSINESS GOALS

Verify data accuracy & optimize the performance of the web
application

Push SVP XMLs over TCP with all required dynamic
data/unique data

Push images using FTP and have image names sent
in SVP XMLs

Have configurable tests with setup & tear-down methods

HOW ZUCI HELPED

As soon as the knowledge transfer and precise analysis were completed, the dedicated team of QA engineers integrated into the client’s infrastructure and processes smoothly.

Zuci team looked at the status quo and proposed testing and test automation improvements. Our team started implementing the improvements and identified measurable metrics.

Reviews were done weekly on overall engineering aspects, including code reviews and how the test process improvements were helping them.

HOW ZUCI HELPED

As soon as the knowledge transfer and precise analysis were completed, the dedicated team of QA engineers integrated into the client’s infrastructure and processes smoothly.

Zuci team looked at the status quo and proposed testing and test automation improvements. Our team started implementing the improvements and identified measurable metrics.

Reviews were done weekly on overall engineering aspects, including code reviews and how the test process improvements were helping them.

To have a transparent process and comprehensive understanding of automated tests, Zuci agreed on a set of KPIs and weekly in-depth reports outlining the time required for detailing code review and automation.

Explored different automation tools and libraries, and ran a feasibility study

As the desktop installer app was making it impossible to automate the test scenarios, our QA team tested a series of technologies and cracked a way to automate the app more efficiently and in multiple environments like Windows, Linux and Mac.

Based on the research, Zuci team advised to go with Sikuli + Java for Windows & Linux installer application

TEST AUTOMATION

Explored different automation tools and libraries, and ran a feasibility study

Based on the research, Zuci team advised to go with Sikuli + Java for Windows & Linux installer application

TEST AUTOMATION

Completed the test automation script using

Java
Cucumber
Sikuli
Selenium

Initiated a range of process improvements to improve the client’s
QA efficiency

Invested efforts to restructure the existing framework and make it reusable to reduce time to develop a new feature or rework the existing one.

Automation engineers upgraded the client’s test automation framework by adding new verification to the already existing feature, therefore, improving the quality of automation.

TEST AUTOMATION

Completed the test automation script using

Java
Cucumber
Sikuli
Selenium

Initiated a range of process improvements to improve the client’s
QA efficiency

Invested efforts to restructure the existing framework and make it reusable to reduce time to develop a new feature or rework the existing one.

Automation engineers upgraded the client’s test automation framework by adding new verification to the already existing feature, therefore, improving the quality of automation.

The engineers prepared user journeys emulating realistic load, which became the baseline for: Load testing & Functional test automation scripts

Explored options to clear/create system, devices, conditions, etc., through API by both JSON upload & multiple API calls.

Tested sending SVP XML data through TCP sampler, HTTP RAW sampler & JSR223 sampler and finalized on TCP sampler.

PERFORMANCE TESTING

The engineers prepared user journeys emulating realistic load, which became the baseline for: Load testing & Functional test automation scripts

Explored options to clear/create system, devices, conditions, etc., through API by both JSON upload & multiple API calls.

Tested sending SVP XML data through TCP sampler, HTTP RAW sampler & JSR223 sampler and finalized on TCP sampler.

PERFORMANCE TESTING

Created modular script for pre-conditions flows such as

Clear-Create-Systems – to clear and set up systems
Send Data – to send SVP XML data over TCP & Image over FTP
Get Count from the database and verify – to verify sent against actual in database.

Configured performance metric collector to capture server metrics

PERFORMANCE TESTING

Created modular script for pre-conditions flows such as

Clear-Create-Systems – to clear and set up systems
Send Data – to send SVP XML data over TCP & Image over FTP
Get Count from the database and verify – to verify sent against actual in database.

Configured performance metric collector to capture server metrics