We've made a huge enhancement on the Tuleap Test Management module. Up to now, Tuleap Test Management supported manual testing only. But from now, it provides even better visibility to handle and control your quality assurance process. With one single module, you can control manual and automated test results at the same place.
Let's come back on the different types of software testing to better understand why they are valuable and complementary. Then you will discover the update of Tuleap Test Management.
Different types of software testing
As a good starting point, first a quick reminder. As you should know, there are different types of testing you can use to make sure that enhancements of your code are working as expected.
Unit tests are very low level, close to the code source. They consist in testing individual methods and functions of the classes, components or modules used by your software. Unit tests are most of time run very quickly by a continuous integration server. In general they are quite cheap because automated.
Integration tests check that different modules used by your application work well together. These types of tests are more expensive to run as they require multiple parts of the application to be up and running.
End-to-end testing replicates a user behavior with the software in a complete application environment. It verifies that various user flows work as expected. End-to-end tests are very useful, but they can be really expensive to perform. That's why it is important to make them more productive.
Exploratory testing is a mix of designing, executing and result interpreting of tests, and learning. This is not made of checklists and error guessing. Exploratory tests is aim at investigating an application with a determination of test cases during the testing phase. This is spontaneous ; test cases are not written well in advance. It is about test design improvement and enable to highlight bugs which are normally uncovered by other testing approaches.
Tuleap Test Management units manual and automated testing
As you should have noticed, there is a distinction between manual and automated tests.
Manual testing is performed by one person, by clicking through the application or interacting with the software and APIs. It allows human observation useful to improve customer experience and guarantee user-friendliness experience. Manual testing is mainly focused on users' workflow. But this can be expensive if not well managed as it requires people to set up an environment and execute the tests themselves.
On the other hand, automated test are done by a machine that executes test scripts that have been written before. Automated testing fasters tests cycles. It is a key component of continuous development and can really improve deliveries quality. But require manual test cases to be written first the automation. And it's true that high level tests are hard to automate. For example, GUI testing is difficult to efficiently perform automatically. In addition, maintening these types of tests is expensive. This is why there's still value in doing some manual testing.
As you should have conclude: both manual and automated tests are required, as complementary. Here is the new Tuleap Test Management to help you manage all your tests.
The schema above shows which tests can be managed with Tuleap Test Management. Providing a big overview on testing Tuleap Test Management effectively combine automated and manual test results. It helps you optimize your QA efforts and obtain the highest quality releases in the shortest amount of time.
Test Management integrated in the whole Software Development Lifecycle
As a complete Application Lifecycle Management (ALM) tool, Tuleap Test Management is tightly integrated to other Tuleap modules such as Requirements and Agile Dashboard -Scrum and Kanban- and Issue Tracker. This ensure full traceability of all the projects' life.
Track Selenium, Cucumber, Robot FW results into Tuleap Test Management
Tuleap relies on existing framework and test automation tools instead of re-inventing the wheel. It assumes you already have some automated tests somewhere and you can run those tests, for example, in Jenkins. Tuleap Test Management will then offer convenient way to associate a Jenkins build with a test campaign, trigger the build, gather and consolidate the results. So, it consolidate automated test results inside a test campaign, alongside the manual tests. This way you can have a mixed campaign overview.
In this new update, Tuleap Test Management is primarily integrated with Jenkins. It requires to have a test output “junit like” but this can be easily extended in the future if different runners or test output format are required.
Tests link to Requirements
Right out of the box, Tuleap Test Management is integrated seamlessly with the Agile Dashboard. You can think and link manual test and automated tests from requirements and related tasks.
All test results in one dashboard
With the new Tuleap Test Management module, you get the ability to combine both manual and automated test reports. This deliver instant reports that would normally takes hours to compile.
Specify Jenkins job in your test campaign
How to get Tuleap Test Management module
This updated plugin is available under Tuleap Enterprise Edition or myTuleap subscriptions