SAP SE
Flaky test systems and methods

Abstract:

In one embodiment, the present disclosure pertains to testing. In one embodiment, software tests are performed on a first software server. Tests may be repeated a plurality of times to check for consistent failures or passes. Test results are sent to a second software server. The test results are stored in one or more databases on the second software server, where particular test results are associated with one or more fields specifying whether the test was passed and whether the test was failed. Tests that were both passed and failed may be deemed "flaky" tests. The second software server may generate a query to retrieve test results from the database that both passed and failed at least one test (flaky tests). Flaky tests may be quickly retrieved and processed.