Machine Learning-Based Prediction of Software Test Failures Using Code and Execution Metrics
DOI:
https://doi.org/10.66838/sauc.6496Keywords:
test failure prediction, machine learning, execution metrics, code metrics, test prioritization, continuous integration, software testing.Abstract
Test suites in large software projects grow to thousands of cases, and running them all on every change is slow and costly, motivating predictive approaches that anticipate which tests are likely to fail. This study develops a machine-learning approach to predict software test failures using a combination of static code metrics and dynamic execution metrics, enabling smarter test selection and prioritization. We assembled a dataset linking code characteristics, historical execution outcomes, and change information to test-case results, and trained classifiers to predict failure for each test on a given build. The approach was benchmarked against baseline strategies and evaluated with both classification metrics and test-prioritization measures. The proposed gradient-boosting model achieved an F1 of 0.78 and AUC of 0.88, outperforming logistic-regression and history-only baselines....
Downloads
Global Statistics ℹ️
|
56
Views
|
33
Downloads
|
|
89
Total
|
|
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2022 Authors retain copyright and transfer to the journal the right of first publication and publishing rights
This work is licensed under a Creative Commons Attribution-NoDerivatives 4.0 International License.
Those authors who publish in this journal accept the following terms:
-
Authors retain copyright.
-
Authors transfer to the journal the right of first publication. The journal also owns the publishing rights.
-
All published contents are governed by an Attribution-NoDerivatives 4.0 International License.
Access the informative version and legal text of the license. By virtue of this, third parties are allowed to use what is published as long as they mention the authorship of the work and the first publication in this journal. If you transform the material, you may not distribute the modified work. -
Authors may make other independent and additional contractual arrangements for non-exclusive distribution of the version of the article published in this journal (e.g., inclusion in an institutional repository or publication in a book) as long as they clearly indicate that the work was first published in this journal.
- Authors are allowed and recommended to publish their work on the Internet (for example on institutional and personal websites), following the publication of, and referencing the journal, as this could lead to constructive exchanges and a more extensive and quick circulation of published works (see The Effect of Open Access).
