Comparative Frameworks for Assessing Software Testing Maturity Levels

  • Margreth Handayani Saragih Binus University


 Software testing is one of the crucial stages in the development of software within an organization or company. Some organizations even measure the maturity level of their software testing practices assessing whether their testing efforts suffice or require improvements in the future. This paper presents the findings of a qualitative research study comparing selected software maturity assessment frameworks. The evaluation in this research compares the TMMI, TPI Next, and Test SPICE frameworks. The paper provides a comparison of these frameworks and recommends the most suitable one based on organizational needs. These frameworks can be considered for use in improving the software testing process, with careful consideration in choosing among them. Additionally, a summary of example implementations of the chosen framework is also provided. The results of this study are expected to serve as a valuable reference for organizations in preparing for software testing maturity assessments.


[1] Afzal, W., Alone, S., Glocksien, K., & Torkar, R. (2016). Software test process improvement approaches: A systematic literature review and an industrial case study. Journal of Systems and Software, 1-33.
[2] Garousi, V., & van Veenendaal, E. (2021). Test Maturity Model integration (TMMi): Trends of worldwide test maturity and certifications. IEEE Software. doi:10.1109/MS.2021.3061930
[3] Garousi, V., Rainer, A., Lauvås, P., & Arcuri, A. (2020). Software-testing education: A systematic literature mapping. Journal of Systems and Software, 110570. doi:10.1016/j.jss.2020.110570
[4] Garousi, V., Veenendaal, E. V., & Felderer, M. (2021). Motivations for and benefits of adopting the Test Maturity Model. United Kingdom: TMMi Foundation.
[5] ISTQB. (2018). ISEB Software Testing Foundation Syllabus Version 2018. ISTQB.
[6] Laksono, M. A., Budiardjo, E. K., & Ferdinansyah, A. (2019). Assessment of Test Maturity Model: A Comparative Study for Process Improvement. Proceedings of the 2nd International Conference on Software Engineering and Information Management (pp. 110–118). New York, NY, USA: Association for Computing Machinery. doi:10.1145/3305160.3305203
[7] Test SPICE. (2018). The TestSPICE PAM: Process Assessment Model for Testing & Testing Services V4.0. Test SPICE.
[8] TMMi Foundation. (2014). TMMi Assessment Method Application Requirements (TAMAR) R1.0. Ireland: TMMi Foundation.
[9] TMMi Foundation. (2018). Test Maturity Model integration: Guidelines for Test Process Improvement Release 1.2. Ireland.: TMMi Foundation.