Software Testing in the Indonesian Industry: Survey of Methods, Tools, and Documentation

Asri Maspupah, Ani Rahmani, Joe Lian Min, Trisna Ari Roshinta

Abstract

Software testing plays a crucial role in the software development by ensuring that software is accurate and of high quality. Many software companies neglect software testing, which can lead to unprofitable business outcomes. For example, ineffective software testing may fail to identify all defects, resulting in increased development costs. A key factor determining the success of software testing is the strategy for implementing the testing process, the selection of testing tools, and the documentation of testing activities. This article examines the current state of software testing processes in the Indonesian software industry. The research objective is to analyze the software testing implementation strategy within the software development context, focusing on three main areas: software testing methodology, software testing tools, and software testing documentation. The research employs a survey method, collecting data from several respondents, Indonesian software companies, via an online questionnaire. The research findings indicate that testing is still predominantly manual. However, some software companies have begun to adopt a combination of manual and automated testing. Most companies utilize software testing documentation for reporting purposes during the execution of tests. Nevertheless, documenting test cases as a guide for testing execution is not prioritized as highly as bug reporting. Conversely, many Indonesian software companies have adopted testing tools and conducted performance testing to ensure software quality. Consequently, the software testing process in the Indonesian software industry tends to adhere to formal methods in accordance with the ISO/IEC/IEEE 29119 software testing standards

Full Text:

PDF (106-117)

References

X. Jia, ‘The Role and Importance of Software Testing in Software Quality Management’, Journal of Industry and Engineering Management, vol. 1, no. 4, pp. 39–44, 2023, doi: https://doi.org/10.62517/jiem.202303406.

M. Bajjouk, M. E. Rana, C. R. Ramachandiran, and S. Chelliah, ‘Software testing for reliability and quality improvement’, Journal of Applied Technology and Innovation, vol. 5, no. 2, pp. 40–46, 2021, Accessed: Sep. 14, 2024. [Online]. Available: https://jati.sites.apiit.edu.my/files/2021/03/Volume5_Issue2_Paper7_2021.pdf

O. Dahiya and K. Solakin, ‘A Study on Identification of Issues and Challenges Encountered in Software Testing’, in Proceedings of International Conference on Communication and Artificial Intelligence, Singapore: Springer, May 2021, pp. 549–556. doi: https://doi.org/10.1007/978-981-33-6546-9_52.

ISO/IEC JTC1/SC7/WG26, ‘Test processes’, in ISO/IEC 29119 Software and systems engineering - Software testing, 2nd ed., IEEE, 2021, ch. 2. doi: https://doi.org/10.1109/IEEESTD.2021.9591508.

S. Kumar, ‘Reviewing Software Testing Models and Optimization Techniques: An Analysis of Efficiency and Advancement Needs’, Journal of Computers, Mechanical and Management, vol. 2, no. 1, pp. 43–55, Feb. 2023, doi: https://doi.org/10.57159/gadl.jcmm.2.1.23041.

S. Ergasheva and A. Kruglov, ‘Software Development Life Cycle early phases and quality metrics: A Systematic Literature Review’, in Conference Information Technologies, Telecommunications and Control Systems (ITTCS), Innopolis, Russia: IOP Publishing Ltd, Dec. 2020, pp. 1–13. doi: https://doi.org/10.1088/1742-6596/1694/1/012007.

I. Santos, S. M. Melo, P. S. L. Souza, and S. R. S. Souza, ‘A survey on the practices of software testing: a look into Brazilian companies’, Journal of Software Engineering Research and Development, vol. 10, pp. 1–15, May 2022, doi: https://doi.org/10.5753/JSERD.2022.786.

Ralf. Bierig, Stephen. Brown, Edgar. Galván, and Joseph. Timoney, Essentials of Software Testing. Cambridge University Press, 2021. doi: https://doi.org/10.1017/9781108974073.

M. Beller, G. Gousios, and A. Zaidman, ‘How (Much) Do Developers Test?’, in Proceedings - International Conference on Software Engineering, IEEE Computer Society, May 2015, pp. 559–562. doi: https://doi.org/10.1109/ICSE.2015.193.

V. Garousi, M. Felderer, M. Kuhrmann, K. Herkiloğlu, and S. Eldh, ‘Exploring the industry’s challenges in software testing: An empirical study’, Journal of Software: Evolution and Process, vol. 32, no. 8, pp. 1–23, Aug. 2020, doi: https://doi.org/10.1002/smr.2251.

P. Waychal, L. F. Capretz, J. Jia, D. Varona, and Y. Lizama, ‘Practitioners’ Testimonials about Software Testing’, in Proceedings - 2021 IEEE International Conference on Software Analysis, Evolution and Reengineering, SANER 2021, Institute of Electrical and Electronics Engineers Inc., Mar. 2021, pp. 582–589. doi: https://doi.org/10.1109/SANER50967.2021.00070.

T. Hynninen, J. Kasurinen, A. Knutas, and O. Taipale, ‘Software Testing: Survey of the Industry Practices’, in International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), IEEE, May 2018, pp. 1449–1454. doi: https://doi.org/10.23919/MIPRO.2018.8400261.

Y. Wang, M. V. Mäntylä, S. Demeyer, K. Wiklund, S. Eldh, and T. Kairi, ‘Software Test Automation Maturity -- A Survey of the State of the Practice’, in In Proceedings of the 15th International Conference on Software Technologies – ICSOFT, SciTePress, Jul. 2020. doi: https://doi.org/10.5220/0009766800270038.

J. Ponto, ‘Understanding and Evaluating Survey Research’, J Adv Pract Oncol, vol. 6, no. 2, pp. 168–171, Apr. 2015, doi: https://doi.org/10.6004/jadpro.2015.6.2.9.

C. Quesada-López, E. Hernandez-Agüero, and M. Jenkins, ‘Characterization of software testing practices: A replicated survey in Costa Rica’, Journal of Software Engineering Research and Development, vol. 7, pp. 1–6, Dec. 2019, doi: https://doi.org/10.5753/jserd.2019.472.

Z. Yu, ‘Analysis of Categorical Data’, in Statistics and Probability with Applications for Engineers and Scientists using MINITAB, R and JMP, Second., 2020: John Wiley & Sons, Inc, 2020, ch. 13, pp. 558–590. doi: https://doi.org/10.1002/9781119516651.ch13.

S. Izzat and N. N. Saleem, ‘Software Testing Techniques and Tools: A Review’, Journal of Education and Science, vol. 32, no. 2, pp. 30–40, Jun. 2023, doi: https://doi.org/10.33899/edusj.2023.137480.1305.

D. S. Taley and B. Pathak, ‘Comprehensive Study of Software Testing Techniques and Strategies: A Review’, International Journal of Engineering Research and Technology (IJERT), vol. 9, no. 8, pp. 40–46, Aug. 2020, doi: https://doi.org/10.17577/ijertv9is080373.

S. Reid, ‘The Personal Test Maturity Matrix’, in Japan Symposium on Software Testing (JaSST), Mar. 2014. Accessed: Sep. 09, 2024. [Online]. Available: https://jasst.jp/symposium/jasst14tokyo/report.html

S. Pargaonkar, ‘A Comprehensive Review of Performance Testing Methodologies and Best Practices: Software Quality Engineering’, International Journal of Science and Research (IJSR), vol. 12, no. 8, pp. 2008–2014, Aug. 2023, doi: https://doi.org/10.21275/sr23822111402.

V. Biju and S. Ali, ‘Automation of Purchase Order in Microsoft Dynamics 365 by Deploying Selenium’, in 8th International Conference of Security, Privacy and Trust Management (SPTM 2020), Helsinki, Finland: Computer Science and Information Technology, Jun. 2020, pp. 101–114. doi: https://doi.org/10.5121/csit.2020.100610.

S. K. Alferidah and S. Ahmed, ‘Automated Software Testing Tools’, in 2020 International Conference on Computing and Information Technology, ICCIT 2020, Tabuk, Saudi Arabia: Institute of Electrical and Electronics Engineers Inc., Sep. 2020, pp. 183–86. doi: 10.1109/ICCIT-144147971.2020.9213735.

ISO/IEC JTC1/SC7/WG26, ‘Test documentation’, in ISO/IEC 29119 Software and systems engineering - Software testing, 2nd ed., IEEE, 2021, ch. 3. doi: https://doi.org/10.1109/IEEESTD.2021.9591577.

H. Singh, ‘Documenting Test Results’, in Structural Materials, 1st ed., Singapore: Springer, 2021, ch. 5, pp. 147–162. doi: https://doi.org/10.1007/978-981-16-3211-2_5.

S. He and P. Carracedo, ‘Software Testing Summary for Chemoinfortics’, in MOL2NET’21, Conference on Molecular, Biomedical & Computational Sciences and Engineering, Sciforum, Oct. 2021, pp. 1–4. doi: https://doi.org/10.3390/mol2net-07-11214.

Kusum, P. Talwar, A. Puri, and G. Kumar, ‘Overview of software testing’, Global Journal of Engineering and Technology Advances, vol. 19, no. 1, pp. 104–112, Apr. 2024, doi: https://doi.org/10.30574/gjeta.2024.19.1.0060.

K. S. Thant and H. H. K. Tin, ‘The Impact Of Manual And Automatic Testing On Software Testing Efficiency And Effectiveness’, Indian Journal of Science and Research, vol. 3, no. 3, pp. 88–93, Sep. 2023, Accessed: Sep. 14, 2024. [Online]. Available: https://www.ijsronline.org/issue/20230714-032703.942.pdf

DOI: https://doi.org/10.37058/innovatics.v6i2.12636

Refbacks

  • There are currently no refbacks.