APPLICATION OF EXPLAINABLE ARTIFICIAL INTELLIGENCE IN SOFTWARE BUG CLASSIFICATION

Main Article Content

DOI

Łukasz Chmielowski

lukasz.chmielowski@nokia.com

http://orcid.org/0000-0001-6970-8144
Michał Kucharzak

michal.kucharzak@nokia.com

https://orcid.org/0000-0001-5068-5229
Robert Burduk

robert.burduk@pwr.edu.pl

https://orcid.org/0000-0002-3506-6611

Abstract

Fault management is an expensive process and analyzing data manually requires a lot of resources. Modern software bug tracking systems may be armed with automated bug report assignment functionality that facilitates bug classification or bug assignment to proper development group. For supporting decision systems, it would be beneficial to introduce information related to explainability. The purpose of this work is to evaluate the use of explainable artificial intelligence (XAI) in processes related to software development and bug classification based on bug reports created by either software testers or software users. The research was conducted on two different datasets. The first one is related to classification of security vs non-security bug reports. It comes from a telecommunication company which develops software and hardware solutions for mobile operators. The second dataset contains a list of software bugs taken from an opensource project. In this dataset the task is to classify issues with one of following labels crash, memory, performance, and security. Studies on XAI-related algorithms show that there are no major differences in the results of the algorithms used when comparing them with others. Therefore, not only the users can obtain results with possible explanations or experts can verify model or its part before introducing into production, but also it does not provide degradation of accuracy. Studies showed that it could be put into practice, but it has not been done so far.

Keywords:

software bug assignment, software bug triaging, explainable artificial intelligence, text analysis, vulnerability

References

Article Details

Chmielowski, Łukasz, Kucharzak, M., & Burduk, R. (2023). APPLICATION OF EXPLAINABLE ARTIFICIAL INTELLIGENCE IN SOFTWARE BUG CLASSIFICATION. Informatyka, Automatyka, Pomiary W Gospodarce I Ochronie Środowiska, 13(1), 14–17. https://doi.org/10.35784/iapgos.3396
Author Biographies

Łukasz Chmielowski, Nokia Solutions and Networks sp. z o.o.

LC.jpg

Łukasz Chmielowski received a M.Sc. degree with distinction in Computer Science with specialization in Intelligent Information Systems. He is currently working towards Ph.D. in Information and Communication Technology at Wroclaw University of Science and Technology (Poland). He is with the Nokia Solutions and Networks sp. z o.o. (Poland) for five years. He is working with machine learning techniques related to natural language processing and software bug assignment.

Michał Kucharzak, Nokia Solutions and Networks sp. z o.o.

MK.jpg

Michał Kucharzak received his Ph.D. in computer science in area of network optimization. In recent years, he cooperated with numerous R&D centers and has been a member of reviewer committees for many international journals, program, and technical committees for various conferences as well. His current research interests are primarily in the areas of network modeling and network optimization with special regard to overlays, simulations, design of efficient algorithms and wireless system protocols, including software testing and quality assurance.

Robert Burduk, Wroclaw University of Science and Technology

RB.jpg

Robert Burduk is Professor of Computer Science in the Department of Systems and Computer Networks, Faculty of Information and Communication Technology, Wroclaw University of Science and Technology, Poland. He received an Ph.D. and D.Sc. degrees in Computer Science in 2003 and 2014 respectively. His research interests cover among the others: machine learning, classifier selection algorithms and multiple classifier systems. He serves on program committees of numerous international conferences, published over 100 papers and edited 5 books.