Comparative analysis of frameworks used in automated testing on example of TestNG and WebdriverIO

Alla Shtokal

alla.shtokal@gmail.com
Ukraine (Poland)

Jakub Smołka


Lublin University of Technology (Poland)

Abstract

The article presents a comparative analysis of frameworks supporting the development of automated tests for defined test scenarios. The comparative study concerned the TestNG and WebDriverIO frameworks. The overview of the tool has been analyzed both in terms of the test development process as well as the speed and efficiency of their execution. The website github.com was used for the purposes of the work. This application was used to run test scripts written in both frameworks. The results were compared by five defined criteria: the time of running the test files in different browser operation modes, the average value of memory and CPU usage during the test execution. The summary includes the evaluation of the compared frameworks.


Keywords:

Selenium, WebDriverIO, TestNG, framework

T. J. Naidu, N. A. Basri, S. Nagenthram, “Selenium: A comparative analysis,” 2014 Internet Conference Contempt Computer Informatics, IC3I 2014, 2014.
DOI: https://doi.org/10.1109/IC3I.2014.7019594   Google Scholar

S. Jagannatha, et al, Comparative Study on Automation Testing using Selenium Testing Framework and QTP, International Journal of Computer Science and Mobile Computing, 3(10) (2014) 258-267.
  Google Scholar

Wac, T. Watras, G. Kozieł, Analiza porównawcza rozwiązań wykorzystywanych w testowaniu automatycznym, 2019.
  Google Scholar

S. Jagannatha, et al, Comparative Study on Automation Testing using Selenium Testing Framework and QTP International Journal of Computer Science and Mobile Computing, 3(10) (2014) 258-267.
  Google Scholar

M. Meiliana, I. Septian, R.S. Alianto, Daniel.. Comparison Analysis of Android GUI Testing Frameworks by Using an Experimental Study, Procedia Computer Science, 135 (2018) 736–748, https://doi.org/10.1016/j.procs.2018.08.211.
DOI: https://doi.org/10.1016/j.procs.2018.08.211   Google Scholar

S.M. Srinivasan, R.S. Sangwan, Web App Security: A Comparison and Categorization of Testing Frameworks, IEEE Software, 34(1) (2017) 99–102.
DOI: https://doi.org/10.1109/MS.2017.21   Google Scholar

S. Sharma, “Study and analysis of automation testing techniques,” J. Global Research Computer Science, 3(12) (2012) 36-43.
  Google Scholar

V. N. Maurya, E. R. Kumar, Analytical Study on Manual vs. Automated Testing Using with Simplistic Cost Model, 2012.
  Google Scholar

K. Bahl, Software Testing Tools Techniques for Web Applications, 2015.
  Google Scholar

Download


Published
2021-06-30

Cited by

Shtokal, A., & Smołka, J. (2021). Comparative analysis of frameworks used in automated testing on example of TestNG and WebdriverIO. Journal of Computer Sciences Institute, 19, 100–106. https://doi.org/10.35784/jcsi.2595

Authors

Alla Shtokal 
alla.shtokal@gmail.com
Ukraine Poland

Authors

Jakub Smołka 

Lublin University of Technology Poland

Statistics

Abstract views: 417
PDF downloads: 325