Comparative analysis of frameworks used in automated testing on example of TestNG and WebdriverIO


Abstract

The article presents a comparative analysis of frameworks supporting the development of automated tests for defined test scenarios. The comparative study concerned the TestNG and WebDriverIO frameworks. The overview of the tool has been analyzed both in terms of the test development process as well as the speed and efficiency of their execution. The website github.com was used for the purposes of the work. This application was used to run test scripts written in both frameworks. The results were compared by five defined criteria: the time of running the test files in different browser operation modes, the average value of memory and CPU usage during the test execution. The summary includes the evaluation of the compared frameworks.


Keywords

Selenium; WebDriverIO; TestNG; framework

T. J. Naidu, N. A. Basri, S. Nagenthram, “Selenium: A comparative analysis,” 2014 Internet Conference Contempt Computer Informatics, IC3I 2014, 2014.

S. Jagannatha, et al, Comparative Study on Automation Testing using Selenium Testing Framework and QTP, International Journal of Computer Science and Mobile Computing, 3(10) (2014) 258-267.

Wac, T. Watras, G. Kozieł, Analiza porównawcza rozwiązań wykorzystywanych w testowaniu automatycznym, 2019.

S. Jagannatha, et al, Comparative Study on Automation Testing using Selenium Testing Framework and QTP International Journal of Computer Science and Mobile Computing, 3(10) (2014) 258-267.

M. Meiliana, I. Septian, R.S. Alianto, Daniel.. Comparison Analysis of Android GUI Testing Frameworks by Using an Experimental Study, Procedia Computer Science, 135 (2018) 736–748, https://doi.org/10.1016/j.procs.2018.08.211.

S.M. Srinivasan, R.S. Sangwan, Web App Security: A Comparison and Categorization of Testing Frameworks, IEEE Software, 34(1) (2017) 99–102.

S. Sharma, “Study and analysis of automation testing techniques,” J. Global Research Computer Science, 3(12) (2012) 36-43.

V. N. Maurya, E. R. Kumar, Analytical Study on Manual vs. Automated Testing Using with Simplistic Cost Model, 2012.

K. Bahl, Software Testing Tools Techniques for Web Applications, 2015.

Download

Published : 2021-06-30


Shtokal, A., & Smołka, J. (2021). Comparative analysis of frameworks used in automated testing on example of TestNG and WebdriverIO. Journal of Computer Sciences Institute, 19, 100-106. https://doi.org/10.35784/jcsi.2595

Alla Shtokal  alla.shtokal@gmail.com
  Poland
Jakub Smołka 
Lublin University of Technology  Poland