Comparative analysis of selected tools for test automation of web applications

Analiza porównawcza wybranych narzędzi do automatyzacji testów aplikacji webowych

Michał Pojęta

michal.pojeta@pollub.edu.pl
Department of Computer Science, Lublin University of Technology (Poland)

Franciszek Wąsik


(Poland)

Małgorzata Plechawska-Wójcik


Lublin University of Technology (Poland)

Abstract

The paper concerns a comparison of selected tools for conducting automated unit tests of web applications. It focuses on the testing of server and client parts. The aim of the paper is to answer the questions: which tools work best in creating automatic tests of server and client applications. In the context of the server part, unittest and pytest – libraries based on the Python language – are compared. The comparison of the client part tools is carried out in the context of testing applications programmed with the Angular framework and pairs Jasmine and Jest together. The research is based on the results of test execution times of the prepared test applications. Analogous tests were programmed with each tool and repeated several times to obtain reliable results. The research showed that among the tools for testing server applications, unittest is the more efficient, while in the case of tools for testing client applications, Jasmine shows higher performance.


Keywords:

comparative analysis, automated testing, performance of test automation tools

M. E. Khan, F. Khan, Importance of Software Testing in Software Development Life Cycle, International Journal of Computer Science Issues (IJCSI) 11(2) (2014) 120-123.
  Google Scholar

I. Bhatti, J. A. Siddiqi, A. Moiz, Z. A. Memon, Towards Ad hoc testing technique effectiveness in software testing life cycle, 2019 2nd International Conference on Computing, Mathematics and Engineering Technologies (iCoMET) (2019) 1-6.
DOI: https://doi.org/10.1109/ICOMET.2019.8673390   Google Scholar

M. A. Umar, C. Zhanfang, A Study of Automated Software Testing: Automation Tools and Frameworks, International Journal of Computer Science Engineering 6 (2019) 217-225.
  Google Scholar

P. Kunte, D. Mane, Automation Testing of Web based application with Selenium and HP UFT (QTP), International Research Journal of Engineering and Technology (IRJET) 6 (2017) 2579-2583.
  Google Scholar

D. Raghuvanshi, Introduction to Software Testing, International Journal of Trend in Scientific Research and Development (IJTSRD) 4(3) (2020) 797-800.
  Google Scholar

V. Garousi, M. V. Mäntylä, When and what to automate in software testing? A multi-vocal literature review, Information and Software Technology 76 (2016) 92-117.
DOI: https://doi.org/10.1016/j.infsof.2016.04.015   Google Scholar

D. Ateşoğulları, A. Mishra, Automation testing tools: A comparative view, International Journal on Information Technologies & Security 12(4) (2020) 63-76.
  Google Scholar

D. Kumar, K. K. Mishra, The impacts of test automation on software's cost, quality and time to market, Procedia Computer Science 79 (2016) 8-15.
DOI: https://doi.org/10.1016/j.procs.2016.03.003   Google Scholar

H. Kaur, G. Gupta, Comparative Study of Automated Testing Tools: Selenium, Quick Test Professional and Testcomplete, Int. Journal of Engineering Research and Applications 3(5) (2013) 1739-1743.
  Google Scholar

E. Pernice, C. Albiston, R. Beeler, E. Chou, C. Fry, M. Shor, J. Spears, D. Speck, A. Thakur, S. West, Application Development in the Face of Evolving Web Technologies at the National Ignition Facility, 17th Int. Conf. on Acc. and Large Exp. Physics Control Systems (2019) 1052-1056.
  Google Scholar

M. Sharma, R. Angmo, Web based automation testing and tools, International Journal of Computer Science and Information Technologies 5(1) (2014) 908-912.
  Google Scholar

A. Bulajic, S. Sambasivam, R. Stojic, Overview of the test driven development research projects and experiments, Proceedings of Informing Science & IT Education Conference (InSITE) (2012) 165-187.
DOI: https://doi.org/10.28945/1647   Google Scholar

C. Solis, X. Wang, A study of the characteristics of behaviour driven development, 37th EUROMICRO conference on software engineering and advanced applications (2011) 383-387.
DOI: https://doi.org/10.1109/SEAA.2011.76   Google Scholar

A. Rawat, A Review on Python Programming, International Journal of Research in Engineering, Science and Management 3(12) (2020) 8-11.
  Google Scholar

A. Pajankar, Python Unit Test Automation: Practical Techniques for Python Developers and Testers, Apress, Nashik, 2017.
DOI: https://doi.org/10.1007/978-1-4842-2677-3   Google Scholar

D. Sale, Testing Python: Applying Unit Testing, TDD, BDD and Acceptance Testing, John Wiley & Sons, Chichester, 2014.
  Google Scholar

D. Arbuckle, Python Testing: Beginner's Guide, Packt Publishing Ltd, Birmingham, 2010.
  Google Scholar

B. Okken, Python Testing with pytest, Pragmatic Bookshelf, Raleigh, 2022.
  Google Scholar

B. Oliveira, pytest Quick Start Guide: Write better Python code with simple and maintainable tests, Packt Publishing Ltd., Birmingham, 2018.
  Google Scholar

L. A. Barbosa, Assessing the migration of testing frameworks in the Python ecosystem, Master Thesis, Universidade Federal de Minas Gerais, Belo Horizonte, 2022.
  Google Scholar

Download


Published
2023-09-30

Cited by

Pojęta, M., Wąsik, F., & Plechawska-Wójcik, M. (2023). Comparative analysis of selected tools for test automation of web applications: Analiza porównawcza wybranych narzędzi do automatyzacji testów aplikacji webowych. Journal of Computer Sciences Institute, 28, 229–235. https://doi.org/10.35784/jcsi.3689

Authors

Michał Pojęta 
michal.pojeta@pollub.edu.pl
Department of Computer Science, Lublin University of Technology Poland

Authors

Franciszek Wąsik 

Poland

Authors

Małgorzata Plechawska-Wójcik 

Lublin University of Technology Poland

Statistics

Abstract views: 114
PDF downloads: 140