Performance evaluation of designated containerization and virtualization solutions using a synthetic benchmark

Sebastian Tarasiuk

sebastian.tarasiuk@pollub.edu.pl
Department of Computer Science, Lublin University of Technology (Poland)

Damian Traczuk


Department of Computer Science, Lublin University of Technology (Poland)

Kacper Szczepaniuk


Department of Computer Science, Lublin University of Technology (Poland)

Patryk Stoń


Department of Computer Science, Lublin University of Technology (Poland)

Jakub Smołka


Department of Computer Science, Lublin University of Technology (Poland)
https://orcid.org/0000-0002-8350-2537

Abstract

The aim of this paper is the analysis of the performance of virtualization and containerization technologies in the context of IT infrastructure. The following virtualization technologies were selected for the study: VirtualBox, VMware and QEMU, as well as containerization technologies: Docker, Podman and LXD. In addition, microVM technologies such as QEMU and Firecracker, which are increasingly important in the context of virtualization, were also included. The comparative criteria on which the analysis is based include aspects of computing and memory performance. Tests conducted on selected technologies included testing CPU performance, RAM efficiency and disk speed for reading and writing data. A SysBench, synthetic benchmark, was used to conduct the tests.

Keywords:

virtualization, containerization, microVM, synthetic benchmark

Z. Li, Comparison between common virtualization solutions: VMware Workstation, Hyper-V and Docker, In 2021 IEEE 3rd International Conference on Frontiers Technology of Information and Computer (ICFTIC) (2021) 701–707, https://doi.org/10.1109/icftic54370.2021.9647226.
  Google Scholar

M. Chae, H. Lee, K. Lee, A performance comparison of linux containers and virtual machines using Docker and KVM, Cluster Computing 22 (2019) 1765–1775, https://doi.org/10.1007/s10586-017-1511-2.
  Google Scholar

R. Morabito, J. Kjällman, M. Komu, Hypervisors vs. Lightweight Virtualization: A Performance Comparison, In 2015 IEEE International Conference on Cloud Engineering (2015) 386–393, https://doi.org/10.1109/IC2E.2015.74.
  Google Scholar

W. Felter, A. Ferreira, R. Rajamony, J. Rubio, An updated performance comparison of virtual machines and Linux containers, In 2015 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) (2015) 171–172, https://doi.org/10.1109/ispass.2015.7095802.
  Google Scholar

F. Manco, C. Lupu, F. Schmidt, J. Mendes, S. Kuenzer, S. Sati, K. Yasukata, C. Raiciu, F. Huici, My VM is Lighter (and Safer) than your Container, Proceedings of the 26th Symposium on Operating Systems Principles (2017) 218–233, https://doi.org/10.1145/3132747.3132763.
  Google Scholar

G. Li, K. Takahashi, K. Ichikawa, H. Iida, P. Thiengburanathum, P. Phannachitta, Comparative Performance Study of Lightweight Hypervisors Used in Container Environment, Proceedings of the 11th International Conference on Cloud Computing and Services Science (2021) 215–223, https://doi.org/10.5220/0010440502150223.
  Google Scholar

B. Djordjević, V. Timčenko, N. Kraljević, I. Jovičić, N. Davidović, Comparison of VMware Workstation, VirtualBox and MS Hyper-V hypervisor performance with MS Windows OS based guests, In 2023 22nd International Symposium INFOTEH-JAHORINA (INFOTEH) (2023) 1–5, https://doi.org/10.1109/INFOTEH57020.2023.10094080.
  Google Scholar

B. Đorđević, N. Kraljević, N. Davidović, Guest file system behavior for type-2 hypervisor-based virtualization in VMware Workstation, In 2023 22nd International Symposium INFOTEH-JAHORINA (INFOTEH) (2023) 1–6, https://doi.org/10.1109/INFOTEH57020.2023.10094170.
  Google Scholar

B. Đorđević, S. Gucunja, N. Kraljević, N. Davidović, Performance comparison of different hypervisor versions of the type-2 hypervisor VirtualBox, In 2023 10th International Conference on Electrical, Electronic and Computing Engineering (IcETRAN) (2023) 1–6, https://doi.org/10.1109/IcETRAN59631.2023.10192192.
  Google Scholar

D. T. Vojnak, B. S. Ðorđević, V. V. Timčenko, S. M. Štrbac, Performance Comparison of the type-2 hypervisor VirtualBox and VMWare Workstation, In 2019 27th Telecommunications Forum (TELFOR) (2019) 1–4, https://doi.org/10.1109/TELFOR48224.2019.8971213.
  Google Scholar

B. Đorđević, V. Timčenko, O. Pavlović, N. Davidović, Performance comparison of native host and hyper-based virtualization VirtualBox, In 2021 20th International Symposium INFOTEH-JAHORINA (INFOTEH) (2021) 1–4, https://doi.org/10.1109/INFOTEH51037.2021.9400684.
  Google Scholar

S. Giallorenzo, J. Mauro, M. G. Poulsen, F. Siroky, Virtualization Costs: Benchmarking Containers and Virtual Machines Against Bare-Metal, SN Computer Science 2 (2021) 404, https://doi.org/10.1007/s42979-021-00781-8.
  Google Scholar

Download


Published
2024-09-30

Cited by

Tarasiuk, S., Traczuk, D., Szczepaniuk, K., Stoń, P., & Smołka, J. (2024). Performance evaluation of designated containerization and virtualization solutions using a synthetic benchmark. Journal of Computer Sciences Institute, 32, 157–162. https://doi.org/10.35784/jcsi.6231

Authors

Sebastian Tarasiuk 
sebastian.tarasiuk@pollub.edu.pl
Department of Computer Science, Lublin University of Technology Poland

Authors

Damian Traczuk 

Department of Computer Science, Lublin University of Technology Poland

Authors

Kacper Szczepaniuk 

Department of Computer Science, Lublin University of Technology Poland

Authors

Patryk Stoń 

Department of Computer Science, Lublin University of Technology Poland

Authors

Jakub Smołka 

Department of Computer Science, Lublin University of Technology Poland
https://orcid.org/0000-0002-8350-2537

Statistics

Abstract views: 117
PDF downloads: 92


License

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.