SYNCHRONIZATION OF EVENT-DRIVEN MANAGEMENT DURING DATA COLLECTION
Valeriy Kuzminykh
vakuz0202@gmail.comNational Technical University of Ukraine "Igor Sikorsky Kyiv Polytechnic Institute", Department of Software Engineering in Energy (Ukraine)
https://orcid.org/0000-0002-8258-0816
Oleksandr Koval
National Technical University of Ukraine "Igor Sikorsky Kyiv Polytechnic Institute", Department of Software Engineering in Energy (Ukraine)
Yevhen Havrylko
National Technical University of Ukraine "Igor Sikorsky Kyiv Polytechnic Institute", Department of Software Engineering in Energy (Ukraine)
https://orcid.org/0000-0001-9437-3964
Beibei Xu
National Technical University of Ukraine "Igor Sikorsky Kyiv Polytechnic Institute", Department of Software Engineering in Energy (Ukraine)
https://orcid.org/0000-0003-1430-5334
Iryna Yepifanova
Vinnytsia National Technical Unіversity (Ukraine)
Shiwei Zhu
National Technical University of Ukraine "Igor Sikorsky Kyiv Polytechnic Institute", Department of Software Engineering in Energy (Ukraine)
Nataliia Bieliaieva
Dragomanov Ukrainian State University (Ukraine)
Bakhyt Yeraliyeva
M. Kh. Dulaty Taraz Regional University (Kazakhstan)
Abstract
The article considers an approach to implementing the architecture of a microservice system for processing large volumes of data based on the event-oriented approach to managing the sequence of using individual microservices. This becomes especially important when processing large volumes of data from information sources with different performance levels when the task is to minimize the total time for processing data streams. In this case, as a rule, the task is to minimize the number of requests for information sources to obtain a sufficient amount of data relevant to the request. The efficiency of the entire software system as a whole depends on how the microservices that provide extraction and primary processing of the received data are managed. To obtain the required amount of relevant data from diverse information sources, the software system must adapt to the request during its operation so that the maximum number of requests are directed to sources that have the maximum probability of finding the data necessary for the request in them. An approach is proposed that allows adaptively managing the choice of microservices during data collection and by emerging events and, thus, forming a choice of information sources based on an assessment of the efficiency of obtaining relevant information from these sources. Events are generated as a result of data extraction and primary processing from certain sources in terms of assessing the availability of data relevant to the request in each of the sources considered within the framework of the selected search scenario. Event-oriented microservice architecture adapts the system operation to the current loads on individual microservices and the overall performance by analyse the relevant events. The use of an adaptive event-oriented microservice architecture can be especially effective in the development of various information and analytical systems constructed by real-time data collection and design scenarios of analytical activity. The article considers the features of synchronous and asynchronous options in the implementation of event-oriented architecture, which can be used in various software systems depending on their purpose. An analysis of the features of synchronous and asynchronous options in the implementation of event-oriented architecture, their quantitative parameters, and features of their use depending on the type of tasks is carried out.
Keywords:
Big Data, microservices, adaptation, event-driven software architecture, information technology, ontologyReferences
[1] Akhtanov S., Turlykozhayeva D., Ussipov N., Ibraimov M., Zhanabaev Z.: Centre including eccentricity algorithm for complex networks. Electronics Letters 58(7), 2022, 283–285.
Google Scholar
[2] Al-Masri E.: Enhancing the Microservices Architecture for the Internet of Things. IEEE International Conference on Big Data (Big Data). USA, WA, Seattle, 2018, 5119–5125.
Google Scholar
[3] Azarov O. et al.: Means of analyzing parameters of speech signal transmission and reproduction. Informatyka, Automatyka, Pomiary w Gospodarce i Ochronie Środowiska 14(2), 2024, 11–16.
Google Scholar
[4] Azarova A. O. et al.: Information technologies for assessing the quality of IT-specialties graduates' training of university by means of fuzzy logic and neural networks. International Journal of Electronics and Telecommunications 66(3), 2020, 411–416.
Google Scholar
[5] Belnar A.: Building Event-Driven Microservices: Leveraging Organizational Data at Scale. O'Reilly Media, USA 2020.
Google Scholar
[6] Bisikalo O. et al.: Parameterization of the Stochastic Model for Evaluating Variable Small Data in the Shannon Entropy Basis. Entropy 25(2), 2023, 184.
Google Scholar
[7] Buyya R.: Big Data. Principles and Paradigms. Elsevier, 2016.
Google Scholar
[8] Chris R.: Microservices. Development and refactoring patterns. Peter, 2019, 544.
Google Scholar
[9] Davis A.: Bootstrapping Microservices with Docker, Kubernetes, and Terraform: A project-based guide. Manning, Shelter Island 2021.
Google Scholar
[10] Dinesh R.: Hands-On Microservices – Monitoring and Testing. Hands-On Microservices – Monitoring and Testing: A performance engineer's guide to the continuous testing and monitoring of microservices. Packt Publishing. 2018.
Google Scholar
[11] Erl T.: Big Data Fundamentals. Concepts, Drivers & Techniques. Prentice Hall, 2016.
Google Scholar
[12] Ford N., Parsons R., Kua P.: Building Evolutionary Architectures: Support Constant Change. O'Reilly Media, 2017.
Google Scholar
[13] Ghiya P.: Typescript Microservices: Build, deploy, and secure microservices using TypeScript combined with Node.js. Packt, Birmingham 2018.
Google Scholar
[14] Gorelik A.: The Enterprise Big Data Lake: Delivering the Promise of Big Data and Data Science. O'Reilly, 2019.
Google Scholar
[15] Koval O. V. et al.: Evaluating the Quality of Modeling the Scenario of Information Analysis on a Branched Network. Modern information protection. DUT 3(39), 2019, 70–76.
Google Scholar
[16] Koval O. V. et al.: Improving the Efficiency of Typical Scenarios of Analytical Activities. CEUR Workshop Proceedings 3241, 2021, 123–132.
Google Scholar
[17] Koval O. V. et al.: Refining the typical scenarios by additional factors. Mathematical and computer modeling. Series: Technical sciences 1(20), 2019, 68–78.
Google Scholar
[18] Kuzminykh V. О. et al.: Data collection for analytical activities using adaptive micro-service architecture. Registration, storage and processing of data 23(1), 2021, 7–79.
Google Scholar
[19] Kuzminykh V., Xu B.: The influence of current results in an event-oriented data collection system. Zviazok 3(169), 2024, 18–22.
Google Scholar
[20] Mamyrbayev O., Toleu A., Tolegen G., Mekebayev N.: Neural architectures for gender detection and speaker identification. Cogent Engineering 7, 2020, 1727168, 1–13.
Google Scholar
[21] Newman S.: Building Microservices: Designing Fine-Grained Systems. O'Reilly Media, 2015.
Google Scholar
[22] Rocha H. F. O.: Practical Event-Driven Microservices Architecture: Building Sustainable and Highly Scalable Event-Driven Microservices. Apress, 2021.
Google Scholar
[23] Shuiskov A.: Building Microservices with Go: Develop seamless, efficient, and robust microservices with Go. Packt Publishing, 2022.
Google Scholar
[24] Simon P.: Too Big to Ignore: The Business Case for Big Data. Wiley, 2019.
Google Scholar
[25] Turlykozhayeva, D. et al.: Routing Algorithm for Software Defined Network Based on Boxcovering Algorithm. 10th International Conference on Wireless Networks and Mobile Communications (WINCOM), 2023, 1–5.
Google Scholar
[26] Wolff E.: Microservices, Flexible Software Architecture. Addison-Wesley, Boston 2016.
Google Scholar
[27] Zgurovsky M. Z., Zaychenko Y. P.: Big Data: Conceptual Analysis and Applications. Springer, 2020.
Google Scholar
[28] Zhang H., Li S., Jia Z, Zhong C., Zhang C.: Microservice Architecture in Reality: An Industrial Inquiry. IEEE International Conference on Software Architecture (ICSA), Germany, Hamburg, 2019, 51–60.
Google Scholar
Authors
Valeriy Kuzminykhvakuz0202@gmail.com
National Technical University of Ukraine "Igor Sikorsky Kyiv Polytechnic Institute", Department of Software Engineering in Energy Ukraine
https://orcid.org/0000-0002-8258-0816
Authors
Oleksandr KovalNational Technical University of Ukraine "Igor Sikorsky Kyiv Polytechnic Institute", Department of Software Engineering in Energy Ukraine
Authors
Yevhen HavrylkoNational Technical University of Ukraine "Igor Sikorsky Kyiv Polytechnic Institute", Department of Software Engineering in Energy Ukraine
https://orcid.org/0000-0001-9437-3964
Authors
Beibei XuNational Technical University of Ukraine "Igor Sikorsky Kyiv Polytechnic Institute", Department of Software Engineering in Energy Ukraine
https://orcid.org/0000-0003-1430-5334
Authors
Iryna YepifanovaVinnytsia National Technical Unіversity Ukraine
Authors
Shiwei ZhuNational Technical University of Ukraine "Igor Sikorsky Kyiv Polytechnic Institute", Department of Software Engineering in Energy Ukraine
Authors
Nataliia BieliaievaDragomanov Ukrainian State University Ukraine
Authors
Bakhyt YeraliyevaM. Kh. Dulaty Taraz Regional University Kazakhstan
Statistics
Abstract views: 65PDF downloads: 31
Most read articles by the same author(s)
- Roman Kvуetnyy, Yuriy Bunyak, Olga Sofina, Oleksandr Kaduk, Orken Mamyrbayev, Vladyslav Baklaiev, Bakhyt Yeraliyeva, ADVERTISING BIDDING OPTIMIZATION BY TARGETING BASED ON SELF-LEARNING DATABASE , Informatyka, Automatyka, Pomiary w Gospodarce i Ochronie Środowiska: Vol. 13 No. 4 (2023)
- Olexandr Koval, Valeriy Kuzminykh, Maxim Voronko, Dmitriy Khaustov, DEVELOPMENT OF A SCENARIO-BASED PROJECT MANAGEMENT SYSTEM CONSTRUCTION IN ENTERPRISES WITH THE FUNCTIONAL ORGANIZATIONAL STRUCTURE , Informatyka, Automatyka, Pomiary w Gospodarce i Ochronie Środowiska: Vol. 3 No. 4 (2013)
- Petr Lezhniuk, Viacheslav Komar, Iryna Hunko, Daniyar Jarykbassov, Dinara Tussupzhanova, Bakhyt Yeraliyeva, Nazbek Katayev, NATURAL-SIMULATION MODEL OF PHOTOVOLTAIC STATION GENERATION IN PROCESS OF ELECTRICITY BALANCING IN ELECTRICAL POWER SYSTEM , Informatyka, Automatyka, Pomiary w Gospodarce i Ochronie Środowiska: Vol. 12 No. 3 (2022)
- Kostyantyn Ovchynnykov, Oleksandr Vasilevskyi, Volodymyr Sevastianov, Yurii Polievoda, Aliya Kalizhanova, Bakhyt Yeraliyeva, DETERMINATION OF THE OPTIMAL FREQUENCY OF THE PRIMARY MEASURING TRANSDUCER OF THE THICKNESS OF DIELECTRIC COATINGS OF METAL SURFACES , Informatyka, Automatyka, Pomiary w Gospodarce i Ochronie Środowiska: Vol. 12 No. 2 (2022)
- Serhii Zakharchenko, Tetiana Korobeinikova, Aigul Tungatarova, Bakhyt Yeraliyeva, NEW METHOD OF ON-LINE SUCCESSIVE-APPROXIMATION ADC CALIBRATION , Informatyka, Automatyka, Pomiary w Gospodarce i Ochronie Środowiska: Vol. 12 No. 2 (2022)
- Petro Loboda, Ivan Starovit, Oleksii Shushura, Yevhen Havrylko, Maxim Saveliev, Natalia Sachaniuk-Kavets’ka, Oleksandr Neprytskyi, Dina Oralbekova, Dinara Mussayeva, VENTILATION CONTROL OF THE NEW SAFE CONFINEMENT OF THE CHORNOBYL NUCLEAR POWER PLANT BASED ON NEURO-FUZZY NETWORKS , Informatyka, Automatyka, Pomiary w Gospodarce i Ochronie Środowiska: Vol. 13 No. 4 (2023)
- Lubov Zahoruiko, Tetiana Martianova, Mohammad Al-Hiari, Lyudmyla Polovenko, Maiia Kovalchuk, Svitlana Merinova, Volodymyr Shakhov, Bakhyt Yeraliyeva, MATHEMATICAL MODEL AND STRUCTURE OF A NEURAL NETWORK FOR DETECTION OF CYBER ATTACKS ON INFORMATION AND COMMUNICATION SYSTEMS , Informatyka, Automatyka, Pomiary w Gospodarce i Ochronie Środowiska: Vol. 14 No. 3 (2024)
- Leonid Timchenko, Natalia Kokriatska, Volodymyr Tverdomed, Iryna Yepifanova, Yurii Didenko, Dmytro Zhuk, Maksym Kozyr, Iryna Shakhina, ARCHITECTURAL AND STRUCTURAL AND FUNCTIONAL FEATURES OF THE ORGANIZATION OF PARALLEL-HIERARCHICAL MEMORY , Informatyka, Automatyka, Pomiary w Gospodarce i Ochronie Środowiska: Vol. 14 No. 1 (2024)
