NAVIGATION STRATEGY FOR MOBILE ROBOT BASED ON COMPUTER VISION AND YOLOV5 NETWORK IN THE UNKNOWN ENVIRONMENT
Thanh-Lam BUI
Hanoi University of Industry, Faculty of Mechanical Engineering, Department of Mechatronics Engineering, (Viet Nam)
Ngoc-Tien TRAN
tientn@haui.edu.vnHanoi University of Industry, Faculty of Mechanical Engineering, Department of Mechatronics Engineering, (Viet Nam)
https://orcid.org/0000-0001-5099-3758
Abstract
Intelligent mobile robots must possess the ability to navigate in complex environments. The field of mobile robot navigation is continuously evolving, with various technologies being developed. Deep learning has gained attention from researchers, and numerous navigation models utilizing deep learning have been proposed. In this study, the YOLOv5 model is utilized to identify objects to aid the mobile robot in determining movement conditions. However, the limitation of deep learning models being trained on insufficient data, leading to inaccurate recognition in unforeseen scenarios, is addressed by introducing an innovative computer vision technology that detects lanes in real-time. Combining the deep learning model with computer vision technology, the robot can identify different types of objects, allowing it to estimate distance and adjust speed accordingly. Additionally, the paper investigates the recognition reliability in varying light intensities. The findings of this study offer promising directions for future breakthroughs in mobile robot navigation
Keywords:
mobile robot, navigation, deep learning, computer visionReferences
Ajeil, F. H., Ibraheem, I. K., Azar, A. T., & Humaidi, A. J. (2020). Autonomous navigation and obstacle avoidance of an omnidirectional mobile robot using swarm optimization and sensors deployment. International Journal of Advanced Robotic Systems, 17(3), 1729881420929498. https://doi.org/10.1177/1729881420929498.
Al Khatib, E. I., Jaradat, M. A. K., & Abdel-Hafez, M. F. (2020). Low-cost reduced navigation system for mobile robot in indoor/outdoor environments. IEEE Access, 8, 25014-25026. https://doi.org/10.1109/ACCESS.2020.2971169.
Altuntaş, N., Imal, E., Emanet, N., & Öztürk, C. N. (2016). Reinforcement learning-based mobile robot navigation. Turkish Journal of Electrical Engineering and Computer Sciences, 24(3), 1747-1767. https://doi.org/10.3906/elk-1311-129.
Amari, S. I. (1993). Backpropagation and stochastic gradient descent method. Neurocomputing, 5(4-5), 185-196.
Bui, T. L., Nguyen, T. H., & Nguyen, X. T. (2023). A Controller for Delta Parallel Robot Based on Hedge Algebras Method. Journal of Robotics, 2023. https://doi.org/10.1016/0925-2312(93)90006-O.
Chen, C. H., Lin, C. J., Jeng, S. Y., Lin, H. Y., & Yu, C. Y. (2021). Using ultrasonic sensors and a knowledge-based neural fuzzy controller for mobile robot navigation control. Electronics, 10(4), 466. https://doi.org/10.3390/electronics10040466.
Cho, J. H., Song, W., Choi, H., & Kim, T. (2017). Hole filling method for depth image based rendering based on boundary decision. IEEE Signal Processing Letters, 24(3), 329-333. https://doi.org/10.1109/LSP.2017.2661319.
Elfwing, S., Uchibe, E., & Doya, K. (2018). Sigmoid-weighted linear units for neural network function approximation in reinforcement learning. Neural Networks, 107, 3-11. https://doi.org/10.1016/j.neunet.2017.12.012.
Geng, H., Liu, H., Wang, B., & Sun, F. (2018). Reinforcement extreme learning machine for mobile robot navigation. In Proceedings of ELM-2016 (pp. 61-73). https://doi.org/10.1007/978-3-319-57421-9_6.
Gharajeh, M. S., & Jond, H. B. (2020). Hybrid global positioning system-adaptive neuro-fuzzy inference system based autonomous mobile robot navigation. Robotics and Autonomous Systems, 134, 103669. https://doi.org/10.1016/j.robot.2020.103669.
Hichri, B., Gallala, A., Giovannini, F., & Kedziora, S. (2022). Mobile robots path planning and mobile multirobots control: A review. Robotica, 1-14. https://doi.org/10.1017/S0263574722000893.
Hu, M., Wei, Y., Li, M., Yao, H., Deng, W., Tong, M., & Liu, Q. (2022). Bimodal learning engagement recognition from videos in the classroom. Sensors, 22(16), 5932. https://doi.org/10.3390/s22165932.
Iqbal, J., Xu, R., Sun, S., & Li, C. (2020). Simulation of an autonomous mobile robot for LiDAR-based in-field phenotyping and navigation. Robotics, 9(2), 46. https://doi.org/10.3390/robotics9020046.
Kingma, D. P., & Ba, J. (2014). Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980.
https://doi.org/10.48550/arXiv.1412.6980.
Lagaza, K. P., Kashyap, A. K., & Pandey, A. (2020). Spider monkey optimization algorithm based collision-free navigation and path optimization for a mobile robot in the static environment. In Advances in Mechanical Engineering: Select Proceedings of ICRIDME 2018 (pp. 1459-1473). https://doi.org/10.1007/978-981-15-0124-1_128.
Lin, H., & Yang, J. (2022). Ensemble cross‐stage partial attention network for image classification. IET Image Processing, 16(1), 102-112. https://doi.org/10.1049/ipr2.12335.
Liu, B., Xiao, X., & Stone, P. (2021). A lifelong learning approach to mobile robot navigation. IEEE Robotics and Automation Letters, 6(2), 1090-1096. https://doi.org/10.1109/LRA.2021.3056373.
Liu, Y., Gao, J., Liu, D., & Wang, Z. (2010, October). The design of control system and study on control algorithm of laser navigation mobile robot. In 2010 3rd International Congress on Image and Signal Processing (Vol. 9, pp. 4276-4280). https://doi.org/10.1109/CISP.2010.5647424
Liu, Y., Li, Z., Zhang, T., & Zhao, S. (2018). Brain–robot interface-based navigation control of a mobile robot in corridor environments. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 50(8), 3047-3058. https://doi.org/10.1109/TSMC.2018.2833857.
Lulio, L. C., Tronco, M. L., & Porto, A. J. (2009, December). JSEG-based image segmentation in computer vision for agricultural mobile robot navigation. In 2009 IEEE International Symposium on Computational Intelligence in Robotics and Automation-(CIRA) (pp. 240-245). https://doi.org/10.1109/CIRA.2009.5423201.
Luo, S., Yu, J., Xi, Y., & Liao, X. (2022). Aircraft target detection in remote sensing images based on improved YOLOv5. IEEE Access, 10, 5184-5192. https://doi.org/10.1109/ACCESS.2022.3140876.
Mourgias-Alexandris, G., Tsakyridis, A., Passalis, N., Tefas, A., Vyrsokinos, K., & Pleros, N. (2019). An all-optical neuron with sigmoid activation function. Optics Express, 27(7), 9620-9630. https://doi.org/10.1364/OE.27.009620.
Nguyen, A. T., & Vu, C. T. (2022). Obstacle Avoidance for Autonomous Mobile Robots Based on Mapping Method. In Proceedings of the International Conference on Advanced Mechanical Engineering, Automation, and Sustainable Development 2021 (AMAS2021) (pp. 810-816). https://doi.org/10.1007/978-3-030-99666-6_118.
Ran, T., Yuan, L., & Zhang, J. B. (2021). Scene perception based visual navigation of mobile robot in indoor environment. ISA transactions, 109, 389-400. https://doi.org/10.1016/j.isatra.2020.10.023.
Saidi, Y., Nemra, A., & Tadjine, M. (2020). Robust mobile robot navigation using fuzzy type 2 with wheel slip dynamic modeling and parameters uncertainties. International Journal of Modelling and Simulation, 40(6), 397-420. https://doi.org/10.1080/02286203.2019.1646480.
Singh, P., Agrawal, P., Nandanwar, A., Behera, L., Verma, N. K., Nahavandi, S., & Jamshidi, M. (2020). Multivariable event-triggered generalized super-twisting controller for safe navigation of nonholonomic mobile robot. IEEE Systems Journal, 15(1), 454-465. https://doi.org/10.1109/JSYST.2020.2985730.
Wang, D., Hu, Y., & Ma, T. (2020). Mobile robot navigation with the combination of supervised learning in cerebellum and reward-based learning in basal ganglia. Cognitive Systems Research, 59, 1-14. https://doi.org/10.1016/j.cogsys.2019.09.006.
Wang, H., Zhang, F., & Wang, L. (2020). Fruit classification model based on improved Darknet53 convolutional neural network. In 2020 International Conference on Intelligent Transportation, Big Data & Smart City (ICITBS) (pp. 881-884). https://doi.org/10.1109/ICITBS49701.2020.00194.
Wang, X., Mizukami, Y., Tada, M., & Matsuno, F. (2021). Navigation of a mobile robot in a dynamic environment using a point cloud map. Artificial Life and Robotics, 26, 10-20. https://doi.org/10.1007/s10015-020-00617-3.
Zhou, L., Rao, X., Li, Y., Zuo, X., Qiao, B., & Lin, Y. (2022). A lightweight object detection method in aerial images based on dense feature fusion path aggregation network. ISPRS International Journal of Geo-Information, 11(3), 189. https://doi.org/10.3390/ijgi11030189.
Al Khatib, E. I., Jaradat, M. A. K., & Abdel-Hafez, M. F. (2020). Low-cost reduced navigation system for mobile robot in indoor/outdoor environments. IEEE Access, 8, 25014-25026. https://doi.org/10.1109/ACCESS.2020.2971169.
Altuntaş, N., Imal, E., Emanet, N., & Öztürk, C. N. (2016). Reinforcement learning-based mobile robot navigation. Turkish Journal of Electrical Engineering and Computer Sciences, 24(3), 1747-1767. https://doi.org/10.3906/elk-1311-129.
Amari, S. I. (1993). Backpropagation and stochastic gradient descent method. Neurocomputing, 5(4-5), 185-196.
Bui, T. L., Nguyen, T. H., & Nguyen, X. T. (2023). A Controller for Delta Parallel Robot Based on Hedge Algebras Method. Journal of Robotics, 2023. https://doi.org/10.1016/0925-2312(93)90006-O.
Chen, C. H., Lin, C. J., Jeng, S. Y., Lin, H. Y., & Yu, C. Y. (2021). Using ultrasonic sensors and a knowledge-based neural fuzzy controller for mobile robot navigation control. Electronics, 10(4), 466. https://doi.org/10.3390/electronics10040466.
Cho, J. H., Song, W., Choi, H., & Kim, T. (2017). Hole filling method for depth image based rendering based on boundary decision. IEEE Signal Processing Letters, 24(3), 329-333. https://doi.org/10.1109/LSP.2017.2661319.
Elfwing, S., Uchibe, E., & Doya, K. (2018). Sigmoid-weighted linear units for neural network function approximation in reinforcement learning. Neural Networks, 107, 3-11. https://doi.org/10.1016/j.neunet.2017.12.012.
Geng, H., Liu, H., Wang, B., & Sun, F. (2018). Reinforcement extreme learning machine for mobile robot navigation. In Proceedings of ELM-2016 (pp. 61-73). https://doi.org/10.1007/978-3-319-57421-9_6.
Gharajeh, M. S., & Jond, H. B. (2020). Hybrid global positioning system-adaptive neuro-fuzzy inference system based autonomous mobile robot navigation. Robotics and Autonomous Systems, 134, 103669. https://doi.org/10.1016/j.robot.2020.103669.
Hichri, B., Gallala, A., Giovannini, F., & Kedziora, S. (2022). Mobile robots path planning and mobile multirobots control: A review. Robotica, 1-14. https://doi.org/10.1017/S0263574722000893.
Hu, M., Wei, Y., Li, M., Yao, H., Deng, W., Tong, M., & Liu, Q. (2022). Bimodal learning engagement recognition from videos in the classroom. Sensors, 22(16), 5932. https://doi.org/10.3390/s22165932.
Iqbal, J., Xu, R., Sun, S., & Li, C. (2020). Simulation of an autonomous mobile robot for LiDAR-based in-field phenotyping and navigation. Robotics, 9(2), 46. https://doi.org/10.3390/robotics9020046.
Kingma, D. P., & Ba, J. (2014). Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980.
https://doi.org/10.48550/arXiv.1412.6980.
Lagaza, K. P., Kashyap, A. K., & Pandey, A. (2020). Spider monkey optimization algorithm based collision-free navigation and path optimization for a mobile robot in the static environment. In Advances in Mechanical Engineering: Select Proceedings of ICRIDME 2018 (pp. 1459-1473). https://doi.org/10.1007/978-981-15-0124-1_128.
Lin, H., & Yang, J. (2022). Ensemble cross‐stage partial attention network for image classification. IET Image Processing, 16(1), 102-112. https://doi.org/10.1049/ipr2.12335.
Liu, B., Xiao, X., & Stone, P. (2021). A lifelong learning approach to mobile robot navigation. IEEE Robotics and Automation Letters, 6(2), 1090-1096. https://doi.org/10.1109/LRA.2021.3056373.
Liu, Y., Gao, J., Liu, D., & Wang, Z. (2010, October). The design of control system and study on control algorithm of laser navigation mobile robot. In 2010 3rd International Congress on Image and Signal Processing (Vol. 9, pp. 4276-4280). https://doi.org/10.1109/CISP.2010.5647424
Liu, Y., Li, Z., Zhang, T., & Zhao, S. (2018). Brain–robot interface-based navigation control of a mobile robot in corridor environments. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 50(8), 3047-3058. https://doi.org/10.1109/TSMC.2018.2833857.
Lulio, L. C., Tronco, M. L., & Porto, A. J. (2009, December). JSEG-based image segmentation in computer vision for agricultural mobile robot navigation. In 2009 IEEE International Symposium on Computational Intelligence in Robotics and Automation-(CIRA) (pp. 240-245). https://doi.org/10.1109/CIRA.2009.5423201.
Luo, S., Yu, J., Xi, Y., & Liao, X. (2022). Aircraft target detection in remote sensing images based on improved YOLOv5. IEEE Access, 10, 5184-5192. https://doi.org/10.1109/ACCESS.2022.3140876.
Mourgias-Alexandris, G., Tsakyridis, A., Passalis, N., Tefas, A., Vyrsokinos, K., & Pleros, N. (2019). An all-optical neuron with sigmoid activation function. Optics Express, 27(7), 9620-9630. https://doi.org/10.1364/OE.27.009620.
Nguyen, A. T., & Vu, C. T. (2022). Obstacle Avoidance for Autonomous Mobile Robots Based on Mapping Method. In Proceedings of the International Conference on Advanced Mechanical Engineering, Automation, and Sustainable Development 2021 (AMAS2021) (pp. 810-816). https://doi.org/10.1007/978-3-030-99666-6_118.
Ran, T., Yuan, L., & Zhang, J. B. (2021). Scene perception based visual navigation of mobile robot in indoor environment. ISA transactions, 109, 389-400. https://doi.org/10.1016/j.isatra.2020.10.023.
Saidi, Y., Nemra, A., & Tadjine, M. (2020). Robust mobile robot navigation using fuzzy type 2 with wheel slip dynamic modeling and parameters uncertainties. International Journal of Modelling and Simulation, 40(6), 397-420. https://doi.org/10.1080/02286203.2019.1646480.
Singh, P., Agrawal, P., Nandanwar, A., Behera, L., Verma, N. K., Nahavandi, S., & Jamshidi, M. (2020). Multivariable event-triggered generalized super-twisting controller for safe navigation of nonholonomic mobile robot. IEEE Systems Journal, 15(1), 454-465. https://doi.org/10.1109/JSYST.2020.2985730.
Wang, D., Hu, Y., & Ma, T. (2020). Mobile robot navigation with the combination of supervised learning in cerebellum and reward-based learning in basal ganglia. Cognitive Systems Research, 59, 1-14. https://doi.org/10.1016/j.cogsys.2019.09.006.
Wang, H., Zhang, F., & Wang, L. (2020). Fruit classification model based on improved Darknet53 convolutional neural network. In 2020 International Conference on Intelligent Transportation, Big Data & Smart City (ICITBS) (pp. 881-884). https://doi.org/10.1109/ICITBS49701.2020.00194.
Wang, X., Mizukami, Y., Tada, M., & Matsuno, F. (2021). Navigation of a mobile robot in a dynamic environment using a point cloud map. Artificial Life and Robotics, 26, 10-20. https://doi.org/10.1007/s10015-020-00617-3.
Zhou, L., Rao, X., Li, Y., Zuo, X., Qiao, B., & Lin, Y. (2022). A lightweight object detection method in aerial images based on dense feature fusion path aggregation network. ISPRS International Journal of Geo-Information, 11(3), 189. https://doi.org/10.3390/ijgi11030189.
BUI, T.-L., & TRAN, N.-T. (2023). NAVIGATION STRATEGY FOR MOBILE ROBOT BASED ON COMPUTER VISION AND YOLOV5 NETWORK IN THE UNKNOWN ENVIRONMENT. Applied Computer Science, 19(2), 82–95. https://doi.org/10.35784/acs-2023-16
Authors
Thanh-Lam BUIHanoi University of Industry, Faculty of Mechanical Engineering, Department of Mechatronics Engineering, Viet Nam
Authors
Ngoc-Tien TRANtientn@haui.edu.vn
Hanoi University of Industry, Faculty of Mechanical Engineering, Department of Mechatronics Engineering, Viet Nam
https://orcid.org/0000-0001-5099-3758
Statistics
Abstract views: 116PDF downloads: 79
License
This work is licensed under a Creative Commons Attribution 4.0 International License.
All articles published in Applied Computer Science are open-access and distributed under the terms of the Creative Commons Attribution 4.0 International License.
Similar Articles
- Hawkar ASAAD, Shavan ASKAR, Ahmed KAKAMIN, Nayla FAIQ, EXPLORING THE IMPACT OF ARTIFICIAL INTELLIGENCE ON HUMANROBOT COOPERATION IN THE CONTEXT OF INDUSTRY 4.0 , Applied Computer Science: Vol. 20 No. 2 (2024)
- Nataliya SHABLIY, Serhii LUPENKO, Nadiia LUTSYK, Oleh YASNIY, Olha MALYSHEVSKA, KEYSTROKE DYNAMICS ANALYSIS USING MACHINE LEARNING METHODS , Applied Computer Science: Vol. 17 No. 4 (2021)
- Behnaz ESLAMI, Mehdi HABIBZADEH MOTLAGH, Zahra REZAEI, Mohammad ESLAMI, Mohammad AMIN AMINI, UNSUPERVISED DYNAMIC TOPIC MODEL FOR EXTRACTING ADVERSE DRUG REACTION FROM HEALTH FORUMS , Applied Computer Science: Vol. 16 No. 1 (2020)
- Manikandan SRIDHARAN, Delphin Carolina RANI ARULANANDAM, Rajeswari K CHINNASAMY, Suma THIMMANNA, Sivabalaselvamani DHANDAPANI, RECOGNITION OF FONT AND TAMIL LETTER IN IMAGES USING DEEP LEARNING , Applied Computer Science: Vol. 17 No. 2 (2021)
- Boutkhil SIDAOUI, PREDICTING STATES OF EPILEPSY PATIENTS USING DEEP LEARNING MODELS , Applied Computer Science: Vol. 20 No. 2 (2024)
- Tomasz NOWICKI, Adam GREGOSIEWICZ, Zbigniew ŁAGODOWSKI, PRODUCTIVITY OF A LOW-BUDGET COMPUTER CLUSTER APPLIED TO OVERCOME THE N-BODY PROBLEM , Applied Computer Science: Vol. 17 No. 4 (2021)
- Benjamin KOMMEY, Ernest Ofosu ADDO, Elvis TAMAKLOE, Eric Tutu TCHAO, Henry NUNOO-MENSAH, A SIX-PORT MEASUREMENT DEVICE FOR HIGH POWER MICROWAVE VECTOR NETWORK ANALYSIS , Applied Computer Science: Vol. 18 No. 3 (2022)
- Saheed A. ADEWUYI, Segun AINA, Adeniran I. OLUWARANTI, A DEEP LEARNING MODEL FOR ELECTRICITY DEMAND FORECASTING BASED ON A TROPICAL DATA , Applied Computer Science: Vol. 16 No. 1 (2020)
- Mahmoud BAKR, Sayed ABDEL-GABER, Mona NASR, Maryam HAZMAN, TOMATO DISEASE DETECTION MODEL BASED ON DENSENET AND TRANSFER LEARNING , Applied Computer Science: Vol. 18 No. 2 (2022)
- Saheed ADEWUYI, Segun AINA, Aderonke LAWAL, Adeniran OLUWARANTI, Moses UZUNUIGBE, AN OVERVIEW OF DEEP LEARNING TECHNIQUES FOR SHORT-TERM ELECTRICITY LOAD FORECASTING , Applied Computer Science: Vol. 15 No. 4 (2019)
You may also start an advanced similarity search for this article.
