HAND MOVEMENT DISORDERS TRACKING BY SMARTPHONE BASED ON COMPUTER VISION METHODS
Article Sidebar
Open full text
Issue Vol. 14 No. 2 (2024)
-
HAND MOVEMENT DISORDERS TRACKING BY SMARTPHONE BASED ON COMPUTER VISION METHODS
Marko Andrushchenko, Karina Selivanova, Oleg Avrunin, Dmytro Palii, Sergii Tymchyk , Dana Turlykozhayeva5-10
-
MEANS OF ANALYZING PARAMETERS OF SPEECH SIGNAL TRANSMISSION AND REPRODUCTION
Olexiy Azarov, Larysa Azarova, Iurii Krak, Leonid Krupelnitskyi, Anzhelika Azarova, Veronika Azarova11-16
-
CONCEPT AND VALIDATION OF A SYSTEM FOR RECORDING VIBROACOUSTIC SIGNALS OF THE KNEE JOINT
Robert Karpiński, Anna Machrowska, Marcin Maciejewski, Józef Jonak, Przemysław Krakowski17-21
-
A COYOTE-INSPIRED APPROACH FOR SYSTEMIC LUPUS ERYTHEMATOSUS PREDICTION USING NEURAL NETWORKS
Sobhana Mummaneni, Pragathi Dodda, Naga Deepika Ginjupalli22-27
-
CHANGE OF FREQUENCY CHARACTERISTICS OF A FILTER USING A REACTOR WITH SMOOTHLY ADJUSTABLE INDUCTANCE
Vasyl Hudym, Vira Kosovska, Huthaifa Al_Issa, Taras Shchur, Oleksandr Miroshnyk, Sławomir Ziarkowski28-33
-
STUDY OF STARTING MODES OF SINGLE-PHASE INDUCTION MOTORS WHEN CHANGING THE PARAMETERS OF THE STATOR WINDINGS, PHASE-SHIFTING CAPACITOR AND SUPPLY VOLTAGE
Suad Omar Aldaikh, Mohannad O. Rawashdeh, Lina H. Hussienat, Mohamed Qawaqzeh, Oleksiy Iegorov, Olga Iegorova, Mykola Kundenko, Dmytro Danylchenko, Oleksandr Miroshnyk, Taras Shchur34-41
-
EVALUATION OF THE ENERGY CHARACTERISTICS OF THE INFRARED DRYING PROCESS OF RAPESEED AND SOYBEANS WITH A VIBRATING WAVE DRIVER
Igor Palamarchuk, Vladyslav Palamarchuk, Marija Zheplinska42-46
-
JUSTIFICATION OF THE POSSIBILITY OF BUILDING AN INTEGRATED ULTRASONIC MEASURING TRANSDUCER OF NATURAL GAS CONSUMPTION
Yosyp Bilynsky, Аndrii Stetsenko, Konstantin Ogorodnik47-50
-
NUMERICAL STUDY OF THE POSSIBILITY OF USING ADHESIVE JOINTS FOR INDIRECT MEASUREMENTS FOR STRESS DISTRIBUTION
Piotr Kisała, Paweł Wiśniewski51-55
-
A MODIFIED METHOD OF SPECTRAL ANALYSIS OF RADIO SIGNALS USING THE OPERATOR APPROACH FOR THE FOURIER TRANSFORM
Valentyn Sobchuk, Serhii Laptiev, Tetiana Laptievа, Oleg Barabash, Oleksandr Drobyk, Andrii Sobchuk56-61
-
ITERATIVE DECODING OF SHORT LOW-DENSITY PARITY-CHECK CODES BASED ON DIFFERENTIAL EVOLUTION
Mykola Shtompel, Sergii Prykhodko62-65
-
A REVIEW OF GENERATIVE ADVERSARIAL NETWORKS FOR SECURITY APPLICATIONS
Swarajya Madhuri Rayavarapu, Shanmukha Prasanthi Tammineni, Sasibhushana Rao Gottapu, Aruna Singam66-70
-
IoT FOR PREDICTIVE MAINTENANCE OF CRITICAL MEDICAL EQUIPMENT IN A HOSPITAL STRUCTURE
Maroua Guissi, My Hachem El Yousfi Alaoui, Larbi Belarbi, Asma Chaik71-76
-
APPLICATION OF RESNET-152 NEURAL NETWORKS TO ANALYZE IMAGES FROM UAV FOR FIRE DETECTION
Nataliia Stelmakh, Svitlana Mandrovska, Roman Galagan77-82
-
IDENTIFICATION OF SALT-AFFECTED SOILS IN THE COASTAL AREA OF KRISHNA DISTRICT, ANDHRA PRADESH, USING REMOTE SENSING DATA AND MACHINE LEARNING TECHNIQUES
Govada Anuradha, Venkata Sai Sankara Vineeth Chivukula, Naga Ganesh Kothangundla83-88
-
PERFORMANCE EVALUATION FOR FACE MASK DETECTION BASED ON MULT MODIFICATION OF YOLOV8 ARCHITECTURE
Muna AL-Shamdeen, Fawziya Mahmood Ramo89-95
-
EVALUATION OF ENGINEERING SOLUTIONS IN THE DEVELOPMENT OF THE PROCUREMENT SECTION FOR THE METAL CONSTRUCTION WORKSHOP
Bogdan Palchevskyi, Lubov Krestyanpol96-100
-
EVALUATING THE PERFORMANCE OF BITCOIN PRICE FORECASTING USING MACHINE LEARNING TECHNIQUES ON HISTORICAL DATA
Mamun Ahmed, Sayma Alam Suha, Fahamida Hossain Mahi, Forhad Uddin Ahmed101-108
-
METHODS OF INTELLIGENT DATA ANALYSIS USING NEURAL NETWORKS IN DIAGNOSIS
Volodymyr Lyfar, Olena Lyfar, Volodymyr Zynchenko109-112
-
IMPROVING PARAMETERS OF V-SUPPORT VECTOR REGRESSION WITH FEATURE SELECTION IN PARALLEL BY USING QUASI-OPPOSITIONAL AND HARRIS HAWKS OPTIMIZATION ALGORITHM
Omar Mohammed Ismael, Omar Saber Qasim, Zakariya Yahya Algamal113-118
-
AN ADAPTIVE DIFFERENTIAL EVOLUTION ALGORITHM WITH A BOUND ADJUSTMENT STRATEGY FOR SOLVING NONLINEAR PARAMETER IDENTIFICATION PROBLEMS
Watchara Wongsa, Pikul Puphasuk, Jeerayut Wetweerapong119-126
-
MODELING THE CHOICE OF AN ONLINE COURSE FOR INFORMATION HYGIENE SKILLS USING THE SAATY METHOD
Yuliia Rudenko, Karen Ahadzhanov-Honsales, Svitlana Ahadzhanova, Alla Batalova, Olena Bieliaieva, Artem Yurchenko, Olena Semenikhina127-132
-
REVIEW OF THE ACHIEVEMENTS OF EMPLOYEES OF THE LUBLIN UNIVERSITY OF TECHNOLOGY IN THE FIELD OF FUZZY SET UTILIZATION
Maciej Celiński, Adam Kiersztyn133-140
-
MODELING ROBOTECHNICAL MECHATRONIC COMPLEXES IN V-REP PROGRAM
Laura Yesmakhanova141-148
Archives
-
Vol. 15 No. 3
2025-09-30 24
-
Vol. 15 No. 2
2025-06-27 24
-
Vol. 15 No. 1
2025-03-31 26
-
Vol. 14 No. 4
2024-12-21 25
-
Vol. 14 No. 3
2024-09-30 24
-
Vol. 14 No. 2
2024-06-30 24
-
Vol. 14 No. 1
2024-03-31 23
-
Vol. 13 No. 4
2023-12-20 24
-
Vol. 13 No. 3
2023-09-30 25
-
Vol. 13 No. 2
2023-06-30 14
-
Vol. 13 No. 1
2023-03-31 12
-
Vol. 12 No. 4
2022-12-30 16
-
Vol. 12 No. 3
2022-09-30 15
-
Vol. 12 No. 2
2022-06-30 16
-
Vol. 12 No. 1
2022-03-31 9
-
Vol. 10 No. 4
2020-12-20 16
-
Vol. 10 No. 3
2020-09-30 22
-
Vol. 10 No. 2
2020-06-30 16
-
Vol. 10 No. 1
2020-03-30 19
Main Article Content
DOI
Authors
Abstract
This article describes the development of a cost-effective, efficient, and accessible solution for diagnosing hand movement disorders using smartphone-based computer vision technologies. It highlights the idea of using ToF camera data combined with RG data and machine learning algorithms to accurately recognize limbs and movements, which overcomes the limitations of traditional motion recognition methods, improving rehabilitation and reducing the high cost of professional medical equipment. Using the ubiquity of smartphones and advanced computational methods, the study offers a new approach to improving the quality and accessibility of diagnosis of movement disorders, offering a promising direction for future research and application in clinical practice.
Keywords:
References
Apple Machine Learning Research (n.d.). Deploying Transformers on the Apple Neural Engine [https://machinelearning.apple.com/research/neural-engine-transformers].
Apple Inc. (n.d.). Streaming Depth Data from the TrueDepth Camera. Apple Developer Documentation [https://developer.apple.com/documentation/avfoundation/additional_data_capture/streaming_depth_data_from_the_truedepth_camera].
Apple Developer Documentation. Streaming Depth Data from the TrueDepth Camera | Apple Developer Documentation [https://developer.apple.com/documentation/avfoundation/additional_data_capture/streaming_depth_data_from_the_truedepth_camera,2023] (accessed 3 Dec. 2023).
Assimp.org. The Asset-Importer Library Home [https://www.assimp.org] (accessed 3 Dec. 2023).
Avrunin O. G. et al.: Research Active Posterior Rhinomanometry Tomography Method for Nasal Breathing Determining Violations. Sensors 21, 2021, 8508. DOI: https://doi.org/10.3390/s21248508
Avrunin O. et al.: Improving the methods for visualization of middle ear pathologies based on telemedicine services in remote treatment. IEEE KhPI Week on Advanced Technology, KhPI Week, 2020, 347–350. DOI: https://doi.org/10.1109/KhPIWeek51551.2020.9250090
GitHub [https://github.com/googlesamples/mediapipe/tree/main/examples/hand_landmarker/ios] (accessed 19 Feb. 2024).
Google for Developers. Hand landmarks detection guide [https://developers.google.com/mediapipe/solutions/vision/hand _landmarker#model] (accessed 19 Feb. 2024).
Gupta S., White M.: Improved On-Device ML on Pixel 6, with Neural Architecture Search. Google Research Blog [https://blog.research.google/2021/11/improved-on-device-ml-on-pixel-6-with.html] (accessed 8 Nov. 2021).
Kim B., Neville Ch.: Accuracy and Feasibility of a Novel Fine Hand Motor Skill Assessment Using Computer Vision Object Tracking. Scientific Reports 13(1), 2023, 1–14 [https://doi.org/10.1038/s41598-023-29091-0]. DOI: https://doi.org/10.1038/s41598-023-29091-0
Lin T.-Y. et al.: Feature Pyramid Networks for Object Detection [https://arxiv.org/pdf/1612.03144.pdf].
Liu W. et al.: SSD: Single Shot MultiBox Detector [https://arxiv.org/pdf/1512.02325.pdf].
Liang M. et al.: Deep Continuous Fusion for Multi-Sensor 3D Object Detection. 2020 [https://arxiv.org/abs/2012.10992] (accessed 19 Feb. 2024).
Liang M. et al.: Multi-Task Multi-Sensor Fusion for 3D Object Detection [https://openaccess.thecvf.com/content_CVPR_2019/papers/Liang_MultiTask_MultiSensor_Fusion_for_3D_Object_Detection_CVPR_2019_paper.pdf].
Muhammad B. S., Chai D.: RGB-D Data-Based Action Recognition: A Review. Sensors 21(12), 2021, 4246–4246 [https://doi.org/10.3390/s21124246]. DOI: https://doi.org/10.3390/s21124246
On-Device, Real-Time Hand Tracking with MediaPipe [https://blog.research.google/2019/08/on-device-real-time-hand-tracking-with.html] (accessed 19 Feb. 2024).
Romanyuk O. et al.: A function-based approach to real-time visualization using graphics processing units. Proc. SPIE 11581, 2020, 115810E [https://doi.org/10.1117/12.2580212].
Selivanova K. Avrunin O.: Method of Hand Movement Disorders Determination based on the Surgeon's Laparoscopic Video Recording. 3rd KhPI Week on Advanced Technology – KhPIWeek, 2022, 1–4 [https://doi.org/10.1109/KhPIWeek57572.2022.9916457]. DOI: https://doi.org/10.1109/KhPIWeek57572.2022.9916457
Selivanova K. et al.: The tracking system of a three-dimensional position of hand movement for tremor detection. Proc. SPIE 11581, 2020, 115810I [https://doi.org/10.1117/12.2580330].
Sokol Y. et al.: Using medical imaging in disaster medicine. IEEE 4th International Conference on Intelligent Energy and Power Systems, IEPS 2020, 2020, 287–290. DOI: https://doi.org/10.1109/IEPS51250.2020.9263175
Taeger J. et al.: Utilization of Smartphone Depth Mapping Cameras for App-Based Grading of Facial Movement Disorders: Development and Feasibility Study. JMIR mHealth and uHealth 9(1), 2021, e19346 [https://doi.org/10.2196/19346]. DOI: https://doi.org/10.2196/19346
Turlykozhayeva D. et al.: Routing Algorithm for Software Defined Network Based on Boxcovering Algorithm. 10th International Conference on Wireless Networks and Mobile Communications – WINCOM, 2023. DOI: https://doi.org/10.1109/WINCOM59760.2023.10322960
Tymkovych M. et al.: 3D scanning technologies by optical RealSense cameras for SIREN-based 3D hand representation. Proc. SPIE 12985, 2023, 129850O [https://doi.org/10.1117/12.3022737]. DOI: https://doi.org/10.1117/12.3022737
Urban S. et al.: On the Issues of TrueDepth Sensor Data for Computer Vision Tasks Across Different IPad Generations. 2022 [https://arxiv.org/abs/2201.10865] (accessed 26 Nov. 2023).
WójcikW. et al.: Information Technology in Medical Diagnostics II. Taylor & Francis Group. CRC Press, Balkema Book. London, 2019.
Wójcik W. et al.: Information Technology in Medical Diagnostics. CRC Press, 2017. DOI: https://doi.org/10.1201/9781315098050
Zhang F. et al.: MediaPipe Hands: On-device Real-time Hand Tracking. 2006 [https://arxiv.org/abs/2006.10214].
Article Details
Abstract views: 763

