СROSS PLATFORM TOOLS FOR MODELING AND RECOGNITION OF THE FINGERSPELLING ALPHABET OF GESTURE LANGUAGE

Serhii Kondratiuk; Iurii Krak; Waldemar Wójcik

doi:10.5604/01.3001.0013.2542

Open full text

pdf

Published: Jun 21, 2019

DOI: https://doi.org/10.5604/01.3001.0013.2542

Issue Vol. 9 No. 2 (2019)

Articles

OPPORTUNITIES FOR THE OUT OF THE 1550 nm WINDOW TRANSMISSION
Jarosław Piotr Turkiewicz

4-7
TOWARDS A DIFFERENT WORLD – ON THE POTENTIAL OF THE INTERNET OF EVERYTHING
Mirosław Płaza, Radosław Belka, Zbigniew Szcześniak

8-11
USE OF THERMAL IMAGING IN CONSTRUCTION
Danuta Proszak-Miąsik

12-15
THE CONSTRUCTION OF THE FEATURE VECTOR IN THE DIAGNOSIS OF SARCOIDOSIS BASED ON THE FRACTAL ANALYSIS OF CT CHEST IMAGES
Zbigniew Omiotek, Paweł Prokop

16-23
СROSS PLATFORM TOOLS FOR MODELING AND RECOGNITION OF THE FINGERSPELLING ALPHABET OF GESTURE LANGUAGE
Serhii Kondratiuk, Iurii Krak, Waldemar Wójcik

24-27
RESEARCH OF PARAMETERS OF FIBER-OPTICAL MEASURING SYSTEMS
Waldemar Wójcik, Aliya Kalizhanova, Gulzhan Kashaganova, Ainur Kozbakova, Zhalau Aitkulov, Zhassulan Orazbekov

28-31
DETERMINATION OF THE PROBABILITY FACTOR OF PARTICLES MOVEMENT IN A GAS-DISPERSED TURBULENT FLOW
Saltanat Adikanova, Waldemar Wójcik, Natalya Denissova, Yerzhan Malgazhdarov, Ainagul Kadyrova

32-35
DEVELOPMENT OF WIND ENERGY COMPLEX AUTOMATION SYSTEM
Kuanysh Mussilimov, Akhmet Ibraev, Waldemar Wójcik

36-40
PULVERIZED COAL COMBUSTION ADVANCED CONTROL TECHNIQUES
Konrad Gromaszek

41-45
THE PROSPECTS FOR THE USE OF INTELLIGENT SYSTEMS IN THE PROCESSES OF GRAVITATIONAL ENRICHMENT
Batyrbek Aitbaevich Suleimenov, Yelena Kulakova

46-49
MODELING OF PROCESSES IN CRUDE OIL TREATED WITH LOW-FREQUENCY SOUNDS
Yelena Blinayeva, Saule Smailova

50-53
INFORMATION TECHNOLOGIES FOR THE ANALYSIS OF THE STRUCTURAL CHANGES IN THE PROCESS OF IDIOPATHIC MACULAR RUPTURE DIAGNOSTICS
Sergii Pavlov, Yosyp Saldan, Dina Vovkotrub-Lyahovska, Yuliia Saldan, Valentina Vassilenko, Yuliia Yakusheva

54-59
GENERATORS OF ONE-TIME TWO-FACTOR AUTHENTICATION PASSWORDS
Olga Ussatova, Saule Nyssanbayeva

60-63
MATHEMATICAL MODELING OF THE PROCESS OF DRAWING AN OPTICAL FIBER USING THE LANGEVIN EQUATION
Aliya Tergeussizova

64-67
MODERN MANAGEMENT OF NATIONAL COMPETITIVENESS
Nataliia Savina, Olha Romanko, Sergii Pavlov, Volodymyr Lytvynenko

68-71
APPLICATION OF HYDRAULIC AUTOMATION EQUIPMENT FOR THE EFFICIENCY ENHANCEMENT OF THE OPERATION ELEMENTS OF THE MOBILE MACHINERY
Leonid Polishchuk, Leonid Kozlov, Yuri Burennikov, Vasil Strutinskiy, Valerii Kravchuk

72-78

DOI

https://doi.org/10.5604/01.3001.0013.2542

Authors

Serhii Kondratiuk

kondratiuk@univ.net.ua

Taras Shevchenko National University of Kyiv, Ukraine

http://orcid.org/0000-0002-5048-2576

Iurii Krak

krak@univ.kiev.ua

1Taras Shevchenko National University of Kyiv, 2Glushkov Institute of Cybernetics of NAS of Ukraine, Ukraine

http://orcid.org/0000-0002-8043-0785

Waldemar Wójcik

waldemar.wojcik@pollub.pl

Lublin Univeristy of Technology, Institute of Electronics and Computer Science, Poland

http://orcid.org/0000-0002-0843-8053

Abstract

A solution for the problems of the finger spelling alphabet of gesture language modelling and recognition based on cross-platform technologies is proposed. Modelling and recognition performance can be flexible and adjusted, based on the hardware it operates or based on the availability of an internet connection. The proposed approach tunes the complexity of the 3D hand model based on the CPU type, amount of available memory and internet connection speed. Sign recognition is also performed using cross-platform technologies and the tradeoff in model size and performance can be adjusted. the methods of convolutional neural networks are used as tools for gestures of alphabet recognition. For the gesture recognition experiment, a dataset of 50,000 images was collected, with 50 different hands recorded, with almost 1,000 images per each person. The experimental researches demonstrated the effectiveness of proposed approaches.

Keywords:

cross platform, sign language, fingerspelling alphabet, 3D modeling, Convolutional Neural Networks

References

Apple Touchless Gesture System for iDevices http://www.patentlyapple.com/patently-apple/2014/12/apple-invents-a-highly-advanced-air-gesturing-system-for-future-idevices-and-beyond.html (available 15.05.2019).

ASL Sign language dictionary http://www.signasl.org/sign/model (available 15.05.2019).

Howard A.G., Wang W.: MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications https://arxiv.org/pdf/1704.04861.pdf (available 15.05.2019).

Khan R.Z., Ibraheem N.A., Meghanathan N., et al.: Comparative study of hand gesture recognition system. SIPM, FCST, ITCA, WSE, ACSIT, CS & IT 06/2012, 203–213.

Krak I., Kondratiuk S.: Cross-platform software for the development of sign communication system: Dactyl language modelling, Proceedings of the 12th International Scientific and Technical Conference on Computer Sciences and Information Technologies, CSIT 1/2017, 167–170 [DOI: 10.1109/STC-CSIT.2017.8098760].

Krizhevsky I. Sutskever, Hinton G.E.: Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems 2012, 1097–1105.

Kryvonos I.G., Krak I.V., Barchukova Y., Trotsenko B.A.: Human hand motion parametrization for dactylemes modeling. Journal of Automation and Information Sciences 43(12)/2011, 1–11.

Kryvonos I.G., Krak I.V., Barmak O.V., Shkilniuk D.V.: Construction and identification of elements of sign communication. Cybernetics and Systems Analysis 49(2)/2013, 163–172.

Kryvonos I.G., Krak I.V.: Modeling human hand movements, facial expressions, and articulation to synthesize and visualize gesture information. Cybernetics and Systems Analysis 47(4)/2011, 501–505.

Mell P., Grance T.: The NIST Definition of Cloud Computing (Technical report). National Institute of Standards and Technology: U.S. Department of Commerce, 2011 [DOI:10.6028/NIST.SP.800-145].

Neff M., Kipp M., Albrecht I., Seidel H.P.: Gesture Modeling and Animation by Imitation. MPI–I 4/2006.

Ong E.I., et al. : Sign language recognition using sequential pattern trees. Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on. IEEE, 2012, 2200–2207.

Raheja J.: Android based portable hand sign recognition system. 2015 [DOI: 10.15579/gcsr.vol3.ch1].

Shapiro A., Chu D., Allen B., Faloutsos P.: Dynamic Controller Toolkit, 2005 http://www.arishapiro.com/Sandbox07_DynamicToolkit.pdf (available 15.05.2019).

Smith J., Navi R.: The Architecture of Virtual Machines. Computer. IEEE Computer Society 38(5)/2005, 32–38.

Tensorflow framework documentation https://www.tensorflow.org/api/ (available 15.05.2019).

The Linux Information Project, Cross-platform Definition.

Unity3D framework https://unity3d.com/ (available 15.05.2019).

YAML – The Official YAML Web Site http://yaml.org/ (available 15.05.2019).

Kondratiuk, S., Krak, I., & Wójcik, W. (2019). СROSS PLATFORM TOOLS FOR MODELING AND RECOGNITION OF THE FINGERSPELLING ALPHABET OF GESTURE LANGUAGE. Informatyka, Automatyka, Pomiary W Gospodarce I Ochronie Środowiska, 9(2), 24–27. https://doi.org/10.5604/01.3001.0013.2542

СROSS PLATFORM TOOLS FOR MODELING AND RECOGNITION OF THE FINGERSPELLING ALPHABET OF GESTURE LANGUAGE

Issue Vol. 9 No. 2 (2019)

Archives

DOI

Authors

Abstract

Keywords:

References

License

Article Sidebar

Issue Vol. 9 No. 2 (2019)

Archives

Main Article Content

DOI

Authors

Abstract

Keywords:

References

Article Details

License