STUDY OF HAND GESTURE RECOGNITION AND CLASSIFICATION

Authors

  • Srinivas K School of Electronics Engineering, VIT University, Chennai-600127, Tamil
  • Manoj Kumar Rajagopal School of Electronics Engineering, VIT University, Chennai-600127, Tamil

DOI:

https://doi.org/10.22159/ajpcr.2017.v10s1.19540

Keywords:

Human-computer interaction, Hand gestures, Gesture recognition system, Static and dynamic hand gesture

Abstract

To recognize different hand gestures and achieve efficient classification to understand static and dynamic hand movements used for communications.
Static and dynamic hand movements are first captured using gesture recognition devices including Kinect device, hand movement sensors, connecting electrodes, and accelerometers. These gestures are processed using hand gesture recognition algorithms such as multivariate fuzzy decision tree, hidden Markov models (HMM), dynamic time warping framework, latent regression forest, support vector machine, and surface electromyogram. Hand movements made by both single and double hands are captured by gesture capture devices with proper illumination conditions. These captured gestures are processed for occlusions and fingers close interactions for identification of right gesture and to classify the gesture and ignore the intermittent gestures. Real-time hand gestures recognition needs robust algorithms like HMM to detect only the intended gesture. Classified gestures are then compared for the effectiveness with training and tested standard datasets like sign language alphabets and KTH datasets. Hand gesture recognition plays a very important role in some of the applications such as sign language recognition, robotics, television control, rehabilitation, and music orchestration.

Downloads

Download data is not yet available.

References

Yao Y, Fu Y. Contour model-based hand-gesture recognition using the Kinect sensor. IEEE Trans Circuits Syst Video Technol

;24(11):1935-44.

Yang S, Premaratne P, Vial P. Hand Gesture Recognition: An Overview. Proceedings of IEEE IC-BNMT; 2013. 3. Çağrıkılıboz N, Güdükbay U. A hand gesture recognition technique for human-computer interaction. J Vis Commun Image Represent

;28:97-104.

Khan RZ, Ibraheem NA. Hand gesture recognition: A literature review. Int J Artif Intell Appl IJAIA 2012;3(4):161-74.

Badi H, Hussein SH, Kareem SA. Feature extraction and ML techniques for static gesture recognition. Neural Comput Appl

;25(3-4):733-41.

Tashev I. Kinect Development Kit: A Toolkit for Gesture and Speech-Based Human-Machine Interaction. IEEE Signal Processing

Magazine. University of Washington, September; 2013.

Bhattacharya S, Czejdo B, Perez N. Gesture Classification with Machine Learning using Kinect Sensor Data. Third International Conference on Emerging Applications of Information Technology (EAIT). Fayetteville State University. 2012.

Ibañez R, Soria A, Teyseyre A, Campo M. Easy gesture recognition for Kinect. Adv Eng Softw 2014;76:171-80.

Chen C, Jafari R, Kehtarnavaz N, Liu K. Fusion of Inertial and Depth Sensor Data for Robust Hand Gesture Recognition. Vol. 14. No. 6. IEEE Sensors Journal. University of Texas at Dallas, June. 2014.

Berman S, Stern H. Sensors for gesture recognition systems. IEEE transactions on systems, man, and cybernetics-part C. Appl Rev

;42(3):277-90.

Cetin A, Erden F. Hand gesture based remote control system using infrared sensors and a camera. IEEE Transactions on Consumer

Electronics. Vol. 60. No. 4. Ankara, Turkey: Hacettepe University (Beytepe campus), November; 2014.

Kurita K. Noncontact hand motion classification technique for application to human-machine interfaces. IEEE Transactions on

Industry Applications. Vol. 50. No. 3. Japan: Kinki University, May/ June; 2014.

Ouyang G, Wilamowska-Korsak M, Liu H, Ju Z. Surface EMG based hand manipulation identification via nonlinear feature extraction and classification. IEEE Sensors Journal. Vol. 13. No. 9. Portsmouth: University of Portsmouth, September; 2013.

Li Y, Lantz V, Wang K, Yang J, Zhang X, Chen X. A framework for hand gesture recognition based on accelerometer and EMG sensors. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems

And Humans. Vol. 41. No. 6. November; 2011.

Bien Z, Jeon MJ, Lee SW. User adaptive hand gesture recognition using multivariate fuzzy decision tree and fuzzy garbage model. Int J Fuzzy Syst Appl 2011;1(3):15-31.

Richarz J, Fink GA. Visual recognition of 3D emblematic gestures in an HMM framework. J Ambient Intell Smart Environ 2011;3(3):193-211.

Jung CR, Miranda ER, Schramm R. Dynamic Time Warping for Music Conducting Gestures Evaluation. IEEE Transactions on Multimedia.Vol. 17. No. 2. Porto Alegre, Brazil: University of Federal do Rio Grande do Sul, February; 2015.

Chang HJ, Tejani A, Kim TK, Tang D. Latent regression forest: Structured estimation of 3D articulated hand posture. IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Columbus, OH,London: Imperial College; 2014.

Stern H, Shmueli M, Berman S. Most discriminating segment - Longest common subsequence (MDSLCS) algorithm for dynamic hand gesture classification. Pattern Recognit Lett 2013;34(15):1980-89.

Glette K, Gruber T, Platzner M, Kaufmann P. Classification of electromyographic signals: Comparing evolvable hardware to conventional classifiers. IEEE Transactions on Evolutionary Computation. Vol. 17. No. 1. Paderborn: University of Paderborn,

February; 2013.

Naik GR, Kumar DK, Jayadeva. Twin SVM for gesture classification using the surface electromyogram. Inf Technol Biomed IEEE Trans 2010;14(2):301-8.

Micera S, Carpaneto J, Raspopovic S. Control of hand prostheses using peripheral information. Biomed Eng IEEE Rev 2010;3:48-68.

Kalsh EA, Garewal NS. Sign language recognition system. Int J Comput Eng Res 2013;3(6):15-21.

Published

01-04-2017

How to Cite

K, S., and M. K. Rajagopal. “STUDY OF HAND GESTURE RECOGNITION AND CLASSIFICATION”. Asian Journal of Pharmaceutical and Clinical Research, vol. 10, no. 13, Apr. 2017, pp. 25-30, doi:10.22159/ajpcr.2017.v10s1.19540.

Issue

Section

Original Article(s)