<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">ENG</journal-id><journal-title-group><journal-title>Engineering</journal-title></journal-title-group><issn pub-type="epub">1947-3931</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/eng.2014.611068</article-id><article-id pub-id-type="publisher-id">ENG-50907</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Engineering</subject></subj-group></article-categories><title-group><article-title>
 
 
  Static Digits Recognition Using Rotational Signatures and Hu Moments with a Multilayer Perceptron
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>rancisco</surname><given-names>Solís</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Margarita</surname><given-names>Hernández</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Amelia</surname><given-names>Pérez</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Carina</surname><given-names>Toxqui</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib></contrib-group><aff id="aff2"><addr-line>Polytechnic University of Tulancingo, Tulancingo, Mexico</addr-line></aff><aff id="aff1"><addr-line>Autonomous University of Mexico State, Toluca, Mexico</addr-line></aff><author-notes><corresp id="cor1">* E-mail:<email>jfsolisv@uaemex.mx(RS)</email>;<email>jfsolisv@uaemex.mx(MH)</email>;<email>jfsolisv@uaemex.mx(AP)</email>;<email>jfsolisv@uaemex.mx(CT)</email>;</corresp></author-notes><pub-date pub-type="epub"><day>07</day><month>10</month><year>2014</year></pub-date><volume>06</volume><issue>11</issue><fpage>692</fpage><lpage>698</lpage><history><date date-type="received"><day>18</day>	<month>August</month>	<year>2014</year></date><date date-type="rev-recd"><day>10</day>	<month>September</month>	<year>2014</year>	</date><date date-type="accepted"><day>22</day>	<month>September</month>	<year>2014</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  This paper presents two systems for recognizing static signs (digits) from American Sign Language (ASL). These systems avoid the use color marks, or gloves, using instead, low-pass and high-pass filters in space and frequency domains, and color space transformations. First system used rotational signatures based on a correlation operator; minimum distance was used for the classification task. Second system computed the seven Hu invariants from binary images; these descriptors fed to a Multi-Layer Perceptron (MLP) in order to recognize the 9 different classes. First system achieves 100% of recognition rate with leaving-one-out validation and second experiment performs 96.7% of recognition rate with Hu moments and 100% using 36 normalized moments and k-fold cross validation.
 
</p></abstract><kwd-group><kwd>Sign Language Recognition</kwd><kwd> Rotational Signatures</kwd><kwd> Hu Moments</kwd><kwd> Multi-Layer Perceptron</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>Sign Language is the basic way for communication of deaf community, and consists of a set of signs represented by different static hand shapes (dynamic in some cases) [<xref ref-type="bibr" rid="scirp.50907-ref1">1</xref>] . Sign Language is not universal; there are several alphabets such as American Sign Language (ASL), Taiwan Sign Language (TSL), Mexican Sign Language (MSL), German Sign Language (GSL), Persian Sign Language (PSL) and so on. Sign Languages change due to different customs and cultures that characterize each region or country.</p><p>The whole set of movements that people make in order to express some idea in Sign Language, generally includes facial gestures, corporal postures, arms and hand expressions, among others [<xref ref-type="bibr" rid="scirp.50907-ref2">2</xref>] ; this is why Sign Language Recognition is too complex. This leads most of the works to limit the problem with some predefined conditions.</p><p>Several papers focus on static hand gestures which contain mainly information about static alphabet signs of a certain Sign Language [<xref ref-type="bibr" rid="scirp.50907-ref3">3</xref>] -[<xref ref-type="bibr" rid="scirp.50907-ref5">5</xref>] , reporting from 92% to 98% of recognition rate approximately. Working only with this data, the dimension of the problem is reduced; nevertheless, due to the freedom degrees of human hand, recognizing static signs of any language is a complex task.</p><p>In Sign Language, a lot of research work has been done over last decades. In general terms, Sign Language Recognition could be classified in two main categories: those using computer vision systems and those using electronic sensors attached to the fingers, hands or articulations [<xref ref-type="bibr" rid="scirp.50907-ref6">6</xref>] . First ones allow expressing signs in a more natural way because signer doesn’t need to be physically connected to the system by wires, batteries or some other hardware, nevertheless with this systems, signs are much complex to analyze because it’s hard to get accurate data of fingers, like position, orientation and so on, from 2D images. In the other hand, electronic systems that use motion sensors or similar hardware can generate precise data of hand gesture with or without CCD’s or digital cameras, but these systems do not allow signers to express themselves freely, because hands and fingers are connected to some hardware.</p></sec><sec id="s2"><title>2. Databases</title><p>In order to see some visual dynamics of rotational-correlation signatures of static signs, for this work was selected a set of 9 digit signs of American Sign Language (ASL). Five signs (1 - 5) face the dorsum to the digital camera, the remaining four (6 - 9) face the palm to the sensor.</p><p>These datasets don’t use electronic hardware attached to the hand or fingers, neither special color markers nor gloves, in order to analyze a more natural way of the signs. Signs were captured by EOS 1100D digital Canon camera with CMOS sensor.</p><p><xref ref-type="fig" rid="fig1">Figure 1</xref> shows a complete version of the 9 static signs, this dataset was named “Database01” and was used to analyze the rotational-correlation signatures, in order to see if this technique can represent the extended fingers. Database01 has 5 versions per sign or digit; files have 2848 width with 4272 height pixels of image size, each pixel has 24 bits of depth. The images of this database were stored in the RGB space color.</p><p><xref ref-type="fig" rid="fig2">Figure 2</xref> shows pictures from dataset named “Database02”, which has 3 versions per sign. The images displayed were cropped from the original ones, in order to get a better look of the gestures.</p><p>Database02 is used to perform the 2<sup>nd</sup> experiment by using Hu moments, original images were of 1280 height with 720 width pixels; color is represented by RGB channels.</p></sec><sec id="s3"><title>3. Rotational-Correlation Operator with Minimum Distance</title><p>Correlation can be expressed as</p><disp-formula id="scirp.50907-formula1847"><label>, (1)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-8102141x6.png"  xlink:type="simple"/></disp-formula><p>this operator can be used to generate a rotational-correlation signature [<xref ref-type="bibr" rid="scirp.50907-ref7">7</xref>] when h is a rotated version of f which contains a binary object. Function g could be represented by a single scalar via the maximum correlation value, if f rotates 360 times with θ = 1, 2, 3, ∙∙∙, 360˚ then f could be characterized by a set of 360 maximum correlation values, normalizing these data it’s obtained a rotational-correlation signature.</p><p>As shown in <xref ref-type="fig" rid="fig3">Figure 3</xref>, binary objects can be described by rotational signatures. This technique has some valuable interesting properties for this particular problem. Rotational-correlation signatures are scale and rotation invariants besides don’t require a continuous border along the hand shape perimeter.</p><p>The scheme of first system is shown in <xref ref-type="fig" rid="fig4">Figure 4</xref> where it can be watched original image of digit 3 version 1 at the beginning, then original RGB image is transformed into HSI space color and Saturation channel was experimentally selected to achieve the best segmented image, this last image is binarized and finally the rotational- correlation signature is calculated with 360 values.</p><fig-group id="fig1"><label><xref ref-type="fig" rid="fig1">Figure 1</xref></label><caption><title> “Database01”.</title></caption><fig id ="fig1_1"><label></label><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/4-8102141x7.png"/></fig></fig-group><fig-group id="fig2"><label><xref ref-type="fig" rid="fig2">Figure 2</xref></label><caption><title> “Database02”.</title></caption><fig id ="fig2_1"><label></label><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/4-8102141x8.png"/></fig></fig-group><fig-group id="fig3"><label><xref ref-type="fig" rid="fig3">Figure 3</xref></label><caption><title> Rotational-correlation signature.</title></caption><fig id ="fig3_1"><label></label><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/4-8102141x9.png"/></fig></fig-group><fig-group id="fig4"><label><xref ref-type="fig" rid="fig4">Figure 4</xref></label><caption><title> First system framework.</title></caption><fig id ="fig4_1"><label></label><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/4-8102141x10.png"/></fig></fig-group><p><xref ref-type="fig" rid="fig5">Figure 5</xref> shows nine graphs corresponding from digit 1 to 9 respectively, signs 1 and 2 are similar and sign 5 is the most dynamic one. Using this technique with minimum distance the recognition rate achieves 100% in a leave-one-out scheme.</p></sec><sec id="s4"><title>4. Hu Moments with MLP</title><p>Invariant moments describe geometrically objects from digital images by values that tend to maintain constant despite changes in translation, rotation, scale and others. Low order moments give some geometrical information</p><fig-group id="fig5"><label><xref ref-type="fig" rid="fig5">Figure 5</xref></label><caption><title> Rotational-correlation signatures.</title></caption><fig id ="fig5_1"><label></label><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/4-8102141x11.png"/></fig></fig-group><p>about the object, such as, area, mass center or mass distribution; if moments were normalized then they could be interpreted as statistical measures such as mean or variance. Geometric moments are expressed as follows:</p><disp-formula id="scirp.50907-formula1848"><label>(2)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-8102141x12.png"  xlink:type="simple"/></disp-formula><p>Central moments are defined as</p><disp-formula id="scirp.50907-formula1849"><graphic  xlink:href="http://html.scirp.org/file/4-8102141x13.png"  xlink:type="simple"/></disp-formula><p>where</p><disp-formula id="scirp.50907-formula1850"><graphic  xlink:href="http://html.scirp.org/file/4-8102141x14.png"  xlink:type="simple"/></disp-formula><p>which are invariant to translation. Normalized moments have a scale factor, they can be expressed by central moments as</p><disp-formula id="scirp.50907-formula1851"><label>(3)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-8102141x15.png"  xlink:type="simple"/></disp-formula><p>where</p><disp-formula id="scirp.50907-formula1852"><graphic  xlink:href="http://html.scirp.org/file/4-8102141x16.png"  xlink:type="simple"/></disp-formula><p>Hu derived his seven invariant moments to rotation [<xref ref-type="bibr" rid="scirp.50907-ref8">8</xref>] and they are given as</p><disp-formula id="scirp.50907-formula1853"><graphic  xlink:href="http://html.scirp.org/file/4-8102141x17.png"  xlink:type="simple"/></disp-formula><p><xref ref-type="fig" rid="fig6">Figure 6</xref> shows the scheme of second system starting with the sign 7 version 1 original image that is cropped</p><fig-group id="fig6"><label><xref ref-type="fig" rid="fig6">Figure 6</xref></label><caption><title> Second system framework.</title></caption><fig id ="fig6_1"><label></label><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/4-8102141x18.png"/></fig></fig-group><p>and segmented in the Red channel (experimentally selected from RGB and HSI space colors), after been binarized, the sign is enhanced by Laplacian high-pass filter, then 7 Hu moments and 36 normalized moments were extracted, finally a Multilayer Perceptron performs classification in two tests, first with 7 Hu moments where system achieves 96.29% using k-fold crossvalidation supported by Weka Pattern Recognition software, second test achieving 100% of recognition rate with a Multilayer Perceptron and k-fold cross validation using 49 normalized invariants (see Equation (3)) by combining the values of p, q = 0, 1, ∙∙∙, 6.</p></sec><sec id="s5"><title>5. Conclusions</title><p>Two systems were presented for recognition of static signs (digits from one to nine) using two datasets (one per system). First system tested “Database01” with rotational-correlation signatures; this technique is a binary object descriptor and can be used for recognize some static signs, nevertheless some signatures of different classes look similar although with minimum distance the similar classes can be separated numerically achieving indeed 100% of recognition rate.</p><p>Second system used “Database02” with invariant moments’ extraction, 7 Hu moments and 49 normalized moments to achieve a performance of 96.29% and 100% of recognition rate.</p><p>One of the most challenging tasks in Sign Language Recognition is the segmentation phase that enhances the hand shape; that’s why many authors use gloves or color markers; some other works like this one use a special solid background color and there are other strong limitations about this field. For better segmentation results each database used its own preprocessing: first system changed the color space from RGB to HSI and used Saturation channel to get experimentally a solid hand shape while second system segmented the hand shape in the RGB space color by using the Red channel.</p><p>Although the two systems achieve 100% of recognition rate, invariant moments use fewer descriptors (7 or 49) than rotational-correlation signatures (360 in this case); therefore invariant moments allow cheaper computational costs.</p></sec><sec id="s6"><title>Acknowledgements</title><p>Authors would like to thank to Research Secretary and Advanced Studies (Secretar&#237;a de Investigaci&#243;n y Estudios Avanzados) of the Autonomous University of Mexico State (Universidad Aut&#243;noma del Estado de M&#233;xico) for the project with registration key 3482/2013CHT that supports this research.</p></sec><sec id="s7"><title>NOTES</title></sec></body><back><ref-list><title>References</title><ref id="scirp.50907-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Oz, C. and Leu, M. (2011) American Sign Language Word Recognition with a Sensory Glove Using Artificial Neural Networks. Engineering Applications of Artificial Intelligence, 24, 1204-1213.  
http://dx.doi.org/10.1016/j.engappai.2011.06.015</mixed-citation></ref><ref id="scirp.50907-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Elons, S., Abull, M. and Tolba, F. (2013) A Proposed PCNN Features Quality Optimization Technique for Pose-Invariant 3D Arabic Sign Language Recognition. Applied Soft Computing, 13, 1646-1660.  
http://dx.doi.org/10.1016/j.asoc.2012.11.036</mixed-citation></ref><ref id="scirp.50907-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Karami, A., Zanj, B. and Kiani, A. (2011) Persian Sign Language (PSL) Recognition Using Wavelet Transform and Neural Networks. Expert Systems with Applications, 38, 2661-2667. http://dx.doi.org/10.1016/j.eswa.2010.08.056</mixed-citation></ref><ref id="scirp.50907-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Rajam, S. and Balakrishnan, G. (2012) Recognition of Tamil Sign Language Alphabet Using Image Processing to Aid Deaf-Dumb People. Procedia Engineering, 30, 681-686. http://dx.doi.org/10.1016/j.proeng.2012.01.938</mixed-citation></ref><ref id="scirp.50907-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Munib, Q., Habeeb, M., Takruri, B. and Al-Malik, A. (2007) American Sign Language (ASL) Recognition Based on Hough Transform and Neural Networks. Expert Systems with Applications, 32, 24-37.  
http://dx.doi.org/10.1016/j.eswa.2005.11.018</mixed-citation></ref><ref id="scirp.50907-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Al-Rousan, M., Assaleh, K. and Tala’a, A. (2009) Video-Based Signer-Independent Arabic Sign Language Recognition Using Hidden Markov Models. Applied Soft Computing, 9, 990-999. http://dx.doi.org/10.1016/j.asoc.2009.01.002</mixed-citation></ref><ref id="scirp.50907-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Urcid, G., Padilla-Vivanco, A., Cornejo, A. and Baez, J. (2004) Correlation-Based Rotational Operator Signature of Planar Binary Objects. Proceedings of SPIE5558, Applications of Digital Image Processing XXVII, 2 November 2004, 87. http://dx.doi.org/10.1117/12.558744</mixed-citation></ref><ref id="scirp.50907-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Hu, M. (1962) Visual Pattern Recognition by Moment Invariants. IRE Transactions on Information Theory, IT-08, 179-187.</mixed-citation></ref></ref-list></back></article>