<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">JSIP</journal-id><journal-title-group><journal-title>Journal of Signal and Information Processing</journal-title></journal-title-group><issn pub-type="epub">2159-4465</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/jsip.2012.31007</article-id><article-id pub-id-type="publisher-id">JSIP-17647</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Computer Science&amp;Communications</subject></subj-group></article-categories><title-group><article-title>
 
 
  Illumination Invariant Face Recognition Using Fuzzy LDA and FFNN
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>ehzad</surname><given-names>Bozorgtabar</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Hamed</surname><given-names>Azami</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Farzad</surname><given-names>Noorian</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib></contrib-group><aff id="aff1"><addr-line>School of Electrical Engineering, Iran University of Science and Technology, Tehran, Iran</addr-line></aff><author-notes><corresp id="cor1">* E-mail:<email>b_bozorgtabar@elec.iust.ac.ir(EB)</email>;<email>hmdazami@gmail.com(HA)</email>;<email>fnoorian@ee.iust.ac.ir(FN)</email>;</corresp></author-notes><pub-date pub-type="epub"><day>28</day><month>02</month><year>2012</year></pub-date><volume>03</volume><issue>01</issue><fpage>45</fpage><lpage>50</lpage><history><date date-type="received"><day>October</day>	<month>20th,</month>	<year>2011</year></date><date date-type="rev-recd"><day>November</day>	<month>24th,</month>	<year>2011</year>	</date><date date-type="accepted"><day>December</day>	<month>10th,</month>	<year>2011</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  The most significant practical challenge for face recognition is perhaps variability in lighting intensity. In this paper, we developed a face recognition which is insensitive to large variation in illumination. Normalization step including two steps, first we used Histogram truncation as a pre-processing step and then we implemented Homomorphic filter. The main idea is that, achieving illumination invariance causes to simplify feature extraction module and increases recognition rate. Then we utilized Fuzzy Linear Discriminant Analysis (FLDA) in feature extraction stage which showed a good discriminating ability compared to other methods while classification is performed using Feedforward Neural Network (FFNN). The experiments were performed on the ORL (Olivetti Research Laboratory) face image database and the results show the present method outweighs other techniques applied on the same database and reported in literature.
 
</p></abstract><kwd-group><kwd>Face Recognition; Histogram Truncation; Homomorphic Filter; Fuzzy LDA; FFNN</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>Face recognition has become one of the most active research areas of pattern recognition since the early 1990s, and has attracted substantial research efforts from the areas of computer vision, bio-informatics and machine learning.</p><p>Illumination is considered one of the most difficult tasks for face recognition. The illumination setup in which recognition is performed is in most cases impractical to control, its physics difficult to accurately model and face appearance differences due to changing illumination are often larger than those differences between individuals. Reliable techniques for recognition under more extreme variations caused by pose, expression, occlusion or illumination is highly nonlinear, have proven elusive [<xref ref-type="bibr" rid="scirp.17647-ref1">1</xref>].</p><p>In this paper, we outline a hybrid technique for illumination normalization, after the Histogram truncation was applied to input face images, the Homomorphic filter was used for normalization. Then face recognition is performed with two major steps. In the first step, some useful features of the image are extracted. In the second step, on the basis of the extracted features the classification is executed.</p><p>Fuzzy LDA (Fuzzy Fisherface) recently, was proposed for feature extraction and face recognition [<xref ref-type="bibr" rid="scirp.17647-ref2">2</xref>]. Fuzzy LDA computes fuzzy within-class scatter matrix and betweenclass scatter matrix by incorporating class membership of the binary labeled faces (patterns).</p><p>Finally extracted features were considered as inputs to classifiers. In this paper well-known classifier, Feedforward Neural Networks were employed as classification.</p><p>Then rest of this paper is as followed. The preprocesssing step is initiated in Section 2 then Fuzzy LDA is introduced in Section 3. Section 4 describes classification and Section 5 determines our experimental results on ORL dataset, and Conclusions is given in Section 6.</p></sec><sec id="s2"><title>2. Illumination Normalization Technique</title><p>In this stage, in order to boost the result of normalization, we first truncated a specified percentage of the lower and upper ends of an image histogram.</p><p>In fact, several studies have shown that histogram remapping in conjunction with photometric normalization techniques results in better face recognition performance than using photometric normalization techniques on their own.</p><p>In the next step, Homomorphic filter as a renowned illumination reflectance was used. And then filtered face image is considered as input of feature extraction module.</p>Homomorphic Filters<p>Homomorphic filtering (HOMO) is a well known normalization technique, which improves the appearance of an image by contrast enhancement and gray-level range compression.</p><p>Consider an image, f(x, y), which can be stated as the product of the illumination i(x, y), and the reflectance component r(x, y)&#160;as follows [<xref ref-type="bibr" rid="scirp.17647-ref3">3</xref>]:</p><disp-formula id="scirp.17647-formula133578"><label>(1)</label><graphic position="anchor" xlink:href="7-3400142\825e5503-837c-470b-a8e9-8252e2f29bc1.jpg"  xlink:type="simple"/></disp-formula><p>Then input image is transformed in to the logarithm domain in order to achieve frequency components of the illumination and reflectance separately:</p><disp-formula id="scirp.17647-formula133579"><label>(2)</label><graphic position="anchor" xlink:href="7-3400142\5a96ab64-2c78-407a-a572-4116b1b86549.jpg"  xlink:type="simple"/></disp-formula><p>Then:</p><p>𝔉{ z(x, y)} = 𝔉 {ln f(x, y)}</p><p>&#160;&#160;&#160;&#160;&#160;&#160;&#160;&#160;&#160;&#160;&#160;&#160;&#160;&#160;&#160; = 𝔉 {ln i(x, y)} + 𝔉{ln r(x, y)}</p><p>Or:</p><p><img src="7-3400142\e85ae98e-3a3b-4360-8643-db9dc42fa192.jpg" /></p><p>where F<sub>i</sub>(u, v) and F<sub>r</sub>(u, v), in Equation (2) are the Fourier transforms of the term defined.</p><p>The Fourier transform of the product of the Z(u, v) and filter function H(u, v) can be expressed as:</p><disp-formula id="scirp.17647-formula133580"><label>(3)</label><graphic position="anchor" xlink:href="7-3400142\0766ea1f-30a0-4872-ac87-768008252ec5.jpg"  xlink:type="simple"/></disp-formula><p>In the spatial domain:</p><p>s(x, y) = 𝔉<sup>–</sup><sup>1</sup>{S(u, v)}</p><p>= 𝔉<sup>–1</sup>{H(u, v). F<sub>i</sub>(u, v) + H(u, v). F<sub>r</sub>(u, v)}</p><p>Finally by letting</p><p>i(x, y) = 𝔉<sup>-1</sup>{H(u, v). F<sub>i</sub>(u, v)}(4)</p><p>r(x, y) = 𝔉<sup>-1</sup>{H(u,v). F<sub>r</sub>(u, v)}</p><p>The equation becomes:</p><disp-formula id="scirp.17647-formula133581"><label>(5)</label><graphic position="anchor" xlink:href="7-3400142\5115a1b8-f80e-49f5-9767-bd324b0fdb54.jpg"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.17647-formula133582"><graphic  xlink:href="7-3400142\a4ab08fc-7455-495e-967c-f5a04ef0515f.jpg"  xlink:type="simple"/></disp-formula><p><img src="7-3400142\8f51688b-8157-4c7a-bdd1-830134482215.jpg" /></p><p><img src="7-3400142\4b12f347-336c-4cec-bd2d-c9b625ad4cf1.jpg" /></p><p>where i<sub>0</sub> and r<sub>0</sub> are the illumination and the reflectance components of the output images. After z(x, y) is transformed into the frequency domain, the high frequency components are emphasized and the low-frequency components are reduced. As a final step the image is transformed back into the spatial domain by applying the inverse Fourier transform and taking the exponential of the result.</p><p>This method is based on a special case of a class of systems known as Homomorphic system. The filter transform function H(u, v) is known as the Homomorphic filter [<xref ref-type="bibr" rid="scirp.17647-ref4">4</xref>] .</p></sec><sec id="s3"><title>3. Fuzzy LDA (FLDA)</title><p>In Fuzzy LDA, which also was called Fuzzy Fisher Face method, the basic LDA is changed. The modification is the introduction of fuzziness in to the belonging of projected vector to the classes which solves binary classification problems. In conventional LDA approach, every vector is supposed to have a crisp membership. But this does not take into account the resemblance of images belonging to different classes, which occurs under varying conditions. In FLDA, each vector is assigned the membership grades of every class based upon the class label of its k nearest neighbors. This Fuzzy k-nearest neighbor is utilized to evaluate the membership grades of all the vectors [<xref ref-type="bibr" rid="scirp.17647-ref5">5</xref>].</p><p><img src="7-3400142\8f20d4bd-c6f6-41ed-8abc-cb82f975fc80.jpg" />stands for the membership grade of <img src="7-3400142\8ed2a58e-08a6-4833-875e-41d073beb8fc.jpg" /> vector in the <img src="7-3400142\14881f66-1182-4dfa-98e3-13bcd026c3e2.jpg" /> class and satisfies two obvious properties:</p><disp-formula id="scirp.17647-formula133583"><label>(6)</label><graphic position="anchor" xlink:href="7-3400142\7ff1d2e6-f9b0-4179-98db-a6e459a3e04f.jpg"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.17647-formula133584"><label>(7)</label><graphic position="anchor" xlink:href="7-3400142\0466016b-02c0-4670-ba2b-1597a00dfce7.jpg"  xlink:type="simple"/></disp-formula><p>The class labels of the k vectors located in the closest neighborhood of each vector is collected during the training phase. Then the membership grade of <img src="7-3400142\9baf73d8-50fd-4969-9274-4e90268af4bd.jpg" /> vector in the <img src="7-3400142\576112df-e757-4ae3-941e-2672abd9c5c7.jpg" /> class is evaluated as follow [<xref ref-type="bibr" rid="scirp.17647-ref5">5</xref>]:</p><p><img src="7-3400142\0af97527-60f7-42cd-b64b-10bf3bca120d.jpg" />(8)</p><p>In the above expression <img src="7-3400142\37f06b31-5d0f-4d76-9a89-6d32f608f44c.jpg" /> stands for the number of the neighbors of the <img src="7-3400142\1e7c924a-a7e5-484a-9f46-a9d71a4e361e.jpg" /> data (pattern) that belong to the <img src="7-3400142\c319f42b-596a-4530-8bd4-45b7c31c36f9.jpg" /> class.</p><p>The moderated membership grades are used in the computations of the statistical properties of the patterns. The mean vector of each class is obtained from the below equation [<xref ref-type="bibr" rid="scirp.17647-ref6">6</xref>]:</p><disp-formula id="scirp.17647-formula133585"><label>(9)</label><graphic position="anchor" xlink:href="7-3400142\efbf8ab1-38c3-483a-8723-6ab43caf0501.jpg"  xlink:type="simple"/></disp-formula><p>Then, the corresponding fuzzy within-class scatter matrix and fuzzy between-class scatter matrix can be redefined as follow [7,8]:</p><disp-formula id="scirp.17647-formula133586"><label>(10)</label><graphic position="anchor" xlink:href="7-3400142\942a3949-4232-4574-8c15-a39248144c87.jpg"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.17647-formula133587"><label>(11)</label><graphic position="anchor" xlink:href="7-3400142\ee206f9f-9521-444f-9736-c567d2380e94.jpg"  xlink:type="simple"/></disp-formula><p>where <img src="7-3400142\3edd5c28-fd55-478e-bbaa-0291767a1eac.jpg" /> is the mean of all samples. Our optimal fuzzy projection <img src="7-3400142\a099b945-250b-4626-bf46-33baa4919912.jpg" /> follows the expression:</p><disp-formula id="scirp.17647-formula133588"><label>(12)</label><graphic position="anchor" xlink:href="7-3400142\3856eb1d-5641-47ce-acb6-f51534f32e90.jpg"  xlink:type="simple"/></disp-formula><p>It is difficult to directly calculate <img src="7-3400142\ac666ee7-7826-42d6-8de3-4b19e7a74e82.jpg" /> because that <img src="7-3400142\2475a065-93d9-4fad-b230-4c8252aa37f3.jpg" /> is often singular [<xref ref-type="bibr" rid="scirp.17647-ref6">6</xref>].</p><p>For tackle this problem, PCA is used as a dimension reduction step and thus the final transformation is given by the following matrix,</p><disp-formula id="scirp.17647-formula133589"><label>(13)</label><graphic position="anchor" xlink:href="7-3400142\cf043b3e-7814-4f57-8b77-cc9988a452c2.jpg"  xlink:type="simple"/></disp-formula></sec><sec id="s4"><title>4. Classification</title>Feedforward Neural Networks<p>Neural networks have been a much-publicized topic of research in recent years and are now beginning to be used in a wide range of subject areas. Having high computation rates, neural network is used as classification. For this purpose each input pattern is forced, adaptively, to output the pattern indicators that are part of the training data. Feed-forward networks, sometimes called multilayer perceptrons (MLP), are trained adaptively to transform a set of input signals, X, into a set of output signals, O [9,10].</p><p>Feedback networks start with an initial activity state of a feedback system, and after state transitions have taken place, the asymptotic final state is identified as the outcome of the computation [<xref ref-type="bibr" rid="scirp.17647-ref11">11</xref>].</p><p><xref ref-type="fig" rid="fig1">Figure 1</xref> shows the architecture of the system for face classification. After calculating the features, the feature projection vectors are calculated for the faces in the database. These feature projection vectors are used as inputs to train the neural network. <xref ref-type="fig" rid="fig2">Figure 2</xref> illustrates the schematic diagram for the training phase. In test phase, image’s feature projection vector is calculated from the feature space. These vectors are fed to the neural network and the network is simulated by them, where the network outputs are compared. The new face’s class is determined by considering maximum output of different classes in which the class with maximum output clarify test image’s label.</p><p>The two activation functions <img src="7-3400142\dd917443-2008-42bf-86a4-2e9f98533af9.jpg" /> (input layer to hidden layer) and <img src="7-3400142\e10ec925-f05e-4f4f-a6d2-7c59894c9e54.jpg" /> (hidden layer to output layer) are used which are logistic functions:</p><disp-formula id="scirp.17647-formula133590"><label>(14)</label><graphic position="anchor" xlink:href="7-3400142\c35c37e8-71bc-404f-adff-8884e65cc337.jpg"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.17647-formula133591"><label>(15)</label><graphic position="anchor" xlink:href="7-3400142\c77fc1e5-5543-4361-bac6-ad4df129aa72.jpg"  xlink:type="simple"/></disp-formula><p><img src="7-3400142\160db76e-1e69-4ff7-bbf1-ab7bc5321641.jpg" />and <img src="7-3400142\0fed07f7-ee55-499d-919f-0abfa776296f.jpg" /> are inputs for hidden layer and output layer respectively.</p></sec><sec id="s5"><title>5. Implementation and Results</title><p>The ORL database consists of 40 groups [<xref ref-type="bibr" rid="scirp.17647-ref12">12</xref>], each containing ten 112 &#215; 92 gray scale images of a single subject. Each subject’s images differ in lighting, facial expression, details (i.e. glasses/no glasses) and even sliding. Some of the database’s images are illustrated in <xref ref-type="fig" rid="fig3">Figure 3</xref>.</p><sec id="s5_1"><title>5.1. Preprocessing Step</title><p><xref ref-type="fig" rid="fig4">Figure 4</xref> shows an original image from ORL database and its histogram respectively. This image is chosen spe-</p></sec></sec></body><back><ref-list><title>References</title><ref id="scirp.17647-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Y. A. Georghiades, P. Belhumeur and D. Kriegman, “From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 23, No. 6, 2001, pp. 643-660. 
doi:10.1109/34.927464 </mixed-citation></ref><ref id="scirp.17647-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple"> 
K. C. Kwak and W. Pedrycz, “Face Recognition Using a Fuzzy Fisher Classifier,” Pattern Recognition, Vol. 38, No. 10, 2005, pp. 1717-1732. 
doi:10.1016/j.patcog.2005.01.018</mixed-citation></ref><ref id="scirp.17647-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple"> 
A. M. E. Thammizharasi, “Performance Analysis of Face Recognition by Combining Multiscale Techniques and Homomorphic Filter Using Fuzzy k-Nearest Neighbour Classifier,” IEEE International Conference on Communication Control and Computing Technologies, Ramanathapuram, 7-9 October 2010, pp. 643-650. </mixed-citation></ref><ref id="scirp.17647-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple"> 
N. A. Surobhi and Md. R. Amin, “Employment of Modified Homomorphic Filters in Medical Imaging,” International University Journal of Science and Technology in Daffodil, Vol. 1, No. 1, 2006. </mixed-citation></ref><ref id="scirp.17647-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple"> 
J. M. Keller, M. R. Gray and J. A. Givern, “A Fuzzy K Nearest Neighbor Classifier Algorithm,” IEEE Transactions on Systems, Man and Cybernetics, Vol. 15, No. 4, 1985, pp. 580-585. </mixed-citation></ref><ref id="scirp.17647-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple"> 
W. Yang, H. Yan, J. Wang and J. Yang, “Face Recognition Using Complete Fuzzy LDA,” 19th Conference on International Pattern Recognition, Tampa, 8-11 December 2008, pp. 1-4. </mixed-citation></ref><ref id="scirp.17647-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple"> 
X.-N. Song and Y. Zheng, “A Complete Fuzzy Discriminant Analysis Approach for Face Recognition,” Applied Soft Computing, Vol. 10, No. 1, 2010, pp. 208-214. </mixed-citation></ref><ref id="scirp.17647-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple"> 
M.-Y. Shieh, C.-M. Hsieh and J.-Y. Chen, “PCA and LDA-Based Fuzzy Face Recognition System,” SICE Annual Conference, Taipei, 18-21 August 2010, pp. 1610-1615. </mixed-citation></ref><ref id="scirp.17647-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple"> 
A. Eleyan and H. Demirel, “Face Recognition System Based on PCA and Feedforward Neural Networks,” Proceedings of Computational Intelligence and Bioinspired Systems, Barcelona, June 2005, pp. 935-942. 
doi:10.1007/11494669_115</mixed-citation></ref><ref id="scirp.17647-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple"> 
S. Lawrence, C. L. Giles, A. C. Tsoi and A. D. Back, “Face Recognition: A Convolutional Neural-Network Approach,” IEEE Transactions on Neural Networks, Vol. 8, No. 1, 1997, pp. 98-113. doi:10.1109/72.554195</mixed-citation></ref><ref id="scirp.17647-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple"> 
Z. J. Yu, “Face Recognition with Eigenface,” Proceeding of the IEEE International Conference on Industrial Technology, Guangzhou, 5-9 December1994, pp. 434-438. </mixed-citation></ref><ref id="scirp.17647-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple"> 
ORL, “The Database of Faces,” 2011.  
http://www.cl.cam.ac.uk/research/dtg/attarchive/facedatase.html</mixed-citation></ref></ref-list></back></article>