<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">JSIP</journal-id><journal-title-group><journal-title>Journal of Signal and Information Processing</journal-title></journal-title-group><issn pub-type="epub">2159-4465</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/jsip.2012.31004</article-id><article-id pub-id-type="publisher-id">JSIP-17627</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Computer Science&amp;Communications</subject></subj-group></article-categories><title-group><article-title>
 
 
  Neural Network Based Order Statistic Processing Engines
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>ehmet</surname><given-names>S. Unluturk</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Jafar</surname><given-names>Saniie</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib></contrib-group><aff id="aff2"><addr-line>Electrical and Computer Engineering Department, Illinois Institute of Technology, Chicago, USA</addr-line></aff><aff id="aff1"><addr-line>Department of Software Engineering, Izmir University of Economics, Izmir, Turkey</addr-line></aff><author-notes><corresp id="cor1">* E-mail:<email>suleyman.unluturk@ieu.edu.tr(ESU)</email>;</corresp></author-notes><pub-date pub-type="epub"><day>28</day><month>02</month><year>2012</year></pub-date><volume>03</volume><issue>01</issue><fpage>30</fpage><lpage>34</lpage><history><date date-type="received"><day>November</day>	<month>8th,</month>	<year>2011</year></date><date date-type="rev-recd"><day>December</day>	<month>16th,</month>	<year>2011</year>	</date><date date-type="accepted"><day>December</day>	<month>30th,</month>	<year>2011</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  Order statistic filters are used often in the applications of science and engineering problems. This paper investigates the design and training of a feed-forward neural network to approximate minimum, median and maximum operations. The design of order statistic neural network filtering (OSNNF) is further refined by converting the input vectors with elements of real numbers to a set of inputs consisting of ones and zeros, and the neural network is trained to yield a rank vector which can be used to obtain the exact ranked values of the input vector. As a case study, the OSNNF is used to improve the visibility of target echoes masked by clutter in ultrasonic nondestructive testing applications.
 
</p></abstract><kwd-group><kwd>Neural Networks; Back-Propagation Algorithm; Order Statistic Filters; Target Echo Detection</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>Order statistic (OS) processors have been widely used in the field of signal and image processing [1-3]. OS results can be obtained by sorting the elements of an input vector according to the rank of each element. Ranked outputs such as minimum, median and maximum have been used for target detection with applications in radar, sonar and ultrasonic nondestructive testing [4,5]. The problem of sorting has already been solved by sequential and iterative methods such as the bubble sort, selection sort, insertion sort, and quick sort with computational efficiency ranging between O(NlogN) and O(N<sup>2</sup>) comparisons and swapping operations [<xref ref-type="bibr" rid="scirp.17627-ref6">6</xref>]. As an alternative to conventional sorting techniques, a neural network design resulting from the harmony theory has been proposed for the sorting operation [<xref ref-type="bibr" rid="scirp.17627-ref7">7</xref>]. Neural network hardware can be implemented with parallel architecture using VLSI and FPGA technology, and this is highly desirable for high-speed computation [8-11].</p><p>In this paper, feed-forward neural network models [<xref ref-type="bibr" rid="scirp.17627-ref12">12</xref>] are introduced to find the minimum, the median, and the maximum of the input vectors consisting of real numbers. The back-propagation learning algorithm [<xref ref-type="bibr" rid="scirp.17627-ref13">13</xref>] is utilized in the training phase of the order statistic neural network filters (OSNNF). If the size of the input data is n, there is n! different input vectors including the same real numbers which give the same sorted output. Furthermore, the input vectors with real numbers demand an unlimited number of input vectors for training. Therefore, it is impractical to train an OSNNF with that many input data. Consequently, the trained OSNNF filter might not provide exact sorted results. In spite of this drawback, neural network filters can be trained to provide good approximation for the sorted results, and perhaps this might be sufficient for sorting the random processes in certain applications [4,5].</p><p>In practice, it is desirable to develop an efficient neural network model that can be used in finding the estimates of minimum, median, and maximum of the input vectors. To achieve this, simulation data is used in the training phase. The training set of data consists of random numbers with uniform distribution scaled between zero and one. Then, the neural network is trained to yield the ranked output (e.g., the minimum, the median or the maximum value of the input vector with real numbers). In the next section we present the design techniques for the neural network OS filters. Section 3 discusses an improved neural network solution that finds the rank of each input in order to reveal the exact sorted result. Section 4 utilizes these neural network filters to enhance the visibility of target echoes in high scattering clutter using split-spectrum processing (SSP).</p></sec><sec id="s2"><title>2. Neural Network OS Filters</title><p><xref ref-type="fig" rid="fig1">Figure 1</xref> displays the structure for the neural network OS filter where the number of inputs is 8 (M = 8). This filter is a fully connected feed-forward neural network. When unordered uniformly distributed random numbers, x(i), are presented as an input vector of real numbers to the neural network, each output of the hidden neurons is the weighted sum of the input nodes and bias node passes</p></sec></body><back><ref-list><title>References</title><ref id="scirp.17627-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">J. Serra, “Image Analysis and Mathematical Morphology,” Academic Press, New York, 1988. </mixed-citation></ref><ref id="scirp.17627-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple"> 
I. Pitas and A. N. Venetsanopoulos, “Nonlinear Digital Filters, Principles and Applications,” Kluwer Academic Publishers, Boston, 1990. </mixed-citation></ref><ref id="scirp.17627-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple"> 
J. Astola and P. Kuosmanen, “Fundamentals of Nonlinear Digital Filtering,” CRC Press, Boca Raton, 1997. </mixed-citation></ref><ref id="scirp.17627-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple"> 
J. Saniie, K. D. Donohue and N. M. Bilgutay, “Order Statistic Filters as Postdetection Processor,” IEEE Transactions on Acoustics, Speech, and Signal Processing, Vol. 38, No. 10, 1990, pp. 1722-1732. </mixed-citation></ref><ref id="scirp.17627-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple"> 
J. Saniie, D. T. Nagle and K. D. Donohue, “Analysis of Order Statistic Filters Applied to Ultrasonic Flaw Detection Using Split-Spectrum Processing,” IEEE Transactions on Ultrasonics, Ferrorelectrics, and Frequency Control, Vol. 38, No. 2, 1999, pp. 133-140. doi:10.1109/58.68470</mixed-citation></ref><ref id="scirp.17627-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple"> 
M. A. Weiss, “Data Structures and Algorithm Analysis in C&lt;sup&gt;++&lt;/sup&gt;,” Addison Wesley, Reading, 2006. </mixed-citation></ref><ref id="scirp.17627-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple"> 
T. Tambouratzis, “A Novel Artificial Neural Network for Sorting,” IEEE Transact?ons on Systems, Man, and Cybernet?cs—Part B: Cybernet?cs, Vol. 29, No. 2, 1999, pp. 271-275. doi:10.1109/3477.752799</mixed-citation></ref><ref id="scirp.17627-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple"> 
P. W. Hollis and J. J. Paulos, “A Neural Network Learning Algorithm Tailored for VLSI Implementation,” IEEE Transactions on Neural Networks, Vol. 5, No. 5, 1994, pp. 784-791. doi:10.1109/72.317729</mixed-citation></ref><ref id="scirp.17627-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple"> 
B. M. Wilamowski and R. C. Jaeger, “Neuro-Fuzzy Architecture for CMOS Implementation,” IEEE Transaction on Industrial Electronics, Vol. 46, No. 6, 1999, pp. 1132-1136. doi:10.1109/41.808001</mixed-citation></ref><ref id="scirp.17627-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple"> 
X. Zhu, L. Yuan, D. Wang and Y. Chen, “FPGA Implementation of a Probabilistic Neural Network for Spike Sorting,” 2010 2nd International Conference on Information Engineering and Computer Science, Wuhan, 25-26 December 2010, pp. 1-4. </mixed-citation></ref><ref id="scirp.17627-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple"> 
J. Misra and I. Saha, “Artificial Neural Networks in Hardware: A Survey of Two Decades of Progress,” Neurocomputing, Vol. 74, No. 1-3, 2010, pp. 239-255. </mixed-citation></ref><ref id="scirp.17627-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple"> 
K. Hornik, “Multilayer Feedforward Networks as Universal Approximators,” Neural Networks, Vol. 2, No. 5, 1989, pp. 359-366. doi:10.1016/0893-6080(89)90020-8</mixed-citation></ref><ref id="scirp.17627-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple"> 
T. Masters, “Practical Neural Network Recipes in C&lt;sup&gt;++&lt;/sup&gt;,” Academic Press Inc., New York, 1993. </mixed-citation></ref><ref id="scirp.17627-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple"> 
F. J. Bremner, S. J. Gotts and D. L. Denham, “Hinton Diagrams: Viewing Connection Strengths in Neural Networks,” Behavior Research Methods, Vol. 26, No. 2, 1994, pp. 215-218. </mixed-citation></ref><ref id="scirp.17627-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple"> 
E. Parzen, “On Estimation of a Probability Density Function and Mode,” Annals of Mathematical Statistics, Vol. 33, No. 3, 1962, pp. 1065-1076. 
doi:10.1214/aoms/1177704472</mixed-citation></ref></ref-list></back></article>