<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">JSIP</journal-id><journal-title-group><journal-title>Journal of Signal and Information Processing</journal-title></journal-title-group><issn pub-type="epub">2159-4465</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/jsip.2015.64024</article-id><article-id pub-id-type="publisher-id">JSIP-61097</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Computer Science&amp;Communications</subject></subj-group></article-categories><title-group><article-title>
 
 
  Convolutional Noise Analysis via Large Deviation Technique
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>onika</surname><given-names>Pinchas</given-names></name><xref ref-type="aff" rid="aff1"><sub>1</sub></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib></contrib-group><aff id="aff1"><label>1</label><addr-line>Department of Electrical and Electronic Engineering, Ariel University, Ariel, Israel</addr-line></aff><author-notes><corresp id="cor1">* E-mail:<email>monikap@ariel.ac.il</email></corresp></author-notes><pub-date pub-type="epub"><day>13</day><month>11</month><year>2015</year></pub-date><volume>06</volume><issue>04</issue><fpage>259</fpage><lpage>265</lpage><history><date date-type="received"><day>8</day>	<month>September</month>	<year>2015</year></date><date date-type="rev-recd"><day>accepted</day>	<month>10</month>	<year>November</year>	</date><date date-type="accepted"><day>13</day>	<month>November</month>	<year>2015</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  Due to non-ideal coefficients of the adaptive equalizer used in the system, a convolutional noise arises at the output of the deconvolutional process in addition to the source input. A higher convolutional noise may make the recovering process of the source signal more difficult or in other cases even impossible. In this paper we deal with the fluctuations of the arithmetic average (sample mean) of the real part of consecutive convolutional noises which deviate from the mean of order higher than the typical fluctuations. Typical fluctuations are those fluctuations that fluctuate near the mean, while the other fluctuations that deviate from the mean of order higher than the typical ones are considered as rare events. Via the large deviation theory, we obtain a closed-form approximated expression for the amount of deviation from the mean of those fluctuations considered as rare events as a function of the system’s parameters (step-size parameter, equalizer’s tap length, SNR, input signal statistics, characteristics of the chosen equalizer and channel power), for a pre-given probability that these events may occur.
 
</p></abstract><kwd-group><kwd>Large Deviation Theory</kwd><kwd> Blind Equalization</kwd><kwd> Blind Deconvolution</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>In this paper, we deal with the convolutional noise arising at the output from a blind deconvolutional process. A blind deconvolution process arises in many applications such as seismology, underwater acoustic, image restoration and digital communication [<xref ref-type="bibr" rid="scirp.61097-ref1">1</xref>] - [<xref ref-type="bibr" rid="scirp.61097-ref7">7</xref>] . A higher convolutional noise may lead to more errors in the recovering process [<xref ref-type="bibr" rid="scirp.61097-ref8">8</xref>] . According to [<xref ref-type="bibr" rid="scirp.61097-ref9">9</xref>] [<xref ref-type="bibr" rid="scirp.61097-ref10">10</xref>] , the convolutional noise power depends on the step-size parameter, equalizer’s tap length, input signal statistics, channel characteristics, characteristics of the chosen blind equali- zation technique and on the signal to noise ratio (SNR). Thus, those fluctuations of the convolutional noise that are near the mean value are well understood and investigated. By well understood we mean that it is well understood how to control the convolutional noise power (thus also the convolutional noise fluctuation near the mean) via the step-size parameter or equalizer’s tap length for instance. But up to now, those fluctuations of the convolutional noise that are larger than the typical ones (which are near the mean), which occur rarely, were not addressed.</p><p>The theory of large deviations is concerned with the exponential decay of probabilities of large fluctuations in random systems. These probabilities are important in many fields of study, including statistics, finance, and engineering, as they often yield valuable information about the large fluctuations of a random system around its most probable state or trajectory [<xref ref-type="bibr" rid="scirp.61097-ref11">11</xref>] . According to [<xref ref-type="bibr" rid="scirp.61097-ref12">12</xref>] , the theory of large deviations deals with the pro- babilities of rare events (or fluctuations) that are exponentially small as a function of some parameters, e.g., the number of random components of a system, the time over which a stochastic system is observed, the amplitude of the noise perturbing a dynamical system or the temperature of a chemical reaction. The reader may refer also to [<xref ref-type="bibr" rid="scirp.61097-ref13">13</xref>] - [<xref ref-type="bibr" rid="scirp.61097-ref17">17</xref>] for further information on the theory of large deviations.</p><p>In this paper we address indirectly those fluctuations of the convolutional noise that are larger than the typical ones, which occur very rare. Namely, we consider the fluctuations of the arithmetic average (sample mean) of the real part of consecutive convolutional noises which deviate from the mean of order higher than the typical fluctuations. As already mentioned, typical fluctuations are those fluctuations that fluctuate near the mean, while the other fluctuations that deviate from the mean of order higher than the typical ones are considered as rare events. Via the large deviation theory, we obtain a closed-form approximated expression for the probability that these rare events may occur as a function of the step-size parameter, equalizers’s tap length, SNR, input signal statistics, characteristics of the chosen equalizer (based on a cost function where the error of the equalized output can be expressed as a polynomial function of order up to three), channel power and the amount of deviation from the mean. Based on this new expression we are able to evaluate approximately the amount of deviation from the mean of those fluctuations considered as rare events as a function of the system’s parameters (step-size parameter, equalizers’s tap length, SNR, input signal statistics, characteristics of the chosen equalizer and channel power), for a pre-given probability that these events may occur.</p><p>The paper is organized as follows: after having described the system under consideration in Section 2 we evaluate in Section 3 approximately the amount of deviation from the mean of those fluctuations considered as rare events as a function of the systems parameters (step-size parameter, equalizerss tap length, SNR, input signal statistics, characteristics of the chosen equalizer and channel power), for a pre-given probability that these events may occur. Section 4 is our conclusion.</p></sec><sec id="s2"><title>2. System Description</title><p>The system under consideration is illustrated in <xref ref-type="fig" rid="fig1">Figure 1</xref>, where we make the following assumptions:</p><p>1) The input sequence <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x6.png" xlink:type="simple"/></inline-formula> belongs to a two independent quadrature carrier case constellation input with variance <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x7.png" xlink:type="simple"/></inline-formula> where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x8.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x9.png" xlink:type="simple"/></inline-formula> are the real and imaginary parts of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x10.png" xlink:type="simple"/></inline-formula> respectively.</p><p>2) The unknown channel <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x11.png" xlink:type="simple"/></inline-formula> is a possibly nonminimum phase linear time-invariant filter in which the transfer function has no “deep zeros”, namely, the zeros lie sufficiently far from the unit circle.</p><p>3) The equalizer <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x12.png" xlink:type="simple"/></inline-formula> is a tap-delay line.</p><p>4) The noise <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x13.png" xlink:type="simple"/></inline-formula> is an additive Gaussian white noise with zero mean and variance <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x14.png" xlink:type="simple"/></inline-formula></p><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x15.png" xlink:type="simple"/></inline-formula> is the expectation operator.</p><fig id="fig1"  position="float"><label><xref ref-type="fig" rid="fig1">Figure 1</xref></label><caption><title> Block diagram of a baseband communication system</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/1-3400427x16.png"/></fig><p>The transmitted sequence <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x17.png" xlink:type="simple"/></inline-formula> is transmitted through the channel <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x18.png" xlink:type="simple"/></inline-formula> and is corrupted with noise<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x19.png" xlink:type="simple"/></inline-formula>. Therefore, the equalizer’s input sequence <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x20.png" xlink:type="simple"/></inline-formula> may be written as:</p><disp-formula id="scirp.61097-formula124"><label>(1)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/1-3400427x21.png"  xlink:type="simple"/></disp-formula><p>where “<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x22.png" xlink:type="simple"/></inline-formula>” denotes the convolution operation. The equalized output sequence is defined by:</p><disp-formula id="scirp.61097-formula125"><label>(2)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/1-3400427x23.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x24.png" xlink:type="simple"/></inline-formula> is the convolutional noise (convolutional error) due to non-ideal equalizer’s coefficients</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x25.png" xlink:type="simple"/></inline-formula>and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x25.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x26.png" xlink:type="simple"/></inline-formula>. The update mechanism of the equalizer’s coefficients is given by</p><p>[<xref ref-type="bibr" rid="scirp.61097-ref18">18</xref>] :</p><disp-formula id="scirp.61097-formula126"><label>(3)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/1-3400427x27.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x28.png" xlink:type="simple"/></inline-formula> is the step-size parameter, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x28.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x29.png" xlink:type="simple"/></inline-formula>stands for the conjugate operation and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x28.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x29.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x30.png" xlink:type="simple"/></inline-formula> is a predefined</p><p>cost function that characterizes the intersymbol interference, see [<xref ref-type="bibr" rid="scirp.61097-ref19">19</xref>] - [<xref ref-type="bibr" rid="scirp.61097-ref26">26</xref>] . Minimizing this <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x31.png" xlink:type="simple"/></inline-formula> with</p><p>respect to the equalizer parameters will reduce the convolutional error. In the following we deal with those</p><p>equalization methods where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x32.png" xlink:type="simple"/></inline-formula> can be defined as a polynomial function <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x32.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x33.png" xlink:type="simple"/></inline-formula> of order up to</p><p>three as is in the case of [<xref ref-type="bibr" rid="scirp.61097-ref19">19</xref>] . Thus, in this work we consider the following update mechanism of the equalizer’s coefficients:</p><disp-formula id="scirp.61097-formula127"><label>(4)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/1-3400427x34.png"  xlink:type="simple"/></disp-formula></sec><sec id="s3"><title>3. The Deviation from the Mean</title><p>In this section we obtain a closed-form approximated expression for the amount of deviation from the mean of those fluctuations considered as rare events as a function of the system’s parameters (step-size parameter, equalizers’s tap length, SNR, input signal statistics, characteristics of the chosen equalizer and channel power), for a pre-given probability that these events may occur.</p><p>Theorem 1. For the following assumptions:</p><p>1) The convolutional noise<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x35.png" xlink:type="simple"/></inline-formula>, is a zero mean, white Gaussian process with variance</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x36.png" xlink:type="simple"/></inline-formula>, where<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x36.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x37.png" xlink:type="simple"/></inline-formula>. <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x36.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x37.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x38.png" xlink:type="simple"/></inline-formula>is the real part of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x36.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x37.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x38.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x39.png" xlink:type="simple"/></inline-formula>.</p><p>2) The source signal <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x40.png" xlink:type="simple"/></inline-formula> is a complex input where the real part of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x40.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x41.png" xlink:type="simple"/></inline-formula> is independent with the imaginary part of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x40.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x41.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x42.png" xlink:type="simple"/></inline-formula>, with known variance <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x40.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x41.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x42.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x43.png" xlink:type="simple"/></inline-formula> and higher moments. The mean of the input sequence is</p><p>zero. Namely,<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x44.png" xlink:type="simple"/></inline-formula>.</p><p>3) The convolutional noise <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x45.png" xlink:type="simple"/></inline-formula> and the source signal are independent.</p><p>4) <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x46.png" xlink:type="simple"/></inline-formula>can be expressed as a polynomial function of the equalized output namely as <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x46.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x47.png" xlink:type="simple"/></inline-formula> of</p><p>order three.</p><p>5) The gain between the source and equalized output signal is equal to one.</p><p>6) The convolutional noise <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x48.png" xlink:type="simple"/></inline-formula> is independent with<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x48.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x49.png" xlink:type="simple"/></inline-formula>.</p><p>The amount of deviation <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x50.png" xlink:type="simple"/></inline-formula> from the mean of those fluctuations considered as rare events as a function of the system’s parameters, given the probability that these events occur can be expressed by:</p><disp-formula id="scirp.61097-formula128"><label>(5)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/1-3400427x51.png"  xlink:type="simple"/></disp-formula><p>where the probability that the fluctuations of the arithmetic average (sample mean) of the real part of consecutive convolutional noises which deviate from the mean of order higher than the typical ones is expressed by:</p><disp-formula id="scirp.61097-formula129"><label>(6)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/1-3400427x52.png"  xlink:type="simple"/></disp-formula><p>and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x53.png" xlink:type="simple"/></inline-formula> is given according to [<xref ref-type="bibr" rid="scirp.61097-ref27">27</xref>] :</p><disp-formula id="scirp.61097-formula130"><label>(7)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/1-3400427x54.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.61097-formula131"><label>(8)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/1-3400427x55.png"  xlink:type="simple"/></disp-formula><p>x<sub>r</sub> is the real part of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x56.png" xlink:type="simple"/></inline-formula>, R is the channel length, N is the equalizer’s tap length, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x56.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x57.png" xlink:type="simple"/></inline-formula></p><p>and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x58.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x58.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x59.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x58.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x59.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x60.png" xlink:type="simple"/></inline-formula>are properties of the chosen equalizer and found by:</p><disp-formula id="scirp.61097-formula132"><label>(9)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/1-3400427x61.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x62.png" xlink:type="simple"/></inline-formula> is the real part of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x62.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x63.png" xlink:type="simple"/></inline-formula> and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x62.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x63.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x64.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x62.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x63.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x64.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x65.png" xlink:type="simple"/></inline-formula>are the real and imaginary parts of the equalized output <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x62.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x63.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x64.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x65.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x66.png" xlink:type="simple"/></inline-formula> respectively.</p><p>Proof. Let us first define:</p><disp-formula id="scirp.61097-formula133"><label>(10)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/1-3400427x67.png"  xlink:type="simple"/></disp-formula><p>Next, by using assumption 1 from this section, we may write:</p><disp-formula id="scirp.61097-formula134"><label>(11)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/1-3400427x68.png"  xlink:type="simple"/></disp-formula><p>The propability density function (pdf) for <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x69.png" xlink:type="simple"/></inline-formula> (10) is</p><disp-formula id="scirp.61097-formula135"><label>(12)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/1-3400427x70.png"  xlink:type="simple"/></disp-formula><p>since a sum of Gaussian random variables is also exactly Gaussian-distributed. According to [<xref ref-type="bibr" rid="scirp.61097-ref11">11</xref>] , a large deviation approximation is obtained from this exact result by neglecting the term<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x71.png" xlink:type="simple"/></inline-formula>, which is subdominant with respect to the decaying exponential, thereby obtaining [<xref ref-type="bibr" rid="scirp.61097-ref11">11</xref>]</p><disp-formula id="scirp.61097-formula136"><label>(13)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/1-3400427x72.png"  xlink:type="simple"/></disp-formula><p>The Central Limit Theory (CLT) governs random fluctuations only near the mean-deviations from the mean</p><p>of the order of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x73.png" xlink:type="simple"/></inline-formula> [<xref ref-type="bibr" rid="scirp.61097-ref14">14</xref>] . Fluctuations which are of the order of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x73.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x74.png" xlink:type="simple"/></inline-formula> are, relative to typical fluctuations,</p><p>much bigger: they are large deviations from the mean [<xref ref-type="bibr" rid="scirp.61097-ref14">14</xref>] . They happen only rarely, and so large deviation theory is often described as the theory of rare events-events which take place away from the mean, out in the tails of the distribution; thus large deviation theory can also be described as a theory which studies the tails of distributions [<xref ref-type="bibr" rid="scirp.61097-ref14">14</xref>] . According to [<xref ref-type="bibr" rid="scirp.61097-ref11">11</xref>] [<xref ref-type="bibr" rid="scirp.61097-ref14">14</xref>] , the probability that</p><disp-formula id="scirp.61097-formula137"><label>(14)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/1-3400427x75.png"  xlink:type="simple"/></disp-formula><p>where according to [<xref ref-type="bibr" rid="scirp.61097-ref11">11</xref>] , <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x76.png" xlink:type="simple"/></inline-formula>is used to stress that as <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x76.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x77.png" xlink:type="simple"/></inline-formula> the dominant part of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x76.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x77.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x78.png" xlink:type="simple"/></inline-formula> is</p><p>the decaying exponential<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x79.png" xlink:type="simple"/></inline-formula>. Thus, based on (14), we may write:</p><disp-formula id="scirp.61097-formula138"><label>(15)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/1-3400427x80.png"  xlink:type="simple"/></disp-formula><p>where</p><disp-formula id="scirp.61097-formula139"><label>(16)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/1-3400427x81.png"  xlink:type="simple"/></disp-formula><p>and</p><disp-formula id="scirp.61097-formula140"><label>(17)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/1-3400427x82.png"  xlink:type="simple"/></disp-formula><p>Thus from (17) and (13) we have:</p><disp-formula id="scirp.61097-formula141"><label>(18)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/1-3400427x83.png"  xlink:type="simple"/></disp-formula><p>Next we turn to find a closed-form approximated expression for<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x84.png" xlink:type="simple"/></inline-formula>. Based on [<xref ref-type="bibr" rid="scirp.61097-ref27">27</xref>] , the expression for the</p><p>convolutional noise power <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x85.png" xlink:type="simple"/></inline-formula> for the noisy and non-biased input case <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x85.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/1-3400427x86.png" xlink:type="simple"/></inline-formula> is given by (7), (8) and (9). This completes our proof.</p></sec><sec id="s4"><title>4. Conclusion</title><p>In this paper we dealt with the fluctuations of the arithmetic average (sample mean) of the real part of consecutive convolutional noises which deviate from the mean of order higher than the typical ones. Via the large deviation theory, we obtained a closed-form approximated expression for the amount of deviation from the mean of those fluctuations considered as rare events as a function of the system’s parameters (step-size pa- rameter, equalizerss tap length, SNR, input signal statistics, characteristics of the chosen equalizer and channel power), for a pre-given probability that these events may occur.</p></sec><sec id="s5"><title>Acknowledgements</title><p>We thank the Editor and the referee for their comments.</p></sec><sec id="s6"><title>Cite this paper</title><p>Monika Pinchas, (2015) Convolutional Noise Analysis via Large Deviation Technique. Journal of Signal and Information Processing,06,259-265. doi: 10.4236/jsip.2015.64024</p></sec></body><back><ref-list><title>References</title><ref id="scirp.61097-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Wang, J., Huang, H.N., Zhang, C.H. and Guan, J. (2009) A Study of the Blind Equalization in the Underwater Communication. WRI Global Congress on Intelligent Systems, 3, 122-125. http://dx.doi.org/10.1109/GCIS.2009.61</mixed-citation></ref><ref id="scirp.61097-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Rao, W., Yuan, K.-M., Guo, Y.-C. and Yang, C. (2008) A Simple Constant Modulus Algorithm for Blind Equalization Suitable for 16-QAM Signal. 9th International Conference on Signal Processing, Beijing, 26-29 October 2008, 1963-1966.</mixed-citation></ref><ref id="scirp.61097-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Weber, R., Schulz, F. and Bohme, J.F. (2002) Blind Adaptive Equalization of Underwater Acoustic Channels Using Second-Order Statistics. OCEANS’02 MTS/IEEE, 4, 2444-2452. http://dx.doi.org/10.1109/OCEANS.2002.1192010</mixed-citation></ref><ref id="scirp.61097-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Abrar, S. and Nandi, A.K. (2010) Adaptive Minimum Entropy Equalization Algorithm. IEEE Communications Letters, 14, 966-968. http://dx.doi.org/10.1109/LCOMM.2010.083110.101168</mixed-citation></ref><ref id="scirp.61097-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Feng, C. and Chi, C. (1999) Performance of Cumulant Based Inverse Filters for Blind Deconvolution. IEEE Transaction on Signal Processing, 47, 1922-1935. http://dx.doi.org/10.1109/78.771041</mixed-citation></ref><ref id="scirp.61097-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Malik, G. and Sappal, A.S. (2011) Adaptive Equalization Algorithms: An Overview. International Journal of Advanced Computer Science and Applications, 2, 62-67. http://dx.doi.org/10.14569/IJACSA.2011.020311</mixed-citation></ref><ref id="scirp.61097-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Pinchas, M. and Bobrovsky, B.Z. (2006) A Maximum Entropy Approach for Blind Deconvolution. Signal Processing (Eurasip), 86, 2913-2931. http://dx.doi.org/10.1016/j.sigpro.2005.12.009</mixed-citation></ref><ref id="scirp.61097-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Pinchas, M. (2013) Symbol Error Rate as a Function of the Residual ISI Obtained by Blind Adaptive Equalizers. Pervasive and Embedded Computing and Communication Systems (PECCS 2013), Barcelona, 19-21 February 2013.</mixed-citation></ref><ref id="scirp.61097-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Pinchas, M. (2010) A Closed Approximated Formed Expression for the Achievable Residual Intersymbol Interference Obtained by Blind Equalizers. Signal Processing (Eurasip), 90, 1940-1962. http://dx.doi.org/10.1016/j.sigpro.2009.12.014</mixed-citation></ref><ref id="scirp.61097-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Pinchas, M. (2010) A New Closed Approximated Formed Expression for the Achievable Residual ISI Obtained by Adaptive Blind Equalizers for the Noisy Case. IEEE International Conference on Wireless Communications, Networking and Information Security WCNIS2010, Beijing, June 2010, 26-30. http://dx.doi.org/10.1109/wcins.2010.5541879</mixed-citation></ref><ref id="scirp.61097-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Touchette, H. (2009) The Large Deviation Approach to Statistical Mechanics. http://arxiv.org/pdf/0804.0327v2.pdf</mixed-citation></ref><ref id="scirp.61097-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Touchette, H. (2012) A Basic Introduction to Large Deviations: Theory, Applications, Simulations.http://arxiv.org/pdf/1106.4146v3.pdf</mixed-citation></ref><ref id="scirp.61097-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Duffy, K. and Metcalfe, A.P. (2004) The Large Deviations of Eestimating Rate-Functions. Applied Probability Trust.http://www.hamilton.ie/ken_duffy/Downloads/tldoerf.pdf</mixed-citation></ref><ref id="scirp.61097-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">Lewis, J.T. and Russell, R. (1997) An Introduction to Large Deviations for Teletraffic Engineers.http://www2.warwick.ac.uk/fac/sci/maths/people/staff/oleg_zaboronski/fm/large_deviations_review.pdf</mixed-citation></ref><ref id="scirp.61097-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Varadhan, S.R.S. (2008) Large Deviations. The Annals of Probability, 36, 397-419.http://dx.doi.org/10.1214/07-AOP348</mixed-citation></ref><ref id="scirp.61097-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">Shwartz, A. and Weiss, A. Large Deviations for Performance Analysis. http://webee.technion.ac.il/~adam/LD/intro.pdf</mixed-citation></ref><ref id="scirp.61097-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">Dembo, A. and Zeitouni, O. (1998) Large Deviations Techniques and Applications. 2nd Edition, Springer, New York.</mixed-citation></ref><ref id="scirp.61097-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">Nandi, A.K. (1999) Blind Estimation Using Higher-Order Statistics. Kluwer Academic Publishers, Boston, 66.http://dx.doi.org/10.1007/978-1-4757-2985-6</mixed-citation></ref><ref id="scirp.61097-ref19"><label>19</label><mixed-citation publication-type="other" xlink:type="simple">Godard, D.N. (1980) Self Recovering Equalization and Carrier Tracking in Two-Dimensional Data Communication System. IEEE Transactions on Communications, 28, 1867-1875. http://dx.doi.org/10.1109/TCOM.1980.1094608</mixed-citation></ref><ref id="scirp.61097-ref20"><label>20</label><mixed-citation publication-type="other" xlink:type="simple">Shalvi, O. and Weinstein, E. (1990) New Criteria for Blind Deconvolution of Nonminimum Phase Systems (Channels). IEEE Transactions on Information Theory, 36, 312-321. http://dx.doi.org/10.1109/18.52478</mixed-citation></ref><ref id="scirp.61097-ref21"><label>21</label><mixed-citation publication-type="other" xlink:type="simple">Pinchas, M. (2011) A MSE Optimized Polynomial Equalizer for 16QAM and 64QAM Constellation. Signal, Image and Video Processing, 5, 29-37. http://dx.doi.org/10.1007/s11760-009-0138-z</mixed-citation></ref><ref id="scirp.61097-ref22"><label>22</label><mixed-citation publication-type="other" xlink:type="simple">Abrar, S. and Nandi, A.K. (2010) Blind Equalization of Square-QAM Signals: A Multimodulus Approach. IEEE Transactions on Communications, 58, 1674-1685.</mixed-citation></ref><ref id="scirp.61097-ref23"><label>23</label><mixed-citation publication-type="other" xlink:type="simple">Arenas-Garcia, J. and Figueiras-Vidal, A.R. (2006) Improved Blind Equalization via Adaptive Combination of Constant Modulus Algorithms. Proceedings of the IEEE Conference on Acoustics Speech and Signal Processing, Toulouse, 14-19 May 2006, 3. http://dx.doi.org/10.1109/ICASSP.2006.1660764</mixed-citation></ref><ref id="scirp.61097-ref24"><label>24</label><mixed-citation publication-type="other" xlink:type="simple">Faruk, M.S. (2014) Modified CMA Based Blind Equalization and Carrier-Phase Recovery in PDM-QPSK Coherent Optical Receivers. Proceedings of the 16th International Conference on Computer and Information Technology, Khulna, 8-10 March 2014, 469-472. http://dx.doi.org/10.1109/ICCITechn.2014.6997333</mixed-citation></ref><ref id="scirp.61097-ref25"><label>25</label><mixed-citation publication-type="other" xlink:type="simple">Jiang, Z.X., Zhang, M., Li, Z.C. and Lu, S.L. (2008) A Newly High-Speed MCMA Algorithm for QAM System. Proceedings of the 4th International Conference on Wireless Communications, Networking and Mobile Computing, Dalian, 12-14 October 2008, 1-4.</mixed-citation></ref><ref id="scirp.61097-ref26"><label>26</label><mixed-citation publication-type="other" xlink:type="simple">Liu, Y.Z. and Song, T. (2007) A New CMA Algorithm Based on Modified Conjugate Gradient. Proceedings of the International Conference on Wireless Communications, Networking and Mobile Computing, Shanghai, 21-25 September 2007, 1160-1162.</mixed-citation></ref><ref id="scirp.61097-ref27"><label>27</label><mixed-citation publication-type="other" xlink:type="simple">Pinchas, M. (2015) Under What Condition Do We Get Improved Equalization Performance in the Residual ISI with Non-Biased Input Signals Compared with the Biased Version. Journal of Signal and Information Processing, 6, 79-91.http://dx.doi.org/10.4236/jsip.2015.62008</mixed-citation></ref></ref-list></back></article>