<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">JCC</journal-id><journal-title-group><journal-title>Journal of Computer and Communications</journal-title></journal-title-group><issn pub-type="epub">2327-5219</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/jcc.2016.414008</article-id><article-id pub-id-type="publisher-id">JCC-72299</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Computer Science&amp;Communications</subject></subj-group></article-categories><title-group><article-title>
 
 
  Convergence Analysis of Iterative Threshold Decoding Process
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Mohammed</surname><given-names>Lahmer</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Mostafa</surname><given-names>Belkasmi</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Abdallah</surname><given-names>Rhattoy</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib></contrib-group><aff id="aff1"><addr-line>Department of Computer Science, High School of Technologies, Meknes, Morocco</addr-line></aff><aff id="aff2"><addr-line>Department of Network and Telecoms, ENSIAS, Rabat, Morocco</addr-line></aff><author-notes><corresp id="cor1">* E-mail:<email>mohammed.lahmer@gmail.com(ML)</email>;</corresp></author-notes><pub-date pub-type="epub"><day>11</day><month>11</month><year>2016</year></pub-date><volume>04</volume><issue>14</issue><fpage>98</fpage><lpage>107</lpage><history><date date-type="received"><day>August</day>	<month>26,</month>	<year>2016</year></date><date date-type="rev-recd"><day>Accepted:</day>	<month>November</month>	<year>25,</year>	</date><date date-type="accepted"><day>November</day>	<month>28,</month>	<year>2016</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  Today the error correcting codes are present in all the telecom standards, in particular the low density parity check (LDPC) codes. The choice of a good code for a given network is essentially linked to the decoding performance obtained by the bit error rate (BER) curves. This approach requires a significant simulation time proportional to the length of the code, to overcome this problem Exit chart was introduced, as a fast technique to predict the performance of a particular class of codes called Turbo codes. In this paper, we success to apply Exit chart to analyze convergence behavior of iterative threshold decoding of one step majority logic decodable (OSMLD) codes. The iterative decoding process uses a soft-input soft-output threshold decoding algorithm as component decoder. Simulation results for iterative decoding of simple and concatenated codes transmitted over a Gaussian channel have shown that the thresholds obtained are a good indicator of the Bit Error Rate (BER) curves.
 
</p></abstract><kwd-group><kwd>OSMLD</kwd><kwd> EXIT</kwd><kwd> BER</kwd><kwd> Mutual Information</kwd><kwd> Iterative Threshold Decoding Extrinsic  Information</kwd><kwd> LLR</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>Since its introduction, the iterative threshold decoding algorithm (ITDA) [<xref ref-type="bibr" rid="scirp.72299-ref1">1</xref>] of one step majority logic decodable codes has gained great interest [<xref ref-type="bibr" rid="scirp.72299-ref2">2</xref>] [<xref ref-type="bibr" rid="scirp.72299-ref3">3</xref>] [<xref ref-type="bibr" rid="scirp.72299-ref4">4</xref>] and this is for several reasons. In fact, OSMLD codes are a subclass of LDPC codes currently present in most telecoms standards, but can be decoded iteratively by ITDA which is less complex than belief propagation algorithm with approximatively the same performances. Getting the performance of these codes is carried out by simulation to evaluate the evolution of the BER compared to the SNR. However, this operation is very expensive in terms of time, especially for long codes. To address this problem, different techniques have been proposed in the literature to analyze the iterative decoding of concatenated codes [<xref ref-type="bibr" rid="scirp.72299-ref5">5</xref>] [<xref ref-type="bibr" rid="scirp.72299-ref6">6</xref>] [<xref ref-type="bibr" rid="scirp.72299-ref7">7</xref>] . The most used method is based on mutual information known as the Exit (Extrinsic Information Transfer) Chart. Indeed, it has been shown by simulation (case of a frame of large size) [<xref ref-type="bibr" rid="scirp.72299-ref8">8</xref>] that the model used by the extrinsic exchanged between the decoders is Gaussian. Moreover, the study of a single decoder is sufficient to predict the iterative decoding performances.</p><p>All work on the Exit chart have focused around the iterative decoding of convolution codes, however, in this paper, we propose to apply it to analyze the convergence behavior of the iterative decoding threshold of one step majority decodable codes. Our work is distinguished by the fact that the codes used are structural block codes completely different from that of convolutional codes and that are decoded by our iterative decoding algorithm [<xref ref-type="bibr" rid="scirp.72299-ref1">1</xref>] [<xref ref-type="bibr" rid="scirp.72299-ref2">2</xref>] .</p><p>The organization of this article is as follows: Section 2 describes the iterative threshold decoding process. In Section 3, we begin with the presentation of the principle of calculating the Exit Chart and end with behavior analysis of convergence of ITDA when applied in both simple and concatenated OSMLD codes. Section 4 provides some conclusions.</p></sec><sec id="s2"><title>2. Iterative Threshold Decoding Process</title><p>In this section a brief description of our proposed iterative decoding algorithm [<xref ref-type="bibr" rid="scirp.72299-ref1">1</xref>] will be given. We will focus in particular on variables that will serve us for the calculation in the Exit chart.</p><sec id="s2_1"><title>2.1. Soft-In Soft-Out Threshold Decoder</title><p>First, Let us consider a transmission of code word C (n, k, d) of binary symbols {0, 1} using a BPSK modulation over AWGN channel, the decoder soft output for the j<sup>th</sup> bit position of a given soft input R (r<sub>1</sub>, r<sub>2</sub> ・・・ r<sub>n</sub>) is defined as:</p><disp-formula id="scirp.72299-formula381"><label>(1)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/8-1730478x2.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.72299-formula382"><label>(2)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/8-1730478x3.png"  xlink:type="simple"/></disp-formula><p>where J is the number of orthogonal parity check equations in code C, n<sub>i</sub> represents the number of elements in the i<sup>th</sup> orthogonal equation, ik represents the k<sup>th</sup> element of the i<sup>th</sup></p><p>parity check equation orthogonal to the j<sup>th</sup> bit and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/8-1730478x4.png" xlink:type="simple"/></inline-formula>.</p><p>The computation of extrinsic information can be approximated by replacing the formula (2) by:</p><disp-formula id="scirp.72299-formula383"><label>(3)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/8-1730478x5.png"  xlink:type="simple"/></disp-formula><p>Which is a good approximation since it requires only signal adders and comparators and can be most easily implemented without undue deterioration in error performance.</p><p>The algorithmic structure of the SISO threshold decoding can be summarized as follows:</p><p>For each bit <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/8-1730478x6.png" xlink:type="simple"/></inline-formula></p><p>Compute the extrinsic information Le<sub>j</sub> as (3)</p><p>Compute the Soft-input</p><p>Compute de Soft-output: LLR<sub>j</sub> = (4Es/N0) r<sub>j</sub> + Le<sub>j</sub></p><p>Correct de bit r<sub>j</sub></p><p><xref ref-type="table" rid="table1">Table 1</xref> shows some examples of OSMLD codes that can be decoded by theses codes are also known as self orthogonal codes. In this table we used the abbreviations DSC for Difference Set Cyclic codes, EG for Euclidean Geometry codes and BCH for Bose Chaudhuri and Hocquenghem codes. For an extensive description of projective geometry codes and Euclidean geometry can be found in [<xref ref-type="bibr" rid="scirp.72299-ref9">9</xref>] .</p></sec><sec id="s2_2"><title>2.2. Iterative Threshold Decoding Process</title><p>The Iterative decoding process (see <xref ref-type="fig" rid="fig1">Figure 1</xref>) can be described as follows: In the first iteration, the decoder only uses the channel output as input, and generates extrinsic information for each symbol. In subsequent iterations, a combination of extrinsic information and channel output is used as input.</p><p>The soft input respectively the soft output of the q<sup>th</sup> iteration is given by:</p><disp-formula id="scirp.72299-formula384"><label>(4)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/8-1730478x7.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.72299-formula385"><label>(5)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/8-1730478x8.png"  xlink:type="simple"/></disp-formula><p>where R represent the received data, L<sub>e</sub>(q) is the extrinsic information computed by the previous iteration. In our procedure we use a fixed value 1/J for the pparameter <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/8-1730478x9.png" xlink:type="simple"/></inline-formula>and this for all iterations. The value chosen for <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/8-1730478x10.png" xlink:type="simple"/></inline-formula> reacts as if one took an average of all J estimators which contribute in the computation of Le.</p><p>Our iterative decoding process can also be applied to the concatenated codes; in this case R is a matrix whose rows are constructed from the C<sup>1</sup> code and columns from C<sup>2</sup></p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> Set of OSMLD Codes</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >n</th><th align="center" valign="middle" >k</th><th align="center" valign="middle" >J</th><th align="center" valign="middle" >d<sub>min </sub></th><th align="center" valign="middle" >Rate</th><th align="center" valign="middle" >code</th></tr></thead><tr><td align="center" valign="middle" >7</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >0.42</td><td align="center" valign="middle" >DSC</td></tr><tr><td align="center" valign="middle" >21</td><td align="center" valign="middle" >11</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >6</td><td align="center" valign="middle" >0.52</td><td align="center" valign="middle" >DSC</td></tr><tr><td align="center" valign="middle" >63</td><td align="center" valign="middle" >37</td><td align="center" valign="middle" >8</td><td align="center" valign="middle" >9</td><td align="center" valign="middle" >0.58</td><td align="center" valign="middle" >EG</td></tr><tr><td align="center" valign="middle" >73</td><td align="center" valign="middle" >45</td><td align="center" valign="middle" >9</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >0.61</td><td align="center" valign="middle" >DSC</td></tr><tr><td align="center" valign="middle" >255</td><td align="center" valign="middle" >175</td><td align="center" valign="middle" >16</td><td align="center" valign="middle" >17</td><td align="center" valign="middle" >0.68</td><td align="center" valign="middle" >EG</td></tr><tr><td align="center" valign="middle" >273</td><td align="center" valign="middle" >191</td><td align="center" valign="middle" >17</td><td align="center" valign="middle" >18</td><td align="center" valign="middle" >0.69</td><td align="center" valign="middle" >DSC</td></tr><tr><td align="center" valign="middle" >1057</td><td align="center" valign="middle" >813</td><td align="center" valign="middle" >33</td><td align="center" valign="middle" >34</td><td align="center" valign="middle" >0.76</td><td align="center" valign="middle" >DSC</td></tr><tr><td align="center" valign="middle" >4161</td><td align="center" valign="middle" >3431</td><td align="center" valign="middle" >65</td><td align="center" valign="middle" >66</td><td align="center" valign="middle" >0.82</td><td align="center" valign="middle" >DSC</td></tr></tbody></table></table-wrap><p>code. Extrinsic information computed by the SISO decoder of code C<sup>1</sup> is given as a priori information to the second SISO decoder of code C<sup>2</sup>. <xref ref-type="table" rid="table2">Table 2</xref> shows some code built from the concatenation of OSMLD codes.</p><p>We wish to emphasize that our algorithm can be applied to simple majority decoding codes, product codes (PC) or parallel (PCB) [<xref ref-type="bibr" rid="scirp.72299-ref2">2</xref>] , serial concatenated codes [<xref ref-type="bibr" rid="scirp.72299-ref4">4</xref>] and quasi-cyclic codes [<xref ref-type="bibr" rid="scirp.72299-ref3">3</xref>] . Indeed in [<xref ref-type="bibr" rid="scirp.72299-ref10">10</xref>] we showed that our algorithm has a good compromise between complexity and performance compared to the belief propagation algorithm (BP). For example, for the code DSC (273, 191) our algorithm is 5 times faster than BP. <xref ref-type="fig" rid="fig2">Figure 2</xref> depicts the performance of iterative decoding of (1057, 813) DSC code with rate 0.69 on AWGN channel. We can see that the performance improves with each iteration and no improvement after 15<sup>th</sup> iteration, at this stage we can said that the decoding process has converged. The number of iterations for convergence as well as the SNR at which begins the enhancement (Point of separation of the different curves) will be predicted by the Exit chart.</p></sec></sec><sec id="s3"><title>3. Convergence Behavior Analysis</title><sec id="s3_1"><title>3.1. Exit Chart Computation</title><p>EXIT chart [<xref ref-type="bibr" rid="scirp.72299-ref5">5</xref>] [<xref ref-type="bibr" rid="scirp.72299-ref6">6</xref>] [<xref ref-type="bibr" rid="scirp.72299-ref7">7</xref>] [<xref ref-type="bibr" rid="scirp.72299-ref8">8</xref>] has emerged as a useful tool for analyzing convergence behavior of iterative decoding of both Turbo codes and LDPC codes. Theses diagrams propose a graphic visualization of the evolution of the quality of the extrinsic information exchanged between two SISO decoders (Turbo codes) or between variable nodes and check nodes in case of LDPC codes. We succeed to apply EXIT charts technique to our</p><fig id="fig1"  position="float"><label><xref ref-type="fig" rid="fig1">Figure 1</xref></label><caption><title> The block diagram of the q<sup>th</sup> iteration</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/8-1730478x11.png"/></fig><table-wrap id="table2" ><label><xref ref-type="table" rid="table2">Table 2</xref></label><caption><title> Set of concatenated codes</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Concatenated Code</th><th align="center" valign="middle" >Code (C<sup>1</sup>)</th><th align="center" valign="middle" >Code (C<sup>2</sup>)</th><th align="center" valign="middle" >Rate</th></tr></thead><tr><td align="center" valign="middle" >PC (441, 121)</td><td align="center" valign="middle" >DSC (21, 11)</td><td align="center" valign="middle" >DSC (21, 21)</td><td align="center" valign="middle" >0.27</td></tr><tr><td align="center" valign="middle" >PC (1533, 495)</td><td align="center" valign="middle" >DSC (21, 11)</td><td align="center" valign="middle" >DSC (73, 45)</td><td align="center" valign="middle" >0.32</td></tr><tr><td align="center" valign="middle" >PC (4095, 1337)</td><td align="center" valign="middle" >BCH (15, 7)</td><td align="center" valign="middle" >DSC (273, 191)</td><td align="center" valign="middle" >0.32</td></tr><tr><td align="center" valign="middle" >PC (3969, 1369)</td><td align="center" valign="middle" >EG (63, 37)</td><td align="center" valign="middle" >EG (63, 37)</td><td align="center" valign="middle" >0,34</td></tr><tr><td align="center" valign="middle" >PC (5329, 2025)</td><td align="center" valign="middle" >DSC (73, 45)</td><td align="center" valign="middle" >DSC (73, 45)</td><td align="center" valign="middle" >0.37</td></tr><tr><td align="center" valign="middle" >PC (19929, 8595)</td><td align="center" valign="middle" >DSC (73, 45)</td><td align="center" valign="middle" >DSC (273, 191)</td><td align="center" valign="middle" >0.43</td></tr><tr><td align="center" valign="middle" >PCB (17633, 8595)</td><td align="center" valign="middle" >DSC (73, 45)</td><td align="center" valign="middle" >DSC (273, 191)</td><td align="center" valign="middle" >0.48</td></tr><tr><td align="center" valign="middle" >PC (74529, 36481)</td><td align="center" valign="middle" >DSC (273, 191)</td><td align="center" valign="middle" >DSC (273, 191)</td><td align="center" valign="middle" >0.49</td></tr></tbody></table></table-wrap><p>iterative decoding process while only one SISO decoder is used. The evolution of extrinsic information at the output of our SISO decoder is visualized during iterations. <xref ref-type="fig" rid="fig3">Figure 3</xref> represents the simulation model to be implemented for calculation of EXIT chart. Let X denote the binary input to an additive white Gaussian noise AWGN channel, X = {&#177;1}, and L<sub>CH</sub> its corresponding output expressed as a log-likelihood ratio LLR. The soft-input/soft-output (SISO) decoder receives as its input both L<sub>CH</sub> and a priori information L<sub>A</sub>, which is also expressed as a LLR.</p><p>For purposes of the analysis, it is assumed that the sequences {L<sub>A</sub>} and {L<sub>CH</sub>} at the input to the decoder are infinitely long. One can easily show that { L<sub>CH</sub> } Gaussian (conditioned on X) with parameters (2/s&#178;, 4/s&#178;) where s&#178; = N<sub>0</sub>/2Es. Under the assumption that the a priori LLR {L<sub>A</sub>} follows a Gaussian distribution we have <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/8-1730478x12.png" xlink:type="simple"/></inline-formula> where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/8-1730478x13.png" xlink:type="simple"/></inline-formula> and h are a Gaussian variable of zero mean and variance<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/8-1730478x14.png" xlink:type="simple"/></inline-formula>. The mutual information I<sub>A</sub> = I (X; A) between X and A which can be expressed as:</p><disp-formula id="scirp.72299-formula386"><label>(6)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/8-1730478x15.png"  xlink:type="simple"/></disp-formula><fig id="fig2"  position="float"><label><xref ref-type="fig" rid="fig2">Figure 2</xref></label><caption><title> BER performance of (1057, 813) code on AWGN channel</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/8-1730478x16.png"/></fig><fig id="fig3"  position="float"><label><xref ref-type="fig" rid="fig3">Figure 3</xref></label><caption><title> Exit chart computing model</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/8-1730478x17.png"/></fig><p>We put</p><disp-formula id="scirp.72299-formula387"><label>(7)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/8-1730478x18.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/8-1730478x19.png" xlink:type="simple"/></inline-formula> and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/8-1730478x19.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/8-1730478x20.png" xlink:type="simple"/></inline-formula>. The function J is monotonically increasing and can be calculated numerically only once because J and J<sup>−1</sup> are the same for all codes.</p><p>On the other hand the mutual information between the extrinsic LLR of the I<sub>E</sub> and X, I<sub>E</sub> = I (X; E) can be expressed as:</p><p>On the other hand the mutual information between the extrinsic LLR of the I<sub>E</sub> and X, I<sub>E</sub> = I (X; E) can be expressed as:</p><disp-formula id="scirp.72299-formula388"><label>(8)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/8-1730478x21.png"  xlink:type="simple"/></disp-formula><p>It is impossible to express this relation in analytical form; the distributions p<sub>E</sub> is most conveniently determined by means of Monte Carlo simulation. Viewing I<sub>E</sub> as a function of I<sub>A</sub> and the signal to noise ratio SNR value, the extrinsic information transfer characteristics is defined as:</p><disp-formula id="scirp.72299-formula389"><label>(9)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/8-1730478x22.png"  xlink:type="simple"/></disp-formula><p>For a concatenated constructed from C<sup>1</sup> (n1, k1) and C<sup>2</sup> (n2, k2) and a fixed SNR, the different steps of calculation can be summarized as follow:</p><p>Initialize a word w of size (k1 &#215; k2) with bit 0</p><p>Initialize the maximum of iteration at Max</p><p>Modulate w with Binary phase shift key (BPSK)</p><p>Transmit de code word over an AWGN channel</p><p>Do</p><p>Generate L<sub>A</sub> for columns (AWGN/sA) and compute I<sub>A</sub></p><p>Decode Lines of the received word and compute I<sub>E</sub></p><p>sA = sA + (sA/Max)</p><p>Iteration = Iteration + 1</p><p>While (iteration! = Max)</p></sec><sec id="s3_2"><title>3.2. Convergence Analysis of ITD</title><p>In order to guarantee a good approximation of the graphical output, it is convenient to work with blocks of size of the order of 10<sup>5</sup>. However, the approximation of the distribution of L<sub>E</sub> by a Gaussian variable is checked in the case of finite length codes (<xref ref-type="fig" rid="fig4">Figure 4</xref>). This assumption will allow us to validate curves Exits reports rated to the BER curves.</p><p><xref ref-type="fig" rid="fig4">Figure 4</xref> shows the evolution of the distribution of the extrinsic information at the output of the SISO threshold decoder of PC code (74529, 36481). We simulated the transmission of a frame without any approximation.</p><p>Transfer characteristics <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/8-1730478x23.png" xlink:type="simple"/></inline-formula> for different SNR are shown in <xref ref-type="fig" rid="fig5">Figure 5</xref>. The a priori input I<sub>A</sub> is on the abscissa, the extrinsic output IE is on the ordinate. The SISO threshold decoding algorithm is applied to (819, 447) OSMLD code of rate 0.54. The numbers on different curves are the SNR values in dB. The obtained diagrams look like those of Turbo code.</p><fig id="fig4"  position="float"><label><xref ref-type="fig" rid="fig4">Figure 4</xref></label><caption><title> Evolution of the distribution of the extrinsic L<sub>E</sub> based on iterations</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/8-1730478x24.png"/></fig><fig id="fig5"  position="float"><label><xref ref-type="fig" rid="fig5">Figure 5</xref></label><caption><title> Extrinsic information transfer characteristics of SISO decoder for code (819, 447) on AWGN channel</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/8-1730478x25.png"/></fig><p>To view the convergence behavior of the iterative decoding, we draw in the same figure (see <xref ref-type="fig" rid="fig6">Figure 6</xref>) the exit charts of the two decoders. In the case of a symmetrical concatenated code the curve of the second decoder is obtained by inverting the symmetry axis of the I<sub>E</sub> and I<sub>A</sub>.</p><p><xref ref-type="fig" rid="fig6">Figure 6</xref> depicts the Exit chart of the concatenated code PC (74529, 36481) constructed from DSC (273, 191) for SNR 2.5, 3, 3.15 and 3.5 dB. The expected decoding trajectory is the “stairs”-like and can be explained as follows: Let q be the iteration index. For q = 0 the decoding process starts at the origin with zero a priori knowledge I<sub>A</sub><sub>,0</sub> = 0. At iteration q, the extrinsic output I<sub>E</sub><sub>,q</sub> = T (I<sub>A</sub><sub>,q</sub>) is forwarded as a priori knowledge for the next decoder I<sub>A</sub><sub>,q+1</sub> = I<sub>E</sub><sub>,q</sub>, and so on, until I<sub>A</sub> = I<sub>E</sub> = 1 after about 16 iterations. Each step of the staircase curve represents one iteration of the decoding process.</p><p><xref ref-type="fig" rid="fig7">Figure 7</xref> shows the Exit chart curve for iterative decoding of asymmetric concatenated code constructed from DSC (273, 191) and DSC (73, 45) at SNR 2.8 dB. In this case and contrary to the result obtained in the figure 6 we calculated and plotted the transfer curves for each Component elementary decoder. As we can see both transfer curves enters a tunnel at SNR = 2 dB away from the x = y − axis.</p><fig id="fig6"  position="float"><label><xref ref-type="fig" rid="fig6">Figure 6</xref></label><caption><title> Exit charts of PC code (74529, 36481) and decoding trajectory on a Gaussian channel</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/8-1730478x26.png"/></fig><fig id="fig7"  position="float"><label><xref ref-type="fig" rid="fig7">Figure 7</xref></label><caption><title> Exit charts of asymmetric concatenated code (19929, 8595) at SNR = 2.8 dB</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/8-1730478x27.png"/></fig><p>BER chart vs. Exit chart</p><p>Two main regions can be defined from the curve of BER (see <xref ref-type="fig" rid="fig8">Figure 8</xref>). The first is called “pinch-off Region” (for SNR &lt; 2.9 dB) whose BER remains constant and iteration has no effect. The second is called “waterfall Region” (SNR &gt; 2.9 dB) here, the BER decreases excessively when the rate increases SNR. These three regions can be illustrated using the exit chart (see <xref ref-type="fig" rid="fig6">Figure 6</xref>).</p><p>“Pinch-off Region” the two decoders transfer curves cross at small values of mutual information (no convergence).</p><p>“Waterfall Region”: the decoding trajectory enters a tunnel area [<xref ref-type="bibr" rid="scirp.72299-ref5">5</xref>] near the bisector with a slower convergence rate.</p><p>For SNR = 3.15 dB we can observe that the decoding trajectory enters an area of tunnel close to the x = y − axis with a deceleration characteristic of convergence’s speed. The bit error rate (BER) versus SNR performance on AWGN channel is displayed in <xref ref-type="fig" rid="fig8">Figure 8</xref>. As we can observe, the waterfall region appears to take shape at SNR &gt; 2.9 dB, which is 0.25 dB away from Exit chart threshold. This uncertainty of estimate is due mainly to the fact that we use a code with finite length.</p></sec></sec><sec id="s4"><title>4. Conclusion</title><p>In this work, we applied Exit chart as a semi analytic method to predict convergence behavior of our iterative threshold decoding for simple and concatenated OSMLD codes with medium length and a gap of 0.3 dB was found compared to BER chart. This uncertainty of estimate is due mainly to the fact that we use a code with finite length.</p><p>The great interest of Exit chart is mainly due to the time we gain compared to the simulation based on BER. Indeed if we assume that θ is the decoding time of one frame</p><fig id="fig8"  position="float"><label><xref ref-type="fig" rid="fig8">Figure 8</xref></label><caption><title> BER performances of ITD of PC code (74529, 36481) on a Gaussian channel</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/8-1730478x28.png"/></fig><p>and frame it takes to generate the BER is 1000, then the gain is of the order of 1000 &#215; θ. As future work, we plan to apply the Exit on a concatenation of OSMLD codes with a convolutional code of rate 1, but also we believe that the Exit Chart can be applied to other non-linear iterative process such as that used in learning neural network.</p></sec><sec id="s5"><title>Cite this paper</title><p>Lahmer, M., Belkasmi, M. and Rhattoy, A. (2016) Convergence Analysis of Iterative Threshold Decoding Process. Journal of Computer and Communications, 4, 98-107. http://dx.doi.org/10.4236/jcc.2016.414008</p></sec></body><back><ref-list><title>References</title><ref id="scirp.72299-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Belkasmi, M., Lahmer, M. and Benchrifa, M. (2006) Iterative Threshold Decoding of Parallel Concatenated Block Codes. Turbo Coding 2006 Conference, Munich, 4-7 April 2006.</mixed-citation></ref><ref id="scirp.72299-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Lahmer, M. and Belkasmi, M. (2010) A New Iterative Threshold Decoding Algorithm For One Step Majority Logic Decodable Block Codes. International Journal of Computer Applications, 7, No. 7. https:/doi.org/10.5120/1265-1697</mixed-citation></ref><ref id="scirp.72299-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Rkizat, K., Yatribi, A., Lahmer, M. and Belkasmi, M. (2016) Iterative Threshold Decoding of High Rates Quasi-Cyclic OSMLD Codes. International Journal of Advanced Computer Science and Applications, 7, No. 4. https:/doi.org/10.14569/IJACSA.2016.070468</mixed-citation></ref><ref id="scirp.72299-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Ayoub, F., Farchane, A., Askali, M., Belkasmi, M. and Himmi, M. (2016) Serially Concatenated OSMLD Codes Design and Iterative Decoding. Applied Mathematical Sciences, 10, 2179-2188.</mixed-citation></ref><ref id="scirp.72299-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">ten Brink, S. (1999) Convergence of Iterative Decoding. Electronics Letters, 35, 806-808.  
https:/doi.org/10.1049/el:19990555</mixed-citation></ref><ref id="scirp.72299-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Richardson, T. and Urbanke, R. (2000) Thresholds for Turbo Codes. Proceedings of ISIT 2000, Sorrento, Italy, June 2000, 317. https:/doi.org/10.1109/isit.2000.866615</mixed-citation></ref><ref id="scirp.72299-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Richardson, T.J. and Urbanke, R.L. (2001) The Capacity of Low-Density Parity-Check Codes under Message-Passing Decoding. IEEE Transactions on Information Theory, 47, 599-618.  
https:/doi.org/10.1109/18.910577</mixed-citation></ref><ref id="scirp.72299-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">ten Brink, S. (2001) Convergence Behavior of Iteratively Decoded Parallel Concatenated Codes. IEEE Transactions on Communications, 49, 1727-1737.  
https:/doi.org/10.1109/26.957394</mixed-citation></ref><ref id="scirp.72299-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Lin, S. and Costello, D.J. (1983) Error Control Coding, Fundamentals and Applications. Prentice-Hall, Englewood Cliffs, NJ.</mixed-citation></ref><ref id="scirp.72299-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Lahmer, M. and Belkasmi, M. (2007) Iterative Threshold Decoding of One Step Majority Logic Decodable block Codes. ISSPIT Conference, Cairo, Egypt, 15-18 December 2007, 668-673. https:/doi.org/10.1109/isspit.2007.4458188</mixed-citation></ref></ref-list></back></article>