<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">JCC</journal-id><journal-title-group><journal-title>Journal of Computer and Communications</journal-title></journal-title-group><issn pub-type="epub">2327-5219</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/jcc.2017.510004</article-id><article-id pub-id-type="publisher-id">JCC-78363</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Computer Science&amp;Communications</subject></subj-group></article-categories><title-group><article-title>
 
 
  Forward-Backward Synergistic Acceleration Pursuit Algorithm Based on Compressed Sensing
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Bowen</surname><given-names>Zheng</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Guiling</surname><given-names>Sun</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Weijian</surname><given-names>Zhao</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Tianyu</surname><given-names>Geng</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib></contrib-group><aff id="aff1"><addr-line>College of Electronic Information and Optical Engineering, Nankai University, Tianjin, China</addr-line></aff><author-notes><corresp id="cor1">* E-mail:<email>zhengbwen@mail.nankai.edu.cn(BZ)</email>;<email>sungl@nankai.edu.cn(GS)</email>;</corresp></author-notes><pub-date pub-type="epub"><day>30</day><month>07</month><year>2017</year></pub-date><volume>05</volume><issue>10</issue><fpage>26</fpage><lpage>35</lpage><history><date date-type="received"><day>21,</day>	<month>July</month>	<year>2017</year></date><date date-type="rev-recd"><day>8,</day>	<month>August</month>	<year>2017</year>	</date><date date-type="accepted"><day>11,</day>	<month>August</month>	<year>2017</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  
    We propose the Forward-Backward Synergistic Acceleration Pursuit (FBSAP) algorithm in this paper. The FBSAP algorithm inherits the advantages of the Forward-Backward Pursuit (FBP) algorithm, which has high success rate of reconstruction and does not necessitate the sparsity level as a priori condition. Moreover, it solves the problem of FBP that the atom can be selected only by the fixed step size. By mining the correlation between candidate atoms and residuals, we innovatively propose the forward acceleration strategy to adjust the forward step size adaptively and reduce the computation. Meanwhile, we accelerate the algorithm further in backward step by fusing the strategy proposed in Acceleration Forward-Backward Pursuit (AFBP) algorithm. The experimental simulation results demonstrate that FBSAP can greatly reduce the running time of the algorithm while guaranteeing the success rate in contrast to FBP and AFBP. 
  
 
</p></abstract><kwd-group><kwd>Compressed Sensing</kwd><kwd> Reconstruction Algorithm</kwd><kwd> Sparse Signal</kwd><kwd> FBP</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>The theory of Compressed Sensing (CS) [<xref ref-type="bibr" rid="scirp.78363-ref1">1</xref>] [<xref ref-type="bibr" rid="scirp.78363-ref2">2</xref>] [<xref ref-type="bibr" rid="scirp.78363-ref3">3</xref>] proposed by Candes and Donoho in 2006, breaks the limitation that the traditional sampling must satisfy the Nyquist frequency and makes it possible to reconstruct low sampling rate signal. Therefore, CS is widely used in wireless sensor networks [<xref ref-type="bibr" rid="scirp.78363-ref4">4</xref>] [<xref ref-type="bibr" rid="scirp.78363-ref5">5</xref>] , magnetic resonance imaging [<xref ref-type="bibr" rid="scirp.78363-ref6">6</xref>] and video compression [<xref ref-type="bibr" rid="scirp.78363-ref7">7</xref>] etc.</p><p>The major research direction of CS includes signal sparse transformation, design of measurement matrix and signal reconstruction algorithm. The reconstruction algorithms are divided into three categories: greedy algorithms, relaxation algorithms and hybrid algorithms. Greedy algorithms are built upon a series of locally optimal single-term updates, including Matching Pursuit (MP) [<xref ref-type="bibr" rid="scirp.78363-ref8">8</xref>] and Orthogonal Matching Pursuit (OMP) [<xref ref-type="bibr" rid="scirp.78363-ref9">9</xref>] etc. Relaxation algorithms are based on convex optimization techniques, which can smooth the l 0 norm and replace it with a continuous function that can be handled using classic optimization, including Basis Pursuit (BP) [<xref ref-type="bibr" rid="scirp.78363-ref10">10</xref>] and Iterative Reweighted Least-Squares (IRLS) [<xref ref-type="bibr" rid="scirp.78363-ref11">11</xref>] etc. Hybrid algorithms include Subspace-Pursuit (SP) [<xref ref-type="bibr" rid="scirp.78363-ref12">12</xref>] , Compressive Sampling Matching Pursuit (CoSaMP) [<xref ref-type="bibr" rid="scirp.78363-ref13">13</xref>] and Iterative Hard Thresholding (IHT) [<xref ref-type="bibr" rid="scirp.78363-ref14">14</xref>] etc.</p><p>FBP is a novel two-stage greedy approach proposed by N. B. Karahanoglu and H. N. Erdogan in reference [<xref ref-type="bibr" rid="scirp.78363-ref15">15</xref>] . It enlarges the estimated support set by α atoms in forward step and eliminates β atoms from the estimated support set in backward step. The disadvantage of the FBP is that it can only enlarge and reduce the estimated support set with a fixed step size. In view of this, Paper [<xref ref-type="bibr" rid="scirp.78363-ref16">16</xref>] proposed Acceleration Forward-Backward Pursuit (AFBP) algorithm, selected the high quality atoms again in backward step. Based on this, we propose the Forward-Backward Synergistic Acceleration Pursuit (FBSAP) algorithm in this paper, which can reduce the atoms selected in the forward step adaptively according to the quality of atoms. Thus the algorithm is further accelerated when we restructure sparse signals, especially the signals which have large amount of data. This greatly improves the practicability of reconstruction algorithms.</p><p>The remainder of the paper is organized as follows. Section 2 briefs the theory of CS and the FBP algorithm. Section 3 introduces the acceleration strategy we used and the specific process of FBSAP. Section 4 presents the simulation results. Finally, conclusion is present in Section 5.</p></sec><sec id="s2"><title>2. Compressed Sensing Theory and Recovery Algorithm</title><sec id="s2_1"><title>2.1. The Theory of Compressed Sensing</title><p>Compressed Sensing aims at restructuring the signal by excavating its sparse feature when the information is sampled in very low sampling rate. The sampling process is represented by</p><p>y = Φ x (1)</p><p>where x is a K-sparse one-dimensional signal of length N, K is the number of nonzero elements in x . Φ is a M &#215; N two-dimensional observation matrix with K &lt; M &lt; N . y is a one-dimensional measurement vector of length M. The purpose of CS is to obtain the signal x by using the measurement vector y and the observation matrix Φ .</p></sec><sec id="s2_2"><title>2.2. The Forward-Backward Pursuit Algorithm</title><p>Without the sparsity K to be known a priori, FBP can reconstruct the sparse signal exactly by selecting atoms with fixed forward and backward step size in contrast to other reconstruction algorithms. The pseudo code of the FBP is given in Algorithm 1. It expands the estimated support set by selecting α atoms with highest correlation in the forward step and reduces the size of the estimated support set by eliminating β atoms with smallest contributions to the projection.</p><disp-formula id="scirp.78363-formula1"><graphic  xlink:href="//html.scirp.org/file/4-1730674x17.png"  xlink:type="simple"/></disp-formula></sec></sec><sec id="s3"><title>3. Forward-Backward Synergistic Acceleration Pursuit Algorithm</title><sec id="s3_1"><title>3.1. The Acceleration Strategy</title><p>The FBP algorithm can be accelerated by two ways: reducing α and enlarging α − β . The strategy mentioned in [<xref ref-type="bibr" rid="scirp.78363-ref16">16</xref>] has the effect of enlarging the α − β , but it doesn’t change the number of atoms selected in the forward step.</p><p>It is not every atom selected in the forward step correct. The wrong atoms are more if the signal is very sparse or after many iterations. A fixed number of atoms are selected in every forward step that increases the computation. We observed the correlation levels of the observation matrix and residuals at first. The results are shown in <xref ref-type="fig" rid="fig1">Figure 1</xref>. We found that the correlation levels</p><p>present ladder-form. Some atoms have the same correlation level such as atoms 2-5, and there is a big ladder between them and the other atoms. The ladder is especially obvious after some iterations. The correlation level of atom 1 is significantly higher than the others. With the above analysis, it is completely unnecessary selecting α atoms in every iteration. Only need to find the last obvious ladder and choose the atoms before it. We can reduce α by this way and accelerate the algorithm.</p><p>We adopt the backward acceleration strategy proposed by [<xref ref-type="bibr" rid="scirp.78363-ref16">16</xref>] in this paper. The main idea of this strategy is giving the atoms corresponding weights according to the correlation levels between atoms and residuals, and then resetting the atom into support set in backward step if its cumulative weight is greater than a threshold, so that we can select multiple atoms in each iteration.</p></sec><sec id="s3_2"><title>3.2. Forward-Backward Synergistic Acceleration Pursuit Algorithm</title><p>The details of FBSAP are shown in Algorithm 2. First, Calculate the correlation levels between atoms and residuals and represent them as set m , meanwhile, calculate the corresponding weights of atoms and save them to set w . Then, Calculate the differences between adjacent elements in w and represent as set g . In order to ensure the simplicity and effectiveness of the algorithm, we think there is a ladder between m i and m i + 1 if an element g i in g is greater than threshold γ . If we cannot find any ladder or the index of the last ladder is greater than α , set the forward step size f as fixed step size α . Otherwise, set f as the index of the last ladder. Next, select f atoms into support set and set the backward step size b as f − 1 . In the backward step, we eliminate b atoms from support set which have the smallest projection coefficients. Then reset the atom whose cumulative weight is greater than η into support set.</p><disp-formula id="scirp.78363-formula2"><graphic  xlink:href="//html.scirp.org/file/4-1730674x43.png"  xlink:type="simple"/></disp-formula></sec></sec><sec id="s4"><title>4. Experimental Results and Analysis</title><sec id="s4_1"><title>4.1. The Effect of Restructuring Sparse Signals</title><p>The reconstruction quality should not be reduced while improve the speed of the algorithm. So the FBSAP is compared with FBP and AFBP in three aspects, exact reconstruction rate, average normalized mean squared error (ANMSE) and running time. The signals we used are Gauss sparse signal and uniform sparse signal. The nonzero entries of Gaussian sparse signals are drawn from the standard Gaussian distribution. Nonzero elements of the uniform sparse signals are distributed uniformly in [ − 1 , 1 ] . A different observation matrix is drawn from the Gaussian distribution with mean 0 and standard deviation 1 / N for each test signal. The simulation system information is as follows. Matlab Version: 2016a, Operating System: Windows 10(64-bit), CPU: Intel(R) Core(TM) i7-6700HQ CPU@2.60 GHz, Memory: 8 GB.</p><p>The length of signal is N = 512 . The length of measurement vector is M = 200. The sparsity K is between 10 and 90. We repeat 1000 experiments and use different sparse signal and measurement matrix for each sparsity K . The exact reconstruction rate is the ratio of accurate reconstruction times and total experiment times. The condition of accurate reconstruction is ‖ x − x ^ ‖ 2 ≤ 10 − 2 ‖ x ‖ 2 , where x ^ is the reconstruction vector of x . The ANMSE is represented as</p><p>A N M S E = 1 1000 ∑ i = 1 1000 ‖ x i − x ^ i ‖ 2 2 ‖ x i ‖ 2 2 (2)</p><p>The running time is represented as the total time of 1000 experiments. We set maximum support set size K max = M / 2 and termination parameter ε = 1 0 − 6 .</p><p>It is pointed out in [<xref ref-type="bibr" rid="scirp.78363-ref15">15</xref>] that FBP have the best reconstruction effect while α ∈ [ 0.2 M , 0.3 M ] and β = α − 1 . We find that FBP has the highest exact reconstruction rate while α = 0.3 M . So we select α = 0.3 M and β = α − 1 in the tests. [<xref ref-type="bibr" rid="scirp.78363-ref16">16</xref>] points out that algorithm has the best effect while η 1 = 0.07 M , η 1 &lt; η 2 &lt; η 3 and only consider the first 0.2 M atoms. So we set η 1 = 0.07 M , η 2 = η 1 + 1 , η 3 = η 1 + 2 , s 1 = 0.05 M , s 2 = 0.1 M , s 3 = 0.2 M , w 1 = 2.0 , w<sub>2</sub> = 1.5, w 3 = 1.0 . We set the ladder threshold parameter as γ = 0.002 . The influence of γ will be discuss in 4.3.</p><p><xref ref-type="fig" rid="fig2">Figure 2</xref> shows the reconstruction result for Gauss sparse signals. It is shown that the exact reconstruction rate of FBSAP is almost same as AFBP and slightly higher than FBP, the ANMSE of FBSAP is slightly lower than FBP and almost equals to AFBP. So FBSAP can ensure the success rate of reconstruction. The</p><p>running time is obviously shorter than FBP and AFBP. While the signal is very sparse, the running time of AFBP is almost same as FBP. It is mentioned in [<xref ref-type="bibr" rid="scirp.78363-ref16">16</xref>] that the size of η is close to K , there is almost no atom is selected into support set through acceleration channel. But FBSAP has good performance, the reason is that FBSAP can greatly shorten the forward step size while the signal is very sparse.</p><p><xref ref-type="fig" rid="fig3">Figure 3</xref> are the result for uniform sparse signal. It is similar to restructuring Gauss sparse signal, FBSAP also has obvious acceleration effect while restructures uniform sparse signal.</p></sec><sec id="s4_2"><title>4.2. The Acceleration Effect of FBSAP</title><p>FBSAP is accelerated by shorten forward step size. Therefore, it performs better while the size of signal is large. In order to describe the acceleration effect better, we define acceleration rate as</p><p>A r = ∑ i = 1 1000 T a i ∑ i = 1 1000 T o i (3)</p><p>where T a i is the ith running time of acceleration algorithm, T o i is the ith running time of original algorithm. The acceleration rate is lower, the acceleration effect is better.</p><p><xref ref-type="fig" rid="fig4">Figure 4</xref> show the acceleration rate for Gauss sparse signals. <xref ref-type="fig" rid="fig5">Figure 5</xref> are the</p><p>result for uniform sparse signals. The figures show that the acceleration effect of FBSAP is better than AFBP for all signal sizes and sparsity levels. The acceleration effect is particularly evident when the size of signal is large and the sparsity level is low. For example, while N = 768 and K = 30 , the AFPB costs 80 percent of FBP’s running time, But FBSAP only costs 40 percent. With the decrease of sparsity, AFBP gradually loses the acceleration effect, but the effect of FBSAP become more obvious.</p></sec><sec id="s4_3"><title>4.3. The Influence of Ladder Threshold Parameter</title><p>The reconstruction effect is influenced by γ . The selection of γ depends on the height of correlation ladder. If the value of γ is too large, we will not find the accurate ladders, lose many correct atoms, and reduce the success rate of reconstruction. If it is very large, we even cannot find any ladder and completely lose the acceleration effect. If it is too small, we will find many no obvious ladders, so that select too many atoms into support set, reduce the algorithm’s speed. Therefore, it is very important to select the appropriate γ .</p><p><xref ref-type="fig" rid="fig6">Figure 6</xref> are the reconstruction effect for Gauss sparse signals. The parameters of FBSAP1 to FBSAP4 are γ = 0.0001 , γ = 0.001 , γ = 0.002 and γ = 0.004 . We find that the reconstruction speed is fastest while γ = 0.001 , but the exact reconstruction rate and ANMSE is not good. A large number of experiments show that FBSAP has the best reconstruction effect when γ = 0.002 .</p></sec></sec><sec id="s5"><title>5. Conclusion</title><p>We propose the Forward-Backward Synergistic Acceleration Pursuit algorithm in this paper. FBSAP is based on FBP and fuses the backward acceleration strategy proposed in AFBP. We adequately explore the correlation between candidate atoms and residuals and innovatively propose forward acceleration strategy. By adaptively adjusting the forward step size, FBSAP solves the problem that FBP can only select a fixed number of atoms in each iteration. We greatly reduce the calculation cost by reducing the number of atoms in forward step and only consume about half the time of FBP while ensuring the accuracy of reconstruction.</p></sec><sec id="s6"><title>Acknowledgements</title><p>This work was supported by Tianjin Key Laboratory of Optoelectronic Sensor and Sensing Network Technology.</p></sec><sec id="s7"><title>Cite this paper</title><p>Zheng, B.W., Sun, G.L., Geng, T.Y. and Zhao, W.J. (2017) Forward-Backward Synergistic Acceleration Pursuit Algorithm Based on Compressed Sensing. Journal of Computer and Communications, 5, 26-35. https://doi.org/10.4236/jcc.2017.510004</p></sec></body><back><ref-list><title>References</title><ref id="scirp.78363-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Donoho, D.L. (2006) Compressed Sensing. IEEE Transactions on Information Theory, 52, 1289-1306.&lt;/br&gt;https://doi.org/10.1109/TIT.2006.871582</mixed-citation></ref><ref id="scirp.78363-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Candes, E.J., Romberg, J. and Tao, T. (2006) Robust Uncertainty Principles: Exact Signal Reconstruction from Highly Incomplete Frequency Information. IEEE Transactions on Information Theory, 52, 489-509. &lt;/br&gt;https://doi.org/10.1109/TIT.2005.862083</mixed-citation></ref><ref id="scirp.78363-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Candes, E.J. and Wakin, M.B. (2008) An Introduction To Compressive Sampling. IEEE Signal Processing Magazine, 25, 21-30. &lt;/br&gt;https://doi.org/10.1109/MSP.2007.914731</mixed-citation></ref><ref id="scirp.78363-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Xie, R. and Jia, X. (2014) Transmission-Efficient Clustering Method for Wireless Sensor Networks Using Compressive Sensing. IEEE Transactions on Parallel and Distributed Systems, 25, 806-815.&lt;/br&gt;https://doi.org/10.1109/TPDS.2013.90</mixed-citation></ref><ref id="scirp.78363-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Li, C., Wang, J. and Li, M. (2016) Efficient Data Transmission of Wireless Sensor Networks through Compressive Sensing and Matrix Completion. International Journal of Wireless Information Networks, 23, 135-140. &lt;/br&gt;https://doi.org/10.1007/s10776-016-0303-6</mixed-citation></ref><ref id="scirp.78363-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Zhang, Y., Wang, S., Ji, G. and Dong, Z. (2014) Exponential Wavelet Iterative Shrinkage Thresholding Algorithm with Random Shift for Compressed Sensing Magnetic Resonance Imaging. IEEJ Transactions on Electrical and Electronic Engineering, 10, 116-117.&lt;/br&gt;https://doi.org/10.1002/tee.22059</mixed-citation></ref><ref id="scirp.78363-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Koller, R., Schmid, L., Matsuda, N., et al. (2015) High Spatio-Temporal Resolution Video with Compressed Sensing. Optics Express, 23, 15992. &lt;/br&gt;https://doi.org/10.1364/OE.23.015992</mixed-citation></ref><ref id="scirp.78363-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Mallat, S.G. and Zhang, Z. (1993) Matching Pursuits with Time-Frequency Dictionaries. IEEE Transactions on Signal Processing, 41, 3397-3415. &lt;/br&gt;https://doi.org/10.1109/78.258082</mixed-citation></ref><ref id="scirp.78363-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Tropp, J.A. and Gilbert, A.C. (2007) Signal Recovery from Random Measurements via Orthogonal Matching Pursuit. IEEE Transactions on Information Theory, 53, 4655-4666.&lt;/br&gt;https://doi.org/10.1109/TIT.2007.909108</mixed-citation></ref><ref id="scirp.78363-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Chen, S.S., Donoho, D.L. and Saunders, M.A. (2001) Atomic Decomposition by Basis Pursuit. SIAM Review, 43, 129-159.&lt;/br&gt;https://doi.org/10.1137/S003614450037906X</mixed-citation></ref><ref id="scirp.78363-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Daubechies, I., DeVore, R., Fornasier, M., and Güntürk, C.S. (2010) Iteratively Reweighted Least Squares Minimization for Sparse Recovery. Communications on Pure and Applied Mathematics, 63, 1-38. &lt;/br&gt;https://doi.org/10.1002/cpa.20303</mixed-citation></ref><ref id="scirp.78363-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Dai, W. and Milenkovic, O. (2009) Subspace Pursuit for Compressive Sensing Signal Reconstruction. IEEE Transactions on Information Theory, 55, 2230-2249. &lt;/br&gt;https://doi.org/10.1109/TIT.2009.2016006</mixed-citation></ref><ref id="scirp.78363-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Needell, D. and Tropp, J.A. (2009) CoSaMP: Iterative Signal Recovery from Incomplete and Inaccurate Samples. Applied and Computational Harmonic Analysis, 26, 301-321.</mixed-citation></ref><ref id="scirp.78363-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">Blumensath, T. and Davies, M.E. (2009) Iterative Hard Thresholding for Compressed Sensing. Applied and Computational Harmonic Analysis, 27, 265-274.</mixed-citation></ref><ref id="scirp.78363-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Karahanoglu, N.B. and Erdogan, H. (2013) Compressed Sensing Signal Recovery via Forward-Backward Pursuit. Digital Signal Processing, 23, 1539-1548.</mixed-citation></ref><ref id="scirp.78363-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">Wang, F., Sun, G., Zhang, J. and He, J.F. (2016) Acceleration Forward-Backward Pursuit Algorithm Based on Compressed Sensing. Journal of Electronics &amp; Information Technology, 38, 2538-2545.&lt;/br&gt;http://www.en.cnki.com.cn/Article_en/CJFDTotal-DZYX201610018.htm</mixed-citation></ref></ref-list></back></article>