<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">JSIP</journal-id><journal-title-group><journal-title>Journal of Signal and Information Processing</journal-title></journal-title-group><issn pub-type="epub">2159-4465</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/jsip.2019.101002</article-id><article-id pub-id-type="publisher-id">JSIP-89101</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Computer Science&amp;Communications</subject></subj-group></article-categories><title-group><article-title>
 
 
  A Universal Approach to Designing an Image Interpolator with an Image Smoothing Filter
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Min-Cheng</surname><given-names>Pan</given-names></name><xref ref-type="aff" rid="aff1"><sub>1</sub></xref></contrib></contrib-group><aff id="aff1"><label>1</label><addr-line>Department of Electronic Engineering, Tungnan University, Taiwan</addr-line></aff><pub-date pub-type="epub"><day>03</day><month>12</month><year>2018</year></pub-date><volume>10</volume><issue>01</issue><fpage>12</fpage><lpage>18</lpage><history><date date-type="received"><day>27,</day>	<month>September</month>	<year>2018</year></date><date date-type="rev-recd"><day>10,</day>	<month>December</month>	<year>2018</year>	</date><date date-type="accepted"><day>13,</day>	<month>December</month>	<year>2018</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  A number of conventional interpolation techniques have been proposed. However, it seems that there do not exist good criteria for the design of optimal linear interpolators. Also, such an interpolator can hardly provide a satisfactory solution for interpolating noisy images. In this paper, the novelty of this research is that a universal approach is proposed to design an image interpolator with any one image smoothing filter, thereby not only interpolating a down-sampled image but also preserving the characteristics of the performing filtering.
 
</p></abstract><kwd-group><kwd>Interpolator</kwd><kwd> Smoothing Filter</kwd><kwd> Down-Sampled Image</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>As known, the process of decimation or down-sampling is an effective way aid often used to reduce image sizes, thus reducing the amount of information transmitted through the communication channels and the local storage requirements, while trying to preserve as much as possible the image quality. Conversely, the reverse procedure of this, referred to as interpolation or up-sampling, is useful in restoring the original high resolution image from its decimated version or for resizing or zooming a digital image. Decimation and interpolation are used for several purposes in many practical applications, such as progressive image transmission systems, image zooming, photographic enlarging, image reconstruction, optical scanners, high resolution printer, and in multi-media applications which require browsing or retrieval of images from the internet or image and video databases. These problems are further aggravated in the case of color images which usually require larger storage capacity and processing time.</p><p>A number of conventional interpolation techniques have been proposed in the literature to increase the spatial resolution of an image [<xref ref-type="bibr" rid="scirp.89101-ref1">1</xref>] [<xref ref-type="bibr" rid="scirp.89101-ref2">2</xref>] [<xref ref-type="bibr" rid="scirp.89101-ref3">3</xref>] . Often, image interpolation is performed by pixel replication in a small neighborhood of each existing pixel. This is equivalent to a first-order linear filter. Obviously, such a scheme is very simple, but can hardly provide a satisfactory solution. In particular, the resulting blocking artifacts and blurring are quite annoying. The performance can be slightly improved by employing higher-order linear filters [<xref ref-type="bibr" rid="scirp.89101-ref4">4</xref>] [<xref ref-type="bibr" rid="scirp.89101-ref5">5</xref>] [<xref ref-type="bibr" rid="scirp.89101-ref6">6</xref>] . However, it seems that there do not exist good criteria for the design of optimal linear interpolators. Also, such an interpolator can hardly provide a satisfactory solution for interpolating noisy images. As known, linear interpolation is generally preferred not for the performance but for computational simplicity whereas adaptive methods aim to avoid these problems by analyzing the local structure of the source image and using different interpolation functions with different areas of support. Several algorithms [<xref ref-type="bibr" rid="scirp.89101-ref7">7</xref>] [<xref ref-type="bibr" rid="scirp.89101-ref8">8</xref>] [<xref ref-type="bibr" rid="scirp.89101-ref9">9</xref>] [<xref ref-type="bibr" rid="scirp.89101-ref10">10</xref>] have been proposed to improve the subjective quality of the interpolated images by imposing more accurate models. However, few of them concern the problem of dealing with noisy images. In this paper, the novelty of this research is that a universal approach is proposed to design an image interpolator with any one image smoothing filter, thereby not only interpolating a down-sampled image but also preserving the characteristics of the used filter.</p><p>Following the above introduction, this paper is organized as follows. Section 2 describes in detail the approach to designing an interpolator with a smoothing filter. Section 3 illustrates some examples of the approach proposed here, the interpolators designed with a mean filter, a median filter or a probability filter. Experimental results and evaluations are shown to highlight the approach in Section 4 and finally some concluding remarks are drawn in Section 5.</p></sec><sec id="s2"><title>2. Approach to Designing an Interpolator</title><p>In this paper, we propose a universal approach for simultaneous image interpolation and smoothing by utilizing the smoothing filter coupled with a pyramidal decomposition shown as in <xref ref-type="fig" rid="fig1">Figure 1</xref>; furthermore, the approach includes three steps to accomplish interpolation.</p><p>Step 1: Any one pixel in a down-sampled image is decomposed into four pixels; for example, g i , j ( k , l ) are obtained from g i , j , the (k, l) of which are (−1, −1), (−1, 1), (1, −1), and (1, 1), respectively.</p><p>Step 2:</p><p>1) g i , j ( − 1 , − 1 ) is determined with the four original pixels, g i , j , g i − 1 , j − 1 , g i − 1 , j , and g i , j − 1 .</p><p>2) g i , j ( − 1 , 1 ) is determined with the four original pixels, g i , j , g i − 1 , j + 1 , g i − 1 , j , and g i , j + 1 .</p><p>3) g i , j ( 1 , − 1 ) is determined with the four original pixels, g i , j , g i + 1 , j − 1 , g i + 1 , j , and g i , j − 1 .</p><p>4) g i , j ( 1 , 1 ) is determined with the four original pixels, g i , j , g i + 1 , j + 1 , g i + 1 , j , and g i , j + 1 .</p><p>Step 3: The interpolated pixel is determined by using the smoothing filter performed on the four original pixels. If odd pixels are needed, g i , j is repeatedly added in convenience; for example, a median filter is applied.</p></sec><sec id="s3"><title>3. Interpolator Derived from Smoothing Filters</title><p>In this section, we illustrate the approach discussed in Sec. 2 with interpolators derived from a mean filter, a median filter, or a probability filter.</p><sec id="s3_1"><title>3.1. Interpolator Based on the Mean Filter</title><p>The interpolator derived from the mean filter can be expressed as Equation (1).</p><p>g i , j ( k , l ) = ( g i , j + g i + k , j + g i , j + l + g i + k , j + l ) / 4 (1)</p><p>where (k, l) = (−1, −1), (−1, 1), (1, −1), (1, 1) shown as in <xref ref-type="fig" rid="fig1">Figure 1</xref>.</p></sec><sec id="s3_2"><title>3.2. Interpolator Based on the Median Filter</title><p>Similarly, the interpolator derived from the median filter can be expressed as Equation (2).</p><p>g i , j ( k , l ) = m e d i a n { g i , j , g i + k , j , g i , j + l , g i + k , j + l } (2)</p><p>where (k, l) = (−1, −1), (−1, 1), (1, −1), (1, 1).</p></sec><sec id="s3_3"><title>3.3. Interpolator Based on the Probability Filter</title><p>Originally, a probability filter [<xref ref-type="bibr" rid="scirp.89101-ref11">11</xref>] is designed for image smoothing or integration with variable weights which are interpreted as probabilities of respective pixel values in a local neighborhood of the current estimated pixel. The algorithm of this filter is explained in more detail as follows. f * ( i , j ) , the restored pixel at (i, j), is defined as</p><p>f * ( i , j ) = ∑ k = − n n ∑ l = − n n p ( i + k , j + l ) g ( i + k , j + l ) (3)</p><p>where p ( i + k , j + l ) , the probability function of a (2n+1) by (2n+1) mask, is given as below:</p><p>p ( i + k , j + l ) = exp { − [ g ( i + k , j + l ) − g &#175; ( i , j ) ] 2 / 2 T 1 2 } / N o r m 1 ,     k ,   l = − n , ⋯ , − 1 , 0 , 1 , ⋯ , n (4)</p><p>and</p><p>N o r m 1 = ∑ k = − n n ∑ l = − n n exp { − [ g ( i + k , j + l ) − g &#175; ( i , j ) ] 2 / 2 T 1 2 } (5)</p><p>T 1 = 1 ( 2 n + 1 ) 2 ∑ k = − n n ∑ l = − n n | g ( i + k , j + l ) − g &#175; ( i , j ) | (6)</p><p>g &#175; ( i , j ) and g ( i + k , j + l ) are the average of all pixels in the mask centered at (i, j) and the gray level of the pixel at g ( i + k , j + l ) , respectively.</p><p>For the purpose of image interpolation with noise removal, this probability filter is modified as follows. According the pyramidal decomposition as <xref ref-type="fig" rid="fig1">Figure 1</xref>, the new interpolated pixel, g i , j ( k , l ) , yielded from the original pixel, g i , j , can be defined as below:</p><p>g i , j ( k , l ) = ( p i , j g i , j + p i + k , j g i + k , j + p i , j + l g i , j + l + p i + k , j + l g i + k , j + l ) / N o r m 2 (7)</p><p>where</p><p>p i , j = w &#215; exp [ − ( g i , j − g &#175; ) 2 / 2 T 2 2 ] (8)</p><p>p i + k , j = exp [ − ( g i + k , j − g &#175; ) 2 / 2 T 2 2 ] (9)</p><p>p i , j + l = exp [ − ( g i , j + l − g &#175; ) 2 / 2 T 2 2 ] (10)</p><p>p i + k , j + l = exp [ − ( g i + k , j + l − g &#175; ) 2 / 2 T 2 2 ] (11)</p><p>N o r m 2 = ( p i , j + p i + k , j + p i , j + l + p i + k , j + l ) / 4 (12)</p><p>g &#175; = ( g i , j + g i + k , j + g i , j + l + g i + k , j + l ) / 4 (13)</p><p>T 2 = ( | g i , j − g &#175; | + | g i + k , j − g &#175; | + | g i , j + l − g &#175; | + | g i + k , j + l − g &#175; | ) / 4 (14)</p><p>and w, a weight number, is chosen to be 1.5 here and (k, l) = (−1, −1), (−1, 1), (1, −1), (1, 1) shown as in <xref ref-type="fig" rid="fig1">Figure 1</xref>.</p><p>As previous discussion, the interpolator associated with the probability filter, (8)~(15), employs the characteristics of interpolating an image with noise removal. Furthermore, the difference of the mean filtering, median filtering, and probability filtering has been discussed and illustrated as described in [<xref ref-type="bibr" rid="scirp.89101-ref11">11</xref>] .</p></sec></sec><sec id="s4"><title>4. Results and Discussions</title><p>In this section, the interpolators are performed on two categories, grey-level and color images, including the following three cases: 1) case 1: noiseless images, 2) case 2: images with impulse noise, and 3) case 3: images with Gaussian white noise. The results of interpolated images through five kinds of interpolators (a bilinear interpolator, a spline interpolator, and three filters designed in Sec. 3,) are to be compared with each other. The mean square error (M.S.E.) is adopted for the measure of evaluation. A 50 &#215; 80 image of clown was used to be interpolated and obtained a “100 &#215; 160” interpolated image.</p><p><xref ref-type="fig" rid="fig2">Figure 2</xref> demonstrates case 1. As shown in <xref ref-type="fig" rid="fig2">Figure 2</xref>, less difference is visualized but there is some difference among them in MSEs which are 106.9361, 106.9361, 21.5693, 22.4969, and 21.5758 forFigures 2(d)-(h) corresponding to <xref ref-type="fig" rid="fig2">Figure 2</xref>(b), respectively. <xref ref-type="fig" rid="fig3">Figure 3</xref> demonstrates case 2. Obviously, <xref ref-type="fig" rid="fig3">Figure 3</xref>(g) and <xref ref-type="fig" rid="fig3">Figure 3</xref>(h) are improved with less noise; MSEs are 157.1737, 188.4837, 29.6231, 25.9398, and 26.2405 for Figures 3(d)-(h) corresponding to <xref ref-type="fig" rid="fig3">Figure 3</xref>(b), respectively. Thus, the interpolation using median or probability filtering is suggested for interpolating images with impulse noise. <xref ref-type="fig" rid="fig4">Figure 4</xref> demonstrates case 3. As shown in <xref ref-type="fig" rid="fig4">Figure 4</xref>, <xref ref-type="fig" rid="fig4">Figure 4</xref>(f) and <xref ref-type="fig" rid="fig4">Figure 4</xref>(h) are better than other; MSEs are 153.8532, 175.6014, 25.7838, 26.7301, and 25.7365 forFigures 4(d)-(h) corresponding to <xref ref-type="fig" rid="fig4">Figure 4</xref>(b), respectively. As can be seen, the interpolation using mean or probability filtering is recommended for interpolating images with Gaussian white noise.</p><p>As can be seen, a bilinear or a spline interpolation demonstrates a good visual quality as other three interpolation do in noiseless images; however, when an image with unknown noise is to be processed, the interpolation with the proposed approach cooperated with probability filtering is best choice whereas a bilinear or a spline interpolation enhances noise.</p></sec><sec id="s5"><title>5. Conclusion</title><p>This paper has developed the approach to designing an interpolator based on a smoothing filter. Such a universal approach can generalize the application of the image smoothing filter for the purpose of interpolation and smoothing simultaneously. According to the above discussion, the interpolation using probability filtering is optimal either for noiseless images or for noisy images.</p></sec><sec id="s6"><title>Acknowledgements</title><p>The work is substantially supported by a grant from the MOST in Taiwan (Project No. MOST 106-2221-E-236-007).</p></sec><sec id="s7"><title>Conflicts of Interest</title><p>The author declares no conflicts of interest regarding the publication of this paper.</p></sec><sec id="s8"><title>Cite this paper</title><p>Pan, M.-C. (2019) A Universal Approach to Designing an Image Interpolator with an Image Smoothing Filter. Journal of Signal and Information Processing, 10, 12-18. https://doi.org/10.4236/jsip.2019.101002</p></sec></body><back><ref-list><title>References</title><ref id="scirp.89101-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Lehmann, T.M., G&amp;#246;nner, C. and Spitzer, K. (1999) Survey: Interpolation Methods in Medical Image Processing. IEEE Transactions on Medical Imaging, 18, 1049-1074. https://doi.org/10.1109/42.816070</mixed-citation></ref><ref id="scirp.89101-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Vaquero, D., Turk, M., Pulli, K. Tico, M. and Gelfand, N. (2010) A Survey of Image Retargeting Techniques. SPIE Optical Engineering Applications, 7798, Article ID: 779814. https://doi.org/10.1117/12.862419</mixed-citation></ref><ref id="scirp.89101-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Zhen, R.W. and Stevenson, R.L. (2015) Color Image and Video Enhancement: Chapter 2-Image Demosaicing.</mixed-citation></ref><ref id="scirp.89101-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Gulati, T. and Sinha, H.P. (2014) Interpolating Low Resolution MRI Images Using Polynomial Based Interpolation. International Journal of Engineering Trends and Technology, 10, 626-631. https://doi.org/10.14445/22315381/IJETT-V10P325</mixed-citation></ref><ref id="scirp.89101-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Thevenaz. T.B. and Unser, M. (2004) Linear Interpolation Revitalized. IEEE Transaction on Image Processing, 13, 710-719. https://doi.org/10.1109/TIP.2004.826093</mixed-citation></ref><ref id="scirp.89101-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Meijering, E.H.W., Zuiderveld, K.J. and Viergever, M.A. (1999) Image Reconstruction by Convolution with Symmetrical Piecewise nth-Order Polynomial Kernels. IEEE Transactions on Image Processing, 8, 192-201.https://doi.org/10.1109/83.743854</mixed-citation></ref><ref id="scirp.89101-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Carrato, S., Ramponi, G. and Marsi, S. (1996) A Simple Edge-Sensitive Image Interpolation Filter. Proceedings of IEEE on International Conference of Image Processing, 3, 711-714. https://doi.org/10.1109/ICIP.1996.560778</mixed-citation></ref><ref id="scirp.89101-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Li, X. and Orchard, M. (2001) New Edge Directed Interpolation. IEEE Transactions on Image Processing, 10, 1521-1527. https://doi.org/10.1109/83.951537</mixed-citation></ref><ref id="scirp.89101-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Kirshner, H. and Porat, M. (2009) On the Role of Exponential Splines in Image Interpolation. IEEE Transactions on Image Processing, 18, 2198-2208.https://doi.org/10.1109/TIP.2009.2025008</mixed-citation></ref><ref id="scirp.89101-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Lee, J.S., Wen, J.H., Ainsworth, T.L., Chen, K.S. and Chen, A.J. (2009) Improved Sigma Filter for Speckle Filtering of SAR Imagery. IEEE Transactions on Geoscience and Remote Sensing, 47, 202-213. https://doi.org/10.1109/TGRS.2008.2002881</mixed-citation></ref><ref id="scirp.89101-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Pan, M.-C. and Lettington, A.H. (1998) Smoothing Images by a Probability Filter. Proceedings of IEEE International Joint Symposia on Intelligence and Systems, Rockville, MD, 23 May 1998, 343-346.</mixed-citation></ref></ref-list></back></article>