<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">JCC</journal-id><journal-title-group><journal-title>Journal of Computer and Communications</journal-title></journal-title-group><issn pub-type="epub">2327-5219</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/jcc.2019.73002</article-id><article-id pub-id-type="publisher-id">JCC-90911</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Computer Science&amp;Communications</subject></subj-group></article-categories><title-group><article-title>
 
 
  Image Quality Assessment through FSIM, SSIM, MSE and PSNR—A Comparative Study
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Umme</surname><given-names>Sara</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Morium</surname><given-names>Akter</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Mohammad</surname><given-names>Shorif Uddin</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib></contrib-group><aff id="aff2"><addr-line>Department of Computer Science and Engineering, Jahangirnagar University, Dhaka, Bangladesh</addr-line></aff><aff id="aff1"><addr-line>National Institute of Textile Engineering and Research, Dhaka, Bangladesh</addr-line></aff><pub-date pub-type="epub"><day>04</day><month>03</month><year>2019</year></pub-date><volume>07</volume><issue>03</issue><fpage>8</fpage><lpage>18</lpage><history><date date-type="received"><day>30,</day>	<month>January</month>	<year>2019</year></date><date date-type="rev-recd"><day>1,</day>	<month>March</month>	<year>2019</year>	</date><date date-type="accepted"><day>4,</day>	<month>March</month>	<year>2019</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  Quality is a very important parameter for all objects and their functionalities. In image-based object recognition, image quality is a prime criterion. For authentic image quality evaluation, ground truth is required. But in practice, it is very difficult to find the ground truth. Usually, image quality is being assessed by full reference metrics, like MSE (Mean Square Error) and PSNR (Peak Signal to Noise Ratio). In contrast to MSE and PSNR, recently, two more full reference metrics SSIM (Structured Similarity Indexing Method) and FSIM (Feature Similarity Indexing Method) are developed with a view to compare the structural and feature similarity measures between restored and original objects on the basis of perception. This paper is mainly stressed on comparing different image quality metrics to give a comprehensive view. Experimentation with these metrics using benchmark images is performed through denoising for different noise concentrations. All metrics have given consistent results. However, from representation perspective, SSIM and FSIM are normalized, but MSE and PSNR are not; and from semantic perspective, MSE and PSNR are giving only absolute error; on the other hand, SSIM and PSNR are giving perception and saliency-based error. So, SSIM and FSIM can be treated more understandable than the MSE and PSNR.
 
</p></abstract><kwd-group><kwd>Image Quality</kwd><kwd> Computer Simulation</kwd><kwd> Gaussian Noise</kwd><kwd> Denoising</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>Image Quality Assessment (IQA) is considered as a characteristic property of an image. Degradation of perceived images is measured by image quality assessment. Usually, degradation is calculated compared to an ideal image known as reference image.</p><p>Quality of image can be described technically as well as objectively to indicate the deviation from the ideal or reference model. It also relates to the subjective perception or prediction of an image [<xref ref-type="bibr" rid="scirp.90911-ref1">1</xref>] , such as an image of a human look.</p><p>The reduction of the quality of an image is affected by the noise. This noise depends on how it correlates with the information the viewer seeks in the image.</p><p>Visual information can have many featuring steps such as acquisition, enhancement, compression or transmission. Some information provided by the features of an image can be distorted after completion of the processing. That’s why the quality should be evaluated by the human view perceptron [<xref ref-type="bibr" rid="scirp.90911-ref2">2</xref>] . Practically, there are two kinds of evaluation: subjective and objective. Subjective evaluation is time-consuming and also expensive to implement. Afterwards, the objective image quality metrics are developed on the basis of different aspects.</p><p>There are several techniques and metrics available to be used for objective image quality assessment. These techniques are grouped into two categories based on the availability of a reference image [<xref ref-type="bibr" rid="scirp.90911-ref3">3</xref>] . The categories are as follows:</p><p>1) Full-Reference (FR) approaches: The FR approaches focus on the assessment of the quality of a test image in comparison with a reference image. This reference image is considered as the perfect quality image that means the ground truth. For example, an original image is compared to the JPEG-compressed image [<xref ref-type="bibr" rid="scirp.90911-ref3">3</xref>] [<xref ref-type="bibr" rid="scirp.90911-ref4">4</xref>] .</p><p>2) No-Reference (NR) approach: The NR metrics focus on the assessment of the quality of a test image only. No reference image is used in this method [<xref ref-type="bibr" rid="scirp.90911-ref3">3</xref>] .</p><p>Image quality metrics are also categorized to measure a specific type of degradation such as blurring, blocking, ringing, or all possible distortions of signals.</p><p>The mean squared error (MSE) is the most widely used and also the simplest full reference metric which is calculated by the squared intensity differences of distorted and reference image pixels and averaging them with the peak signal-to-noise ratio (PSNR) of the related quantity [<xref ref-type="bibr" rid="scirp.90911-ref5">5</xref>] .</p><p>Image quality assessment metrics such as MSE, PSNR are mostly applicable as they are simple to calculate, clear in physical meanings, and also convenient to implement mathematically in the optimization context. But they are sometimes very mismatched to perceive visual quality and also are not normalized in representation. With this view, researchers have taken-into account, two normalized reference methods to give structural and feature similarities. Structured similarity indexing method (SSIM) gives normalized mean value of structural similarity between the two images and feature similarity indexing method (FSIM) gives normalized mean value of feature similarity between the two images. All these are full-reference image quality measurement metrics.</p><p>In this paper, we compare the FSIM, SSIM, MSE and PSNR values between the two images (an original and a recovered image) from denoising for different noise concentrations.</p></sec><sec id="s2"><title>2. Quality Measurement Technique</title><p>There are so many image quality techniques largely used to evaluate and assess the quality of images such as MSE (Mean Square Error), UIQI (Universal Image Quality Index), PSNR (Peak Signal to Noise Ratio), SSIM (Structured Similarity Index Method), HVS (Human Vision System), FSIM (Feature Similarity Index Method), etc. In this paper, we have worked on SSIM, FSIM, MSE and PSNR methods to find their suitability.</p><sec id="s2_1"><title>2.1. MSE (Mean Square Error)</title><p>MSE is the most common estimator of image quality measurement metric. It is a full reference metric and the values closer to zero are the better.</p><p>It is the second moment of the error. The variance of the estimator and its bias are both incorporated with mean squared error. The MSE is the variance of the estimator in case of unbiased estimator. It has the same units of measurement as the square of the quantity being calculated like as variance. The MSE introduces the Root-Mean-Square Error (RMSE) or Root-Mean-Square Deviation (RMSD) and often referred to as standard deviation of the variance.</p><p>The MSE can also be said the Mean Squared Deviation (MSD) of an estimator. Estimator is referred as the procedure for measuring an unobserved quantity of image. The MSE or MSD measures the average of the square of the errors. The error is the difference between the estimator and estimated outcome. It is a function of risk, considering the expected value of the squared error loss or quadratic loss.</p><p>Mean Squared Error (MSE) between two images such as g ( x , y ) and g ^ ( x , y ) is defined as [<xref ref-type="bibr" rid="scirp.90911-ref6">6</xref>]</p><p>MSE = 1 M N ∑ n = 0 M ∑ m = 1 N [ g ^ ( n , m ) − g ( n , m ) ] 2 (1)</p><p>From Equation (1), we can see that MSE is a representation of absolute error.</p></sec><sec id="s2_2"><title>2.2. RMSE (Root Mean Square Error)</title><p>Root Mean square Error is another type of error measuring technique used very commonly to measure the differences between the predicted value by an estimator and the actual value. It evaluates the error magnitude. It is a perfect measure of accuracy which is used to perform the differences of forecasting errors from the different estimators for a definite variable [<xref ref-type="bibr" rid="scirp.90911-ref7">7</xref>] .</p><p>Let us suppose that θ ^ be an estimator with respect to a given estimated parameter θ, the Root Mean Square Error is actually the square root of the Mean Square Error as</p><p>RMSE ( θ ^ ) = MSE ( θ ^ ) (2)</p></sec><sec id="s2_3"><title>2.3. PSNR (Peak Signal to Noise Ratio)</title><p>PSNR is used to calculate the ratio between the maximum possible signal power and the power of the distorting noise which affects the quality of its representation. This ratio between two images is computed in decibel form. The PSNR is usually calculated as the logarithm term of decibel scale because of the signals having a very wide dynamic range. This dynamic range varies between the largest and the smallest possible values which are changeable by their quality.</p><p>The Peak signal-to-noise ratio is the most commonly used quality assessment technique to measure the quality of reconstruction of lossy image compression codecs. The signal is considered as the original data and the noise is the error yielded by the compression or distortion. The PSNR is the approximate estimation to human perception of reconstruction quality compared to the compression codecs.</p><p>In image and video compression quality degradation, the PSNR value varies from 30 to 50 dB for 8-bit data representation and from 60 to 80 dB for 16-bit data. In wireless transmission, accepted range of quality loss is approximately 20 - 25 dB [<xref ref-type="bibr" rid="scirp.90911-ref8">8</xref>] .</p><p>PSNR is expressed as:</p><p>PSNR = 10 log 10 ( peakval 2 ) / MSE (3)</p><p>Here, peakval (Peak Value) is the maximal in the image data. If it is an 8-bit unsigned integer data type, the peakval is 255 [<xref ref-type="bibr" rid="scirp.90911-ref8">8</xref>] . From Equation (3), we can see that it is a representation of absolute error in dB.</p></sec><sec id="s2_4"><title>2.4. Structure Similarity Index Method (SSIM)</title><p>Structural Similarity Index Method is a perception based model. In this method, image degradation is considered as the change of perception in structural information. It also collaborates some other important perception based fact such as luminance masking, contrast masking, etc. The term structural information emphasizes about the strongly inter-dependant pixels or spatially closed pixels. These strongly inter-dependant pixels refer some more important information about the visual objects in image domain. Luminace masking is a term where the distortion part of an image is less visible in the edges of an image. On the other hand contrast masking is a term where distortions are also less visible in the texture of an image. SSIM estimates the perceived quality of images and videos. It measures the similarity between two images: the original and the recovered.</p><p>There is an advanced version of SSIM called Multi Scale Structural Similarity Index Method (MS-SSIM) that evaluates various structural similarity images at different image scale [<xref ref-type="bibr" rid="scirp.90911-ref9">9</xref>] . In MS-SSIM, two images are compared to the scale of same size and resolutions. As Like as SSIM, change in luminance, contrast and structure are considered to calculate multi scale structural similarity between two images [<xref ref-type="bibr" rid="scirp.90911-ref10">10</xref>] . Sometimes it gives better performance over SSIM on different subjective image and video databases.</p><p>Another version of SSIM, called a three-component SSIM (3-SSIM) that corresponds to the fact: human visual system observes the differences more accurately in textured regions than the smooth regions. This 3-component SSIM model was proposed by Ran and Farvardin [<xref ref-type="bibr" rid="scirp.90911-ref11">11</xref>] where an image is disintegrated into three important properties such as edge, texture and smooth region. The resulting metric is calculated as a weighted average of structural similarity for these three categories. The proposed weight measuring estimations are 0.5 for edges, 0.25 for texture and 0.25 for smooth regions. It can also be mentioned that a 1/0/0 weight measurement influences the results to be closer to the subjective ratings. This can be implied that, no textures or smooth regions rather edge regions play a dominant role in perception of image quality [<xref ref-type="bibr" rid="scirp.90911-ref11">11</xref>] .</p></sec><sec id="s2_5"><title>2.5. DSSIM (Structural Dissimilarity)</title><p>There is another distance metric referred as Structural Dissimilarity (DSSIM) deduced from the Structural Similarity (SSIM) can be expressed as:</p><p>DSSIM ( x , y ) = 1 − SSIM ( x , y ) 2 (4)</p><p>The SSIM index method, a quality measurement metric is calculated based on the computation of three major aspects termed as luminance, contrast and structural or correlation term. This index is a combination of multiplication of these three aspects [<xref ref-type="bibr" rid="scirp.90911-ref12">12</xref>] .</p><p>Structural Similarity Index Method can be expressed through these three terms as:</p><p>SSIM ( x , y ) = [ l ( x , y ) ] α ⋅ [ c ( x , y ) ] β ⋅ [ s ( x , y ) ] γ (5)</p><p>Here, l is the luminance (used to compare the brightness between two images), c is the contrast (used to differ the ranges between the brightest and darkest region of two images) and s is the structure (used to compare the local luminance pattern between two images to find the similarity and dissimilarity of the images) and α, β and γ are the positive constants [<xref ref-type="bibr" rid="scirp.90911-ref13">13</xref>] .</p><p>Again luminance, contrast and structure of an image can be expressed separately as:</p><p>l ( x , y ) = 2 μ x μ y + C 1 μ x 2 + μ y 2 + C 1 (6)</p><p>c ( x , y ) = 2 σ x σ y + C 2 σ x 2 + σ y 2 + C 2 (7)</p><p>s ( x , y ) = σ x y + C 3 σ x σ y + C 3 (8)</p><p>where μ x and μ y are the local means, σ x and σ y are the standard deviations and σ x y is the cross-covariance for images x and y sequentially. If α = β = γ = 1 , then the index is simplified as the following form using Equations (6)-(8):</p><p>SSIM ( x , y ) = ( 2 μ x μ y + C 1 ) ( 2 σ x σ y + C 2 ) ( μ x 2 + μ y 2 + C 1 ) ( σ x 2 + σ y 2 + C 2 ) (9)</p><p>From Equation (9) we can see that FSIM is in normalized scale (values between 0 to 1). We can also express it in dB scale as 10log<sub>10</sub>[SSIM(x, y)].</p></sec><sec id="s2_6"><title>2.6. Features Similarity Index Matrix (FSIM)</title><p>Feature Similarity Index Method maps the features and measures the similarities between two images. To describe FSIM we need to describe two criteria more clearly. They are: Phase Congruency (PC) and Gradient Magnitude (GM).</p><p>Phase Congruency (PC): A new method for detecting image features is phase congruency. One of the important characteristics of phase congruency is that it is invariant to light variation in images. Besides, it is also able to detect more some interesting features. It stresses on the features of the image in the domain frequency. Phase congruency is invariant to contrast.</p><p>Gradient magnitude (GM): The computation of image gradient is a very traditional topic in the digital image processing. Convolution masks used to express the operators of the gradient. There are many convolutional masks to measure the gradients. If f(x) is an image and G<sub>x</sub>, G<sub>y</sub> of its horizontal and vertical gradients, respectively. Then the gradient magnitude of f(x) can be defined as [<xref ref-type="bibr" rid="scirp.90911-ref13">13</xref>]</p><p>G x 2 + G y 2 (10)</p><p>In this paper we are going to calculate the similarity between two images to assess the quality of images. Let two images are f<sub>1</sub> (test image) and f<sub>2</sub> (reference image) and their phase congruency can be denoted by PC<sub>1</sub> and PC<sub>2</sub>, respectively. The Phase Congruency (PC) maps extracted from two images f<sub>1</sub> and f<sub>2</sub> and the Magnitude Gradient (GM) maps G<sub>1</sub> and G<sub>2</sub> extracted from the two images too. FSIM can be defined and calculated based on PC<sub>1</sub>, PC<sub>2</sub>, G<sub>1</sub> and G<sub>2</sub>. At first, we can calculate the similarity of these two images as</p><p>S P C = 2 P C 1 P C 2 + T 1 P C 1 2 + P C 2 2 + T 1 (11)</p><p>where T<sub>1</sub> is a positive constant which increases the stability of S<sub>pc</sub>. Practically T<sub>1</sub> can be calculated based on the PC values. The above equation describes the measurement to determine the similarity of two positive real numbers and its range is within 0 to 1.</p><p>Similarly, we can calculate the similarity from G<sub>1</sub> and G<sub>2</sub> as</p><p>S G = 2 G 1 G 2 + T 2 G 1 2 + G 2 2 + T 2 (12)</p><p>where T<sub>2</sub> is a positive constant which depends on the dynamic range of gradient magnitude values. In this paper, both T<sub>1</sub> and T<sub>2</sub> are constant so that the FSIM can be conveniently used.</p><p>Now S P C and S G are combined together to calculate the similarity S L of f<sub>1</sub> and f<sub>2</sub>. S l can be defined as</p><p>S L ( x ) = [ S P C ( x ) ] α ⋅ [ S G ( x ) ] β (13)</p><p>where the parameters α and β are used to adjust the relative importance of PC and GM features. In this paper, we set α = β =1 for convenience. From Equations (11) to (13), it is evident that FSIM is normalized (values between 0 to 1).</p></sec></sec><sec id="s3"><title>3. Experimental Results and Discussions</title><p>We used three benchmark images (Lena, Barbara, Cameraman) and then used Gaussian noise of different concentrations (noise variances). For all noise variances the mean is taken as 1.0. Then we applied Gaussian convolutional mask for denoising. The original, noisy and denoised images are shown in <xref ref-type="fig" rid="fig1">Figure 1</xref>, <xref ref-type="fig" rid="fig2">Figure 2</xref> and <xref ref-type="fig" rid="fig3">Figure 3</xref> for noise variances 0.2, 0.4 and 0.6, respectively.</p><p>After denoising, we estimated the quality of the denoised (restored/recoverd) images by using FSIM, SSIM, PSNR and MSE metrics. The summary of quality matrices calculation is shown in <xref ref-type="table" rid="table1">Table 1</xref>. From this table, we can see that all metrics have given almost consistent results. However, from representation perspective, SSIM and FSIM are normalized, but MSE and PSNR are not. So, SSIM and FSIM can be treated more understandable than the MSE and PSNR. This is because, MSE and PSNR are absolute errors, however, SSIM and FSIM are giving perception and saliency-based errors. If noise level is increasing, then the</p><p>recovery quality of output image is also deteriorating.</p></sec><sec id="s4"><title>4. Conclusion</title><p>Image Quality Assessment plays a very significant role in digital image processing applications. The metrics (MSE, PSNR, SSIM and FSIM) are applied in this paper to get the best quality metric. We have done simulating experiments using Gaussian noise through Gaussian filtering technique. The obtained image quality has been judged on applying the above metrics. We found consistent</p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> Error deduction summary for different image quality metrics (MSE, PSNR, SSIM, FSIM)</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Image</th><th align="center" valign="middle" >Noise Level (Gaussian-variance)</th><th align="center" valign="middle"  colspan="4"  >Quality Assessment Techniques</th></tr></thead><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >MSE</td><td align="center" valign="middle" >PSNR</td><td align="center" valign="middle" >SSIM</td><td align="center" valign="middle" >FSIM</td></tr><tr><td align="center" valign="middle"  rowspan="3"  >Lena</td><td align="center" valign="middle" >0.2</td><td align="center" valign="middle" >21.56</td><td align="center" valign="middle" >21.54</td><td align="center" valign="middle" >0.78</td><td align="center" valign="middle" >0.89</td></tr><tr><td align="center" valign="middle" >0.4</td><td align="center" valign="middle" >16.81</td><td align="center" valign="middle" >16.81</td><td align="center" valign="middle" >0.74</td><td align="center" valign="middle" >0.86</td></tr><tr><td align="center" valign="middle" >0.6</td><td align="center" valign="middle" >14.18</td><td align="center" valign="middle" >14.18</td><td align="center" valign="middle" >0.7</td><td align="center" valign="middle" >0.8</td></tr><tr><td align="center" valign="middle"  rowspan="3"  >Barbara</td><td align="center" valign="middle" >0.2</td><td align="center" valign="middle" >21.95</td><td align="center" valign="middle" >21.95</td><td align="center" valign="middle" >0.8</td><td align="center" valign="middle" >0.88</td></tr><tr><td align="center" valign="middle" >0.4</td><td align="center" valign="middle" >17.8</td><td align="center" valign="middle" >17.79</td><td align="center" valign="middle" >0.75</td><td align="center" valign="middle" >0.84</td></tr><tr><td align="center" valign="middle" >0.6</td><td align="center" valign="middle" >15.49</td><td align="center" valign="middle" >15.48</td><td align="center" valign="middle" >0.7</td><td align="center" valign="middle" >0.8</td></tr><tr><td align="center" valign="middle"  rowspan="3"  >Cameramen</td><td align="center" valign="middle" >0.2</td><td align="center" valign="middle" >21.64</td><td align="center" valign="middle" >21.65</td><td align="center" valign="middle" >0.73</td><td align="center" valign="middle" >0.84</td></tr><tr><td align="center" valign="middle" >0.4</td><td align="center" valign="middle" >17.29</td><td align="center" valign="middle" >17.31</td><td align="center" valign="middle" >0.76</td><td align="center" valign="middle" >0.86</td></tr><tr><td align="center" valign="middle" >0.6</td><td align="center" valign="middle" >15.27</td><td align="center" valign="middle" >15.28</td><td align="center" valign="middle" >0.76</td><td align="center" valign="middle" >0.87</td></tr></tbody></table></table-wrap><p>results for all the metrics. However, from representation perspective, SSIM and FSIM are normalized, but MSE and PSNR are not. So, SSIM and FSIM can be treated more understandable than the MSE and PSNR. This is due to the fact that MSE and PSNR are absolute errors, however, SSIM and FSIM are giving perception and saliency-based errors. If noise level is increasing, then the recovery quality of output image is also deteriorating. So, we can conclude that SSIM and SSIM are comparatively better than MSE and PSNR metrics from human visual perspective.</p></sec><sec id="s5"><title>Conflicts of Interest</title><p>The authors declare no conflicts of interest regarding the publication of this paper.</p></sec><sec id="s6"><title>Cite this paper</title><p>Sara, U., Akter, M. and Uddin, M.S. (2019) Image Quality Assessment through FSIM, SSIM, MSE and PSNR―A Comparative Study. Journal of Computer and Communications, 7, 8-18. https://doi.org/10.4236/jcc.2019.73002</p></sec></body><back><ref-list><title>References</title><ref id="scirp.90911-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Thung, K.-H. and Raveendran, P. (2009) A Survey of Image Quality Measures. IEEE Technical Postgraduates (TECHPOS) International Conference, Kuala Lumpur, 14-15 December 2009, 1-4.</mixed-citation></ref><ref id="scirp.90911-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Oszust, M. (2016) Full-Reference Image Quality Assessment with Linear Combination of Genetically Selected Quality Measures. Yongtang Shi, Nankai University, China, Vol. 11, No. 6, June 24.</mixed-citation></ref><ref id="scirp.90911-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Wang, Z. and Simoncelli, E.P. (2005) Reduced-Reference Image Quality Assessment Using A Wavelet-Domain Natural Image Statistic Model. Human Vision and Electronic Imaging X, Proc. SPIE, Vol. 5666, San Jose, CA, 18 March 2005.https://doi.org/10.1117/12.597306</mixed-citation></ref><ref id="scirp.90911-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Lahoulou, A., Larabi, M.C., Beghdadi, A., Viennet, E. and Bouridane, A. (2016) Knowledge-Based Taxonomic Scheme for Full-Reference Objective Image Quality Measurement Models. Journal of Imaging Science and Technology, 60, 1-15.</mixed-citation></ref><ref id="scirp.90911-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Wang, Z. and Sheikh, H.R. (2004) Image Quality Assessment: From Error Visibility to Structural Similarity. IEEE Transactions on Image Processing, 13, No. 4. https://doi.org/10.1109/TIP.2003.819861</mixed-citation></ref><ref id="scirp.90911-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">S&amp;oslash;gaard, J., Krasula, L., Shahid, M., Temel, D., Brunnstrom, K. and Razaak, M. (2016) Applicability of Existing Objective Metrics of Perceptual Quality for Adaptive Video Streaming. Society for Imaging Science and Technology IS&amp;T International Symposium on Electronic Imaging.</mixed-citation></ref><ref id="scirp.90911-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Mean Squared Error. https://math.tutorvista.com/statistics/mean-squared-error.html</mixed-citation></ref><ref id="scirp.90911-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Deshpande, R.G., Ragha, L.L. and Sharma, S.K. (2018) Video Quality Assessment through PSNR Estimation for Different Compression Standards. Indonesian Journal of Electrical Engineering and Computer Science, 11, 918-924.</mixed-citation></ref><ref id="scirp.90911-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Wang, Z., Simoncelli, E.P. and Bovik, A.C. (2004) Multiscale Structural Similarity for Image Quality Assessment. Conference Record of the Thirty-Seventh Asilomar Conference on Signals, Systems and Computers, 2, 1398-1402.</mixed-citation></ref><ref id="scirp.90911-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Dosselmann, R. and Yang, X.D. (2011) A Comprehensive Assessment of the Structural Similarity Index. Signal, Image and Video Processing, 5, 81-91. https://doi.org/10.1007/s11760-009-0144-1</mixed-citation></ref><ref id="scirp.90911-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Li, C.F. and Bovik, A.C. (2009) Three-Component Weighted Structural Similarity Index. Image Quality and System Performance VI, SPIE Proc. 7242, San Jose, CA, 19 January 2009, 1-9.</mixed-citation></ref><ref id="scirp.90911-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Brooks, A.C., et al. (2008) Structural Similarity Quality Metrics in a Coding Context: Exploring the Space of Realistic Distortions. IEEE Transactions on Image Processing, 17, 1261-1273. https://doi.org/10.1109/TIP.2008.926161</mixed-citation></ref><ref id="scirp.90911-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Kumar, R. and Moyal, V. (2013) Visual Image Quality Assessment Technique Using FSIM. International Journal of Computer Applications Technology and Research, 2, 250-254. https://doi.org/10.7753/IJCATR0203.1008</mixed-citation></ref></ref-list></back></article>