<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">JAMP</journal-id><journal-title-group><journal-title>Journal of Applied Mathematics and Physics</journal-title></journal-title-group><issn pub-type="epub">2327-4352</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/jamp.2019.76094</article-id><article-id pub-id-type="publisher-id">JAMP-93442</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Physics&amp;Mathematics</subject></subj-group></article-categories><title-group><article-title>
 
 
  Robust Element-Wise Empirical Likelihood Estimation Method for Longitudinal Data
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Tianyu</surname><given-names>Huang</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Yali</surname><given-names>Fan</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Zongren</surname><given-names>Sun</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib></contrib-group><aff id="aff1"><addr-line>College of Science, University of Shanghai for Science and Technology, Shanghai, China</addr-line></aff><pub-date pub-type="epub"><day>19</day><month>06</month><year>2019</year></pub-date><volume>07</volume><issue>06</issue><fpage>1408</fpage><lpage>1420</lpage><history><date date-type="received"><day>22,</day>	<month>May</month>	<year>2019</year></date><date date-type="rev-recd"><day>27,</day>	<month>June</month>	<year>2019</year>	</date><date date-type="accepted"><day>30,</day>	<month>June</month>	<year>2019</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  For the regression model about longitudinal data, we combine the robust estimation equation with the elemental empirical likelihood method, and propose an efficient robust estimator, where the robust estimation equation is based on bounded scoring function and the covariate depended weight function. This method reduces the influence of outliers in response variables and covariates on parameter estimation, takes into account the correlation between data, and improves the efficiency of estimation. The simulation results show that the proposed method is robust and efficient.
 
</p></abstract><kwd-group><kwd>Longitudinal Data</kwd><kwd> Element-Wise Empirical Likelihood</kwd><kwd> Robust Estimation Equation</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>Longitudinal data is a dataset obtained by repeatedly measuring multiple times for each individual over a period of time. The longitudinal data is equivalent to the combination of cross section and time series data, and is composed of a plurality of short time series. For a fixed time point, the observation data of different individuals is similar to the cross-sectional data; for fixed individuals, different time points observation data is similar to time series. Therefore, longitudinal data can make full use of the information inside the individual while distinguishing individual differences. In the fields of medicine and finance, the frequency of longitudinal data appears to be higher and higher, so the research on longitudinal data is of great significance.</p><p>Longitudinal data is a hot topic in statistical research in recent years. So far, significant progress has been made in the field of theoretical research. Liang et al. (1986) [<xref ref-type="bibr" rid="scirp.93442-ref1">1</xref>] extended generalized linear model research to longitudinal data, proposed a generalized estimating equation (GEE) method, introduced correlation matrices in estimating equations, and gave corresponding estimates of regression parameters and their variances. It is proved that the consistent estimation of regression coefficients can be obtained by using GEE method even if the work correlation matrix is misspecified (See Diggle et al. (2002) [<xref ref-type="bibr" rid="scirp.93442-ref2">2</xref>] for more details). However, the principle of the GEE developed from the generalized linear model is similar to the principle of the weighted least squares method, and is sensitive to outliers. In the longitudinal data, because of repeated measurements, there are abnormal values in individual measurements, which will lead to a series of abnormal values in samples. In order to reduce the interference of outliers, Fan et al. (2012) [<xref ref-type="bibr" rid="scirp.93442-ref3">3</xref>] introduced a generalized estimating equation method based on the bounded scoring function of Huber function to achieve robustness. For the definition of Huber function, (see Huber (1964) [<xref ref-type="bibr" rid="scirp.93442-ref4">4</xref>] ), Wang et al. (2013) [<xref ref-type="bibr" rid="scirp.93442-ref5">5</xref>] and Lv et al. (2015) [<xref ref-type="bibr" rid="scirp.93442-ref6">6</xref>] applied the bounded exponential score function to the generalized estimating equation. There are many articles (Qin et al. (2005) [<xref ref-type="bibr" rid="scirp.93442-ref7">7</xref>] ; Wang et al. (2005) [<xref ref-type="bibr" rid="scirp.93442-ref8">8</xref>] ; Qin et al. (2009) [<xref ref-type="bibr" rid="scirp.93442-ref9">9</xref>] ; Zheng et al. (2013) [<xref ref-type="bibr" rid="scirp.93442-ref10">10</xref>] ) about generalized estimation equation and robustness research.</p><p>In the field of longitudinal data research, empirical likelihood methods are also one of the frequently used methods. The empirical likelihood (EL) method was originally applied by Owen (1988) [<xref ref-type="bibr" rid="scirp.93442-ref11">11</xref>] to the estimation of the population mean of completely independent and identically distributed data. The method has the characteristics of asymmetric confidence intervals, transformation-preserving and better coverage probability. Azzalini (2017) [<xref ref-type="bibr" rid="scirp.93442-ref12">12</xref>] comprehensively introduced the application of empirical likelihood method in statistical inference. Qin and Lawless (1994) [<xref ref-type="bibr" rid="scirp.93442-ref13">13</xref>] first linked the empirical likelihood method with the estimation equation. They proved that the empirical likelihood estimation is effective when the moment conditions are correctly specified in the estimation equation. Bondell and Stefansk (2013) [<xref ref-type="bibr" rid="scirp.93442-ref14">14</xref>] proposed a robust estimator in linear regression which has relatively high efficiency compared to other robust estimators by using generalized EL methods. Bai et al. (2010) [<xref ref-type="bibr" rid="scirp.93442-ref15">15</xref>] introduced the EL method into longitudinal data research, and proposed a weighted empirical likelihood (WEL) inference method for generalized linear models of longitudinal data. Wang et al. (2010) [<xref ref-type="bibr" rid="scirp.93442-ref16">16</xref>] established two methods based on generalized empirical likelihood: elemental empirical likelihood and object empirical likelihood, where the element-wise empirical likelihood method can give slightly better coverage probabilities for small or medium samples.</p><p>Based on the existing research results of longitudinal data, this paper combines the bounded scoring function based on Huber function and the robust estimation equation of weight function based on covariate with elemental empirical likelihood method, and proposes an effective robust estimation method. The effectiveness of the proposed method is derived from the advantages of the empirical likelihood method, while robustness is obtained by means of robust estimation equations. We carried out the simulation and the results showed that whether the correlation matrix used is consistent with the real correlation matrix or not, the estimation method in this paper can reduce the impact of outliers on the estimation and improve the estimation efficiency.</p><p>The following content is divided into four subsections. In Section 1, we give the linear regression model of the longitudinal data and the estimation method used in this paper. The iterative algorithm of this paper is introduced in Section 2. Section 3 is the simulation experiment part and Section 4 is the summary and outlook.</p></sec><sec id="s2"><title>2. Proposed Method</title><sec id="s2_1"><title>2.1. Models</title><p>Linear models are often used in longitudinal data research. Their structure is simple for analysis and the basis of many models. We will consider the following continuous response variable longitudinal regression model</p><p>y i j = x i j T β + ε i j ,     i = 1 , ⋯ , n ;     j = 1 , ⋯ , m i (2.1)</p><p>where y i j is the jth observation on the ith subject, x i j is a p-vector of covariance values and β 0 is a p-vector of unknown regression coefficients, x i j T = ( x i j ( 1 ) , x i j ( 2 ) , ⋯ , x i j ( p ) ) , β T = ( β ( 1 ) , β ( 2 ) , ⋯ , β ( p ) ) . n is the number of subjects participating in the study, m i is the number of repeated measurements for the ith subject, m 1 , ⋯ , m n are bounded positive integers. Denote the total sample size by N = m 1 + ⋯ + m n . ε i j is the random error term, satisfying E ( ε i j ) = 0 , V a r ( ε i j ) = σ 2 . We set Y i T = ( y i 1 , y i 2 , ⋯ , y i m i ) , X i = ( x i 1 , x i 2 , ⋯ , x i m i ) and ε i T = ( ε i 1 , ε i 2 , ⋯ , ε i m i ) . Then model (2.1) can be rewritten as</p><p>Y i = X i T β + ε i (2.2)</p><p>For the longitudinal data model, it is usually assumed that the variables between different individuals are independent of each other, and the different measurements of the same individual are related. The covariance matrix of the random vector ε i is V i = σ 2 R ( ρ ) = A i 1 2 R ( ρ ) A i 1 2 , where V i is an m i &#215; m i invertible matrix, R ( ρ ) is a correlation matrix, ρ is a correlation coefficient vector, A i 1 2 = σ I m i . Exchangeable structure (Exch), work-independent structure (Ind) and first-order autoregressive structure (AR(1)) are common related structures in practice.</p><p>R E x c h = ( 1 ρ ⋯ ρ ρ 1 ⋯ ρ ⋮ ⋮ ⋱ ⋮ ρ ρ ⋯ 1 ) , R l n d = ( 1 0 ⋯ 0 0 1 ⋯ 0 ⋮ ⋮ ⋱ ⋮ 0 0 ⋯ 1 ) , R A R ( 1 ) = ( 1 ρ ⋯ ρ m i − 1 ρ 1 ⋯ ρ m i − 2 ⋮ ⋮ ⋱ ⋮ ρ m i − 1 ρ m i − 2 ⋯ 1 ) .</p><p>Let</p><p>Z i ( β ) = { z i 1 ( β ) , z i 2 ( β ) , ⋯ , z i m i ( β ) } T = V i − 1 ( Y i − X i T β ) (2.3)</p></sec><sec id="s2_2"><title>2.2. Proposed Estimator</title><p>More generally, we can define an estimating equation</p><p>∑ i = 1 n   X i Z i ( β ) = ∑ i = 1 n ∑ j = 1 m i   x i j z i j ( β ) = 0 (2.4)</p><p>Such estimating equation is susceptible to the influence of outliers. Bounded scoring function of Huber function and weight function depending on covariates are introduced in formula (3)</p><p>Z i R ( β ) = { z i 1 R ( β ) , z i 2 R ( β ) , ⋯ , z i m i R ( β ) } = ( A i 1 2 R i ) − 1 W i ψ c ( A i − 1 2 ( Y i − X i T β ) ) (2.5)</p><p>Consequently, a robust estimation equation is obtained</p><p>∑ i = 1 n   X i Z i R ( β ) = ∑ i = 1 n ∑ j = 1 m i   x i j z i j R ( β ) = 0 (2.6)</p><p>where ψ c ( x ) = min ( c , max ( − c , x ) ) is the bounded scoring function, it is used to limit the influence on outliers in response. Because it is applied to the standardized residuals, the value of c are generally between 1 and 2. W i = d i a g ( w i 1 , w i 2 , ⋯ , w i m i ) is the weight function. There are many ways to select the weight function, similar to the reference [<xref ref-type="bibr" rid="scirp.93442-ref14">14</xref>] , we consider a function of the Mahalanobis distance</p><p>w i j = min { 1 , ( b 0 ( x i j − m x ) T S x − 1 ( x i j − m x ) ) r 2 } (2.7)</p><p>where r ≥ 1 , b 0 is the 0.95 quantile of the chi-square distribution with the degree of freedom equal to the dimension of x i j , m x and S x are some robust estimates of location and scatter of x i j . If x i j deviates from the whole, ( x i j − m x ) T S x − 1 ( x i j − m x ) will be larger and</p><p>( b 0 ( x i j − m x ) T S x − 1 ( x i j − m x ) ) r 2</p><p>will be smaller. Then the corresponding weight w i j is less than 1. On the contrary, the corresponding weight w i j is 1. Therefore, the influence of the outliers on the estimation can be controlled by the Mahalanobis distance function. For data without outlying points, we can set ψ c ( x ) = x and w i j = 1 in the robust estimating Equation (2.6), and this will lead to the classical nonrobust estimating equation.</p><p>Empirical likelihood method is a non-parametric statistical method, which has many good properties. The empirical likelihood and the estimated equation were first associated by Qin and Lawless (1994) [<xref ref-type="bibr" rid="scirp.93442-ref13">13</xref>] . Wang et al. (2010) [<xref ref-type="bibr" rid="scirp.93442-ref16">16</xref>] proposed two methods for combining empirical likelihood methods with estimation equations. Subject-wise empirical likelihood is assigning a probability p i to each subject y i . Li et al. (2018) [<xref ref-type="bibr" rid="scirp.93442-ref17">17</xref>] introduced a robust estimation equation based on the exponential score function and prove that a better estimate can be obtained with outliers. Element-wise empirical likelihood is assigning a probability mass p i j to each observation y i j . This paper combines the element-wise empirical likelihood method with the robust estimation Equation (2.6) to obtain the following empirical likelihood ratio function</p><p>L 1 ( β ) = sup { ∏ i = 1 n ∏ j = 1 m i N p i j | p i j ≥ 0 , ∑ i = 1 n ∑ j = 1 m i   p i j = 1 , ∑ i = 1 n ∑ j = 1 m i   p i j x i j z i j R ( β ) = 0 } (2.8)</p><p>Similar to Owen (1988) [<xref ref-type="bibr" rid="scirp.93442-ref11">11</xref>] classic empirical likelihood, by using the Lagrangian multiplier method, we obtain that L 1 ( β ) is maximized at</p><p>p i j = 1 N ( 1 + λ ′ x i j z i j R ( β ) ) − 1 , i = 1 , ⋯ , n ; j = 1 , ⋯ , m i (2.9)</p><p>where the vector λ = ( λ 1 , λ 2 , ⋯ , λ p ) ′ satisfies 1 N ∑ i = 1 n ∑ j = 1 m i x i j z i j R ( β ) 1 + λ ′ x i j z i j R ( β ) = 0 . From this we can get</p><p>− 2 log L 1 ( β ) = 2 ∑ i = 1 n ∑ j = 1 m i log ( 1 + λ ′ x i j z i j R ( β ) ) (2.10)</p><p>The estimate proposed in this paper is the maximum point of Equation (2.8), which is equivalently the minimum point of Equation (2.10). Recorded as</p><p>β ^ RELGEE = arg max L 1 ( β ) = arg min ( − 2 log L 1 ( β ) ) (2.11)</p><p>β ^ RELGEE is the RELEGE estimate of β . Under some regular conditions, the estimate can be proved to be consistent and subject to an asymptotic normal distribution. − 2 log L 1 ( β ) subject to an asymptotic linear combination of independent chi-Square distribution. The proof process is similar to Wang et al. (2010) [<xref ref-type="bibr" rid="scirp.93442-ref16">16</xref>] .</p><p>The parameter of interest in this paper is β . But the parameters σ and ρ are unknown. Reference to He et al. (2005) [<xref ref-type="bibr" rid="scirp.93442-ref18">18</xref>] , we can use a median of absolute deviations to give σ a robust estimate</p><p>σ ^ = { 1.483 median { | ( y i j − x i j T β * ) − median ( y i j − x i j T β * ) | } } (2.12)</p><p>where β * is the current estimate of β .</p><p>According to the above description of the correlation matrix, the specific robust estimation of the parameter ρ depends on the selection of the relevant structure. Simply consider, when m i = m , for Exchange-able structure (Exch)</p><p>ρ ^ = ∑ i = 1 n ∑ j &gt; j ′ r ^ i j * r ^ i j ′ * 0.5 n m ( m − 1 ) − p (2.13)</p><p>where r ^ i j * = ψ c ( y i j − x i j T β * σ ^ ) . For first-order autoregressive structure (AR(1)), We use robust moment estimators</p><p>ρ ^ = a b − a b − 1 (2.14)</p><p>where a = ∑ i = 1 n   r i * ′ T 1 r i * , b = ∑ i = 1 n     r i * ′ T 2 r i * , r i * = ( r i 1 * , r i 2 * , ⋯ , r i m * ) T , T 1 is m-order diagonal matrix d i a g ( 1,1,1,1, ⋯ , 1,1 ) and T 2 is m-order diagonal matrix d i a g ( 0,1,1,1, ⋯ , 1,0 ) .</p></sec></sec><sec id="s3"><title>3. Algorithm</title><p>Since the maximal estimation of computational empirical likelihood will encounter numerical calculation problems, when solving β ^ RELGEE , we refer to the Newton-type algorithm of Lagrange multiplier for constrained optimization problems proposed by &#214;zdemir (2018) [<xref ref-type="bibr" rid="scirp.93442-ref19">19</xref>] . In order to make the calculation simple and without loss of generality, we pull p i j , y i j , x i j and z i j R ( β ) into a column vector. Like ( p 1 , p 2 , ⋯ , p N ) = ( p 11 , ⋯ , p 1 m 1 , ⋯ , p n 1 , ⋯ , p n m n ) , ( y 1 , y 2 , ⋯ , y N ) , ( z 1 R ( β ) , z 2 R ( β ) , ⋯ , z N R ( β ) ) and ( x 1 , x 2 , ⋯ , x N ) are the same. We get</p><p>L 2 ( β ) = sup { ∏ i = 1 N p i | ∑ i = 1 N   p i = 1 , p i &gt; 0 , ∑ i = 1 N   p i x i z i R ( β ) } (3.1)</p><p>This problem can also be defined as follows</p><p>J ( p , β ) = min p i ∈ ( 0 , 1 ) [ − ∑ i = 1 N ln p i ] (3.2)</p><p>under the constraints ∑ i = 1 N   p i = 1 and ∑ i = 1 N   p i x i z i R ( β ) = 0 .</p><p>Lagrangian multiplier method is commonly used to find the extreme value of a general constrained function. We can get</p><p>J ( p , β , λ 0 , λ 1 T ) = − ∑ i = 1 N ln p i + λ 0 ( ∑ i = 1 N   p i − 1 ) − λ 1 T ∑ i = 1 N   p i x i z i R ( β ) (3.3)</p><p>where λ 0 ∈ R 1 and λ 1 T ∈ R p are Lagrange multipliers</p><p>A = [ p β ] ,   Λ = [ λ 0 λ 1 T ] (3.4)</p><p>The first order gradient of Equation (3.3) is</p><p>∇ J ( A , Λ ) = [ ∇ R ( A ) + ( D G ( A ) ) T Λ G ( A ) T ] (3.5)</p><p>where</p><p>∇ J ( A ) = [ − 1 p 1 − 1 p 2 ⋯ − 1 p N   0 1 &#215; p ] T , G ( A ) = [ ∑ i = 1 N   p i − 1 , ∑ i = 1 N   p i x i z i R ( β ) ]</p><p>G ( A ) Jacobi matrix about A can be written</p><p>D G ( A ) = [ 1 1 ⋯ 1 0 l &#215; p x 1 z 1 R ( β ) x 2 z 2 R ( β ) ⋯ x N z N R ( β ) − [ ∑ i = 1 N p i x i ϕ i ] T ] (3.6)</p><p>where ϕ i = ∂ z i R ( β ) ∂ β .</p><p>So the Hessian matrix of Equation (3.3) is</p><p>H L ( A , Λ ) = [ B ( A , Λ ) D G ( A ) T D G ( A ) 0 p &#215; p ] (3.7)</p><p>where B ( A , Λ ) = [ 1 p 1 2 0 ⋯ 0 − λ 1 T x 1 ϕ 1 0 1 p 2 2 ⋯ 0 − λ 1 T x 2 ϕ 2 ⋮ ⋮ ⋱ ⋮ ⋮ 0 0 ⋯ 1 p N 2 − λ 1 T x N ϕ N − [ λ 1 T x 1 ϕ 1 ] T − [ λ 1 T x 2 ϕ 2 ] T ⋯ − [ λ 1 T x N ϕ N ] T 0 p &#215; p ] , it’s a ( N + k ) &#215; ( N + k ) matrix.</p><p>By Newton iteration, we can get</p><p>H L ( A t , Λ t ) [ A t + 1 − A t Λ t + 1 − Λ t ] + ∇ L ( A t , Λ t ) = 0 (3.8)</p><p>where the value of A t , Λ t represents the result of iteration A , Λ at the tth time, the value of A t + 1 , Λ t + 1 is calculated by A t , Λ t .</p><p>We can get the iterative expression of A t , Λ t</p><p>[ A t + 1 Λ t + 1 ] = [ A t Λ t ] − H L ( A t , Λ t ) − 1 ∇ L ( A t , Λ t ) (9)</p><p>Summarize the algorithm for estimating the parameter β ^ RELGEE as follows:</p><p>Step 1. Set the initial value of p , β , λ 0 , λ 1 and the threshold ξ , where the initial value of β can be set to the estimated value obtained by the least squares method to speed up the convergence.</p><p>Step 2. Calculate H L ( A t , Λ t ) and ∇ L ( A t , Λ t ) at the tth time.</p><p>Step 3. Calculate A t + 1 , Λ t + 1 according to Iterative Formula (3.9).</p><p>Step 4. Let t ← t + 1 , repeat Step 2 and Step 3 until ‖ β t + 1 − β t ‖ &lt; ξ is satisfied and obtain a convergent β ^ RELGEE . At this point, the solution of the robust empirical likelihood estimate is completed.</p></sec><sec id="s4"><title>4. Simulation Study</title><p>In this section, we present a simulation study. The estimators obtained by the RELGEE method proposed in this paper are compared with the estimators obtained by the common element empirical likelihood method (ELGEE). The finite sample properties of the estimators are explored. The main research contents are as follows:</p><p>1) Estimated relative efficiency when there is no pollution in the data;</p><p>2) Estimated robustness when the data is contaminated;</p><p>3) The effect on the estimation efficiency when the work correlation matrix is correctly or incorrectly specified.</p><p>The model is set to</p><p>y i j = x i j T β + ε i j , i = 1 , 2 , ⋯ , n ; j = 1 , 2 , 3 (4.1)</p><p>where the number of repeated observations is 3, x i j T = ( x i j ( 1 ) , x i j ( 2 ) , x i j ( 3 ) ) , x i j ~ ( ( 0,0,0 ) T , I 3 ) , β T = ( 7,1.7, − 1.5 ) and</p><p>( ε i 1 , ε i 2 , ε i 3 ) T ~ N ( ( 0 , 0 , 0 ) T , R ( ρ ) ) .</p><p>Considering sample size n = 50 and n = 100 . Let R ( ρ ) take exchangeable structure (Exch) and first-order autoregressive structure (AR(1)), where the parameter ρ is taken as 0.3 and 0.7 respectively. Because of the different values of parameter ρ and the different settings of real correlation matrix and work correlation matrix, We repeat the simulation 1000 times for different settings to calculate MSE (&#215;100) that represents 100 times the mean square error of the sample under different conditions. Since there are three parameters, we find the average of the mean square error of the three parameters.</p><p>In order to study the problem (1), we compared the mean squared error of the estimating method (RELGEE) and the ordinary element empirical likelihood method (ELGEE) in the case of no pollution. The simulation results are shown in <xref ref-type="table" rid="table1">Table 1</xref>.</p><p>When processing non-polluting data, due to the robust processing of the longitudinal data to some extent, resulting in the loss of part of the information, the efficiency of robust estimation is usually lower than the non-stable estimate when there is no pollution. <xref ref-type="table" rid="table1">Table 1</xref> shows that the mean square error of RELGEE estimator is only slightly larger than that of ELGEE estimator, which shows that this method is efficient even in the case of no pollution.</p><p>In order to explore questions (2) and (3), we have designed three ways of pollution:</p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> Comparison of Two Estimators under Non-pollution Conditions</title></caption><table><tbody><thead><tr><th align="center" valign="middle"  colspan="3"  >Non-pollution</th><th align="center" valign="middle"  colspan="4"  >TR</th></tr></thead><tr><td align="center" valign="middle" >n</td><td align="center" valign="middle" >ρ</td><td align="center" valign="middle" >WR</td><td align="center" valign="middle"  colspan="2"  >Exch</td><td align="center" valign="middle"  colspan="2"  >AR(1)</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >ELGEE</td><td align="center" valign="middle" >RELGEE</td><td align="center" valign="middle" >ELGEE</td><td align="center" valign="middle" >RELGEE</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.3</td><td align="center" valign="middle" >Exch</td><td align="center" valign="middle" >0.57386</td><td align="center" valign="middle" >0.58100</td><td align="center" valign="middle" >0.57386</td><td align="center" valign="middle" >0.58100</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >AR(1)</td><td align="center" valign="middle" >0.58885</td><td align="center" valign="middle" >0.60091</td><td align="center" valign="middle" >0.54477</td><td align="center" valign="middle" >0.56010</td></tr><tr><td align="center" valign="middle" >50</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Ind</td><td align="center" valign="middle" >0.72633</td><td align="center" valign="middle" >0.73693</td><td align="center" valign="middle" >0.72633</td><td align="center" valign="middle" >0.73693</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.7</td><td align="center" valign="middle" >Exch</td><td align="center" valign="middle" >0.28785</td><td align="center" valign="middle" >0.29751</td><td align="center" valign="middle" >0.36407</td><td align="center" valign="middle" >0.37805</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >AR(1)</td><td align="center" valign="middle" >0.36407</td><td align="center" valign="middle" >0.37805</td><td align="center" valign="middle" >0.28785</td><td align="center" valign="middle" >0.29751</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Ind</td><td align="center" valign="middle" >0.66757</td><td align="center" valign="middle" >0.67960</td><td align="center" valign="middle" >0.66757</td><td align="center" valign="middle" >0.67960</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.3</td><td align="center" valign="middle" >Exch</td><td align="center" valign="middle" >0.27770</td><td align="center" valign="middle" >0.27829</td><td align="center" valign="middle" >0.39119</td><td align="center" valign="middle" >0.41201</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >AR(1)</td><td align="center" valign="middle" >0.34903</td><td align="center" valign="middle" >0.35454</td><td align="center" valign="middle" >0.29119</td><td align="center" valign="middle" >0.29492</td></tr><tr><td align="center" valign="middle" >100</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Ind</td><td align="center" valign="middle" >0.44306</td><td align="center" valign="middle" >0.43724</td><td align="center" valign="middle" >0.40696</td><td align="center" valign="middle" >0.41015</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.7</td><td align="center" valign="middle" >Exch</td><td align="center" valign="middle" >0.17467</td><td align="center" valign="middle" >0.17678</td><td align="center" valign="middle" >0.16708</td><td align="center" valign="middle" >0.16904</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >AR(1)</td><td align="center" valign="middle" >0.19500</td><td align="center" valign="middle" >0.19504</td><td align="center" valign="middle" >0.14110</td><td align="center" valign="middle" >0.14566</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Ind</td><td align="center" valign="middle" >0.42543</td><td align="center" valign="middle" >0.42879</td><td align="center" valign="middle" >0.40011</td><td align="center" valign="middle" >0.42267</td></tr></tbody></table></table-wrap><p>WR: Woring R, TR: True R.</p><p>(C1). Pollution of the response variable Y: randomly turn S% of y i j into y i j + b , b ~ N ( 2,1 ) .</p><p>(C2). Pollution only for covariate X: randomly turn S% of x i j into x i j + a , a ~ N ( ( 1 , 1 , 1 ) T , I 3 ) .</p><p>(C3). Simultaneous contamination of X and Y: randomly turn S%/3 of y i j into y i j + b , b ~ N ( 2,1 ) , randomly turn S%/3 of x i j into x i j + a , a ~ N ( ( 1 , 1 , 1 ) T , I 3 ) .</p><p>Where S% is pollution rate. In this paper, 0.06 and 0.1 are selected. Some simulation results are shown in Tables 2-4.</p><p><xref ref-type="table" rid="table2">Table 2</xref> is the simulation results under C1. By comparison, in most cases, the</p><table-wrap id="table2" ><label><xref ref-type="table" rid="table2">Table 2</xref></label><caption><title> Comparison of Two Estimators under C1</title></caption><table><tbody><thead><tr><th align="center" valign="middle"  colspan="4"  >C1</th><th align="center" valign="middle"  colspan="4"  >TR</th></tr></thead><tr><td align="center" valign="middle" >n</td><td align="center" valign="middle" >ρ</td><td align="center" valign="middle" >YP</td><td align="center" valign="middle" >WR</td><td align="center" valign="middle"  colspan="2"  >Exch</td><td align="center" valign="middle"  colspan="2"  >AR-1</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >ELGEE</td><td align="center" valign="middle" >RELGEE</td><td align="center" valign="middle" >ELGEE</td><td align="center" valign="middle" >RELGEE</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Exch</td><td align="center" valign="middle" >1.04790</td><td align="center" valign="middle" >0.79504</td><td align="center" valign="middle" >0.99345</td><td align="center" valign="middle" >0.74981</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.06</td><td align="center" valign="middle" >AR-1</td><td align="center" valign="middle" >1.07018</td><td align="center" valign="middle" >0.81152</td><td align="center" valign="middle" >0.97866</td><td align="center" valign="middle" >0.73729</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.3</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Ind</td><td align="center" valign="middle" >1.14262</td><td align="center" valign="middle" >0.87243</td><td align="center" valign="middle" >0.98603</td><td align="center" valign="middle" >0.76988</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Exch</td><td align="center" valign="middle" >1.23468</td><td align="center" valign="middle" >0.88941</td><td align="center" valign="middle" >1.50948</td><td align="center" valign="middle" >1.05796</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.1</td><td align="center" valign="middle" >AR-1</td><td align="center" valign="middle" >1.29277</td><td align="center" valign="middle" >0.92924</td><td align="center" valign="middle" >1.43798</td><td align="center" valign="middle" >1.02313</td></tr><tr><td align="center" valign="middle" >50</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Ind</td><td align="center" valign="middle" >1.33828</td><td align="center" valign="middle" >0.98621</td><td align="center" valign="middle" >1.46806</td><td align="center" valign="middle" >1.03712</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Exch</td><td align="center" valign="middle" >0.80301</td><td align="center" valign="middle" >0.56517</td><td align="center" valign="middle" >0.91464</td><td align="center" valign="middle" >0.62653</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.06</td><td align="center" valign="middle" >AR-1</td><td align="center" valign="middle" >0.89749</td><td align="center" valign="middle" >0.65623</td><td align="center" valign="middle" >0.86469</td><td align="center" valign="middle" >0.62672</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.7</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Ind</td><td align="center" valign="middle" >1.18518</td><td align="center" valign="middle" >0.99555</td><td align="center" valign="middle" >1.02135</td><td align="center" valign="middle" >0.84933</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Exch</td><td align="center" valign="middle" >1.15356</td><td align="center" valign="middle" >0.78475</td><td align="center" valign="middle" >1.30655</td><td align="center" valign="middle" >0.79852</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.1</td><td align="center" valign="middle" >AR-1</td><td align="center" valign="middle" >1.28685</td><td align="center" valign="middle" >0.90425</td><td align="center" valign="middle" >1.24750</td><td align="center" valign="middle" >0.79105</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Ind</td><td align="center" valign="middle" >1.46320</td><td align="center" valign="middle" >1.12052</td><td align="center" valign="middle" >1.39281</td><td align="center" valign="middle" >1.01290</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Exch</td><td align="center" valign="middle" >0.42925</td><td align="center" valign="middle" >0.36534</td><td align="center" valign="middle" >0.45132</td><td align="center" valign="middle" >0.41615</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.06</td><td align="center" valign="middle" >AR-1</td><td align="center" valign="middle" >0.44041</td><td align="center" valign="middle" >0.37885</td><td align="center" valign="middle" >0.44808</td><td align="center" valign="middle" >0.40805</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.3</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Ind</td><td align="center" valign="middle" >0.47229</td><td align="center" valign="middle" >0.41564</td><td align="center" valign="middle" >0.45741</td><td align="center" valign="middle" >0.42950</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Exch</td><td align="center" valign="middle" >0.49700</td><td align="center" valign="middle" >0.44274</td><td align="center" valign="middle" >0.42543</td><td align="center" valign="middle" >0.38569</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.1</td><td align="center" valign="middle" >AR-1</td><td align="center" valign="middle" >0.50975</td><td align="center" valign="middle" >0.45279</td><td align="center" valign="middle" >0.41175</td><td align="center" valign="middle" >0.37517</td></tr><tr><td align="center" valign="middle" >100</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Ind</td><td align="center" valign="middle" >0.53253</td><td align="center" valign="middle" >0.48246</td><td align="center" valign="middle" >0.43528</td><td align="center" valign="middle" >0.38958</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Exch</td><td align="center" valign="middle" >0.26753</td><td align="center" valign="middle" >0.23767</td><td align="center" valign="middle" >0.28060</td><td align="center" valign="middle" >0.24274</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.06</td><td align="center" valign="middle" >AR-1</td><td align="center" valign="middle" >0.30773</td><td align="center" valign="middle" >0.27131</td><td align="center" valign="middle" >0.28723</td><td align="center" valign="middle" >0.23802</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.7</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Ind</td><td align="center" valign="middle" >0.42582</td><td align="center" valign="middle" >0.39690</td><td align="center" valign="middle" >0.47786</td><td align="center" valign="middle" >0.43469</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Exch</td><td align="center" valign="middle" >0.33180</td><td align="center" valign="middle" >0.25774</td><td align="center" valign="middle" >0.36312</td><td align="center" valign="middle" >0.30250</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.1</td><td align="center" valign="middle" >AR-1</td><td align="center" valign="middle" >0.39815</td><td align="center" valign="middle" >0.31492</td><td align="center" valign="middle" >0.38295</td><td align="center" valign="middle" >0.30005</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Ind</td><td align="center" valign="middle" >0.51711</td><td align="center" valign="middle" >0.46137</td><td align="center" valign="middle" >0.50765</td><td align="center" valign="middle" >0.46074</td></tr></tbody></table></table-wrap><p>YP: Pollution probability of the response variable Y.</p><table-wrap id="table3" ><label><xref ref-type="table" rid="table3">Table 3</xref></label><caption><title> Comparison of Two Estimators under C2</title></caption><table><tbody><thead><tr><th align="center" valign="middle"  colspan="4"  >C2</th><th align="center" valign="middle"  colspan="4"  >TR</th></tr></thead><tr><td align="center" valign="middle" >n</td><td align="center" valign="middle" >ρ</td><td align="center" valign="middle" >XP</td><td align="center" valign="middle" >WR</td><td align="center" valign="middle"  colspan="2"  >Exch</td><td align="center" valign="middle"  colspan="2"  >AR-1</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >ELGEE</td><td align="center" valign="middle" >RELGEE</td><td align="center" valign="middle" >ELGEE</td><td align="center" valign="middle" >RELGEE</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Exch</td><td align="center" valign="middle" >12.91886</td><td align="center" valign="middle" >0.99187</td><td align="center" valign="middle" >13.97928</td><td align="center" valign="middle" >1.02373</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.06</td><td align="center" valign="middle" >AR(1)</td><td align="center" valign="middle" >12.82331</td><td align="center" valign="middle" >0.99716</td><td align="center" valign="middle" >14.12307</td><td align="center" valign="middle" >1.02851</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.3</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Ind</td><td align="center" valign="middle" >13.06875</td><td align="center" valign="middle" >1.03024</td><td align="center" valign="middle" >13.80362</td><td align="center" valign="middle" >1.00403</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Exch</td><td align="center" valign="middle" >42.76916</td><td align="center" valign="middle" >3.00972</td><td align="center" valign="middle" >39.56463</td><td align="center" valign="middle" >2.88551</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.1</td><td align="center" valign="middle" >AR(1)</td><td align="center" valign="middle" >43.36231</td><td align="center" valign="middle" >3.05236</td><td align="center" valign="middle" >39.30508</td><td align="center" valign="middle" >2.88421</td></tr><tr><td align="center" valign="middle" >50</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Ind</td><td align="center" valign="middle" >43.31341</td><td align="center" valign="middle" >3.05817</td><td align="center" valign="middle" >40.03126</td><td align="center" valign="middle" >2.89432</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Exch</td><td align="center" valign="middle" >14.44630</td><td align="center" valign="middle" >0.88005</td><td align="center" valign="middle" >13.3182</td><td align="center" valign="middle" >0.89685</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.06</td><td align="center" valign="middle" >AR(1)</td><td align="center" valign="middle" >14.57675</td><td align="center" valign="middle" >0.93714</td><td align="center" valign="middle" >13.72404</td><td align="center" valign="middle" >0.87365</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.7</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Ind</td><td align="center" valign="middle" >14.76241</td><td align="center" valign="middle" >1.09283</td><td align="center" valign="middle" >13.10561</td><td align="center" valign="middle" >0.93932</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Exch</td><td align="center" valign="middle" >39.52561</td><td align="center" valign="middle" >2.89129</td><td align="center" valign="middle" >37.91395</td><td align="center" valign="middle" >2.73270</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.1</td><td align="center" valign="middle" >AR(1)</td><td align="center" valign="middle" >40.71029</td><td align="center" valign="middle" >3.08226</td><td align="center" valign="middle" >37.78436</td><td align="center" valign="middle" >2.74435</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Ind</td><td align="center" valign="middle" >40.76240</td><td align="center" valign="middle" >3.18213</td><td align="center" valign="middle" >39.59294</td><td align="center" valign="middle" >2.85362</td></tr></tbody></table></table-wrap><p>XP: Pollution probability of covariate X.</p><table-wrap id="table4" ><label><xref ref-type="table" rid="table4">Table 4</xref></label><caption><title> Comparison of Two Estimators under C3</title></caption><table><tbody><thead><tr><th align="center" valign="middle"  colspan="4"  >C3</th><th align="center" valign="middle"  colspan="4"  >TR</th></tr></thead><tr><td align="center" valign="middle" >n</td><td align="center" valign="middle" >ρ</td><td align="center" valign="middle" >YXP</td><td align="center" valign="middle" >WR</td><td align="center" valign="middle"  colspan="2"  >Exch</td><td align="center" valign="middle"  colspan="2"  >AR-1</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >ELGEE</td><td align="center" valign="middle" >RELGEE</td><td align="center" valign="middle" >ELGEE</td><td align="center" valign="middle" >RELGEE</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Exch</td><td align="center" valign="middle" >17.02696</td><td align="center" valign="middle" >1.67541</td><td align="center" valign="middle" >13.75782</td><td align="center" valign="middle" >1.83632</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.06</td><td align="center" valign="middle" >AR(1)</td><td align="center" valign="middle" >17.02611</td><td align="center" valign="middle" >1.68535</td><td align="center" valign="middle" >13.80805</td><td align="center" valign="middle" >1.77938</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.3</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Ind</td><td align="center" valign="middle" >16.81146</td><td align="center" valign="middle" >1.69671</td><td align="center" valign="middle" >13.69043</td><td align="center" valign="middle" >1.70931</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Exch</td><td align="center" valign="middle" >17.74346</td><td align="center" valign="middle" >1.62392</td><td align="center" valign="middle" >15.18327</td><td align="center" valign="middle" >1.75757</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.1</td><td align="center" valign="middle" >AR(1)</td><td align="center" valign="middle" >18.27163</td><td align="center" valign="middle" >1.59380</td><td align="center" valign="middle" >15.07867</td><td align="center" valign="middle" >1.73827</td></tr><tr><td align="center" valign="middle" >50</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Ind</td><td align="center" valign="middle" >19.71323</td><td align="center" valign="middle" >1.63598</td><td align="center" valign="middle" >15.07310</td><td align="center" valign="middle" >1.73339</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Exch</td><td align="center" valign="middle" >19.71323</td><td align="center" valign="middle" >1.66511</td><td align="center" valign="middle" >16.65348</td><td align="center" valign="middle" >1.49746</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.06</td><td align="center" valign="middle" >AR(1)</td><td align="center" valign="middle" >20.38681</td><td align="center" valign="middle" >1.82246</td><td align="center" valign="middle" >16.67835</td><td align="center" valign="middle" >1.47826</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.7</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Ind</td><td align="center" valign="middle" >19.18665</td><td align="center" valign="middle" >1.92724</td><td align="center" valign="middle" >15.74532</td><td align="center" valign="middle" >1.71987</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Exch</td><td align="center" valign="middle" >15.62539</td><td align="center" valign="middle" >1.63831</td><td align="center" valign="middle" >15.67169</td><td align="center" valign="middle" >1.71610</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.1</td><td align="center" valign="middle" >AR(1)</td><td align="center" valign="middle" >17.59703</td><td align="center" valign="middle" >1.83022</td><td align="center" valign="middle" >16.35533</td><td align="center" valign="middle" >1.61183</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Ind</td><td align="center" valign="middle" >14.57003</td><td align="center" valign="middle" >2.01667</td><td align="center" valign="middle" >16.47950</td><td align="center" valign="middle" >1.73774</td></tr></tbody></table></table-wrap><p>YXP: Pollution probability of the response variable Y when Pollution probability of covariate X is 0.06.</p><p>mean square error of the estimator in this paper is smaller than that of the estimator in ELGEE method. Comparing different pollution intensity, we can see that the greater the pollution intensity, the more obvious the superiority of robust estimation efficiency, which shows that the estimation method in this paper has a strong robustness. It can also be seen that when the working matrix is set incorrectly, the difference of estimator is relatively small; when the working correlation matrix is a real matrix, the estimation efficiency is the highest; when the working matrix is independent structure (Ind), the estimation efficiency is the lowest without considering the correlation between data.</p><p><xref ref-type="table" rid="table3">Table 3</xref> and <xref ref-type="table" rid="table4">Table 4</xref> are part of the results under C2 and pollution mode C3. Similar to <xref ref-type="table" rid="table2">Table 2</xref>, in most cases, the mean square error of this estimator is smaller than that of ELGEE estimator. Compared with <xref ref-type="table" rid="table2">Table 2</xref>, the mean square error of ELGEE estimator is only one-tenth of the mean square error of ELGEE estimator when the pollution intensity is significantly increased. The estimation method in this paper can significantly reduce the impact of outliers on the estimator. Similarly, the estimation efficiency is the highest when the working correlation matrix is a real matrix. When there is intra-group correlation in the model, the estimation efficiency is the lowest when the correlation is neglected in the estimation, which reflects the necessity of considering the longitudinal data model.</p><p>It is worth adding that because the method in this paper is a non-parametric method, the distribution of random errors does not necessarily follow the normal distribution. We simulate the distribution of random errors satisfying t(3) again. The simulation results are shown in <xref ref-type="table" rid="table5">Table 5</xref>. Bias (&#215;100) represents 100 times the deviation.</p><p>In <xref ref-type="table" rid="table5">Table 5</xref>, in all cases, the mean square error of the estimator in this paper is less than that of ELGEE estimator, which shows that the estimation method constructed in this paper can also effectively and robustly estimate the data of heavy-tailed distribution.</p></sec><sec id="s5"><title>5. Summary</title><p>We introduce the generalized estimating equations commonly used in longitudinal data, and derive robust estimation functions. Then we combine the robust estimation equations with the elemental empirical likelihood method to obtain the empirical likelihood ratio function of the estimated parameters. We show a</p><table-wrap id="table5" ><label><xref ref-type="table" rid="table5">Table 5</xref></label><caption><title> The error distribution of data satisfies t(3)</title></caption><table><tbody><thead><tr><th align="center" valign="middle"  colspan="7"  >t(3)</th></tr></thead><tr><td align="center" valign="middle" >n</td><td align="center" valign="middle" >ρ</td><td align="center" valign="middle" >WR</td><td align="center" valign="middle"  colspan="2"  >Bias (&#215;100)</td><td align="center" valign="middle"  colspan="2"  >MSE (&#215;100)</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >ELGEE</td><td align="center" valign="middle" >RELGEE</td><td align="center" valign="middle" >ELGEE</td><td align="center" valign="middle" >RELGEE</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.3</td><td align="center" valign="middle" >Exch</td><td align="center" valign="middle" >−0.03467</td><td align="center" valign="middle" >−0.05221</td><td align="center" valign="middle" >1.81182</td><td align="center" valign="middle" >1.01774</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >AR(1)</td><td align="center" valign="middle" >0.17968</td><td align="center" valign="middle" >0.30765</td><td align="center" valign="middle" >1.75744</td><td align="center" valign="middle" >1.15462</td></tr><tr><td align="center" valign="middle" >50</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Ind</td><td align="center" valign="middle" >0.26076</td><td align="center" valign="middle" >0.11889</td><td align="center" valign="middle" >2.14819</td><td align="center" valign="middle" >1.30291</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >0.7</td><td align="center" valign="middle" >Exch</td><td align="center" valign="middle" >0.55148</td><td align="center" valign="middle" >0.64514</td><td align="center" valign="middle" >0.84950</td><td align="center" valign="middle" >0.58737</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >AR(1)</td><td align="center" valign="middle" >0.18788</td><td align="center" valign="middle" >0.18082</td><td align="center" valign="middle" >1.25479</td><td align="center" valign="middle" >0.67416</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Ind</td><td align="center" valign="middle" >−0.19433</td><td align="center" valign="middle" >−0.07454</td><td align="center" valign="middle" >2.04687</td><td align="center" valign="middle" >1.18954</td></tr></tbody></table></table-wrap><p>relatively optimized algorithm that can improve the efficiency and computational time of operation. We do a systematic simulation study. The simulation results show that our method maintains high estimation efficiency when the data is not polluted; in the case of data pollution, the estimator of this paper is obviously better than the non-robust estimator. With the increase of pollution intensity, the robustness of our method is more significant, and it has a significant resistance to outliers. When the working matrix is set incorrectly, the difference of estimator is relatively small; when the working correlation matrix is a real matrix, the estimation efficiency is the highest; when the working matrix is independent structure (Ind), the estimation efficiency is the lowest without considering the correlation between data. At the same time, since the estimator in this paper is based on empirical likelihood method, it is suitable for the longitudinal data of thick-tailed distribution. There are still many problems worth further study in this paper, such as the application of estimation methods to partial linear models and variable selection based on robust estimation.</p></sec><sec id="s6"><title>Conflicts of Interest</title><p>The authors declare no conflicts of interest regarding the publication of this paper.</p></sec><sec id="s7"><title>Cite this paper</title><p>Huang, T.Y., Fan, Y.L. and Sun, Z.R. (2019) Robust Element-Wise Empirical Likelihood Estimation Method for Longitudinal Data. Journal of Applied Mathematics and Physics, 7, 1408-1420. https://doi.org/10.4236/jamp.2019.76094</p></sec></body><back><ref-list><title>References</title><ref id="scirp.93442-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Liang, K.Y. and Zeger, S.L. (1986) Longitudinal Data Analysis Using Generalized Linear Models. Biometrika, 73, 13-22. https://doi.org/10.1093/biomet/73.1.13</mixed-citation></ref><ref id="scirp.93442-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Diggle, P., Diggle, P.J., Heagerty, P., et al. (2002) Analysis of Longitudinal Data. Oxford University Press, Oxford.</mixed-citation></ref><ref id="scirp.93442-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Fan, Y.L, Qin, G.Y. and Zhu, Z.Y. (2012) Variable Selection in Robust Regression Models for Longitudinal Data. Journal of Multivariate Analysis, 109, 156-167. https://doi.org/10.1016/j.jmva.2012.03.007</mixed-citation></ref><ref id="scirp.93442-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Huber, P.J. (1964) Robust Estimation of a Location Parameter. The Annals of Mathematical Statistics, 35, 73-101. https://doi.org/10.1214/aoms/1177703732</mixed-citation></ref><ref id="scirp.93442-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Wang, X., Jiang, Y., Huang, M. and Zhang, H.P. (2013) Robust Variable Selection with Exponential Squared Loss. Journal of the American Statistical Association, 108, 632-643. https://doi.org/10.1080/01621459.2013.766613</mixed-citation></ref><ref id="scirp.93442-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Lv, J., Yang, H. and Guo, C. (2015) An Efficient and Robust Variable Selection Method for Longitudinal Generalized Linear Models. Computational Statistics Data Analysis, 82, 74-88. https://doi.org/10.1016/j.csda.2014.08.006</mixed-citation></ref><ref id="scirp.93442-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Qin, G.Y., Zhu, Z.Y. and Fung, W.K. (2009) Robust Estimation of Covariance Parameters in Partial Linear Model for Longitudinal Data. Journal of Statistical Planning and Inference, 139, 558-570. https://doi.org/10.1016/j.jspi.2008.03.042</mixed-citation></ref><ref id="scirp.93442-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Wang, Y.G., Lin, X. and Zhu, M. (2005) Robust Estimating Functions and Bias Correction for Longitudinal Data Analysis. Biometrics, 61, 684-691. https://doi.org/10.1111/j.1541-0420.2005.00354.x</mixed-citation></ref><ref id="scirp.93442-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Qin, G.Y. and Zhu, Z.Y. (2007) Robust Estimation in Generalized Semiparametric Mixed Models for Longitudinal Data. Journal of Multivariate Analysis, 98, 1658-1683. https://doi.org/10.1016/j.jmva.2007.01.006</mixed-citation></ref><ref id="scirp.93442-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Zheng, X., Fung, W.K. and Zhu, Z. (2013) Robust Estimation in Joint Mean? Covariance Regression Model for Longitudinal Data. Annals of the Institute of Statistical Mathematics, 65, 617-638. https://doi.org/10.1007/s10463-012-0383-8</mixed-citation></ref><ref id="scirp.93442-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Owen, A.B. (1988) Empirical Likelihood Ratio Confidence Intervals for a Single Functional. Biometrika, 75, 237-249. https://doi.org/10.1093/biomet/75.2.237</mixed-citation></ref><ref id="scirp.93442-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Azzalini, A. (2017) Statistical Inference Based on the Likelihood. Routledge, Abingdon-on-Thames.</mixed-citation></ref><ref id="scirp.93442-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Qin, J. and Lawless, J. (1994) Empirical Likelihood and General Estimating Equations. The Annals of Statistics, 100, 300-325. https://doi.org/10.1214/aos/1176325370</mixed-citation></ref><ref id="scirp.93442-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">Bondell, H.D. and Stefansk, L.A. (1994) Empirical Robust Regression via Two-Stage Generalized Empirical Likelihood. Journal of the American Statistical Association, 108, 644-655. https://doi.org/10.1080/01621459.2013.779847</mixed-citation></ref><ref id="scirp.93442-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Bai, Y., Fung, W.K. and Zhu, Z. (2010) Weighted Empirical Likelihood for Generalized Linear Models with Longitudinal Data. Journal of Statistical Planning and Inference, 140, 3446-3456. https://doi.org/10.1016/j.jspi.2010.05.007</mixed-citation></ref><ref id="scirp.93442-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">Wang, S., Qian, L. and Carroll, R.J. (2010) Generalized Empirical Likelihood Methods for Analyzing Longitudinal Data. Biometrika, 97, 79-93. https://doi.org/10.1093/biomet/asp073</mixed-citation></ref><ref id="scirp.93442-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">Li, S.M., Ren, Y.Y. and Lu, G. (2018) A Robust Estimation and Empirical Likelihood Inference for Longitudinal Data Models. Journal of Applied Statistics and Management, 4, 631-638.</mixed-citation></ref><ref id="scirp.93442-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">He, X., Fung, W.K. and Zhu, Z. (2005) Robust Estimation in Generalized Partial Linear Models for Clustered Data. Journal of the American Statistical Association, 100, 1176-1184. https://doi.org/10.1198/016214505000000277</mixed-citation></ref><ref id="scirp.93442-ref19"><label>19</label><mixed-citation publication-type="other" xlink:type="simple">Ozdemir, S. and Arslan, O. (2015) An Alternative Algorithm of the Empirical Likelihood Estimation for the Parameter of a Linear Regression Model. Communications in Statistics-Simulation and Computation, 42, 1-9. https://doi.org/10.1080/03610918.2018.1435801</mixed-citation></ref></ref-list></back></article>