<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">OJS</journal-id><journal-title-group><journal-title>Open Journal of Statistics</journal-title></journal-title-group><issn pub-type="epub">2161-718X</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/ojs.2014.49071</article-id><article-id pub-id-type="publisher-id">OJS-50518</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Physics&amp;Mathematics</subject></subj-group></article-categories><title-group><article-title>
 
 
  On Diagnostics in Stochastic Restricted Linear Regression Models
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>huling</surname><given-names>Wang</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Man</surname><given-names>Liu</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Xiaohong</surname><given-names>Deng</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib></contrib-group><aff id="aff1"><addr-line>Department of Fundametal Course, Air Force Logistics College, Xuzhou, China</addr-line></aff><author-notes><corresp id="cor1">* E-mail:<email>155328313@qq.com(HW)</email>;<email>155328313@qq.com(ML)</email>;<email>155328313@qq.com(XD)</email>;</corresp></author-notes><pub-date pub-type="epub"><day>13</day><month>10</month><year>2014</year></pub-date><volume>04</volume><issue>09</issue><fpage>757</fpage><lpage>764</lpage><history><date date-type="received"><day>18</day>	<month>August</month>	<year>2014</year></date><date date-type="rev-recd"><day>23</day>	<month>September</month>	<year>2014</year>	</date><date date-type="accepted"><day>2</day>	<month>October</month>	<year>2014</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  The aim of this paper is to propose some diagnostic methods in stochastic restricted linear regression models. A review of stochastic restricted linear regression models is given. For the model, this paper studies the method and application of the diagnostic mostly. Firstly, review the estimators of this model. Secondly, show that the case deletion model is equivalent to the mean shift outlier model for diagnostic purpose. Then, some diagnostic statistics are given. At last, example is given to illustrate our results.
 
</p></abstract><kwd-group><kwd>Stochastic Restricted Linear Regression Model</kwd><kwd> Stochastic Restricted Ridge Estimator</kwd><kwd> Statistical Diagnostics</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>In a linear regression, the ordinary least squares estimator (LS) is unbiased and has minimum variance among all linear unbiased estimators and has been treated as the best estimator for a long time. When the addition of stochastic linear restrictions on the unknown parameter vector was assumed to be held, Theil [<xref ref-type="bibr" rid="scirp.50518-ref1">1</xref>] proposed the ordinary mixed estimator (OME). Hubert and Wijekoon [<xref ref-type="bibr" rid="scirp.50518-ref2">2</xref>] proposed the stochastic restricted Liu estimator (SRLE). And Li and Yang [<xref ref-type="bibr" rid="scirp.50518-ref3">3</xref>] introduced the stochastic restricted ridge estimator (SRRE) by grating the ORE into the mixed estimation procedure. Wu [<xref ref-type="bibr" rid="scirp.50518-ref4">4</xref>] discussed stochastic restricted <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x5.png" xlink:type="simple"/></inline-formula> class estimator and stochastic restricted <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x6.png" xlink:type="simple"/></inline-formula> class estimator in linear regression model. When the prior information and the sample information were not equally important, Schafrin and Toutenburg [<xref ref-type="bibr" rid="scirp.50518-ref5">5</xref>] introduced the method of weighted mixed regression and developed the weighted mixed estimator (WME). Li and Yang [<xref ref-type="bibr" rid="scirp.50518-ref6">6</xref>] grated the ORE into the weighted mixed estimation procedure and proposed the weighted mixed ridge estimator. Liu, et al. [<xref ref-type="bibr" rid="scirp.50518-ref7">7</xref>] proposed the stochastic weighted mixed almost unbiased ridge estimator by combining the WME and the AURE and also proposed the stochastic weighted mixed almost unbiased Liu estimator by combining the WME and the AULE in a linear regression model. He and Wu [<xref ref-type="bibr" rid="scirp.50518-ref8">8</xref>] proposed a new estimator to combat the multicollinearity in the linear model when there were stochastic linear restrictions on the regression coefficients. The new estimator is constructed by combining the ordinary mixed estimator (OME) and the principal components regression (PCR) estimator, which is called the stochastic restricted principal components (SRPC) regression estimator. Liu, Yang and Wu [<xref ref-type="bibr" rid="scirp.50518-ref9">9</xref>] introduced the weighted mixed almost unbiased ridge estimator (WMAURE) based on the weighted mixed estimator (WME) and the almost unbiased ridge estimator (AURE) in linear regression model. They discussed superiorities of the new estimator under the quadratic bias (QB) and the mean square error matrix (MSEM) criteria. Wu and Liu [<xref ref-type="bibr" rid="scirp.50518-ref10">10</xref>] considered several estimators for estimating the stochastic restricted ridge regression estimators. A simulation study has been conducted to compare the performance of the estimators. The result from the simulation study shows that stochastic restricted ridge regression estimators outperform mixed estimator.</p><p>Nearly forty years, the diagnosis and influence analysis of linear regression model has been fully developed (R.D. Cook and S. Weisberg [<xref ref-type="bibr" rid="scirp.50518-ref11">11</xref>] , Wei, et al. [<xref ref-type="bibr" rid="scirp.50518-ref12">12</xref>] ). Jiawei Wang [<xref ref-type="bibr" rid="scirp.50518-ref13">13</xref>] discussed the linear regression model with the random constraints, introduced its residuals and showed that the CDM was equivalent to the mean shift outlier model for diagnostics purpose based on general least square estimate. Lian Yang and Hu Yang [<xref ref-type="bibr" rid="scirp.50518-ref14">14</xref>] dealt with the data deleted model and the mean shift model under ellipsoidal restriction and obtained the equivalence of the diagonal statistic between the two models. Lu Wang [<xref ref-type="bibr" rid="scirp.50518-ref15">15</xref>] discussed the statistical diagnostic of multivariate linear regression model with linear restriction.</p><p>However, statistical diagnostics of stochastic restricted linear regression models based on stochastic restricted ridge estimator (SRRE) are studied in this paper. The paper is organized as follows. The model and the estimators are reviewed in Section 2. We show that the case deletion model is equivalent to the mean shift outlier model for diagnostic purpose in Section 3. Some diagnostic statistics are given in Section 4. The example to illustrate our results is given in Section 5.</p></sec><sec id="s2"><title>2. Review of Stochastic Restricted Linear Regression Model</title><p>Consider the following linear model:</p><disp-formula id="scirp.50518-formula245"><label>, (1)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/10-1240416x7.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x8.png" xlink:type="simple"/></inline-formula> is an <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x9.png" xlink:type="simple"/></inline-formula> vector of observation, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x10.png" xlink:type="simple"/></inline-formula>is an <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x11.png" xlink:type="simple"/></inline-formula> design matrix of rank<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x12.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x13.png" xlink:type="simple"/></inline-formula>is a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x14.png" xlink:type="simple"/></inline-formula> vector denoting unknown coefficients, and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x15.png" xlink:type="simple"/></inline-formula> is an <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x16.png" xlink:type="simple"/></inline-formula> random error vector with <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x17.png" xlink:type="simple"/></inline-formula> and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x18.png" xlink:type="simple"/></inline-formula>.</p><p>Suppose that <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x19.png" xlink:type="simple"/></inline-formula> satisfies the following stochastic restriction, that is,</p><disp-formula id="scirp.50518-formula246"><label>, (2)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/10-1240416x20.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x21.png" xlink:type="simple"/></inline-formula> is a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x21.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x22.png" xlink:type="simple"/></inline-formula> nonzero matrix with <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x21.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x22.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x23.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x21.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x22.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x23.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x24.png" xlink:type="simple"/></inline-formula> is a known vector, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x21.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x22.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x23.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x24.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x25.png" xlink:type="simple"/></inline-formula>and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x21.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x22.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x23.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x24.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x25.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x26.png" xlink:type="simple"/></inline-formula>. In this paper, we assumed that <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x21.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x22.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x23.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x24.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x25.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x26.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x27.png" xlink:type="simple"/></inline-formula> is independent of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x21.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x22.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x23.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x24.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x25.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x26.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x27.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x28.png" xlink:type="simple"/></inline-formula>. And now model (1) is called stochastic restricted linear regression model.</p><sec id="s2_1"><title>2.1. Estimates of Model</title><p>Using the mixed approach, Durbin [<xref ref-type="bibr" rid="scirp.50518-ref16">16</xref>] , Theil and Goldberger [<xref ref-type="bibr" rid="scirp.50518-ref17">17</xref>] introduced the mixed estimator (ME), which is defined as follows:</p><disp-formula id="scirp.50518-formula247"><label>. (3)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/10-1240416x29.png"  xlink:type="simple"/></disp-formula><p>The mixed estimator is an unbiased estimator. However, when multicollinearity exists, the mixed estimator is no longer a good estimator.</p><p>Ozkale [<xref ref-type="bibr" rid="scirp.50518-ref18">18</xref>] proposed the following stochastic restricted ridge estimator (SRRE):</p><disp-formula id="scirp.50518-formula248"><label>. (4)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/10-1240416x30.png"  xlink:type="simple"/></disp-formula><p>The result from the simulation study shows that SRRE outperform ME (see Wu and Liu [<xref ref-type="bibr" rid="scirp.50518-ref19">19</xref>] ).</p></sec><sec id="s2_2"><title>2.2. Estimating k</title><p>The most classical ridge estimator for linear regression is the following:</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x31.png" xlink:type="simple"/></inline-formula>,</p><p>proposed by Hoerl and Kennard [<xref ref-type="bibr" rid="scirp.50518-ref20">20</xref>] , where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x32.png" xlink:type="simple"/></inline-formula> denote the maximum element of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x32.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x33.png" xlink:type="simple"/></inline-formula>,</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x34.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x34.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x35.png" xlink:type="simple"/></inline-formula>, and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x34.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x35.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x36.png" xlink:type="simple"/></inline-formula> is the estimator of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x34.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x35.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x36.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x37.png" xlink:type="simple"/></inline-formula>. Hoerl, et al. [<xref ref-type="bibr" rid="scirp.50518-ref21">21</xref>] introduced</p><p>an alternative of the estimator of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x38.png" xlink:type="simple"/></inline-formula>, which is defined as follows:</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x39.png" xlink:type="simple"/></inline-formula>.</p><p>In Schaefer, et al. [<xref ref-type="bibr" rid="scirp.50518-ref22">22</xref>] , a modified version of this estimator is proposed as follows:</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x40.png" xlink:type="simple"/></inline-formula>.</p><p>In Kibria, et al. [<xref ref-type="bibr" rid="scirp.50518-ref23">23</xref>] , a new estimator is proposed as follows:</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x41.png" xlink:type="simple"/></inline-formula>.</p><p>This paper selects <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x42.png" xlink:type="simple"/></inline-formula> to estimate <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x42.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x43.png" xlink:type="simple"/></inline-formula> below.</p></sec></sec><sec id="s3"><title>3. Diagnostic Methods</title><sec id="s3_1"><title>3.1. Case-Deletion Model</title><p>Consider the stochastic restricted linear model, where the <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x44.png" xlink:type="simple"/></inline-formula>-th case <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x44.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x45.png" xlink:type="simple"/></inline-formula> is deleted,<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x44.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x45.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x46.png" xlink:type="simple"/></inline-formula>.</p><disp-formula id="scirp.50518-formula249"><label>(5)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/10-1240416x47.png"  xlink:type="simple"/></disp-formula><p>This model is called case-deletion model. Supposed that the SRRE of the coefficient function <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x48.png" xlink:type="simple"/></inline-formula> in model (5) is<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x48.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x49.png" xlink:type="simple"/></inline-formula>.</p><p>In order to study the influence of the <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x50.png" xlink:type="simple"/></inline-formula>-th case<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x50.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x51.png" xlink:type="simple"/></inline-formula>, and compare the difference between <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x50.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x51.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x52.png" xlink:type="simple"/></inline-formula> and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x50.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x51.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x52.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x53.png" xlink:type="simple"/></inline-formula>. The important result as following theorem.</p><p>Theorem 1. For model (5), the SRRE of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x54.png" xlink:type="simple"/></inline-formula> is</p><disp-formula id="scirp.50518-formula250"><label>(6)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/10-1240416x55.png"  xlink:type="simple"/></disp-formula><p>and</p><disp-formula id="scirp.50518-formula251"><label>(7)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/10-1240416x56.png"  xlink:type="simple"/></disp-formula><p>where<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x57.png" xlink:type="simple"/></inline-formula>,<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x57.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x58.png" xlink:type="simple"/></inline-formula>.</p><p>Proof: Let <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x59.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x59.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x60.png" xlink:type="simple"/></inline-formula> corresponding to <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x59.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x60.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x61.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x59.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x60.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x61.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x62.png" xlink:type="simple"/></inline-formula> to delete the cases which belong to<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x59.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x60.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x61.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x62.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x63.png" xlink:type="simple"/></inline-formula>. For model (5), we use the SRRE obtained that</p><disp-formula id="scirp.50518-formula252"><graphic  xlink:href="http://html.scirp.org/file/10-1240416x64.png"  xlink:type="simple"/></disp-formula><p>Supposed that<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x65.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x65.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x66.png" xlink:type="simple"/></inline-formula>, then</p><disp-formula id="scirp.50518-formula253"><graphic  xlink:href="http://html.scirp.org/file/10-1240416x67.png"  xlink:type="simple"/></disp-formula><p>which leads to (6).</p><p>Because</p><disp-formula id="scirp.50518-formula254"><graphic  xlink:href="http://html.scirp.org/file/10-1240416x68.png"  xlink:type="simple"/></disp-formula><p>and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x69.png" xlink:type="simple"/></inline-formula>,</p><p>hence</p><disp-formula id="scirp.50518-formula255"><graphic  xlink:href="http://html.scirp.org/file/10-1240416x70.png"  xlink:type="simple"/></disp-formula></sec><sec id="s3_2"><title>3.2. Mean Shift Outlier Model</title><p>The other common statistical diagnosis model is the mean shift outlier model (MSOM). For the stochastic restricted linear regression model, the corresponding MSOM is</p><disp-formula id="scirp.50518-formula256"><label>(8)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/10-1240416x71.png"  xlink:type="simple"/></disp-formula><p>where the parameter <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x72.png" xlink:type="simple"/></inline-formula> are number, which describe the outlier. Let the SRRE of model (8) are <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x72.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x73.png" xlink:type="simple"/></inline-formula> and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x72.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x73.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x74.png" xlink:type="simple"/></inline-formula>. The corresponding matrix formula of model (8) as follows:</p><disp-formula id="scirp.50518-formula257"><label>(9)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/10-1240416x75.png"  xlink:type="simple"/></disp-formula><p>where<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x76.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x76.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x77.png" xlink:type="simple"/></inline-formula>is a n-dimensional vector, the <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x76.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x77.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x78.png" xlink:type="simple"/></inline-formula>-th component is 1, and the other are zero.</p><p>Theorem 2. For model (8), there are<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x79.png" xlink:type="simple"/></inline-formula>, and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x79.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x80.png" xlink:type="simple"/></inline-formula>.</p><p>Proof: By the matrix form of model (8), we obtained</p><disp-formula id="scirp.50518-formula258"><graphic  xlink:href="http://html.scirp.org/file/10-1240416x81.png"  xlink:type="simple"/></disp-formula><p>On the other hand, by the formula of calculating the inverse matrix of partitioned matrix, we have</p><disp-formula id="scirp.50518-formula259"><graphic  xlink:href="http://html.scirp.org/file/10-1240416x82.png"  xlink:type="simple"/></disp-formula><p>which leads to <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x83.png" xlink:type="simple"/></inline-formula> and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x83.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x84.png" xlink:type="simple"/></inline-formula>.</p></sec></sec><sec id="s4"><title>4. Diagnostical Statistics</title><sec id="s4_1"><title>4.1. Generalized Cook Distance</title><p>Let <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x85.png" xlink:type="simple"/></inline-formula> is a nonnegetive matrix and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x85.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x86.png" xlink:type="simple"/></inline-formula> is one real number. The generalized Cook distance of the <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x85.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x86.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x87.png" xlink:type="simple"/></inline-formula>-th case is defined as follows:</p><disp-formula id="scirp.50518-formula260"><label>(10)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/10-1240416x88.png"  xlink:type="simple"/></disp-formula><p>Theorem 3. Supposed that<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x89.png" xlink:type="simple"/></inline-formula>, then the generalized Cook distance of the <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x89.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x90.png" xlink:type="simple"/></inline-formula>-th case is</p><disp-formula id="scirp.50518-formula261"><graphic  xlink:href="http://html.scirp.org/file/10-1240416x91.png"  xlink:type="simple"/></disp-formula><p>where<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x92.png" xlink:type="simple"/></inline-formula>,<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x92.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x93.png" xlink:type="simple"/></inline-formula>.</p><p>Proof: Because</p><disp-formula id="scirp.50518-formula262"><graphic  xlink:href="http://html.scirp.org/file/10-1240416x94.png"  xlink:type="simple"/></disp-formula><p>Substituting these results into (9) gives</p><disp-formula id="scirp.50518-formula263"><graphic  xlink:href="http://html.scirp.org/file/10-1240416x95.png"  xlink:type="simple"/></disp-formula></sec><sec id="s4_2"><title>4.2. W-K Statistic</title><p>W-K statistic is advanced from the view of data fitting. Considering the influence of the <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x96.png" xlink:type="simple"/></inline-formula>-th case. In order to eliminate the influence of scale, it is also need to divide the variance of estimator<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x96.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x97.png" xlink:type="simple"/></inline-formula>. Because the keystone is to review the influence of deleting the <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x96.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x97.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x98.png" xlink:type="simple"/></inline-formula>-th case. Hence, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x96.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x97.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x98.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x99.png" xlink:type="simple"/></inline-formula>is substituted by<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x96.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x97.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x98.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x99.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x100.png" xlink:type="simple"/></inline-formula>. Then, the W-K statistic can be expressed as follows:</p><disp-formula id="scirp.50518-formula264"><label>(11)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/10-1240416x101.png"  xlink:type="simple"/></disp-formula></sec><sec id="s4_3"><title>4.3. Covariance Ratio Statistic</title><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x102.png" xlink:type="simple"/></inline-formula>is to measure the superiorities of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x102.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x103.png" xlink:type="simple"/></inline-formula>. The covariance ratio statistic is defined as follows:</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x104.png" xlink:type="simple"/></inline-formula>,</p><p>which measure the influence of the <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x105.png" xlink:type="simple"/></inline-formula>-th case.</p></sec></sec><sec id="s5"><title>5. Monte Carlo Experiments</title><p>In order to illustrate the validity of above results, extensive Monte Carlo sampling experiments were conducted. To evaluate the finite-sample performance of our proposed method, we simulate 60 random samples from the following model:</p><disp-formula id="scirp.50518-formula265"><graphic  xlink:href="http://html.scirp.org/file/10-1240416x106.png"  xlink:type="simple"/></disp-formula><p>The stochastic restricts as follows:</p><disp-formula id="scirp.50518-formula266"><graphic  xlink:href="http://html.scirp.org/file/10-1240416x107.png"  xlink:type="simple"/></disp-formula><p>where<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x108.png" xlink:type="simple"/></inline-formula>,<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x108.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x109.png" xlink:type="simple"/></inline-formula>. In order to checkout the validity of our proposed metho-</p><p>dology, we change the value of the first, 125th and 374th data. For every case, it is easy to obtain<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x110.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x110.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x111.png" xlink:type="simple"/></inline-formula>and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x110.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x111.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x112.png" xlink:type="simple"/></inline-formula>.</p><p>From the <xref ref-type="fig" rid="fig1">Figure 1</xref>, <xref ref-type="fig" rid="fig2">Figure 2</xref>, <xref ref-type="fig" rid="fig3">Figure 3</xref>, we can see that in most cases, the value of are reasonably close to one fixed value. Following the definition and properties of diagnosis statistics, we can diagnose the strong influence points, the value of which deviate from the average seriously. <xref ref-type="fig" rid="fig2">Figure 2</xref> and <xref ref-type="fig" rid="fig3">Figure 3</xref> show that the first and the third data are strong influence points. Indeed, our results are illustrated.</p><fig id="fig1"  position="float"><label><xref ref-type="fig" rid="fig1">Figure 1</xref></label><caption><title> Generalized cook distance<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x114.png" xlink:type="simple"/></inline-formula></title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/10-1240416x113.png"/></fig><fig id="fig2"  position="float"><label><xref ref-type="fig" rid="fig2">Figure 2</xref></label><caption><title> W-K statistic<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x116.png" xlink:type="simple"/></inline-formula></title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/10-1240416x115.png"/></fig><fig id="fig3"  position="float"><label><xref ref-type="fig" rid="fig3">Figure 3</xref></label><caption><title> Covariance ratio statistic<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/10-1240416x118.png" xlink:type="simple"/></inline-formula></title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/10-1240416x117.png"/></fig></sec><sec id="s6"><title>6. Conclusion</title><p>In this paper, stochastic restricted linear regression models are revisited. Useful diagnostic methods are derived. Through simulation study, we illustrate that our proposed methods can work fairly well.</p></sec></body><back><ref-list><title>References</title><ref id="scirp.50518-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Theil, H. (1963) On the Use of Incomplete Prior Information in Regression Analysis. Journal of the American Statistical Association, 58, 401-414. http://dx.doi.org/10.1080/01621459.1963.10500854</mixed-citation></ref><ref id="scirp.50518-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Hubert, M.H. and Wijekoon, P. (2006) Improvement of the Liu Estimator in Linear Regression Model. Statistical Papers, 47, 471-479. http://dx.doi.org/10.1007/s00362-006-0300-4</mixed-citation></ref><ref id="scirp.50518-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Li, Y. and Yang, H. (2010) A New Stochastic Mixed Ridge Estimator in Linear Regression Model. Statistical Papers, 51, 315-323. http://dx.doi.org/10.1007/s00362-008-0169-5</mixed-citation></ref><ref id="scirp.50518-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Wu, J. (2014) On the Stochastic Restricted r-k Class Estimator and Stochastic Restricted r-d Class Estimator in Linear Regression Model. Journal of Applied Mathematics, 2014, Article ID: 173836.</mixed-citation></ref><ref id="scirp.50518-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Schafrin, B. and Toutenburg, H. (1990) Weighted Mixed Regression. Zeitschrit fur Angewandte Mathematik und Mechanik, 70, T735-T738.</mixed-citation></ref><ref id="scirp.50518-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Li, Y. and Yang, H. (2011) A New Ridge-Type Estimator in Stochastic Restricted Linear Regression. Statistics, 45, 123-130. http://dx.doi.org/10.1080/02331880903573153</mixed-citation></ref><ref id="scirp.50518-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Liu, C.L., Jiang, H.N., Shi, X.H. and Liu, D.L. (2014) Two Kinds of Weighted Biased Estimators in Stochastic Restricted Regression Model. Journal of Applied Mathematics, 2014, Article ID: 314875.</mixed-citation></ref><ref id="scirp.50518-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">He, D.J. and Wu, Y. (2014) A Stochastic Restricted Components Regression Estimator in the Linear Model. The Science World Journal, 2014, Article ID: 231506.</mixed-citation></ref><ref id="scirp.50518-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Liu, C.L., Yang, H. and Wu, J.B. (2014) On the Weighted Mixed Almost Unbiased Ridge Estimator in Stochastic Restricted Linear Regression. Journal of Applied Mathematics, 2014, Article ID: 902715.</mixed-citation></ref><ref id="scirp.50518-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Wu, J.B. and Liu, C.L. (2014) Performance of Some Stochastic Restricted Ridge Estimator in Linear Regression Model. Journal of Applied Mathematics, 2014, Article ID: 508793.</mixed-citation></ref><ref id="scirp.50518-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Cook, R.D. and Weisberg, S. (1982) Residuals and Influence in Regression. Chapman and Hall, New York.</mixed-citation></ref><ref id="scirp.50518-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Wei, B., Lu, G. and Shi, J. (1990) Statistical Diagnostics. Publishing House of Southeast University, Nanjing.</mixed-citation></ref><ref id="scirp.50518-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Wang, J. (2007) Statistical Diagnosis of Linear Regression Model with the Random Constraints and BAYES Method. Nanjing University of Science and Technology, Nanjing.</mixed-citation></ref><ref id="scirp.50518-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">Yang, L. and Yang, H. (2007) Influence of Linear Model under Ellipsoidal Restriction. Chinese Journal of Engineering Mathematics, 24, 60-64.</mixed-citation></ref><ref id="scirp.50518-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Wang, L. (2008) Statistical Diagnosis of Linear Model under Linear Restriction. Nanjing University of Science and Technology, Nanjing.</mixed-citation></ref><ref id="scirp.50518-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">Durbin, J. (1953) A Note on Regression When There Is Extra Neous Information about One of the Coefficients. Journal of the American Statistical Association, 48, 799-808. http://dx.doi.org/10.1080/01621459.1953.10501201</mixed-citation></ref><ref id="scirp.50518-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">Theil, H. and Goldberger, A.S. (1961) On Pure and Mixed Statistical Estimation in Economics. International Economic Review, 2, 65-78. http://dx.doi.org/10.2307/2525589</mixed-citation></ref><ref id="scirp.50518-ref18"><label>18</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>&amp;#214;zkale</surname><given-names> M.R. </given-names></name>,<etal>et al</etal>. (<year>2009</year>)<article-title>A Stochastic Restricted Ridge Regression Estimator</article-title><source> Journal of Multivariate Analysis</source><volume> 100</volume>,<fpage> 1706</fpage>-<lpage>1716</lpage>.<pub-id pub-id-type="doi"></pub-id></mixed-citation></ref><ref id="scirp.50518-ref19"><label>19</label><mixed-citation publication-type="other" xlink:type="simple">Hoerl, A.E. and Kennard, R.W. (1970) Ridge Regression: Biased Estimation for Nonorthogonal Problems. Technometrics, 12, 55-67. http://dx.doi.org/10.1080/00401706.1970.10488634</mixed-citation></ref><ref id="scirp.50518-ref20"><label>20</label><mixed-citation publication-type="other" xlink:type="simple">Hoerl, A.E. and Kennard, R.W. (1970) Ridge Regression: Applications to Nonorthogonal Problems. Technometrics, 12, 69-82. http://dx.doi.org/10.1080/00401706.1970.10488635</mixed-citation></ref><ref id="scirp.50518-ref21"><label>21</label><mixed-citation publication-type="other" xlink:type="simple">Hoerl, A.E., Kennard, R.W. and Baldwin, K.F. (1975) Ridge Regression: Some Simulation. Communications in Statistics: Theory and Methods, 4, 105-123.</mixed-citation></ref><ref id="scirp.50518-ref22"><label>22</label><mixed-citation publication-type="other" xlink:type="simple">Schaefer, R.L., Roi, L.D. and Wolfe, R.A. (1984) A Ridge Logistic Estimator. Communications in Statistics: Theory and Methods, 13, 99-113. http://dx.doi.org/10.1080/03610928408828664</mixed-citation></ref><ref id="scirp.50518-ref23"><label>23</label><mixed-citation publication-type="other" xlink:type="simple">Kibria, B.M.G., Mansson, K. and Shukur, G. (2011) Performance of Some Logistic Ridge Regression Estimators. Computational Economics, 40, 401-414. http://dx.doi.org/10.1007/s10614-011-9275-x</mixed-citation></ref></ref-list></back></article>