<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article">
 <front>
  <journal-meta>
   <journal-id journal-id-type="publisher-id">
    ojs
   </journal-id>
   <journal-title-group>
    <journal-title>
     Open Journal of Statistics
    </journal-title>
   </journal-title-group>
   <issn pub-type="epub">
    2161-718X
   </issn>
   <issn publication-format="print">
    2161-7198
   </issn>
   <publisher>
    <publisher-name>
     Scientific Research Publishing
    </publisher-name>
   </publisher>
  </journal-meta>
  <article-meta>
   <article-id pub-id-type="doi">
    10.4236/ojs.2025.151006
   </article-id>
   <article-id pub-id-type="publisher-id">
    ojs-140771
   </article-id>
   <article-categories>
    <subj-group subj-group-type="heading">
     <subject>
      Articles
     </subject>
    </subj-group>
    <subj-group subj-group-type="Discipline-v2">
     <subject>
      Physics 
     </subject>
     <subject>
       Mathematics
     </subject>
    </subj-group>
   </article-categories>
   <title-group>
    Least Product Relative Error Estimation for Partially Linear Multiplicative Model with Monotonic Constraint
   </title-group>
   <contrib-group>
    <contrib contrib-type="author" xlink:type="simple">
     <name name-style="western">
      <surname>
       Jun
      </surname>
      <given-names>
       Sun
      </given-names>
     </name>
    </contrib>
    <contrib contrib-type="author" xlink:type="simple">
     <name name-style="western">
      <surname>
       Mingtao
      </surname>
      <given-names>
       Zhao
      </given-names>
     </name>
    </contrib>
   </contrib-group> 
   <aff id="affnull">
    <addr-line>
     aSchool of Statistics and Applied Mathematics, Anhui University of Finance and Economics, Bengbu, China
    </addr-line> 
   </aff> 
   <pub-date pub-type="epub">
    <day>
     07
    </day> 
    <month>
     02
    </month>
    <year>
     2025
    </year>
   </pub-date> 
   <volume>
    15
   </volume> 
   <issue>
    01
   </issue>
   <fpage>
    81
   </fpage>
   <lpage>
    92
   </lpage>
   <history>
    <date date-type="received">
     <day>
      5,
     </day>
     <month>
      February
     </month>
     <year>
      2025
     </year>
    </date>
    <date date-type="published">
     <day>
      21,
     </day>
     <month>
      February
     </month>
     <year>
      2025
     </year> 
    </date> 
    <date date-type="accepted">
     <day>
      21,
     </day>
     <month>
      February
     </month>
     <year>
      2025
     </year> 
    </date>
   </history>
   <permissions>
    <copyright-statement>
     © Copyright 2014 by authors and Scientific Research Publishing Inc. 
    </copyright-statement>
    <copyright-year>
     2014
    </copyright-year>
    <license>
     <license-p>
      This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/
     </license-p>
    </license>
   </permissions>
   <abstract>
    We consider the partially linear multiplicative model with monotonic constraint for the analysis of positive response data. We propose a constrained least product relative error (LPRE) estimation procedure for the model by means of B-spline basis expansion. We have also established asymptotic properties of the proposed estimators under regularity conditions. We finally provide numerical simulations and a real data application to assess the finite sample performance of the developed methodology.
   </abstract>
   <kwd-group> 
    <kwd>
     Partially Linear Multiplicative Model
    </kwd> 
    <kwd>
      Monotonic Constraint
    </kwd> 
    <kwd>
      Least Product Relative Error
    </kwd> 
    <kwd>
      B-Spline
    </kwd> 
    <kwd>
      Asymptotic Property
    </kwd>
   </kwd-group>
  </article-meta>
 </front>
 <body>
  <sec id="s1">
   <title>1. Introduction</title>
   <p>Linear multiplicative models are popular tools for analyzing data with positive responses. However, the linear structure of models is too restrictive on the regression relation, which may lead to a high risk of model misspecification when dealing with more complicated data. To compensate for this defect, scholars have proposed many general and powerful multiplicative models that allow nonparametric or semi-parametric modeling. Examples of these models include the partially linear multiplicative model, which takes the following structure:</p>
   <p>
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mi>
        Y 
      </mi> 
      <mo>
        = 
      </mo> 
      <mtext>
        exp 
      </mtext> 
      <mrow> 
       <mo>
         ( 
       </mo> 
       <mrow> 
        <msup> 
         <mi>
           X 
         </mi> 
         <mtext>
           T 
         </mtext> 
        </msup> 
        <mi>
          β 
        </mi> 
        <mo>
          + 
        </mo> 
        <mi>
          f 
        </mi> 
        <mrow> 
         <mo>
           ( 
         </mo> 
         <mi>
           U 
         </mi> 
         <mo>
           ) 
         </mo> 
        </mrow> 
       </mrow> 
       <mo>
         ) 
       </mo> 
      </mrow> 
      <mi>
        ϵ 
      </mi> 
      <mo>
        , 
      </mo> 
     </mrow> 
    </math> (1.1)</p>
   <p>where 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mi>
       Y 
     </mi> 
    </math> is the response, 
    <math display="inline" xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mi>
        X 
      </mi> 
      <mo>
        = 
      </mo> 
      <msup> 
       <mrow> 
        <mrow> 
         <mo>
           ( 
         </mo> 
         <mrow> 
          <msub> 
           <mi>
             X 
           </mi> 
           <mn>
             1 
           </mn> 
          </msub> 
          <mo>
            , 
          </mo> 
          <mo>
            ⋯ 
          </mo> 
          <mo>
            , 
          </mo> 
          <msub> 
           <mi>
             X 
           </mi> 
           <mi>
             p 
           </mi> 
          </msub> 
         </mrow> 
         <mo>
           ) 
         </mo> 
        </mrow> 
       </mrow> 
       <mtext>
         T 
       </mtext> 
      </msup> 
     </mrow> 
    </math> is a 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mi>
       p 
     </mi> 
    </math>-dimensional random covariates vector, 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mi>
        β 
      </mi> 
      <mo>
        = 
      </mo> 
      <msup> 
       <mrow> 
        <mrow> 
         <mo>
           ( 
         </mo> 
         <mrow> 
          <msub> 
           <mi>
             β 
           </mi> 
           <mn>
             1 
           </mn> 
          </msub> 
          <mo>
            , 
          </mo> 
          <mo>
            ⋯ 
          </mo> 
          <mo>
            , 
          </mo> 
          <msub> 
           <mi>
             β 
           </mi> 
           <mi>
             p 
           </mi> 
          </msub> 
         </mrow> 
         <mo>
           ) 
         </mo> 
        </mrow> 
       </mrow> 
       <mtext>
         T 
       </mtext> 
      </msup> 
     </mrow> 
    </math> is a 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mi>
       p 
     </mi> 
    </math>-dimensional vector of unknown parameter, 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mi>
        f 
      </mi> 
      <mrow> 
       <mo>
         ( 
       </mo> 
       <mo>
         ⋅ 
       </mo> 
       <mo>
         ) 
       </mo> 
      </mrow> 
     </mrow> 
    </math> is an unknown smooth function, covariate 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mi>
       U 
     </mi> 
    </math> ranges over a non-degenerate compact interval, 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mi>
       ϵ 
     </mi> 
    </math> is the model error term. Both 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mi>
       Y 
     </mi> 
    </math> and 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mi>
       ϵ 
     </mi> 
    </math> defined in model (1.1) are positive. By applying logarithmic transformation to model (1.1), the above model becomes the usual partially linear model 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <msup> 
       <mi>
         Y 
       </mi> 
       <mo>
         * 
       </mo> 
      </msup> 
      <mo>
        = 
      </mo> 
      <msup> 
       <mi>
         X 
       </mi> 
       <mtext>
         T 
       </mtext> 
      </msup> 
      <mi>
        β 
      </mi> 
      <mo>
        + 
      </mo> 
      <mi>
        f 
      </mi> 
      <mrow> 
       <mo>
         ( 
       </mo> 
       <mi>
         U 
       </mi> 
       <mo>
         ) 
       </mo> 
      </mrow> 
      <mo>
        + 
      </mo> 
      <msup> 
       <mi>
         ϵ 
       </mi> 
       <mo>
         * 
       </mo> 
      </msup> 
     </mrow> 
    </math> with 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <msup> 
       <mi>
         Y 
       </mi> 
       <mo>
         * 
       </mo> 
      </msup> 
      <mo>
        = 
      </mo> 
      <mtext>
        log 
      </mtext> 
      <mrow> 
       <mo>
         ( 
       </mo> 
       <mi>
         Y 
       </mi> 
       <mo>
         ) 
       </mo> 
      </mrow> 
     </mrow> 
    </math> and 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <msup> 
       <mi>
         ϵ 
       </mi> 
       <mo>
         * 
       </mo> 
      </msup> 
      <mo>
        = 
      </mo> 
      <mtext>
        log 
      </mtext> 
      <mrow> 
       <mo>
         ( 
       </mo> 
       <mi>
         ϵ 
       </mi> 
       <mo>
         ) 
       </mo> 
      </mrow> 
     </mrow> 
    </math>. By allowing the response variable to depend linearly on some covariates and nonlinearly on remains through an unknown smooth function, the partially linear model enjoys both interpretation property of parametric modeling and flexibility of nonparametric modeling.</p>
   <p>For logarithmic transformation of model (1.1), the absolute error based methods such as the least squares method and the least absolute deviation approach can be used to estimate 
    <math display="inline" xmlns="http://www.w3.org/1998/Math/MathML"> <mi>
       β 
     </mi> 
    </math> and 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mi>
        f 
      </mi> 
      <mrow> 
       <mo>
         ( 
       </mo> 
       <mo>
         ⋅ 
       </mo> 
       <mo>
         ) 
       </mo> 
      </mrow> 
     </mrow> 
    </math>, however it may lose the intuitive explanatory sense for the transformed models. In many statistical applications, consideration of the relative error sometimes are more attractive than that of the absolute error for positive response data analysis. For example, under nonlinear regression framework, Khoshgoftaar et al. <xref ref-type="bibr" rid="scirp.140771-1">
     [1]
    </xref> studied the strong consistency of the estimators in the case of both squared relative error and absolute relative error. Park and Stefanski <xref ref-type="bibr" rid="scirp.140771-2">
     [2]
    </xref> derived the form of the best mean squared relative error prediction and adopted it into county-level gasoline usage prediction. Inspired by these, Chen et al. <xref ref-type="bibr" rid="scirp.140771-3">
     [3]
    </xref> proposed least absolute relative error (LARE) criterion for linear multiplicative models and they further applied proposed method to a study of stock returns in Hong Kong Stock Exchange. Xia et al. <xref ref-type="bibr" rid="scirp.140771-4">
     [4]
    </xref> discussed the interpretation of LARE criterion through a case study of stock price data from the views of buyers and sellers, they aimed to investigate the variable selection problem of linear multiplicative model with a diverging number of covariates. For model (1.1), Zhang and Wang <xref ref-type="bibr" rid="scirp.140771-5">
     [5]
    </xref> proposed the semi-parametric LARE criterion for estimating both parametric and nonparametric parts with help of kernel smoothing technique. However, the optimization of LARE criterion is non-smoothing and the computation is complicated. To this end, Chen et al. <xref ref-type="bibr" rid="scirp.140771-6">
     [6]
    </xref> developed the least product relative error (LPRE) criterion, the LPRE objective function is infinitely differentiable and strictly convex which makes the computation very convenient, while possess favourable statistical properties for resulting estimators. They further demonstrated the effectiveness of the LPRE estimation over some existing estimations under certain conditions. For model (1.1), Zhang et al. <xref ref-type="bibr" rid="scirp.140771-7">
     [7]
    </xref> proposed a profile LPRE estimation method for parametric components. This method has also been extended to other semi-parametric multiplicative models for estimation and inference, the recent literature include but is not restricted to Hu <xref ref-type="bibr" rid="scirp.140771-8">
     [8]
    </xref> for varying coefficient multiplicative models, Liu and Xia <xref ref-type="bibr" rid="scirp.140771-9">
     [9]
    </xref> for single index multiplicative models, Ming et al. <xref ref-type="bibr" rid="scirp.140771-10">
     [10]
    </xref> for multiplicative additive models, Zhang et al. <xref ref-type="bibr" rid="scirp.140771-11">
     [11]
    </xref> for varying coefficient single index multiplicative models. For more intuitive explanation of the advantages of the LPRE method, see the discussion of real monthly income for any two people in Ming et al. <xref ref-type="bibr" rid="scirp.140771-10">
     [10]
    </xref>.</p>
   <p>It is worth noting that the above mentioned works on model (1.1) take unspecified form for nonparametric function 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mi>
        f 
      </mi> 
      <mrow> 
       <mo>
         ( 
       </mo> 
       <mo>
         ⋅ 
       </mo> 
       <mo>
         ) 
       </mo> 
      </mrow> 
     </mrow> 
    </math>. In many applications the nonparametric component 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mi>
        f 
      </mi> 
      <mrow> 
       <mo>
         ( 
       </mo> 
       <mo>
         ⋅ 
       </mo> 
       <mo>
         ) 
       </mo> 
      </mrow> 
     </mrow> 
    </math> may be monotone constrained. For example, dose response curves in some clinical trials and growth curves in biomedical studies are known to be increasing. There are many references focused on monotone constrained partially linear model include but are not restricted to the following ones. Lu <xref ref-type="bibr" rid="scirp.140771-12">
     [12]
    </xref> used monotone B-spline to approximate the monotone nonparametric function and applied the generalized Rosen algorithm to compute the estimators jointly. Du et al. <xref ref-type="bibr" rid="scirp.140771-13">
     [13]
    </xref> studied the M-estimation of partially linear model under monotonic constraints. Sun et al. <xref ref-type="bibr" rid="scirp.140771-14">
     [14]
    </xref> investigated the isotonic partially linear error-in-variable model with randomly right censored response. Boente et al. <xref ref-type="bibr" rid="scirp.140771-15">
     [15]
    </xref> considered robust estimators for generalized partially linear regression model in which the nonparametric component is assumed to be a monotone function. Zhang and Wang <xref ref-type="bibr" rid="scirp.140771-16">
     [16]
    </xref> proposed a kernel based method for the monotone estimation of the nonparametric function component. There is a growing literature on monotone constrained partially linear model, but no such work exists for the model (1.1) with monotonic constraint up to now. It is, therefore, our impetus for solving this problem.</p>
   <p>In this study, we extend the partially linear multiplicative model (1.1) to the situation in which the nonparametric component 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mi>
        f 
      </mi> 
      <mrow> 
       <mo>
         ( 
       </mo> 
       <mo>
         ⋅ 
       </mo> 
       <mo>
         ) 
       </mo> 
      </mrow> 
     </mrow> 
    </math> is specified with monotone constraint, and we assume that 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mi>
        f 
      </mi> 
      <mrow> 
       <mo>
         ( 
       </mo> 
       <mo>
         ⋅ 
       </mo> 
       <mo>
         ) 
       </mo> 
      </mrow> 
     </mrow> 
    </math> is a nondecreasing function without loss of generality. We investigate the LPRE-based estimators along with their theoretical results for the model (1.1) with monotonic constraint. Our work is also motivated by analyzing an environmental data set elaborated in Section 4, as we will see, there exists a monotonic relationship between concentration of NO<sub>2</sub> and traffic volume. Thus, our main goal is to examine the association between the levels of air pollutants and the number of cars per hour although the air pollutants are always influenced by potential confounding effects from other variables. It is not a unique model that fits the current data set, but our studies provide a useful perspective in exploring hidden structures for environmental data modeling.</p>
   <p>The rest of this paper is organized as follows. In Section 2, we propose a constrained least product relative error estimation method for partially linear multiplicative model with monotonic constraint using spline approximation and constrained nonlinear programming, and then we provide the theoretical properties of the resulting estimators for both parametric and nonparametric components. In Section 3, we present some simulation studies to illustrate the merits of proposed method compared with existing ones. In Section 4, we apply our method to a real data application. We conclude the paper by mentioning some possible extensions in Section 5.</p>
  </sec><sec id="s2">
   <title>2. Estimation and Asymptotic Properties</title>
   <p>This section focuses on the constrained LPRE estimation of model (1.1) and delves into the algorithm for computation. We also state the main asymptotic results of developed estimators for both the parametric and the nonparametric terms.</p>
   <sec id="s2_1">
    <title>2.1. Estimation</title>
    <p>Let 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mrow> 
        <mo>
          { 
        </mo> 
        <mrow> 
         <msub> 
          <mi>
            Y 
          </mi> 
          <mi>
            i 
          </mi> 
         </msub> 
         <mo>
           , 
         </mo> 
         <msub> 
          <mi>
            X 
          </mi> 
          <mi>
            i 
          </mi> 
         </msub> 
         <mo>
           , 
         </mo> 
         <msub> 
          <mi>
            U 
          </mi> 
          <mi>
            i 
          </mi> 
         </msub> 
        </mrow> 
        <mo>
          } 
        </mo> 
       </mrow> 
      </mrow> 
     </math>, 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mi>
         i 
       </mi> 
       <mo>
         = 
       </mo> 
       <mn>
         1 
       </mn> 
       <mo>
         , 
       </mo> 
       <mo>
         ⋯ 
       </mo> 
       <mo>
         , 
       </mo> 
       <mi>
         n 
       </mi> 
      </mrow> 
     </math> be independent and identically distributed (i.i.d.) copies of 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mrow> 
        <mo>
          { 
        </mo> 
        <mrow> 
         <mi>
           Y 
         </mi> 
         <mo>
           , 
         </mo> 
         <mi>
           X 
         </mi> 
         <mo>
           , 
         </mo> 
         <mi>
           U 
         </mi> 
        </mrow> 
        <mo>
          } 
        </mo> 
       </mrow> 
      </mrow> 
     </math>, the sample version of model (1.1) is given by</p>
    <p>
     <math display="inline" xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msub> 
        <mi>
          Y 
        </mi> 
        <mi>
          i 
        </mi> 
       </msub> 
       <mo>
         = 
       </mo> 
       <mtext>
         exp 
       </mtext> 
       <mrow> 
        <mo>
          ( 
        </mo> 
        <mrow> 
         <msubsup> 
          <mi>
            X 
          </mi> 
          <mi>
            i 
          </mi> 
          <mtext>
            T 
          </mtext> 
         </msubsup> 
         <mi>
           β 
         </mi> 
         <mo>
           + 
         </mo> 
         <mi>
           f 
         </mi> 
         <mrow> 
          <mo>
            ( 
          </mo> 
          <mrow> 
           <msub> 
            <mi>
              U 
            </mi> 
            <mi>
              i 
            </mi> 
           </msub> 
          </mrow> 
          <mo>
            ) 
          </mo> 
         </mrow> 
        </mrow> 
        <mo>
          ) 
        </mo> 
       </mrow> 
       <msub> 
        <mi>
          ϵ 
        </mi> 
        <mi>
          i 
        </mi> 
       </msub> 
       <mo>
         . 
       </mo> 
      </mrow> 
     </math> (2.1)</p>
    <p>To address the estimating issue of 
     <math display="inline" xmlns="http://www.w3.org/1998/Math/MathML"> <mi>
        β 
      </mi> 
     </math> and 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mi>
         f 
       </mi> 
       <mrow> 
        <mo>
          ( 
        </mo> 
        <mo>
          ⋅ 
        </mo> 
        <mo>
          ) 
        </mo> 
       </mrow> 
      </mrow> 
     </math> simultaneously, we adopt the B-spline basis functions approximation to covert the estimation problem of model (2.1) to the problem of regression coefficients estimating in the linear combinations framework. We first provide a brief review about the construction of these basis functions. Without loss of generality, we assume that the compact support set of 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mi>
        U 
      </mi> 
     </math> is 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msub> 
        <mi mathvariant="script">
          S 
        </mi> 
        <mi>
          U 
        </mi> 
       </msub> 
       <mo>
         = 
       </mo> 
       <mrow> 
        <mo>
          [ 
        </mo> 
        <mrow> 
         <mn>
           0 
         </mn> 
         <mo>
           , 
         </mo> 
         <mn>
           1 
         </mn> 
        </mrow> 
        <mo>
          ] 
        </mo> 
       </mrow> 
      </mrow> 
     </math>. Let 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mi>
         B 
       </mi> 
       <mrow> 
        <mo>
          ( 
        </mo> 
        <mi>
          u 
        </mi> 
        <mo>
          ) 
        </mo> 
       </mrow> 
       <mo>
         = 
       </mo> 
       <msup> 
        <mrow> 
         <mrow> 
          <mo>
            ( 
          </mo> 
          <mrow> 
           <msub> 
            <mi>
              B 
            </mi> 
            <mi>
              m 
            </mi> 
           </msub> 
           <mrow> 
            <mo>
              ( 
            </mo> 
            <mi>
              u 
            </mi> 
            <mo>
              ) 
            </mo> 
           </mrow> 
           <mo>
             : 
           </mo> 
           <mn>
             1 
           </mn> 
           <mo>
             ≤ 
           </mo> 
           <mi>
             m 
           </mi> 
           <mo>
             ≤ 
           </mo> 
           <msub> 
            <mi>
              J 
            </mi> 
            <mi>
              n 
            </mi> 
           </msub> 
          </mrow> 
          <mo>
            ) 
          </mo> 
         </mrow> 
        </mrow> 
        <mtext>
          T 
        </mtext> 
       </msup> 
      </mrow> 
     </math> be the B-splines basis functions of order 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mi>
        q 
      </mi> 
     </math>, where 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msub> 
        <mi>
          J 
        </mi> 
        <mi>
          n 
        </mi> 
       </msub> 
       <mo>
         = 
       </mo> 
       <msub> 
        <mi>
          N 
        </mi> 
        <mi>
          n 
        </mi> 
       </msub> 
       <mo>
         + 
       </mo> 
       <mi>
         q 
       </mi> 
      </mrow> 
     </math> and 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msub> 
        <mi>
          N 
        </mi> 
        <mi>
          n 
        </mi> 
       </msub> 
      </mrow> 
     </math> is the number of interior knots for a knot sequence given as</p>
    <p>
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msub> 
        <mi>
          ξ 
        </mi> 
        <mn>
          1 
        </mn> 
       </msub> 
       <mo>
         = 
       </mo> 
       <mo>
         ⋯ 
       </mo> 
       <mo>
         = 
       </mo> 
       <mn>
         0 
       </mn> 
       <mo>
         = 
       </mo> 
       <msub> 
        <mi>
          ξ 
        </mi> 
        <mi>
          q 
        </mi> 
       </msub> 
       <mo>
         &lt; 
       </mo> 
       <msub> 
        <mi>
          ξ 
        </mi> 
        <mrow> 
         <mi>
           q 
         </mi> 
         <mo>
           + 
         </mo> 
         <mn>
           1 
         </mn> 
        </mrow> 
       </msub> 
       <mo>
         &lt; 
       </mo> 
       <mo>
         ⋯ 
       </mo> 
       <mo>
         &lt; 
       </mo> 
       <msub> 
        <mi>
          ξ 
        </mi> 
        <mrow> 
         <msub> 
          <mi>
            N 
          </mi> 
          <mi>
            n 
          </mi> 
         </msub> 
         <mo>
           + 
         </mo> 
         <mi>
           q 
         </mi> 
        </mrow> 
       </msub> 
       <mo>
         &lt; 
       </mo> 
       <mn>
         1 
       </mn> 
       <mo>
         = 
       </mo> 
       <msub> 
        <mi>
          ξ 
        </mi> 
        <mrow> 
         <msub> 
          <mi>
            N 
          </mi> 
          <mi>
            n 
          </mi> 
         </msub> 
         <mo>
           + 
         </mo> 
         <mi>
           q 
         </mi> 
         <mo>
           + 
         </mo> 
         <mn>
           1 
         </mn> 
        </mrow> 
       </msub> 
       <mo>
         = 
       </mo> 
       <mo>
         ⋯ 
       </mo> 
       <mo>
         = 
       </mo> 
       <msub> 
        <mi>
          ξ 
        </mi> 
        <mrow> 
         <msub> 
          <mi>
            N 
          </mi> 
          <mi>
            n 
          </mi> 
         </msub> 
         <mo>
           + 
         </mo> 
         <mn>
           2 
         </mn> 
         <mi>
           q 
         </mi> 
        </mrow> 
       </msub> 
       <mo>
         . 
       </mo> 
      </mrow> 
     </math></p>
    <p>For 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mi>
         q 
       </mi> 
       <mo>
         ≤ 
       </mo> 
       <mi>
         ι 
       </mi> 
       <mo>
         ≤ 
       </mo> 
       <msub> 
        <mi>
          J 
        </mi> 
        <mi>
          n 
        </mi> 
       </msub> 
      </mrow> 
     </math>, this knot sequence satisfies</p>
    <p>
     <math display="inline" xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mrow> 
        <mrow> 
         <munder> 
          <mrow> 
           <mtext>
             max 
           </mtext> 
          </mrow> 
          <mrow> 
           <mi>
             q 
           </mi> 
           <mo>
             ≤ 
           </mo> 
           <mi>
             ι 
           </mi> 
           <mo>
             ≤ 
           </mo> 
           <msub> 
            <mi>
              J 
            </mi> 
            <mi>
              n 
            </mi> 
           </msub> 
          </mrow> 
         </munder> 
         <mrow> 
          <mo>
            | 
          </mo> 
          <mrow> 
           <msub> 
            <mi>
              ξ 
            </mi> 
            <mrow> 
             <mi>
               ι 
             </mi> 
             <mo>
               + 
             </mo> 
             <mn>
               1 
             </mn> 
            </mrow> 
           </msub> 
           <mo>
             − 
           </mo> 
           <msub> 
            <mi>
              ξ 
            </mi> 
            <mi>
              ι 
            </mi> 
           </msub> 
          </mrow> 
          <mo>
            | 
          </mo> 
         </mrow> 
        </mrow> 
        <mo>
          / 
        </mo> 
        <mrow> 
         <munder> 
          <mrow> 
           <mtext>
             min 
           </mtext> 
          </mrow> 
          <mrow> 
           <mi>
             q 
           </mi> 
           <mo>
             ≤ 
           </mo> 
           <mi>
             ι 
           </mi> 
           <mo>
             ≤ 
           </mo> 
           <msub> 
            <mi>
              J 
            </mi> 
            <mi>
              n 
            </mi> 
           </msub> 
          </mrow> 
         </munder> 
         <mrow> 
          <mo>
            | 
          </mo> 
          <mrow> 
           <msub> 
            <mi>
              ξ 
            </mi> 
            <mrow> 
             <mi>
               ι 
             </mi> 
             <mo>
               + 
             </mo> 
             <mn>
               1 
             </mn> 
            </mrow> 
           </msub> 
           <mo>
             − 
           </mo> 
           <msub> 
            <mi>
              ξ 
            </mi> 
            <mi>
              ι 
            </mi> 
           </msub> 
          </mrow> 
          <mo>
            | 
          </mo> 
         </mrow> 
        </mrow> 
       </mrow> 
       <mo>
         ≤ 
       </mo> 
       <mi>
         M 
       </mi> 
       <mo>
         , 
       </mo> 
      </mrow> 
     </math></p>
    <p>for some constants 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mn>
         0 
       </mn> 
       <mo>
         &lt; 
       </mo> 
       <mi>
         M 
       </mi> 
       <mo>
         &lt; 
       </mo> 
       <mi>
         ∞ 
       </mi> 
      </mrow> 
     </math>. We refer the interested readers to Huang <xref ref-type="bibr" rid="scirp.140771-17">
      [17]
     </xref> for more details. Under some smoothness assumptions, we can approximate 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mi>
         f 
       </mi> 
       <mrow> 
        <mo>
          ( 
        </mo> 
        <mo>
          ⋅ 
        </mo> 
        <mo>
          ) 
        </mo> 
       </mrow> 
      </mrow> 
     </math> by</p>
    <p>
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mi>
         f 
       </mi> 
       <mrow> 
        <mo>
          ( 
        </mo> 
        <mrow> 
         <msub> 
          <mi>
            U 
          </mi> 
          <mi>
            i 
          </mi> 
         </msub> 
        </mrow> 
        <mo>
          ) 
        </mo> 
       </mrow> 
       <mo>
         ≈ 
       </mo> 
       <munderover> 
        <mstyle mathsize="140%" displaystyle="true"> 
         <mo>
           ∑ 
         </mo> 
        </mstyle> 
        <mrow> 
         <mi>
           m 
         </mi> 
         <mo>
           = 
         </mo> 
         <mn>
           1 
         </mn> 
        </mrow> 
        <mrow> 
         <msub> 
          <mi>
            J 
          </mi> 
          <mi>
            n 
          </mi> 
         </msub> 
        </mrow> 
       </munderover> 
       <mtext>
           
       </mtext> 
       <msub> 
        <mi>
          B 
        </mi> 
        <mi>
          m 
        </mi> 
       </msub> 
       <mrow> 
        <mo>
          ( 
        </mo> 
        <mrow> 
         <msub> 
          <mi>
            U 
          </mi> 
          <mi>
            i 
          </mi> 
         </msub> 
        </mrow> 
        <mo>
          ) 
        </mo> 
       </mrow> 
       <msub> 
        <mi>
          γ 
        </mi> 
        <mi>
          m 
        </mi> 
       </msub> 
       <mo>
         = 
       </mo> 
       <msup> 
        <mi>
          B 
        </mi> 
        <mtext>
          T 
        </mtext> 
       </msup> 
       <mrow> 
        <mo>
          ( 
        </mo> 
        <mrow> 
         <msub> 
          <mi>
            U 
          </mi> 
          <mi>
            i 
          </mi> 
         </msub> 
        </mrow> 
        <mo>
          ) 
        </mo> 
       </mrow> 
       <mi>
         γ 
       </mi> 
       <mo>
         , 
       </mo> 
      </mrow> 
     </math> (2.2)</p>
    <p>where 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mi>
         γ 
       </mi> 
       <mo>
         = 
       </mo> 
       <msup> 
        <mrow> 
         <mrow> 
          <mo>
            ( 
          </mo> 
          <mrow> 
           <msub> 
            <mi>
              γ 
            </mi> 
            <mi>
              m 
            </mi> 
           </msub> 
           <mo>
             : 
           </mo> 
           <mn>
             1 
           </mn> 
           <mo>
             ≤ 
           </mo> 
           <mi>
             m 
           </mi> 
           <mo>
             ≤ 
           </mo> 
           <msub> 
            <mi>
              J 
            </mi> 
            <mi>
              n 
            </mi> 
           </msub> 
          </mrow> 
          <mo>
            ) 
          </mo> 
         </mrow> 
        </mrow> 
        <mtext>
          T 
        </mtext> 
       </msup> 
      </mrow> 
     </math>.</p>
    <p>Follows Theorem 5.9 of Schumaker <xref ref-type="bibr" rid="scirp.140771-18">
      [18]
     </xref>, the spline 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mi>
         f 
       </mi> 
       <mrow> 
        <mo>
          ( 
        </mo> 
        <mo>
          ⋅ 
        </mo> 
        <mo>
          ) 
        </mo> 
       </mrow> 
      </mrow> 
     </math> is monotonically non-decreasing on 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msub> 
        <mi mathvariant="script">
          S 
        </mi> 
        <mi>
          U 
        </mi> 
       </msub> 
      </mrow> 
     </math> if non-decreasing constraints are imposed on the coefficients 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mi>
         γ 
       </mi> 
       <mo>
         = 
       </mo> 
       <msup> 
        <mrow> 
         <mrow> 
          <mo>
            ( 
          </mo> 
          <mrow> 
           <msub> 
            <mi>
              γ 
            </mi> 
            <mi>
              m 
            </mi> 
           </msub> 
           <mo>
             : 
           </mo> 
           <mn>
             1 
           </mn> 
           <mo>
             ≤ 
           </mo> 
           <mi>
             m 
           </mi> 
           <mo>
             ≤ 
           </mo> 
           <msub> 
            <mi>
              J 
            </mi> 
            <mi>
              n 
            </mi> 
           </msub> 
          </mrow> 
          <mo>
            ) 
          </mo> 
         </mrow> 
        </mrow> 
        <mtext>
          T 
        </mtext> 
       </msup> 
      </mrow> 
     </math>, i.e.,</p>
    <p>
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msub> 
        <mi>
          γ 
        </mi> 
        <mn>
          1 
        </mn> 
       </msub> 
       <mo>
         ≤ 
       </mo> 
       <msub> 
        <mi>
          γ 
        </mi> 
        <mn>
          2 
        </mn> 
       </msub> 
       <mo>
         ≤ 
       </mo> 
       <mo>
         ⋯ 
       </mo> 
       <mo>
         ≤ 
       </mo> 
       <msub> 
        <mi>
          γ 
        </mi> 
        <mrow> 
         <msub> 
          <mi>
            J 
          </mi> 
          <mi>
            n 
          </mi> 
         </msub> 
        </mrow> 
       </msub> 
       <mo>
         , 
       </mo> 
      </mrow> 
     </math></p>
    <p>this ensures the nondecreasing property of nonparametric function 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mi>
         f 
       </mi> 
       <mrow> 
        <mo>
          ( 
        </mo> 
        <mo>
          ⋅ 
        </mo> 
        <mo>
          ) 
        </mo> 
       </mrow> 
      </mrow> 
     </math>.</p>
    <p>Based on the above analysis, we can rewrite model (2.1) as</p>
    <p>
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msub> 
        <mi>
          Y 
        </mi> 
        <mi>
          i 
        </mi> 
       </msub> 
       <mo>
         ≈ 
       </mo> 
       <mtext>
         exp 
       </mtext> 
       <mrow> 
        <mo>
          ( 
        </mo> 
        <mrow> 
         <msubsup> 
          <mi>
            X 
          </mi> 
          <mi>
            i 
          </mi> 
          <mtext>
            T 
          </mtext> 
         </msubsup> 
         <mi>
           β 
         </mi> 
         <mo>
           + 
         </mo> 
         <msup> 
          <mi>
            B 
          </mi> 
          <mtext>
            T 
          </mtext> 
         </msup> 
         <mrow> 
          <mo>
            ( 
          </mo> 
          <mrow> 
           <msub> 
            <mi>
              U 
            </mi> 
            <mi>
              i 
            </mi> 
           </msub> 
          </mrow> 
          <mo>
            ) 
          </mo> 
         </mrow> 
         <mi>
           γ 
         </mi> 
        </mrow> 
        <mo>
          ) 
        </mo> 
       </mrow> 
       <msub> 
        <mi>
          ϵ 
        </mi> 
        <mi>
          i 
        </mi> 
       </msub> 
       <mo>
         , 
       </mo> 
      </mrow> 
     </math> (2.3)</p>
    <p>which transforms the model (2.1) into an almost equivalent linear multiplicative model. Let 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msub> 
        <mi>
          Π 
        </mi> 
        <mi>
          i 
        </mi> 
       </msub> 
       <mo>
         = 
       </mo> 
       <msup> 
        <mrow> 
         <mrow> 
          <mo>
            ( 
          </mo> 
          <mrow> 
           <msubsup> 
            <mi>
              X 
            </mi> 
            <mi>
              i 
            </mi> 
            <mtext>
              T 
            </mtext> 
           </msubsup> 
           <mo>
             , 
           </mo> 
           <msup> 
            <mi>
              B 
            </mi> 
            <mtext>
              T 
            </mtext> 
           </msup> 
           <mrow> 
            <mo>
              ( 
            </mo> 
            <mrow> 
             <msub> 
              <mi>
                U 
              </mi> 
              <mi>
                i 
              </mi> 
             </msub> 
            </mrow> 
            <mo>
              ) 
            </mo> 
           </mrow> 
          </mrow> 
          <mo>
            ) 
          </mo> 
         </mrow> 
        </mrow> 
        <mtext>
          T 
        </mtext> 
       </msup> 
      </mrow> 
     </math>, then following Chen et al. <xref ref-type="bibr" rid="scirp.140771-6">
      [6]
     </xref>, we estimate the related coefficients 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mi>
         ϑ 
       </mi> 
       <mo>
         = 
       </mo> 
       <msup> 
        <mrow> 
         <mrow> 
          <mo>
            ( 
          </mo> 
          <mrow> 
           <msup> 
            <mi>
              β 
            </mi> 
            <mtext>
              T 
            </mtext> 
           </msup> 
           <mo>
             , 
           </mo> 
           <msup> 
            <mi>
              γ 
            </mi> 
            <mtext>
              T 
            </mtext> 
           </msup> 
          </mrow> 
          <mo>
            ) 
          </mo> 
         </mrow> 
        </mrow> 
        <mtext>
          T 
        </mtext> 
       </msup> 
      </mrow> 
     </math> by minimizing</p>
    <p>
     <math display="inline" xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <munderover> 
        <mstyle mathsize="140%" displaystyle="true"> 
         <mo>
           ∑ 
         </mo> 
        </mstyle> 
        <mrow> 
         <mi>
           i 
         </mi> 
         <mo>
           = 
         </mo> 
         <mn>
           1 
         </mn> 
        </mrow> 
        <mi>
          n 
        </mi> 
       </munderover> 
       <mrow> 
        <mo>
          { 
        </mo> 
        <mrow> 
         <mrow> 
          <mo>
            | 
          </mo> 
          <mrow> 
           <mfrac> 
            <mrow> 
             <msub> 
              <mi>
                Y 
              </mi> 
              <mi>
                i 
              </mi> 
             </msub> 
             <mo>
               − 
             </mo> 
             <mtext>
               exp 
             </mtext> 
             <mrow> 
              <mo>
                ( 
              </mo> 
              <mrow> 
               <msubsup> 
                <mi>
                  Π 
                </mi> 
                <mi>
                  i 
                </mi> 
                <mtext>
                  T 
                </mtext> 
               </msubsup> 
               <mi>
                 ϑ 
               </mi> 
              </mrow> 
              <mo>
                ) 
              </mo> 
             </mrow> 
            </mrow> 
            <mrow> 
             <msub> 
              <mi>
                Y 
              </mi> 
              <mi>
                i 
              </mi> 
             </msub> 
            </mrow> 
           </mfrac> 
          </mrow> 
          <mo>
            | 
          </mo> 
         </mrow> 
         <mo>
           × 
         </mo> 
         <mrow> 
          <mo>
            | 
          </mo> 
          <mrow> 
           <mfrac> 
            <mrow> 
             <msub> 
              <mi>
                Y 
              </mi> 
              <mi>
                i 
              </mi> 
             </msub> 
             <mo>
               − 
             </mo> 
             <mtext>
               exp 
             </mtext> 
             <mrow> 
              <mo>
                ( 
              </mo> 
              <mrow> 
               <msubsup> 
                <mi>
                  Π 
                </mi> 
                <mi>
                  i 
                </mi> 
                <mtext>
                  T 
                </mtext> 
               </msubsup> 
               <mi>
                 ϑ 
               </mi> 
              </mrow> 
              <mo>
                ) 
              </mo> 
             </mrow> 
            </mrow> 
            <mrow> 
             <mtext>
               exp 
             </mtext> 
             <mrow> 
              <mo>
                ( 
              </mo> 
              <mrow> 
               <msubsup> 
                <mi>
                  Π 
                </mi> 
                <mi>
                  i 
                </mi> 
                <mtext>
                  T 
                </mtext> 
               </msubsup> 
               <mi>
                 ϑ 
               </mi> 
              </mrow> 
              <mo>
                ) 
              </mo> 
             </mrow> 
            </mrow> 
           </mfrac> 
          </mrow> 
          <mo>
            | 
          </mo> 
         </mrow> 
        </mrow> 
        <mo>
          } 
        </mo> 
       </mrow> 
       <mo>
         , 
       </mo> 
      </mrow> 
     </math> (2.4)</p>
    <p>subject to the constraint 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msub> 
        <mi>
          γ 
        </mi> 
        <mn>
          1 
        </mn> 
       </msub> 
       <mo>
         ≤ 
       </mo> 
       <msub> 
        <mi>
          γ 
        </mi> 
        <mn>
          2 
        </mn> 
       </msub> 
       <mo>
         ≤ 
       </mo> 
       <mo>
         ⋯ 
       </mo> 
       <mo>
         ≤ 
       </mo> 
       <msub> 
        <mi>
          γ 
        </mi> 
        <mrow> 
         <msub> 
          <mi>
            J 
          </mi> 
          <mi>
            n 
          </mi> 
         </msub> 
        </mrow> 
       </msub> 
      </mrow> 
     </math>, which is equivalent to solve the following</p>
    <p>
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msub> 
        <mi>
          ℒ 
        </mi> 
        <mi>
          n 
        </mi> 
       </msub> 
       <mrow> 
        <mo>
          ( 
        </mo> 
        <mi>
          ϑ 
        </mi> 
        <mo>
          ) 
        </mo> 
       </mrow> 
       <mo>
         ≡ 
       </mo> 
       <munderover> 
        <mstyle mathsize="140%" displaystyle="true"> 
         <mo>
           ∑ 
         </mo> 
        </mstyle> 
        <mrow> 
         <mi>
           i 
         </mi> 
         <mo>
           = 
         </mo> 
         <mn>
           1 
         </mn> 
        </mrow> 
        <mi>
          n 
        </mi> 
       </munderover> 
       <mrow> 
        <mo>
          { 
        </mo> 
        <mrow> 
         <msub> 
          <mi>
            Y 
          </mi> 
          <mi>
            i 
          </mi> 
         </msub> 
         <mi>
           exp 
         </mi> 
         <mrow> 
          <mo>
            ( 
          </mo> 
          <mrow> 
           <mo>
             − 
           </mo> 
           <msubsup> 
            <mi>
              Π 
            </mi> 
            <mi>
              i 
            </mi> 
            <mtext>
              T 
            </mtext> 
           </msubsup> 
           <mi>
             ϑ 
           </mi> 
          </mrow> 
          <mo>
            ) 
          </mo> 
         </mrow> 
         <mo>
           + 
         </mo> 
         <msubsup> 
          <mi>
            Y 
          </mi> 
          <mi>
            i 
          </mi> 
          <mrow> 
           <mo>
             − 
           </mo> 
           <mn>
             1 
           </mn> 
          </mrow> 
         </msubsup> 
         <mi>
           exp 
         </mi> 
         <mrow> 
          <mo>
            ( 
          </mo> 
          <mrow> 
           <msubsup> 
            <mi>
              Π 
            </mi> 
            <mi>
              i 
            </mi> 
            <mtext>
              T 
            </mtext> 
           </msubsup> 
           <mi>
             ϑ 
           </mi> 
          </mrow> 
          <mo>
            ) 
          </mo> 
         </mrow> 
        </mrow> 
        <mo>
          } 
        </mo> 
       </mrow> 
       <mo>
         , 
       </mo> 
      </mrow> 
     </math> (2.5)</p>
    <p>with constraint 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msub> 
        <mi>
          γ 
        </mi> 
        <mn>
          1 
        </mn> 
       </msub> 
       <mo>
         ≤ 
       </mo> 
       <msub> 
        <mi>
          γ 
        </mi> 
        <mn>
          2 
        </mn> 
       </msub> 
       <mo>
         ≤ 
       </mo> 
       <mo>
         ⋯ 
       </mo> 
       <mo>
         ≤ 
       </mo> 
       <msub> 
        <mi>
          γ 
        </mi> 
        <mrow> 
         <msub> 
          <mi>
            J 
          </mi> 
          <mi>
            n 
          </mi> 
         </msub> 
        </mrow> 
       </msub> 
      </mrow> 
     </math>.</p>
    <p>Now we delve into the algorithm for solving (2.5), since minimization problem (2.5) requires constrained nonlinear programming, we use the constrOptim package in R software to ensure restrictive condition 
     <math display="inline" xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msub> 
        <mi>
          γ 
        </mi> 
        <mn>
          1 
        </mn> 
       </msub> 
       <mo>
         ≤ 
       </mo> 
       <msub> 
        <mi>
          γ 
        </mi> 
        <mn>
          2 
        </mn> 
       </msub> 
       <mo>
         ≤ 
       </mo> 
       <mo>
         ⋯ 
       </mo> 
       <mo>
         ≤ 
       </mo> 
       <msub> 
        <mi>
          γ 
        </mi> 
        <mrow> 
         <msub> 
          <mi>
            J 
          </mi> 
          <mi>
            n 
          </mi> 
         </msub> 
        </mrow> 
       </msub> 
      </mrow> 
     </math> and achieve this optimization. To use the constrOptim algorithm, we need to specify the gradient of the objective function 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msub> 
        <mi>
          ℒ 
        </mi> 
        <mi>
          n 
        </mi> 
       </msub> 
       <mrow> 
        <mo>
          ( 
        </mo> 
        <mi>
          ϑ 
        </mi> 
        <mo>
          ) 
        </mo> 
       </mrow> 
      </mrow> 
     </math> in (2.5) given as,</p>
    <p>
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mfrac> 
        <mrow> 
         <mo>
           ∂ 
         </mo> 
         <msub> 
          <mi>
            ℒ 
          </mi> 
          <mi>
            n 
          </mi> 
         </msub> 
         <mrow> 
          <mo>
            ( 
          </mo> 
          <mi>
            ϑ 
          </mi> 
          <mo>
            ) 
          </mo> 
         </mrow> 
        </mrow> 
        <mrow> 
         <mo>
           ∂ 
         </mo> 
         <mi>
           ϑ 
         </mi> 
        </mrow> 
       </mfrac> 
       <mo>
         = 
       </mo> 
       <munderover> 
        <mstyle mathsize="140%" displaystyle="true"> 
         <mo>
           ∑ 
         </mo> 
        </mstyle> 
        <mrow> 
         <mi>
           i 
         </mi> 
         <mo>
           = 
         </mo> 
         <mn>
           1 
         </mn> 
        </mrow> 
        <mi>
          n 
        </mi> 
       </munderover> 
       <mtext>
           
       </mtext> 
       <msubsup> 
        <mi>
          Π 
        </mi> 
        <mi>
          i 
        </mi> 
        <mtext>
          T 
        </mtext> 
       </msubsup> 
       <mrow> 
        <mo>
          { 
        </mo> 
        <mrow> 
         <msubsup> 
          <mi>
            Y 
          </mi> 
          <mi>
            i 
          </mi> 
          <mrow> 
           <mo>
             − 
           </mo> 
           <mn>
             1 
           </mn> 
          </mrow> 
         </msubsup> 
         <mi>
           exp 
         </mi> 
         <mrow> 
          <mo>
            ( 
          </mo> 
          <mrow> 
           <msubsup> 
            <mi>
              Π 
            </mi> 
            <mi>
              i 
            </mi> 
            <mtext>
              T 
            </mtext> 
           </msubsup> 
           <mi>
             ϑ 
           </mi> 
          </mrow> 
          <mo>
            ) 
          </mo> 
         </mrow> 
         <mo>
           − 
         </mo> 
         <msub> 
          <mi>
            Y 
          </mi> 
          <mi>
            i 
          </mi> 
         </msub> 
         <mi>
           exp 
         </mi> 
         <mrow> 
          <mo>
            ( 
          </mo> 
          <mrow> 
           <mo>
             − 
           </mo> 
           <msubsup> 
            <mi>
              Π 
            </mi> 
            <mi>
              i 
            </mi> 
            <mtext>
              T 
            </mtext> 
           </msubsup> 
           <mi>
             ϑ 
           </mi> 
          </mrow> 
          <mo>
            ) 
          </mo> 
         </mrow> 
        </mrow> 
        <mo>
          } 
        </mo> 
       </mrow> 
       <mo>
         . 
       </mo> 
      </mrow> 
     </math> (2.6)</p>
    <p>Denote the final estimator in (2.5) as 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mover accent="true"> 
       <mi>
         ϑ 
       </mi> 
       <mo>
         ^ 
       </mo> 
      </mover> 
     </math>, we call it monotone constrained LPRE estimator, then the estimator for 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mi>
         f 
       </mi> 
       <mrow> 
        <mo>
          ( 
        </mo> 
        <mo>
          ⋅ 
        </mo> 
        <mo>
          ) 
        </mo> 
       </mrow> 
      </mrow> 
     </math> is given by 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mover accent="true"> 
        <mi>
          f 
        </mi> 
        <mo>
          ^ 
        </mo> 
       </mover> 
       <mrow> 
        <mo>
          ( 
        </mo> 
        <mo>
          ⋅ 
        </mo> 
        <mo>
          ) 
        </mo> 
       </mrow> 
       <mo>
         = 
       </mo> 
       <msup> 
        <mi>
          B 
        </mi> 
        <mtext>
          T 
        </mtext> 
       </msup> 
       <mrow> 
        <mo>
          ( 
        </mo> 
        <mrow> 
         <msub> 
          <mi>
            U 
          </mi> 
          <mi>
            i 
          </mi> 
         </msub> 
        </mrow> 
        <mo>
          ) 
        </mo> 
       </mrow> 
       <mover accent="true"> 
        <mi>
          γ 
        </mi> 
        <mo>
          ^ 
        </mo> 
       </mover> 
      </mrow> 
     </math>.</p>
   </sec>
   <sec id="s2_2">
    <title>2.2. Asymptotic Properties</title>
    <p>The asymptotic properties of the proposed estimators are studied in this subsection. Let 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msub> 
        <mi>
          β 
        </mi> 
        <mn>
          0 
        </mn> 
       </msub> 
      </mrow> 
     </math> and 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msub> 
        <mi>
          f 
        </mi> 
        <mn>
          0 
        </mn> 
       </msub> 
       <mrow> 
        <mo>
          ( 
        </mo> 
        <mo>
          ⋅ 
        </mo> 
        <mo>
          ) 
        </mo> 
       </mrow> 
      </mrow> 
     </math> be the true values of 
     <math display="inline" xmlns="http://www.w3.org/1998/Math/MathML"> <mi>
        β 
      </mi> 
     </math> and 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mi>
         f 
       </mi> 
       <mrow> 
        <mo>
          ( 
        </mo> 
        <mo>
          ⋅ 
        </mo> 
        <mo>
          ) 
        </mo> 
       </mrow> 
      </mrow> 
     </math> in model (1.1). We use 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mrow> 
        <mo>
          ‖ 
        </mo> 
        <mo>
          ⋅ 
        </mo> 
        <mo>
          ‖ 
        </mo> 
       </mrow> 
      </mrow> 
     </math> to denote the 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msup> 
        <mi>
          L 
        </mi> 
        <mn>
          2 
        </mn> 
       </msup> 
      </mrow> 
     </math> norm for functions. For some positive series 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msub> 
        <mi>
          a 
        </mi> 
        <mi>
          n 
        </mi> 
       </msub> 
      </mrow> 
     </math> and 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msub> 
        <mi>
          b 
        </mi> 
        <mi>
          n 
        </mi> 
       </msub> 
      </mrow> 
     </math>, 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msub> 
        <mi>
          a 
        </mi> 
        <mi>
          n 
        </mi> 
       </msub> 
       <mo>
         ≍ 
       </mo> 
       <msub> 
        <mi>
          b 
        </mi> 
        <mi>
          n 
        </mi> 
       </msub> 
      </mrow> 
     </math> means 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msub> 
        <mrow> 
         <mi>
           lim 
         </mi> 
        </mrow> 
        <mrow> 
         <mi>
           n 
         </mi> 
         <mo>
           → 
         </mo> 
         <mi>
           ∞ 
         </mi> 
        </mrow> 
       </msub> 
       <mrow> 
        <mrow> 
         <msub> 
          <mi>
            a 
          </mi> 
          <mi>
            n 
          </mi> 
         </msub> 
        </mrow> 
        <mo>
          / 
        </mo> 
        <mrow> 
         <msub> 
          <mi>
            b 
          </mi> 
          <mi>
            n 
          </mi> 
         </msub> 
        </mrow> 
       </mrow> 
       <mo>
         = 
       </mo> 
       <mi>
         c 
       </mi> 
      </mrow> 
     </math> for some nonzero constant 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mi>
         c 
       </mi> 
       <mo>
         &gt; 
       </mo> 
       <mn>
         0 
       </mn> 
      </mrow> 
     </math>. The following regularity conditions are required.</p>
    <p>(C1). The covariate 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msub> 
        <mi>
          U 
        </mi> 
        <mi>
          i 
        </mi> 
       </msub> 
      </mrow> 
     </math> has a continuous density 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msub> 
        <mi>
          g 
        </mi> 
        <mrow> 
         <msub> 
          <mi>
            U 
          </mi> 
          <mi>
            i 
          </mi> 
         </msub> 
        </mrow> 
       </msub> 
       <mrow> 
        <mo>
          ( 
        </mo> 
        <mi>
          u 
        </mi> 
        <mo>
          ) 
        </mo> 
       </mrow> 
      </mrow> 
     </math> which is bounded away from 0 and infinity on 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msub> 
        <mi mathvariant="script">
          S 
        </mi> 
        <mi>
          U 
        </mi> 
       </msub> 
      </mrow> 
     </math> for every 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mi>
         i 
       </mi> 
       <mo>
         = 
       </mo> 
       <mn>
         1 
       </mn> 
       <mo>
         , 
       </mo> 
       <mo>
         ⋯ 
       </mo> 
       <mo>
         , 
       </mo> 
       <mi>
         n 
       </mi> 
      </mrow> 
     </math>.</p>
    <p>(C2). 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mi>
         f 
       </mi> 
       <mrow> 
        <mo>
          ( 
        </mo> 
        <mo>
          ⋅ 
        </mo> 
        <mo>
          ) 
        </mo> 
       </mrow> 
       <mo>
         ∈ 
       </mo> 
       <msup> 
        <mi>
          C 
        </mi> 
        <mrow> 
         <mrow> 
          <mo>
            ( 
          </mo> 
          <mi>
            r 
          </mi> 
          <mo>
            ) 
          </mo> 
         </mrow> 
        </mrow> 
       </msup> 
       <mrow> 
        <mo>
          ( 
        </mo> 
        <mrow> 
         <msub> 
          <mi mathvariant="script">
            S 
          </mi> 
          <mi>
            U 
          </mi> 
         </msub> 
        </mrow> 
        <mo>
          ) 
        </mo> 
       </mrow> 
      </mrow> 
     </math> for some integer 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mi>
         r 
       </mi> 
       <mo>
         ≥ 
       </mo> 
       <mn>
         2 
       </mn> 
      </mrow> 
     </math>, and the spline order satisfies 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mi>
         q 
       </mi> 
       <mo>
         ≥ 
       </mo> 
       <mi>
         r 
       </mi> 
      </mrow> 
     </math>. 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msup> 
        <mi>
          C 
        </mi> 
        <mrow> 
         <mrow> 
          <mo>
            ( 
          </mo> 
          <mi>
            r 
          </mi> 
          <mo>
            ) 
          </mo> 
         </mrow> 
        </mrow> 
       </msup> 
       <mrow> 
        <mo>
          ( 
        </mo> 
        <mrow> 
         <msub> 
          <mi mathvariant="script">
            S 
          </mi> 
          <mi>
            U 
          </mi> 
         </msub> 
        </mrow> 
        <mo>
          ) 
        </mo> 
       </mrow> 
       <mo>
         = 
       </mo> 
       <mrow> 
        <mo>
          { 
        </mo> 
        <mrow> 
         <mi>
           φ 
         </mi> 
         <mo>
           | 
         </mo> 
         <msup> 
          <mi>
            φ 
          </mi> 
          <mrow> 
           <mrow> 
            <mo>
              ( 
            </mo> 
            <mi>
              r 
            </mi> 
            <mo>
              ) 
            </mo> 
           </mrow> 
          </mrow> 
         </msup> 
         <mo>
           ∈ 
         </mo> 
         <mi>
           C 
         </mi> 
         <mrow> 
          <mo>
            ( 
          </mo> 
          <mrow> 
           <msub> 
            <mi mathvariant="script">
              S 
            </mi> 
            <mi>
              U 
            </mi> 
           </msub> 
          </mrow> 
          <mo>
            ) 
          </mo> 
         </mrow> 
        </mrow> 
        <mo>
          } 
        </mo> 
       </mrow> 
      </mrow> 
     </math> denotes the space of 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mi>
        r 
      </mi> 
     </math>-th order smooth function.</p>
    <p>(C3). The matrix 
     <math display="inline" xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mi>
         E 
       </mi> 
       <mrow> 
        <mo>
          ( 
        </mo> 
        <mrow> 
         <mi>
           X 
         </mi> 
         <msup> 
          <mi>
            X 
          </mi> 
          <mtext>
            T 
          </mtext> 
         </msup> 
        </mrow> 
        <mo>
          ) 
        </mo> 
       </mrow> 
      </mrow> 
     </math> is nonsingular and its eigenvalues are uniformly bounded away from 0 and infinity.</p>
    <p>(C4). The error 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mi>
        ϵ 
      </mi> 
     </math> satisfies 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mi>
         E 
       </mi> 
       <mrow> 
        <mo>
          ( 
        </mo> 
        <mrow> 
         <mi>
           ϵ 
         </mi> 
         <mo>
           + 
         </mo> 
         <msup> 
          <mi>
            ϵ 
          </mi> 
          <mrow> 
           <mo>
             − 
           </mo> 
           <mn>
             1 
           </mn> 
          </mrow> 
         </msup> 
         <mo>
           | 
         </mo> 
         <mi>
           X 
         </mi> 
         <mo>
           , 
         </mo> 
         <mi>
           U 
         </mi> 
        </mrow> 
        <mo>
          ) 
        </mo> 
       </mrow> 
       <mo>
         &lt; 
       </mo> 
       <mi>
         ∞ 
       </mi> 
      </mrow> 
     </math>.</p>
    <p>(C5). The error 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mi>
        ϵ 
      </mi> 
     </math> satisfies 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mi>
         E 
       </mi> 
       <mrow> 
        <mo>
          ( 
        </mo> 
        <mrow> 
         <mi>
           ϵ 
         </mi> 
         <mo>
           | 
         </mo> 
         <mi>
           X 
         </mi> 
         <mo>
           , 
         </mo> 
         <mi>
           U 
         </mi> 
        </mrow> 
        <mo>
          ) 
        </mo> 
       </mrow> 
       <mo>
         = 
       </mo> 
       <mi>
         E 
       </mi> 
       <mrow> 
        <mo>
          ( 
        </mo> 
        <mrow> 
         <msup> 
          <mi>
            ϵ 
          </mi> 
          <mrow> 
           <mo>
             − 
           </mo> 
           <mn>
             1 
           </mn> 
          </mrow> 
         </msup> 
         <mo>
           | 
         </mo> 
         <mi>
           X 
         </mi> 
         <mo>
           , 
         </mo> 
         <mi>
           U 
         </mi> 
        </mrow> 
        <mo>
          ) 
        </mo> 
       </mrow> 
      </mrow> 
     </math>.</p>
    <p>Conditions (C1)-(C3) are standard for the nonparametric estimation in spline smoothing literature, which are essentially same as those in Shen et al. <xref ref-type="bibr" rid="scirp.140771-19">
      [19]
     </xref> and Guo et al. <xref ref-type="bibr" rid="scirp.140771-20">
      [20]
     </xref> Condition (C4) ensures the asymptotic normality of the estimator for parametric term, see Liu and Xia <xref ref-type="bibr" rid="scirp.140771-9">
      [9]
     </xref> and Hu <xref ref-type="bibr" rid="scirp.140771-8">
      [8]
     </xref>. Condition (C5) is needed for model identification and asymptotic variance of estimates, see Ming et al. <xref ref-type="bibr" rid="scirp.140771-10">
      [10]
     </xref> and Hu <xref ref-type="bibr" rid="scirp.140771-8">
      [8]
     </xref>.</p>
    <p>Theorem 1 Under conditions (C1)-(C5), if 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msub> 
        <mi>
          N 
        </mi> 
        <mi>
          n 
        </mi> 
       </msub> 
       <mo>
         ≍ 
       </mo> 
       <msup> 
        <mi>
          n 
        </mi> 
        <mrow> 
         <mrow> 
          <mn>
            1 
          </mn> 
          <mo>
            / 
          </mo> 
          <mrow> 
           <mrow> 
            <mo>
              ( 
            </mo> 
            <mrow> 
             <mn>
               2 
             </mn> 
             <mi>
               r 
             </mi> 
             <mo>
               + 
             </mo> 
             <mn>
               1 
             </mn> 
            </mrow> 
            <mo>
              ) 
            </mo> 
           </mrow> 
          </mrow> 
         </mrow> 
        </mrow> 
       </msup> 
      </mrow> 
     </math>, then we have</p>
    <p>
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msup> 
        <mrow> 
         <mrow> 
          <mo>
            ‖ 
          </mo> 
          <mrow> 
           <mover accent="true"> 
            <mi>
              f 
            </mi> 
            <mo>
              ^ 
            </mo> 
           </mover> 
           <mrow> 
            <mo>
              ( 
            </mo> 
            <mi>
              u 
            </mi> 
            <mo>
              ) 
            </mo> 
           </mrow> 
           <mo>
             − 
           </mo> 
           <msub> 
            <mi>
              f 
            </mi> 
            <mn>
              0 
            </mn> 
           </msub> 
           <mrow> 
            <mo>
              ( 
            </mo> 
            <mi>
              u 
            </mi> 
            <mo>
              ) 
            </mo> 
           </mrow> 
          </mrow> 
          <mo>
            ‖ 
          </mo> 
         </mrow> 
        </mrow> 
        <mn>
          2 
        </mn> 
       </msup> 
       <mo>
         = 
       </mo> 
       <msub> 
        <mi>
          O 
        </mi> 
        <mi>
          p 
        </mi> 
       </msub> 
       <mrow> 
        <mo>
          ( 
        </mo> 
        <mrow> 
         <msup> 
          <mi>
            n 
          </mi> 
          <mrow> 
           <mo>
             − 
           </mo> 
           <mrow> 
            <mrow> 
             <mn>
               2 
             </mn> 
             <mi>
               r 
             </mi> 
            </mrow> 
            <mo>
              / 
            </mo> 
            <mrow> 
             <mrow> 
              <mo>
                ( 
              </mo> 
              <mrow> 
               <mn>
                 2 
               </mn> 
               <mi>
                 r 
               </mi> 
               <mo>
                 + 
               </mo> 
               <mn>
                 1 
               </mn> 
              </mrow> 
              <mo>
                ) 
              </mo> 
             </mrow> 
            </mrow> 
           </mrow> 
          </mrow> 
         </msup> 
        </mrow> 
        <mo>
          ) 
        </mo> 
       </mrow> 
       <mo>
         . 
       </mo> 
      </mrow> 
     </math></p>
    <p>Theorem 1 indicates that the nonparametric estimates obtained by our proposed method achieve the optimal convergence rates. The following Theorem 2 states that the estimator 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mover accent="true"> 
       <mi>
         β 
       </mi> 
       <mo>
         ^ 
       </mo> 
      </mover> 
     </math> is asymptotically normal.</p>
    <p>Theorem 2 Under the same assumptions of Theorem 1, 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mover accent="true"> 
       <mi>
         β 
       </mi> 
       <mo>
         ^ 
       </mo> 
      </mover> 
     </math> converges in probability to the true value 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msub> 
        <mi>
          β 
        </mi> 
        <mn>
          0 
        </mn> 
       </msub> 
      </mrow> 
     </math>, i.e.</p>
    <p>
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msqrt> 
        <mi>
          n 
        </mi> 
       </msqrt> 
       <mrow> 
        <mo>
          ( 
        </mo> 
        <mrow> 
         <mover accent="true"> 
          <mi>
            β 
          </mi> 
          <mo>
            ^ 
          </mo> 
         </mover> 
         <mo>
           − 
         </mo> 
         <msub> 
          <mi>
            β 
          </mi> 
          <mn>
            0 
          </mn> 
         </msub> 
        </mrow> 
        <mo>
          ) 
        </mo> 
       </mrow> 
       <mover> 
        <mo>
          → 
        </mo> 
        <mi>
          d 
        </mi> 
       </mover> 
       <mi>
         N 
       </mi> 
       <mrow> 
        <mo>
          ( 
        </mo> 
        <mrow> 
         <mn>
           0 
         </mn> 
         <mo>
           , 
         </mo> 
         <msup> 
          <mtext>
            Σ 
          </mtext> 
          <mrow> 
           <mo>
             − 
           </mo> 
           <mn>
             1 
           </mn> 
          </mrow> 
         </msup> 
         <msup> 
          <mrow> 
           <mtext>
             ΛΣ 
           </mtext> 
          </mrow> 
          <mrow> 
           <mo>
             − 
           </mo> 
           <mn>
             1 
           </mn> 
          </mrow> 
         </msup> 
        </mrow> 
        <mo>
          ) 
        </mo> 
       </mrow> 
       <mo>
         , 
       </mo> 
      </mrow> 
     </math></p>
    <p>where 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mover> 
        <mo>
          → 
        </mo> 
        <mi>
          d 
        </mi> 
       </mover> 
      </mrow> 
     </math> denotes convergence in distribution, 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mtext>
         Σ 
       </mtext> 
       <mo>
         = 
       </mo> 
       <mi>
         E 
       </mi> 
       <mrow> 
        <mo>
          { 
        </mo> 
        <mrow> 
         <mi>
           X 
         </mi> 
         <msup> 
          <mi>
            X 
          </mi> 
          <mtext>
            T 
          </mtext> 
         </msup> 
         <mrow> 
          <mo>
            ( 
          </mo> 
          <mrow> 
           <mi>
             ϵ 
           </mi> 
           <mo>
             + 
           </mo> 
           <msup> 
            <mi>
              ϵ 
            </mi> 
            <mrow> 
             <mo>
               − 
             </mo> 
             <mn>
               1 
             </mn> 
            </mrow> 
           </msup> 
          </mrow> 
          <mo>
            ) 
          </mo> 
         </mrow> 
        </mrow> 
        <mo>
          } 
        </mo> 
       </mrow> 
      </mrow> 
     </math> and 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <mtext>
         Λ 
       </mtext> 
       <mo>
         = 
       </mo> 
       <mi>
         E 
       </mi> 
       <mrow> 
        <mo>
          { 
        </mo> 
        <mrow> 
         <mi>
           X 
         </mi> 
         <msup> 
          <mi>
            X 
          </mi> 
          <mtext>
            T 
          </mtext> 
         </msup> 
         <msup> 
          <mrow> 
           <mrow> 
            <mo>
              ( 
            </mo> 
            <mrow> 
             <mi>
               ϵ 
             </mi> 
             <mo>
               − 
             </mo> 
             <msup> 
              <mi>
                ϵ 
              </mi> 
              <mrow> 
               <mo>
                 − 
               </mo> 
               <mn>
                 1 
               </mn> 
              </mrow> 
             </msup> 
            </mrow> 
            <mo>
              ) 
            </mo> 
           </mrow> 
          </mrow> 
          <mn>
            2 
          </mn> 
         </msup> 
        </mrow> 
        <mo>
          } 
        </mo> 
       </mrow> 
      </mrow> 
     </math>.</p>
    <p>Since the proofs of Theorems 1-2 follow along the same ideas as the proofs of Theorems in Ming et al. <xref ref-type="bibr" rid="scirp.140771-10">
      [10]
     </xref> although part of details differs, we omit the proofs in this paper.</p>
   </sec>
  </sec><sec id="s3">
   <title>3. Numerical Simulations</title>
   <p>In this section, we carry out numerical simulations to investigate the finite sample performance of the proposed method. We generate the random samples from the following model:</p>
   <p>
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <msub> 
       <mi>
         Y 
       </mi> 
       <mi>
         i 
       </mi> 
      </msub> 
      <mo>
        = 
      </mo> 
      <mtext>
        exp 
      </mtext> 
      <mrow> 
       <mo>
         ( 
       </mo> 
       <mrow> 
        <msub> 
         <mi>
           X 
         </mi> 
         <mrow> 
          <mi>
            i 
          </mi> 
          <mn>
            1 
          </mn> 
         </mrow> 
        </msub> 
        <msub> 
         <mi>
           β 
         </mi> 
         <mn>
           1 
         </mn> 
        </msub> 
        <mo>
          + 
        </mo> 
        <msub> 
         <mi>
           X 
         </mi> 
         <mrow> 
          <mi>
            i 
          </mi> 
          <mn>
            2 
          </mn> 
         </mrow> 
        </msub> 
        <msub> 
         <mi>
           β 
         </mi> 
         <mn>
           2 
         </mn> 
        </msub> 
        <mo>
          + 
        </mo> 
        <mi>
          f 
        </mi> 
        <mrow> 
         <mo>
           ( 
         </mo> 
         <mrow> 
          <msub> 
           <mi>
             U 
           </mi> 
           <mi>
             i 
           </mi> 
          </msub> 
         </mrow> 
         <mo>
           ) 
         </mo> 
        </mrow> 
       </mrow> 
       <mo>
         ) 
       </mo> 
      </mrow> 
      <msub> 
       <mi>
         ϵ 
       </mi> 
       <mi>
         i 
       </mi> 
      </msub> 
      <mo>
        , 
      </mo> 
      <mtext>
          
      </mtext> 
      <mi>
        i 
      </mi> 
      <mo>
        = 
      </mo> 
      <mn>
        1 
      </mn> 
      <mo>
        , 
      </mo> 
      <mo>
        ⋯ 
      </mo> 
      <mo>
        , 
      </mo> 
      <mi>
        n 
      </mi> 
      <mo>
        , 
      </mo> 
     </mrow> 
    </math></p>
   <p>where 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mi>
        n 
      </mi> 
      <mo>
        = 
      </mo> 
      <mn>
        100 
      </mn> 
      <mo>
        , 
      </mo> 
      <mn>
        200 
      </mn> 
      <mo>
        , 
      </mo> 
      <mn>
        500 
      </mn> 
     </mrow> 
    </math>, 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <msub> 
       <mi>
         X 
       </mi> 
       <mi>
         i 
       </mi> 
      </msub> 
      <mo>
        = 
      </mo> 
      <msup> 
       <mrow> 
        <mrow> 
         <mo>
           ( 
         </mo> 
         <mrow> 
          <msub> 
           <mi>
             X 
           </mi> 
           <mrow> 
            <mi>
              i 
            </mi> 
            <mn>
              1 
            </mn> 
           </mrow> 
          </msub> 
          <mo>
            , 
          </mo> 
          <msub> 
           <mi>
             X 
           </mi> 
           <mrow> 
            <mi>
              i 
            </mi> 
            <mn>
              2 
            </mn> 
           </mrow> 
          </msub> 
         </mrow> 
         <mo>
           ) 
         </mo> 
        </mrow> 
       </mrow> 
       <mtext>
         T 
       </mtext> 
      </msup> 
     </mrow> 
    </math>, 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <msub> 
       <mi>
         X 
       </mi> 
       <mrow> 
        <mi>
          i 
        </mi> 
        <mn>
          1 
        </mn> 
       </mrow> 
      </msub> 
     </mrow> 
    </math> and 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <msub> 
       <mi>
         X 
       </mi> 
       <mrow> 
        <mi>
          i 
        </mi> 
        <mn>
          2 
        </mn> 
       </mrow> 
      </msub> 
     </mrow> 
    </math> follows a bivariate normal distribution with mean 0, variance 1, and covariance 0.5, the true parameters 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <msub> 
       <mi>
         β 
       </mi> 
       <mn>
         1 
       </mn> 
      </msub> 
      <mo>
        = 
      </mo> 
      <mn>
        1 
      </mn> 
     </mrow> 
    </math> and 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <msub> 
       <mi>
         β 
       </mi> 
       <mn>
         2 
       </mn> 
      </msub> 
      <mo>
        = 
      </mo> 
      <mn>
        3.5 
      </mn> 
     </mrow> 
    </math>, we set 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mi>
        f 
      </mi> 
      <mrow> 
       <mo>
         ( 
       </mo> 
       <mrow> 
        <msub> 
         <mi>
           U 
         </mi> 
         <mi>
           i 
         </mi> 
        </msub> 
       </mrow> 
       <mo>
         ) 
       </mo> 
      </mrow> 
      <mo>
        = 
      </mo> 
      <msup> 
       <mrow> 
        <mrow> 
         <mo>
           ( 
         </mo> 
         <mrow> 
          <msub> 
           <mi>
             U 
           </mi> 
           <mi>
             i 
           </mi> 
          </msub> 
          <mo>
            − 
          </mo> 
          <mn>
            1 
          </mn> 
         </mrow> 
         <mo>
           ) 
         </mo> 
        </mrow> 
       </mrow> 
       <mn>
         3 
       </mn> 
      </msup> 
     </mrow> 
    </math> and the variable 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <msub> 
       <mi>
         U 
       </mi> 
       <mi>
         i 
       </mi> 
      </msub> 
     </mrow> 
    </math>'s are sampled uniformly on 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mrow> 
       <mo>
         [ 
       </mo> 
       <mrow> 
        <mn>
          0 
        </mn> 
        <mo>
          , 
        </mo> 
        <mn>
          2 
        </mn> 
       </mrow> 
       <mo>
         ] 
       </mo> 
      </mrow> 
     </mrow> 
    </math>. The following three cases for the random error 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mi>
       ϵ 
     </mi> 
    </math> are considered:</p>
   <p>Case I. The log normal distribution 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mtext>
        log 
      </mtext> 
      <mrow> 
       <mo>
         ( 
       </mo> 
       <mi>
         ϵ 
       </mi> 
       <mo>
         ) 
       </mo> 
      </mrow> 
      <mo>
        ~ 
      </mo> 
      <mi>
        N 
      </mi> 
      <mrow> 
       <mo>
         ( 
       </mo> 
       <mrow> 
        <mn>
          0 
        </mn> 
        <mo>
          , 
        </mo> 
        <mn>
          1 
        </mn> 
       </mrow> 
       <mo>
         ) 
       </mo> 
      </mrow> 
     </mrow> 
    </math>.</p>
   <p>Case II. The log uniform distribution on 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mrow> 
       <mo>
         ( 
       </mo> 
       <mrow> 
        <mo>
          − 
        </mo> 
        <mn>
          2 
        </mn> 
        <mo>
          , 
        </mo> 
        <mn>
          2 
        </mn> 
       </mrow> 
       <mo>
         ) 
       </mo> 
      </mrow> 
     </mrow> 
    </math>, 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mtext>
        log 
      </mtext> 
      <mrow> 
       <mo>
         ( 
       </mo> 
       <mi>
         ϵ 
       </mi> 
       <mo>
         ) 
       </mo> 
      </mrow> 
      <mo>
        ∼ 
      </mo> 
      <mi>
        U 
      </mi> 
      <mrow> 
       <mo>
         ( 
       </mo> 
       <mrow> 
        <mo>
          − 
        </mo> 
        <mn>
          2 
        </mn> 
        <mo>
          , 
        </mo> 
        <mn>
          2 
        </mn> 
       </mrow> 
       <mo>
         ) 
       </mo> 
      </mrow> 
     </mrow> 
    </math>.</p>
   <p>Case III. 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mi>
        ϵ 
      </mi> 
      <mo>
        ~ 
      </mo> 
      <mi>
        U 
      </mi> 
      <mrow> 
       <mo>
         ( 
       </mo> 
       <mrow> 
        <mn>
          0.5 
        </mn> 
        <mo>
          , 
        </mo> 
        <mi>
          κ 
        </mi> 
       </mrow> 
       <mo>
         ) 
       </mo> 
      </mrow> 
     </mrow> 
    </math> with 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mi>
       κ 
     </mi> 
    </math> being chosen such that 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mi>
        E 
      </mi> 
      <mrow> 
       <mo>
         ( 
       </mo> 
       <mi>
         ϵ 
       </mi> 
       <mo>
         ) 
       </mo> 
      </mrow> 
      <mo>
        = 
      </mo> 
      <mi>
        E 
      </mi> 
      <mrow> 
       <mo>
         ( 
       </mo> 
       <mrow> 
        <mrow> 
         <mn>
           1 
         </mn> 
         <mo>
           / 
         </mo> 
         <mi>
           ϵ 
         </mi> 
        </mrow> 
       </mrow> 
       <mo>
         ) 
       </mo> 
      </mrow> 
     </mrow> 
    </math>.</p>
   <p>To implement the developed method, we need to choose the number of interior knots appropriately. We fix the spline order as cubic, as this is the most commonly used choice in the spline literature. As recommended by Ming et al. <xref ref-type="bibr" rid="scirp.140771-10">
     [10]
    </xref>, 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <msub> 
       <mi>
         N 
       </mi> 
       <mi>
         n 
       </mi> 
      </msub> 
     </mrow> 
    </math> was set as <img width="71.14967462039046" src="https://html.scirp.org/file/1241924-rId234.svg?20250224023933">, this choice is small enough to avoid over-fitting with suitable sample size not too small and big enough to approximate smooth functions, and the results are similar for 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msub> 
        <mi>
          N 
        </mi> 
        <mi>
          n 
        </mi> 
       </msub> 
      </mrow> 
     </math> varying on a set of candidate values. In this article, we propose a data-driven approach to select it. We use the Bayesian information criterion (BIC) to choose the optimal number of interior knots 
     <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
       <msub> 
        <mi>
          N 
        </mi> 
        <mi>
          n 
        </mi> 
       </msub> 
      </mrow> 
     </math> by minimizing the following BIC function</img></p>
   <p>
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mtext>
        BIC 
      </mtext> 
      <mrow> 
       <mo>
         ( 
       </mo> 
       <mrow> 
        <msub> 
         <mi>
           N 
         </mi> 
         <mi>
           n 
         </mi> 
        </msub> 
       </mrow> 
       <mo>
         ) 
       </mo> 
      </mrow> 
      <mo>
        = 
      </mo> 
      <mtext>
        log 
      </mtext> 
      <mrow> 
       <mo>
         { 
       </mo> 
       <mrow> 
        <mfrac> 
         <mn>
           1 
         </mn> 
         <mi>
           n 
         </mi> 
        </mfrac> 
        <munderover> 
         <mstyle displaystyle="true" mathsize="140%"> 
          <mo>
            ∑ 
          </mo> 
         </mstyle> 
         <mrow> 
          <mi>
            i 
          </mi> 
          <mo>
            = 
          </mo> 
          <mn>
            1 
          </mn> 
         </mrow> 
         <mi>
           n 
         </mi> 
        </munderover> 
        <mrow> 
         <mo>
           [ 
         </mo> 
         <mrow> 
          <msub> 
           <mi>
             Y 
           </mi> 
           <mi>
             i 
           </mi> 
          </msub> 
          <mi>
            exp 
          </mi> 
          <mrow> 
           <mo>
             ( 
           </mo> 
           <mrow> 
            <mo>
              − 
            </mo> 
            <msubsup> 
             <mi>
               Π 
             </mi> 
             <mi>
               i 
             </mi> 
             <mtext>
               T 
             </mtext> 
            </msubsup> 
            <mover accent="true"> 
             <mi>
               ϑ 
             </mi> 
             <mo>
               ^ 
             </mo> 
            </mover> 
           </mrow> 
           <mo>
             ) 
           </mo> 
          </mrow> 
          <mo>
            + 
          </mo> 
          <msubsup> 
           <mi>
             Y 
           </mi> 
           <mi>
             i 
           </mi> 
           <mrow> 
            <mo>
              − 
            </mo> 
            <mn>
              1 
            </mn> 
           </mrow> 
          </msubsup> 
          <mi>
            exp 
          </mi> 
          <mrow> 
           <mo>
             ( 
           </mo> 
           <mrow> 
            <msubsup> 
             <mi>
               Π 
             </mi> 
             <mi>
               i 
             </mi> 
             <mtext>
               T 
             </mtext> 
            </msubsup> 
            <mover accent="true"> 
             <mi>
               ϑ 
             </mi> 
             <mo>
               ^ 
             </mo> 
            </mover> 
           </mrow> 
           <mo>
             ) 
           </mo> 
          </mrow> 
         </mrow> 
         <mo>
           ] 
         </mo> 
        </mrow> 
       </mrow> 
       <mo>
         } 
       </mo> 
      </mrow> 
      <mo>
        + 
      </mo> 
      <mfrac> 
       <mrow> 
        <mrow> 
         <mo>
           ( 
         </mo> 
         <mrow> 
          <msub> 
           <mi>
             N 
           </mi> 
           <mi>
             n 
           </mi> 
          </msub> 
          <mo>
            + 
          </mo> 
          <mi>
            q 
          </mi> 
         </mrow> 
         <mo>
           ) 
         </mo> 
        </mrow> 
        <mtext>
          log 
        </mtext> 
        <mrow> 
         <mo>
           ( 
         </mo> 
         <mi>
           n 
         </mi> 
         <mo>
           ) 
         </mo> 
        </mrow> 
       </mrow> 
       <mi>
         n 
       </mi> 
      </mfrac> 
      <mo>
        , 
      </mo> 
     </mrow> 
    </math></p>
   <p>on the range <img width="170.06507592190889" src="https://html.scirp.org/file/1241924-rId242.svg?20250224023933">, where <img width="31.25" src="https://html.scirp.org/file/1241924-rId244.svg?20250224023933"> denotes the closest integer to 
      <math xmlns="http://www.w3.org/1998/Math/MathML"> <mi>
         a 
       </mi> 
      </math>. Then the optimal 
      <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
        <msub> 
         <mi>
           N 
         </mi> 
         <mi>
           n 
         </mi> 
        </msub> 
       </mrow> 
      </math> can be derived as 
      <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
        <msubsup> 
         <mi>
           N 
         </mi> 
         <mi>
           n 
         </mi> 
         <mrow> 
          <mi>
            o 
          </mi> 
          <mi>
            p 
          </mi> 
          <mi>
            t 
          </mi> 
         </mrow> 
        </msubsup> 
        <mo>
          = 
        </mo> 
        <munder> 
         <mrow> 
          <mi>
            arg 
          </mi> 
          <mi>
            min 
          </mi> 
         </mrow> 
         <mrow> 
          <msub> 
           <mi>
             N 
           </mi> 
           <mi>
             n 
           </mi> 
          </msub> 
         </mrow> 
        </munder> 
        <mtext>
          BIC 
        </mtext> 
        <mrow> 
         <mo>
           ( 
         </mo> 
         <mrow> 
          <msub> 
           <mi>
             N 
           </mi> 
           <mi>
             n 
           </mi> 
          </msub> 
         </mrow> 
         <mo>
           ) 
         </mo> 
        </mrow> 
       </mrow> 
      </math>.</img></img></p>
   <p>In our simulation experiments, 500 repetitions are carried out for each error configuration. We compute the means of absolute biases (ABISE<sub>ℓ</sub>) for each estimated parametric coefficient 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <msub> 
       <mover accent="true"> 
        <mi>
          β 
        </mi> 
        <mo>
          ^ 
        </mo> 
       </mover> 
       <mi>
         ℓ 
       </mi> 
      </msub> 
     </mrow> 
    </math>, 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mi>
        ℓ 
      </mi> 
      <mo>
        = 
      </mo> 
      <mn>
        1 
      </mn> 
      <mo>
        , 
      </mo> 
      <mn>
        2 
      </mn> 
     </mrow> 
    </math> and mean squared error (MSE) for the estimated 
    <math display="inline" xmlns="http://www.w3.org/1998/Math/MathML"> <mover accent="true"> 
      <mi>
        β 
      </mi> 
      <mo>
        ^ 
      </mo> 
     </mover> 
    </math>. To assess the performance of estimator 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mover accent="true"> 
       <mi>
         f 
       </mi> 
       <mo>
         ^ 
       </mo> 
      </mover> 
      <mrow> 
       <mo>
         ( 
       </mo> 
       <mo>
         ⋅ 
       </mo> 
       <mo>
         ) 
       </mo> 
      </mrow> 
     </mrow> 
    </math> for the monotone function 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mi>
        f 
      </mi> 
      <mrow> 
       <mo>
         ( 
       </mo> 
       <mo>
         ⋅ 
       </mo> 
       <mo>
         ) 
       </mo> 
      </mrow> 
     </mrow> 
    </math>, we apply the square root of average square error (RASE) of 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mover accent="true"> 
       <mi>
         f 
       </mi> 
       <mo>
         ^ 
       </mo> 
      </mover> 
      <mrow> 
       <mo>
         ( 
       </mo> 
       <mo>
         ⋅ 
       </mo> 
       <mo>
         ) 
       </mo> 
      </mrow> 
     </mrow> 
    </math>, which is defined as</p>
   <p>
    <math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"> <mrow> 
      <mtext>
        RASE 
      </mtext> 
      <mrow> 
       <mo>
         ( 
       </mo> 
       <mover accent="true"> 
        <mi>
          f 
        </mi> 
        <mo>
          ^ 
        </mo> 
       </mover> 
       <mo>
         ) 
       </mo> 
      </mrow> 
      <mo>
        = 
      </mo> 
      <msup> 
       <mrow> 
        <mrow> 
         <mo>
           { 
         </mo> 
         <mrow> 
          <mfrac> 
           <mn>
             1 
           </mn> 
           <mrow> 
            <msub> 
             <mi>
               n 
             </mi> 
             <mrow> 
              <mtext>
                grid 
              </mtext> 
             </mrow> 
            </msub> 
           </mrow> 
          </mfrac> 
          <munderover> 
           <mstyle displaystyle="true" mathsize="140%"> 
            <mo>
              ∑ 
            </mo> 
           </mstyle> 
           <mrow> 
            <mi>
              i 
            </mi> 
            <mo>
              = 
            </mo> 
            <mn>
              1 
            </mn> 
           </mrow> 
           <mrow> 
            <msub> 
             <mi>
               n 
             </mi> 
             <mrow> 
              <mtext>
                grid 
              </mtext> 
             </mrow> 
            </msub> 
           </mrow> 
          </munderover> 
          <msup> 
           <mrow> 
            <mrow> 
             <mo>
               ( 
             </mo> 
             <mrow> 
              <mover accent="true"> 
               <mi>
                 f 
               </mi> 
               <mo>
                 ^ 
               </mo> 
              </mover> 
              <mrow> 
               <mo>
                 ( 
               </mo> 
               <mrow> 
                <msub> 
                 <mi>
                   u 
                 </mi> 
                 <mi>
                   i 
                 </mi> 
                </msub> 
               </mrow> 
               <mo>
                 ) 
               </mo> 
              </mrow> 
              <mo>
                − 
              </mo> 
              <mi>
                f 
              </mi> 
              <mrow> 
               <mo>
                 ( 
               </mo> 
               <mrow> 
                <msub> 
                 <mi>
                   u 
                 </mi> 
                 <mi>
                   i 
                 </mi> 
                </msub> 
               </mrow> 
               <mo>
                 ) 
               </mo> 
              </mrow> 
             </mrow> 
             <mo>
               ) 
             </mo> 
            </mrow> 
           </mrow> 
           <mn>
             2 
           </mn> 
          </msup> 
         </mrow> 
         <mo>
           } 
         </mo> 
        </mrow> 
       </mrow> 
       <mrow> 
        <mrow> 
         <mn>
           1 
         </mn> 
         <mo>
           / 
         </mo> 
         <mn>
           2 
         </mn> 
        </mrow> 
       </mrow> 
      </msup> 
      <mo>
        , 
      </mo> 
     </mrow> 
    </math></p>
   <p>where 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mrow> 
       <mo>
         { 
       </mo> 
       <mrow> 
        <msub> 
         <mi>
           u 
         </mi> 
         <mi>
           i 
         </mi> 
        </msub> 
        <mo>
          , 
        </mo> 
        <mi>
          i 
        </mi> 
        <mo>
          = 
        </mo> 
        <mn>
          1 
        </mn> 
        <mo>
          , 
        </mo> 
        <mn>
          2 
        </mn> 
        <mo>
          , 
        </mo> 
        <mo>
          ⋯ 
        </mo> 
        <mo>
          , 
        </mo> 
        <msub> 
         <mi>
           n 
         </mi> 
         <mrow> 
          <mtext>
            grid 
          </mtext> 
         </mrow> 
        </msub> 
       </mrow> 
       <mo>
         } 
       </mo> 
      </mrow> 
     </mrow> 
    </math> are the grid points at which the function 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mi>
        f 
      </mi> 
      <mrow> 
       <mo>
         ( 
       </mo> 
       <mo>
         ⋅ 
       </mo> 
       <mo>
         ) 
       </mo> 
      </mrow> 
     </mrow> 
    </math> is evaluated, and we simply set 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <msub> 
       <mi>
         n 
       </mi> 
       <mrow> 
        <mtext>
          grid 
        </mtext> 
       </mrow> 
      </msub> 
     </mrow> 
    </math> equals to the sample sizes in each simulation.</p>
   <p>Meanwhile, we compare our proposed monotone constrained LPRE estimator (M-LPRE) with three conventional competitors, including: 1) transformation least squares estimator using data 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mrow> 
       <mo>
         { 
       </mo> 
       <mrow> 
        <mi>
          log 
        </mi> 
        <mrow> 
         <mo>
           ( 
         </mo> 
         <mrow> 
          <msub> 
           <mi>
             Y 
           </mi> 
           <mi>
             i 
           </mi> 
          </msub> 
         </mrow> 
         <mo>
           ) 
         </mo> 
        </mrow> 
        <mo>
          , 
        </mo> 
        <msub> 
         <mi>
           X 
         </mi> 
         <mi>
           i 
         </mi> 
        </msub> 
        <mo>
          , 
        </mo> 
        <msub> 
         <mi>
           U 
         </mi> 
         <mi>
           i 
         </mi> 
        </msub> 
       </mrow> 
       <mo>
         } 
       </mo> 
      </mrow> 
     </mrow> 
    </math> and regular B-spline approximation without monotone constraint (TLS); 2) transformation least squares estimator using monotone B-spline approximation (M-TLS); 3) classical LPRE estimator without monotone constraint (see Ming et al. <xref ref-type="bibr" rid="scirp.140771-10">
     [10]
    </xref>). <xref ref-type="table" rid="tableTables 1">
     Tables 1
    </xref>-<xref ref-type="bibr" rid="scirp.140771-#t3">
     3
    </xref> list the means and standard deviations (in parentheses) of ABISE<sub>ℓ</sub>, 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mi>
        ℓ 
      </mi> 
      <mo>
        = 
      </mo> 
      <mn>
        1 
      </mn> 
      <mo>
        , 
      </mo> 
      <mn>
        2 
      </mn> 
     </mrow> 
    </math>, MSE and RASE for the estimators with different sample sizes and cases.</p>
   <table-wrap id="table1">
    <label>
     <xref ref-type="table" rid="table1">
      Table 1
     </xref></label>
    <caption>
     <title>
      <xref ref-type="bibr" rid="scirp.140771-"></xref>Table 1. The simulation results (×10<sup>−</sup><sup>2</sup>) of ABISEs, MSEs and RASEs for Case I.</title>
    </caption>
    <table class="MsoTableGrid custom-table" border="0" cellspacing="0" cellpadding="0"> 
     <tr> 
      <td class="custom-bottom-td acenter" width="11.46%"><p style="text-align:center">n</p></td> 
      <td class="custom-bottom-td acenter" width="11.46%"><p style="text-align:center">Methods</p></td> 
      <td class="custom-bottom-td acenter" width="11.47%"><p style="text-align:center">ABIAS<sub>1</sub></p></td> 
      <td class="custom-bottom-td acenter" width="11.47%"><p style="text-align:center">ABIAS<sub>2</sub></p></td> 
      <td class="custom-bottom-td acenter" width="11.47%"><p style="text-align:center">MSE</p></td> 
      <td class="custom-bottom-td acenter" width="11.47%"><p style="text-align:center">RASE</p></td> 
     </tr> 
     <tr> 
      <td rowspan="4" class="custom-top-td acenter" width="11.46%"><p style="text-align:center">100</p></td> 
      <td class="custom-top-td acenter" width="11.46%"><p style="text-align:center">TLS</p></td> 
      <td class="custom-top-td acenter" width="11.47%"><p style="text-align:center">9.7389 (7.2943)</p></td> 
      <td class="custom-top-td acenter" width="11.47%"><p style="text-align:center">9.6925 (7.3219)</p></td> 
      <td class="custom-top-td acenter" width="11.47%"><p style="text-align:center">2.9539 (3.5008)</p></td> 
      <td class="custom-top-td acenter" width="11.47%"><p style="text-align:center">21.738 (6.7734)</p></td> 
     </tr> 
     <tr> 
      <td class="acenter" width="11.46%"><p style="text-align:center">M-TLS</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">9.7247 (7.2827)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">9.6772 (7.2483)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">2.9358 (3.4886)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">17.877 (6.1711)</p></td> 
     </tr> 
     <tr> 
      <td class="acenter" width="11.46%"><p style="text-align:center">LPRE</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">10.153 (7.7417)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">10.073 (7.9802)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">3.2795 (4.0361)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">22.906 (7.1748)</p></td> 
     </tr> 
     <tr> 
      <td class="custom-bottom-td acenter" width="11.46%"><p style="text-align:center">M-LPRE</p></td> 
      <td class="custom-bottom-td acenter" width="11.47%"><p style="text-align:center">10.085 (7.6489)</p></td> 
      <td class="custom-bottom-td acenter" width="11.47%"><p style="text-align:center">10.086 (7.8772)</p></td> 
      <td class="custom-bottom-td acenter" width="11.47%"><p style="text-align:center">3.2375 (4.0039)</p></td> 
      <td class="custom-bottom-td acenter" width="11.47%"><p style="text-align:center">18.662 (6.4405)</p></td> 
     </tr> 
     <tr> 
      <td rowspan="4" class="custom-top-td acenter" width="11.46%"><p style="text-align:center">200</p></td> 
      <td class="custom-top-td acenter" width="11.46%"><p style="text-align:center">TLS</p></td> 
      <td class="custom-top-td acenter" width="11.47%"><p style="text-align:center">6.7492 (5.4977)</p></td> 
      <td class="custom-top-td acenter" width="11.47%"><p style="text-align:center">6.6565 (4.7724)</p></td> 
      <td class="custom-top-td acenter" width="11.47%"><p style="text-align:center">1.4275 (1.6476)</p></td> 
      <td class="custom-top-td acenter" width="11.47%"><p style="text-align:center">15.429 (5.0271)</p></td> 
     </tr> 
     <tr> 
      <td class="acenter" width="11.46%"><p style="text-align:center">M-TLS</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">6.7855 (5.4965)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">6.6675 (4.7479)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">1.4315 (1.6459)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">13.096 (4.8426)</p></td> 
     </tr> 
     <tr> 
      <td class="acenter" width="11.46%"><p style="text-align:center">LPRE</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">7.0469 (5.6828)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">7.0415 (5.0957)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">1.5738 (1.8380)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">16.335 (5.3119)</p></td> 
     </tr> 
     <tr> 
      <td class="custom-bottom-td acenter" width="11.46%"><p style="text-align:center">M-LPRE</p></td> 
      <td class="custom-bottom-td acenter" width="11.47%"><p style="text-align:center">7.0928 (5.7057)</p></td> 
      <td class="custom-bottom-td acenter" width="11.47%"><p style="text-align:center">7.0122 (5.0885)</p></td> 
      <td class="custom-bottom-td acenter" width="11.47%"><p style="text-align:center">1.5781 (1.8394)</p></td> 
      <td class="custom-bottom-td acenter" width="11.47%"><p style="text-align:center">13.790 (4.9359)</p></td> 
     </tr> 
     <tr> 
      <td rowspan="4" class="custom-top-td acenter" width="11.46%"><p style="text-align:center">500</p></td> 
      <td class="custom-top-td acenter" width="11.46%"><p style="text-align:center">TLS</p></td> 
      <td class="custom-top-td acenter" width="11.47%"><p style="text-align:center">4.2335 (3.1922)</p></td> 
      <td class="custom-top-td acenter" width="11.47%"><p style="text-align:center">4.4513 (3.2366)</p></td> 
      <td class="custom-top-td acenter" width="11.47%"><p style="text-align:center">0.5836 (0.6642)</p></td> 
      <td class="custom-top-td acenter" width="11.47%"><p style="text-align:center">9.7130 (3.2102)</p></td> 
     </tr> 
     <tr> 
      <td class="acenter" width="11.46%"><p style="text-align:center">M-TLS</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">4.2227 (3.1807)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">4.4396 (3.2398)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">0.5811 (0.6617)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">8.6214 (3.0531)</p></td> 
     </tr> 
     <tr> 
      <td class="acenter" width="11.46%"><p style="text-align:center">LPRE</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">4.5267 (3.5264)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">4.7574 (3.5601)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">0.6818 (0.8095)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">10.262 (3.3762)</p></td> 
     </tr> 
     <tr> 
      <td class="acenter" width="11.46%"><p style="text-align:center">M-LPRE</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">4.5190 (3.5183)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">4.7561 (3.5641)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">0.6807 (0.8054)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">9.0773 (3.2266)</p></td> 
     </tr> 
    </table>
   </table-wrap>
   <table-wrap id="table2">
    <label>
     <xref ref-type="table" rid="table2">
      Table 2
     </xref></label>
    <caption>
     <title>
      <xref ref-type="bibr" rid="scirp.140771-"></xref>Table 2. The simulation results (×10<sup>−</sup><sup>2</sup>) of ABISEs, MSEs and RASEs for Case II.</title>
    </caption>
    <table class="MsoTableGrid custom-table" border="0" cellspacing="0" cellpadding="0"> 
     <tr> 
      <td class="custom-bottom-td acenter" width="11.46%"><p style="text-align:center">n</p></td> 
      <td class="custom-bottom-td acenter" width="11.46%"><p style="text-align:center">Methods</p></td> 
      <td class="custom-bottom-td acenter" width="11.47%"><p style="text-align:center">ABISE<sub>1</sub></p></td> 
      <td class="custom-bottom-td acenter" width="11.47%"><p style="text-align:center">ABISE<sub>2</sub></p></td> 
      <td class="custom-bottom-td acenter" width="11.47%"><p style="text-align:center">MSE</p></td> 
      <td class="custom-bottom-td acenter" width="11.47%"><p style="text-align:center">RASE</p></td> 
     </tr> 
     <tr> 
      <td rowspan="4" class="custom-top-td acenter" width="11.46%"><p style="text-align:center">100</p></td> 
      <td class="custom-top-td acenter" width="11.46%"><p style="text-align:center">TLS</p></td> 
      <td class="custom-top-td acenter" width="11.47%"><p style="text-align:center">11.440 (8.1737)</p></td> 
      <td class="custom-top-td acenter" width="11.47%"><p style="text-align:center">10.838 (8.3276)</p></td> 
      <td class="custom-top-td acenter" width="11.47%"><p style="text-align:center">3.8423 (4.0262)</p></td> 
      <td class="custom-top-td acenter" width="11.47%"><p style="text-align:center">24.858 (7.9266)</p></td> 
     </tr> 
     <tr> 
      <td class="acenter" width="11.46%"><p style="text-align:center">M-TLS</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">11.304 (8.1259)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">10.723 (8.2529)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">3.7665 (3.9514)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">20.267 (7.0257)</p></td> 
     </tr> 
     <tr> 
      <td class="acenter" width="11.46%"><p style="text-align:center">LPRE</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">9.8071 (7.1019)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">9.3712 (7.2280)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">2.8647 (3.0107)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">21.389 (7.1301)</p></td> 
     </tr> 
     <tr> 
      <td class="custom-bottom-td acenter" width="11.46%"><p style="text-align:center">M-LPRE</p></td> 
      <td class="custom-bottom-td acenter" width="11.47%"><p style="text-align:center">9.6380 (6.9635)</p></td> 
      <td class="custom-bottom-td acenter" width="11.47%"><p style="text-align:center">9.1854 (7.1033)</p></td> 
      <td class="custom-bottom-td acenter" width="11.47%"><p style="text-align:center">2.7601 (2.9055)</p></td> 
      <td class="custom-bottom-td acenter" width="11.47%"><p style="text-align:center">17.667 (6.2289)</p></td> 
     </tr> 
     <tr> 
      <td rowspan="4" class="custom-top-td acenter" width="11.46%"><p style="text-align:center">200</p></td> 
      <td class="custom-top-td acenter" width="11.46%"><p style="text-align:center">TLS</p></td> 
      <td class="custom-top-td acenter" width="11.47%"><p style="text-align:center">8.0140 (5.8346)</p></td> 
      <td class="custom-top-td acenter" width="11.47%"><p style="text-align:center">7.7360 (5.9461)</p></td> 
      <td class="custom-top-td acenter" width="11.47%"><p style="text-align:center">1.9333 (2.0871)</p></td> 
      <td class="custom-top-td acenter" width="11.47%"><p style="text-align:center">17.735 (5.4551)</p></td> 
     </tr> 
     <tr> 
      <td class="acenter" width="11.46%"><p style="text-align:center">M-TLS</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">7.9488 (5.8484)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">7.6923 (5.8878)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">1.9109 (2.0591)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">15.221 (5.2409)</p></td> 
     </tr> 
     <tr> 
      <td class="acenter" width="11.46%"><p style="text-align:center">LPRE</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">6.6634 (4.9784)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">6.4300 (4.9792)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">1.3522 (1.4655)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">14.836 (4.7409)</p></td> 
     </tr> 
     <tr> 
      <td class="custom-bottom-td acenter" width="11.46%"><p style="text-align:center">M-LPRE</p></td> 
      <td class="custom-bottom-td acenter" width="11.47%"><p style="text-align:center">6.6228 (4.9507)</p></td> 
      <td class="custom-bottom-td acenter" width="11.47%"><p style="text-align:center">6.3848 (4.9110)</p></td> 
      <td class="custom-bottom-td acenter" width="11.47%"><p style="text-align:center">1.3315 (1.4410)</p></td> 
      <td class="custom-bottom-td acenter" width="11.47%"><p style="text-align:center">12.852 (4.5762)</p></td> 
     </tr> 
     <tr> 
      <td rowspan="4" class="custom-top-td acenter" width="11.46%"><p style="text-align:center">500</p></td> 
      <td class="custom-top-td acenter" width="11.46%"><p style="text-align:center">TLS</p></td> 
      <td class="custom-top-td acenter" width="11.47%"><p style="text-align:center">4.9159 (3.9014)</p></td> 
      <td class="custom-top-td acenter" width="11.47%"><p style="text-align:center">4.6336 (3.3834)</p></td> 
      <td class="custom-top-td acenter" width="11.47%"><p style="text-align:center">0.7225 (0.8453)</p></td> 
      <td class="custom-top-td acenter" width="11.47%"><p style="text-align:center">11.117 (3.5822)</p></td> 
     </tr> 
     <tr> 
      <td class="acenter" width="11.46%"><p style="text-align:center">M-TLS</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">4.9090 (3.8962)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">4.6229 (3.3747)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">0.7198 (0.8477)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">9.8016 (3.4976)</p></td> 
     </tr> 
     <tr> 
      <td class="acenter" width="11.46%"><p style="text-align:center">LPRE</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">4.0294 (3.2317)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">3.8389 (2.7915)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">0.4917 (0.5751)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">9.1923 (2.9412)</p></td> 
     </tr> 
     <tr> 
      <td class="acenter" width="11.46%"><p style="text-align:center">M-LPRE</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">4.0156 (3.2192)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">3.8274 (2.7830)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">0.4884 (0.5754)</p></td> 
      <td class="acenter" width="11.47%"><p style="text-align:center">8.1851 (2.8816)</p></td> 
     </tr> 
    </table>
   </table-wrap>
   <table-wrap id="table3">
    <label>
     <xref ref-type="table" rid="table3">
      Table 3
     </xref></label>
    <caption>
     <title>
      <xref ref-type="bibr" rid="scirp.140771-"></xref>Table 3. The simulation results (×10<sup>−</sup><sup>2</sup>) of ABISEs, MSEs and RASEs for Case III.</title>
    </caption>
    <table class="MsoTableGrid custom-table" border="0" cellspacing="0" cellpadding="0"> 
     <tr> 
      <td class="custom-bottom-td acenter" width="15.56%"><p style="text-align:center">n</p></td> 
      <td class="custom-bottom-td acenter" width="15.56%"><p style="text-align:center">Methods</p></td> 
      <td class="custom-bottom-td acenter" width="15.56%"><p style="text-align:center">ABISE<sub>1</sub></p></td> 
      <td class="custom-bottom-td acenter" width="15.56%"><p style="text-align:center">ABISE<sub>2</sub></p></td> 
      <td class="custom-bottom-td acenter" width="15.56%"><p style="text-align:center">MSE</p></td> 
      <td class="custom-bottom-td acenter" width="15.56%"><p style="text-align:center">RASE</p></td> 
     </tr> 
     <tr> 
      <td rowspan="4" class="custom-top-td acenter" width="15.56%"><p style="text-align:center">100</p></td> 
      <td class="custom-top-td acenter" width="15.56%"><p style="text-align:center">TLS</p></td> 
      <td class="custom-top-td acenter" width="15.56%"><p style="text-align:center">3.2162 (2.3359)</p></td> 
      <td class="custom-top-td acenter" width="15.56%"><p style="text-align:center">3.0322 (2.3445)</p></td> 
      <td class="custom-top-td acenter" width="15.56%"><p style="text-align:center">0.3047 (0.3208)</p></td> 
      <td class="custom-top-td acenter" width="15.56%"><p style="text-align:center">7.1122 (2.1965)</p></td> 
     </tr> 
     <tr> 
      <td class="acenter" width="15.56%"><p style="text-align:center">M-TLS</p></td> 
      <td class="acenter" width="15.56%"><p style="text-align:center">3.2146 (2.3095)</p></td> 
      <td class="acenter" width="15.56%"><p style="text-align:center">3.0107 (2.3420)</p></td> 
      <td class="acenter" width="15.56%"><p style="text-align:center">0.3019 (0.3191)</p></td> 
      <td class="acenter" width="15.56%"><p style="text-align:center">6.4357 (2.0982)</p></td> 
     </tr> 
     <tr> 
      <td class="acenter" width="15.56%"><p style="text-align:center">LPRE</p></td> 
      <td class="acenter" width="15.56%"><p style="text-align:center">3.1725 (2.3017)</p></td> 
      <td class="acenter" width="15.56%"><p style="text-align:center">2.9921 (2.3203)</p></td> 
      <td class="acenter" width="15.56%"><p style="text-align:center">0.2967 (0.3123)</p></td> 
      <td class="acenter" width="15.56%"><p style="text-align:center">7.0157 (2.1718)</p></td> 
     </tr> 
     <tr> 
      <td class="custom-bottom-td acenter" width="15.56%"><p style="text-align:center">M-LPRE</p></td> 
      <td class="custom-bottom-td acenter" width="15.56%"><p style="text-align:center">3.1705 (2.2772)</p></td> 
      <td class="custom-bottom-td acenter" width="15.56%"><p style="text-align:center">2.9699 (2.3135)</p></td> 
      <td class="custom-bottom-td acenter" width="15.56%"><p style="text-align:center">0.2939 (0.3102)</p></td> 
      <td class="custom-bottom-td acenter" width="15.56%"><p style="text-align:center">6.3625 (2.0805)</p></td> 
     </tr> 
     <tr> 
      <td rowspan="4" class="custom-top-td acenter" width="15.56%"><p style="text-align:center">200</p></td> 
      <td class="custom-top-td acenter" width="15.56%"><p style="text-align:center">TLS</p></td> 
      <td class="custom-top-td acenter" width="15.56%"><p style="text-align:center">2.2765 (1.6694)</p></td> 
      <td class="custom-top-td acenter" width="15.56%"><p style="text-align:center">2.1814 (1.6741)</p></td> 
      <td class="custom-top-td acenter" width="15.56%"><p style="text-align:center">0.1552 (0.1693)</p></td> 
      <td class="custom-top-td acenter" width="15.56%"><p style="text-align:center">5.1104 (1.5069)</p></td> 
     </tr> 
     <tr> 
      <td class="acenter" width="15.56%"><p style="text-align:center">M-TLS</p></td> 
      <td class="acenter" width="15.56%"><p style="text-align:center">2.2662 (1.6723)</p></td> 
      <td class="acenter" width="15.56%"><p style="text-align:center">2.1767 (1.6696)</p></td> 
      <td class="acenter" width="15.56%"><p style="text-align:center">0.1544 (0.1685)</p></td> 
      <td class="acenter" width="15.56%"><p style="text-align:center">4.7502 (1.4204)</p></td> 
     </tr> 
     <tr> 
      <td class="acenter" width="15.56%"><p style="text-align:center">LPRE</p></td> 
      <td class="acenter" width="15.56%"><p style="text-align:center">2.2435 (1.6464)</p></td> 
      <td class="acenter" width="15.56%"><p style="text-align:center">2.1490 (1.6455)</p></td> 
      <td class="acenter" width="15.56%"><p style="text-align:center">0.1505 (0.1639)</p></td> 
      <td class="acenter" width="15.56%"><p style="text-align:center">5.0379 (1.4909)</p></td> 
     </tr> 
     <tr> 
      <td class="custom-bottom-td acenter" width="15.56%"><p style="text-align:center">M-LPRE</p></td> 
      <td class="custom-bottom-td acenter" width="15.56%"><p style="text-align:center">2.2334 (1.6478)</p></td> 
      <td class="custom-bottom-td acenter" width="15.56%"><p style="text-align:center">2.1434 (1.6398)</p></td> 
      <td class="custom-bottom-td acenter" width="15.56%"><p style="text-align:center">0.1497 (0.1630)</p></td> 
      <td class="custom-bottom-td acenter" width="15.56%"><p style="text-align:center">4.6889 (1.4076)</p></td> 
     </tr> 
     <tr> 
      <td rowspan="4" class="custom-top-td acenter" width="15.56%"><p style="text-align:center">500</p></td> 
      <td class="custom-top-td acenter" width="15.56%"><p style="text-align:center">TLS</p></td> 
      <td class="custom-top-td acenter" width="15.56%"><p style="text-align:center">1.3782 (1.1084)</p></td> 
      <td class="custom-top-td acenter" width="15.56%"><p style="text-align:center">1.3298 (0.9610)</p></td> 
      <td class="custom-top-td acenter" width="15.56%"><p style="text-align:center">0.0581 (0.0688)</p></td> 
      <td class="custom-top-td acenter" width="15.56%"><p style="text-align:center">3.2795 (0.9612)</p></td> 
     </tr> 
     <tr> 
      <td class="acenter" width="15.56%"><p style="text-align:center">M-TLS</p></td> 
      <td class="acenter" width="15.56%"><p style="text-align:center">1.3750 (1.1066)</p></td> 
      <td class="acenter" width="15.56%"><p style="text-align:center">1.3278 (0.9607)</p></td> 
      <td class="acenter" width="15.56%"><p style="text-align:center">0.0579 (0.0687)</p></td> 
      <td class="acenter" width="15.56%"><p style="text-align:center">3.1095 (0.9321)</p></td> 
     </tr> 
     <tr> 
      <td class="acenter" width="15.56%"><p style="text-align:center">LPRE</p></td> 
      <td class="acenter" width="15.56%"><p style="text-align:center">1.3562 (1.0906)</p></td> 
      <td class="acenter" width="15.56%"><p style="text-align:center">1.3097 (0.9474)</p></td> 
      <td class="acenter" width="15.56%"><p style="text-align:center">0.0563 (0.0668)</p></td> 
      <td class="acenter" width="15.56%"><p style="text-align:center">3.2249 (0.9389)</p></td> 
     </tr> 
     <tr> 
      <td class="acenter" width="15.56%"><p style="text-align:center">M-LPRE</p></td> 
      <td class="acenter" width="15.56%"><p style="text-align:center">1.3530 (1.0902)</p></td> 
      <td class="acenter" width="15.56%"><p style="text-align:center">1.3086 (0.9462)</p></td> 
      <td class="acenter" width="15.56%"><p style="text-align:center">0.0562 (0.0668)</p></td> 
      <td class="acenter" width="15.56%"><p style="text-align:center">3.0596 (0.9112)</p></td> 
     </tr> 
    </table>
   </table-wrap>
   <p>We can make the following observations: 1) M-TLS and M-LPRE estimators perform better than the corresponding TLS and LPRE estimators, respectively. 2) For Case I, as is anticipated, M-TLS estimators perform best, for Cases II-III, M-LPRE generally outperform the others, this is because the error term of logarithmic partially linear multiplicative model is the standard norm distribution, makes least squares based estimator better, while Cases II-III make LPRE based estimators efficient. 3) For a given error distribution case, it is obvious that the mean and standard deviation of ABISE<sub>ℓ</sub>, 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mi>
        ℓ 
      </mi> 
      <mo>
        = 
      </mo> 
      <mn>
        1 
      </mn> 
      <mo>
        , 
      </mo> 
      <mn>
        2 
      </mn> 
     </mrow> 
    </math>, MSE and RASE for all estimators decrease as the sample size increases, this result confirms the asymptotic consistency of the proposed estimation. Moreover, we present the estimated nonparametric curves and boxplots of MSEs and RASEs for the parameters and coefficient functions in <xref ref-type="fig" rid="fig1">
     Figure 1
    </xref> under the Case II when the sample size 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mi>
        n 
      </mi> 
      <mo>
        = 
      </mo> 
      <mn>
        200 
      </mn> 
     </mrow> 
    </math>. All these findings reflect the satisfactory performance of our proposed method under the considered settings.</p>
  </sec><sec id="s4">
   <title>4. Real Data Application</title>
   <p>In this section, we illustrate the proposed approach by analysing the air pollution data set. This data set was collected by the Norwegian Public Roads Administration which is available at <xref ref-type="bibr" rid="scirp.140771-http://lib.stat.cmu.edu/datasets/NO2.dat">
     http://lib.stat.cmu.edu/datasets/NO2.dat
    </xref>. There are 500 observations measured at Alnabru in Oslo, Norway, between October 2001 and August 2003. The purpose is to research how the concentration of the air pollution NO<sub>2</sub> depends on the traffic volume and three meteorological elements, thus, it is appropriate to treat hourly values of the logarithm of the concentration of NO<sub>2</sub> (particles) as the response variable ( 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mi>
       Y 
     </mi> 
    </math>). According to the suggestion proposed by Du et al. <xref ref-type="bibr" rid="scirp.140771-13">
     [13]
    </xref>, we take the logarithm of the number of cars per hour as predictor</p>
   <fig id="fig1" position="float">
    <label>Figure 1</label>
    <caption>
     <title>Figure 1. Estimated nonparametric curves and boxplots of MSEs and RASEs for Case II when sample size 

      <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
  
        <mi>
         
   n
  
        </mi>
  
        <mo>
         
   =
  
        </mo>
  
        <mn>
         
   200
  
        </mn>
 
       </mrow>

      </math>.</title>
    </caption>
    <graphic mimetype="image" position="float" xlink:type="simple" xlink:href="https://html.scirp.org/file/1241924-rId283.jpeg?20250224023933" />
   </fig>
   <p>variable 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mi>
       U 
     </mi> 
    </math>, and the three covariate variables are temperature two meters above ground ( 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <msub> 
       <mi>
         X 
       </mi> 
       <mn>
         1 
       </mn> 
      </msub> 
     </mrow> 
    </math>, ˚C), wind speed ( 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <msub> 
       <mi>
         X 
       </mi> 
       <mn>
         2 
       </mn> 
      </msub> 
     </mrow> 
    </math>, m/s) and the temperature difference between 25 and 2 m above ground ( 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <msub> 
       <mi>
         X 
       </mi> 
       <mn>
         3 
       </mn> 
      </msub> 
     </mrow> 
    </math>, ˚C). In the subsequent analysis, we use exponential 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mi>
       Y 
     </mi> 
    </math> as response variable for model (1.1), and then construct the model as follows:</p>
   <p>
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mi>
        Y 
      </mi> 
      <mo>
        = 
      </mo> 
      <mtext>
        exp 
      </mtext> 
      <mrow> 
       <mo>
         ( 
       </mo> 
       <mrow> 
        <msub> 
         <mi>
           X 
         </mi> 
         <mn>
           1 
         </mn> 
        </msub> 
        <msub> 
         <mi>
           β 
         </mi> 
         <mn>
           1 
         </mn> 
        </msub> 
        <mo>
          + 
        </mo> 
        <msub> 
         <mi>
           X 
         </mi> 
         <mn>
           2 
         </mn> 
        </msub> 
        <msub> 
         <mi>
           β 
         </mi> 
         <mn>
           2 
         </mn> 
        </msub> 
        <mo>
          + 
        </mo> 
        <msub> 
         <mi>
           X 
         </mi> 
         <mn>
           3 
         </mn> 
        </msub> 
        <msub> 
         <mi>
           β 
         </mi> 
         <mn>
           3 
         </mn> 
        </msub> 
        <mo>
          + 
        </mo> 
        <mi>
          f 
        </mi> 
        <mrow> 
         <mo>
           ( 
         </mo> 
         <mi>
           U 
         </mi> 
         <mo>
           ) 
         </mo> 
        </mrow> 
       </mrow> 
       <mo>
         ) 
       </mo> 
      </mrow> 
      <mi>
        ϵ 
      </mi> 
      <mo>
        . 
      </mo> 
     </mrow> 
    </math></p>
   <p>We use the first 420 samples from the data as the training data for modeling fitting and the remainder as test data for evaluating the prediction performance of the methods. We calculate the median of additive relative prediction error defined as 
    <math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"> <mrow> 
      <mtext>
        MAPE 
      </mtext> 
      <mo>
        = 
      </mo> 
      <mtext>
        Median 
      </mtext> 
      <mrow> 
       <mo>
         { 
       </mo> 
       <mrow> 
        <mrow> 
         <mrow> 
          <mrow> 
           <mo>
             | 
           </mo> 
           <mrow> 
            <msub> 
             <mi>
               Y 
             </mi> 
             <mi>
               i 
             </mi> 
            </msub> 
            <mo>
              − 
            </mo> 
            <msub> 
             <mover accent="true"> 
              <mi>
                Y 
              </mi> 
              <mo>
                ^ 
              </mo> 
             </mover> 
             <mi>
               i 
             </mi> 
            </msub> 
           </mrow> 
           <mo>
             | 
           </mo> 
          </mrow> 
         </mrow> 
         <mo>
           / 
         </mo> 
         <mrow> 
          <msub> 
           <mi>
             Y 
           </mi> 
           <mi>
             i 
           </mi> 
          </msub> 
         </mrow> 
        </mrow> 
        <mo>
          + 
        </mo> 
        <mrow> 
         <mrow> 
          <mrow> 
           <mo>
             | 
           </mo> 
           <mrow> 
            <msub> 
             <mi>
               Y 
             </mi> 
             <mi>
               i 
             </mi> 
            </msub> 
            <mo>
              − 
            </mo> 
            <msub> 
             <mover accent="true"> 
              <mi>
                Y 
              </mi> 
              <mo>
                ^ 
              </mo> 
             </mover> 
             <mi>
               i 
             </mi> 
            </msub> 
           </mrow> 
           <mo>
             | 
           </mo> 
          </mrow> 
         </mrow> 
         <mo>
           / 
         </mo> 
         <mrow> 
          <msub> 
           <mover accent="true"> 
            <mi>
              Y 
            </mi> 
            <mo>
              ^ 
            </mo> 
           </mover> 
           <mi>
             i 
           </mi> 
          </msub> 
         </mrow> 
        </mrow> 
        <mo>
          , 
        </mo> 
        <mi>
          i 
        </mi> 
        <mo>
          = 
        </mo> 
        <mn>
          1 
        </mn> 
        <mo>
          , 
        </mo> 
        <mo>
          ⋯ 
        </mo> 
        <mo>
          , 
        </mo> 
        <mn>
          80 
        </mn> 
       </mrow> 
       <mo>
         } 
       </mo> 
      </mrow> 
     </mrow> 
    </math> to measure the predictability, where 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <msub> 
       <mover accent="true"> 
        <mi>
          Y 
        </mi> 
        <mo>
          ^ 
        </mo> 
       </mover> 
       <mi>
         i 
       </mi> 
      </msub> 
     </mrow> 
    </math> is the fitted value of 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <msub> 
       <mi>
         Y 
       </mi> 
       <mi>
         i 
       </mi> 
      </msub> 
     </mrow> 
    </math>. The obtained MAPEs along with parameter estimator given in brackets are 0.6778 ( 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <msub> 
       <mover accent="true"> 
        <mi>
          β 
        </mi> 
        <mo>
          ^ 
        </mo> 
       </mover> 
       <mn>
         1 
       </mn> 
      </msub> 
      <mo>
        = 
      </mo> 
      <mo>
        − 
      </mo> 
      <mn>
        0.0211 
      </mn> 
     </mrow> 
    </math>, 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <msub> 
       <mover accent="true"> 
        <mi>
          β 
        </mi> 
        <mo>
          ^ 
        </mo> 
       </mover> 
       <mn>
         2 
       </mn> 
      </msub> 
      <mo>
        = 
      </mo> 
      <mo>
        − 
      </mo> 
      <mn>
        0.1432 
      </mn> 
     </mrow> 
    </math>, 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <msub> 
       <mover accent="true"> 
        <mi>
          β 
        </mi> 
        <mo>
          ^ 
        </mo> 
       </mover> 
       <mn>
         3 
       </mn> 
      </msub> 
      <mo>
        = 
      </mo> 
      <mn>
        0.1357 
      </mn> 
     </mrow> 
    </math>) and 0.6565 ( 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <msub> 
       <mover accent="true"> 
        <mi>
          β 
        </mi> 
        <mo>
          ^ 
        </mo> 
       </mover> 
       <mn>
         1 
       </mn> 
      </msub> 
      <mo>
        = 
      </mo> 
      <mo>
        − 
      </mo> 
      <mn>
        0.0202 
      </mn> 
     </mrow> 
    </math>, 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <msub> 
       <mover accent="true"> 
        <mi>
          β 
        </mi> 
        <mo>
          ^ 
        </mo> 
       </mover> 
       <mn>
         2 
       </mn> 
      </msub> 
      <mo>
        = 
      </mo> 
      <mo>
        − 
      </mo> 
      <mn>
        0.1407 
      </mn> 
     </mrow> 
    </math>, 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <msub> 
       <mover accent="true"> 
        <mi>
          β 
        </mi> 
        <mo>
          ^ 
        </mo> 
       </mover> 
       <mn>
         3 
       </mn> 
      </msub> 
      <mo>
        = 
      </mo> 
      <mn>
        0.1373 
      </mn> 
     </mrow> 
    </math>) for LPRE and M-LPRE methods, respectively. The estimated curves are displayed in <xref ref-type="fig" rid="fig2">
     Figure 2
    </xref>. As expected, the more cars would result in higher concentration of NO<sub>2</sub>, therefore it is reasonable to assume the monotonicity of 
    <math xmlns="http://www.w3.org/1998/Math/MathML"> <mrow> 
      <mi>
        f 
      </mi> 
      <mrow> 
       <mo>
         ( 
       </mo> 
       <mo>
         ⋅ 
       </mo> 
       <mo>
         ) 
       </mo> 
      </mrow> 
     </mrow> 
    </math>, and our proposed method coincides with this empirical evidence.</p>
   <fig id="fig2" position="float">
    <label>Figure 2</label>
    <caption>
     <title>Figure 2. Estimated nonparametric curves in the air pollution study data set.</title>
    </caption>
    <graphic mimetype="image" position="float" xlink:type="simple" xlink:href="https://html.scirp.org/file/1241924-rId318.jpeg?20250224023933" />
   </fig>
  </sec><sec id="s5">
   <title>5. Conclusions</title>
   <p>In this paper, we propose a novel partially linear multiplicative model in which the nonparametric component is assumed to be a monotone function. We use monotone B-spline basis expansion to estimate the nonparametric function based on the constrained least product relative error criterion. We then provide a uniform convergence rate and asymptotic normality of the proposed spline estimators. Numerical results suggest that the proposed estimation is promising over its competitors.</p>
   <p>The proposed method has some useful extensions. First, we can add a penalty term to achieve sparsity when irrelevant variables exist in the model. Second, we can set an intercept term in the model and allow it to vary for different subgroups from a heterogeneous population, we then study subgroup analysis problem using popular concave pairwise penalized approach. Third, it would be of interest to extend the proposed method to monotone partially linear single index multiplicative model and investigate its theoretical property. Fourth, as one of the reviewers pointed out whether the optimization process is computationally feasible for large-scale data. We need pay efforts to constructing adaptive distributed algorithm or use subsampling method to solve the constraint problem imposed by large-scale data. For the relatively strong condition of monotonicity, pursuing constraint test on this aspect should be meaningful and interesting. We will pursue these detailed investigation issues in our future research.</p>
  </sec><sec id="s6">
   <title>Acknowledgements</title>
   <p>This work was supported by the Natural Science Research Project of Anhui Educational Department (2024AH050015) and the Anhui Provincial Philosophy and Social Science Project (AHSKF2022D08).</p>
  </sec>
 </body><back>
  <ref-list>
   <title>References</title>
   <ref id="scirp.140771-ref1">
    <label>1</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Khoshgoftaar, T.M., Bhattacharyya, B.B. and Richardson, G.D. (1992) Predicting Software Errors, during Development, Using Nonlinear Regression Models: A Comparative Study. IEEE Transactions on Reliability, 41, 390-395. &gt;https://doi.org/10.1109/24.159804 
    </mixed-citation>
   </ref>
   <ref id="scirp.140771-ref2">
    <label>2</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Park, H. and Stefanski, L.A. (1998) Relative-Error Prediction. Statistics &amp; Probability Letters, 40, 227-236. &gt;https://doi.org/10.1016/s0167-7152(98)00088-1
    </mixed-citation>
   </ref>
   <ref id="scirp.140771-ref3">
    <label>3</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Chen, K., Guo, S., Lin, Y. and Ying, Z. (2010) Least Absolute Relative Error Estimation. Journal of the American Statistical Association, 105, 1104-1112. &gt;https://doi.org/10.1198/jasa.2010.tm09307
    </mixed-citation>
   </ref>
   <ref id="scirp.140771-ref4">
    <label>4</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Xia, X., Liu, Z. and Yang, H. (2016) Regularized Estimation for the Least Absolute Relative Error Models with a Diverging Number of Covariates. Computational Statistics &amp; Data Analysis, 96, 104-119. &gt;https://doi.org/10.1016/j.csda.2015.10.012
    </mixed-citation>
   </ref>
   <ref id="scirp.140771-ref5">
    <label>5</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Zhang, Q. and Wang, Q. (2013) Local Least Absolute Relative Error Estimating Approach for Partially Linear Multiplicative Model. Statistica Sinica, 23, 1091-1116. &gt;https://doi.org/10.5705/ss.2012.133
    </mixed-citation>
   </ref>
   <ref id="scirp.140771-ref6">
    <label>6</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Chen, K., Lin, Y., Wang, Z. and Ying, Z. (2016) Least Product Relative Error Estimation. Journal of Multivariate Analysis, 144, 91-98. &gt;https://doi.org/10.1016/j.jmva.2015.10.017
    </mixed-citation>
   </ref>
   <ref id="scirp.140771-ref7">
    <label>7</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Zhang, J., Feng, Z. and Peng, H. (2018) Estimation and Hypothesis Test for Partial Linear Multiplicative Models. Computational Statistics &amp; Data Analysis, 128, 87-103. &gt;https://doi.org/10.1016/j.csda.2018.06.017
    </mixed-citation>
   </ref>
   <ref id="scirp.140771-ref8">
    <label>8</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Hu, D. (2019) Local Least Product Relative Error Estimation for Varying Coefficient Multiplicative Regression Model. Acta Mathematicae Applicatae Sinica, English Series, 35, 274-286. &gt;https://doi.org/10.1007/s10255-018-0794-2
    </mixed-citation>
   </ref>
   <ref id="scirp.140771-ref9">
    <label>9</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Liu, H. and Xia, X. (2018) Estimation and Empirical Likelihood for Single-Index Multiplicative Models. Journal of Statistical Planning and Inference, 193, 70-88. &gt;https://doi.org/10.1016/j.jspi.2017.08.003
    </mixed-citation>
   </ref>
   <ref id="scirp.140771-ref10">
    <label>10</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Ming, H., Liu, H. and Yang, H. (2022) Least Product Relative Error Estimation for Identification in Multiplicative Additive Models. Journal of Computational and Applied Mathematics, 404, Article ID: 113886. &gt;https://doi.org/10.1016/j.cam.2021.113886
    </mixed-citation>
   </ref>
   <ref id="scirp.140771-ref11">
    <label>11</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Zhang, J., Zhu, X. and Li, G. (2024) Estimation and Hypothesis Test for Varying Coefficient Single-Index Multiplicative Models. Journal of Statistical Computation and Simulation, 94, 2862-2891. &gt;https://doi.org/10.1080/00949655.2024.2359563
    </mixed-citation>
   </ref>
   <ref id="scirp.140771-ref12">
    <label>12</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Lu, M. (2010) Spline-based Sieve Maximum Likelihood Estimation in the Partly Linear Model under Monotonicity Constraints. Journal of Multivariate Analysis, 101, 2528-2542. &gt;https://doi.org/10.1016/j.jmva.2010.07.002
    </mixed-citation>
   </ref>
   <ref id="scirp.140771-ref13">
    <label>13</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Du, J., Sun, Z. and Xie, T. (2013) Estimation for the Partially Linear Regression Model under Monotonic Constraints. Statistics &amp; Probability Letters, 83, 1353-1363. &gt;https://doi.org/10.1016/j.spl.2013.01.006
    </mixed-citation>
   </ref>
   <ref id="scirp.140771-ref14">
    <label>14</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Sun, Z., Zhang, Z. and Du, J. (2013) Semiparametric Analysis of Isotonic Errors-In-Variables Regression Models with Randomly Right Censored Response. Journal of Systems Science and Complexity, 26, 441-461. &gt;https://doi.org/10.1007/s11424-013-1154-1
    </mixed-citation>
   </ref>
   <ref id="scirp.140771-ref15">
    <label>15</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Boente, G., Rodriguez, D. and Vena, P. (2019) Robust Estimators in a Generalized Partly Linear Regression Model under Monotony Constraints. TEST, 29, 50-89. &gt;https://doi.org/10.1007/s11749-019-00629-7
    </mixed-citation>
   </ref>
   <ref id="scirp.140771-ref16">
    <label>16</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Zhang, Y. and Wang, S. (2018) Monotone Function Estimation in Partially Linear Models. Statistics and Its Interface, 11, 19-29. &gt;https://doi.org/10.4310/sii.2018.v11.n1.a2
    </mixed-citation>
   </ref>
   <ref id="scirp.140771-ref17">
    <label>17</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Huang, J.Z. (2003) Local Asymptotics for Polynomial Spline Regression. The Annals of Statistics, 31, 1600-1635. &gt;https://doi.org/10.1214/aos/1065705120
    </mixed-citation>
   </ref>
   <ref id="scirp.140771-ref18">
    <label>18</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Schumaker, L. (1981) Spline Functions: Basic Theory. Wiley.
    </mixed-citation>
   </ref>
   <ref id="scirp.140771-ref19">
    <label>19</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Shen, X., Wolfe, D.A. and Zhou, S. (1998) Local Asymptotics for Regression Splines and Confidence Regions. The Annals of Statistics, 26, 1760-1782. &gt;https://doi.org/10.1214/aos/1024691356
    </mixed-citation>
   </ref>
   <ref id="scirp.140771-ref20">
    <label>20</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Guo, C., Yang, H. and Lv, J. (2016) Generalized Varying Index Coefficient Models. Journal of Computational and Applied Mathematics, 300, 1-17. &gt;https://doi.org/10.1016/j.cam.2015.11.025
    </mixed-citation>
   </ref>
  </ref-list>
 </back>
</article>