<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">OJS</journal-id><journal-title-group><journal-title>Open Journal of Statistics</journal-title></journal-title-group><issn pub-type="epub">2161-718X</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/ojs.2018.81012</article-id><article-id pub-id-type="publisher-id">OJS-82716</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Physics&amp;Mathematics</subject></subj-group></article-categories><title-group><article-title>
 
 
  Simulated Minimum Hellinger Distance Inference Methods for Count Data
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Andrew</surname><given-names>Luong</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Claire</surname><given-names>Bilodeau</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Christopher</surname><given-names>Blier-Wong</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib></contrib-group><aff id="aff1"><addr-line>école d’actuariat, Université Laval, Québec, Canada</addr-line></aff><pub-date pub-type="epub"><day>25</day><month>01</month><year>2018</year></pub-date><volume>08</volume><issue>01</issue><fpage>187</fpage><lpage>219</lpage><history><date date-type="received"><day>22,</day>	<month>January</month>	<year>2018</year></date><date date-type="rev-recd"><day>25,</day>	<month>February</month>	<year>2018</year>	</date><date date-type="accepted"><day>28,</day>	<month>February</month>	<year>2018</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  In this paper, we consider simulated minimum Hellinger distance (SMHD) inferences for count data. We consider grouped and ungrouped data and emphasize SMHD methods. The approaches extend the methods based on the deterministic version of Hellinger distance for count data. The methods are general, it only requires that random samples from the discrete parametric family can be drawn and can be used as alternative methods to estimation using probability generating function (pgf) or methods based matching moments.
   
  Whereas this paper focuses on count data, goodness of fit tests based on simulated Hellinger distance can also be applied for testing goodness of fit for continuous distributions when continuous observations are grouped into intervals like in the case of the traditional Pearson’s statistics.
   
  Asymptotic properties of the SMHD methods are studied and the methods appear to preserve the properties of having good efficiency and robustness of the deterministic version.
 
</p></abstract><kwd-group><kwd>Break Down Points</kwd><kwd> Robustness</kwd><kwd> Power Mixture</kwd><kwd> Esscher Transform</kwd><kwd> Mixture Discrete Distributions</kwd><kwd> Chi-Square Tests Statistics</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><sec id="s1_1"><title>1.1. New Distribution Created Using Probability Generating Functions</title><p>Nonnegative discrete parametric families of distributions are useful for modeling count data. Many of these families do not have closed form probability mass functions nor closed form formulas to express the probability mass function (pmf) recursively. Their pmfs can only be expressed using an infinite series representation but their corresponding Laplace transforms have a closed form and, in many situations, they are relatively simple. Probability generating functions are often used for discrete distributions but Laplace transforms are equivalent and can also be used. In this paper, we use Laplace transforms but they will be converted to probability generating functions (pgfs) whenever the need arises to link with results which already appear in the literature. We begin with a few examples to illustrate the situation often encountered when new distributions are created.</p><p>Example 1 (Discrete stable distributions) The random variable X ≥ 0 follows a positive stable law if the probability generating function and Laplace transform are given respectively as</p><p>P β ( s ) = E ( s X ) = e − λ ( 1 − s ) α ,   0 &lt; α ≤ 1 ,   λ &gt; 0 ,   β = ( λ , α ) ′ ,   | s | ≤ 1</p><p>and</p><p>φ β ( s ) = E ( e − s X ) = e − λ ( 1 − e − s ) α ,   0 &lt; α ≤ 1 ,   λ &gt; 0 ,   β = ( λ , α ) ′ ,   s ≥ 0 .</p><p>The distribution was introduced by Christoph and Schreiber [<xref ref-type="bibr" rid="scirp.82716-ref1">1</xref>] .</p><p>It is easy to see that φ β ( s ) = P β ( e − s ) .</p><p>The Poisson distribution can be obtained by fixing α = 1 . The distribution is infinitely divisible and displays long tail behavior. The recursive formula for its mass function has been obtained; see expression (8) given by Christoph and Schreiber [<xref ref-type="bibr" rid="scirp.82716-ref1">1</xref>] .</p><p>Now if we allow λ to be a random variable with an inverse Gaussian distribution whose Laplace transform is given by h ( s ) = e μ ( 1 − 1 + 2 μ s ) , s ≥ − μ 2 , a mixed</p><p>nonnegative discrete stable distribution can be created with Laplace transform given by</p><p>φ β ( s ) = ∫ 0 ∞ ( g ( s ) ) λ d H ( λ ) ,</p><p>where g ( s ) = e − ( 1 − s ) α and H ( λ ) is the distribution with Laplace transform h ( s ) . The resulting Laplace transform,</p><p>φ β ( s ) = exp ( μ ( 1 − 1 + 2 μ ( 1 − e − s ) α ) ) ,</p><p>is the Laplace transform of a nonnegative infinitely divisible (ID) distribution.</p><p>We can see that it is not always straightforward to find the recursive formula for the pmf for a nonnegative count distribution. Even if it is available, it might still complicated to be used numerically for inferences meanwhile the Laplace transform or pgf can have a relatively simple representation.</p><p>We can observe that the new distribution is obtained by using the inverse Gaussian distribution as a mixing distribution. This is also an example of the use of a power mixture (PM) operator to obtain a new distribution. The PM operator will be further discussed in Section 1.2.</p><p>From a statistical point of view, when neither a closed form pmf nor a recursive formula for the pmf exists, maximum likelihood estimation can be difficult to implement.</p><p>The power mixture operator was introduced by Abate and Whitt [<xref ref-type="bibr" rid="scirp.82716-ref2">2</xref>] (1996) as a way to create new distributions from an infinitely divisible (ID) distribution together with a mixing distribution using Laplace transforms (LT). We shall review it here in the next section, after a definition of an ID distribution.</p><p>Definition 1.1.3. A nonnegative random variable X is infinitely divisible if its Laplace transform can be written as</p><p>ψ ( s ) = ( k n ( s ) ) n , n = 1 , 2 , ⋯ ,</p><p>where k n ( s ) also is the Laplace transform of a random variable. In many situations, k n ( s ) and ψ ( s ) belong to the same parametric family. See Panjer and Willmott [<xref ref-type="bibr" rid="scirp.82716-ref3">3</xref>] (1992, p42) for this definition.</p><p>Abate and Whitt [<xref ref-type="bibr" rid="scirp.82716-ref2">2</xref>] (1996) introduced the power mixture (PM) operator for ID distributions and also some other operators. To the operators already developed by them, we add the Esscher transform operator and the shift operator. All operators considered are discussed below.</p></sec><sec id="s1_2"><title>1.2. Operational calculus on Laplace Transforms</title><sec id="s1_2_1"><title>1.2.1. Power Mixture (PM) Operator</title><p>Suppose that X t is an infinitely divisible nonnegative discrete random variable such that the Laplace transform can be expressed as ( κ ( s ) ) t , t ≥ 0 , where κ ( s ) is the Laplace transform of X, which is nonnegative and infinitely divisible as well. The power mixture (PM) with mixing distribution function H ( y ) and Laplace transform κ H ( s ) of a nonnegative random variable Y is defined as the Laplace transform</p><p>η ( s ) = PM ( κ , H ) = ∫ 0 ∞ ( κ ( s ) ) t d H ( t ) = κ H ( − log ( κ ( s ) ) ) .</p><p>Furthermore, if H ( y ) is infinitely divisible, then the distribution with Laplace transform η ( s ) is also infinitely divisible. The random variable Y ≥ 0 with distribution H ( y ) can be discrete or continuous but needs to be ID. This is the PM method for creating new parametric families, i.e., using the PM operator. The PM method can be viewed as a form of continuous compounding method. The ID property can be dropped but as a result the new distribution created using the PM operator needs not be ID. For the traditional compounding methods, see Klugman et al. [<xref ref-type="bibr" rid="scirp.82716-ref4">4</xref>] (p141-148). Abate and Whitt [<xref ref-type="bibr" rid="scirp.82716-ref2">2</xref>] also mentioned other methods.</p><p>Example 2 (Generalized negative binomial) The generalized negative binomial (GNB) distribution introduced by Gerber [<xref ref-type="bibr" rid="scirp.82716-ref5">5</xref>] can be viewed as a power variance function distribution mixture of a Poisson distribution. The power variance function distribution introduced by Hougaard [<xref ref-type="bibr" rid="scirp.82716-ref6">6</xref>] is obtained by tilting the positive stable distribution using a parameter θ . It is a three-parameter continuous nonnegative distribution with Laplace transform given by</p><p>κ H ( s ) = exp { − λ ( θ + s ) α − θ α } ,   λ , θ &gt; 0 ,   0 &lt; α &lt; 1 .</p><p>Gerber [<xref ref-type="bibr" rid="scirp.82716-ref5">5</xref>] used a different parameterization and named this distribution generalized gamma. It is also called positive tempered stable distribution in finance.</p><p>Let κ ( s ) = e ( e − s − 1 ) be the Laplace transform of a Poisson distribution with rate μ = 1 . The Laplace transform of the GNB distribution can be represented as</p><p>η ( s ) = exp ( − λ ( θ − e − s + 1 ) α − θ α ) .</p><p>The corresponding pgf can be expressed as</p><p>P ( s ) = exp ( − λ ( θ − s + 1 ) α − θ α ) .</p><p>The pgf is given by expression (21) in the paper by Gerber [<xref ref-type="bibr" rid="scirp.82716-ref5">5</xref>] . The GNB distribution is infinitely divisible. If stochastic processes are used instead of distributions, the distribution can also be derived from a stochastic process point of view by considering a Poisson process subordinated to a generalized gamma process and obtain the new distribution as the distribution of increments of the new process created. See section 6 of Abate and Whitt [<xref ref-type="bibr" rid="scirp.82716-ref2">2</xref>] (p92-93). See Zhu and Joe [<xref ref-type="bibr" rid="scirp.82716-ref7">7</xref>] for other distributions which are related to the GNB distribution.</p><p>Note that, if H ( y ) is discrete, η ( s ) is the Laplace transform of a random variable expressible as a random sum. A random sum is also called stopped sum in the literature, see chapter 9 by Johnson et al. [<xref ref-type="bibr" rid="scirp.82716-ref8">8</xref>] (p343-403). The Neymann-Type A distribution given below is an example of a distribution of a random sum.</p><p>Example 3 Let X = ∑ i = 1 Y U i ,the U i ’s conditioning on Y are independent and identically distributed and follows a Poisson distribution with rate ф and Y is distributed with a Poisson distribution with rate λ . Using the Power mixture operator we conclude that the LT for X is</p><p>η ( s ) = exp ( λ ( e ф ( e − s − 1 ) − 1 ) ) ,</p><p>and the pgf is</p><p>P ( s ) = exp ( λ ( e ф ( s − 1 ) − 1 ) ) .</p><p>Properties and applications of the Neymann type A distribution have been studied by Johnson et al. [<xref ref-type="bibr" rid="scirp.82716-ref8">8</xref>] (p368-378). The mean and variance of X are given respectively by E ( X ) = λ ф and V ( X ) = λ ф ( 1 + ф ) . From these expressions, moment estimators (MM) have closed form expressions, see section (4.1) for comparisons between MM estimators and SMHD estimators in a numerical study. For applications often the parameter λ is smaller than the parameter ф .</p></sec><sec id="s1_2_2"><title>1.2.2. Esscher transform operator</title><p>By tilting the density function using the Esscher transform, the Esscher transform operator can be defined and, provided the tilting parameter τ introduced is identifiable, new distributions can be created from existing ones.</p><p>Let X be the original random variable with Laplace transform κ ( s ) . The Esscher transform operator which can be viewed as a tilting operator is defined as</p><p>η ( s ) = Esscher ( κ , τ ) = κ ( s + τ ) κ ( τ ) .</p></sec><sec id="s1_2_3"><title>1.2.3. Shift operator</title><p>Let κ ( s ) be the Laplace transform of a positive continuous random variable X. The Laplace transform of Y = X − τ , Y ≥ τ ≥ 0 is given by e τ κ ( s ) . So, we can define the shift operator as</p><p>η ( s ) = Shift ( κ , τ ) = e τ κ ( s ) .</p><p>In some cases, even the pmf of Y has a closed form but the maximum likelihood (ML) estimators might be attained at the boundaries, the ML estimators might not have the regular optimum properties.</p><p>Note that parallel to the closed form pgf expressions for these new discrete distributions, it is often simple to simulate from the new distributions if we can simulate from the original distribution before the operators are applied. For example, let us consider the new distribution obtained by using the Esscher operator. It suffices to simulate from the distribution before applying the operator and apply the acceptance-rejection method to obtain a sample from the Esscher transformed distribution. The situation is similar for new distributions created by the PM operator. If we can simulate one observation from the mixing distribution of Y which gives a realized value t and if it is not difficult to draw one observation from the distribution with LT κ ( s ) t then combining these two steps, we would be able to obtain one observation from the new distribution created by the PM operator. Consequently, simulated methods of inferences offer alternative methods to inferences methods based on matching selected points of the empirical pgf with its model counterpart or other related methods, see Doray et al. [<xref ref-type="bibr" rid="scirp.82716-ref9">9</xref>] for regression methods using selected points of the pgfs. For these methods there is some arbitrariness on the choice of points which make it difficult to apply. The techniques of using a continuum number of points to match are more involved numerically, see Carrasco and Florens [<xref ref-type="bibr" rid="scirp.82716-ref10">10</xref>] . The new methods also avoid the arbitrariness of the choice of points which is needed for the regression methods and the k-L procedures as proposed by Feurverger and McDunnough [<xref ref-type="bibr" rid="scirp.82716-ref11">11</xref>] if characteristic functions are used instead of probability generating functions and they are more robust than methods based on matching moments (MM) in general. We can reach the same conclusions for another class of distributions namely mixture distributions created by other mixing mechanisms, see Klugman et al. [<xref ref-type="bibr" rid="scirp.82716-ref4">4</xref>] , Nadarajah and Kotz [<xref ref-type="bibr" rid="scirp.82716-ref12">12</xref>] , Nadarajah and Kotz [<xref ref-type="bibr" rid="scirp.82716-ref13">13</xref>] . These distributions might not display closed form pmf or the pmf are only expressible only using special functions such as the confluent hypergeometric functions. For these models, likelihood methods might also be difficult to implement.</p><p>This leads us to look for alternative methods such as the simulated minimum Hellinger distance (SMHD) methods for count data. We shall consider grouped count data and ungrouped count data. With grouped data, it leads to simulated chi-square type statistics which can be used for model testing for discrete or continuous models. These statistics are similar to the traditional Pearson statistics. For model testing with continuous distributions, continuous observations when grouped into intervals are reduced to count data and we do not need to integrate the model density functions on intervals using SMHD methods, it suffices to simulate from the continuous model and construct sample distribution functions to obtain estimate interval probabilities. Therefore, the scopes of applications of simulated methods are widened due to these features.</p><p>We briefly describe the classical minimum Hellinger distance methods introduced by Simpson [<xref ref-type="bibr" rid="scirp.82716-ref14">14</xref>] , Simpson [<xref ref-type="bibr" rid="scirp.82716-ref15">15</xref>] for estimation for count data in the next section and we shall develop inference methods based on a simulated version of this HD distance following Pakes and Pollard [<xref ref-type="bibr" rid="scirp.82716-ref16">16</xref>] (1989), who have developed an elegant asymptotic theory for estimators obtained by minimizing a simulated objective function expressible as the Euclidean norm of a random vector of functions. As an example, they have shown that the simulated minimum chi-square estimators without weight satisfy the regularity conditions for being consistent and have an asymptotic normal distribution, see Pakes and Pollard [<xref ref-type="bibr" rid="scirp.82716-ref16">16</xref>] (p1048). They work with properties of some special classes of sets to check the regularity conditions of their Theorem 3.3. Meanwhile, Newey and McFadden [<xref ref-type="bibr" rid="scirp.82716-ref17">17</xref>] (p2187) work with properties of random functions and introduce a stochastic version of the classical equicontinuity property of real analysis. In this paper, we shall also extend the notion of continuity of real analysis to a version which only holds in probability for random functions which we call continuity in probability for a sequence of random functions which is similar to the notion of continuity with probability one as discussed by Newey and McFadden [<xref ref-type="bibr" rid="scirp.82716-ref17">17</xref>] (p2132) in their Theorem 2.6. We also use the property of the compact domains under considerations shrink as the sample size n → ∞ to verify conditions of Theorem 3.3 given by Pakes and Pollard [<xref ref-type="bibr" rid="scirp.82716-ref16">16</xref>] (1989) for SMHD methods using grouped data and conditions of Theorem 7.1 of Newey and McFadden [<xref ref-type="bibr" rid="scirp.82716-ref17">17</xref>] (p2185) for ungrouped data. This approach appears to be new and simpler that other approaches which have been used in the literature to establish asymptotic normality for estimators using simulations; previous approaches are very general but they are also more complicated to apply. A similar notion of continuity in probability has been introduced in the literature of stochastic processes.</p><p>It is worth to mention that simulated methods of inferences are relatively recent. In advanced econometrics textbook such as the book by Davidson and McKinnon [<xref ref-type="bibr" rid="scirp.82716-ref18">18</xref>] , only section 9.6 is devoted to simulated methods of inferences where the authors mention simulated methods of moments (MSM). The simulated version for HD methods will be referred to as version S and the original version which is deterministic will be referred to as version D in this paper. We briefly review the Hellinger distance and chi-square distance below and subsequently develop simulated inference methods for grouped and ungrouped count data using HD distance.</p></sec></sec><sec id="s1_3"><title>1.3. Hellinger and Chi-Square Distance Estimation</title><p>Assume that we have a random sample of n independent and identically distributed</p><p>(iid) nonnegative observations X 1 , ⋯ , X n from a pmf p θ ( x ) with x = 0 , 1 , ⋯ and</p><p>θ = ( θ 1 , ⋯ , θ m ) ′</p><p>is the vector of parameters of interest, θ 0 is the vector of the true parameters. If the data are grouped into r = k + 1 disjoint intervals <inline-formula><inline-graphic xlink:href="/html.scirp.org/file/12-1241044x61.png" xlink:type="simple"/></inline-formula> so that they form a partition of the nonnegative real line, the unweighted chi-square distance is defined to be</p><p><inline-formula><inline-graphic xlink:href="/html.scirp.org/file/12-1241044x62.png" xlink:type="simple"/></inline-formula>,</p><p>where <inline-formula><inline-graphic xlink:href="/html.scirp.org/file/12-1241044x63.png" xlink:type="simple"/></inline-formula> is the proportion of the sample which fall into the interval <inline-formula><inline-graphic xlink:href="/html.scirp.org/file/12-1241044x64.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="/html.scirp.org/file/12-1241044x65.png" xlink:type="simple"/></inline-formula> is the probability of an observation which fall into <inline-formula><inline-graphic xlink:href="/html.scirp.org/file/12-1241044x66.png" xlink:type="simple"/></inline-formula> under the pmf<inline-formula><inline-graphic xlink:href="/html.scirp.org/file/12-1241044x67.png" xlink:type="simple"/></inline-formula>. If <inline-formula><inline-graphic xlink:href="/html.scirp.org/file/12-1241044x68.png" xlink:type="simple"/></inline-formula> has no closed form expression but we can draw a sample of size <inline-formula><inline-graphic xlink:href="/html.scirp.org/file/12-1241044x69.png" xlink:type="simple"/></inline-formula> from this distribution then clearly <inline-formula><inline-graphic xlink:href="/html.scirp.org/file/12-1241044x70.png" xlink:type="simple"/></inline-formula> can be estimated</p><p>by <inline-formula><inline-graphic xlink:href="/html.scirp.org/file/12-1241044x71.png" xlink:type="simple"/></inline-formula> using the simulated sample of size U which is the proportion of observations of the simulated sample which has taken a value in<inline-formula><inline-graphic xlink:href="/html.scirp.org/file/12-1241044x72.png" xlink:type="simple"/></inline-formula>. To illustrate their theory Pake and Pollard [<xref ref-type="bibr" rid="scirp.82716-ref16">16</xref>] (p1047-1048) considered simulated estimators obtained by minimizing with respect to <inline-formula><inline-graphic xlink:href="/html.scirp.org/file/12-1241044x73.png" xlink:type="simple"/></inline-formula> the objective function</p><disp-formula id="scirp.82716-formula3"><graphic  xlink:href="//html.scirp.org/file/12-1241044x74.png"  xlink:type="simple"/></disp-formula><p>and show that the estimators satisfy the regularity conditions of their Theorem 3.1 and 3.3 which lead to conclude that the simulated estimators are consistent and have an asymptotic normal distribution. As we already know, a weighted version can be more efficient, if we attempt a version S for the Pearson’s chi square distance,</p><p><inline-formula><inline-graphic xlink:href="/html.scirp.org/file/12-1241044x75.png" xlink:type="simple"/></inline-formula>,</p><p>and since the denominator of the summand involves<inline-formula><inline-graphic xlink:href="/html.scirp.org/file/12-1241044x76.png" xlink:type="simple"/></inline-formula>, it is numerically not easy to introduce a version S. Clearly, if<inline-formula><inline-graphic xlink:href="/html.scirp.org/file/12-1241044x77.png" xlink:type="simple"/></inline-formula>, the version S of this</p><p>distance will run into numerical difficulties. The traditional and deterministic version of the Hellinger distance as given by</p><disp-formula id="scirp.82716-formula4"><label>(1)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x78.png"  xlink:type="simple"/></disp-formula><p>is more appropriate for a version S and it is already known that it generates minimum HD estimators which are as efficient as the minimum chi-square estimators or maximum likelihood (ML) estimators for grouped data, see</p><p>Cressie-Read divergence measure with <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x79.png" xlink:type="simple"/></inline-formula> given by Cressie and Read [<xref ref-type="bibr" rid="scirp.82716-ref19">19</xref>] (p457) for version D.</p><p>Note that <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x80.png" xlink:type="simple"/></inline-formula> and by using Cauchy-Schwartz inequality, we have</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x81.png" xlink:type="simple"/></inline-formula>,</p><p>so that <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x82.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x82.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x83.png" xlink:type="simple"/></inline-formula> remains always bounded. Therefore the objective function for version S can be defined as</p><disp-formula id="scirp.82716-formula5"><label>. (2)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x84.png"  xlink:type="simple"/></disp-formula><p>Since the objective function remains bounded and this property continues to hold for the ungrouped data case, this suggests that SMHD methods could preserve some of the nice robustness properties of version D.</p><p>For ungrouped data, it is equivalent to have grouped data but using intervals with unit length <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x85.png" xlink:type="simple"/></inline-formula> and the number of classes is infinite, we shall develop SMHD estimation which is based on the objective function</p><disp-formula id="scirp.82716-formula6"><label>. (3)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x86.png"  xlink:type="simple"/></disp-formula><p>Note that for a data set the sum given by the RHS of the above expression only has a finite number of terms as <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x87.png" xlink:type="simple"/></inline-formula> when j is large.</p><p>The version D with</p><disp-formula id="scirp.82716-formula7"><label>(4)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x88.png"  xlink:type="simple"/></disp-formula><p>has been investigated by Simpson [<xref ref-type="bibr" rid="scirp.82716-ref14">14</xref>] , Simpson [<xref ref-type="bibr" rid="scirp.82716-ref15">15</xref>] who also shows that the MHD estimators have a high breakdown point of at least 50% and first order as efficient as the ML estimators. For the Poisson case, the ML estimator is the sample mean which has a zero breakdown point and consequently far less robust than the HD estimators, yet the HD estimators are first order as efficient as the ML estimators. This feature makes HD estimators attractive. For the notion of finite sample break down point as a measure of robustness, see Hogg et al. [<xref ref-type="bibr" rid="scirp.82716-ref20">20</xref>] (p594-595), Kloke and McKean [<xref ref-type="bibr" rid="scirp.82716-ref21">21</xref>] (p29) and for the notion of asymptotic breakdown point for large samples, see Maronna et al. [<xref ref-type="bibr" rid="scirp.82716-ref22">22</xref>] (p58).</p><p>Simpson [<xref ref-type="bibr" rid="scirp.82716-ref14">14</xref>] , Simpson [<xref ref-type="bibr" rid="scirp.82716-ref15">15</xref>] extended the works of Beran [<xref ref-type="bibr" rid="scirp.82716-ref23">23</xref>] for continuous distributions to discrete distributions. Beran [<xref ref-type="bibr" rid="scirp.82716-ref23">23</xref>] appears to be the first to introduce a weaker form of robustness not based on bounded influence function and shows that efficiency can be achieved for robust estimators not based on influence functions. Also, see Lindsay [<xref ref-type="bibr" rid="scirp.82716-ref24">24</xref>] for discussions on robustness of Hellinger distance estimators. Simulated versions extending some of the seminal works of Simpson will be introduced in this paper.</p><p>SMHD methods appear to be useful for actuarial studies when there is a need for fitting discrete risk models, see chapter 9 of Panjer and Willmott [<xref ref-type="bibr" rid="scirp.82716-ref3">3</xref>] (p292-238) for fitting discrete risk models using ML methods. The SMHD methods appear to be useful for other fields as well especially when there is a need to analyze count data with efficiency and robustness but the pmfs of the models do not have closed form expressions. For minimizing the objective functions to obtain SMHD estimators, simplex derivative free algorithm can be used and the R package already has built in functions to implement these minimization procedures.</p></sec><sec id="s1_4"><title>1.4. Outlines of the paper</title><p>In this paper, we develop unified simulated methods of inferences for grouped and ungrouped count data using HD distances and it is organized as follows. Asymptotic properties for SMHD methods are developed in Section 2 where consistency and asymptotic normality are shown in section 2.2. Based on asymptotic properties, consistency of the SMHD estimators hold in general but high efficiencies of SMHD estimators can only be guaranteed if the Fisher information matrix of the parametric exists, a situation which is similar to likelihood estimation. One can also viewed the estimators are fully efficient within the class of simulated estimators obtained with the model pmf being replaced by a simulated version. Chi-square goodness of fit test statistics are constructed in Section 2.3. For the ungrouped case, it can be seen as having grouped data but the number of intervals with unit length and the number of intervals is infinite, it is given in section 3 where the ungrouped SMHD estimators are shown to have good efficiencies. The breakdown point for the SMHD estimators remains</p><p>at least <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x89.png" xlink:type="simple"/></inline-formula> just as for the deterministic version. A limited simulation study is</p><p>included in section 4. First, we consider the Neymann type A distribution and compare the efficiencies of the SMHD estimators versus moment (MM) estimators, simulations results appear to confirm the theoretical results showing that the SMHD estimators are more efficient than the MM estimators based on matching the first two empirical moments with their model counterparts for a selected range of parameters. The Poisson distribution is considered next and the study shows that despite being less efficient than the ML estimator, the efficiency of the SMHD estimators remain high and the estimators are far more robust than the ML estimator in the presence of outliers just as in the deterministic case as shown by Simpson [<xref ref-type="bibr" rid="scirp.82716-ref14">14</xref>] (p805). More works are needed in this direction in general and for assessing the performance SMHD estimators and comparisons with the performances of other traditional estimators in various parametric models in finite samples.</p></sec></sec><sec id="s2"><title>2. SMHD Methods for Grouped data</title><sec id="s2_1"><title>2.1. Introduction</title><p>Pakes and Pollard [<xref ref-type="bibr" rid="scirp.82716-ref16">16</xref>] have developed a very elegant and general theory for establishing consistency and asymptotic normality of estimators obtained by minimizing the length of a random function taking values in an Euclidean space, i.e., by minimizing</p><disp-formula id="scirp.82716-formula8"><label>(5)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x90.png"  xlink:type="simple"/></disp-formula><p>or</p><disp-formula id="scirp.82716-formula9"><label>(6)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x91.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x92.png" xlink:type="simple"/></inline-formula> is a vector of random functions with values in a Euclidean space and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x92.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x93.png" xlink:type="simple"/></inline-formula> is the Euclidean norm and if <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x92.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x93.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x94.png" xlink:type="simple"/></inline-formula> is a matrix of finite dimension then</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x95.png" xlink:type="simple"/></inline-formula>. Their theory is summarized by their Theorem 3.1 and</p><p>Theorem 3.3 given in Pakes and Pollard [<xref ref-type="bibr" rid="scirp.82716-ref16">16</xref>] (p1038-1043). It is very general and it is clearly applicable for both versions D and S for Hellinger distance with grouped data. Let</p><disp-formula id="scirp.82716-formula10"><label>(7)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x96.png"  xlink:type="simple"/></disp-formula><p>and for HD distance, version D, let</p><disp-formula id="scirp.82716-formula11"><label>, (8)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x97.png"  xlink:type="simple"/></disp-formula><p>and for version S, let</p><disp-formula id="scirp.82716-formula12"><label>(9)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x98.png"  xlink:type="simple"/></disp-formula><p>which can be reexpressed as</p><disp-formula id="scirp.82716-formula13"><label>. (10)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x99.png"  xlink:type="simple"/></disp-formula><p>In general, the intervals<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x100.png" xlink:type="simple"/></inline-formula>’s form a partition of the nonnegative real line <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x100.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x101.png" xlink:type="simple"/></inline-formula></p><p>with<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x102.png" xlink:type="simple"/></inline-formula>. Only in section (2.3) where we want to test goodness of fit</p><p>for continuous distribution with support of the entire real line used in financial</p><p>study, we might let<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x103.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x103.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x104.png" xlink:type="simple"/></inline-formula>is the real line.</p><p>Let<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x105.png" xlink:type="simple"/></inline-formula>, the vector</p><p>of the true parameters is denoted by<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x106.png" xlink:type="simple"/></inline-formula>, the parameter space <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x106.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x107.png" xlink:type="simple"/></inline-formula> is assumed to be compact. Clearly, we have point wise convergence in probability with <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x106.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x107.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x108.png" xlink:type="simple"/></inline-formula> for each <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x106.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x107.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x108.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x109.png" xlink:type="simple"/></inline-formula> for both versions, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x106.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x107.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x108.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x109.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x110.png" xlink:type="simple"/></inline-formula>is nonrandom. Clearly the set up fits into the scopes of their Theorem 3.1 and 3.3 which we shall rearrange the results of these two theorems before applying to version D and version S of Hellinger distance inferences and verify that we can satisfy the regularity conditions of these two Theorems.</p></sec><sec id="s2_2"><title>2.2. Asymptotic properties</title><sec id="s2_2_1"><title>2.2.1. Consistency</title><p>We define MHD estimators as given by the vector <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x111.png" xlink:type="simple"/></inline-formula> for version D and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x111.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x112.png" xlink:type="simple"/></inline-formula> for version S but emphasize version S as version D has been studied by Simpson [<xref ref-type="bibr" rid="scirp.82716-ref14">14</xref>] . Both versions can be treated in a unified way using the following Theorem 1 for consistency which is essentially Theorem 3.1 of Pakes and Pollard [<xref ref-type="bibr" rid="scirp.82716-ref16">16</xref>] (p1038) and the proof has been given by the authors.</p><p>Theorem 1 (Consistency)</p><p>Under the following conditions <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x113.png" xlink:type="simple"/></inline-formula> converges in probability to<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x113.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x114.png" xlink:type="simple"/></inline-formula>:</p><p>a)<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x115.png" xlink:type="simple"/></inline-formula>, the parameter space Ω is compact</p><p>b)<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x116.png" xlink:type="simple"/></inline-formula>,</p><p>c) <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x117.png" xlink:type="simple"/></inline-formula>for each<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x117.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x118.png" xlink:type="simple"/></inline-formula>.</p><p>Theorem 3.1 states condition b) as <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x119.png" xlink:type="simple"/></inline-formula> but in the proof the authors just use <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x119.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x120.png" xlink:type="simple"/></inline-formula> so we state condition b) as <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x119.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x120.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x121.png" xlink:type="simple"/></inline-formula> as it is easier to use this condition when there is a need to extend to the infinite dimensional case with the space<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x119.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x120.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x121.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x122.png" xlink:type="simple"/></inline-formula>.</p><p>An expression is <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x123.png" xlink:type="simple"/></inline-formula> if it converges to 0 in probability and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x123.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x124.png" xlink:type="simple"/></inline-formula> if it is bounded in probability. In version D and version S for Hellinger distance we have <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x123.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x124.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x125.png" xlink:type="simple"/></inline-formula> occurs at the values of the vector values of the HD estimators, so the conditions a) and b) are satisfied for both versions and compactness of the parameter space Ω is assumed. Also, for both versions <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x123.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x124.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x125.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x126.png" xlink:type="simple"/></inline-formula> only at <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x123.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x124.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x125.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x126.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x127.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x123.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x124.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x125.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x126.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x127.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x128.png" xlink:type="simple"/></inline-formula> otherwise, this implies that there exist real numbers u and v with <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x123.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x124.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x125.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x126.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x127.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x128.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x129.png" xlink:type="simple"/></inline-formula> such that</p><disp-formula id="scirp.82716-formula14"><graphic  xlink:href="//html.scirp.org/file/12-1241044x130.png"  xlink:type="simple"/></disp-formula><p>Therefore, for both versions of <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x131.png" xlink:type="simple"/></inline-formula> whether deterministic or simulated, the minimum Hellinger distance estimators (MHD) are consistent. Theorem 3.1 of Pakes and Pollard [<xref ref-type="bibr" rid="scirp.82716-ref16">16</xref>] is an elegant theorem, its proof is also concise using the norm concept of functional analysis and it allows many results to be unified. Essentially, the same theorem remains valid with the use of the Hilbert space <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x131.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x132.png" xlink:type="simple"/></inline-formula> and its norm instead of the Euclidean space <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x131.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x132.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x133.png" xlink:type="simple"/></inline-formula> and the Euclidean norm. By using <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x131.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x132.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x133.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x134.png" xlink:type="simple"/></inline-formula> and its norm the consistency for the ungrouped SMHD estimators can also be established but further asymptotic results for the ungrouped SMHD estimators will be postponed and given in Section 3.</p><p>Asymptotic normality is more complicated in general. For the grouped case, Theorem 3.3 given by Pakes and Pollard [<xref ref-type="bibr" rid="scirp.82716-ref16">16</xref>] (p1040) can be used to establish asymptotic normality for both versions of Hellinger distance estimators. We shall rearrange results of Theorem 3.3 under Theorem 2 and Corollary 1 given in the next section to make it easier to apply for HD estimation using both versions.</p><p>Since the proofs have been given by the authors, we only discuss here the ideas of their proofs to make it easier to follow the results of Theorem 2 and Corollary 1 in Section (2.2.2).</p><p>For both versions, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x135.png" xlink:type="simple"/></inline-formula>but <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x135.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x136.png" xlink:type="simple"/></inline-formula> is</p><p>not differentiable for version S, the traditional Taylor expansion argument cannot be used to establish asymptotic normality of estimators obtained by minimizing<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x137.png" xlink:type="simple"/></inline-formula>. If we assume <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x137.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x138.png" xlink:type="simple"/></inline-formula> is differentiable with derivative matrix<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x137.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x138.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x139.png" xlink:type="simple"/></inline-formula>, then we can define the random function <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x137.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x138.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x139.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x140.png" xlink:type="simple"/></inline-formula> to approximate <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x137.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x138.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x139.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x140.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x141.png" xlink:type="simple"/></inline-formula> with</p><disp-formula id="scirp.82716-formula15"><label>. (11)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x142.png"  xlink:type="simple"/></disp-formula><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x143.png" xlink:type="simple"/></inline-formula>is based on expression (8) for version D and it is based on expressions (9-10) for version S. Note that <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x143.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x144.png" xlink:type="simple"/></inline-formula> is differentiable for both versions.</p><p>Let <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x145.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x145.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x146.png" xlink:type="simple"/></inline-formula> be the vectors which minimize <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x145.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x146.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x147.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x145.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x146.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x147.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x148.png" xlink:type="simple"/></inline-formula> respectively. If the approximation is of the right order then <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x145.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x146.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x147.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x148.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x149.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x145.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x146.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x147.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x148.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x149.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x150.png" xlink:type="simple"/></inline-formula> are asymptotically equivalent. This set up will allow a unified approach for establishing asymptotic for MHD estimation for both versions. For version D, it suffices to let <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x145.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x146.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x147.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x148.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x149.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x150.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x151.png" xlink:type="simple"/></inline-formula> and for version S, let<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x145.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x146.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x147.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x148.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x149.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x150.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x151.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x152.png" xlink:type="simple"/></inline-formula>.</p><p>Under these circumstances, it suffices to work with <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x153.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x153.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x154.png" xlink:type="simple"/></inline-formula> for asymptotic properties of <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x153.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x154.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x155.png" xlink:type="simple"/></inline-formula> and<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x153.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x154.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x155.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x156.png" xlink:type="simple"/></inline-formula>. A regularity condition for the approximation is of the right order which implies the condition (iii) given by their Theorem 3.3, which is the most difficult to check is given as</p><disp-formula id="scirp.82716-formula16"><label>. (12)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x157.png"  xlink:type="simple"/></disp-formula><p>This condition is used to formulate Theorem 2 below and is slightly more stringent than the condition iii) of their Theorem 3.3 but it is less technical and sufifcient for SMHD estimation. Clearly, for SMHD estimation <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x158.png" xlink:type="simple"/></inline-formula> is as given by expression (9) or expression (10). For simulated unweighted simulated minimum chi-square estimation for this condition to hold, independent samples for each <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x158.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x159.png" xlink:type="simple"/></inline-formula> cannot be used, see Pakes and Pollard [<xref ref-type="bibr" rid="scirp.82716-ref16">16</xref>] (p1048). Otherwise, only consistency can be guaranteed for estimators using version S. For version S, the simulated samples are assumed to have size <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x158.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x159.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x160.png" xlink:type="simple"/></inline-formula> and the same seed is used across different values of <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x158.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x159.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x160.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x161.png" xlink:type="simple"/></inline-formula> to draw samples of size U. We implicitly make these assumptions for SMHD methods. These two assumption are standard for simulated methods of inferences, see section 9.6 for method of simulated moments(MSM) given by Davidson and McKinnon [<xref ref-type="bibr" rid="scirp.82716-ref19">19</xref>] (p383-394). For numerical optimization to find the minimum of the objective function<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x158.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x159.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x160.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x161.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x162.png" xlink:type="simple"/></inline-formula>, we rely on direct search simplex methods which are derivative free and the R package already has prewritten functions to implement direct search methods.</p></sec><sec id="s2_2_2"><title>2.2.2. Asymptotic normality</title><p>In this section, we shall state a Theorem namely Theorem 2 which is essentially Theorem 3.3 by Pakes and Pollard [<xref ref-type="bibr" rid="scirp.82716-ref16">16</xref>] (p1040-1043) with the condition (4) of Theorem 2 given by expression (9) replacing their condition (iii) in their Theorem 3.3, the condition (4) implies the condition (iii) by being more stringent. We also comment on the conditions needed to verify asymptotic normality for the HD estimators based on Theorem 2.</p><p>Theorem 2</p><p>Let <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x163.png" xlink:type="simple"/></inline-formula> be a vector of consistent estimators for<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x163.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x164.png" xlink:type="simple"/></inline-formula>, the unique vector which satisfies<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x163.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x164.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x165.png" xlink:type="simple"/></inline-formula>.</p><p>Under the following conditions:</p><p>1) The parameter space Ω is compact, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x166.png" xlink:type="simple"/></inline-formula>is an interior point of Ω.</p><p>2)<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x167.png" xlink:type="simple"/></inline-formula>.</p><p>3) <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x168.png" xlink:type="simple"/></inline-formula>is differentiable at <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x168.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x169.png" xlink:type="simple"/></inline-formula> with a derivative matrix <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x168.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x169.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x170.png" xlink:type="simple"/></inline-formula> of full rank.</p><p>4) <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x171.png" xlink:type="simple"/></inline-formula>for every sequence <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x171.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x172.png" xlink:type="simple"/></inline-formula> of positive numbers which converge to zero.</p><p>5)<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x173.png" xlink:type="simple"/></inline-formula>.</p><p>6) <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x174.png" xlink:type="simple"/></inline-formula>is an interior point of the parameter space Ω.</p><p>Then, we have the following representation which will give the asymptotic distribution of <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x175.png" xlink:type="simple"/></inline-formula> in Corollary 1, i.e.,</p><disp-formula id="scirp.82716-formula17"><label>, (13)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x176.png"  xlink:type="simple"/></disp-formula><p>or equivalently, using equality in distribution,</p><disp-formula id="scirp.82716-formula18"><label>. (14)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x177.png"  xlink:type="simple"/></disp-formula><p>The proofs of these results follow from the results used to prove Theorem 3.3 given by Pakes and Pollard [<xref ref-type="bibr" rid="scirp.82716-ref16">16</xref>] (p1040-1043). For expression (13) or expression (14) to hold, in general only condition 5) of Theorem 2 is needed and there is no need to assume that <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x178.png" xlink:type="simple"/></inline-formula> has an asymptotic distribution. From the results of Theorem 2, it is easy to see that we can obtain the main result of the following Corollary 1 which gives the asymptotic covariance matrix for the HD estimators for both versions.</p><p>Corollary 1.</p><p>Let<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x179.png" xlink:type="simple"/></inline-formula>, if <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x179.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x180.png" xlink:type="simple"/></inline-formula> then <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x179.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x180.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x181.png" xlink:type="simple"/></inline-formula> with</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x182.png" xlink:type="simple"/></inline-formula>,</p><p>The matrices <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x183.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x183.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x184.png" xlink:type="simple"/></inline-formula> depend on <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x183.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x184.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x185.png" xlink:type="simple"/></inline-formula>we also adopt the notations<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x183.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x184.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x185.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x186.png" xlink:type="simple"/></inline-formula>,<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x183.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x184.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x185.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x186.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x187.png" xlink:type="simple"/></inline-formula>.</p><p>We observe that condition 4) of Theorem 2 when applies to Hellinger distance or in general involve technicalities. The condition 4) holds for version D, we only need to verify for version S. Note that to verify the condition 4, it is equivalent to verify</p><disp-formula id="scirp.82716-formula19"><graphic  xlink:href="//html.scirp.org/file/12-1241044x188.png"  xlink:type="simple"/></disp-formula><p>and for version S of Hellinger distance estimation, let</p><disp-formula id="scirp.82716-formula20"><graphic  xlink:href="//html.scirp.org/file/12-1241044x189.png"  xlink:type="simple"/></disp-formula><p>and for the grouped case, it is given by</p><disp-formula id="scirp.82716-formula21"><label>. (15)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x190.png"  xlink:type="simple"/></disp-formula><p>We need to verify that we have the sequence of functions <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x191.png" xlink:type="simple"/></inline-formula> converge uniformly to 0 in probability as <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x191.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x192.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x191.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x192.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x193.png" xlink:type="simple"/></inline-formula> or equivalently, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x191.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x192.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x193.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x194.png" xlink:type="simple"/></inline-formula> as <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x191.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x192.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x193.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x194.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x195.png" xlink:type="simple"/></inline-formula> and<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x191.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x192.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x193.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x194.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x195.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x196.png" xlink:type="simple"/></inline-formula>.</p><p>Note that</p><disp-formula id="scirp.82716-formula22"><graphic  xlink:href="//html.scirp.org/file/12-1241044x197.png"  xlink:type="simple"/></disp-formula><p>We shall outline the approach by first defining the notion of continuity in probability and let <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x198.png" xlink:type="simple"/></inline-formula> which is a compact set. The compactness of this set simplifies proofs and does not appear to be used in previous approaches in the literature. Observe that<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x198.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x199.png" xlink:type="simple"/></inline-formula>, it is easy to see that</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x200.png" xlink:type="simple"/></inline-formula>as<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x200.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x201.png" xlink:type="simple"/></inline-formula>. Subsequently we establish <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x200.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x201.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x202.png" xlink:type="simple"/></inline-formula> being continuous in probability for <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x200.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x201.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x202.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x203.png" xlink:type="simple"/></inline-formula> and using the property that <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x200.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x201.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x202.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x203.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x204.png" xlink:type="simple"/></inline-formula> is continuous in probability <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x200.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x201.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x202.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x203.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x204.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x205.png" xlink:type="simple"/></inline-formula> is attained at a point <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x200.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x201.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x202.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x203.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x204.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x205.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x206.png" xlink:type="simple"/></inline-formula> which belongs to the compact set <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x200.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x201.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x202.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x203.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x204.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x205.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x206.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x207.png" xlink:type="simple"/></inline-formula> in probability. This is similar to the property of nonrandom continuous function in real analysis.</p><p>Now as <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x208.png" xlink:type="simple"/></inline-formula> which implies <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x208.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x209.png" xlink:type="simple"/></inline-formula> and by continuity in probability<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x208.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x209.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x210.png" xlink:type="simple"/></inline-formula>. Therefore, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x208.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x209.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x210.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x211.png" xlink:type="simple"/></inline-formula>which means that <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x208.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x209.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x210.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x211.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x212.png" xlink:type="simple"/></inline-formula> converges uniformly in probability as<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x208.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x209.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x210.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x211.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x212.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x213.png" xlink:type="simple"/></inline-formula>. The technical</p><p>details of these arguments are given in technical appendices TA1.1 and TA1.2 at the end of the paper, in the section of Appendices.</p><p>The notion of continuity in probability has been used in a similar context in the literature of stochastic processes, see Gusalk et al. [<xref ref-type="bibr" rid="scirp.82716-ref25">25</xref>] and will be introduced in the next paragraph and we also make a few assumptions which are summarized by Assumption 1 and Assumption 2 given below along with the notion of continuity in probability. A related continuity notion namely the notion of continuity with probability one has been mentioned by Newey and McFadden [<xref ref-type="bibr" rid="scirp.82716-ref18">18</xref>] in their Theorem 2.6 as mentioned earlier. They also commented that this notion can be used for establishing asymptotic properties of simulated estimators introduced by Pakes [<xref ref-type="bibr" rid="scirp.82716-ref26">26</xref>] . Pakes [<xref ref-type="bibr" rid="scirp.82716-ref26">26</xref>] also has used pseudo random numbers to estimate probability frequencies for some models. For SMHD estimation, we extend a standard result of analysis which states that a continuous function attains its supremum on a compact set to a version which holds in probability. This approach seems to be new and simpler than the use of the more general stochastic equicontinuity condition given by section 2.2 in Newey and McFadden [<xref ref-type="bibr" rid="scirp.82716-ref18">18</xref>] (p2136-2138) to establish uniform convergence of a sequence of random functions in probability. Our approach uses the fact that as <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x214.png" xlink:type="simple"/></inline-formula> the set <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x214.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x215.png" xlink:type="simple"/></inline-formula> shrinks to<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x214.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x215.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x216.png" xlink:type="simple"/></inline-formula>, a property which did not seem to have been</p><p>used previously by other approaches to establish <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x217.png" xlink:type="simple"/></inline-formula> as</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x218.png" xlink:type="simple"/></inline-formula>and<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x218.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x219.png" xlink:type="simple"/></inline-formula>. Subsequently, we define the notion of continuity in probability which is similar to the one used in stochastic processes, see Gusak et al. [<xref ref-type="bibr" rid="scirp.82716-ref25">25</xref>] (p33) for a related notion of continuity in probability for stochastic processes.</p><p>Definition 1 (Continuity in probability)</p><p>A sequence of random functions <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x220.png" xlink:type="simple"/></inline-formula> is continuous in probability at <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x220.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x221.png" xlink:type="simple"/></inline-formula> if <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x220.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x221.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x222.png" xlink:type="simple"/></inline-formula> whenever<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x220.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x221.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x222.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x223.png" xlink:type="simple"/></inline-formula>. Equivalently, for any<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x220.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x221.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x222.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x223.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x224.png" xlink:type="simple"/></inline-formula>, there exists a <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x220.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x221.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x222.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x223.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x224.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x225.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x220.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x221.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x222.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x223.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x224.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x225.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x226.png" xlink:type="simple"/></inline-formula> such that <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x220.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x221.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x222.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x223.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x224.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x225.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x226.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x227.png" xlink:type="simple"/></inline-formula> for<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x220.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x221.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x222.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x223.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x224.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x225.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x226.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x227.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x228.png" xlink:type="simple"/></inline-formula>, whenever<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x220.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x221.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x222.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x223.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x224.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x225.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x226.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x227.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x228.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x229.png" xlink:type="simple"/></inline-formula>. This can be viewed as an extension of the classical</p><p>result of continuity in real analysis. It is also well known that the supremum of a continuous function on a compact domain is attained at a point of the compact domain, see Davidson and Donsig [<xref ref-type="bibr" rid="scirp.82716-ref27">27</xref>] (p81) or Rudin [<xref ref-type="bibr" rid="scirp.82716-ref28">28</xref>] (p89) for this classical result. The equivalent property for a random function which is only continuous in probability is the supremum of the random function is attained at a point of the compact domain in probability. The compact domain we study here</p><p>is given by <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x230.png" xlink:type="simple"/></inline-formula> and as<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x230.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x231.png" xlink:type="simple"/></inline-formula>,<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x230.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x231.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x232.png" xlink:type="simple"/></inline-formula>. It</p><p>might be more precise to use the term sequence of random functions rather than just random function here for the notion of continuity in probability as the random function will depend on n.</p><p>Below are the assumptions we need to make to establish asymptotic normality for SMHD estimators and they appear to be reasonable.</p><p>Assumption 1</p><p>1) The pmf of the parametric model has the continuity property with <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x233.png" xlink:type="simple"/></inline-formula> whenever<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x233.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x234.png" xlink:type="simple"/></inline-formula>.</p><p>2) The simulated counterpart has the continuity in probability property with <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x235.png" xlink:type="simple"/></inline-formula> whenever<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x235.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x236.png" xlink:type="simple"/></inline-formula>. Convergence in probability is denote by<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x235.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x236.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x237.png" xlink:type="simple"/></inline-formula>.</p><p>3) <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x238.png" xlink:type="simple"/></inline-formula>is differentiable with respect to<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x238.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x239.png" xlink:type="simple"/></inline-formula>.</p><p>In general, the condition 2) will be satisfied if the condition 1) holds and implicitly we assume the same seed is used for obtaining the simulated samples across different values of<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x240.png" xlink:type="simple"/></inline-formula>. For ungrouped data, we also need the notion of differentiability in probability to facilitate the application of Theorem 7.1 given by Newey and McFadden (1994, p2185-2186). Before stating their Theorem 7.1, Newey and McFadden has mentioned the notion of approximate derivative for the use of their Theorem, the definition given below will make it clearer.</p><p>Definition 2 (Differentiability in probability)</p><p>The sequence of random functions <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x241.png" xlink:type="simple"/></inline-formula> is differentiable with respect to <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x241.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x242.png" xlink:type="simple"/></inline-formula> at <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x241.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x242.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x243.png" xlink:type="simple"/></inline-formula> in probability if<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x241.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x242.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x243.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x244.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x241.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x242.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x243.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x244.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x245.png" xlink:type="simple"/></inline-formula>exists and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x241.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x242.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x243.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x244.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x245.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x246.png" xlink:type="simple"/></inline-formula> with 1 occurring at the ith entry. Furthermore, the vector <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x241.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x242.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x243.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x244.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x245.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x246.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x247.png" xlink:type="simple"/></inline-formula> is continuous and bounded in probability for all <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x241.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x242.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x243.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x244.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x245.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x246.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x247.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x248.png" xlink:type="simple"/></inline-formula> for some<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x241.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x242.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x243.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x244.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x245.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x246.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x247.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x248.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x249.png" xlink:type="simple"/></inline-formula>. This concept is similar to the notion of</p><p>differentiability in real analysis for nonrandom function.</p><p>A similar notion of differentiability in probability has been used in stochastic processes literature, see Gusak et al. [<xref ref-type="bibr" rid="scirp.82716-ref25">25</xref>] (p33-34), a more stringent differentiability notion namely differentiability in quadratic mean has also been used to study local asymptotic normality (LAN) property for a parametric family, see Keener [<xref ref-type="bibr" rid="scirp.82716-ref29">29</xref>] (p326). The notion of differentiability in probability will be used in section 3 with Theorem 7.1 of Newey and McFadden [<xref ref-type="bibr" rid="scirp.82716-ref17">17</xref>] to establish asymptotic normality for the SMHD estimators for the ungrouped case. We make the</p><p>following assumption for <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x250.png" xlink:type="simple"/></inline-formula> where <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x250.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x251.png" xlink:type="simple"/></inline-formula> can be viewed as a proxy model for<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x250.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x251.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x252.png" xlink:type="simple"/></inline-formula>,</p><p>Assumption 2</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x253.png" xlink:type="simple"/></inline-formula>with the same seed being used across different values of <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x253.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x254.png" xlink:type="simple"/></inline-formula> is differentiable in probability with the same derivative vector as <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x253.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x254.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x255.png" xlink:type="simple"/></inline-formula> where the derivative vector for <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x253.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x254.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x255.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x256.png" xlink:type="simple"/></inline-formula> is</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x257.png" xlink:type="simple"/></inline-formula>.</p><p>This assumption appears to be reasonable, this can be checked by using limit operations as in real analysis with <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x258.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x258.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x259.png" xlink:type="simple"/></inline-formula> is continuous in probability.</p><p>Since regularity conditions for Theorem 2 and its corollary can be met and they are justified in TA1.1 and TA1.2 in the Appendices, we proceed here to find the asymptotic covariance matrix<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x260.png" xlink:type="simple"/></inline-formula>.</p><p>Since <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x261.png" xlink:type="simple"/></inline-formula> for version D is based on expression (8) and for version S is based on expressions (9-10), the asymptotic covariance matrix of <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x261.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x262.png" xlink:type="simple"/></inline-formula> version S is just the asymptotic covariance matrix of <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x261.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x262.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x263.png" xlink:type="simple"/></inline-formula> of version D multiplied by <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x261.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x262.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x263.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x264.png" xlink:type="simple"/></inline-formula> as the simulated sample from <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x261.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x262.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x263.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x264.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x265.png" xlink:type="simple"/></inline-formula> is independent</p><p>from the sample given by the data, so we can focus on version D and make the adjustment for version S. We need the asymptotic covariance matrix <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x266.png" xlink:type="simple"/></inline-formula> of the</p><p>vector <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x267.png" xlink:type="simple"/></inline-formula> first then we can find the matrix <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x267.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x268.png" xlink:type="simple"/></inline-formula> and we let <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x267.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x268.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x269.png" xlink:type="simple"/></inline-formula> for version D and for version S, we shall let<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x267.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x268.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x269.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x270.png" xlink:type="simple"/></inline-formula>.</p><p>Recall that form properties of the multinomial distribution, the covariances of <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x271.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x271.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x272.png" xlink:type="simple"/></inline-formula> are</p><disp-formula id="scirp.82716-formula23"><graphic  xlink:href="//html.scirp.org/file/12-1241044x273.png"  xlink:type="simple"/></disp-formula><p>and</p><disp-formula id="scirp.82716-formula24"><graphic  xlink:href="//html.scirp.org/file/12-1241044x274.png"  xlink:type="simple"/></disp-formula><p>The covariance matrix of <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x275.png" xlink:type="simple"/></inline-formula> using matrix notations can be expressed as</p><disp-formula id="scirp.82716-formula25"><label>, (16)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x276.png"  xlink:type="simple"/></disp-formula><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x277.png" xlink:type="simple"/></inline-formula>is a diagonal matrix with diagonal elements <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x277.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x278.png" xlink:type="simple"/></inline-formula> and the vector <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x277.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x278.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x279.png" xlink:type="simple"/></inline-formula> is the transpose of <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x277.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x278.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x279.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x280.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x277.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x278.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x279.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x280.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x281.png" xlink:type="simple"/></inline-formula> is the identity matrix of dimension <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x277.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x278.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x279.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x280.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x281.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x282.png" xlink:type="simple"/></inline-formula> with<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x277.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x278.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x279.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x280.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x281.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x282.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x283.png" xlink:type="simple"/></inline-formula>. Using the delta method the asymptotic covariance matrix of <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x277.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x278.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x279.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x280.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x281.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x282.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x283.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x284.png" xlink:type="simple"/></inline-formula> of version D is simply the asymptotic covariance matrix of <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x277.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x278.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x279.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x280.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x281.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x282.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x283.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x284.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x285.png" xlink:type="simple"/></inline-formula> which is given by</p><disp-formula id="scirp.82716-formula26"><label>, (17)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x286.png"  xlink:type="simple"/></disp-formula><p>and the asymptotic covariance matrix of<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x287.png" xlink:type="simple"/></inline-formula>, version S is</p><disp-formula id="scirp.82716-formula27"><label>. (18)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x288.png"  xlink:type="simple"/></disp-formula><p>We then have the vector of HD estimators version D and S given respectively by <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x289.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x289.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x290.png" xlink:type="simple"/></inline-formula> with asymptotic distributions given by</p><disp-formula id="scirp.82716-formula28"><graphic  xlink:href="//html.scirp.org/file/12-1241044x291.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.82716-formula29"><label>(19)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x292.png"  xlink:type="simple"/></disp-formula><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x293.png" xlink:type="simple"/></inline-formula>,</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x294.png" xlink:type="simple"/></inline-formula>is the model Fisher information matrix using grouped data as <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x294.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x295.png" xlink:type="simple"/></inline-formula> due to <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x294.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x295.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x296.png" xlink:type="simple"/></inline-formula> using<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x294.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x295.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x296.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x297.png" xlink:type="simple"/></inline-formula>. Let<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x294.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x295.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x296.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x297.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x298.png" xlink:type="simple"/></inline-formula>,</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x299.png" xlink:type="simple"/></inline-formula>,</p><p>so</p><disp-formula id="scirp.82716-formula30"><graphic  xlink:href="//html.scirp.org/file/12-1241044x300.png"  xlink:type="simple"/></disp-formula><p>with</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x301.png" xlink:type="simple"/></inline-formula>.</p><p>Therefore for version S,</p><disp-formula id="scirp.82716-formula31"><label>(20)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x302.png"  xlink:type="simple"/></disp-formula><p>the simulated sample size is<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x303.png" xlink:type="simple"/></inline-formula>.</p><p>Note that for version D, the HD estimators are as efficient as the minimum chi-square estimators or ML estimators based on grouped data. The overall asymptotic relative efficiency (ARE) between version D and S for HD estimation is</p><p>simply ARE = <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x304.png" xlink:type="simple"/></inline-formula> and we recommend to set <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x304.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x305.png" xlink:type="simple"/></inline-formula> to minimize the loss of efficiency due to simulations.</p><p>An estimate for the covariance matrix</p><p>The asymptotic covariance matrix of <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x306.png" xlink:type="simple"/></inline-formula> can be estimated if we can estimate<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x306.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x307.png" xlink:type="simple"/></inline-formula>. Using a result given by Pakes and Pollard (1989, p1043), an estimate for <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x306.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x307.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x308.png" xlink:type="simple"/></inline-formula> is the matrix</p><disp-formula id="scirp.82716-formula32"><label>, (21)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x309.png"  xlink:type="simple"/></disp-formula><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x310.png" xlink:type="simple"/></inline-formula>with 1 occurring at the ith entry of the vector <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x310.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x311.png" xlink:type="simple"/></inline-formula> and<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x310.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x311.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x312.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x310.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x311.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x312.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x313.png" xlink:type="simple"/></inline-formula>and in general we can let<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x310.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x311.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x312.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x313.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x314.png" xlink:type="simple"/></inline-formula>. Note that the columns of <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x310.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x311.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x312.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x313.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x314.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x315.png" xlink:type="simple"/></inline-formula> estimate the corresponding partial derivatives given by the columns of .</p><p>For ungrouped data and for version D, it is equivalent to choose <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x316.png" xlink:type="simple"/></inline-formula> with unit length and let<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x316.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x317.png" xlink:type="simple"/></inline-formula>. If we choose <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x316.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x317.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x318.png" xlink:type="simple"/></inline-formula> and let <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x316.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x317.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x318.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x319.png" xlink:type="simple"/></inline-formula> and note that <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x316.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x317.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x318.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x319.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x320.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x316.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x317.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x318.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x319.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x320.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x321.png" xlink:type="simple"/></inline-formula> the is Fisher information matrix for ungrouped data with elements given by</p><disp-formula id="scirp.82716-formula33"><label>(22)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x322.png"  xlink:type="simple"/></disp-formula><p>and<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x323.png" xlink:type="simple"/></inline-formula>. We can foresee that the HD estimators are as efficient as ML estimators for version D, a result which is already obtained by Simpson [<xref ref-type="bibr" rid="scirp.82716-ref14">14</xref>] . We postpone till section (3) for a more rigorous approach to justify the related result for version S using Theorem 7.1 given by Newey and McFadden [<xref ref-type="bibr" rid="scirp.82716-ref17">17</xref>] . The SMHD estimators given by <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x323.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x324.png" xlink:type="simple"/></inline-formula> for ungrouped data will be shown to have the property</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x325.png" xlink:type="simple"/></inline-formula>.</p><p>Section 3 may be skipped for practitioners if their main interests are only on applications of the results.</p></sec></sec><sec id="s2_3"><title>2.3. Chi-square Goodness of Fit test Statistics</title><sec id="s2_3_1"><title>2.3.1. Simple Hypothesis</title><p>In this section, the Hellinger distance <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x326.png" xlink:type="simple"/></inline-formula> is used to construct goodness of fit test statistics for the simple hypothesis</p><p>H<sub>0</sub>: data comes from a specified distribution with distribution<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x327.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x327.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x328.png" xlink:type="simple"/></inline-formula>can be the distribution of a discrete or continuous distribution. The chi-square test statistics and their asymptotic distributions are given below with</p><disp-formula id="scirp.82716-formula34"><label>(23)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x329.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.82716-formula35"><label>(24)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x330.png"  xlink:type="simple"/></disp-formula><p>The version S is of interest since it allows testing goodness of fit for discrete or continuous distribution without closed form pmfs or density functions, all we need is to be able to simulate from the specified distribution. We shall justify the asymptotic chi-square distributions given by expression (23) and expression (24) below.</p><p>Note that</p><disp-formula id="scirp.82716-formula36"><graphic  xlink:href="//html.scirp.org/file/12-1241044x331.png"  xlink:type="simple"/></disp-formula><p>and</p><disp-formula id="scirp.82716-formula37"><graphic  xlink:href="//html.scirp.org/file/12-1241044x332.png"  xlink:type="simple"/></disp-formula><p>for version D. For version S,</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x333.png" xlink:type="simple"/></inline-formula>.</p><p>Using standard results for distribution of quadratic forms and the property of the operator trace of a matrix with <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x334.png" xlink:type="simple"/></inline-formula>, see Luong and Thompson [<xref ref-type="bibr" rid="scirp.82716-ref30">30</xref>] (p247); we have the asymptotic chi-square distributions as given by expression (23) and expression (24). On how to choose the intervals, the problem is rather complex as it depends on the type of alternatives we would like to detect. We can also follow the recommendations of the Pearson’s statistics, see Greenwood and Nikulin [<xref ref-type="bibr" rid="scirp.82716-ref31">31</xref>] ; also see Lehmann [<xref ref-type="bibr" rid="scirp.82716-ref32">32</xref>] (p341) for more discussions and references on this issue.</p></sec><sec id="s2_3_2"><title>2.3.2. Composite hypothesis</title><p>Just as the chi-square distance, the Hellinger distance <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x335.png" xlink:type="simple"/></inline-formula> can also be used for construction of the test statistics for the composite hypothesis,</p><p>H<sub>0</sub>: data comes from a parametric model<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x336.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x336.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x337.png" xlink:type="simple"/></inline-formula>can be a discrete or continuous parametric model. The chi-square test statistics are given by</p><disp-formula id="scirp.82716-formula38"><label>, (25)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x338.png"  xlink:type="simple"/></disp-formula><p>for version D and for version S,</p><disp-formula id="scirp.82716-formula39"><label>(26)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x339.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x340.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x340.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x341.png" xlink:type="simple"/></inline-formula> are the vector of HD estimators which minimize <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x340.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x341.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x342.png" xlink:type="simple"/></inline-formula> version D and version S respectively and assuming<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x340.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x341.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x342.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x343.png" xlink:type="simple"/></inline-formula>. To justify these asymptotic chi-square distributions, note that we have for version D,</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x344.png" xlink:type="simple"/></inline-formula>. It suffices to consider the asymptotic distribution of <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x344.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x345.png" xlink:type="simple"/></inline-formula> as we have the following equalities in distribution,</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x346.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x346.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x347.png" xlink:type="simple"/></inline-formula>as given by expression (11). Also, using expression (11) and expression (13),</p><disp-formula id="scirp.82716-formula40"><graphic  xlink:href="//html.scirp.org/file/12-1241044x348.png"  xlink:type="simple"/></disp-formula><p>which can be reexpressed as</p><disp-formula id="scirp.82716-formula41"><graphic  xlink:href="//html.scirp.org/file/12-1241044x349.png"  xlink:type="simple"/></disp-formula><p>or</p><disp-formula id="scirp.82716-formula42"><graphic  xlink:href="//html.scirp.org/file/12-1241044x350.png"  xlink:type="simple"/></disp-formula><p>With</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x351.png" xlink:type="simple"/></inline-formula>,</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x352.png" xlink:type="simple"/></inline-formula>is based on expression (8) for version D. Consequently,</p><disp-formula id="scirp.82716-formula43"><graphic  xlink:href="//html.scirp.org/file/12-1241044x353.png"  xlink:type="simple"/></disp-formula><p>by noting</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x354.png" xlink:type="simple"/></inline-formula>,</p><p>using <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x355.png" xlink:type="simple"/></inline-formula> and the matrix <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x355.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x356.png" xlink:type="simple"/></inline-formula> is of rank <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x355.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x356.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x357.png" xlink:type="simple"/></inline-formula> with the rank of the matrix <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x355.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x356.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x357.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x358.png" xlink:type="simple"/></inline-formula> is also equal to its trace. The argument used is very similar to the one used for the Pearson’s statistics, see Luong and Thompson [<xref ref-type="bibr" rid="scirp.82716-ref30">30</xref>] (p249).</p><p>For version S,</p><disp-formula id="scirp.82716-formula44"><graphic  xlink:href="//html.scirp.org/file/12-1241044x359.png"  xlink:type="simple"/></disp-formula><p>and</p><disp-formula id="scirp.82716-formula45"><graphic  xlink:href="//html.scirp.org/file/12-1241044x360.png"  xlink:type="simple"/></disp-formula><p>with</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x361.png" xlink:type="simple"/></inline-formula>,</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x362.png" xlink:type="simple"/></inline-formula>is based on expressions (9-10) for version S. This justifies the asymptotic chi-square distribution for version S as given by expression (25) and expression (26). This version is useful for model testing for nonnegative continuous models without closed form expression densities, see Luong [<xref ref-type="bibr" rid="scirp.82716-ref33">33</xref>] for some positive infinitely divisible distributions without closed form densities used in actuarial sciences. It is also suitable for testing models with support on the real line used in finance such as the jump diffusion model as given by Tsay [<xref ref-type="bibr" rid="scirp.82716-ref34">34</xref>] (p311-319), for example. All we need is to be able to simulate from the model.</p></sec></sec></sec><sec id="s3"><title>3. SMHD Methods for Ungrouped Data</title><p>For the classical version D with ungrouped data, Simpson [<xref ref-type="bibr" rid="scirp.82716-ref14">14</xref>] (p806) in the proof of his Theorem 2 has shown that we have equality in probability of the following expression by letting</p><disp-formula id="scirp.82716-formula46"><graphic  xlink:href="//html.scirp.org/file/12-1241044x363.png"  xlink:type="simple"/></disp-formula><p>be the vector of partial derivatives with respect to <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x364.png" xlink:type="simple"/></inline-formula> of <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x364.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x365.png" xlink:type="simple"/></inline-formula> and we have</p><disp-formula id="scirp.82716-formula47"><label>(27)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x366.png"  xlink:type="simple"/></disp-formula><p>with <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x367.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x367.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x368.png" xlink:type="simple"/></inline-formula> is the vector of the</p><p>score functions with covariance matrix <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x369.png" xlink:type="simple"/></inline-formula> which is the Fisher information matrix.</p><p>For version D, we then have</p><disp-formula id="scirp.82716-formula48"><graphic  xlink:href="//html.scirp.org/file/12-1241044x370.png"  xlink:type="simple"/></disp-formula><p>or equivalently</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x371.png" xlink:type="simple"/></inline-formula>.</p><p>Therefore, we can conclude that <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x372.png" xlink:type="simple"/></inline-formula> which is</p><p>the result of Theorem 2 given by Simpson [<xref ref-type="bibr" rid="scirp.82716-ref14">14</xref>] (p804) which shows that the MHDE estimators are as effcient as the maximum likelihood (ML) estimators.</p><p>For version S with ungrouped data, it is more natural to use Theorem 7.1 of Newey and McFadden [<xref ref-type="bibr" rid="scirp.82716-ref17">17</xref>] (p2185-2186) to establish asymptotic normality for SMHD estimators. The ideas behind Theorem 7.1 can be summarized as follows. In case of the objective function <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x373.png" xlink:type="simple"/></inline-formula> is non smooth and the estimators is the vector <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x373.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x374.png" xlink:type="simple"/></inline-formula> which is obtained by minimizing<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x373.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x374.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x375.png" xlink:type="simple"/></inline-formula>, we can consider the vector <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x373.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x374.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x375.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x376.png" xlink:type="simple"/></inline-formula> which is obtained by minimizing a smooth function <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x373.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x374.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x375.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x376.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x377.png" xlink:type="simple"/></inline-formula> which approximates <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x373.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x374.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x375.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x376.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x377.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x378.png" xlink:type="simple"/></inline-formula> if <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x373.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x374.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x375.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x376.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x377.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x378.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x379.png" xlink:type="simple"/></inline-formula> is differentiable in probability at <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x373.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x374.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x375.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x376.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x377.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x378.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x379.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x380.png" xlink:type="simple"/></inline-formula> with the derivative vector given by<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x373.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x374.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x375.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x376.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x377.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x378.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x379.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x380.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x381.png" xlink:type="simple"/></inline-formula>. For SMHD estimation,</p><disp-formula id="scirp.82716-formula49"><label>(28)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x382.png"  xlink:type="simple"/></disp-formula><p>with its equivalent expression given by expression (3).</p><p>Also, if <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x383.png" xlink:type="simple"/></inline-formula> and assume that <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x383.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x384.png" xlink:type="simple"/></inline-formula> is non random and twice differentiable with second derivative matrix <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x383.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x384.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x385.png" xlink:type="simple"/></inline-formula> with<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x383.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x384.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x385.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x386.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x383.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x384.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x385.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x386.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x387.png" xlink:type="simple"/></inline-formula>attains its minimum at <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x383.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x384.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x385.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x386.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x387.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x388.png" xlink:type="simple"/></inline-formula> then we can define</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x389.png" xlink:type="simple"/></inline-formula>.</p><p>The vector <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x390.png" xlink:type="simple"/></inline-formula> which minimizes <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x390.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x391.png" xlink:type="simple"/></inline-formula> can be obtained explicitly as <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x390.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x391.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x392.png" xlink:type="simple"/></inline-formula> is a quadratic function of<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x390.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x391.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x392.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x393.png" xlink:type="simple"/></inline-formula>, it is given by <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x390.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x391.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x392.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x393.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x394.png" xlink:type="simple"/></inline-formula> and using equality in distribution</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x395.png" xlink:type="simple"/></inline-formula>.</p><p>If the remainder of the approximation is small, we also have</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x396.png" xlink:type="simple"/></inline-formula>.</p><p>Before defining the remainder term<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x397.png" xlink:type="simple"/></inline-formula>, note that the following approximation <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x397.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x398.png" xlink:type="simple"/></inline-formula> can be viewed as equivalent with</p><disp-formula id="scirp.82716-formula50"><graphic  xlink:href="//html.scirp.org/file/12-1241044x399.png"  xlink:type="simple"/></disp-formula><p>as <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x400.png" xlink:type="simple"/></inline-formula> using<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x400.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x401.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x400.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x401.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x402.png" xlink:type="simple"/></inline-formula>is minimized at<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x400.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x401.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x402.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x403.png" xlink:type="simple"/></inline-formula>.</p><p>For the approximation to be valid, we define</p><disp-formula id="scirp.82716-formula51"><graphic  xlink:href="//html.scirp.org/file/12-1241044x404.png"  xlink:type="simple"/></disp-formula><p>and requires <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x405.png" xlink:type="simple"/></inline-formula> as <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x405.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x406.png" xlink:type="simple"/></inline-formula> as indicated by the</p><p>proofs of Theorem 7.1 given by Newey and McFadden. The following Theorem 3 is essentially Theorem 7.1 given by Newey and McFadden but restated with estimators obtained by minimizing an objective function instead of maximizing an</p><p>objective function and requires <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x407.png" xlink:type="simple"/></inline-formula> which is slightly</p><p>more stringent than the original condition v) of their Theorem 7.1. We also require compactness of the parameter space<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x408.png" xlink:type="simple"/></inline-formula>. Newey and McFadden do not use this assumption but with this assumption, the proofs are less technical and simplified. It is also likely to be met in practice.</p><p>Theorem 3</p><p>Suppose that<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x409.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x409.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x410.png" xlink:type="simple"/></inline-formula>and</p><p>1) <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x411.png" xlink:type="simple"/></inline-formula>is minimized at<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x411.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x412.png" xlink:type="simple"/></inline-formula>;</p><p>2) <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x413.png" xlink:type="simple"/></inline-formula>is an interior point of the parameter space<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x413.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x414.png" xlink:type="simple"/></inline-formula>;</p><p>3) <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x415.png" xlink:type="simple"/></inline-formula>is twice differentiable at <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x415.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x416.png" xlink:type="simple"/></inline-formula> with nonsingular matrix<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x415.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x416.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x417.png" xlink:type="simple"/></inline-formula>;</p><p>4)<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x418.png" xlink:type="simple"/></inline-formula>;</p><p>5) <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x419.png" xlink:type="simple"/></inline-formula>as<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x419.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x420.png" xlink:type="simple"/></inline-formula>. Then</p><disp-formula id="scirp.82716-formula52"><graphic  xlink:href="//html.scirp.org/file/12-1241044x421.png"  xlink:type="simple"/></disp-formula><p>The regularity conditions (1-3) of Theorem 3 can easily be checked. The condition 4 follows from expression (27) established by Simpson [<xref ref-type="bibr" rid="scirp.82716-ref14">14</xref>] . The condition 5 might be the most difficult to check as it involve technicalities and it is verified in TA2 of the Appendices. By assuming all can be verified, we apply Theorem 3 for SMHD estimation with<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x422.png" xlink:type="simple"/></inline-formula>.</p><p>The objective function <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x423.png" xlink:type="simple"/></inline-formula> is as defined by expression (3),</p><disp-formula id="scirp.82716-formula53"><graphic  xlink:href="//html.scirp.org/file/12-1241044x424.png"  xlink:type="simple"/></disp-formula><p>the matrix of second derivative of <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x425.png" xlink:type="simple"/></inline-formula> is</p><disp-formula id="scirp.82716-formula54"><graphic  xlink:href="//html.scirp.org/file/12-1241044x426.png"  xlink:type="simple"/></disp-formula><p>and it can be seen that</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x427.png" xlink:type="simple"/></inline-formula>,</p><p>by performing limit operations to find derivates as in real analysis and using Assumption 1 and Assumption 2. Therefore, we have the following equality in distribution using the condition 4) of Theorem 3 and expression (27)</p><disp-formula id="scirp.82716-formula55"><label>(29)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x428.png"  xlink:type="simple"/></disp-formula><p>which is similar to the grouped case.</p><p>Now with <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x429.png" xlink:type="simple"/></inline-formula> with the size of the simulated sample is <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x429.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x430.png" xlink:type="simple"/></inline-formula> and the simulated sample is independent of the sample given by data, we can argue as for the grouped case to conclude</p><disp-formula id="scirp.82716-formula56"><label>. (30)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/12-1241044x431.png"  xlink:type="simple"/></disp-formula><p>One might want to define the extended Cram&#233;r-Rao lower bound for simulated method estimators to be<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x432.png" xlink:type="simple"/></inline-formula>; with this definition, the asymptotic covariance matrix of SMHD estimators attains this bound just as the asymptotic covariance matrix of ML estimators attain the classical Cram&#233;r-Rao lower bound. The factor <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x432.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x433.png" xlink:type="simple"/></inline-formula> is a common factor which also appears in</p><p>other simulated methods, it can be interpreted as the adjustment factor when estimators are obtained via minimizing a simulated version of the objective function instead of the original objective function with the model distribution being replaced by a sample distribution using a simulated sample, see Pakes and Pollard [<xref ref-type="bibr" rid="scirp.82716-ref16">16</xref>] (p1048) for the simulated minimum chi-square estimators, for example. Clearly, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x434.png" xlink:type="simple"/></inline-formula>can also be estimated numerically as in the grouped case which is given in section (2). Results of Theorem 2 and Corollary 1 allow us to establish asymptotic normality of the MHD estimators for both versions in a unified way.</p><p>We close this section by showing the asymptotic breakdown point <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x435.png" xlink:type="simple"/></inline-formula> of SHMD estimators is the same as HMD estimators under the true model with</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x436.png" xlink:type="simple"/></inline-formula>by using the argument used by Simpson for the version D of HD estimators,</p><p>see Simpson [<xref ref-type="bibr" rid="scirp.82716-ref14">14</xref>] (p805-806) and assuming only the original data set might be contaminated, there is no contamination coming from simulated samples. This assumption appears to be reasonable as we can control the simulation procedures. We focus only on the strict parametric model and the set up is less general than the one considered by Theorem 3 of Simpson [<xref ref-type="bibr" rid="scirp.82716-ref13">13</xref>] (p805) which also includes distributions near the parametric model.</p><p>Let <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x437.png" xlink:type="simple"/></inline-formula> be the contaminated distribution function defined as</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x438.png" xlink:type="simple"/></inline-formula>, where <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x438.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x439.png" xlink:type="simple"/></inline-formula> is the true distribution function and the distribution <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x438.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x439.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x440.png" xlink:type="simple"/></inline-formula> is introduced to contaminate the model. The pmfs of <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x438.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x439.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x440.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x441.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x438.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x439.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x440.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x441.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x442.png" xlink:type="simple"/></inline-formula> are given respectively by <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x438.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x439.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x440.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x441.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x442.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x443.png" xlink:type="simple"/></inline-formula> and<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x438.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x439.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x440.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x441.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x442.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x443.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x444.png" xlink:type="simple"/></inline-formula>. The asymptotic breakdown point is the smallest value <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x438.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x439.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x440.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x441.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x442.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x443.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x444.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x445.png" xlink:type="simple"/></inline-formula> which makes<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x438.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x439.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x440.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x441.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x442.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x443.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x444.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x445.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x446.png" xlink:type="simple"/></inline-formula>. The vector <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x438.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x439.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x440.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x441.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x442.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x443.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x444.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x445.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x446.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x447.png" xlink:type="simple"/></inline-formula> minimizes with respect to <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x438.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x439.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x440.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x441.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x442.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x443.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x444.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x445.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x446.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x447.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x448.png" xlink:type="simple"/></inline-formula> the objective function</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x449.png" xlink:type="simple"/></inline-formula>.</p><p>Now with the same seed used across<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x450.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x450.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x451.png" xlink:type="simple"/></inline-formula>can be viewed as a proxy pmf for the true parametric model. We let <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x450.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x451.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x452.png" xlink:type="simple"/></inline-formula> and show that this will imply <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x450.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x451.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x452.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x453.png" xlink:type="simple"/></inline-formula> in probability. As <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x450.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x451.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x452.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x453.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x454.png" xlink:type="simple"/></inline-formula> is the vector which minimizes SHD or maximizes <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x450.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x451.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x452.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x453.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x454.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x455.png" xlink:type="simple"/></inline-formula> clearly<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x450.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x451.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x452.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x453.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x454.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x455.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x456.png" xlink:type="simple"/></inline-formula>. Now observe that</p><disp-formula id="scirp.82716-formula57"><graphic  xlink:href="//html.scirp.org/file/12-1241044x457.png"  xlink:type="simple"/></disp-formula><p>but</p><disp-formula id="scirp.82716-formula58"><graphic  xlink:href="//html.scirp.org/file/12-1241044x458.png"  xlink:type="simple"/></disp-formula><p>as <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x459.png" xlink:type="simple"/></inline-formula> which implies<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x459.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x460.png" xlink:type="simple"/></inline-formula>. So, in probability, we have the lower bound</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x461.png" xlink:type="simple"/></inline-formula>.</p><p>With<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x462.png" xlink:type="simple"/></inline-formula>,</p><p>using the inequality <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x463.png" xlink:type="simple"/></inline-formula> with<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x463.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x464.png" xlink:type="simple"/></inline-formula>, we have the upper bound inequality</p><disp-formula id="scirp.82716-formula59"><graphic  xlink:href="//html.scirp.org/file/12-1241044x465.png"  xlink:type="simple"/></disp-formula><p>The last inequality follows from the assumption that <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x466.png" xlink:type="simple"/></inline-formula> since <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x466.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x467.png" xlink:type="simple"/></inline-formula> which implies the two pmfs <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x466.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x467.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x468.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x466.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x467.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x468.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x469.png" xlink:type="simple"/></inline-formula> are not close according to the discrepancy measure using SHD as<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x466.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x467.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x468.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x469.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x470.png" xlink:type="simple"/></inline-formula>, an argument also used by Simpson [<xref ref-type="bibr" rid="scirp.82716-ref14">14</xref>] to justify his expression<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x466.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x467.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x468.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x469.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x470.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x471.png" xlink:type="simple"/></inline-formula>, see Simpson [<xref ref-type="bibr" rid="scirp.82716-ref14">14</xref>] (p805-806).</p><p>Using<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x472.png" xlink:type="simple"/></inline-formula>, we might conclude in probability we have the inequalities <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x472.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x473.png" xlink:type="simple"/></inline-formula> which implies <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x472.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x473.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x474.png" xlink:type="simple"/></inline-formula> in</p><p>probability under the true model which is similar to version D. The only difference is here we have an inequality in probability. From this result, we might conclude that the SMHD estimators preserve the robustness properties of version D and the loss of asymptotic efficiency comparing to version D can be minimized if<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x475.png" xlink:type="simple"/></inline-formula>.</p></sec><sec id="s4"><title>4. Numerical Issues</title><sec id="s4_1"><title>4.1. Methods to Approximate Probabilities</title><p>Once the parameters are estimated, probabilities can be estimated. For situations where recursive formulas exist then Panjer’s method can be used, see Chapter 9 of the book by Klugman et al. [<xref ref-type="bibr" rid="scirp.82716-ref4">4</xref>] . Otherwise, we might need to approximate probabilities by simulations or by analytic methods.</p><p>In this section, we discuss some methods for approximating probabilities <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x476.png" xlink:type="simple"/></inline-formula> for a discrete nonnegative random variable X with pgf <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x476.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x477.png" xlink:type="simple"/></inline-formula> which can be used if a recursion formula for <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x476.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x477.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x478.png" xlink:type="simple"/></inline-formula> is not available. The saddlepoint method and the method based on inverting the characteristic function can be used.</p><p>See Butler [<xref ref-type="bibr" rid="scirp.82716-ref35">35</xref>] (p8-9) for details of the saddlepoint approximation. It can be described as using <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x479.png" xlink:type="simple"/></inline-formula> to approximate<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x479.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x480.png" xlink:type="simple"/></inline-formula>, with</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x481.png" xlink:type="simple"/></inline-formula>.</p><p>The saddlepoint <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x482.png" xlink:type="simple"/></inline-formula> is defined implicitly, using the pgf, as the solution of<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x482.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x483.png" xlink:type="simple"/></inline-formula>, and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x482.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x483.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x484.png" xlink:type="simple"/></inline-formula> with <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x482.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x483.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x484.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x485.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x482.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x483.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x484.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x485.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x486.png" xlink:type="simple"/></inline-formula>. The function <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x482.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x483.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x484.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x485.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x486.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x487.png" xlink:type="simple"/></inline-formula> is the cumulant function.</p><p>If the cumulant function does not exist, an alternative method which is based on the characteristic function, as described by Abate and Whitt [<xref ref-type="bibr" rid="scirp.82716-ref36">36</xref>] (p32), can be used.</p></sec><sec id="s4_2"><title>4.2. A Limited Simulation study</title><sec id="s4_2_1"><title>4.2.1. Neymann Type A distribution</title><p>As an example for illustration we choose the Neymann Type A distribution with the method of moments (MM) estimators for <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x488.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x488.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x489.png" xlink:type="simple"/></inline-formula> which have been given</p><p>by Johnson et al. [<xref ref-type="bibr" rid="scirp.82716-ref8">8</xref>] . The MM estimators are given by <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x490.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x490.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x491.png" xlink:type="simple"/></inline-formula></p><p>with the sample mean and variance given respectively by <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x492.png" xlink:type="simple"/></inline-formula> and<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x492.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x493.png" xlink:type="simple"/></inline-formula>. The MM estimators are classical moment estimators. We perform a limited simulation study to compare the performance of the SMHD estimator which is given by</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x494.png" xlink:type="simple"/></inline-formula>vs the MM estimators given by<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x494.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x495.png" xlink:type="simple"/></inline-formula>.</p><p>For the range of parameter values, we let<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x496.png" xlink:type="simple"/></inline-formula>,</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x497.png" xlink:type="simple"/></inline-formula>are used in the study. For applications often the parameter <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x497.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x498.png" xlink:type="simple"/></inline-formula> for the mixing distribution much smaller than the parameter<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x497.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x498.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x499.png" xlink:type="simple"/></inline-formula>. The SMHD estimators seem to perform much better than the MM estimators, in general. The results are displayed in <xref ref-type="table" rid="table">Table </xref>A. The criterion for overall relative</p><p>efficiency used is the ratio <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x500.png" xlink:type="simple"/></inline-formula> with <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x500.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x501.png" xlink:type="simple"/></inline-formula> denotes</p><p>the mean square error of the estimator inside the parenthesis. The mean square error of an estimator <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x502.png" xlink:type="simple"/></inline-formula> for <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x502.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x503.png" xlink:type="simple"/></inline-formula> is defined as</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x504.png" xlink:type="simple"/></inline-formula>.</p><p>The ratio ARE can be estimated using simulated data and they are displayed in <xref ref-type="table" rid="table">Table </xref>A. Due to limited computing facilities, we only draw <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x505.png" xlink:type="simple"/></inline-formula> samples of size <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x505.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x506.png" xlink:type="simple"/></inline-formula> and the simulated sample is fixed at<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x505.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x506.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x507.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x505.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x506.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x507.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x508.png" xlink:type="simple"/></inline-formula>and the results are summarized using <xref ref-type="table" rid="table">Table </xref>A. It takes around one minute using a laptop computer for obtaining the SMHD estimators for one simulated sample. The MM estimators appear to perform reasonably well for some samples but display erratic results for some other samples which account for the loss of efficiency of the MM estimators. Also, the parameter <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x505.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x506.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x507.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x508.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x509.png" xlink:type="simple"/></inline-formula> is not well estimated by the moment method but it gives reasonably good estimates for the parameter <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x505.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x506.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x507.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x508.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x509.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x510.png" xlink:type="simple"/></inline-formula> in general. The MM estimators are based on the sample mean and variance and these statistics are known to be nonrobust. If outliers are present, the MM estimators again might become erratic. The mean square errors (MSE) for estimating the parameters and the corresponding ratios ARE are estimated using the simulated samples and the AREs are displayed in <xref ref-type="table" rid="table">Table </xref>A.</p></sec><sec id="s4_2_2"><title>4.2.2. Poisson distribution</title><p>For the Poisson model with parameter <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x511.png" xlink:type="simple"/></inline-formula> we compare the performance of <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x511.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x512.png" xlink:type="simple"/></inline-formula> the MLE for <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x511.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x512.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x513.png" xlink:type="simple"/></inline-formula> which is the sample mean vs the SMHD estimator <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x511.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x512.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x513.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x514.png" xlink:type="simple"/></inline-formula></p><p>using the ratio <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x515.png" xlink:type="simple"/></inline-formula> for<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x515.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x516.png" xlink:type="simple"/></inline-formula>. For the Poisson</p><p>model, the information matrix exists and we can check the efficiency and robustness of the SHD estimator and compare it with the ML estimator which is the sample mean. Since there is only on parameter estimate we are able to fix</p><table-wrap id="table1" ><label><xref ref-type="table" rid="table">Table </xref>A</label><caption><title> Asymptotic relative efficiencies between MM estimators and SMHD estimators<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x517.png" xlink:type="simple"/></inline-formula></title></caption><table><tbody><thead><tr><th align="center" valign="middle" ><inline-formula><inline-graphic xlink:href="/html.scirp.org/file/12-1241044x518.png" xlink:type="simple"/></inline-formula></th><th align="center" valign="middle" >30</th><th align="center" valign="middle" >40</th><th align="center" valign="middle" >50</th><th align="center" valign="middle" >60</th><th align="center" valign="middle" >80</th><th align="center" valign="middle" >100</th></tr></thead><tr><td align="center" valign="middle" >0.25</td><td align="center" valign="middle" >0.0032</td><td align="center" valign="middle" >0.0082</td><td align="center" valign="middle" >0.0238</td><td align="center" valign="middle" >0.0173</td><td align="center" valign="middle" >0.0074</td><td align="center" valign="middle" >0.0063</td></tr><tr><td align="center" valign="middle" >0.5</td><td align="center" valign="middle" >0.0523</td><td align="center" valign="middle" >0.0024</td><td align="center" valign="middle" >0.0148</td><td align="center" valign="middle" >0.2053</td><td align="center" valign="middle" >0.0115</td><td align="center" valign="middle" >0.0429</td></tr><tr><td align="center" valign="middle" >1</td><td align="center" valign="middle" >0.0337</td><td align="center" valign="middle" >0.0256</td><td align="center" valign="middle" >0.1253</td><td align="center" valign="middle" >0.1502</td><td align="center" valign="middle" >0.0892</td><td align="center" valign="middle" >0.0481</td></tr><tr><td align="center" valign="middle" >2</td><td align="center" valign="middle" >0.0073</td><td align="center" valign="middle" >0.0197</td><td align="center" valign="middle" >0.0393</td><td align="center" valign="middle" >0.0536</td><td align="center" valign="middle" >0.2986</td><td align="center" valign="middle" >0.0147</td></tr><tr><td align="center" valign="middle" >3</td><td align="center" valign="middle" >0.0038</td><td align="center" valign="middle" >0.0046</td><td align="center" valign="middle" >0.0020</td><td align="center" valign="middle" >0.3167</td><td align="center" valign="middle" >0.0229</td><td align="center" valign="middle" >0.0057</td></tr><tr><td align="center" valign="middle" >4</td><td align="center" valign="middle" >0.0098</td><td align="center" valign="middle" >0.0103</td><td align="center" valign="middle" >0.0117</td><td align="center" valign="middle" >0.0156</td><td align="center" valign="middle" >0.0102</td><td align="center" valign="middle" >0.0020</td></tr><tr><td align="center" valign="middle" >5</td><td align="center" valign="middle" >0.0481</td><td align="center" valign="middle" >0.1431</td><td align="center" valign="middle" >0.0062</td><td align="center" valign="middle" >0.0073</td><td align="center" valign="middle" >0.0100</td><td align="center" valign="middle" >0.0009</td></tr><tr><td align="center" valign="middle" >6</td><td align="center" valign="middle" >1.0330</td><td align="center" valign="middle" >0.0632</td><td align="center" valign="middle" >0.0145</td><td align="center" valign="middle" >0.0236</td><td align="center" valign="middle" >0.0126</td><td align="center" valign="middle" >0.0062</td></tr></tbody></table></table-wrap><p>Asymptotic relative efficiency between MLE <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x519.png" xlink:type="simple"/></inline-formula> and SHD<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x519.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x520.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x519.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x520.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x521.png" xlink:type="simple"/></inline-formula>for the Poisson model with parameter<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x519.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x520.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x521.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x522.png" xlink:type="simple"/></inline-formula>.</p><p>Asymptotic relative efficiency between MLE <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x525.png" xlink:type="simple"/></inline-formula> and SHD <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x525.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x526.png" xlink:type="simple"/></inline-formula> for the Poisson model <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x525.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x526.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x527.png" xlink:type="simple"/></inline-formula> when 10% of data coming from the discrete positive distribution with parameter <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x525.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x526.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x527.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x528.png" xlink:type="simple"/></inline-formula> and<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x525.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x526.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x527.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x528.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x529.png" xlink:type="simple"/></inline-formula>, i.e.,<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x525.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x526.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x527.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x528.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x529.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x530.png" xlink:type="simple"/></inline-formula>.</p><p>U = 10000 for the simulated sample size from the Poisson model without slowing down the computations. It appears overall the SHD estimators performs very well for the range of parameters often encountered in actuarial studies, here we observe that the asymptotic efficiencies range from 0.7 to 1.1. We also study a contaminated Poisson model (<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x533.png" xlink:type="simple"/></inline-formula>) with <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x533.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x534.png" xlink:type="simple"/></inline-formula> observations coming from the Poisson model (<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x533.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x534.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x535.png" xlink:type="simple"/></inline-formula>) and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x533.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x534.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x535.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x536.png" xlink:type="simple"/></inline-formula> of observations coming from a discrete positive stable (DPS) distribution with the parameter for <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x533.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x534.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x535.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x536.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x537.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x533.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x534.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x535.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x536.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x537.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x538.png" xlink:type="simple"/></inline-formula> has the same value of the Poisson model. We compare the performance of the sample mean for <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x533.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x534.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x535.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x536.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x537.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x538.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x539.png" xlink:type="simple"/></inline-formula> which is the ML estimator vs the SMHD estimator <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x533.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x534.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x535.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x536.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x537.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x538.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x539.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x540.png" xlink:type="simple"/></inline-formula> using the contaminated model Poisson model as described and estimate the</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x541.png" xlink:type="simple"/></inline-formula>for <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x541.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x542.png" xlink:type="simple"/></inline-formula> to compare the robustness of</p><p>the SMHD estimator vs ML estimator in presence of contamination. The sample mean looses its efficiency and becomes very biased. The results are given at the bottom of <xref ref-type="table" rid="table">Table </xref>A which shows that the <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x543.png" xlink:type="simple"/></inline-formula> performs much better than the sample mean which is the ML estimator. For drawing simulated samples from the DPS distribution, the algorithm given by Devroye [<xref ref-type="bibr" rid="scirp.82716-ref37">37</xref>] is used.</p></sec></sec></sec><sec id="s5"><title>5. Conclusion</title><p>More simulation experiments to further study the performance of the SMHD estimators vs commonly used estimators across various parametric models are needed and we do not have the computing facilities to carry out such large scale studies. Most of the computing works were carried out using only a laptop computer. So far, the simulation results confirm the theoretical asymptotic results which show that SMHD estimators have the potential of having high efficiencies for parametric models with finite Fisher information matrices and they are robust if data is contaminated; the last feature might not be shared by ML estimators.</p></sec><sec id="s6"><title>Acknowledgements</title><p>The helps received from the Editorial staffs of OJS which lead to an improvement of the presentation of the paper are gratefully acknowledged.</p></sec><sec id="s7"><title>Cite this paper</title><p>Luong, A., Bilodeau, C. and Blier-Wong, C. (2018) Simulated Minimum Hellinger Distance Inference Methods for Count Data. Open Journal of Statistics, 8, 187-219. https://doi.org/10.4236/ojs.2018.81012</p></sec><sec id="s8"><title>Appendices</title>Technical Appendix 1 (TA1)<p>TA 1.1</p><p>In this technical appendix, we shall show that a sequence of random functions <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x544.png" xlink:type="simple"/></inline-formula> which is continuous in probability and bounded in probability on a compact set <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x544.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x545.png" xlink:type="simple"/></inline-formula> will attain its supremum on a point of <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x544.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x545.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x546.png" xlink:type="simple"/></inline-formula> in probability. Pick a sequence <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x544.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x545.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x546.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x547.png" xlink:type="simple"/></inline-formula> in <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x544.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x545.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x546.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x547.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x548.png" xlink:type="simple"/></inline-formula> with the property<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x544.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x545.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x546.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x547.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x548.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x549.png" xlink:type="simple"/></inline-formula>. Since <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x544.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x545.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x546.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x547.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x548.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x549.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x550.png" xlink:type="simple"/></inline-formula> is compact we can extract a subsequence <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x544.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x545.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x546.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x547.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x548.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x549.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x550.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x551.png" xlink:type="simple"/></inline-formula> from <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x544.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x545.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x546.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x547.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x548.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x549.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x550.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x551.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x552.png" xlink:type="simple"/></inline-formula> with the property <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x544.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x545.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x546.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x547.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x548.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x549.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x550.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x551.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x552.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x553.png" xlink:type="simple"/></inline-formula> which belongs to<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x544.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x545.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x546.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x547.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x548.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x549.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x550.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x551.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x552.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x553.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x554.png" xlink:type="simple"/></inline-formula>. This property in real analysis is also known under the name Bolzano-Weirstrass theorem. We then have <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x544.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x545.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x546.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x547.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x548.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x549.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x550.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x551.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x552.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x553.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x554.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x555.png" xlink:type="simple"/></inline-formula> and<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x544.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x545.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x546.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x547.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x548.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x549.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x550.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x551.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x552.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x553.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x554.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x555.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x556.png" xlink:type="simple"/></inline-formula>.</p><p>TA 1.2</p><p>In this technical appendix, we shall show that the sequence of function <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x557.png" xlink:type="simple"/></inline-formula> is continuous in probability and for the grouped case of Section (2.2.2), <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x557.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x558.png" xlink:type="simple"/></inline-formula>for the grouped data case can also be expressed as</p><disp-formula id="scirp.82716-formula60"><graphic  xlink:href="//html.scirp.org/file/12-1241044x559.png"  xlink:type="simple"/></disp-formula><p>The first two terms of the RHS of the above equation are bounded in probability as they have a limiting distributions and this implies the third term is also bounded in probability by using Cauchy-Schwartz inequality. Now using the conditions of Assumption 1 of Section (2.2.2) and implicitly the assumption of the same seed is used across different values of<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x560.png" xlink:type="simple"/></inline-formula>, we then have as<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x560.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x561.png" xlink:type="simple"/></inline-formula>,</p><disp-formula id="scirp.82716-formula61"><graphic  xlink:href="//html.scirp.org/file/12-1241044x562.png"  xlink:type="simple"/></disp-formula><p>and</p><disp-formula id="scirp.82716-formula62"><graphic  xlink:href="//html.scirp.org/file/12-1241044x563.png"  xlink:type="simple"/></disp-formula><p>From the above property, it is clear that<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x564.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x564.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x565.png" xlink:type="simple"/></inline-formula>is continuous in probability, and using TA1.1 we conclude that there exists <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x564.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x565.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x566.png" xlink:type="simple"/></inline-formula> which</p><p>belongs to <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x567.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x567.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x568.png" xlink:type="simple"/></inline-formula> but as<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x567.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x568.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x569.png" xlink:type="simple"/></inline-formula>,<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x567.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x568.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x569.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x570.png" xlink:type="simple"/></inline-formula>. Therefore, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x567.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x568.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x569.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x570.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x571.png" xlink:type="simple"/></inline-formula>, as<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x567.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x568.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x569.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x570.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x571.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x572.png" xlink:type="simple"/></inline-formula>.</p><p>The justifications for the ungrouped case are similar using the same type of arguments but with the use of Theorem 7.1 given by Newey and McFadden [<xref ref-type="bibr" rid="scirp.82716-ref17">17</xref>] and will be given in TA2.</p>Technical Appendix 2 (TA2)<p>In this technical appendix we shall verify the condition</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x573.png" xlink:type="simple"/></inline-formula>as <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x573.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x574.png" xlink:type="simple"/></inline-formula> for SMHD estimation using ungrouped data. Despite<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x573.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x574.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x575.png" xlink:type="simple"/></inline-formula>, we will keep <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x573.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x574.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x575.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x576.png" xlink:type="simple"/></inline-formula> and define the sequence of functions <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x573.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x574.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x575.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x576.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x577.png" xlink:type="simple"/></inline-formula> then it will allow us to express<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x573.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x574.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x575.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x576.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x577.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x578.png" xlink:type="simple"/></inline-formula>. Now with<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x573.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x574.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x575.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x576.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x577.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x578.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x579.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x573.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x574.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x575.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x576.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x577.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x578.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x579.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x580.png" xlink:type="simple"/></inline-formula>is differentiable in probability at<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x573.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x574.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x575.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x576.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x577.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x578.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x579.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x580.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x581.png" xlink:type="simple"/></inline-formula>. The derivative vector for <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x573.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x574.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x575.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x576.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x577.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x578.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x579.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x580.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x581.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x582.png" xlink:type="simple"/></inline-formula> at <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x573.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x574.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x575.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x576.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x577.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x578.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x579.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x580.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x581.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x582.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x583.png" xlink:type="simple"/></inline-formula> is simply <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x573.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x574.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x575.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x576.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x577.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x578.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x579.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x580.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x581.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x582.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x583.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x584.png" xlink:type="simple"/></inline-formula> as it can be seen by performing limit operations as in real analysis and using Assumption 1 and Assumption 2 in Section 3. Therefore, we have <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x573.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x574.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x575.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x576.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x577.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x578.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x579.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x580.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x581.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x582.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x583.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x584.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x585.png" xlink:type="simple"/></inline-formula> as <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x573.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x574.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x575.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x576.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x577.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x578.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x579.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x580.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x581.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x582.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x583.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x584.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x585.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x586.png" xlink:type="simple"/></inline-formula> by using definition of the derivative. Since <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x573.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x574.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x575.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x576.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x577.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x578.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x579.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x580.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x581.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x582.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x583.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x584.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x585.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x586.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x587.png" xlink:type="simple"/></inline-formula> is approximable by <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x573.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x574.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x575.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x576.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x577.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x578.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x579.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x580.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x581.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x582.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x583.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x584.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x585.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x586.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x587.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x588.png" xlink:type="simple"/></inline-formula> which is bounded in probability in a neighborhood including<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x573.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x574.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x575.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x576.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x577.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x578.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x579.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x580.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x581.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x582.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x583.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x584.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x585.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x586.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x587.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x588.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x589.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x573.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x574.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x575.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x576.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x577.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x578.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x579.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x580.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x581.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x582.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x583.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x584.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x585.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x586.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x587.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x588.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x589.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x590.png" xlink:type="simple"/></inline-formula> using expression (27), we might assume <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x573.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x574.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x575.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x576.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x577.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x578.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x579.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x580.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x581.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x582.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x583.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x584.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x585.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x586.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x587.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x588.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x589.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x590.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x591.png" xlink:type="simple"/></inline-formula> is bounded in probability for<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x573.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x574.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x575.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x576.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x577.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x578.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x579.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x580.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x581.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x582.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x583.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x584.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x585.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x586.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x587.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x588.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x589.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x590.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x591.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x592.png" xlink:type="simple"/></inline-formula>. We might also assume that <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x573.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x574.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x575.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x576.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x577.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x578.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x579.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x580.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x581.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x582.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x583.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x584.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x585.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x586.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x587.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x588.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x589.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x590.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x591.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x592.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x593.png" xlink:type="simple"/></inline-formula> as<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x573.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x574.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x575.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x576.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x577.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x578.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x579.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x580.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x581.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x582.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x583.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x584.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x585.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x586.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x587.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x588.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x589.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x590.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x591.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x592.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x593.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x594.png" xlink:type="simple"/></inline-formula>, using Dominated Convergence Theorem (DCT) with <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x573.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x574.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x575.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x576.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x577.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x578.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x579.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x580.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x581.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x582.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x583.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x584.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x585.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x586.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x587.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x588.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x589.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x590.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x591.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x592.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x593.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x594.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x595.png" xlink:type="simple"/></inline-formula> when<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x573.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x574.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x575.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x576.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x577.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x578.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x579.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x580.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x581.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x582.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x583.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x584.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x585.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x586.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x587.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x588.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x589.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x590.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x591.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x592.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x593.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x594.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x595.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x596.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x573.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x574.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x575.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x576.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x577.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x578.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x579.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x580.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x581.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x582.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x583.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x584.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x585.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x586.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x587.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x588.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x589.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x590.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x591.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x592.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x593.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x594.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x595.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x596.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x597.png" xlink:type="simple"/></inline-formula>as defined by expression (28) of Section 3, the summand of <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x573.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x574.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x575.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x576.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x577.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x578.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x579.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x580.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x581.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x582.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x583.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x584.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x585.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x586.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x587.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x588.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x589.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x590.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x591.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x592.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x593.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x594.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x595.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x596.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x597.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x598.png" xlink:type="simple"/></inline-formula> satisfies the following inequalities</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x599.png" xlink:type="simple"/></inline-formula>,</p><p>hence the use of DCT is justified. Therefore, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x600.png" xlink:type="simple"/></inline-formula>is continuous in probability for all<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x600.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x601.png" xlink:type="simple"/></inline-formula>.</p><p>Now if we define<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x602.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x602.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x603.png" xlink:type="simple"/></inline-formula>is continuous in probability for all <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x602.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x603.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x604.png" xlink:type="simple"/></inline-formula> which belongs to<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x602.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x603.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x604.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x605.png" xlink:type="simple"/></inline-formula>. Consequently, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x602.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x603.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x604.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x605.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x606.png" xlink:type="simple"/></inline-formula>with <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x602.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x603.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x604.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x605.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x606.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x607.png" xlink:type="simple"/></inline-formula> as the set <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x602.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x603.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x604.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x605.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x606.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x607.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x608.png" xlink:type="simple"/></inline-formula> is compact. As<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x602.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x603.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x604.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x605.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x606.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x607.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x608.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x609.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x602.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x603.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x604.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x605.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x606.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x607.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x608.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x609.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x610.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x602.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x603.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x604.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x605.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x606.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x607.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x608.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x609.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x610.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x611.png" xlink:type="simple"/></inline-formula>,<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x602.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x603.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x604.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x605.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x606.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x607.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x608.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x609.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x610.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x611.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/12-1241044x612.png" xlink:type="simple"/></inline-formula> , this establishes the result and the argument used is similar to the one used in TA1.2 for the grouped data case.</p></sec></body><back><ref-list><title>References</title><ref id="scirp.82716-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Christoph, G. and Schreiber, K. (1998) Discrete Stable Random Variables. Statistics and Probability Letters, 37, 243-247.  
https://doi.org/10.1016/S0167-7152(97)00123-5</mixed-citation></ref><ref id="scirp.82716-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Abate, J. and Whitt, W. (1996) An Operational Calculus for Probability Distributions via Laplace Transforms. Advances in Applied Probability, 28, 75-113.  
https://doi.org/10.2307/1427914</mixed-citation></ref><ref id="scirp.82716-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Panjer, H. and Willmot, G.E. (1992) Insurance Risk Models. Society of Actuaries, Chicago, IL.</mixed-citation></ref><ref id="scirp.82716-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Klugman, H., Panjer, H.H. and Willmot, G.E. (2012) Loss Models: From Data to Decisions. Wiley, New York.</mixed-citation></ref><ref id="scirp.82716-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Gerber, H.U. (1991) From the Generalized Gamma to the Generalized Negative Binomial Distribution. Insurance: Mathematics and Economics, 10, 303-309.  
https://doi.org/10.1016/0167-6687(92)90061-F</mixed-citation></ref><ref id="scirp.82716-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Hougaard, P. (1986) Survival Models for Heterogeneous Populations Derived from Stable Distributions. Biometrika, 73, 387-396.  
https://doi.org/10.1093/biomet/73.2.387</mixed-citation></ref><ref id="scirp.82716-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Zhu, R. and Joe, H. (2009) Modelling Heavy Tailed Count Data Using a Generalized Poisson Inverse Gaussian Family. Statistics and Probability Letters, 79, 1695-1703. https://doi.org/10.1016/j.spl.2009.04.011</mixed-citation></ref><ref id="scirp.82716-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Johnson, N.L., Kotz, S. and Kemp, A.W. (1992) Univariate Discrete Distributions. 2nd Edition, Wiley, New York.</mixed-citation></ref><ref id="scirp.82716-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Doray, L.G., Jiang, S.M. and Luong, A. (2009) Some Simple Methods of Estimation for the Parameters of the Discrete Stable Distributions with Probability Generating Functions. Communications in Statistics, Simulation and Computation, 38, 2004-2007.  
https://doi.org/10.1080/03610910903202089</mixed-citation></ref><ref id="scirp.82716-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Carrasco, M. and Florens, J.-P. (2000) Generalization of GMM to a Continuum Moments Conditions. Econometric Theory, 16, 797-834.  
https://doi.org/10.1017/S0266466600166010</mixed-citation></ref><ref id="scirp.82716-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Feuerverger, A. and McDunnough, P. (1981) On the Efficiency of Empirical Characteristic Function Procedure. Journal of the Royal Statistical Society, Series B, 43, 20-27.</mixed-citation></ref><ref id="scirp.82716-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Nadarajah, S and Kotz, S. (2006a) Compound Mixed Poisson Distribution I. Scandinavian Actuarial Journal, 2006, 141-162.  
https://doi.org/10.1080/03461230600783384</mixed-citation></ref><ref id="scirp.82716-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Nadarajah, S and Kotz, S. (2006b) Compound Mixed Poisson Distribution II. Scandinavian Actuarial Journal, 2006, 163-181.  
https://doi.org/10.1080/03461230600715253</mixed-citation></ref><ref id="scirp.82716-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">Simpson, D.G. (1987) Minimum Hellinger Distance Estimation for the Analysis of Count Data. Journal of the American Statistical Association, 82, 802-807.  
https://doi.org/10.1080/01621459.1987.10478501</mixed-citation></ref><ref id="scirp.82716-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Simpson, D.G. (1989) Hellinger Deviance Tests: Efficiency, Breakdown Points and Examples. Journal of the American Statistical Association, 84, 107-113.  
https://doi.org/10.1080/01621459.1989.10478744</mixed-citation></ref><ref id="scirp.82716-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">Pakes, A. and Pollard, D. (1989) Simulation Asymptotic of Optimization Estimators. Econometrica, 57, 1027-1057. https://doi.org/10.2307/1913622</mixed-citation></ref><ref id="scirp.82716-ref17"><label>17</label><mixed-citation publication-type="book" xlink:type="simple">Newey, W.K. and McFadden, D. (1994) Large Sample Estimation and Hypothesis Testing. In: Engle, R.F. and McFadden, D., Eds., Handbook of Econometrics, Vol. 4, North Holland, Amsterdam.</mixed-citation></ref><ref id="scirp.82716-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">Davidson, R. and MacKinnon, J.G. (2004) Econometric Theory and Methods. Oxford University Press, Oxford.</mixed-citation></ref><ref id="scirp.82716-ref19"><label>19</label><mixed-citation publication-type="other" xlink:type="simple">Cressie, N. and Read, T. (1984) Multinomial Goodness of Fit Tests. Journal of the Royal Statistical Society, Series B, 46, 440-464.</mixed-citation></ref><ref id="scirp.82716-ref20"><label>20</label><mixed-citation publication-type="other" xlink:type="simple">Hogg, R.V., Mc Kean, J.W. and Craig, A. (2013) Introduction to Mathematical Statistics. 7th Edition, Pearson, Boston, MA.</mixed-citation></ref><ref id="scirp.82716-ref21"><label>21</label><mixed-citation publication-type="other" xlink:type="simple">Kloke, J. and McKean, J.W. (2015) Nonparametric Statistical Using R. CRC Press, New York.</mixed-citation></ref><ref id="scirp.82716-ref22"><label>22</label><mixed-citation publication-type="other" xlink:type="simple">Maronna, R.A., Martin, R.D. and Yohai, V.G. (2006) Robust Statistics: Theory and Methods. Wiley, New York. https://doi.org/10.1002/0470010940</mixed-citation></ref><ref id="scirp.82716-ref23"><label>23</label><mixed-citation publication-type="other" xlink:type="simple">Beran, R. (1977) Minimum Hellinger Distance Estimates for Parametric Models. Annals of Statistics, 5, 445-463. https://doi.org/10.1214/aos/1176343842</mixed-citation></ref><ref id="scirp.82716-ref24"><label>24</label><mixed-citation publication-type="other" xlink:type="simple">Lindsay, B.G. (1994) Efficiency versus Robustness: The Case for Minimum Hellinger Distance and Related Methods. Annals of Statistics, 22, 1081-1114.  
https://doi.org/10.1214/aos/1176325512</mixed-citation></ref><ref id="scirp.82716-ref25"><label>25</label><mixed-citation publication-type="other" xlink:type="simple">Gusak, D., Kukush, A., Kulik, A., Mishura, Y. and Pilipenko, A. (2010) Theory of Stochastic Processes with Applications to Financial Mathematics and Risk Theory. Springer, New York.</mixed-citation></ref><ref id="scirp.82716-ref26"><label>26</label><mixed-citation publication-type="other" xlink:type="simple">Pakes, A. (1986) Patents as Options: Some Estimates of the Value of Holding European Patent Stocks. Econometrica, 54, 755-784. https://doi.org/10.2307/1912835</mixed-citation></ref><ref id="scirp.82716-ref27"><label>27</label><mixed-citation publication-type="other" xlink:type="simple">Keener, R.W. (2016) Theoretical Statistics. Springer, New York.</mixed-citation></ref><ref id="scirp.82716-ref28"><label>28</label><mixed-citation publication-type="other" xlink:type="simple">Davidson, K.R. and Donsig, A.P. (2009) Real Analysis and Applications. Springer, New York.</mixed-citation></ref><ref id="scirp.82716-ref29"><label>29</label><mixed-citation publication-type="other" xlink:type="simple">Rudin, W. (1976) Principles of Mathematical Analysis. McGraw-Hill, New York.</mixed-citation></ref><ref id="scirp.82716-ref30"><label>30</label><mixed-citation publication-type="other" xlink:type="simple">Luong, A. and Thompson, M.E. (1987) Minimum Distance Methods Based on Quadratic Distance for Transforms. Canadian Journal of Statistics, 15, 239-251.  
https://doi.org/10.2307/3314914</mixed-citation></ref><ref id="scirp.82716-ref31"><label>31</label><mixed-citation publication-type="other" xlink:type="simple">Greenwood, P.E. and Nikulin, M.S. (1996) A Guide to Chi-Squared Testing. Wiley, New York.</mixed-citation></ref><ref id="scirp.82716-ref32"><label>32</label><mixed-citation publication-type="other" xlink:type="simple">Lehmann, E.L. (1999) Element of Large Sample Theory. Wiley, New York.  
https://doi.org/10.1007/b98855</mixed-citation></ref><ref id="scirp.82716-ref33"><label>33</label><mixed-citation publication-type="other" xlink:type="simple">Luong, A. (2016) Cramér-Von Mises Distance Estimation for Some Positive Infinitely Divisible Parametric Families with Actuarial Applications. Scandinavian Actuarial Journal, 2016, 530-549. https://doi.org/10.1080/03461238.2014.977817</mixed-citation></ref><ref id="scirp.82716-ref34"><label>34</label><mixed-citation publication-type="other" xlink:type="simple">Tsay, R.S. (2010) The Analysis of Financial Time Series. 3rd Edition, Wiley, New York. https://doi.org/10.1002/9780470644560</mixed-citation></ref><ref id="scirp.82716-ref35"><label>35</label><mixed-citation publication-type="other" xlink:type="simple">Butler, R.W. (2007) Saddlepoint Approximations with Applications. Cambridge University Press, Cambridge. https://doi.org/10.1017/CBO9780511619083</mixed-citation></ref><ref id="scirp.82716-ref36"><label>36</label><mixed-citation publication-type="other" xlink:type="simple">Abate, J. and Whitt, W. (1992) The Fourier Methods for Inverting Transforms of Probability Distributions. Queueing Systems, 10, 5-87.  
https://doi.org/10.1007/BF01158520</mixed-citation></ref><ref id="scirp.82716-ref37"><label>37</label><mixed-citation publication-type="other" xlink:type="simple">Devroye, L. (1993) A Triptych of Discrete Distributions Related to the Stable Laws. Statistics and Probability Letters, 18, 349-351.  
https://doi.org/10.1016/0167-7152(93)90027-G</mixed-citation></ref></ref-list></back></article>