<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article">
  <front>
    <journal-meta>
      <journal-id journal-id-type="publisher-id">OJS</journal-id>
      <journal-title-group>
        <journal-title>Open Journal of Statistics</journal-title>
      </journal-title-group>
      <issn pub-type="epub">2161-718X</issn>
      <publisher>
        <publisher-name>Scientific Research Publishing</publisher-name>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">10.4236/ojs.2017.72025</article-id>
      <article-id pub-id-type="publisher-id">OJS-75963</article-id>
      <article-categories>
        <subj-group subj-group-type="heading">
          <subject>Articles</subject>
        </subj-group>
        <subj-group subj-group-type="Discipline-v2">
          <subject>Physics&amp;Mathematics</subject>
        </subj-group>
      </article-categories>
      <title-group>
        <article-title>


          Likelihood and Quadratic Distance Methods for the Generalized Asymmetric Laplace Distribution for Financial Data

        </article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author" xlink:type="simple">
          <name name-style="western">
            <surname>Andrew</surname>
            <given-names>Luong</given-names>
          </name>
          <xref ref-type="aff" rid="aff1">
            <sub>1</sub>
          </xref>
          <xref ref-type="corresp" rid="cor1">
            <sup>*</sup>
          </xref>
        </contrib>
      </contrib-group>
      <aff id="aff1">
        <label>1</label>
        <addr-line>&amp;amp;Eacute;cole d’actuariat, Université Laval, Canada</addr-line>
      </aff>
      <author-notes>
        <corresp id="cor1">
          * E-mail:<email>andrew.luong@act.ulaval.ca</email>
        </corresp>
      </author-notes>
      <pub-date pub-type="epub">
        <day>20</day>
        <month>04</month>
        <year>2017</year>
      </pub-date>
      <volume>07</volume>
      <issue>02</issue>
      <fpage>347</fpage>
      <lpage>368</lpage>
      <history>
        <date date-type="received">
          <day>6,</day>
          <month>March</month>
          <year>2017</year>
        </date>
        <date date-type="rev-recd">
          <day>27,</day>
          <month>April</month>
          <year>2017</year>
        </date>
        <date date-type="accepted">
          <day>30,</day>
          <month>April</month>
          <year>2017</year>
        </date>
      </history>
      <permissions>
        <copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement>
        <copyright-year>2014</copyright-year>
        <license>
          <license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p>
        </license>
      </permissions>
      <abstract>
        <p>


          Maximum likelihood (ML) estimation for the generalized asymmetric Laplace (GAL) distribution also known as Variance gamma using simplex direct search algorithms is investigated. In this paper, we use numerical direct search techniques for maximizing the log-likelihood to obtain ML estimators instead of using the traditional EM algorithm. The density function of the GAL is only continuous but not differentiable with respect to the parameters and the appearance of the Bessel function in the density make it difficult to obtain the asymptotic covariance matrix for the entire GAL family. Using M-estimation theory, the properties of the ML estimators are investigated in this paper. The ML estimators are shown to be consistent for the GAL family and their asymptotic normality can only be guaranteed for the asymmetric Laplace (AL) family. The asymptotic covariance matrix is obtained for the AL family and it completes the results obtained previously in the literature. For the general GAL model, alternative methods of inferences based on quadratic distances (QD) are proposed. The QD methods appear to be overall more efficient than likelihood methods infinite samples using sample sizes
          <em>n</em>
          ≤5000 and the range of parameters often encountered for financial data. The proposed methods only require that the moment generating function of the parametric model exists and has a closed form expression and can be used for other models.

        </p>
      </abstract>
      <kwd-group>
        <kwd>M-Estimators</kwd>
        <kwd> Cumulant Generating Function</kwd>
        <kwd> Chi-Square Tests</kwd>
        <kwd> Generalized Hyperbolic Distribution</kwd>
        <kwd> Simplex Pattern Search</kwd>
        <kwd> Variance Gamma</kwd>
        <kwd> Minimum Distance</kwd>
        <kwd> Value at Risk</kwd>
        <kwd> Entropic Value at Risk</kwd>
        <kwd> European Call Option</kwd>
      </kwd-group>
    </article-meta>
  </front>
  
    
  <body>
    <sec id="s1">
      <title>1. Introduction</title>
      <sec id="s1_1">
        <title>1.1. Generalized Asymmetric Laplace (GAL) Distribution</title>
        <p>The generalized asymmetric Laplace distribution (GAL) is a four parameters infinitely divisible continuous distribution with four parameters given by</p>
        <p>β = ( θ , μ , σ , τ ) ′ . (1)</p>
        <p>
          The parameter θ is a location parameter and σ is a scale parameter. The parameter μ can be viewed as the asymmetry parameter of the distribution and τ is the shape parameter which controls the thickness of the tail of the distribution. If μ = 0 , the distribution is symmetric around θ , see Kotz et al. ( [<xref ref-type="bibr" rid="scirp.75963-ref1">1</xref>] , p. 180). It is flexible and can be used as an alternative to the four parameters stable distribution. The GAL distribution has a thicker tail than the normal distribution but unlike the stable distribution where even the first positive moment might not exist, all the positive integer moments exist. Its moment generating function is
        </p>
        <p>M ( s ) = e θ s ( 1 − μ s − 1 2 σ 2 s 2 ) τ , σ , τ ≥ 0 , β = ( θ , μ , σ , τ ) ′ , (2)</p>
        <p>s must satisfy the inequality</p>
        <p>1 − 1 2 σ 2 s 2 − μ s &gt; 0. (3)</p>
        <p>
          The GAL distribution is also known as variance gamma (VG) distribution. It was introduced by Madan and Senata [<xref ref-type="bibr" rid="scirp.75963-ref2">2</xref>] , Madan et al. [<xref ref-type="bibr" rid="scirp.75963-ref3">3</xref>] . For the GAL distribution, we adopt the parameterizations used by Kotz et al. [<xref ref-type="bibr" rid="scirp.75963-ref1">1</xref>] . It is not difficult to relate them to the original parameterization, see Senata [<xref ref-type="bibr" rid="scirp.75963-ref4">4</xref>] . The commonly used parameterisations will be discussed in Section (1.2).
        </p>
        <p>From the moment generating function, it is easy to see that the first four cumulants of the GAL distribution are given by</p>
        <p>c 1 = θ + τ μ , c 2 = τ σ 2 + τ μ 2 , (4)</p>
        <p>c 3 = 3 τ σ 2 μ + 2 τ μ 3 , c 4 = 6 τ μ 4 + 12 τ μ 2 σ 2 + 3 τ σ 4 . (5)</p>
        <p>
          Note that c 3 = 0 if μ = 0 and c 3 can be positive or negative depending on values of the parameters .Therefore, the GAL distribution can be symmetric or asymmetric. Furthermore, with c 4 &gt; 0 , the tail of the GAL distribution is thicker than the normal distribution. These characteristics make the GAL distribution useful for modelling asset returns, see Senata [<xref ref-type="bibr" rid="scirp.75963-ref4">4</xref>] for further discussions on financial modelling using the GAL distribution.
        </p>
        <p>The moments can be obtained based on cumulants and they are given below,</p>
        <p>E ( X ) = c 1 , E ( X − E ( X ) ) 2 = c 2 , E ( X − E ( X ) ) 3 = c 3 , E ( X − E ( X ) ) 4 = 6 τ μ 4 + 12 τ μ 2 σ 2 + 3 τ σ 4 + 3 τ 2 σ 4 + 6 σ 2 τ 2 μ 2 + 3 μ 4 τ 2 .</p>
        <p>The GAL distribution belongs to the class of normal mean-variance mixture distributions where the mixture variable follows agamma distribution with shape parameter τ and scale parameter equal to 1, i.e., with density function</p>
        <p>f w ( w ) = 1 Γ ( τ ) w τ − 1 e − w , w , τ &gt; 0 , Γ ( . ) is the commonly used gamma function.</p>
        <p>
          This leads to the following representation in distribution using Expression (4.1.10) in Kotz et al. ( [<xref ref-type="bibr" rid="scirp.75963-ref3">3</xref>] , p. 183),
        </p>
        <p>X = θ d + μ Y + σ Y Z where (6)</p>
        <p>1) Z ~ N ( 0 , 1 ) ,</p>
        <p>2) Y ~ G ( τ , 1 ) as given by expression (8) and independent of Z</p>
        <p>3) θ , μ , σ , τ are parameters with σ , τ &gt; 0 。</p>
        <p>
          The representation given by expression (6) is useful for simulating samples from a GAL distribution. Note that despite the simple closed form expression for the moment generating function, the density function is rather complicated as it depends on the modified Bessel function of the third kind with real index λ , i.e., K λ ( u ) see Kotz et al. ( [<xref ref-type="bibr" rid="scirp.75963-ref1">1</xref>] , p. 315) for various representations for the function K λ ( . ) . The density function will be introduced in Section (1.2). Using the moment generating function of the GAL distribution, it is easy to see that the distribution is related to a L&#233;vy process, see Podgorski and Wegener [<xref ref-type="bibr" rid="scirp.75963-ref5">5</xref>] for GAL processes.
        </p>
        <p>
          The GAL parametric family can be introduced as a limit case of the generalized hyperbolic (GH) family where the mixing random variable belongs to the generalized inverse Gaussian family, see Mc Neil et al. [<xref ref-type="bibr" rid="scirp.75963-ref6">6</xref>] for properties of the GH family. Note that the GAL family is nested within the bilateral gamma family as the GAL random variable can be represented in distribution as
        </p>
        <p>X = θ d + σ 2 ( 1 κ G 1 − κ G 2 ) , (7)</p>
        <p>G 1 and G 2 are independent random variables with common gamma distribution. The common mgf of the gamma distribution is given by</p>
        <p>
          M G ( s ) = 1 ( 1 − s ) α , see expression (4.1.1) given by Kotz et al. ( [<xref ref-type="bibr" rid="scirp.75963-ref1">1</xref>] , p. 183).
        </p>
        <p>If we introduce κ using μ = σ 2 ( 1 κ − κ ) , the GAL distribution can also be</p>
        <p>parameterised using the four equivalent parameters, i.e., with θ , σ , κ , τ .</p>
        <p>
          Moment estimation for the GAL family has been given by Podgorski and Wegener [<xref ref-type="bibr" rid="scirp.75963-ref5">5</xref>] . Maximum likelihood estimation for the GH family by fixing the parameter τ within some bounds has been given by Protassov [<xref ref-type="bibr" rid="scirp.75963-ref7">7</xref>] , McNeil et al. ( [<xref ref-type="bibr" rid="scirp.75963-ref6">6</xref>] , p. 80). For ML estimation, they implicitly assumed that the mixing random
        </p>
        <p>variable Y ~ Gamma ( τ , ϕ 2 ) which implies the following form of the moment</p>
        <p>generating function for X ,</p>
        <p>M ( s ) = e θ s ( 1 − ϕ 2 ( μ s + 1 2 σ 2 s 2 ) ) τ , ϕ &gt; 0.</p>
        <p>
          From the above expression, it is easy to see that the parameter ϕ &gt; 0 is redundant and the parameterisation using five parameters will introduce instability in the estimation process. It appears to be simpler to use the parameterisation given by Kotz et al. [<xref ref-type="bibr" rid="scirp.75963-ref1">1</xref>] or the parametrisation used by Madan and Senata [<xref ref-type="bibr" rid="scirp.75963-ref2">2</xref>] , Madan et al. [<xref ref-type="bibr" rid="scirp.75963-ref3">3</xref>] , Senata [<xref ref-type="bibr" rid="scirp.75963-ref4">4</xref>] with only four parameters by letting ϕ = 2 .
        </p>
        <p>
          Hu [<xref ref-type="bibr" rid="scirp.75963-ref8">8</xref>] advocated fitting the GAL distribution using the EM algorithm but the drawback of this approach is the difficulty to obtain the information matrix using the method of Louis [<xref ref-type="bibr" rid="scirp.75963-ref9">9</xref>] , see McLachlan and Krishnan [<xref ref-type="bibr" rid="scirp.75963-ref10">10</xref>] for a comprehensive review of the EM algorithm. The lack of a closed form asymptotic covariance matrix for the estimators might create difficulties for hypotheses testing.
        </p>
      </sec>
      <sec id="s1_2">
        <title>1.2. Some Properties of the GAL Distribution and Parameterisations</title>
        <p>In this subsection, we first review a few parameterisations which are commonly used for the GAL distribution.</p>
        <p>Definition 1 (GAL density)</p>
        <p>From the GH density, the density function for the GAL distribution can be obtained and it can be expressed as</p>
        <p>f ( x ; θ , σ , μ , τ ) = 2 e μ σ ( X − θ σ ) σ π Γ ( τ ) ( 1 2 + ( μ σ ) 2 ) τ − 0.5 ( | X − θ | σ ) τ − 0.5     ⋅ K τ − 0.5 ( 2 + ( μ σ ) 2 | X − θ | σ ) . (8)</p>
        <p>
          The vector of parameters is β = ( θ , μ , σ , τ ) ′ and we shall call this parametrisation parameterisation1.The density can be derived using thenormal mean variance mixture representation given by expression (6). See expression (3.30) given by Mc Neil et al. ( [<xref ref-type="bibr" rid="scirp.75963-ref6">6</xref>] , p. 78).
        </p>
        <p>Alternatively, by letting μ = σ 2 ( 1 κ − κ ) and keeping other parameters as in</p>
        <p>parametrisation 1, we obtain the following expression for the density of a GAL distribution</p>
        <p>f ( x ; θ , σ , κ , τ ) = 2 e 2 2 ( 1 κ − κ ) ( X − θ σ ) σ π Γ ( τ ) ( 2 1 κ + κ ) τ − 0.5 ( | X − θ | σ ) τ − 0.5 ⋅ K τ − 0.5 ( 1 2 ( 1 κ + κ ) | X − θ | σ ) . (9)</p>
        <p>
          with the vector of parameters given by β = ( θ , κ , σ , τ ) ′ . We shall call this parameterisation, parameterisation 2 which is used by Kotz et al. ( [<xref ref-type="bibr" rid="scirp.75963-ref1">1</xref>] , p. 184).
        </p>
        <p>Note that θ , σ are respectively the location and scale parameter with either parameterisation 1 or 2. Setting θ = 0 , σ = 1 , the standardized GAL density with parameterisation 2 will have only two parameters and it is given by</p>
        <p>f ε ( x ; κ , τ ) = 2 e 2 2 ( 1 κ − κ ) x π Γ ( τ ) ( 2 1 κ + κ ) τ − 0.5 ( | x | ) τ − 0.5 K τ − 0.5 ( 1 2 ( 1 κ + κ ) | x | )</p>
        <p>or equivalently by using parametrisation1,</p>
        <p>f ε ( x ; μ , τ ) = 2 e μ x π Γ ( τ ) ( 1 2 + ( μ ) 2 ) τ − 0.5 ( | x | ) τ − 0.5 K τ − 0.5 ( 2 + ( μ ) 2 | x | ) .</p>
        <p>
          Following Kotz et al. [<xref ref-type="bibr" rid="scirp.75963-ref1">1</xref>] we only use these two parametrisations but it is easy to see their relationships with parametrisation 3 used by Madan et al. [<xref ref-type="bibr" rid="scirp.75963-ref3">3</xref>] and Senata [<xref ref-type="bibr" rid="scirp.75963-ref4">4</xref>] . With parametrisation 3, the mgf of the GAL distribution is
        </p>
        <p>M ( s ) = e c s ( 1 − θ ′ ν s − 1 2 ν σ ' 2 s 2 ) 1 / ν , (10)</p>
        <p>the parameters are θ ′ , σ ′ , ν , c with</p>
        <p>θ ′ = μ ν , σ ′ 2 = σ 2 ν , ν = 1 / τ , c = θ .</p>
        <p>
          The first four moments using parameterisation 3 as given by Senata ( [<xref ref-type="bibr" rid="scirp.75963-ref4">4</xref>] , p. 181) aregiven below,
        </p>
        <p>E ( X ) = c + θ ′ , V ( X ) = σ ′ 2 + θ ′ 2 ν , E ( X − E ( X ) ) 3 = 2 θ ′ 3 ν 2 + 3 σ ′ 2 θ ′ ν , E ( X − E ( X ) ) 4 = 3 σ ′ 4 ν + 12 σ ′ 2 θ ′ 2 ν 2 + 6 θ ′ 4 ν 3 + 3 σ ′ 4 + 6 σ ′ 2 θ ′ 2 ν + 3 θ ′ 4 ν 2 . ,</p>
        <p>The GAL random variable can also be expressed as the difference of two independent gamma random variables, the GAL random variable is nested inside the class of bilateral gamma random variable Y which can be represented as</p>
        <p>Y = θ d + G 1 − G 2 (11)</p>
        <p>with G 1 , G 2 are independent gamma random variables with the mgf’s given</p>
        <p>respectively by M G 1 ( s ) = 1 ( 1 − β 1 s ) α and M G 2 ( s ) = 1 ( 1 − β 2 s ) α . We obtain the GAL random variable by letting β 1 = σ κ 2 and β 2 = κ σ 2 .</p>
        <p>
          The class of bilateral gamma distribution was introduced by K&#252;chler and Tappe [<xref ref-type="bibr" rid="scirp.75963-ref11">11</xref>] and they have shown that the Esscher transform of a bilateral gamma distribution remains within this class of distribution .More specifically, let Y E
        </p>
        <p>be the random variable with mgf given by M Y E ( s ) = M Y ( s + h ) M Y ( s ) . I is easy to see</p>
        <p>that Y E = θ d + G &#175; 1 − G &#175; 2 , G &#175; 1 and G &#175; 2 are independent gamma random variables with common shape parameter α ( α = 1 ) and scale parameters given</p>
        <p>respectively by β &#175; 1 = β 1 1 − β 1 h and β &#175; 2 = β 2 1 + β 2 h .</p>
        <p>
          For option pricing with the risk neutral approach, this property is useful as it is easy to simulate samples from a bilateral gamma distribution. The use of Esscher transform to find risk neutral parameters for option pricing in financeisdue to the seminal works of Gerber and Shiu [<xref ref-type="bibr" rid="scirp.75963-ref12">12</xref>] . The Esscher transform risk neutral parameters can also be interpreted as minimum entropy risk neutral parameters. See Miyahara [<xref ref-type="bibr" rid="scirp.75963-ref13">13</xref>] for this interpretation, see section 4 for more discussions on financial applications.
        </p>
        <p>
          For numerical methods to find estimators, Nelder-Mead simplex method and related derivative free simplex methods are recommended. Derivative free simplex direct search methods are well described in chapter 16 of the book by Bierlaire [<xref ref-type="bibr" rid="scirp.75963-ref14">14</xref>] .
        </p>
        <p>The paper is organized as follows. In Section 2, some submodels of the GAL family are introduced to highlight the difficulty on obtaining the asymptotic covariance matrix using classical likelihood theory. Asymptotic properties of the ML estimators are investigated in section (3). The ML estimators for the GAL</p>
        <p>family are shown to be consistent for τ &gt; 1 2 . For the special case with τ = 1 ,</p>
        <p>
          this corresponds to the asymmetric Laplace (AL) model, we obtain the asymptotic covariance matrix in closed form using the approach based on M-estima- tion theory as given by Huber [<xref ref-type="bibr" rid="scirp.75963-ref15">15</xref>] which completes the missing components of expression (2) given by Kotz et al. ( [<xref ref-type="bibr" rid="scirp.75963-ref16">16</xref>] , p. 818). As an alternative to ML estimation, QD estimation based on matching cumulant generating functions is developed in section (4) for the entire GAL family. The QD estimators are shown to be consistent and follow an asymptotic normal distribution. The asymptotic covariance matrix can be obtained in closed form for the entire GAL family using QD methods which makes testing for parameters easy to implement. Chi-square goodness of fit tests statistics can also be constructed based on the distance function used to obtained QD estimators. The methods are also general and can be applied to other models. Numerical issues and simulations illustrations are discussed in Section (5). A limited simulation study shows that the proposed QD estimators perform better than ML estimators overall for sample sizes n ≤ 5000 using parameters values often encountered for financial data. Some applications drawn from finance are discussed in Section (6).
        </p>
        <p>We shall consider first a few submodels of the GAL model to show the difficulties encountered when likelihood theory is used to obtain the asymptotic covariance matrix for ML estimators.</p>
        <p>
          The difficulties are mainly due to the score functions when viewed as functions of the parameters have a discontinuity point and fail to be differentiable. If the asymptotic covariance matrix for the ML estimators is derived based on likelihood theory, it will have missing components. This is the problem of expression (2) given by Kotz et al. ( [<xref ref-type="bibr" rid="scirp.75963-ref16">16</xref>] , p. 818) for the AL family, a subfamily of the GAL family. M-estimation theory will be used to replace likelihood theory for deriving the asymptotic covariance matrix.
        </p>
      </sec>
    </sec>
    <sec id="s2">
      <title>2. Some Subfamilies of the GAL Family</title>
      <p>Example 1</p>
      <p>Let μ = 0 , τ = 1 , σ = 1 , τ = 1 and the only parameter is the location parameter</p>
      <p>and the family is symmetric around θ . Using the result K 1 2 ( u ) = π 2 u e − u , the</p>
      <p>density function is reduced to</p>
      <p>f ( x , θ ) = 1 2 s 0 e − | x − θ | s 0 , s 0 = 1 2 .</p>
      <p>Equivalently,</p>
      <p>f ( x , θ ) = f 0 ( x − θ ) , f 0 ( x ) = 1 2 e − 2 | x | , − ∞ &lt; x &lt; ∞ .</p>
      <p>
        This is the well known double exponential distribution, the maximum likelihood estimator for θ is the sample median. There is no Fisher information matrix available as the score function is discontinuous with respect to the parameter θ . The asymptotic variance of the sample median can be found by using M-estimation theory, see Huber [<xref ref-type="bibr" rid="scirp.75963-ref17">17</xref>] , Huber [<xref ref-type="bibr" rid="scirp.75963-ref15">15</xref>] , also see Amemiya ( [<xref ref-type="bibr" rid="scirp.75963-ref18">18</xref>] , p. 148-154) on the least absolute deviations (LAD) estimator .We shall use the same approach to derive the asymptotic covariance matrix for the ML estimators for the GAL distribution with τ = 1 . The GAL distribution when τ = 1 is the asymmetric Laplace (AL) distribution. The AL distribution will be introduced below.
      </p>
      <p>Example 2</p>
      <p>
        Using the density of the GAL distribution and setting τ = 1 , we obtain the AL distribution with only 3 parameters. The location and scale parameters are given respectively by θ , σ and the asymmetry parameter μ . If parameterisation 2 is used, the density function g ( x ; θ , σ , κ ) of the AL distribution is based on the standardized AL density as given by expression (4.1.31) in Kotz et al. ( [<xref ref-type="bibr" rid="scirp.75963-ref1">1</xref>] , p. 189) with
      </p>
      <p>g ( x ; θ , σ , κ ) = 2 σ γ exp ( 2 2 δ ( X − θ σ ) ) exp ( − 2 2 γ ( | X − θ | σ ) ) , γ = κ + 1 k , δ = κ − 1 k .</p>
      <p>
        The AL family can be considered as a subfamily of the GAL family and the score functions for this model are again discontinuous. We shall derive the asymptotic covariance matrix using M-estimation theory in Section (3.2) and complete the expression (2) of Kotz et al. ( [<xref ref-type="bibr" rid="scirp.75963-ref16">16</xref>] , p. 818). The expression derived by the authors has missing components as it is derived based on likelihood theory. Kotz et al. [<xref ref-type="bibr" rid="scirp.75963-ref16">16</xref>] used a different parametrisation but it is equivalent to the one used in Kotz et al. ( [<xref ref-type="bibr" rid="scirp.75963-ref1">1</xref>] , p. 189) and it is not difficult to establish the links between these 2 parameterisations.
      </p>
    </sec>
    <sec id="s3">
      <title>3. Maximum Likelihood Estimation for the GAL Family</title>
      <sec id="s3_1">
        <title>3.1. Maximum Likelihood Estimation for the GAL Distribution</title>
        <p>
          For consistency of the MLE, the following Theorem which is Theorem 2.5 given by Newey and McFadden ( [<xref ref-type="bibr" rid="scirp.75963-ref19">19</xref>] , p. 2131) is useful. We make the basic assumption that we have a random sample which consists of n iid observations X 1 , ⋯ , X n drawn from the GAL parametric family with density f ( x ; β ) where β 0 is the vector of the true parameters.
        </p>
        <p>Theorem (Consistency)</p>
        <p>Assume that:</p>
        <p>1) If β 1 ≠ β 2 then f ( x ; β 1 ) ≠ f ( x ; β 2 ) .</p>
        <p>2) The parameter space Θ is compact, β 0 ∈ Θ .</p>
        <p>3) f ( x ; β ) is a continuous with respect to β .</p>
        <p>4) E ( sup β ∈ Θ | ln f ( x ; β ) ) &lt; ∞ .</p>
        <p>Under the conditons stated, the ML estimators (MLE) given by the vector β ^ is obtained by maximizing the log of the likelihood function</p>
        <p>ln L ( β ) = ∑ i = 1 n ln f ( x ; β ) is consstent, β ^ → p β 0 .</p>
        <p>One can see that the conditions for consistency are mild, the condition d) will</p>
        <p>be satisfied for the GAL family if τ &gt; 1 2 as the density function remains bounded. For τ ≤ 1 2 , the density functions with θ = 0 , μ = 0 tend to infinity as</p>
        <p>
          x → 0 + , see Theorem 4.1.2 given by Kotz et al. ( [<xref ref-type="bibr" rid="scirp.75963-ref1">1</xref>] , p. 190-192).
        </p>
        <p>
          It might be possible to prove consistency using the approach to obtain results of Theorem 4 by Broniatowski et al. ( [<xref ref-type="bibr" rid="scirp.75963-ref20">20</xref>] , p. 2578).
        </p>
        <p>For asymptotic normality, it is more complicated as standard theory often requires that the function ln L ( β ) being twice differentiable with respect to β . The appearance of the Bessel function creates further complications. It makes it very difficult to establish asymptotic properties even with the use of M estimation theory.</p>
        <p>
          For the special case with τ = 1 which corresponds to the AL distribution, the density function can be expressed without the use of the Bessel function and M- estimation theory can be used to find the asymptotic covariance matrix for the ML estimators. Asymptotic normality has been shown by Kotz et al. ( [<xref ref-type="bibr" rid="scirp.75963-ref1">1</xref>] , p. 158-174) but the asymptotic covariance matrix of the ML estimators is still incomplete.
        </p>
        <p>
          The formula (2.2) given by Kotz et al. ( [<xref ref-type="bibr" rid="scirp.75963-ref16">16</xref>] , p. 818) does not give the correct asymptotic covariance for the ML estimators. The complete formula for the asymptotic covariance matrix of the ML estimators can be obtained using M-estimation theory. An example is given at the end of section (3.2) which shows that one cannot recover the common asymptotic variance of the sample median using results in Kotz et al. ( [<xref ref-type="bibr" rid="scirp.75963-ref16">16</xref>] , p. 818).
        </p>
        <p>
          M-estimation theory allows the score functions when viewed as functions of the parameters to have a few points of discontinuities and full differentiability with respect to β can be replaced by one side differentiability accordingly. Amemiya ( [<xref ref-type="bibr" rid="scirp.75963-ref18">18</xref>] , p. 151) uses this approach. For establishing asymptotic normality for the sample median, the sample median is viewed as a root given by a solution of the estimating equation
        </p>
        <p>1 n ∑ i = 1 n ψ ( x i , θ ) = 0 ,</p>
        <p>using the indicator function I [ . ] ,</p>
        <p>ψ ( x , θ ) = − I [ θ &lt; x ] and ψ ( x , θ ) = I [ θ &gt; x ] , ψ ( x , θ ) = 0 if x = θ .</p>
        <p>The function ψ ( x , θ ) is simply the one side derivative and we adopt the notation</p>
        <p>ψ ( x , θ ) = ∂ | x − θ | ∂ θ with the meaning of one side derivative, also see Hogg et</p>
        <p>
          al. ( [<xref ref-type="bibr" rid="scirp.75963-ref21">21</xref>] , p. 538) on estimating equations based on the sign test. The probability of the existence of such a root tend to 1 as n → ∞ .
        </p>
        <p>
          Another M estimator for the location parameter θ has been proposed by Huber ( [<xref ref-type="bibr" rid="scirp.75963-ref17">17</xref>] , p. 232-233). It consists of estimating θ by solving
        </p>
        <p>1 n ∑ i = 1 n ψ ( x i , θ ) = 0 with</p>
        <p>ψ ( x , θ ) = x − θ if | x − θ | ≤ k , k is chosen.</p>
        <p>ψ ( x , θ ) = k , if | x − θ | &gt; k .</p>
        <p>
          For M-estimators based on ψ ( x , β ) , where β is a vector of parameters, Huber [<xref ref-type="bibr" rid="scirp.75963-ref17">17</xref>] , Huber [<xref ref-type="bibr" rid="scirp.75963-ref15">15</xref>] has generalized and relaxed conditions for the classical Taylor expansion. The technical details can be found in his seminal paper and in Huber [<xref ref-type="bibr" rid="scirp.75963-ref15">15</xref>] . It can be summarized as follows. Suppose that the M-estimators given by β ^ , given as the roots of the following estimating functions
        </p>
        <p>1 n ∑ i = 1 n ψ ( x , β ) = 0 . (12)</p>
        <p>Under the following main conditions:</p>
        <p>a) 1 n ∑ i = 1 n ψ ( x i , β ^ ) → p 0 , assuming β ^ → p β 0 has been shown,</p>
        <p>b) λ ( β 0 ) = E β 0 ( β 0 ) = 0 , λ ( β ) = E β 0 ( ψ ( x , β ) ) ,</p>
        <p>
          with assumption N-3 given by Huber ( [<xref ref-type="bibr" rid="scirp.75963-ref15">15</xref>] , p. 132) and λ ( β ) is differentiable with respect to β , then we have the following representation:
        </p>
        <p>1 n ∑ i = 1 n ψ ( x , β 0 ) = − Λ ( β 0 ) n ( β ^ − β 0 ) + o p ( 1 ) ,</p>
        <p>Λ ( β 0 ) = ∂ λ ( β ) ∂ β ′ | β = β 0 and o p ( 1 ) is a term converging to 0 in probability.</p>
        <p>When we compare with the usual Taylor expansion, we only require λ ( β ) = E β 0 ( ψ ( x , β ) ) to be differentiable with respect to β . This differentiability condition is satisfied for the AL family. Note that if indeed the score functions are differentiable then − Λ ( β 0 ) is the Fisher information matrix.</p>
        <p>
          For the technical details on how to verify the conditions N-3, see Hinkley and Revankar ( [<xref ref-type="bibr" rid="scirp.75963-ref22">22</xref>] , p. 7). The condition 1) is usually verified by making use of the Lebesgue dominated convergence theorem (LDGT) as given by Rudin ( [<xref ref-type="bibr" rid="scirp.75963-ref23">23</xref>] , p. 321). It can become every technical to construct integrable functions to bound the score functions in order to check the sufficient conditions for the LDGT but they are expected to hold for the AL distribution with the existence of all integer positive moments and the parameters space is assumed to be compact. Essentially, we need to show that the condition 2) is met by showing the convergence in probability of the integrals
        </p>
        <p>∫ − ∞ ∞ ψ ( x , β ^ ) d F n ( x ) → p ∫ − ∞ ∞ ψ ( x , β 0 ) d F β 0 ( x ) = E β 0 ( β 0 ) = 0 , F n ( x ) is the</p>
        <p>sample distribution function, the score functions are given by expressions (14)-(16).</p>
        <p>From the above representation, we then have</p>
        <p>n ( β ^ − β 0 ) → L N ( 0 , ( [ Λ ( β 0 ) ] − 1 ) ) V β 0 ( ψ ( x , β 0 ) ) ( [ Λ ( β 0 ) ] − 1 ) ′ .</p>
        <p>The asymptotic covariance matrix of β ^ is given by</p>
        <p>V ( β ^ ) = 1 n ( [ Λ ( β 0 ) ] − 1 ) V β 0 ( ψ ( x , β 0 ) ) ( [ Λ ( β 0 ) ] − 1 ) ′ , (13)</p>
        <p>V β 0 ( ψ ( x , β 0 ) ) is the covariance matrix of the vector ψ ( x , β 0 ) , ψ ( x , β 0 ) is the vector of the true score functions or quasi score functions if a proxy density function is used to replace the true density function.</p>
        <p>Now based on M-estimation theory, we proceed to find Λ ( β 0 ) and V β 0 ( ψ ( x , β 0 ) ) for the AL distribution to obtain the asymptotic covariance matrix of the ML estimators in the following section.</p>
      </sec>
      <sec id="s3_2">
        <title>3.2. Asymptotic Covariance Matrix for the AL Family</title>
        <p>
          Kotz et al. [<xref ref-type="bibr" rid="scirp.75963-ref1">1</xref>] , Kotz et al. [<xref ref-type="bibr" rid="scirp.75963-ref16">16</xref>] have shown that the ML estimators for the AL distribution have an asymptotic normal distribution but their asymptotic covariance matrix given by expression (3.5.1) of Kotz ( [<xref ref-type="bibr" rid="scirp.75963-ref1">1</xref>] , p. 158) which is identical to expression (2) given by Kotz et al. ( [<xref ref-type="bibr" rid="scirp.75963-ref16">16</xref>] , p. 818) is still incomplete. If M-esti- mation theory is used then the asymptotic covariance matrix should be based on Corollary (3.2) as given by Huber ( [<xref ref-type="bibr" rid="scirp.75963-ref15">15</xref>] , p. 133), also see expression (12.18) given by Woolridge ( [<xref ref-type="bibr" rid="scirp.75963-ref24">24</xref>] , p. 407).
        </p>
        <p>Since</p>
        <p>ln g ( x ; θ , σ , κ ) = ln 2 − ln σ − ln γ + δ 2 2 ( x − θ ) σ − γ 2 2 | x − θ | σ ,</p>
        <p>the following derivatives are the score functions of the AL distribution,</p>
        <p>ψ 1 ( x ; θ , σ , κ ) = ∂ ln g ( x ; θ , σ , κ ) ∂ θ = − 2 δ 2 σ − 2 γ 2 σ v ( x ; θ )       with   v ( x ; θ ) = − I [ x &gt; θ ] + I [ x &lt; θ ] ,   v ( x ; θ ) = 0   if   x = θ . (14)</p>
        <p>ψ 2 ( x ; θ , σ , κ ) = ∂ ln g ( x ; θ , σ , κ ) ∂ σ = − 1 σ − 2 δ 2 ( x − θ ) σ 2 + 2 γ 2 | x − θ | σ 2 , (15)</p>
        <p>ψ 3 ( x ; θ , σ , κ ) = ∂ ln g ( x ; θ , σ , κ ) ∂ κ = − ∂ γ ∂ κ γ + ∂ δ ∂ κ 2 ( x − θ ) σ − 2 2 ∂ γ ∂ κ | x − θ | σ . (16)</p>
        <p>Let β = ( θ , σ , κ ) ′ and β 0 the vector of the true parameters we need to find first the vector</p>
        <p>λ ( β ) = ( λ 1 ( β ) , λ 2 ( β ) , λ 3 ( β ) ) ′ , λ i ( β ) = E β 0 ( ψ i ( x ; θ , σ , κ ) ) , i = 1 , 2 , 3.</p>
        <p>Subsequently, we need to find the derivatives of these expressions with respect to β then evaluated at β = β 0 to obtain the matrix − Λ ( β 0 ) . The matrix − Λ ( β 0 ) generalizes the Fisher information matrix.</p>
        <p>It will be reduced to this matrix if the score functions ψ i ( x ; β ) , i = 1 , 2 , 3 , are differentiable with respect to β . It is clear that the elements of Λ ( β 0 ) will have closed form expressions but are lengthy to display. To obtain E β 0 ( ψ i ( x ; θ , σ , κ ) ) , i = 1 , 2 , 3 , note that we have a location and scale parameter. Consequently, it appears to be simpler to define first the standardized AL density as the AL density with θ = 0 , σ = 1 , i.e.,</p>
        <p>g ε ( x ; κ ) = 2 γ exp ( 2 2 δ x ) exp ( − 2 2 γ ( | x | ) ) and the AL density with three</p>
        <p>parameters as</p>
        <p>g ( x ; θ , σ , κ ) = 1 σ g ε ( x − θ σ ; κ ) .</p>
        <p>Making use of g ε ( x ; κ ) ,</p>
        <p>E β 0 ( v ( x ; θ ) ) = ∫ θ ∞ 1 σ 0 g ε ( x − θ 0 σ 0 ; κ 0 ) d x − ∫ − ∞ θ 1 σ 0 g ε ( x − θ 0 σ 0 ; κ 0 ) d x ,</p>
        <p>or</p>
        <p>E β 0 ( v ( x ; θ ) ) = 1 − 2 G ε ( θ − θ 0 σ 0 ; κ 0 ) , (17)</p>
        <p>G ε ( x ; κ ) is the distribution function with density function g ε ( x ; κ ) .</p>
        <p>Similarly,</p>
        <p>E β 0 ( | x − θ | ) = ∫ θ ∞ ( x − θ ) g ε ( x − θ 0 σ 0 ; κ 0 ) d x + ∫ − ∞ θ ( θ − x ) 1 σ 0 g ε ( x − θ 0 σ 0 ; κ 0 ) d x . (18)</p>
        <p>Therefore, ∂ E β 0 ( | x − θ | ) ∂ θ can be obtained by first evaluating the term</p>
        <p>∂ ∂ θ ∫ θ ∞ ( x − θ ) 1 σ 0 g ε ( x − θ 0 σ 0 ; κ 0 ) d x = − ∫ θ ∞ 1 σ 0 g ε ( x − θ 0 σ 0 ; κ 0 ) d x = − [ 1 − G ε ( θ − θ 0 σ 0 ; κ 0 ) ] ,</p>
        <p>using Leibnitz’s rule which taking into account the lower bound of the interval also depends on θ then subsequently evaluate using Leibnitz’s rule the expression</p>
        <p>∂ ∂ θ ∫ − ∞ θ ( θ − x ) 1 σ 0 g ε ( x − θ 0 σ 0 ; κ 0 ) d x = G ε ( θ − θ 0 σ 0 ; κ 0 ) .</p>
        <p>Consequently,</p>
        <p>∂ E β 0 ( | x − θ | ) ∂ θ = − 1 + 2 G ε ( θ − θ 0 σ 0 ; κ 0 ) .</p>
        <p>The elements of Λ ( β 0 ) can be found subsequently by first forming</p>
        <p>λ 1 ( β ; β 0 ) = ∫ − ∞ ∞ ψ 1 ( x , β ) g ( x ; β 0 ) d x = − 2 2 δ σ − 2 2 γ σ E β 0 ( v ( x ; θ ) ) ,</p>
        <p>E β 0 ( v ( x ; θ ) ) is as given by expression (17). Also,</p>
        <p>λ 2 ( β ; β 0 ) = ∫ − ∞ ∞ ψ 2 ( x , β ) g ( x ; β 0 ) d x = − 1 σ − 2 2 δ σ 2 ( E β 0 ( x ) − θ ) + 2 2 γ σ 2 E β 0 ( | x − θ | ) ,</p>
        <p>E β 0 ( | x − θ | ) is as given by expression (18), E β 0 ( x ) = θ 0 + τ 0 μ 0 with τ 0 = 1 using expression (4). With</p>
        <p>λ 3 ( β ; β 0 ) = ∫ − ∞ ∞ ψ 3 ( x , β ) g ( x ; β 0 ) d x or equivalently,</p>
        <p>λ 3 ( β ; β 0 ) = − ∂ γ ∂ κ γ + ∂ γ ∂ κ 2 σ ( E β 0 ( x ) − θ ) − 2 2 ∂ γ ∂ κ E β 0 ( | x − θ | ) ,</p>
        <p>then the matrix Λ ( β 0 ) can be obtained by differentiating with respect to β the vector</p>
        <p>λ ( β ; β 0 ) = ( λ 1 ( β ; β 0 ) , λ 2 ( β ; β 0 ) , λ 3 ( β ; β 0 ) ) ′ and set β = β 0 , i.e.,</p>
        <p>Λ ( β 0 ) = ∂ λ ( β ; β 0 ) ∂ β ′ | β = β 0 .</p>
        <p>Clearly, the elements of the matrix Λ ( β 0 ) have closed form expressions but are lengthy to display. Packages like MATLAB or Mathematica can handle symbolic derivatives and can be used to obtain these elements. Substituting β 0 by the ML estimator β ^ in Λ ( β 0 ) yields an estimate for the matrix Λ ( β 0 ) .</p>
        <p>
          Now we turn our attention to the matrix ∑ which is the covariance matrix of the vector of score functions ψ ( x , β 0 ) = ( ψ 1 ( x , β 0 ) , ψ 2 ( x , β 0 ) , ψ 3 ( x , β 0 ) ) ′ . Using a different but equivalent parameterisation, this matrix has been obtained by Kotz et al. ( [<xref ref-type="bibr" rid="scirp.75963-ref16">16</xref>] , p. 818), Kotz et al. ( [<xref ref-type="bibr" rid="scirp.75963-ref1">1</xref>] , p. 158) but its inverse does not give the asymptotic covariance matrix of the ML estimators as claimed in their paper. It is not difficult to establish the relationships between the parameterisation used in example 2 and the one used in the paper by Kotz et al. ( [<xref ref-type="bibr" rid="scirp.75963-ref1">1</xref>] , p. 818).
        </p>
        <p>Note that the inverse of Σ is not the asymptotic covariance matrix of the ML</p>
        <p>estimators is due to Λ ( β 0 ) = ∂ λ ( β ; β 0 ) ∂ β ′ | β = β 0 is not equal to − Σ − 1 if the differ-</p>
        <p>
          rentiability assumptions for the score functions do not hold, see corollary (3.2) and proposition (3.3) given by Huber ( [<xref ref-type="bibr" rid="scirp.75963-ref15">15</xref>] , p. 133).
        </p>
        <p>The matrix Σ can also be estimated by the following estimator</p>
        <p>1 n ∑ i = 1 n [ ψ ( x i , β ^ ) ] [ ψ ( x i , β ^ ) ] ′ .</p>
        <p>
          Let us consider the following location model with known σ 0 and check the expression (2.2) as given by Kotz et al. ( [<xref ref-type="bibr" rid="scirp.75963-ref16">16</xref>] , p. 818) has missing components. The density function is given by
        </p>
        <p>f ( x ; θ ) = 1 σ 0 2 e − 2 σ 0 | x − θ | , or alternatively the density can also be expressed as</p>
        <p>f ( x ; θ ) = f 0 ( x − θ ) , f 0 ( x ) = 1 σ 0 2 e − 2 | x | σ 0 .</p>
        <p>This subfamily will correspond to their parametrisation with κ = 1 ​ in their paper. The sample median θ ^ is the ML estimator for θ , using their result it will</p>
        <p>lead to conclude that the asymptotic variance is given by ( E ( ∂ ln f ∂ θ ) 2 ) − 1 = σ 0 2 2 ,</p>
        <p>as indicated by case1 in the table of their paper. On the other hand, it is known that the asymptotic distribution of the sample median is given by</p>
        <p>n ( θ ^ − θ 0 ) → L N ( 0 , 1 4 ( f 0 ( 0 ) ) 2 ) , see expression (2.4.19) given by Lehmann</p>
        <p>
          ( [<xref ref-type="bibr" rid="scirp.75963-ref25">25</xref>] , p. 81) for example. For the location model being considered, we have
        </p>
        <p>1 4 ( f 0 ( 0 ) ) 2 = 1 8 σ 0 2 . Clearly, 1 8 σ 0 2 ≠ σ 0 2 2 but the correct asymptotic variance can</p>
        <p>be obtained using expression (13).</p>
        <p>For the general GAL distribution with four parameters, alternative methods of estimation based on quadratic distances (QD) which make use of the empirical cumulant generating function will be introduced in the next section. The QD</p>
        <p>methods are developed based on empirical findings which show that the ML methods for finite sample sizes as large as n = 5000 do not give good estimates for the shape parameter τ and the scale parameter σ but ML methods give good estimates for the other two parameters. Howewer, the overall efficiency of ML methods lags behind QD methods in finite samples. Also, QD methods beside giving better estimates for σ and τ , the methods can be used for parameter testing since the asymptotic covariance matrix for the QD estimators can be obtained explicitly for the entire GAL family. The methods also provide a chi- square test statistics of goodness-of-fit for the model being used. Therefore, it might be of interests to consider using QD methods whenever ML methods might have deficiencies.</p>
      </sec>
    </sec>
    <sec id="s4">
      <title>4. Quadratic Distance Methods</title>
      <p>
        General Quadratic distance (QD) theory has been developed in Luong and Thompson [<xref ref-type="bibr" rid="scirp.75963-ref26">26</xref>] . Howewer, if it is used for estimating parameters of the GAL distribution we need to specify a distance which can generate estimators with good efficiencies. For applied works, it is also preferable to have methods which are relatively simple to implement numerically.
      </p>
      <p>For financial data, observations are recorded as percentages so they are small in magnitude, we recommend minimizing the following distance based on matching the empirical cumulant generating function K n ( t ) with its model counterpart K β ( t ) using the following points</p>
      <p>t j , j = 1 , ⋯ , m = 20</p>
      <p>with</p>
      <p>t 1 = 0.01 , t 2 = 0.02 , ⋯ , t 10 = 0.1 , t 11 = − 0.01 , t 12 = − 0.02 , ⋯ , t 20 = − 0.1. (19)</p>
      <p>The choice of points as given above is suggested based on empirical findings that overall, the QD estimators are more efficient than the ML estimators for the range of parameters often encountered for modelling financial data using finite sample sizes as large as n = 5000. Note that the set of points chosen does not include the origin 0.</p>
      <p>The empirical moment generating function, empirical cumulant generating function are given respectively by</p>
      <p>M n ( s ) = 1 n ∑ i = 1 n e s X i and K n ( s ) = log M n ( s ) .</p>
      <p>The model cumulant generating function is K β ( t ) , K β ( t ) = log M β ( t ) with M β ( s ) being the model moment generating function as defined by expression (1). The proposed QD estimators given by the vector β ˜ is obtained by minimizing with respect to β the following specific QD distance given by</p>
      <p>D ( β ) = ∑ j = 1 20 ( K n ( s j ) − K β ( s j ) ) 2 . (20)</p>
      <p>Once the estimates are obtained, goodness of fit test statistics with an asymptotic chi-square distribution with r = 16 degree of feedom can also be constructed. General QD distances theory can be used to derive the asymptotic covariance matrix of the QD estimators and the chi-square goodness of fit test statistics. They will be given at the end of this section. Having the asymptotic covariance matrix of the QD estimators in closed form for the GAL family is useful for parameter testing.</p>
      <p>For notations, let us define the vector based on observations</p>
      <p>z n = ( K n ( t 1 ) , ⋯ , K n ( t m ) ) ′ , m = 20 .</p>
      <p>Its model counterpart is the vector</p>
      <p>z β = ( K β ( t 1 ) , ⋯ , K β ( t m ) ) ′ .</p>
      <p>Therefore,</p>
      <p>D ( β ) = ( z n − z β ) ′ ( z n − z β ) .</p>
      <p>Observe that the elements of the covariance matrix V M for the vector</p>
      <p>n ( M n ( t 1 ) , ⋯ , M n ( t m ) ) ′ are given by</p>
      <p>V M ( i , j ) = M β ( t i + t j ) − M β ( t i ) M β ( t j ) , i = 1 , ⋯ , 20 , j = 1 , ⋯ , 20.</p>
      <p>The elements of the approximate covariance matrix based on the differential method or delta method for</p>
      <p>n ( K n ( t 1 ) , ⋯ , K n ( t m ) ) ′</p>
      <p>are given by</p>
      <p>V K ( i , j ) = ( M β ( t i + t j ) − M β ( t i ) M β ( t j ) ) / ( M β ( t i ) M β ( t j ) ) , i = 1 , ⋯ , 20 , j = 1 , ⋯ , 20.</p>
      <p>
        Under the regularity conditions given by Lemma (3.4.1) of Luong and Thompson ( [<xref ref-type="bibr" rid="scirp.75963-ref26">26</xref>] , p. 244), the QD estimators given by the vector β ˜ are consistent. Clearly, we need to assume that on the restricted parameter space the model moment generating function and the covariance matrix V M given by expression (21) are well defined. Some modifications might be necessary if the methods are applied to other models. The conditions are met in general for the GAL distribution when used for modeling financial data. We then have
      </p>
      <p>n ( β ˜ − β 0 ) → L N ( 0 , V ) , V = ( S ′ S ) − 1 S ′ V K S ( S ′ S ) − 1 .</p>
      <p>The asymptotic covariance for the QD estimators is simply 1 n V .</p>
      <p>All the expressions which form V as given above are evaluated under the true vector of parameters β 0 , β = ( θ , μ , σ , τ ) ′ = ( β 1 , β 2 , β 3 , β 4 ) ′ and</p>
      <p>S = [ ∂ K β ( t 1 ) ∂ β 1 ⋯ ∂ K β ( t 1 ) ∂ β 4 ⋮ ⋱ ⋮ ∂ K β ( t m ) ∂ β 1 ⋯ ∂ K β ( t m ) ∂ β 4 ] , S ′ is the transpose of S .</p>
      <p>
        We also use S = S ( β 0 ) , V K = V ( β 0 ) , Σ 2 = Σ 2 ( β 0 ) to emphasize that these matrices depend on β 0 . The matrix Σ 2 is derived below. For constructing test statistics with chi-square limiting distribution, use expression (3.4.2) given by Luong and Thompson ( [<xref ref-type="bibr" rid="scirp.75963-ref26">26</xref>] , p. 248) to obtain
      </p>
      <p>n ( z n − z β ˜ ) → L N ( 0 , Σ 2 ) with Σ 2 , a covariance matrix which depends on β 0 and</p>
      <p>Σ 2 = [ I − S ( S ′ S ) − 1 S ′ ] V K [ I − S ( S ′ S ) − 1 S ′ ] . (21)</p>
      <p>In practice, β 0 needs te be replaced by β ˜ so that an estimate of Σ 2 can be defined as</p>
      <p>Σ ˜ 2 = Σ 2 ( β ˜ ) .</p>
      <p>We need to find the Moore-Penrose (MP) generalized inverse for Σ ˜ 2 to constructa chi-square statistics. The quadratic form constructed with the MP inverse will follow a chi-square distribution asymptotically. Many computer packages provide prewritten functions to find the Moore-Penrose inverse of a matrix. It can also be computed easily using the spectral decomposition of Σ ˜ 2 , i.e., using the representation Σ ˜ 2 = P D P ′ . The columns of the matrix P are the eigenvectors of Σ ˜ 2 and D is a diagonal matrix with the diagonal elements being the corresponding eigenvalues of Σ ˜ 2 given respectively by λ i ≥ 0 , i = 1 , ⋯ , m . The matrix P is orthonormal with the property P P ′ = I .</p>
      <p>The Moore Penrose inverse Σ ˜ 2 M P can be obtained as</p>
      <p>Σ ˜ 2 M P = P D − P ′ with</p>
      <p>D − being the diagonal matrix constructed based on the diagonal elements λ i , i = 1 , ⋯ , 20 of D . The diagonal elements of D − are given as</p>
      <p>λ i − = 1 λ i if λ i &gt; 0 and λ i − = 0 if λ i = 0 .</p>
      <p>For discussions on property of the Moore Penrose generalized inverse,</p>
      <p>
        see Theil ( [<xref ref-type="bibr" rid="scirp.75963-ref27">27</xref>] , p 273-274), also see expressions (4.3 - 4.6) given by Harville ( [<xref ref-type="bibr" rid="scirp.75963-ref28">28</xref>] , p 504). For numerical computations using R, see section 8.3 given by Fieller ( [<xref ref-type="bibr" rid="scirp.75963-ref29">29</xref>] , p. 123-133). The chi-square test statistics for testing the null hypothesis which specifies that observations are drawn from the GAL family can be based on the criterion function
      </p>
      <p>Q ( β ) = n ( z n − z β ) ′ ( P D − P ′ ) ( z n − z β ) , (22)</p>
      <p>Q ( β ˜ ) = n ( z n − z β ˜ ) ′ ( P D − P ′ ) ( z n − z β ˜ ) → L χ 2 ( 16 ) . (23)</p>
      <p>
        The limiting distribution of the test statistics is chi-square with r = 16 , based on Theorem 3.4.1 of Luong and Thompson ( [<xref ref-type="bibr" rid="scirp.75963-ref26">26</xref>] , p. 248). The test statistics can also be viewed as a generalized Pearson test statistics. The criterion function Q ( β ) can also be used to find a good starting vector to initialize the algorithms for finding the QD estimators, see section (3) given by Andrews ( [<xref ref-type="bibr" rid="scirp.75963-ref30">30</xref>] , p. 917- 922) for more discussions and section (5.2) of this paper.
      </p>
    </sec>
    <sec id="s5">
      <title>5. Numerical Issues</title>
      <sec id="s5_1">
        <title>5.1. Simplemoment Estimators</title>
        <p>
          The simple approximate moment estimate proposed by Senata [<xref ref-type="bibr" rid="scirp.75963-ref4">4</xref>] can be found explicitly and can be used as starting points for numerical optimization to find QDE or MLE. Let the first four moments be denoted by μ ^ s j , j = 1 , 2 , 3 , 4 with
        </p>
        <p>μ ^ j = 1 n ∑ i = 1 n ( X i − X &#175; ) j , j = 1 , ⋯ , 4 and equalizing with the model counterparts</p>
        <p>and neglecting all the terms with θ ′ j , j = 2 , 3 , 4 yields the following system of estimating equation for moment estimation,</p>
        <p>μ ^ 1 = c + θ ′ , μ ^ 2 = σ ′ 2 , μ ^ 3 = 3 σ ′ 2 θ ′ ν , μ ^ 4 = 3 σ ′ 4 ν + 3 σ ′ 4 . The moment estimators are</p>
        <p>( σ &#175; ′ ) 2 = μ ^ 2 , ν &#175; = μ ^ 4 3 − ( σ &#175; ′ ) 4 ( σ &#175; ′ ) 4 , θ &#175; ' = μ ^ 3 3 ν &#175; ( σ &#175; ′ ) 2 , c &#175; = μ ^ 1 − θ &#175; ' . When converted to the</p>
        <p>
          parameterization given by Kotz et al. [<xref ref-type="bibr" rid="scirp.75963-ref16">16</xref>] , the approximate moment estimators
        </p>
        <p>for τ , σ 2 , μ , θ are given respectively as τ &#175; = 1 ν &#175; , σ &#175; 2 = σ &#175; ′ 2 ν &#175; , μ &#175; = θ &#175; ′ ν &#175; , θ &#175; = c &#175; . The</p>
        <p>approximate moment estimators are not efficient but they are simple and given explicitly .Therefore, they can be used as starting points for the numerical algorithms to implement QD or ML estimation. Moment estimators can also be verified to see whether they are appropriate as starting points. This will be discussed in the next section.</p>
      </sec>
      <sec id="s5_2">
        <title>5.2. The Choice of an Initial Vector</title>
        <p>
          Most of the algorithms will return a local minimizer and the vector which gives the estimators is defined to be the global minimizer. Due to this limitation, some cares are needed to ensure that we can identify the global minimizer. In practice, it is important to test the algorithm with various starting vectors, see Andrews [<xref ref-type="bibr" rid="scirp.75963-ref30">30</xref>] . Andrews [<xref ref-type="bibr" rid="scirp.75963-ref30">30</xref>] has suggested that it is preferable to have the starting vector
        </p>
        <p>β ( 0 ) = ( θ ( 0 ) , μ ( 0 ) , σ ( 0 ) , τ ( 0 ) ) ′ close to the vector of the estimators given by β ˜</p>
        <p>which globally minimizes the objective function. We might look for a different starting vector if the vector of moment estimators cannot be used as a starting vector to initialize the numerical algorithm.</p>
        <p>The criterion function Q ( β ) given by expression (22) which is used to construct goodness of fit test can also be used to select a good starting vector. The starting vector β ( 0 ) is subject to the screening test by checking whether</p>
        <p>Q ( β ( 0 ) ) ≤ χ 0.95 2 ( 16 ) ,</p>
        <p>
          χ 0.95 2 ( 16 ) is the 95th percentile of the chi-square distribution with 16 degree of freedom to be qualified as a suitable starting vector, see expression (3.5) given by Andrews ( [<xref ref-type="bibr" rid="scirp.75963-ref30">30</xref>] , p. 919). If β ( 0 ) passes the screening test then one might consider to use β ( 0 ) as the vector of starting points for the numerical algorithm used to find the vector of estimators, otherwise look for another one.
        </p>
      </sec>
      <sec id="s5_3">
        <title>5.3. A limited Simulation Study</title>
        <p>For financial data, observations are recorded as percentages so they are small in magnitude. We are in the situation of modeling with values for θ and μ are near 0. The plausible values for τ and σ , 0 &lt; τ ≤ 10 , 0 &lt; σ ≤ 0.1 . For parameters with these ranges we observe that the ML estimators for τ and σ do not perform well for sample size as large as n = 5000 . For comparisons between QD methods vs ML methods, the ratio of total Mean square errors is used as a measure for the overall relative efficiency. Due to the limited capacity on computing as we only have access to a laptop computer, we can only use M = 100 samples with each sample is of a size n = 5000.</p>
        <p>The overall relative efficiency for comparisons is defined as the ratio</p>
        <p>TMSE ( Q D ) TMSE ( M L ) = MSE ( θ ˜ ) + MSE ( μ ˜ ) + MSE ( σ ˜ ) + MSE ( τ ˜ ) MSE ( θ ^ ) + MSE ( μ ^ ) + MSE ( σ ^ ) + MSE ( τ ^ ) .</p>
        <p>
          The expressions for MSE and TMSE which appear in <xref ref-type="table" rid="table1">Table 1</xref> are estimated using simulated samples. The results of the simulation study are lengthy. We only extract the key findings, which is summarized using <xref ref-type="table" rid="table1">Table 1</xref>.
        </p>
        <p>The study seems to indicate that overall ML methods are less efficient than QD methods but ML methods are more efficient for estimating the first two</p>
        <table-wrap-group id="1">
          <label>
            <xref ref-type="table" rid="table1">Table 1</xref>
          </label>
          <caption>
            <title> Illustrations of simulation results</title>
          </caption>
          </table-wrap-group>
        
        
          </sec>
      </sec>
          </body>
            <back>
              <ref-list>
                <title>References</title>
                <ref id="scirp.75963-ref1">
                  <label>1</label>
                  <mixed-citation publication-type="other" xlink:type="simple">Kotz, S., Kozubowski, T.J. and Podgorski, K. (2001) The Laplace Distribution and Generalizations. Birkhauser, Boston. https://doi.org/10.1007/978-1-4612-0173-1</mixed-citation>
                </ref>
                <ref id="scirp.75963-ref2">
                  <label>2</label>
                  <mixed-citation publication-type="other" xlink:type="simple">Madan, D.P. and Senata, E. (1990) The Variance Gamma (VG) Model for Share Market. Journal of Business, 63, 551-524. https://doi.org/10.1086/296519</mixed-citation>
                </ref>
                <ref id="scirp.75963-ref3">
                  <label>3</label>
                  <mixed-citation publication-type="other" xlink:type="simple">
                    Madan, D.P., Carr, P. and Chang, E.C. (1998) The Variance Gamma Process and Option Pricing. European Finance Review, 2, 79-105.
                    https://doi.org/10.1086/296519
                  </mixed-citation>
                </ref>
                <ref id="scirp.75963-ref4">
                  <label>4</label>
                  <mixed-citation publication-type="other" xlink:type="simple">Seneta, E. (2004) Fitting the Variance Gamma Model to Financial Data. Journal of Applied Probability, 41, 177-187. https://doi.org/10.1017/S0021900200112288</mixed-citation>
                </ref>
                <ref id="scirp.75963-ref5">
                  <label>5</label>
                  <mixed-citation publication-type="other" xlink:type="simple">Podgorski, K. and Wegener, J. (2011) Estimation for Stochastic Models Driven by Laplace Motion. Communications in Statistics, Theory and Methods, 40, 3281-3302. https://doi.org/10.1080/03610926.2010.499051</mixed-citation>
                </ref>
                <ref id="scirp.75963-ref6">
                  <label>6</label>
                  <mixed-citation publication-type="other" xlink:type="simple">McNeil, A.J., Frey, R. and Embrechts, P. (2005) Quantitative Risk Management. Princeton University Press, Princeton.</mixed-citation>
                </ref>
                <ref id="scirp.75963-ref7">
                  <label>7</label>
                  <mixed-citation publication-type="other" xlink:type="simple">Protassov, R.S. (2004) EM-Based Maximum Likelihood Parameter Estimation for Multivariate Generalized Hyperbolic Distributions with Fixed λ. Statistics and Computing, 14, 67-77. https://doi.org/10.1023/B:STCO.0000009419.12588.da</mixed-citation>
                </ref>
                <ref id="scirp.75963-ref8">
                  <label>8</label>
                  <mixed-citation publication-type="other" xlink:type="simple">Hu, W. (2005) Calibration of Multivariate Generalized Hyperbolic Distributions Using the EM Algorithm with Applications in Risk Management, Portfolio Optimization and Portfolio Credit Risk. Unpublished PHD Thesis, Department of Mathematics, The Florida State University, Tallahassee.</mixed-citation>
                </ref>
                <ref id="scirp.75963-ref9">
                  <label>9</label>
                  <mixed-citation publication-type="journal" xlink:type="simple">
                    <name name-style="western">
                      <surname>Louis</surname>
                      <given-names> T.A. </given-names>
                    </name>,<etal>et al</etal>. (<year>1982</year>)<article-title>Finding the Observed Information Using the EM Algorithm</article-title><source> Journal of the Royal Statistical Society Series B</source><volume> 44</volume>,<fpage> 98</fpage>-<lpage>130</lpage>.<pub-id pub-id-type="doi"></pub-id>
                  </mixed-citation>
                </ref>
                <ref id="scirp.75963-ref10">
                  <label>10</label>
                  <mixed-citation publication-type="other" xlink:type="simple">McLachlan, G.J. and Krishnan, T. (2008) The EM Algorithm and Extensions. 2nd Edition, Wiley, New York. https://doi.org/10.1002/9780470191613</mixed-citation>
                </ref>
                <ref id="scirp.75963-ref11">
                  <label>11</label>
                  <mixed-citation publication-type="other" xlink:type="simple">Küchler, U. and Tappe, S. (2008) Bilateral Gamma Distributions and Processes in Fi-nancial Mathematics. Stochastic Processes and Their Applications, 118, 261-283.</mixed-citation>
                </ref>
                <ref id="scirp.75963-ref12">
                  <label>12</label>
                  <mixed-citation publication-type="other" xlink:type="simple">Gerber, H.U. and Shiu, E.S.W. (1994) Option Pricing by Esscher Transforms. Transactions of the Society of Actuaries, 46, 99-191.</mixed-citation>
                </ref>
                <ref id="scirp.75963-ref13">
                  <label>13</label>
                  <mixed-citation publication-type="other" xlink:type="simple">Miyahara, Y. (2012) Option Pricing in Incomplete Markets: Modeling Based on Geometric Lévy Processes and Minimal Entropy Martingales Measures. Imperial College Press, London.</mixed-citation>
                </ref>
                <ref id="scirp.75963-ref14">
                  <label>14</label>
                  <mixed-citation publication-type="other" xlink:type="simple">Bierlaire, M. (2006) Introduction à l’optimisation différentiable. Presses Polytechniques et Universités Romandes, Lausanne.</mixed-citation>
                </ref>
                <ref id="scirp.75963-ref15">
                  <label>15</label>
                  <mixed-citation publication-type="other" xlink:type="simple">
                    Huber, P. (1981) Robust Statistics. Wiley, New York.
                    https://doi.org/10.1002/0471725250
                  </mixed-citation>
                </ref>
                <ref id="scirp.75963-ref16">
                  <label>16</label>
                  <mixed-citation publication-type="other" xlink:type="simple">Kotz, S., Kozubowski, T.J. and Podgorski, K. (2002) Maximum Likelihood Estimation of Asymmetric Laplace Parameters. Annals of Institute of Statistical Mathematics, 54, 816-826. https://doi.org/10.1023/A:1022467519537</mixed-citation>
                </ref>
                <ref id="scirp.75963-ref17">
                  <label>17</label>
                  <mixed-citation publication-type="other" xlink:type="simple">Huber, P. (1967) The Behaviour of Maximum Likelihood Estimates under Nonstandard Conditions. In: Proceeding 5th Berkeley Symposium on Mathematical Statistics and Probability, Vol. 1, University of California Press, Berkeley.</mixed-citation>
                </ref>
                <ref id="scirp.75963-ref18">
                  <label>18</label>
                  <mixed-citation publication-type="other" xlink:type="simple">Amemiya, T. (1985) Advanced Econometrics. Harvard University Press, Cambridge.</mixed-citation>
                </ref>
                <ref id="scirp.75963-ref19">
                  <label>19</label>
                  <mixed-citation publication-type="book" xlink:type="simple">Newey, W.K. and McFadden, D. (1994) Large Sample Estimation and Hypothesis Testing. In: Engle, R.F. and McFadden, D., Eds., Handbook of Econometrics, Vol. 4, North Holland, Amsterdam.</mixed-citation>
                </ref>
                <ref id="scirp.75963-ref20">
                  <label>20</label>
                  <mixed-citation publication-type="other" xlink:type="simple">Broniatowski, M., Toma, A. and Vajda, I. (2012) Decomposable Pseudodistances and Application in Statistical Estimation. Journal of Statistical and Planning Inference, 142, 2574-2585.</mixed-citation>
                </ref>
                <ref id="scirp.75963-ref21">
                  <label>21</label>
                  <mixed-citation publication-type="other" xlink:type="simple">Hogg, R., McKean, J.W. and Craig, A.T. (2013) Introduction to Mathematical Statistics. 7th Edition, Pearson, New York.</mixed-citation>
                </ref>
                <ref id="scirp.75963-ref22">
                  <label>22</label>
                  <mixed-citation publication-type="other" xlink:type="simple">Hinkley, D.V. and Revankar, N.S. (1977) Estimation of the Pareto Law form Under-reported Data: A Further Analysis. Journal of Econometrics, 5, 1-11.</mixed-citation>
                </ref>
                <ref id="scirp.75963-ref23">
                  <label>23</label>
                  <mixed-citation publication-type="other" xlink:type="simple">Rudin, W. (1976) Principles of Mathematical Analysis. McGraw Hill, New York.</mixed-citation>
                </ref>
                <ref id="scirp.75963-ref24">
                  <label>24</label>
                  <mixed-citation publication-type="other" xlink:type="simple">Woolridge, J.M. (2010) Econometric Analysis of Cross Section and Panel Data. 2nd Edition, MIT Press, Cambridge.</mixed-citation>
                </ref>
                <ref id="scirp.75963-ref25">
                  <label>25</label>
                  <mixed-citation publication-type="other" xlink:type="simple">
                    Lehmann, E.L. (1999) Elements of Large Sample Theory. Springer, New York.
                    https://doi.org/10.1007/b98855
                  </mixed-citation>
                </ref>
                <ref id="scirp.75963-ref26">
                  <label>26</label>
                  <mixed-citation publication-type="other" xlink:type="simple">
                    Luong, A. and Thompson, M.E. (1987) Minimum Distance Methods Based on Quadratic Distances for Transforms. Canadian Journal of Statistics, 15, 239-251.
                    https://doi.org/10.2307/3314914
                  </mixed-citation>
                </ref>
                <ref id="scirp.75963-ref27">
                  <label>27</label>
                  <mixed-citation publication-type="other" xlink:type="simple">Theil, H. (1971) Principle of Econometrics. Wiley, New York.</mixed-citation>
                </ref>
                <ref id="scirp.75963-ref28">
                  <label>28</label>
                  <mixed-citation publication-type="other" xlink:type="simple">Harville, D.A. (1997) Matrix Algebra from a Statistician’s Perspective. Springer, New York. https://doi.org/10.1007/b98818</mixed-citation>
                </ref>
                <ref id="scirp.75963-ref29">
                  <label>29</label>
                  <mixed-citation publication-type="other" xlink:type="simple">Fieller, N. (2016) Basics of Matrix Algebra with R. Chapman and Hall, New York.</mixed-citation>
                </ref>
                <ref id="scirp.75963-ref30">
                  <label>30</label>
                  <mixed-citation publication-type="other" xlink:type="simple">
                    Andrews, D.W.K. (1997) A Stopping Rule for the Computation of the Generalized Method of Moments Estimators. Econometrica, 65, 913-931.
                    https://doi.org/10.2307/2171944
                  </mixed-citation>
                </ref>
                <ref id="scirp.75963-ref31">
                  <label>31</label>
                  <mixed-citation publication-type="other" xlink:type="simple">Schoutens, W. (2003) Lévy Processes in Finance: Pricing Financial Derivatives. Wiley, New York. https://doi.org/10.1002/0470870230</mixed-citation>
                </ref>
                <ref id="scirp.75963-ref32">
                  <label>32</label>
                  <mixed-citation publication-type="other" xlink:type="simple">Rockafellar, R.T. and Uriyasev, S. (2002) Conditional Value-at-Risk for General Loss Distribution. Journal of Banking and Finance, 26, 1443-1471.</mixed-citation>
                </ref>
                <ref id="scirp.75963-ref33">
                  <label>33</label>
                  <mixed-citation publication-type="other" xlink:type="simple">
                    Ahmadi-Javid, A. (2012) Entropic Value-At Risk: A New Coherent Risk Measure. Journal of Optimization: Theory and Applications, 155, 1105-1123.
                    https://doi.org/10.1007/s10957-011-9968-2
                  </mixed-citation>
                </ref>
                <ref id="scirp.75963-ref34">
                  <label>34</label>
                  <mixed-citation publication-type="other" xlink:type="simple">
                    Chernoff, H. (1952) A Measure of Asymptotic Efficiency for Tests of a Hypothesis Based on a Sum of Observations. Annals of Mathematical Statistics, 23, 497-507.
                    https://doi.org/10.1214/aoms/1177729330
                  </mixed-citation>
                </ref>
                <ref id="scirp.75963-ref35">
                  <label>35</label>
                  <mixed-citation publication-type="other" xlink:type="simple">Toma, A. and Dedu, S. (2014) Quantitative Techniques for Financial Risk Assessment: A Comparative Approach Using Different Risk Measures and Estimation Methods. Procedia Economics and Finance, 8, 712-719.</mixed-citation>
                </ref>
              </ref-list>
            </back>
</article>