<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">AJCM</journal-id><journal-title-group><journal-title>American Journal of Computational Mathematics</journal-title></journal-title-group><issn pub-type="epub">2161-1203</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/ajcm.2019.94024</article-id><article-id pub-id-type="publisher-id">AJCM-97390</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Physics&amp;Mathematics</subject></subj-group></article-categories><title-group><article-title>
 
 
  Review on the Current Stochastic Numerical Methods for Econometric Analysis
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Lewis</surname><given-names>N. K. Mambo</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Rostin</surname><given-names>M. M. Mabela</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Jean-Pièrre</surname><given-names>B. Bosonga</given-names></name><xref ref-type="aff" rid="aff3"><sup>3</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Eugène</surname><given-names>M. Mbuyi</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib></contrib-group><aff id="aff3"><addr-line>Department of Economics, University of Kinshasa, Kinshasa, Congo</addr-line></aff><aff id="aff2"><addr-line>Department of Mathematics and Computer Sciences, University of Kinshasa, Kinshasa, Congo</addr-line></aff><aff id="aff1"><addr-line>Central Bank of Congo, Kinshasa, Congo</addr-line></aff><pub-date pub-type="epub"><day>25</day><month>10</month><year>2019</year></pub-date><volume>09</volume><issue>04</issue><fpage>328</fpage><lpage>347</lpage><history><date date-type="received"><day>25,</day>	<month>October</month>	<year>2019</year></date><date date-type="rev-recd"><day>23,</day>	<month>December</month>	<year>2019</year>	</date><date date-type="accepted"><day>26,</day>	<month>December</month>	<year>2019</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  The main aim of this paper is to present and emphasize the contribution of stochastic numerical methods as must tools for the modern econometric modelisation. Indeed, the stochastic numerical methods play an important role in mathematical modelling and the econometric analysis because they model uncertainties that govern the real-world data. However these powerful tools are not well-known and understood by many economists and financial econometricians.
 
</p></abstract><kwd-group><kwd>Stochastic Differential Equations</kwd><kwd> The Euler-Maruyama Scheme</kwd><kwd> The Milstein Scheme</kwd><kwd> The Crank-Nicolson Scheme</kwd><kwd> Runge-Kutta Method</kwd><kwd> It&#244; Integrals</kwd><kwd> Econometric Analysis</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>As mentioned in [<xref ref-type="bibr" rid="scirp.97390-ref1">1</xref>] , the theory of stochastic differential equations was originally developed by mathematicians as a tool for explicit construction of the trajectories of diffussion processes for given coefficients of drift and diffusion.</p><p>Today, the stochastic differential equation (SDE) models</p><p>d X ( t ) = Φ ( X ( t ) , t ) d t + Ψ ( X ( t ) , t ) d B (t)</p><p>or Stochastic partial differential equation (SPDE) models</p><p>d X t = [ A X t + F ( X t ) ] d t + B ( X t ) d W t ,     X t | ∂ D = 0, X = ξ</p><p>play a prominent role in a range of application areas, including economics, finance, biology, epidemiology, chemistry, microelectronics, and mechanics [<xref ref-type="bibr" rid="scirp.97390-ref2">2</xref>] [<xref ref-type="bibr" rid="scirp.97390-ref3">3</xref>] .</p><p>By reading [<xref ref-type="bibr" rid="scirp.97390-ref4">4</xref>] [<xref ref-type="bibr" rid="scirp.97390-ref5">5</xref>] and [<xref ref-type="bibr" rid="scirp.97390-ref6">6</xref>] in the field as the reference books of Numerical methods in Economics, one can remark that there exist the high needs to take in content the uncertainties in economic analysis. Therefore, the stochastic numerical methods must be understood by econometricians or economists.</p><p>In all, the main challenge of econometricians or economists is how to numerize the stochastic differential equations, that is, how to move from the continuous-time stochastic models to discrete-time stochastic models [<xref ref-type="bibr" rid="scirp.97390-ref7">7</xref>] - [<xref ref-type="bibr" rid="scirp.97390-ref15">15</xref>] .</p><p>The motivation for these methods came from the need to deal effectively with problems arising in the fields of economics and Finance [<xref ref-type="bibr" rid="scirp.97390-ref2">2</xref>] [<xref ref-type="bibr" rid="scirp.97390-ref16">16</xref>] - [<xref ref-type="bibr" rid="scirp.97390-ref21">21</xref>] . Also, the new direction of the modern econometric theory and applications go to stochastic analysis [<xref ref-type="bibr" rid="scirp.97390-ref22">22</xref>] [<xref ref-type="bibr" rid="scirp.97390-ref23">23</xref>] [<xref ref-type="bibr" rid="scirp.97390-ref24">24</xref>] [<xref ref-type="bibr" rid="scirp.97390-ref25">25</xref>] .</p><p>The remainder of this paper is organized as follows. Section 2 presents some useful definitions and notations in stochastic analysis. Section 3 gives the stochastic integrals as the tools of evaluation of stochastic differential equations. Section 4 presents some recent stochastic differential equations that can be meaningfully in econometric analysis and their assumptions used for uniqueness and existence of solution. Section 5 presents some powerful numerical methods for stochastic differential equations.</p></sec><sec id="s2"><title>2. Notations and Definitions</title><p>In this section we present the notations, definitions and basic facts of stochastic differential equations, stochastic integrals, stochastic numerical methods and convergence which will be used in this paper.</p><p>Definition 2.0.1. Let ( Ω , F , P , ( F ) t ∈ ℝ + ) be a filtered probability space. The σ -algebra on ℝ &#215; Ω generated by all sets of the form A, A ∈ F 0 , and A, 0 ≤ a &lt; b &lt; + ∞ , A ∈ F a , is said to be the predictable σ -algebra for the filtration ( F ) t ∈ ℝ +</p><p>Definition 2.0.2. A real-valued process ( X t ) t ∈ R + is called predictable with respect to a filtration ( F t ) t ∈ ℝ + or F t -predictable, if as a mapping from ℝ + ∈ Ω → ℝ predictable σ -algebra generated by this filtration.</p><p>Definition 2.0.3 Let ( X t ) t ∈ ℝ + be a left-continuous real-valued process adapted to ( F t ) t ∈ ℝ + . Then X t is predictable.</p><p>Definition 2.0.4. A stochastic process ( X t ) is said to be right-continuous with left limits (RCLL) or contu &#224; droite avec limite &#224; gauche (c&#224;dl&#224;g) if, almost surely, it has trajectories that are RCLL. That is,</p><p>X t = l i m x s</p><p>Definition 2.0.5. (Wiener process, [<xref ref-type="bibr" rid="scirp.97390-ref26">26</xref>] ) Let ( Ω , F , P ) be a probability space and let { F t , t ≥ 0 } be a filtration defined on it. A process { X ( t ) , t ≥ 0 } is called an F t -Wiener process if it satisfies the following conditions.</p><p>1) X ( 0 ) = 0 ;</p><p>2) X ( t ) is F t -measurable and F ( X ( s ) − X ( t ) : s ≥ t ) is independent of F t for all t ≥ 0 ;</p><p>3) The increments X ( s ) − X ( t ) are normally distributed with mean 0 and variance σ 2 ( s − t ) &gt; 0 for all s &gt; t ≥ 0 ;</p><p>4) The sample paths of X ( . ) are in C [ 0, ∞ ) .</p><p>Definition 2.0.6. [<xref ref-type="bibr" rid="scirp.97390-ref27">27</xref>] X is a Markov process if for any t and s &gt; 0 , the conditional distribution of X ( t + s ) given F t is the same as the conditional distribution of X ( t + s ) , given X ( t ) , that is,</p><p>P ( X ( t + s ) ≤ Y | F t ) = P ( X ( t + s ) ≤ Y | X (t) )</p><p>a.s.</p><p>Definition 2.0.7. [<xref ref-type="bibr" rid="scirp.97390-ref28">28</xref>] A Brownian motion is a continuous, adapted process B = { B t , F t : 0 ≤ s &lt; ∞ } , defined on some probability space ( Ω , F , P ) , with the properties that B 0 = 0 a.s. and for 0 ≤ s &lt; ∞ , the increment B t − B s is indepedentof F ∫ and is normally distributed with mean zero and variable t − s .</p><p>The Brownian paths have the following properties [<xref ref-type="bibr" rid="scirp.97390-ref27">27</xref>] . Almost every sample path B ( t ) ,0 ≤ t ≤ T : 1) is a continuous function of t; 2) is not monotone in any interval, no matter how small the interval is; 3) is not differentiable at any point; 4) has infinite variation on any, no matter how small it is; 5) has quadratic variation [ 0, t ] equal to t, for any t.</p><p>Definition 2.0.8. (Brownian motion with respect to a filtration, [<xref ref-type="bibr" rid="scirp.97390-ref29">29</xref>] ) A vectorial (d-dimensional) Brownian motion on T with respect to a filtration F = ( F t ) t ∈ T such that 1) W 0 = 0 ; 2) For all 0 ≤ s &lt; t in T , the increment W t − W s is independent of F s and follows a centered Gaussian distribution with variance-covariance matrix ( t − s ) I d .</p><p>Some classical properties of Brownian motion are stated in the following proposition.</p><p>Proposition 2.0.1. Let ( W t ) t ∈ T be a Brownian motion with respect to ( F t ) t ∈ T . 1) symmetry: ( W t ) t ∈ T is also a Brownian motion. 2) scaling: for all λ &gt; 0 , the process is also a Brownian motion. 3) Invariance by translation: for all s &gt; 0 , the process W t + s − W s is a standard Brownian motion independent of F s .</p><p>Definition 2.0.9. [<xref ref-type="bibr" rid="scirp.97390-ref27">27</xref>] A process X is called adapted to the filtration F = ( F t ) , if for all t, X ( t ) is F -measurable.</p><p>Definition 2.0.10. Let X t be an adapted stochastic process with RCLL trajectories. It is said to be decomposable if it can be written as</p><p>X t = X 0 + M t + Z t ,</p><p>where M 0 = Z 0 = 0 , M t is a locally square-integrable martingale, and Z t has RCLL-adapted trajectories of bounded variation.</p><p>Definition 2.0.11 (Martingale, [<xref ref-type="bibr" rid="scirp.97390-ref30">30</xref>] ) Let { F t } be an indexed set of sub-σ-algebra of { F } such that { F t } ⊃ { F s } if t &gt; s . The pair { x ( t ) , F t } is said to be a F t -martingale if E | x ( t ) | &lt; ∞ and x ( t ) is F t -measurable and</p><p>E [ x ( t + s ) | F t ] = x (t)</p><p>w.p.1. for each t and s &gt; 0 . If the equality is replaced by ≤ , we have a Supermartingale, and if it is replaced by ≥ we have a Submartingale.</p><p>Definition 2.0.12. [<xref ref-type="bibr" rid="scirp.97390-ref31">31</xref>] The quadratic covariation of two processes X and Y is</p><p>[ X , Y ] t = lim Π n → 0 ∑ k = 1 n ( X ( t k ) − X ( t k − 1 ) ) ( Y ( t k ) − Y ( t k − 1 ) ) . (1)</p><p>Here Π n = { 0 = t 0 &lt; t 1 &lt; t 2 &lt; ⋯ &lt; t n − 1 &lt; t n = t } is an arbitrary partition of the interval [ 0, t ] .</p></sec><sec id="s3"><title>3. Stochastic Integrals</title><p>The aim of this section is to provide some backgrounds on the stochastic integrals. These integrals constitute a cornerstone of mathematical modelling and stochastic analysis used in evaluation and resolution of the stochastic diferential equatons [<xref ref-type="bibr" rid="scirp.97390-ref1">1</xref>] [<xref ref-type="bibr" rid="scirp.97390-ref32">32</xref>] - [<xref ref-type="bibr" rid="scirp.97390-ref36">36</xref>] .</p><sec id="s3_1"><title>3.1. The It&#244; Integral</title><p>It&#244;’s theory of stochastic integration was originally motivated as a direct method to construct diffusion processes (as subclass of Markov processes) as solution of stochastic differential equations [<xref ref-type="bibr" rid="scirp.97390-ref35">35</xref>] . As in [<xref ref-type="bibr" rid="scirp.97390-ref27">27</xref>] It&#244; integral is defined as a sum</p><p>∫ 0 T   X ( t ) d B ( t ) = ∑ i = 0 n − 1     C i ( B ( t i + 1 ) − B ( t i ) ) . (2)</p><p>Theorem 3.1. (Properties of stochastic integrals, [<xref ref-type="bibr" rid="scirp.97390-ref27">27</xref>] ) Let X ( t ) be a regular</p><p>adapted such that with probability one ∫ 0 T X 2 ( t ) d t &lt; ∞ . Then It&#244; integral ∫ 0 T   X ( t ) d B ( t ) is defined and has the following properties.</p><p>1) Linearity. If It&#244; integrals of X ( t ) and Y ( t ) are defined and α and β are some constants then</p><p>∫ 0 T ( α X ( t ) + β Y ( t ) ) d B ( t ) = α ∫ 0 T   X ( t ) d B ( t ) + β ∫ 0 T   Y ( t ) d B (t)</p><p>2) ∫ 0 T X ( t ) I ( a , b ] ( t ) d B ( t ) = ∫ a b   X ( t ) d B ( t ) . The following two properties hold when the process satisfies an additional assumption</p><p>∫ 0 T E ( X 2 ( t ) ) d t &lt; ∞ . (3)</p><p>3) Zero mean property. If condition 3 holds then E ( ∫ 0 T X ( t ) d B ( t ) ) = 0 .</p><p>4) Isometry property. If condition 3 holds. Then</p><p>E ( ∫ 0 T X ( t ) d B ( t ) ) 2 = ∫ 0 T E ( X 2 ( t ) ) d B (t)</p><p>5) Generalized It&#244; Isometry [<xref ref-type="bibr" rid="scirp.97390-ref31">31</xref>] . For f , g ∈ L a 2 d ( Ω , L 2 ( [ 0, T ] ) ) , we have</p><p>E [ ∫ 0 t     f ( s ) d W ( s ) ∫ 0 t     g ( s ) d W ( s ) ] = ∫ 0 t     E [ f ( s ) g ( s ) ] d t</p><p>Corollary 3.1.1. If X is a continuous adapted process then the It&#244; integral</p><p>∫ 0 T X ( t ) d B ( t ) exists. In particular, ∫ 0 T f ( B ( t ) ) d B ( t ) where f is a continuous function on R is well-defined.</p><p>A consequence of the isometry property is the expectation of the product of two It&#244; integrals.</p><p>Theorem 3.2. Let X ( t ) and Y ( t ) be regular adapted processes, such that ∫ 0 T   X ( t ) 2 d t &lt; ∞ and ∫ 0 T   Y ( t ) 2 &lt; ∞ . Then</p><p>E ( ∫ 0 T   X ( t ) d B ( t ) ∫ 0 T   Y ( t ) d B ( t ) ) = ∫ 0 T   E ( X ( t ) Y ( t ) ) d t</p><p>We denote by ℝ m n all real-valued m &#215; n matrices and by</p><p>W ( t ) = ( W 1 ( t ) , ⋯ , W n ( t ) ) ′ , t ≥ 0.</p><p>Let [ a , b ] ∈ [ 0, ∞ [ and we put</p><p>C W ( [ a , b ] ) = { f : [ a , b ] &#215; Ω → ℝ m n | ∀ 1 ≤ i ≤ m , ∀ 1 ≤ j ≤ n : f i j ∈ C W j ( [ a , b ] ) } ,</p><p>C I W ( [ a , b ] ) = { f : [ a , b ] &#215; Ω → ℝ m n | ∀ 1 ≤ i ≤ m , ∀ 1 ≤ j ≤ n : f i j ∈ C I W j ( [ a , b ] ) }</p><p>and C I ( [ a , b ] ) respectively.</p><p>Definition 3.2.1. [<xref ref-type="bibr" rid="scirp.97390-ref37">37</xref>] If f : [ a , b ] &#215; Ω → ℝ m n belongs to C I W ( [ a , b ] ) , then the stochastic integral with respect to W is the m-dimensional vector defined by</p><p>∫ a b   f ( t ) d W ( t ) = ( ∑ j = 1 n ∫ a b   f i j ( t ) d W j ( t ) ) ′ 1 ≤ i ≤ m (4)</p><p>where each of the integrals on the right-hand side is defined in the sense of It&#244;.</p><p>As in [<xref ref-type="bibr" rid="scirp.97390-ref38">38</xref>] the It&#244; formula for multidimensional It&#244; processes is defined in following way. If</p><p>X t i = X 0 i + ∫ 0 t     K s i d s + ∑ l = 1 k ∫ 0 t   H s i l d B s l ,</p><p>t ∈ [ 0, T ] , i = 1 , ⋯ , m , are It&#244; processes and F ∈ C 2 ( [ 0, T ] &#215; ℝ m ) , then</p><p>F ( T , X T ) − F ( 0 , X 0 ) = ∑ i = 1 m ∫ 0 T ∂ F ∂ x i ( t , X t ) d X t i + ∑ 0 T ∂ F ∂ t ( t , X t ) + 1 2 ∑ i , j = 1 m ∫ 0 T ∂ 2 F ∂ x i ∂ x j ( t , X t ) d 〈 X i , X j 〉 t (5)</p><p>= ∑ i = 1 m ∑ l = 1 k ∫ 0 T ∂ F ∂ x i ( t , X t ) H t i l d B t l + ∑ i = 1 m ∫ 0 T ∂ F ∂ x i ( t , X t ) K t i l d t       + ∫ 0 T ∂ F ∂ t ( t , X t ) d t + 1 2 ∑ i = 1 m ∑ l = 1 k ∫ 0 T ∂ 2 F ∂ x i ∂ x j ( t , X t ) H t i l H t j l d t . (6)</p><p>Morever, if F ∈ C 2,3 ( [ 0, T ] &#215; ℝ m ) , then this formula can be written in term of the Stratonovich integral [<xref ref-type="bibr" rid="scirp.97390-ref38">38</xref>]</p><p>F ( T , X T ) − F ( 0 , X 0 ) = ∑ i = 1 m ∫ 0 T ∂ F ∂ x i ( t , X t ) ∘ d X t i + ∫ 0 T ∂ F ∂ t ( t , X t ) d t (7)</p><p>= ∑ i = 1 m ∑ l = 1 k ∫ 0 T ∂ F ∂ x i ( t , X t ) H t i l ∘ d B t + ∑ i = 1 m ∫ 0 T ∂ F ∂ x i ( t , X t ) K t i l d t + ∫ 0 T ∂ F ∂ t ( t , X t ) d t (8)</p></sec><sec id="s3_2"><title>3.2. The Stratonovich Integral</title><p>Definition 3.2.2. [<xref ref-type="bibr" rid="scirp.97390-ref35">35</xref>] Let X t and Y t be It&#244; processes. The Stratonovich integral of X t with respect to Y t is defined by</p><p>∫ a b   X t ∘ d Y t = ∫ a b X t d Y t + 1 2 ∫ a b ( d X t ) ( d Y t ) , (9)</p><p>or equivalently in the stochastic differential form</p><p>X t ∘ d Y t = X t d Y t + 1 2 ( d X t ) ( d Y t ) . (10)</p><p>Theorem 3.3. [<xref ref-type="bibr" rid="scirp.97390-ref35">35</xref>] Let f ( t , x ) be a continuous function with continuous partial derivatives ∂ F ∂ t , ∂ f ∂ t , and ∂ f ∂ x . Then</p><p>∫ a b f ( t , B ( t ) ) ∘ d B t = F ( t , B ( t ) ) | a b − ∫ a b ∂ B ∂ t ( t , B ( t ) ) ∘ d t . (11)</p><p>In particular, when the function f does not depend on t, we have</p><p>∫ a b   f ( B ( t ) ) ∘ d B t = F ( B ( t ) ) | a b . (12)</p><p>Theorem 3.4. [<xref ref-type="bibr" rid="scirp.97390-ref35">35</xref>] Let f ( t , x ) be a continuous function with continuous partial derivatives ∂ f ∂ t , ∂ f ∂ x , and ∂ 2 f ∂ x 2 . Then</p><p>∫ a b   X t ∘ d Y t = lim ‖ Δ ‖ → 0 ∑ i = 1 n   f ( t i * , 1 2 ( B ( t i − 1 ) + B ( t i ) ) ) ( B ( t i ) − B ( t i − 1 ) ) (13)</p><p>= lim ‖ Δ ‖ → 0 ∑ i = 1 n   f ( t i * , B ( t i − 1 + t i 2 ) ) ( B ( t i ) − B ( t i − 1 ) ) , (14)</p><p>in probability, where t i − 1 ≤ t i * ≤ t i , Δ = { t 0 , t 1 , ⋯ , t n − 1 , t n } is a partition of the finite interval [ a , b ] and ‖ Δ ‖ = max 1 ≤ i ≤ n ( t i − t i − n ) .</p><p>In [<xref ref-type="bibr" rid="scirp.97390-ref39">39</xref>] , the multidimensional Stratonovich integrals S m ( f ) can be expressed by the following formula using It&#244; integrals</p><p>S m ( f ) = ∑ 2 k ≤ m ! 2 k k ! ( m − 2 k ) I m − 2 k ( T r k f ) . (15)</p><p>where T r denoted the iterated traces that are defined formally starting with</p><p>T r f ( s 1 , ⋯ , s m − 2 ) = ∫ f ( s 1 , ⋯ , s m − 2 , s ) d s .</p><p>Another approach to formula (15) using Hida’s theory of white noise. Working on ℝ m instead of ℝ + m and assuming that f is a test-function, the integral S m ( f ) may indead be rewritten as</p><p>∫ f ( s 1 , ⋯ , s m ) X ˙ s 1 ( w ) ⋯ X ˙ s m ( w ) d s 1 ⋯ d s n = 〈 f , X ˙ ⊗ n 〉</p><p>where the derivative of Brownian motion is understood in the distribution sense. In the sense of Hu and Meyer [<xref ref-type="bibr" rid="scirp.97390-ref39">39</xref>] , a Stratonovich integral is given in rigorous form as</p><p>S ( f ) = ∑ m 1 m ! ∫ [ S )     f m ( s 1 , ⋯ , s m ) d X s 1 ( w ) ⋯ d X s m ( w ) (16)</p><p>where f is a finite sequence of coefficients f m ∈ L s 2 (ℝm)</p><p>and n ! = n &#215; ( n − 1 ) &#215; ⋯ &#215; 1 .</p></sec><sec id="s3_3"><title>3.3. The Skorohod Integral</title><p>The Skorohod integral was introduced for the first time by A. Skorohod in 1975 as an extension of the It&#244; integral to non-adapted processes and is the adjoint of the Malliavin derivative which is fundamentals to the stochastic calculus of variations [<xref ref-type="bibr" rid="scirp.97390-ref40">40</xref>] [<xref ref-type="bibr" rid="scirp.97390-ref41">41</xref>] .</p><p>Definition 3.4.1. [<xref ref-type="bibr" rid="scirp.97390-ref40">40</xref>] Let u ( t ) , t ∈ [ 0, T ] , be a measurable stochastic process such that for all t ∈ [ 0, T ] the random variable u ( t ) is F T -measurable and E [ u 2 ( t ) ] &lt; ∞ . Let its Wiener-It&#244; chaos expansion be</p><p>u ( t ) = ∑ n = 0 ∞     I n ( f n , t ) = ∑ n = 0 ∞     I n ( f n ( . , t ) ) . (17)</p><p>Then we define the Skorohod integral of u ( t ) by</p><p>δ ( u ) : = ∫ 0 T   u ( t ) δ W ( t ) : = ∑ n = 0 ∞   I n + 1 ( f ˜ n ) , (18)</p><p>where convergent in L 2 ( P ) . Here f ˜ n , n = 1 , 2 , ⋯ are the symmetric functions derived from f n ( ., t ) , n = 1,2, ⋯ . We say that u is Skorohod integrable, and we write u ∈ D o m ( δ ) if the series in (18) converges in L 2 ( P ) .</p></sec><sec id="s3_4"><title>3.4. The Ogawa Integral</title><p>The It&#244; integral and others are based in a fundamental hypothesis of causal relationship. Shigeyoshi Ogawa [<xref ref-type="bibr" rid="scirp.97390-ref42">42</xref>] defined this following noncausal integral that is so-called Ogawa integral</p><p>∫ 0 T f ( t ) ∗ d W ( t ) = ∑ ∫ 0 t     f ( s ) m i ( s ) d s ∫ 0 t     m i ( s ) d W ( s ) ,     t ∈ [ 0, T ] (19)</p><p>where { m i ( t ) } is the complete orthnormal system on L 2 ( [ 0, T ] ) . Nualart and Zakai [<xref ref-type="bibr" rid="scirp.97390-ref43">43</xref>] proved that the Ogawa integral is equivalent to the Stratonovich integral of the Ogawa integral exists with the Stratonovich integral defined [<xref ref-type="bibr" rid="scirp.97390-ref31">31</xref>] as</p><p>∫ 0 t     f ( t ) ∘ d W ( t ) = lim | Π n | → 0 ∑ i = 1 n 1 t i + 1 − t i ∫ t i t i + 1 f ( s ) d s ( W ( t i + 1 ) − W ( t i ) ) . (20)</p><p>Here Π n = { 0 = t 1 &lt; t 2 &lt; ⋯ &lt; t n − 1 &lt; t n = t } is an arbitrary partition of the interval [ 0, t ] . The Ogawa integral coincides with the Stratonovich integral defined at the midpoints [<xref ref-type="bibr" rid="scirp.97390-ref31">31</xref>]</p><p>∫ 0 t   f ( t ) ∘ d W ( t ) = lim | Π n | → 0 ∑ i = 1 n     f ( t i + t i + 1 2 ) ( W ( t i + 1 ) − W ( t i ) ) . (21)</p><p>Here Π n = { 0 = t 0 &lt; t 1 &lt; t 2 &lt; ⋯ &lt; t n − 1 &lt; t n = t } is an arbitrary partition of the interval [ 0, t ] .</p></sec></sec><sec id="s4"><title>4. Stochastic Differential Equations</title><p>This section presents four types of stochastic differential equations that can be useful in econometric modelling such as the stochastic ordinary differential equation, stochastic partial differential equation, Stochastic Differential Equation with Jumps, and Stochastic Delay Differential Equations [<xref ref-type="bibr" rid="scirp.97390-ref15">15</xref>] [<xref ref-type="bibr" rid="scirp.97390-ref26">26</xref>] [<xref ref-type="bibr" rid="scirp.97390-ref44">44</xref>] - [<xref ref-type="bibr" rid="scirp.97390-ref51">51</xref>] .</p><sec id="s4_1"><title>4.1. Stochastic Ordinary Differential Equations</title><p>Let X ( t ) be a diffusion in n dimensions described by the multi-dimensional stochastic differential equation</p><p>d X ( t ) = Φ ( X ( t ) , t ) d t + Ψ ( X ( t ) , t ) d B ( t ) , (22)</p><p>where Ψ is n &#215; d matrix valued function, B is d-dimensional Brownian motion and and X and Φ are vector n-dimensional vector valued functions. The vector Φ ( X , t ) and the matrix Ψ ( X , t ) are the coefficients of the stochastic differential equation.</p><p>Theorem 4.1. (Unique and Existence of Solution). If the coefficients are locally Lipschitz in X with a constant independent of t, that is, for every N, there is a constant K depending only on T and N such that for all | x | , | y | ≤ N and all 0 ≤ t ≤ T ,</p><p>| Φ ( x , t ) − Φ ( y , t ) | + | Ψ ( x , t ) − Ψ ( y , t ) | ≤ K | x − y | , (23)</p><p>for any given X ( 0 ) the strong solution to stochastic differentional equation 26 is unique. If in addition to condition 23 the linear growth condition holds</p><p>| Φ ( x , t ) | + | Ψ ( x , t ) | ≤ K τ ( 1 + | x | ) , (24)</p><p>X ( 0 ) is independent of B, and E | X ( 0 ) | 2 &lt; ∞ , then the strong solution exists and is unique on [ 0, T ] , moreover,</p><p>E ( sup | X ( t ) | 2 ) &lt; C ( 1 + E | X ( 0 ) | 2 ) ,</p><p>where constant C depends only on K and T.</p><p>The following theorem gives the solution of stochastic differential equations as Markov processes.</p><p>Theorem 4.2. [<xref ref-type="bibr" rid="scirp.97390-ref1">1</xref>] (The solution of SDEs as Markov processes) If Equation (26) satisfies the conditions of the existence and uniqueness theorem 4.1, the solution X t of the equation for arbitrary initial values is a Markov process on the interval [ t 0 , T ] whose initial probability distribution at the instant to is the distribution of C and whose transition probabilities are given by</p><p>P ( s , x t , B ) = P ( X t ∈ B | X s = x ) = P ( X t ( s , x ) ∈ B ) (25)</p><p>where X t ( s , x ) is the solution of equation.</p><p>Theorem 4.3. [<xref ref-type="bibr" rid="scirp.97390-ref1">1</xref>] (The solution of SDEs as Diffusion processes). The condition of the existence and uniqueness Theorem 4.1 are satisfied for the SDE</p><p>d X ( t ) = Φ ( X ( t ) , t ) d t + Ψ ( X ( t ) , t ) d B ( t ) , X t 0 = C , t 0 ≤ t ≤ T , (26)</p><p>where X t ∈ R d , Φ ( t , x ) ∈ R d , B ∈ R m and Ψ ( t , x ) is a d &#215; m matrix. If in addition, the functions Φ and Ψ are continuous with respect to t, the solution X t is a d-dimensional diffusion process on [ t 0 , T ] with drift vector and diffusion matrix Π ( t , x ) = Ψ ( t , x ) Ψ ( t , x ) ′ . In particular, the solution of an autonomous SDE is always a homogeneous diffusion process on [ t 0 , ∞ ) .</p></sec><sec id="s4_2"><title>4.2. Stochastic Partial Differential Equations</title><p>Consider the It&#244; Stochastic Partial Differential Equation of the form as mentioned in [<xref ref-type="bibr" rid="scirp.97390-ref52">52</xref>]</p><p>d X t = [ A X t + F ( X t ) ] d t + B ( X t ) d W t ,     X t | ∂ D = 0, X = ξ (27)</p><p>for t ≥ 0 , where W t , is an infinite dimensional Wiener process of the</p><p>W t ( x , w ) = ∑ j = 1 ∞     C j W t j ( w ) ϕ j ( x ) ,   t ≥ 0,   x ∈ D (28)</p><p>with independent scalar Wiener processes W t j , j ∈ ℕ . Here the family ϕ j , j ∈ ℕ , is an orthonormal basis in, e.g., L 2 ( D , ℝ ) .</p><p>Assumptions: For uniqueness and existence of solution of this SPDE the following assumptions hold. A1) Linear operator A. Let L be a finite or countable set. In addition, let ( λ i ) i ∈ L be a family of real numbers with i n f i ∈ L &gt; − ∞ and let ( ϑ i ) i ∈ L be an orthonormal basis of H. The linear operator A : D ( A ) → H is given by A υ = ∑ i = L − λ 〈 ϑ i , υ 〉 ϑ i for all υ ∈ D ( A ) with</p><p>D ( A ) = { ∑ i = L | λ | 2 | 〈 ϑ i , υ 〉 | 2 } ∈ H .</p><p>A2) Drift term F. Let α , δ ∈ ℝ be real numbers with δ − α &lt; 1 and let F : H δ → H α be a globally Lipschitz continuous mapping.</p><p>A3) Diffusion term B.Let α , δ ∈ ℝ be real numbers with δ − β &lt; 1 2 and let F : H δ → H S ( υ 0 , H β ) be a globally Lipschitz continuous mapping.</p><p>A4) Initial value ξ : Let γ ∈ [ δ , min ( α + 1 , β + 1 / 2 ) ] and p ∈ [ 2, ∞ ) be real numbers and let ξ : Ω → H γ be an F 0 / B ( H γ ) -measurable mapping with</p><p>E [ ‖ ξ ‖ H γ p ] &lt; ∞ .</p><p>The literature contains many existence and uniqueness theorems for mild solutions of SPDEs. Theorem below provides an existence, uniqueness, and regularity result for solutions of SPDEs with globally Lipschitz continuous coefficients in the Equation (27).</p><p>Theorem 4.4. [<xref ref-type="bibr" rid="scirp.97390-ref52">52</xref>] Assume that the Assumptions A1)-A4) are fulfilled. Then there exists a unique predictable stochastic process X : [ 0, T ] &#215; Ω → H γ</p><p>satisfying sup t ∈ [ 0 , T ] E [ ‖ ξ ‖ H γ p ] &lt; ∞ and</p><p>X t = e A t ξ + ∫ 0 t     e A ( t − s ) F ( X s ) d s + ∫ 0 t     e A ( t − s ) B ( X s ) d W s (29)</p><p>ℙ − a . s . for all t ∈ [ 0, T ] . In addition,</p><p>X ∈ ∩ r ∈ ( − ∞ , γ ] C min ( γ − r , 1 / 2 ) ( [ 0 , T ] , L p ( Ω , H r ) ) .</p><p>Here we assume that the Assumptions that X : [ 0, T ] &#215; Ω → H is a predictable stochastic process, which satisfies 27. Let t 0 ∈ [ 0, T ) . Then the solution process X also satisfies</p><p>X t = e A ( t − t 0 ) X t 0 + ∫ t 0 t     e A ( t − s ) F ( X s ) d s + ∫ t 0 t     e A ( t − s ) B ( X s ) d W s , ℙ − a . s . (30)</p><p>for every t ∈ [ t 0 ∈ T ] .</p><p>Proposition 2 Let assumption A1)-A4) be satisfied and let γ ∈ ( 0,1 ) be given by Assumption A3. Then there is an up-to-modification unique predictable stochastic process X : [ 0, T ] &#215; Ω → D ( ( κ − A ) γ ) with</p><p>sup 0 ≤ t ≤ T E ‖ ( κ − A ) γ A t ‖ H p &lt; ∞</p><p>for p ∈ [ 0, ∞ ) and with</p><p>P [ X t = e A ( t − t 0 ) X 0 + ∫ 0 t     e A ( t − s ) F ( X s ) d s + ∫ 0 t     e A ( t − s ) B ( X s ) d W s ] = 1 , (31)</p><p>for all t ∈ [ 0, T ) . Moreover, X is the unique mild solution of the SPDE 27 in the sense of Equation (31).</p></sec><sec id="s4_3"><title>4.3. Stochastic Differential Equation with Jumps</title><p>In real world, some phenomena or economic policy decisions are governed under uncertainty with jumps. Therefore, stochastic differential equation with jumps modeling can be considered as a useful econometric approach [<xref ref-type="bibr" rid="scirp.97390-ref53">53</xref>] . Consider a one-dimensional SDE, d = 1, in the form</p><p>d X t = a ( t , X t ) d t + b ( t , X t ) d W t + ∫ ε     c ( t , X t − , v ) p φ ( d v , d t ) (32)</p><p>for t ∈ [ 0, T ] , with X 0 ∈ ℝ , and W = { W t , t ∈ [ 0, T ] } an F t -adapted one-dimensional Wiener process. We assume an an F t -adapted Poisson measure p φ ( d v , d t ) with mark space ε ⊆ ℝ \ { 0 } and with intensity measure φ ( d v ) d t = λ F ( d v ) d t , where F ( . ) is a given probability distribution function for the realizations of the marks.</p><p>Consider a one-dimensional SDE with Jumps (32) in integral form, is of the form</p><p>X t = X 0 + ∫ 0 t     a ( s , X s ) d s + ∫ 0 t     b ( s , X s ) d W s + ∑ i = 1 p φ ( t ) c ( τ i , X τ i ) (33)</p></sec><sec id="s4_4"><title>4.4. Stochastic Delay Differential Equations</title><p>Consider the following Stochastic Delay Differential Equations with constant delay in Stratonovich form [<xref ref-type="bibr" rid="scirp.97390-ref54">54</xref>]</p><p>d X ( t ) = f ( X ( t ) , X ( t − τ ) ) d t + ∑ l = 1 r     g l ( X ( t ) , X ( t − τ ) ) ∘ d W l ( t ) , (34)</p><p>X ( t ) = ϕ ( t ) (35)</p><p>where τ &gt; 0 is a constant ( W ( t ) , F t ) = ( { W l ( t ) ,1 ≤ l ≤ r } , F ) is a system of one dimensional independent standard Wiener process, the function f : ℝ d &#215; ℝ d → ℝ d , g l : ℝ d &#215; ℝ d → ℝ d , ϕ ( t ) : [ − τ ,0 ] → ℝ d are continuous with E ‖ ϕ ‖ L ∞ 2 &lt; ∞ . and ϕ is F -measurable. For mean-square stability of (35), we assume that f , g l , ∂ x g l g q and ∂ x τ g l g q ( ∂ x and ∂ x τ denote the derivatives with respect to the first and second variables respectively), l , q = 1 , 2 , ⋯ , r , in (35) satisfy the Lipschitz and linear growth conditions.</p></sec></sec><sec id="s5"><title>5. Numerical Methods for Stochastic Differential Equations</title><p>In this section we review shortly some numerical methods used in the stochastic analysis that can be useful for economists and other social scientists. These main books that can helpfully to econometricians and economists are [<xref ref-type="bibr" rid="scirp.97390-ref26">26</xref>] [<xref ref-type="bibr" rid="scirp.97390-ref52">52</xref>] [<xref ref-type="bibr" rid="scirp.97390-ref55">55</xref>] - [<xref ref-type="bibr" rid="scirp.97390-ref61">61</xref>] .</p><sec id="s5_1"><title>5.1. Numerical Methods for Stochastic Ordinary Differential Equations</title><p>The Euler-Maruyama Scheme. The Euler-Maruyama method is a method for the approximate numerical solution of a stochastic differential equation. It is a simple generalization of the Euler method for ordinary differential equations to stochastic differential equations. It is named after a Swiss mathematician, physicist, geograph, astronomer, engineer, and logician Leonhard Euler (1707-1783) and a Japanese mathematician Gisiro Maruyama (1916-1986). Consider a scalar It&#244; stochastic ordinary differential equation [<xref ref-type="bibr" rid="scirp.97390-ref52">52</xref>]</p><p>d X t = f ( t , X t ) d t + g ( t , X t ) d W t (36)</p><p>with a standard scalar Wiener process W t , t ≥ 0 . This Equation (36) is in fact a symbolic representation for the stochastic integral equation</p><p>X t = X t 0 + ∫ t 0 t     f ( t , X t ) d t + ∫ t 0 t     g ( t , X t ) d W t (37)</p><p>The simplest numerical scheme for the stochastic ordinary differential Eqaution (36) is the Euler-Maruyama Scheme given by</p><p>Y n + 1 = Y n + f ( t n , Y n ) ∫ t n t n + 1   d s + g ( t n , Y n ) ∫ t n t n + 1   d W s (38)</p><p>where one usually writes</p><p>Δ n = ∫ t n t n + 1   d s ,     Δ W n = ∫ t n t n + 1   d W s ,</p><p>for n = 0 , 1 , ⋯ , M T − 1 and where t 0 &lt; t 1 &lt; ⋯ &lt; t M = T with M T ∈ ℕ is an arbitrary partition of [ t 0 , T ] . The Euler-Maruyama approximation of an m-dimensional stochastic differential equation X h = ( X 1 h , X 2 h , ⋯ , X m h ) is defined by [<xref ref-type="bibr" rid="scirp.97390-ref38">38</xref>]</p><p>X t p + 1 h = X t p h + μ ( t p , X t p h ) h + σ ( t p , X t p h ) Δ B p (39)</p><p>X 0 h = x , Δ B p : = B t p + 1 − B t p , t p = p h .</p><p>As a strong approximation, it is of order 1/2, while as a weak approximation it s of order 1. In other words, sup t ≤ T E | X t h − X t | = O ( h 1 / 2 ) and</p><p>E f ( X t h ) − E f ( X t ) = O ( h ) , h → 0 , for all f ∈ C μ 4 ( ℝ m ) .</p><p>The Milstein Scheme The Mistein method is a technique for the approximate numerical solution of a stochastic differential equation. It is named after Russian mathematician Grigori N. Milstein (who first published the method in 1974. The another useful numerical scheme for the SODE (36) is the Milstein Scheme given in [<xref ref-type="bibr" rid="scirp.97390-ref52">52</xref>] by</p><p>Y n + 1 = Y n + f ( t n , Y n ) ∫ t n t n + 1   d s + g ( t n , Y n ) ∫ t n t n + 1   d W s     + g ( t n , Y n ) ∂ g ∂ x ( t n , Y n ) ∫ t n t n + 1 ∫ t n s   d W u d W s (40)</p><p>The Milstein approximation of an m-dimensional stochastic differential equation X h = ( X 1 h , X 2 h , ⋯ , X m h ) is defined by [<xref ref-type="bibr" rid="scirp.97390-ref38">38</xref>]</p><p>X i t p + 1 h = X i t p h + μ i ( t p , X i t p h ) h + ∑     σ i j ( t p , X i t p h ) Δ B p j + ∑ j , l , q ∂ σ i q ∂ x j σ j l Δ C p l q ,</p><p>Δ C p l q : = ∫ t p t p + 1 ( B s l − B t p ) d B s q , X i t p h = x i , t p = p h .</p><p>The Runge-Kutta Scheme. The Runge-Kutta methods are a family of implicit and explicit iterative methods, which include the well-known routine called the Euler Method, used in temporal discretization for the approximate solutions of ordinary differential equations. These methods were developed around 1900 by the German mathematicians Carl Runge (1856-1927) and Wilhelm Kutta (1867-1944). Consider an m-dimensional Stratonovich differential equation of the form [<xref ref-type="bibr" rid="scirp.97390-ref62">62</xref>] [<xref ref-type="bibr" rid="scirp.97390-ref63">63</xref>]</p><p>d X = f ( t , X ) d t + g ( t , X ) ∘ d W ( t ) ,     X ( t 0 ) = X 0 , (41)</p><p>where f is an m-vector-valued function, g is an m &#215; p matrix-valued function and W ( t ) is a p-dimensional process having independent scalar Wiener process components and the solution X ( t ) is an m-vector process. A general class of stochastic Runge-Kutta method in which [<xref ref-type="bibr" rid="scirp.97390-ref62">62</xref>] [<xref ref-type="bibr" rid="scirp.97390-ref63">63</xref>]</p><p>X i = x n + h ∑ j = 1 s     a i j f ( X j ) + ∑ j = 1 s     Z i j g ( X j ) ,   i = 1 , ⋯ , s (42)</p><p>x n + 1 = x n + h ∑ j = 1 s     α i f ( X j ) + ∑ j = 1 s     Z j g ( X j ) , (43)</p><p>where Z and z are respectively, an s &#215; s matrix and s &#215; 1 vector whose elements are themselves arbitrary random variables. By letting</p><p>Z i j = b i j ( 1 ) J 1 + b i j J 10 / h ,   i , j = 1 , ⋯ , s ,</p><p>Z j = γ j ( 1 ) J 1 + γ j ( 2 ) / h ,   j = 1 , ⋯ , s .</p><p>Here J 10 represents the Stratonovich multiple integral of order two given by</p><p>J 10 = ∫ t 0 t ∫ t 0 s ∘ d W ( s t ) d s .</p><p>This method is defined to be of order p if the local truncation error is O ( h p ) .</p></sec><sec id="s5_2"><title>5.2. Numerical Methods for Stochastic Differential Equations with Jumps</title><p>The Euler scheme for SDE with jumps (32), is given by the algorithm, Platen [<xref ref-type="bibr" rid="scirp.97390-ref53">53</xref>] [<xref ref-type="bibr" rid="scirp.97390-ref64">64</xref>] [<xref ref-type="bibr" rid="scirp.97390-ref65">65</xref>]</p><p>Y n + 1 = Y n + a Δ n + b Δ W n + ∫ t n t n + 1 ∫ ε     c ( v ) p φ ( d v , d z )</p><p>Y n + 1 = Y n + a Δ n + b Δ W n + ∑ i = p φ ( t ) + 1 p φ ( t n + 1 )     c ( ξ i ) (44)</p><p>for n ∈ { 0,1, ⋯ , N − 1 } with initial value Y 0 = X 0 . Here Δ n = t n + 1 − t n is the length of the time interval [ t n , t n + 1 ] and Δ W n = W t n + 1 − W t n is the n<sup>th</sup> Gaussian N ( 0, Δ n ) distributed increment of the Wiener process W, n ∈ { 0,1, ⋯ , N − 1 } , p φ ( t ) = p φ ( ε , [ 0 , t ] ) represents the total number of jumps of Poisson random measure up to time t, which is Poisson distributed with mean λ t .</p><p>In the multidimensional case with mark-indepedent jump size we obtain the k<sup>th</sup> component of the Euler scheme</p><p>Y n + 1 k = Y n k + a k Δ n + ∑ i = p φ ( t ) + 1 p φ ( t n + 1 )     b k , j Δ W n + c k Δ p n . (45)</p></sec><sec id="s5_3"><title>5.3. Numerical Methods for Stochastic Partial Differential Equations</title><p>This material is from [<xref ref-type="bibr" rid="scirp.97390-ref66">66</xref>]</p><p>X ( t j + 1 n ) = S ( t j + 1 n − t j n ) X ( t j n ) + ∫ t j n t j + 1 n     S ( t j + 1 n − s ) B ( S ( s − t j n ) X ( t j n )     + ∫ t j n s     B X ( r ) d r + ∫ t j n s     S ( s − r ) G ( X ( r ) ) d M ( r ) ) d s     + ∫ t j n t j + 1 n     S ( t j + 1 n − s ) B ( S ( s − t j n ) X ( t j n )     + ∫ t j n s     B X ( r ) d r + ∫ t j n s     S ( s − r ) G ( X ( r ) ) d M ( r ) ) d M ( s ) (46)</p><p>For SPDE with multiplicative noise, (27), there are two stochastic numerical methods that are used in the literature the linear-mplicit Euler and the linear-implicit Crank-Nicolson schemes [<xref ref-type="bibr" rid="scirp.97390-ref52">52</xref>] .</p><p>The Euler-Maruyama scheme</p><p>Y k + 1 N , M , L = ( I − h A N ) − 1 ( Y k + 1 N , M , L + h F N ( Y k + 1 N , M , L ) )                         + ( I − h A N ) − 1 B N , L ( Y k + 1 N , M , L ) Δ W k ,   ℙ − a . s . (47)</p><p>The Crank-Nicolson scheme. The Crank-Nicolson method is a finite difference method used for numerically solving the heat equation and similar partial differential equations. It is implicit in time and can be written as an implicit Runge-Kutta method, and it is numerically stable. The method was developed by a British mathematical physicist John Crank (1867-1944) and a British mathematician Phyllis Nicolson (1916-1968) in the mid 20th century [<xref ref-type="bibr" rid="scirp.97390-ref67">67</xref>] .</p><p>Y k + 1 N , M , L = ( I − h 2 A N ) − 1 ( ( I + h 2 A N ) Y k + 1 N , M , L + h F N ( Y k + 1 N , M , L ) )                         + ( I − h 2 A N ) − 1 B N , L ( Y k N , M , L ) Δ W k ,   ℙ − a . s . (48)</p><p>for k ∈ { 0,1, ⋯ , M − 1 } and N , M , L ∈ ℕ . Here it is necessary to assume that λ ≥ 0 for all i ∈ L in Assumption ( ) in order to ensure that ( I − h A ) is inversible for every h ≥ 0 .</p><p>Convergence of SPDE with multiplicative noise. The convergence of the exponential Euler scheme will proved under the following assumptions.</p><p>Assumption 5.0.1 (A5). (Linear operator A). There exist sequences of real eigenvalues 0 &lt; λ 1 ≤ λ 2 ≤ ⋯ and orthonormal eigenfunctions ( e n ) n ≥ 1 of − A such that the linear operator A : D ( A ) ∈ H → H is given by</p><p>A v = ∑ n = 1 ∞ − λ n 〈 e n , v 〉 ,</p><p>for all v ∈ D ( A ) with D ( A ) = { v ∈ H : ∑ n = 1 ∞ | λ n | 2 〈 e n , v 〉 2 &lt; ∞ } .</p><p>(A6) (nonlinearity F). The nonlinearity F : H → H is two times continuously Fr&#233;chet differentiable and its derivatives satisfy</p><p>‖ F ′ ( x ) − F ′ ( y ) ‖ ≤ L | x − y | H ,</p><p>| ( − A ) − ( − r ) F ′ ( x ) ( − A ) r v | H ≤ L | v | H ,</p><p>for all x , y ∈ H , v ∈ D ( ( − A ) r ) , and r = 0 , 1 / 2 , 1 , and</p><p>| A − 1 F ″ ( x ) ( v , w ) | ≤ L | ( − A ) − 1 / 2 v | H | ( − A ) − 1 / 2 w | H ,</p><p>for all x , y ∈ H , where L &gt; 0 is a positive constant.</p><p>(A7) (Cylindrical Q-Wiener process W t ). There exist a sequence ( q n ) n ≥ 1 of positive real numbers and a real number γ ∈ ( 0,1 ) such that</p><p>∑ n = 1 ∞     λ n 2 γ − 1 q n &lt; ∞</p><p>and pairwise independent scalar F t -adapted Wiener process ( W t ) t ≥ 0 for n ≥ 1 . The cylindrical Q-Wiener process W t is given formally by</p><p>W t = ∑ n = 1 ∞ q n W t n e n . (49)</p><p>(A8) (Initial value). The random variable x 0 : Ω → D ( ( − A ) γ ) satisfies E | ( − A ) γ x 0 | H 4 &lt; ∞ , where γ &gt; 0 is given in A7.</p></sec><sec id="s5_4"><title>5.4. Numerical Methods for Stochastic Delay Differential Equations</title><p>There are many numerical schemes for solving stochastic delay differential equations. As given in [<xref ref-type="bibr" rid="scirp.97390-ref54">54</xref>] , we give three schemes to solve (35). The first scheme is the Predictor-correction scheme given by</p><p>X n + 1 = X n + h 2 [ f ( X n , X n − m ) + f ( X &#175; n + 1 , X n − m + 1 ) ]     + 1 2 ∑ l = 1 r [ g l ( X n , X n − m ) + g l ( X &#175; n + 1 , X n − m + 1 ) ] Δ W l , n , (50)</p><p>X &#175; n + 1 = X n + h f ( X n , X n − m ) + ∑ l = 1 r     g l ( X n , X n − m ) Δ W l , n (51)</p><p>The second is the Midpoint scheme given by</p><p>X n + 1 = X n + h f ( X n + X n + 1 2 , X n − m + X n − m + 1 2 )     + ∑ l = 1 r [ g l ( X n + X n + 1 2 , X n − m + X n − m + 1 2 ) ] Δ W &#175; l , n (52)</p><p>where we have Δ W l , n with Δ W &#175; l , n .</p><p>The last scheme is the Milstein-like scheme given by</p><p>X n + 1 = X n + h f ( X n , X n − m ) + ∑ l = 1 r     g l ( X n , X n − m ) I 0     + ∑ l = 1 r ∑ l = 1 r     ∂ x g l ( X n , X n − m ) g q ( X n , X n − m ) I q , l , t n , t n + 1 , 0     + ∑ l = 1 r ∑ l = 1 r     ∂ x τ g l ( X n , X n − m ) g q ( X n − m , X n − 2 m ) χ t n ≥ τ I q , l , t n , t n + 1 (53)</p><p>where I 0 = ∫ t n t n + 1   d W ˜ l ( t ) , I q , l , t n , t n + 1 , 0 = ∫ t n t n + 1 ∫ t n t     d W ˜ q ( s ) d W ˜ l ( t ) ,</p><p>I q , l , t n , t n + 1 , τ = ∫ t n t n + 1 ∫ t n − τ t − τ     d W ˜ q ( s ) d W ˜ l ( t ) , t n + 1 ≥ 0 ,</p><p>∫ t n t n + 1   d W ˜ l ( t ) = Δ W l , n = W l ( t n + 1 ) − W l ( t n ) .</p></sec></sec><sec id="s6"><title>6. Convergence and Implementation of Numerical Methods</title><sec id="s6_1"><title>6.1. Convergences of Numerical Methods</title><p>Definition 6.0.1. (Strong Convergence) We say that a numerical scheme for solving the SDE (36) converges strongly on [ 0, T ] to the solution X of the SDE if for the final time T have</p><p>lim δ → 0 E ( | X ( T ) − Y δ ( T ) | ) = 0. (54)</p><p>A strongly convergent scheme is said o have convergence rate γ if for some constants C and δ 0 &gt; 0 we have</p><p>lim δ → 0 E ( | X ( T ) − Y δ ( T ) | ) ≤ C δ γ , ∀ δ ∈ [ 0, δ 0 ] . (55)</p><p>Theorem 6.1. (Strong Convergence: Euler-Maruyama scheme) Under assumptions of Lipschitz and linear growth of coefficients and additionally</p><p>| a ( t , x ) − a ( s , x ) | + | σ ( t , x ) − σ ( s , x ) | ≤ K ( 1 + | x | ) | t − s | 1 / 2 (56)</p><p>for some suitable constant K, the Euler-Maruyama scheme converges strongly with a convergence rate of γ = 1 / 2 .</p><p>Theorem 6.2. (Strong convergence of Milstein scheme) In addition to the</p><p>assumption of Theorem , let σ ( t , x ) and ∂ σ ( t , x ) ∂ x satisfy the conditions on</p><p>the coefficients of the Theorem . If further we have a ∈ C 1,1 , σ ∈ C 1,2 , then the Milstein converges strongly with a convergence rate of γ = 1 .</p><p>The convergence of error for SPDE is given by the following theorem.</p><p>Theorem 6.3. (Convergence Theorem, [<xref ref-type="bibr" rid="scirp.97390-ref52">52</xref>] ) Suppose that assumptions (A1)-(A8) are satisfied. Then there is a constant C T &gt; 0 such that</p><p>sup k = 0 , ⋯ , M ( E | X t k − Y k ( N , M ) | H 2 ) 1 2 ≤ C T ( λ N − γ + log ( M ) M ) , (57)</p><p>holds for all N , M ∈ ℕ , where X t is the solution of SPDE (27), Y k ( N , M ) is the</p><p>numerical solution given by (46), t k = T k M for k = 0 , 1 , ⋯ , M , and γ &gt; 0 is</p><p>the constant given in Assumption (A8).</p></sec><sec id="s6_2"><title>6.2. Implementation of Numerical Methods</title><p>As with the Euler-Maruyama method, the Milstein method is very easy to implement which is a reason that it is also quite popular among practitioners in finance.</p><p>Algorithm 6.3.1. (The Euler-Maruyama Scheme). Let Δ t : = T / N for a given N. Then approximate the SDE via</p><p>1) Set Y N ( 0 ) = X ( 0 ) = x 0</p><p>2) For j = 0 to N − 1 do</p><p>a) Simulate a standard normally distributed random number Z j</p><p>b) Set Δ W ( j Δ t ) = Δ t Z j and</p><p>Y N ( ( j + 1 ) Δ t ) = Y N ( j Δ t ) + a ( j Δ t , Y N ( j Δ t ) ) Δ t + σ ( j Δ t , Y N ( j Δ t ) ) Δ W ( j Δ t ) .</p><p>Algorithm 6.3.2. (The Milstein Scheme) Let Δ t : = T / N for a given N. Then approximate the SDE via</p><p>1) Set Y N ( 0 ) = X ( 0 ) = x 0</p><p>2) For j = 0 to N − 1 do</p><p>a) Simulate a standard normally distributed random number Z j</p><p>b) Set Δ W ( j Δ t ) = Δ t Z j and</p><p>Y N ( ( j + 1 ) Δ t ) = Y N ( j Δ t ) + a ( j Δ t , Y N ( j Δ t ) ) Δ t + σ ( j Δ t , Y N ( j Δ t ) ) Δ W ( j Δ t )     + 1 2 σ ( j Δ t , Y N ( j Δ t ) ) σ ′ ( j Δ t , Y N ( j Δ t ) ) ( Δ W ( j Δ t ) 2 − Δ t ) .</p></sec></sec><sec id="s7"><title>7. Conclusion</title><p>This paper surveys the recent development of numerical methods used in stochastic analysis that can be useful in econometric analysis. As well-known, the discretization of the stochastic continuous-time models through the numerical methods is one of main cornerstones and problems of the modern econometric analysis. Modelling and analyzing economical dynamical systems under uncertainties through the stochastic differential equations are considered as the challenges for economists. In this paper we give these numerical methods such as Euler-Maruyama scheme, Runge-Kutta scheme, Milstein scheme and Crank-Nicolson scheme that are used in literature. Since the Black-Scholes-Merton works awarded by Nobel Prize Committee in 1997 in Economics field, the stochastic differential equations are used in economics and finance as one of the best ways to model uncertainties.</p></sec><sec id="s8"><title>Conflicts of Interest</title><p>The authors declare no conflicts of interest regarding the publication of this paper.</p></sec><sec id="s9"><title>Cite this paper</title><p>Mambo, L.N.K., Mabela, R.M.M., Bosonga, J.-P.B. and Mbuyi, E.M. (2019) Review on the Current Stochastic Numerical Methods for Econometric Analysis. American Journal of Computational Mathematics, 9, 328-347. https://doi.org/10.4236/ajcm.2019.94024</p></sec></body><back><ref-list><title>References</title><ref id="scirp.97390-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Arnold, L. (1974) Stochastic Differential Equations: Theory and Applications. John Wiley &amp; Sons, New York.</mixed-citation></ref><ref id="scirp.97390-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Stokey, N.L. (2009) The Economics of Inaction: Stochastic Control Models with Fixed Costs. Princeton University Press, Princeton.  
https://doi.org/10.1515/9781400829811</mixed-citation></ref><ref id="scirp.97390-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Higham, D.J. (2001) An Algorithmic Introduction to Numerical Simulation of Stochastic Differential Equations. SIAM Review, 43, 525-546.  
https://doi.org/10.1137/S0036144500378302</mixed-citation></ref><ref id="scirp.97390-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Judd, K.L. (1998) Numerical Methods in Economics. The MIT Press, Cambridge.</mixed-citation></ref><ref id="scirp.97390-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Brandimarte, P. (2006) Numerical Methods in Finance and Economics with MATLAB. Statistics in Practice. 2nd Edition, Wiley-Interscience, Hoboken.  
https://doi.org/10.1002/0470080493</mixed-citation></ref><ref id="scirp.97390-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Stokey, N.L., Lucas Jr., R.E. and Prescott, E.C. (1989) Recursive Methods in Economic Dynamics. Harvard University Press, Cambridge.  
https://doi.org/10.2307/j.ctvjnrt76</mixed-citation></ref><ref id="scirp.97390-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Allen, E. (2007) Modeling with Ito Stochastic Differential Equation. Springer, Berlin.</mixed-citation></ref><ref id="scirp.97390-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Moryson, M. (1998) Testing for Random Walk Coefficients in Regression and State Space Models. Physica-Verlag, Heidelberg.  
https://doi.org/10.1007/978-3-642-99799-0</mixed-citation></ref><ref id="scirp.97390-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Greene, W.H. (2003) Econometric Analysis. 5th Edition, Pearson Education, Upper Saddle River.</mixed-citation></ref><ref id="scirp.97390-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Le Cam, L.M. and Yang, G.L. (1990) Asymptotics in Statistics Some Basic Concepts. Springer-Verlag, New York. https://doi.org/10.1007/978-1-4684-0377-0</mixed-citation></ref><ref id="scirp.97390-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Lutkepohl, H. (2005) New Introduction to Multiple Time Series Analysis. Springer-Verlag, Berlin and Heidelberg. https://doi.org/10.1007/978-3-540-27752-1</mixed-citation></ref><ref id="scirp.97390-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Baker, S.R. and Davis, S.J. (2016) Measuring Economic Policy Uncertainty. Quarterly Journal of Economics, 131, 1593-1636. https://doi.org/10.1093/qje/qjw024</mixed-citation></ref><ref id="scirp.97390-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Bordo, M.D., Duca, J.V. and Koch, C. (2017) Economic Policy Uncertainty and the Credit Channel: Aggregate and Bank Level U.S. Evidence over Several Decades. Journal of Financial Stability, 58, 1317-1354. https://doi.org/10.3386/w22021</mixed-citation></ref><ref id="scirp.97390-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">Creal, D.D. and Wu, J.C. (2017) Monetary Policy Uncertainty and Economic Fluctuations. International Economic Review, 58, 1317-1354.  
https://doi.org/10.1111/iere.12253</mixed-citation></ref><ref id="scirp.97390-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Malliavin, P. and Thalmaien, A. (2006) Stochastic Calculus of Variations in Mathematical Finance. Springer Finance, Berlin and Heidelberg.</mixed-citation></ref><ref id="scirp.97390-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">Bachelier, L. (1900) Théorie de la spéculation. PhD Thesis, Ecole Normale Supérieure de Paris, Paris. https://doi.org/10.24033/asens.476</mixed-citation></ref><ref id="scirp.97390-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">Chirikjian, G.S. (2012) Stochastic Models, Information Theory, and Lie Groups: Analytic Methods and Modern Applications. Springer Science + Business Media, New York. https://doi.org/10.1007/978-0-8176-4944-9</mixed-citation></ref><ref id="scirp.97390-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">Black, F. and Scholes, M. (1973) The Pricing of Options and Corporate Liabilities. The Journal of Political Economy, 81, 637-654. https://doi.org/10.1086/260062</mixed-citation></ref><ref id="scirp.97390-ref19"><label>19</label><mixed-citation publication-type="other" xlink:type="simple">Merton, R.C. (1973) Theory of Rational Option Pricing. The Bell Journal of Econometrics and Management Science, 4, 141-183. https://doi.org/10.2307/3003143</mixed-citation></ref><ref id="scirp.97390-ref20"><label>20</label><mixed-citation publication-type="other" xlink:type="simple">Merton, R.C. (1980) On Estimating the Expected Return on the Market: An Exploratory Investigation. Journal of Financial Economics, 8, 231-247.  
https://doi.org/10.3386/w0444</mixed-citation></ref><ref id="scirp.97390-ref21"><label>21</label><mixed-citation publication-type="other" xlink:type="simple">Black, F. and Karasinski, P. (1991) Bond and Option Pricing When Short Rates Are Lognormal. Financial Analysts Journal, 47, 52-59.  
https://doi.org/10.2469/faj.v47.n4.52</mixed-citation></ref><ref id="scirp.97390-ref22"><label>22</label><mixed-citation publication-type="other" xlink:type="simple">Hansen, B.E. (1992) Convergence to Stochastic Integrals for Dependent Heterogenuous. Econometric Theory, 8, 489-500.  
https://doi.org/10.1017/S0266466600013189</mixed-citation></ref><ref id="scirp.97390-ref23"><label>23</label><mixed-citation publication-type="other" xlink:type="simple">A&amp;iuml;t-Sahalia, Y. and Jacod, J. (2010) Is Brownian Motion Necessary to Model High- Frequency Data? The Annals of Statistics, 38, 10.  
https://doi.org/10.1214/09-AOS749</mixed-citation></ref><ref id="scirp.97390-ref24"><label>24</label><mixed-citation publication-type="other" xlink:type="simple">Carrasco, M., Hu, L. and Ploberger, W. (2014) Optimal Test for Markov Switching Parameters. Econometrica, 82, 765-784. https://doi.org/10.3982/ECTA8609</mixed-citation></ref><ref id="scirp.97390-ref25"><label>25</label><mixed-citation publication-type="other" xlink:type="simple">Tsay, R.S. (2005) Analysis of Financial Time Series. 2nd Edition, John Wiley &amp; Sons, Inc., Hoboken. https://doi.org/10.1002/0471746193</mixed-citation></ref><ref id="scirp.97390-ref26"><label>26</label><mixed-citation publication-type="other" xlink:type="simple">Kushner, H.J. and Dupuis, P. (2001) Numerical Methods for Stochastic Control Problems in Continuous Time. Springer-Verlag, Berlin.  
https://doi.org/10.1007/978-1-4613-0007-6</mixed-citation></ref><ref id="scirp.97390-ref27"><label>27</label><mixed-citation publication-type="other" xlink:type="simple">Klobner, F.C. (2005) Introduction to Stochastic Calculus with Applications. 2nd Edition, Imperial College Press, London.</mixed-citation></ref><ref id="scirp.97390-ref28"><label>28</label><mixed-citation publication-type="other" xlink:type="simple">Shreve, S.E. (2004) Stochastic Calculus for Finance II: Continuous-Time Models. Springer, Berlin. https://doi.org/10.1007/978-1-4757-4296-1</mixed-citation></ref><ref id="scirp.97390-ref29"><label>29</label><mixed-citation publication-type="other" xlink:type="simple">Pham, H. (2007) Optimisation et controle stochastique appliqués à la finance. Springer-Verlag, Berlin.</mixed-citation></ref><ref id="scirp.97390-ref30"><label>30</label><mixed-citation publication-type="other" xlink:type="simple">Kushner, H.J. (1984) Approximaion and Weak Convergence Methods for Random Processes with Applications to Stochastic Systems Theory. The MIT Press, Cambridge.</mixed-citation></ref><ref id="scirp.97390-ref31"><label>31</label><mixed-citation publication-type="other" xlink:type="simple">Zhang, Z.Q. and Karniadakis, G.E. (2017) Numerical Methods for Stochastic Partial Differential Equations with White Noise. Applied Mathematical Sciences 196. Springer International Publishing AG, Berlin.  
https://doi.org/10.1007/978-3-319-57511-7_7</mixed-citation></ref><ref id="scirp.97390-ref32"><label>32</label><mixed-citation publication-type="other" xlink:type="simple">Wong, R. (2001) Asymptotic Approximations of Integrals. SIAM 34, Philadelphia.  
https://doi.org/10.1137/1.9780898719260</mixed-citation></ref><ref id="scirp.97390-ref33"><label>33</label><mixed-citation publication-type="other" xlink:type="simple">McKean Jr., H.P. (1969) Stochastic Integrals. Academic Press, New York.  
https://doi.org/10.1016/B978-1-4832-3054-2.50008-X</mixed-citation></ref><ref id="scirp.97390-ref34"><label>34</label><mixed-citation publication-type="other" xlink:type="simple">Davis, R.A. and Song, L. (2012) Functional Convergence of Stochastic Integrals with Application to Statistical Inference. Stochastic Processes and Their Applications, 122, 725-757. https://doi.org/10.1016/j.spa.2011.10.007</mixed-citation></ref><ref id="scirp.97390-ref35"><label>35</label><mixed-citation publication-type="other" xlink:type="simple">Kuo, H.H. (2006) Introduction to Stochastic Integrals. Springer Science Business, New York.</mixed-citation></ref><ref id="scirp.97390-ref36"><label>36</label><mixed-citation publication-type="other" xlink:type="simple">Medvegyev, P. (2007) Stochastic Integration Theory. Oxford University Press, New York.</mixed-citation></ref><ref id="scirp.97390-ref37"><label>37</label><mixed-citation publication-type="other" xlink:type="simple">Capasso, V. and Barstein, D. (2005) An Introduction to Continuous-Time Stochastic Processes. Birkhauser, Boston.</mixed-citation></ref><ref id="scirp.97390-ref38"><label>38</label><mixed-citation publication-type="other" xlink:type="simple">Mackevicius, V. (2011) Introduction to Stochastic Analysis: Integrals and Differential Equations. ISTE Ltd., London. John Wiley &amp; Sons, Inc., Hoboken, New Jersey.  
https://doi.org/10.1002/9781118603338</mixed-citation></ref><ref id="scirp.97390-ref39"><label>39</label><mixed-citation publication-type="other" xlink:type="simple">Hu, Y.Z. and Meyer, P.A. (1993) On the Approximation of Multiple Stratonovich Integrals. In: Stochastic Processes: A Festschrift in Honour of Gopinath Kallianpur, Springer-Verlag New York, Inc., New York, 141-148.  
https://doi.org/10.1007/978-1-4615-7909-0_17</mixed-citation></ref><ref id="scirp.97390-ref40"><label>40</label><mixed-citation publication-type="other" xlink:type="simple">Di Nunno, G., Oksendal, B. and Proske, F. (2009) Malliavin Calculus for Lévy Precesses with Applications to Finance. Springer, Berlin.  
https://doi.org/10.1007/978-3-540-78572-9</mixed-citation></ref><ref id="scirp.97390-ref41"><label>41</label><mixed-citation publication-type="other" xlink:type="simple">Malliavin, P. (1997) Stochastic Analysis. Springer-Verlag, Berlin and Heidelberg.</mixed-citation></ref><ref id="scirp.97390-ref42"><label>42</label><mixed-citation publication-type="other" xlink:type="simple">Ogawa, S. (1984) Quelques propriétés de lintégrale stochastique du type noncausal. Japan Journal of Industrial and Applied Mathematics, 1, Article No. 405.  
https://doi.org/10.1007/BF03167066</mixed-citation></ref><ref id="scirp.97390-ref43"><label>43</label><mixed-citation publication-type="other" xlink:type="simple">Nualart, D. and Zakai, M. (1989) On the Relation between the Stratonovich and Ogawa Integrals. The Annals of Probability, 17, 1536-1540.  
https://doi.org/10.1214/aop/1176991172</mixed-citation></ref><ref id="scirp.97390-ref44"><label>44</label><mixed-citation publication-type="other" xlink:type="simple">Ikeda, N. and Watanabe, S. (1989) Stochastic Differential Equations and Diffusion Processes. 2nd Edition, North-Holland Publishing Company, Kodansha Scientific Books, New York.</mixed-citation></ref><ref id="scirp.97390-ref45"><label>45</label><mixed-citation publication-type="other" xlink:type="simple">Oksendal, B. (2000) Stochastic Differential Equations. 5th Edition, Springer-Verlag, Berlin.</mixed-citation></ref><ref id="scirp.97390-ref46"><label>46</label><mixed-citation publication-type="other" xlink:type="simple">Friedman, A. (1975) Stochastic Differential Equations and Applications. Academic Press, New York. https://doi.org/10.1016/B978-0-12-268201-8.50010-4</mixed-citation></ref><ref id="scirp.97390-ref47"><label>47</label><mixed-citation publication-type="other" xlink:type="simple">Mao, X.R. (2010) Stochastic Differential Equations and Applications. 2nd Edition, Woodhead Publishing, Philadelphia.</mixed-citation></ref><ref id="scirp.97390-ref48"><label>48</label><mixed-citation publication-type="other" xlink:type="simple">Gawarecki, L. and Mandrekar, V. (2011) Stochastic Differential Equations in Infinite Dimensions with Applications to Stochastic Partial Differential Equations. Springer Verlag, Berlin and Heidelberg. https://doi.org/10.1007/978-3-642-16194-0</mixed-citation></ref><ref id="scirp.97390-ref49"><label>49</label><mixed-citation publication-type="other" xlink:type="simple">Da Prato, G. and Tubaro, L. (2006) Stochastic Differential Equations and Applications VII. Volume 245 of Lecture Note in Pure and Applied Mathematics. Chapman and Hall/CRC, Boca Raton. https://doi.org/10.1201/9781420028720</mixed-citation></ref><ref id="scirp.97390-ref50"><label>50</label><mixed-citation publication-type="other" xlink:type="simple">Da Prato, G. and Zabczyk (2004) Second Order Partial Differential Equations in Hilbert Spaces. Number 293 in Lecture Notes Series. Cambridge University Press, Cambridge.</mixed-citation></ref><ref id="scirp.97390-ref51"><label>51</label><mixed-citation publication-type="other" xlink:type="simple">Da Prato, G. and Tubaro, L. (2002) Stochastic Partial Differential Equations and Applications. Marcel Dekker, New York. https://doi.org/10.1201/9780203910177</mixed-citation></ref><ref id="scirp.97390-ref52"><label>52</label><mixed-citation publication-type="other" xlink:type="simple">Jentzen, A. and Kloeden, P.E. (2011) Taylor Approximations for Stochastic Partial Differential Equations. The Society for Industrial and Applied Mathematics, Philadelphia. https://doi.org/10.1137/1.9781611972016</mixed-citation></ref><ref id="scirp.97390-ref53"><label>53</label><mixed-citation publication-type="other" xlink:type="simple">Platen, E. and Bruti Liberti, N. (2010) Numerical Solution of Stochastic Differential Equations with Jumps in Finance. Springer-Verlag, Berlin and Heidelberg.  
https://doi.org/10.1007/978-3-642-13694-8</mixed-citation></ref><ref id="scirp.97390-ref54"><label>54</label><mixed-citation publication-type="other" xlink:type="simple">Cao, W.R., Zhang, Z.Q. and Karniadakis, G.E. (2015) Numerical Methods for Stochastic Delay Differential Equations via the Wongzakai Approximation. SIAM Journal on Scientific Computing, 37, A295-A318.  
https://doi.org/10.1137/130942024</mixed-citation></ref><ref id="scirp.97390-ref55"><label>55</label><mixed-citation publication-type="other" xlink:type="simple">Milstein, G.N. (1998) Numerical Integration of Stochastic Differential Equations. Springer Science + Business Media, Dordrecht.</mixed-citation></ref><ref id="scirp.97390-ref56"><label>56</label><mixed-citation publication-type="other" xlink:type="simple">Milstein, G.N. and Tretyakov, M.V. (2001) Numerical Solution of the Dirichlet Problem for Nonlinear Parabolic Equations by a Parabolistic Approach. IMA Journal of Numerical Analysis, 21, 887-917. https://doi.org/10.1093/imanum/21.4.887</mixed-citation></ref><ref id="scirp.97390-ref57"><label>57</label><mixed-citation publication-type="other" xlink:type="simple">Milstein, G.N. and Tretyakov, M.V. (2014) Numerics for Mathematical Physics. Springer, New York.</mixed-citation></ref><ref id="scirp.97390-ref58"><label>58</label><mixed-citation publication-type="other" xlink:type="simple">Milstein, G.N. (1995) Numerical Integration of Stochastic Differential Equations. Springer Science + Business Media, Dordrecht.  
https://doi.org/10.1007/978-94-015-8455-5</mixed-citation></ref><ref id="scirp.97390-ref59"><label>59</label><mixed-citation publication-type="other" xlink:type="simple">Ashyralyev, A. (2008) On Modified Crank-Nicholson Difference Scheme for Parabolic Equation. Numerical Functional Analysis and Optimization, 29, 268-282.  
https://doi.org/10.1080/01630560801998138</mixed-citation></ref><ref id="scirp.97390-ref60"><label>60</label><mixed-citation publication-type="other" xlink:type="simple">Kushner, H.J. and Yin, G.G. (2003) Stochastic Approximation and Recursive Algorithms and Applications. Springer-Verlag, New York.</mixed-citation></ref><ref id="scirp.97390-ref61"><label>61</label><mixed-citation publication-type="other" xlink:type="simple">Tocino, A. and Ardanuy, R. (2002) Runge-Kutta Methods for Numerical Solution of Stochastic Differential Equations. Journal of Computational and Applied Mathematics, 138, 219-241. https://doi.org/10.1016/S0377-0427(01)00380-6</mixed-citation></ref><ref id="scirp.97390-ref62"><label>62</label><mixed-citation publication-type="other" xlink:type="simple">Burrage, K. and Burrage, P.M. (2001) Order Conditions of Stochastic Rungekutta Methods by b-Series. SIAM Journal on Numerical Analysis, 38, 1626-1646.  
https://doi.org/10.1137/S0036142999363206</mixed-citation></ref><ref id="scirp.97390-ref63"><label>63</label><mixed-citation publication-type="other" xlink:type="simple">Carletti, M. (2006) Numerical Solution of Stochastic Differential Problems in the Biosciences. Journal of Computational and Applied Mathematics, 185, 422-440.  
https://doi.org/10.1016/j.cam.2005.03.020</mixed-citation></ref><ref id="scirp.97390-ref64"><label>64</label><mixed-citation publication-type="other" xlink:type="simple">Jakobsen, N.M. and Sorensen, M. (2018) Estimating Function for Jump-Diffusions.</mixed-citation></ref><ref id="scirp.97390-ref65"><label>65</label><mixed-citation publication-type="other" xlink:type="simple">Li, C. (2013) Maximum-Likelihood Estimation for Diffusion Processes via Closed Form Density Expansions. The Annals of Statistics, 41, 1350-1380.  
https://doi.org/10.1214/13-AOS1118</mixed-citation></ref><ref id="scirp.97390-ref66"><label>66</label><mixed-citation publication-type="other" xlink:type="simple">Lang, A. (2012) Mean Square Convergence of a Semidiscrete Scheme for Spdes of Zakai Type Driven by Square Integrale Martingales. Procedia Computer Science, 1, 1615-1623. https://doi.org/10.1016/j.procs.2010.04.181</mixed-citation></ref><ref id="scirp.97390-ref67"><label>67</label><mixed-citation publication-type="other" xlink:type="simple">Crank, J., Nicolson, P. and Hartree, D.R. (1947) A Practical Method for Numerical Evaluation of Solutions of Partial Differential Equations of the Heat-Conduction Type. Mathematical Proceedings of the Cambridge Philosophical Society, 43, 50-67.  
https://doi.org/10.1017/S0305004100023197</mixed-citation></ref></ref-list></back></article>