<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">JMF</journal-id><journal-title-group><journal-title>Journal of Mathematical Finance</journal-title></journal-title-group><issn pub-type="epub">2162-2434</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/jmf.2018.82026</article-id><article-id pub-id-type="publisher-id">JMF-84884</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Business&amp;Economics</subject><subject> Physics&amp;Mathematics</subject></subj-group></article-categories><title-group><article-title>
 
 
  Optimization of Cash Management Fluctuation through Stochastic Processes
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Youssef</surname><given-names>M. Dib</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Najat</surname><given-names>Kmeid</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Hanna</surname><given-names>Greige</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Youssef</surname><given-names>N. Raffoul</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib></contrib-group><aff id="aff1"><addr-line>Department of Mathematics, University of Balamand, Al-Koura, Lebanon</addr-line></aff><aff id="aff2"><addr-line>Department of Mathematics, University of Dayton, Dayton, OH, USA</addr-line></aff><author-notes><corresp id="cor1">* E-mail:<email>youssef.dib@balamand.edu.lb(YMD)</email>;</corresp></author-notes><pub-date pub-type="epub"><day>29</day><month>03</month><year>2018</year></pub-date><volume>08</volume><issue>02</issue><fpage>408</fpage><lpage>425</lpage><history><date date-type="received"><day>3,</day>	<month>November</month>	<year>2017</year></date><date date-type="rev-recd"><day>25,</day>	<month>May</month>	<year>2018</year>	</date><date date-type="accepted"><day>28,</day>	<month>May</month>	<year>2018</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  In this paper, we study the optimal level of cash for the firm to hold. We model the cash level with inflows and outflows due to deposits and withdrawals; in between, the cash level is a stochastic process where it signals a time to sell. After modeling the continuous jump, we implemented first step analysis method to find the probability of the event with initial cash and we were able to calculate data driven by set of difference equations. These data are used to determine the length of the period of the investment. Then, we adopt the probabilistic decision model where it goes under mathematical optimization. This model let the investor to maximize the probability of success or to stop on one of the largest fortunes using the equation of the principle of optimality. Finally, to solve these optimal equations, we used the result of positive dynamic programming and we elaborated them by proves.
 
</p></abstract><kwd-group><kwd>Cash Management</kwd><kwd> Markov Chain</kwd><kwd> Probability</kwd><kwd> Expected Duration</kwd><kwd> Mean Length</kwd><kwd> First-Step Analysis</kwd><kwd> Principle of Optimality</kwd><kwd> Positive Dynamic Programming</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>Defining cash balance is a classic problem in firm’s financial management. Cash management happens due to the daily inflows and outflows. It has the following responsibilities: To mobilize, manage and plan the financial resources of business. Demand for cash can be positive or negative. Positive demand consists of accounts payable, whereas negative demand is known as account receivables. These funds are available at any moment in time for the firm.</p><p>Historically, cash management problem has been studied by various researches by extension of the continuous-review stochastic inventory models. These models were originally presented in Baumol (1952) [<xref ref-type="bibr" rid="scirp.84884-ref1">1</xref>] , whereby the author makes a parallel relation between cash with other firms’ inventories. Later Miller and Orr (1966) [<xref ref-type="bibr" rid="scirp.84884-ref2">2</xref>] presented a model that considers the assumption of random cash flows as the normal distribution. They consider only two assets, cash and an alternative investment. He adopted the uses of upper and lower bounds, and considering the small time gap between the investment of cash and withdrawing it. In this case, with buy and sell bond operations, they calculated the time on an hourly basis and the cost of maintaining the cash balance daily.</p><p>Since 1980’s, various authors have worked with the cash optimization problem which is divided into deterministic and stochastic process. In this type of research, Tapiero and Zuckerman (1980) [<xref ref-type="bibr" rid="scirp.84884-ref3">3</xref>] presented a stochastic model based on the premise that cash inflows and outflows have random behavior in a poisson process.</p><p>Considering the cash balance problem as a possible use of the general and stationary Markov Model in Hinderer and Waldmann (2001) [<xref ref-type="bibr" rid="scirp.84884-ref4">4</xref>] , the authors use a model for Markov chain processes in random environments that have a stationary process as, for example, low variation over time.</p><p>As the reader could notice, this subject is the main focus of many researchers over the past few decades, but because of the uncertainty related to receipts and payments from cash flow resources, what made the result a composition of random variables were implemented models with new approaches, mainly based on stochastic process. Further reading about history and origin of cash management are discussed in [<xref ref-type="bibr" rid="scirp.84884-ref5">5</xref>] .</p><p>Recently, a literature review was conducted similar to Newman’s (2002), which presented the Faustmann framework of optimal forest rotation literature in forestry investment decisions. The application of real options in forestry investment decisions developed during the late 1980s from the simple topic of nature preservation employing a quasi-option value. This analysis method has recently been applied to much larger problems of timber cutting contracts employing Monte Carlo simulation approaches. In addition, geometric Brownian motion and mean reversion, two of the most prevalent continuous-time stochastic price models, are discussed. The number of publications slowly but steadily increased from the early 1980s to the late 1990s and has remained steady since the early 2000s, with an average of 2.7 articles annually. The discounted cash flow technique remains the major tool supporting forestry investment decisions.</p><p>The study conducted by Yao et al. (2006) [<xref ref-type="bibr" rid="scirp.84884-ref6">6</xref>] presents a different formulation, considering the demand for money according to fuzzy logic concepts, developing a single period model as, for example, without using past data due to historical data not being able to provide a cash demand forecast. Along these lines of stochastic development, Volosov et al. (2005) [<xref ref-type="bibr" rid="scirp.84884-ref7">7</xref>] present a stochastic programming model in two stages, based on scenario trees, which consider not only the problem of cash balance, but also the exposure to international currency, addressing the risk of exchange rate variation. In this model, the authors consider cash flows coming from different currencies, relating to the aspect of existing foreign exchange and the need for hedging. Thus, the authors obtain positive results in determining the optimal cash balance. More recently, Gormley and Meade (2007) [<xref ref-type="bibr" rid="scirp.84884-ref8">8</xref>] have differentiated their work by presenting a dynamic policy for cash balance that minimizes transfer costs when cash flows are not independent or identically distributed in a general cost structure. By using this methodology, the authors used historical data to develop a time series model to forecast cash flows, promoting a conditional expectation of future cash flows and obtaining results in the reduced transfer cost.</p><p>Melo and Bilich (2011) [<xref ref-type="bibr" rid="scirp.84884-ref9">9</xref>] propose the use of dynamic programming to minimize the cost of cash, considering the cost de rupture cash. In order to ensure that investment decisions are made optimally in terms of both reward and risk, suitable frameworks for the solution of supply chain optimisation problems under uncertainty are required. Most of the existing frameworks are suitable for two-stage problems while there is a need for appropriate multi-stage, multi-period optimisation frameworks for supply chain management as Balasubramanian and Grossmann (2004) [<xref ref-type="bibr" rid="scirp.84884-ref10">10</xref>] and Wu and Ierapetritou (2007) [<xref ref-type="bibr" rid="scirp.84884-ref11">11</xref>] .</p><p>In this manuscript, we consider an inventory approach to cash management where the stochastic nature appears in the demand for money.</p></sec><sec id="s2"><title>2. Model</title><p>The firm’s cash level fluctuates randomly as the result of many relatively small transactions. We model this fluctuation by dividing time into successive, length periods and by assuming that from period to period, the cash level moves up or down one unit, each with different probability.</p><p>Using these symbols, we will elaborate our study by letting:</p><p>s: Minimal capital.</p><p>S: Maximum capital.</p><p>n: Period n or cycle.</p><p>p: Probability of success.</p><p>q: Probability of loss.</p><p>T 0 : Initial cash on hand.</p><p>X n : Event when the cash reaches the boundaries at n<sup>th</sup> periods.</p><p>T: Random time of the first transaction when it stops at 0 or S.</p><p>T 0 + 1 : First position when there is successful investment.</p><p>T 0 − 1 : First position when the investor loses his investment.</p><p>k: Possible cash states.</p><p>u k : Probability of cash fluctuation starting from initial state k.</p><p>s + 1 : State at first step of success.</p><p>s − 1 : State at first step of loss.</p><p>W s + 1 : Remainder after the first step of success.</p><p>W s − 1 : Remainder after the first step of loss.</p><p>W s : Mean duration starting from s reaching k.</p><p>W s h : Homogeneous solution of mean duration.</p><p>W s p : Particular solution of mean duration.</p><p>W s k : Expected number of visits to level k starting from s.</p><p>1 { X n = k } : Indicator random variable that takes value 1 when it reaches k and the value 0 otherwise.</p><p>max ( s − k , 0 ) : Maximum state k reached between 0 and s.</p><p>r: Total cost of holding cash on hand during a cycle.</p><p>K: Fixed cost of each transaction.</p><p>T i : Duration of the i<sup>th</sup> cycle.</p><p>R i : Total opportunity cost of holding cash on hand.</p><p>Y n : Maximum value observed in the sequence of Y 1 till Y n .</p><p>σ i * : Optimal stopping time.</p><p>P { Y σ * } : Probability of success where the investor will stop investing with the largest fortune.</p><p>C: All stopping time.</p><p>w ( x ) : Probability of success starting from x.</p><p>s ( x ) : Probability of success starting when the firm stop in x.</p><p>c ( x ) : Probability of success when firm continue investing in an optimal manner.</p><p>x * : Valid investments at state x.</p><p>x: Set of fortune valid at state x.</p><p>f: Stationary policy.</p><p>x &lt; x * : State when the firm stop investing.</p><p>x ≥ x * : State when the firm continue investing.</p><p>w f ( x ) : Probability of success starting from state x when policy f is employed.</p><p>P x or P x ( S − x , x ) : Probability reaching the fortune at state x before the maximum amount of capital S.</p><p>i: Largest fortune that the investor feels satisfied about.</p><p>r (Section 2.4.2): State of when the investor chooses to stop.</p><p>P x ( i , x ) : Probability of success at state x having one of the largest fortune i.</p><p>k i * : Valid investment at i when the firm stops at one of the largest fortune.</p><p>We consider cash management strategies and we specify cash levels by two parameters, s and S, where 0 &lt; s &lt; S . The policy is as follows:</p><p>-When the firm’s capital drops to zero, then he will sell sufficient bonds to replenish the cash level up to s.</p><p>-When it increases up to S, then the investor will invest in treasury bills in order to reduce the cash level to s.</p><p>This process has led us to adopt an approach in [<xref ref-type="bibr" rid="scirp.84884-ref12">12</xref>] to analyse fluctuation.</p><p>We see in <xref ref-type="fig" rid="fig1">Figure 1</xref> that the cash level fluctuates in each cycle when it begins with s units of cash on hand and end at the next intervention whether a replenishment or reduction in cash.</p><p>We will begin our study by evaluating the mean number of visits to a</p><p>particular state, the mean length of a cycle, first step analysis and at the end we will evaluate the long run performance of the model.</p><p>Consider a firm who wins or loses on each investment as a result of many small deposits and withdrawals. We model this fluctuation by dividing time into periods. In each time period, assume the reserve randomly increases one unit of cash with probability p and decreases one unit by a probability q.</p><p>We will model this assumption using stochastic probability where p ≠ q . Let’s define the random variable Y 1 , Y 2 , ⋯ where</p><p>Y n = { + 1,   with   probability   p ;   − 1,   with   probability   q .  </p><p>We start with an initial value T 0 = Y 0 = s as initial cash. We define the</p><p>sequence of sums T n = ∑ i = 0 n   Y i which makes the sequence T n = T 0 + ∑ i = 1 n   Y i is</p><p>the cash on hand at period n. We can look at how many investment the process will experience until it achieves 0 or S. Each investment is of probability p and q = 1 − p respectively.</p></sec><sec id="s3"><title>3. Probability and Mean Duration</title><p>Let T denote the random time of the first transaction and X n represents the event when they both reach 0 or S at n<sup>th</sup> period.</p><p>In symbols, T = min { n ≥ 0 ; X n = 0   or   X n = S } . If there is success the firm continues to invest as if the initial position is T 0 + 1 with probability p and if the firm loses the position initial is T 0 − 1 with probability q.</p><p>T 0 + 1 and T 0 − 1 are the first trial when the firm invest. That’s why the most important step in real life phenomena is the first step analysis. Its main benefit is that it provides a benchmark to evaluate more methods. To this end, we perform the first step analysis associated with our optimization problem by:</p>The Method “First-Step Analysis”<p>The probability of the cash fluctuation starting from the initial state k is:</p><p>u k = P r { X T = 0 / X 0 = k }</p><p>where the event written as X T = 0 is the event of firms robbed.</p><p>Similar to the first step analysis in [<xref ref-type="bibr" rid="scirp.84884-ref13">13</xref>] and [<xref ref-type="bibr" rid="scirp.84884-ref14">14</xref>] we will obtain the equations</p><p>u k = p u k + 1 + q u k − 1 ,     for   k = 1 , 2 , ⋯ , S − 1. (1)</p><p>with boundary conditions:</p><p>u 0 = 1 , u S = 0.</p><p>We begin the solution by introducing the differences x k = u k − u k − 1 for k = 1 , 2 , ⋯ , S . Using p + q = 1 to write u k = ( p + q ) u k = p u k + q u k , equation (2.1) becomes:</p><p>k = 1 ;     0 = p ( u 2 − u 1 ) − q ( u 1 − u 0 ) = p x 2 − q x 1 ;</p><p>k = 2 ;     0 = p ( u 3 − u 2 ) − q ( u 2 − u 1 ) = p x 3 − q x 2 ;</p><p>⋯</p><p>k = S − 1 ;     0 = p ( u S − u S − 1 ) − q ( u S − 1 − u S − 2 ) = p x S − q x S − 1 ;</p><p>given,</p><p>x 2 = ( q / p ) x 1 ;</p><p>x 3 = ( q / p ) x 2 = ( q / p ) 2 x 1 ;</p><p>x 4 = ( q / p ) x 3 = ( q / p ) 3 x 1 ;</p><p>⋯</p><p>x k = ( q / p ) x k − 1 = ( q / p ) k − 1 x 1 ;</p><p>⋯</p><p>x S = ( q / p ) x S − 1 = ( q / p ) S − 1 x 1 ;</p><p>Now, using u 0 , u 1 , ⋯ , u S by invoking the conditions u 0 = 1 , u S = 0 and summing the x k ’s:</p><p>x 1 = u 1 − u 0 = u 1 − 1 ;</p><p>x 2 = u 2 − u 1 , x 1 + x 2 = u 2 − 1 ;</p><p>x 3 = u 3 − u 2 , x 1 + x 2 + x 3 = u 3 − 1 ;</p><p>⋯</p><p>x k = u k − u k − 1 , x 1 + x 2 + ⋯ + x k = u k − 1 ;</p><p>⋯</p><p>x S = u S − u S − 1 ,<inline-formula><inline-graphic xlink:href="/html.scirp.org/file/10-1490610x82.png" xlink:type="simple"/></inline-formula>;</p><p>The equation for general k gives:</p><disp-formula id="scirp.84884-formula1"><label>(2)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x83.png"  xlink:type="simple"/></disp-formula><p>which expresses <inline-formula><inline-graphic xlink:href="/html.scirp.org/file/10-1490610x84.png" xlink:type="simple"/></inline-formula> in terms of<inline-formula><inline-graphic xlink:href="/html.scirp.org/file/10-1490610x85.png" xlink:type="simple"/></inline-formula>; But <inline-formula><inline-graphic xlink:href="/html.scirp.org/file/10-1490610x86.png" xlink:type="simple"/></inline-formula> gives</p><disp-formula id="scirp.84884-formula2"><graphic  xlink:href="//html.scirp.org/file/10-1490610x87.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.84884-formula3"><graphic  xlink:href="//html.scirp.org/file/10-1490610x88.png"  xlink:type="simple"/></disp-formula><p>which substituted into (2.2) gives:</p><disp-formula id="scirp.84884-formula4"><graphic  xlink:href="//html.scirp.org/file/10-1490610x89.png"  xlink:type="simple"/></disp-formula><p>The geometric series sums to:</p><disp-formula id="scirp.84884-formula5"><graphic  xlink:href="//html.scirp.org/file/10-1490610x90.png"  xlink:type="simple"/></disp-formula><p>whence <inline-formula><inline-graphic xlink:href="/html.scirp.org/file/10-1490610x91.png" xlink:type="simple"/></inline-formula></p><p>A similar approach can be used to evaluate the mean duration, the time T is composed of a first step plus the remaining steps. With probability p, the first step of success is to state<inline-formula><inline-graphic xlink:href="/html.scirp.org/file/10-1490610x92.png" xlink:type="simple"/></inline-formula>, and then the remainder is<inline-formula><inline-graphic xlink:href="/html.scirp.org/file/10-1490610x93.png" xlink:type="simple"/></inline-formula>.With probability q, the first step of loss is to <inline-formula><inline-graphic xlink:href="/html.scirp.org/file/10-1490610x94.png" xlink:type="simple"/></inline-formula> and there are <inline-formula><inline-graphic xlink:href="/html.scirp.org/file/10-1490610x95.png" xlink:type="simple"/></inline-formula> remainder.</p><p>Thus, for the mean duration, a first step analysis leads to the difference equation:</p><disp-formula id="scirp.84884-formula6"><label>(3)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x96.png"  xlink:type="simple"/></disp-formula><p>The firm will end its investment in states 0 and S.</p><p>The boundary conditions are:<inline-formula><inline-graphic xlink:href="/html.scirp.org/file/10-1490610x97.png" xlink:type="simple"/></inline-formula>.</p><p>We will solve (2.3) when<inline-formula><inline-graphic xlink:href="/html.scirp.org/file/10-1490610x98.png" xlink:type="simple"/></inline-formula>:</p><p>First, we need to find the general solution to the homogeneous equation:</p><disp-formula id="scirp.84884-formula7"><graphic  xlink:href="//html.scirp.org/file/10-1490610x99.png"  xlink:type="simple"/></disp-formula><p>and a particular solution to the non-homogeneous equation.</p><p>We already know the general solution to the homogeneous equation:</p><disp-formula id="scirp.84884-formula8"><graphic  xlink:href="//html.scirp.org/file/10-1490610x100.png"  xlink:type="simple"/></disp-formula><p>which is: <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x101.png" xlink:type="simple"/></inline-formula></p><p>Then, we use the form <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x102.png" xlink:type="simple"/></inline-formula> to find the particular solution. <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x102.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x103.png" xlink:type="simple"/></inline-formula>and E represent the constants to be found that fits <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x102.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x103.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x104.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x102.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x103.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x104.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x105.png" xlink:type="simple"/></inline-formula> to obtain<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x102.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x103.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x104.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x105.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x106.png" xlink:type="simple"/></inline-formula>, the general solution.</p><p>The general solution of the duration equation is:</p><disp-formula id="scirp.84884-formula9"><graphic  xlink:href="//html.scirp.org/file/10-1490610x107.png"  xlink:type="simple"/></disp-formula><p>The boundary conditions require that<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x108.png" xlink:type="simple"/></inline-formula>, and</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x109.png" xlink:type="simple"/></inline-formula>.</p><p>Solving for A and B, we find:</p><disp-formula id="scirp.84884-formula10"><label>(4)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x110.png"  xlink:type="simple"/></disp-formula><p>Comparing to Dunbar’s paper [<xref ref-type="bibr" rid="scirp.84884-ref15">15</xref>] where he discussed the following:</p><p>If<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x111.png" xlink:type="simple"/></inline-formula>; the particular solution is<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x111.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x112.png" xlink:type="simple"/></inline-formula>. It follows the general solution is of the form<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x111.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x112.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x113.png" xlink:type="simple"/></inline-formula>; satisfying the boundary conditions the solution is<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x111.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x112.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x113.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x114.png" xlink:type="simple"/></inline-formula>.</p></sec><sec id="s4"><title>4. Mean Number of Visits to a Cycle</title><p>Now, fix a state k where <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x115.png" xlink:type="simple"/></inline-formula> and let <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x115.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x116.png" xlink:type="simple"/></inline-formula> be the expected number of visits to the level k starting from s given by a formal mathematical expression which is:</p><disp-formula id="scirp.84884-formula11"><graphic  xlink:href="//html.scirp.org/file/10-1490610x117.png"  xlink:type="simple"/></disp-formula><p>where<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x118.png" xlink:type="simple"/></inline-formula> is the indicator random variable that takes the value 1 when <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x118.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x119.png" xlink:type="simple"/></inline-formula> reaches state k and 0 otherwise.</p><p>Note that if I go to a bank N times and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x120.png" xlink:type="simple"/></inline-formula> is the event (“I am robbed the n<sup>th</sup></p><p>time”) then the inner sum “<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x121.png" xlink:type="simple"/></inline-formula>” is the total number of times where I am</p><p>robbed.</p><p>Then using the first step analysis, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x122.png" xlink:type="simple"/></inline-formula>satisfies the equations:</p><disp-formula id="scirp.84884-formula12"><label>(5)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x123.png"  xlink:type="simple"/></disp-formula><p>with boundary conditions <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x124.png" xlink:type="simple"/></inline-formula></p><p>where</p><disp-formula id="scirp.84884-formula13"><graphic  xlink:href="//html.scirp.org/file/10-1490610x125.png"  xlink:type="simple"/></disp-formula><p>We consider two cases:</p><p>• case 1: When<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x126.png" xlink:type="simple"/></inline-formula>, we will obtain the homogeneous equation<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x126.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x127.png" xlink:type="simple"/></inline-formula>;</p><p>• case 2: When<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x128.png" xlink:type="simple"/></inline-formula>, we will obtain a non homogeneous difference equation.</p><p>Using Linear Algebra, we found the particular solution:</p><disp-formula id="scirp.84884-formula14"><graphic  xlink:href="//html.scirp.org/file/10-1490610x129.png"  xlink:type="simple"/></disp-formula><p>Following that:</p><disp-formula id="scirp.84884-formula15"><graphic  xlink:href="//html.scirp.org/file/10-1490610x130.png"  xlink:type="simple"/></disp-formula><p>which makes the full solution when <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x131.png" xlink:type="simple"/></inline-formula> is as following:</p><disp-formula id="scirp.84884-formula16"><graphic  xlink:href="//html.scirp.org/file/10-1490610x132.png"  xlink:type="simple"/></disp-formula><p>where we denote <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x133.png" xlink:type="simple"/></inline-formula> by the notation <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x133.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x134.png" xlink:type="simple"/></inline-formula></p><p>so when<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x135.png" xlink:type="simple"/></inline-formula>; we will obtain:</p><disp-formula id="scirp.84884-formula17"><graphic  xlink:href="//html.scirp.org/file/10-1490610x136.png"  xlink:type="simple"/></disp-formula><p>Using the obtained result of<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x137.png" xlink:type="simple"/></inline-formula>, the mean total unit periods of cash on hand up to time T starting from<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x137.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x138.png" xlink:type="simple"/></inline-formula>, multiplying by k, by r and summing overall the cash is calculated as follow:</p><disp-formula id="scirp.84884-formula18"><label>(6)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x139.png"  xlink:type="simple"/></disp-formula><p>These results are interesting and useful in their own right as estimates of the length of a cycle and the expected cost of cash on hand during a cycle. Now we use these results to evaluate the long run behavior of the cycles. These cycles are statistically independent. Let K be the fixed cost of each transaction. Let <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x140.png" xlink:type="simple"/></inline-formula> be the duration of the ith cycle and let <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x140.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x141.png" xlink:type="simple"/></inline-formula> be the total opportunity cost of holding cash on hand during that time. Over n cycles the average cost per unit time is:</p><disp-formula id="scirp.84884-formula19"><graphic  xlink:href="//html.scirp.org/file/10-1490610x142.png"  xlink:type="simple"/></disp-formula><p>Next, divide the numerator and denominator by n, we obtain :</p><disp-formula id="scirp.84884-formula20"><graphic  xlink:href="//html.scirp.org/file/10-1490610x143.png"  xlink:type="simple"/></disp-formula><p>Let r denote the opportunity cost per time unit of cash on hand. Then<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x144.png" xlink:type="simple"/></inline-formula>, while<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x144.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x145.png" xlink:type="simple"/></inline-formula>. Since these quantities were determined in (2.4) and (2.6) respectively we have:</p><disp-formula id="scirp.84884-formula21"><label>(7)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x146.png"  xlink:type="simple"/></disp-formula><p>We used calculus to determine the minimizing values for S and s, it simplifies matters if we introduce the new variable<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x147.png" xlink:type="simple"/></inline-formula>. Then (2.7) becomes:</p><disp-formula id="scirp.84884-formula22"><graphic  xlink:href="//html.scirp.org/file/10-1490610x148.png"  xlink:type="simple"/></disp-formula><p>Take the partial derivatives with respect to x and S and set them equal to zero, then solve, to find the critical points.</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x149.png" xlink:type="simple"/></inline-formula>and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x149.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x150.png" xlink:type="simple"/></inline-formula></p><p>Implementing the cash management strategy with the values <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x151.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x151.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x152.png" xlink:type="simple"/></inline-formula> results in the optimal balance between transaction costs and the opportunity cost of holding cash in hand.</p><p>In our study, we adopted the approach with <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x153.png" xlink:type="simple"/></inline-formula> as oppose to what in literature used to solve the optimization problem where they used similar probabilities when<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x153.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x154.png" xlink:type="simple"/></inline-formula>. Dunbar specifically worked on <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x153.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x154.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x155.png" xlink:type="simple"/></inline-formula> where he found</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x156.png" xlink:type="simple"/></inline-formula>and<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x156.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x157.png" xlink:type="simple"/></inline-formula>, the probability of cash fluctuation and the mean</p><p>duration respectively. Our approach is more realistic because there is no similar probabilities in real life. Contrarily to their study too, we analyzed the first step analysis. At the end, we evaluated the long run behavior cost. The last one is better than the short one because the firm will have the flexibility to change big components to achieve optimal efficiency.</p></sec><sec id="s5"><title>5. Optimal Stopping Time</title><sec id="s5_1"><title>5.1. Maximize the Probability of Success</title><p>In the previous section, we discussed when the firm will go bankrupt or when it reaches a predefined boundary. Now, we will discuss the decision that the investor will take to stop or continue investing [<xref ref-type="bibr" rid="scirp.84884-ref16">16</xref>] [<xref ref-type="bibr" rid="scirp.84884-ref17">17</xref>] .</p><p>This decision-making problem is classified under two categories: deterministic and probabilistic decision models. During our work, we will adopt the probabilistic decision model where it goes under the mathematical optimization. It is the branch of the computational science that seeks the answer to the question “What is the best?”. The model of the mathematical optimization consists of an objective function and a set of constraints expressed in the form of a system of stochastic inequalities [<xref ref-type="bibr" rid="scirp.84884-ref18">18</xref>] .</p><p>Optimization models are used in almost all areas of decision making such that financial investment and cash management. The process of these models starts by describing the problem; prescribes a solution and controls the problem by updating the optimal solution continuously while changing the parameters.</p></sec><sec id="s5_2"><title>5.2. Optimization’s Model</title><p>The sequence <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x158.png" xlink:type="simple"/></inline-formula> defined in Section 2.1 as a sequence of random variables is redefined in this section. Then, the serious decision of either to stop or continue takes place at time n when <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x158.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x159.png" xlink:type="simple"/></inline-formula> is the maximum value observed.</p><p>The sequence is now defined as follow:</p><disp-formula id="scirp.84884-formula23"><graphic  xlink:href="//html.scirp.org/file/10-1490610x160.png"  xlink:type="simple"/></disp-formula><p>The objective is to find a stopping policy that will maximize the probability of success where the investor will stop investing with the largest fortune. This problem can be described in terms of stopping time as that of seeking an optimal stopping time <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x161.png" xlink:type="simple"/></inline-formula> such that:</p><disp-formula id="scirp.84884-formula24"><label>(8)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x162.png"  xlink:type="simple"/></disp-formula><p>where C is all stopping times and T is the time process defined in section 2 as:</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x163.png" xlink:type="simple"/></inline-formula>.</p><p>This decision state is referred to as state x if<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x164.png" xlink:type="simple"/></inline-formula>, because the decision depends neither on the values of <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x164.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x165.png" xlink:type="simple"/></inline-formula> nor on the number of investments already made.</p><p>Let <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x166.png" xlink:type="simple"/></inline-formula> be the probability of success starting from state x, and let:</p><p>• <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x167.png" xlink:type="simple"/></inline-formula> be the probability of success when the firm stop in state x</p><p>• <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x168.png" xlink:type="simple"/></inline-formula> be the probability that the firm continue investing in an optimal manner in state x.</p><p>Then, the principle of optimality:</p><disp-formula id="scirp.84884-formula25"><label>(9)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x169.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x170.png" xlink:type="simple"/></inline-formula> is already defined by <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x170.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x171.png" xlink:type="simple"/></inline-formula> in Section 2.2.1:</p><disp-formula id="scirp.84884-formula26"><label>(10)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x172.png"  xlink:type="simple"/></disp-formula><p>and</p><disp-formula id="scirp.84884-formula27"><label>(11)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x173.png"  xlink:type="simple"/></disp-formula><p>as given in [<xref ref-type="bibr" rid="scirp.84884-ref16">16</xref>] [<xref ref-type="bibr" rid="scirp.84884-ref17">17</xref>]</p><p>with the boundary conditions:</p><disp-formula id="scirp.84884-formula28"><graphic  xlink:href="//html.scirp.org/file/10-1490610x174.png"  xlink:type="simple"/></disp-formula><p>To solve the optimality equation we use the result of positive dynamic programming [<xref ref-type="bibr" rid="scirp.84884-ref19">19</xref>] . If the result fits the framework of the positive dynamic programming, then a given stationary policy is optimal if its value function satisfies the optimality equation. This problem fits the framework of positive dynamic programming since if we suppose that the reserve increases one unit of cash if we attain the largest over all and all other reserves are zero, then the expected total fortune equals the probability of success.</p><p>Let f be a stationary policy which, when the decision process is in state x, chooses to stop if and only if <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x175.png" xlink:type="simple"/></inline-formula> where:</p><disp-formula id="scirp.84884-formula29"><label>(12)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x176.png"  xlink:type="simple"/></disp-formula><p>Then f is optimal.</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x177.png" xlink:type="simple"/></inline-formula>belongs to the set of valid investments and x belongs to the set of fortune.</p><p>In addition, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x178.png" xlink:type="simple"/></inline-formula>because we will always assume that the investor cannot invest using the capital that he doesn’t have and doesn’t invest more than he needs in order to reach the target;</p><p>To prove that f is optimal when (2.12) is considered:</p><p>Let <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x179.png" xlink:type="simple"/></inline-formula> denote the probability of success starting from state x when policy f is employed.</p><p>Once the decision process leaves state x; i.e.<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x180.png" xlink:type="simple"/></inline-formula>; it never stops until absorption takes place under f.</p><p>We obtain:</p><disp-formula id="scirp.84884-formula30"><label>(13)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x181.png"  xlink:type="simple"/></disp-formula><p>where</p><disp-formula id="scirp.84884-formula31"><label>(14)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x182.png"  xlink:type="simple"/></disp-formula><p>Observe that <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x183.png" xlink:type="simple"/></inline-formula> is decreasing in x because if we find the derivative of (2.10):</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x184.png" xlink:type="simple"/></inline-formula>;</p><p>we obtain:</p><disp-formula id="scirp.84884-formula32"><graphic  xlink:href="//html.scirp.org/file/10-1490610x185.png"  xlink:type="simple"/></disp-formula><p>which will be negative. For that <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x186.png" xlink:type="simple"/></inline-formula> is decreasing in x.</p><p>Similarly, the derivative for<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x187.png" xlink:type="simple"/></inline-formula>, is <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x187.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x188.png" xlink:type="simple"/></inline-formula> and it is negative</p><p>that’s why we say that <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x189.png" xlink:type="simple"/></inline-formula> is decreasing in x. While <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x189.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x190.png" xlink:type="simple"/></inline-formula> is increasing in x because if we find its derivative, we find that<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x189.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x190.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x191.png" xlink:type="simple"/></inline-formula>.</p><p>In fact, from Equation (2.14) and</p><p>for<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x192.png" xlink:type="simple"/></inline-formula>:</p><disp-formula id="scirp.84884-formula33"><graphic  xlink:href="//html.scirp.org/file/10-1490610x193.png"  xlink:type="simple"/></disp-formula><p>For<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x194.png" xlink:type="simple"/></inline-formula>,<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x194.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x195.png" xlink:type="simple"/></inline-formula>.</p><p>Let’s prove that f is optimal where f is as defined in (2.9). We have to show that <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x196.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x196.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x197.png" xlink:type="simple"/></inline-formula> satisfies:</p><disp-formula id="scirp.84884-formula34"><label>(15)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x198.png"  xlink:type="simple"/></disp-formula><p>as given in [<xref ref-type="bibr" rid="scirp.84884-ref16">16</xref>] [<xref ref-type="bibr" rid="scirp.84884-ref17">17</xref>] ; and</p><disp-formula id="scirp.84884-formula35"><label>(16)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x199.png"  xlink:type="simple"/></disp-formula><p>we have to work on the conditions where <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x200.png" xlink:type="simple"/></inline-formula> and<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x200.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x201.png" xlink:type="simple"/></inline-formula>;</p><p>1) for<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x202.png" xlink:type="simple"/></inline-formula>; it means when<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x202.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x203.png" xlink:type="simple"/></inline-formula>;</p><disp-formula id="scirp.84884-formula36"><label>(17)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x204.png"  xlink:type="simple"/></disp-formula><p>or</p><disp-formula id="scirp.84884-formula37"><graphic  xlink:href="//html.scirp.org/file/10-1490610x205.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.84884-formula38"><graphic  xlink:href="//html.scirp.org/file/10-1490610x206.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.84884-formula39"><graphic  xlink:href="//html.scirp.org/file/10-1490610x207.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.84884-formula40"><graphic  xlink:href="//html.scirp.org/file/10-1490610x208.png"  xlink:type="simple"/></disp-formula><p>Then,</p><disp-formula id="scirp.84884-formula41"><graphic  xlink:href="//html.scirp.org/file/10-1490610x209.png"  xlink:type="simple"/></disp-formula><p>Let’s verify the inequality for<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x210.png" xlink:type="simple"/></inline-formula>:</p><p>In this case,</p><p>- <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x211.png" xlink:type="simple"/></inline-formula></p><p>- <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x212.png" xlink:type="simple"/></inline-formula></p><p>- <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x213.png" xlink:type="simple"/></inline-formula></p><disp-formula id="scirp.84884-formula42"><graphic  xlink:href="//html.scirp.org/file/10-1490610x214.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.84884-formula43"><graphic  xlink:href="//html.scirp.org/file/10-1490610x215.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.84884-formula44"><label>(18)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x216.png"  xlink:type="simple"/></disp-formula><p>True, so the inequality is verified.</p><p>Now, for<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x217.png" xlink:type="simple"/></inline-formula>:</p><p>- <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x218.png" xlink:type="simple"/></inline-formula></p><p>- <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x219.png" xlink:type="simple"/></inline-formula></p><p>- <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x220.png" xlink:type="simple"/></inline-formula></p><p>- <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x221.png" xlink:type="simple"/></inline-formula></p><p>- <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x222.png" xlink:type="simple"/></inline-formula></p><p>So the inequality is as follow;</p><disp-formula id="scirp.84884-formula45"><label>(19)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x223.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.84884-formula46"><graphic  xlink:href="//html.scirp.org/file/10-1490610x224.png"  xlink:type="simple"/></disp-formula><p>2) Check for<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x225.png" xlink:type="simple"/></inline-formula>:</p><p>It means that when<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x226.png" xlink:type="simple"/></inline-formula>;</p><disp-formula id="scirp.84884-formula47"><label>(20)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x227.png"  xlink:type="simple"/></disp-formula><p>or;</p><disp-formula id="scirp.84884-formula48"><graphic  xlink:href="//html.scirp.org/file/10-1490610x228.png"  xlink:type="simple"/></disp-formula><p>Let’s start with:</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x229.png" xlink:type="simple"/></inline-formula>for <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x229.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x230.png" xlink:type="simple"/></inline-formula></p><p>and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x231.png" xlink:type="simple"/></inline-formula> so, <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x231.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x232.png" xlink:type="simple"/></inline-formula></p><p>Having;</p><disp-formula id="scirp.84884-formula49"><graphic  xlink:href="//html.scirp.org/file/10-1490610x233.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.84884-formula50"><graphic  xlink:href="//html.scirp.org/file/10-1490610x234.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.84884-formula51"><graphic  xlink:href="//html.scirp.org/file/10-1490610x235.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.84884-formula52"><graphic  xlink:href="//html.scirp.org/file/10-1490610x236.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.84884-formula53"><graphic  xlink:href="//html.scirp.org/file/10-1490610x237.png"  xlink:type="simple"/></disp-formula><p>To prove that the investor will continue investing, we have <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x238.png" xlink:type="simple"/></inline-formula> because P denotes the probability of success starting at state x and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x238.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x239.png" xlink:type="simple"/></inline-formula> when the firm stop at state x. The inequality (2.20) is proved for<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x238.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x239.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x240.png" xlink:type="simple"/></inline-formula>, so the inequality is proved and makes the statement true for<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x238.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x239.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x240.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x241.png" xlink:type="simple"/></inline-formula>.</p></sec><sec id="s5_3"><title>5.3. Optimal Stopping Time of Satisfaction</title><p>In this section, we will find an optimal stopping time of when the investor feels satisfaction and stop investing on one of the largest fortune that he had.</p><p>Similarly to the previous section, the optimal stopping time is given by:</p><disp-formula id="scirp.84884-formula54"><label>(21)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x242.png"  xlink:type="simple"/></disp-formula><p>where:</p><disp-formula id="scirp.84884-formula55"><label>(22)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x243.png"  xlink:type="simple"/></disp-formula><p>We denote the serious decision as if:</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x244.png" xlink:type="simple"/></inline-formula>.</p><p>This state can be written as <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x245.png" xlink:type="simple"/></inline-formula> if <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x245.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x246.png" xlink:type="simple"/></inline-formula> where <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x245.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x246.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x247.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x245.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x246.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x247.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x248.png" xlink:type="simple"/></inline-formula> and</p><disp-formula id="scirp.84884-formula56"><graphic  xlink:href="//html.scirp.org/file/10-1490610x249.png"  xlink:type="simple"/></disp-formula><p>Let <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x250.png" xlink:type="simple"/></inline-formula> where <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x250.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x251.png" xlink:type="simple"/></inline-formula> be the probability of success starting from state <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x250.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x251.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x252.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x250.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x251.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x252.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x253.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x250.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x251.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x252.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x253.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x254.png" xlink:type="simple"/></inline-formula> as defined in the previous section.</p><p>The principle of optimality is:</p><disp-formula id="scirp.84884-formula57"><label>(23)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x255.png"  xlink:type="simple"/></disp-formula><p>where</p><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x256.png" xlink:type="simple"/></inline-formula>when <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x256.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x257.png" xlink:type="simple"/></inline-formula></p><p>with</p><disp-formula id="scirp.84884-formula58"><label>(24)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x258.png"  xlink:type="simple"/></disp-formula><p>and;</p><disp-formula id="scirp.84884-formula59"><graphic  xlink:href="//html.scirp.org/file/10-1490610x259.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.84884-formula60"><label>(25)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x260.png"  xlink:type="simple"/></disp-formula><p>Similarly;</p><p>Let f be a stationary policy which, when the decision process is in state<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x261.png" xlink:type="simple"/></inline-formula>; we chooses to stop if and only if <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x261.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x262.png" xlink:type="simple"/></inline-formula> where:</p><disp-formula id="scirp.84884-formula61"><label>(26)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x263.png"  xlink:type="simple"/></disp-formula><p>Then f is optimal.</p><p>Let’s prove the Equation (2.26);</p><p>Let <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x264.png" xlink:type="simple"/></inline-formula> be the probability of success starting from state <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x264.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x265.png" xlink:type="simple"/></inline-formula> when the policy f is employed.</p><p>Once the decision process leaves the state <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x266.png" xlink:type="simple"/></inline-formula> for <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x266.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x267.png" xlink:type="simple"/></inline-formula> it never stops until absorption takes place under f.</p><disp-formula id="scirp.84884-formula62"><label>(27)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x268.png"  xlink:type="simple"/></disp-formula><p><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x269.png" xlink:type="simple"/></inline-formula>is decreasing already proved; while <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x269.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x270.png" xlink:type="simple"/></inline-formula> is increasing in x, and <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x269.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x270.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x271.png" xlink:type="simple"/></inline-formula> is given as follows:</p><disp-formula id="scirp.84884-formula63"><graphic  xlink:href="//html.scirp.org/file/10-1490610x272.png"  xlink:type="simple"/></disp-formula><p>we choose to continue in state<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x273.png" xlink:type="simple"/></inline-formula>; <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x273.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x274.png" xlink:type="simple"/></inline-formula>if<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x273.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x274.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x275.png" xlink:type="simple"/></inline-formula>.</p><p>It means that for<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x276.png" xlink:type="simple"/></inline-formula>:<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x276.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x277.png" xlink:type="simple"/></inline-formula>;</p><p>Let</p><disp-formula id="scirp.84884-formula64"><label>(28)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x278.png"  xlink:type="simple"/></disp-formula><p>to show that<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x279.png" xlink:type="simple"/></inline-formula>; we have to show:</p><disp-formula id="scirp.84884-formula65"><label>(29)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x280.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.84884-formula66"><graphic  xlink:href="//html.scirp.org/file/10-1490610x281.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.84884-formula67"><graphic  xlink:href="//html.scirp.org/file/10-1490610x282.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.84884-formula68"><graphic  xlink:href="//html.scirp.org/file/10-1490610x283.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.84884-formula69"><graphic  xlink:href="//html.scirp.org/file/10-1490610x284.png"  xlink:type="simple"/></disp-formula><p>so let’s substitute each variable by it’s convenient expression in (2.29) we obtain;</p><disp-formula id="scirp.84884-formula70"><label>(30)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x285.png"  xlink:type="simple"/></disp-formula><p>Having<inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x286.png" xlink:type="simple"/></inline-formula>;</p><disp-formula id="scirp.84884-formula71"><graphic  xlink:href="//html.scirp.org/file/10-1490610x287.png"  xlink:type="simple"/></disp-formula><p>simplify by <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x288.png" xlink:type="simple"/></inline-formula> we will get;</p><disp-formula id="scirp.84884-formula72"><label>(31)</label><graphic position="anchor" xlink:href="//html.scirp.org/file/10-1490610x289.png"  xlink:type="simple"/></disp-formula><p>So, the inequality for <inline-formula><inline-graphic xlink:href="//html.scirp.org/file/10-1490610x290.png" xlink:type="simple"/></inline-formula> is proved.</p></sec><sec id="s5_4"><title>5.4. Conclusions</title><p>Managing the cash balance is important in business administration, but rarely do we apply the techniques presented in this study in practice. Much of this neglect is due to the difficulty in developing models closer to reality. Despite its name, optimization does not necessarily mean finding the optimum solution to a problem. Furthermore, the view of the cash balance is still limited and not regarded as an investment, which has a negative profitability defined by total cost of the cash, immediate liquidity, and risk associated with cash deficit. Thus, it is necessary to understand the cash balance together with other financial investments and examines the investment choices in financial products.</p><p>This is a classic problem in business, involving economics, accounting, and finance, and it should return to be the focus of discussions in these areas, as the existing limitations concerning the models and methods can be eliminated. We must discuss the cash balance problem not only about the method involved in optimization but also in practical application. Further studies can be done concerning the elaboration of this topic and discussing the fair investment when there is no loss or gain during investment. Finally, we must discuss the cash balance problem not only about the method involved in optimization but also in practical application.</p></sec></sec><sec id="s6"><title>Cite this paper</title><p>Dib, Y.M., Kmeid, N., Greige, H. and Raffoul, Y.N. (2018) Optimization of Cash Management Fluctuation through Stochastic Processes. Journal of Mathematical Finance, 8, 408-425. https://doi.org/10.4236/jmf.2018.82026</p></sec></body><back><ref-list><title>References</title><ref id="scirp.84884-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Baumol, W.J. (1952) The Transactions Demand for Cash: An Inventory Theoretic Approach. The Quarterly Journal of Economics, 66, 545-556.  
https://doi.org/10.2307/1882104</mixed-citation></ref><ref id="scirp.84884-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Miller, M.H. and Orr, D. (1966) A Model of the Demand for Money by Firms. The Quarterly Journal of Economics, 80, 413-435. https://doi.org/10.2307/1880728</mixed-citation></ref><ref id="scirp.84884-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Tapiero, C.S. and Zuckerman, D. (1980) A Note on the Optimal Control of a Cash Balance Problem. Journal of Banking and Finance, 4, 345-352.  
https://doi.org/10.1016/0378-4266(80)90013-8</mixed-citation></ref><ref id="scirp.84884-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Hinderer, K. and Waldmann, K.H. (2001) Cash Management in a Randomly Varying Environment. European Journal of Operational Research, 130, 468-485.  
https://doi.org/10.1016/S0377-2217(99)00398-7</mixed-citation></ref><ref id="scirp.84884-ref5"><label>5</label><mixed-citation publication-type="book" xlink:type="simple">Guarnieri, P. (Ed.). (2015) Decision Models in Engineering and Management. Springer, Berlin. https://doi.org/10.1007/978-3-319-11949-6</mixed-citation></ref><ref id="scirp.84884-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Yao, J.S., Chen, M.S. and Lu, H.F. (2006) A Fuzzy Stochastic Single-Period Model for Cash Management. European Journal of Operational Research, 170, 72-90.  
https://doi.org/10.1016/j.ejor.2004.06.017</mixed-citation></ref><ref id="scirp.84884-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Volosov, K., Mitra, G., Spagnolo, F. and Lucas, C. (2005) Treasury Management Model with Foreign Exchange Exposure. Computational Optimization and Applications, 32, 179-207. https://doi.org/10.1007/s10589-005-2059-2</mixed-citation></ref><ref id="scirp.84884-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Gormley, F.M. and Meade, N. (2007) The Utility of Cash Flow Forecasts in the Management of Corporate Cash Balances. European Journal of Operational Research, 182, 923-935. https://doi.org/10.1016/j.ejor.2006.07.041</mixed-citation></ref><ref id="scirp.84884-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Melo, M.A.S. and Bilich, F. (2011) Expectancy Balance Model for Cash Flow. Journal of Economics and Finance, 37, 240-252.  
https://doi.org/10.1007/s12197-011-9180-0</mixed-citation></ref><ref id="scirp.84884-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Balasubramanian, J. and Grossmann, I.E. (2004) Approximation to Multistage Stochastic Optimization in Multiperiod Batch Plant Scheduling under Demand Uncertainty. Industrial and Engineering Chemistry Research, 43, 3695-3713.  
https://doi.org/10.1021/ie030308+</mixed-citation></ref><ref id="scirp.84884-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Wu, D. and Ierapetritou, M. (2007) Hierarchical Approach for Production Planning and Scheduling under Uncertainty. Chemical Engineering and Processing, 46, 1129-1140. https://doi.org/10.1016/j.cep.2007.02.021</mixed-citation></ref><ref id="scirp.84884-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">The Gambler’s Ruin Problem. (n.d.). http://www.columbia.edu/</mixed-citation></ref><ref id="scirp.84884-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Pinsky, M. and Karlin, S. (2010) An Introduction to Stochastic Modeling. Academic Press.</mixed-citation></ref><ref id="scirp.84884-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">Allen, L.J. (2010) An Introduction to Stochastic Processes with Applications to Biology. CRC Press.</mixed-citation></ref><ref id="scirp.84884-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Dunbar, S.R. (2016) Mathematical Modeling in Economics and Finance with Probability and Stochastic Processes. http://www.math.unl.edu/</mixed-citation></ref><ref id="scirp.84884-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">Ross, S.M. (1974) Dynamic Programming and Gambling Models. Advances in Applied Probability, 6, 593-606. https://doi.org/10.2307/1426236</mixed-citation></ref><ref id="scirp.84884-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">Ross, S.M. (2014) Introduction to Stochastic Dynamic Programming. Academic Press.</mixed-citation></ref><ref id="scirp.84884-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">Diwekar, U. (2008) Introduction to Applied Optimization (Vol. 22). Springer Science and Business Media. https://doi.org/10.1007/978-0-387-76635-5</mixed-citation></ref><ref id="scirp.84884-ref19"><label>19</label><mixed-citation publication-type="other" xlink:type="simple">Weber (n.d.) Dynamic Programming. http://www.statslab.cam.ac.uk/rrw1/oc/L01</mixed-citation></ref></ref-list></back></article>