Optimal Strategies for COVID-19 Control in a Stochastic Process ()
1. Introduction
A generic analysis suggests that SARS-CoV-2 originated from a bat coronavirus that became infectious to humans after acquiring genes specific to pangolin coronaviruses. Regarding the etiology of the COVID-19 pandemic, this disease is a respiratory infection caused by the SARS-CoV-2 coronavirus, likely originating in China and transmitted by infected bats. COVID-19, whose symptoms resemble those of seasonal flu, is more severe in the elderly and those weakened by certain chronic diseases or lack of treatment. On average, it is asymptomatic in approximately 40% of infected adults. This percentage is an average; it is higher in children and lower in younger adults. The incubation period is the time elapsed between infection and the onset of symptoms (when they appear). The incubation period for COVID-19 is estimated to be 5 days on average. An infected person becomes contagious on the third day of the incubation period. It is estimated that it remains contagious until the seventh day after symptoms disappear. COVID-19 has the particularity of not always causing symptoms. In this case, infected people, unaware of their condition, can secrete the virus and infect other people for a few days. This fact explains the great difficulty in controlling the spread of the COVID-19 pandemic. However, the literature offers mathematical perspectives for the control of COVID-19. Mathematical modeling has proven to be very useful in better understanding the spread and proposing optimal strategies for controlling infectious diseases [1]. In this literature, a deterministic model of COVID-19 was proposed and studied, implementing different controls. It emerged that the best strategy to control the spread of COVID-19 is social distancing and wearing masks and disinfecting the environment.
In stable (human and viral) environments where uncertainties and variability in the dynamic process of human contamination by the virus are absent, deterministic modeling produces acceptable results. However, as soon as uncertainty and variability are present in the dynamic system, deterministic modelling can lead to erroneous results in the long term, as it cannot capture the uncertainties and variability inherent in stochastic dynamics. It is then crucial to be able to quantify, manage, and control contamination risks linked to the unpredictability and complexity of the process or phenomenon. Although deterministic models can be useful in some cases, stochastic models are often preferable for monitoring and controlling complex and uncertain systems, such as managing the risk associated with viral contamination.
In this article, we explore a new stochastic model and we apply the theory of the stochastic optimal control in a model of Coronavirus spread in a human population constituted of the susceptible individuals, the exposed, mildly and severely symptomatic persons and recovered persons. This viral contamination dynamics takes in account, in addition of deterministic evolution, the uncertain diffusion due to noises white demonstrated under form of the movement standard Brownian on a probability filtered space. The optimal strategies of the stochastic process of COVID-19 control are determined by minimizing subject to the stochastic model, the cost functional deriving from the limited development of human infection force
plus the viral spread force
because these forces depend on the state variables of exposed persons, mildly and severely symptomatic infected on the one hand and the surface viral concentration on the other hand. The existence of control functions and the optimal characterizations are established with the help of one basic principles of the stochastic control: Pontryagin’s Minimum Principle (PMP) that we recall below in the mathematical tool section. This principle serve to convert the minimization problem subject to one stochastic differential equation into one simple minimization problem to be solved from its optimality conditions. Our survey is an extension into the stochastic modelling of a deterministic case in [1]. The important results of this extension are in Sections 3, 4 and 5. The continuation of the paper is structured as follows: Mathematical tools for stochastic process in Section 2.
Presentation in Section 3 of a stochastic model of COVID-19.
Analysis of the stochastic model in Section 4.
Stochastic optimal control of COVID-19 spread in Section 5.
Numerical implementation of data and stochastic model 6.
On finishes by a conclusion in final Section.
2. Mathematical Tools for Stochastic Process
In this Section, before expressing the basic principles of the controlled stochastic process, the mathematical tool recall is necessary to illuminate better and to understand the notion landed in this article.
Thus, we first define, the process and function of control, then the controlled stochastic process and the optimal control problem.
2.1. Definition of Process of Control and Function of Control
• Process of control: is a process that influences the behaviour of a stochastic process while modifying at each instant
her dynamics (her evolution and her diffusion) by the action of a function of control denoted
.
• Function of control: is a progressively measurable function defined on
and taking values in
designating the set of functions of control.
2.2. Definition of Controlled Stochastic Process
• Stochastic process: is a random variable family indexed by the set of time
. It is denoted by
. It dynamic can be described by a Stochastic Differential Equation (SDE) of Itô given by:
where,
is a vector function designating evolution function;
is a matrix function designating matrix of diffusion; and
a
-dimensional Brownian motion defined on a space of probability filtered
and taking values in
.
• Controlled stochastic process: Let given for all stochastic process
and for all process of control
, the controlled stochastic process is a random process denoted again by
where it probabilistic behavior can be influenced by an external function of control
input.
The dynamic (SDE) of the stochastic process
influenced by the action of external function of control
input. This influenced dynamic can be described generally by a following Controlled Stochastic Differential Equation (CSDE):
Remark. In particular, when the matrix of diffusion, multiplicative factor of the random noise is not concerned by actions of control
, then we have:
So, if the dynamic of the stochastic process influenced by the action of external function of control doesn’t take in account the random noise, i.e. that the matrix of diffusion is hopeless (
), then this evolutionary process is deterministic and it can be described by a following deterministic Controlled Ordinary differential Equation (CODE):
When the function of control is defined on
and takes values in
by
, then it is about a retroactive control or control feedback.
2.3. Basic Principle of the Controlled Stochastic Process
In the deterministic process case [2] as in the stochastic process case [3]-[5], it exists two basic principles of the optimal control: Dynamic Programming Principle (DPP) and Pontryagin’s Minimum Principle (PMP). While considering the characteristic of the stochastic model that we are going to control, only the PMP is a priority in this article.
The PMP: is a powerful tool in optimal control strategy for a dynamic system (per e.g. CDSE or CODE) that minimizes (or maximizes) a given cost functional. It provides necessary conditions for optimality, transforming the problem into CDSE or CODE) and an optimization problem. The PMP is using here to solve the stochastic optimal control problem formulated with constraint on the state variables as in following Subsection 2.4.
2.4. General Concept of Stochastic Optimal Control Problem
The optimal control problem subject to a controlled EDS is constructed as a minimization problem of the following definite objective function
according to the mathematical expectation i.e. researches a control optimal
, if it exists such that:
Stochastic optimal control problem:
where
is the functional cost, and for all
, we have
Hypotheses: We suppose that:
1)
is a full metric space separable,
2)
and
are the measurable functions, and if there exists a real constant
such that for
,
,
and
we have the following conditions to guarantee the existence of an unique solution of CSDE.
,
Theorem 1. Let
be probability space equipped with a filtration
and a
-dimensional Brownian motion
. Let
the adapted set of control
. Let
the random initial condition tacking values in
wich satisfies
for some
. With the guarantee of existence conditions then, there exists an unique solution
of CSDE. Furthermore, for any
there exists a constant
such that
and for all
,
Proof. [6]
Corollary 1. Let
be a solution of CSDE and
be a function of class
such that for
.
Then for all
, almost surely, we have
where
is an operator defined by
Theorem 2. The cost function for using control process
starting from random initial state
at time
is
where
and
the function assumed to be continuous with at most polynomial growth Then the value function of Bellman (in DPP)
is given by
Using the heuristic arguments in theory of Dynamic Programming Principle (DPP) in [6]-[9], we arrive at the following HJB equation associated with the above optimal control problem:
Therefore, the optimal control
is expressed by
Proof. Let’s begin the minimal cost by intuition on
then on
because the minimal cost on
is achieved when running optimally in
and the continue optimally in
with
as initial random variable. Using this heuristic arguments in order to give a formal derivation of the HJB-equation.
We now start deriving Bellman’s dynamic programming principle (or DPP) which read as follows:
then, for all
, we have
Subtracting
from both sides and diving by
gives
Let
and
are defined as follows
and
Using equation of Corollary 1 for
yields
then
implies that
thus
(*)
If
, then
.
Marking similar calculation as those above, one shows that
(**)
Combining relations (
) and (
), we prove that relation of HJB equation is satisfied and the searched for optimal control
is expressed therefore by:
It mark the end of this proof ☐
The PMP uses the following Hamiltonian associated to CSDE defined by:
and the ad-joint equations (of first order for control of deterministic term or second order for control of deterministic and stochastic term). They are given respectively by:
In the deterministic control case, Pontryagin’s Minimum Principle (PMP) applied to problem of optimal control in CODE which consists to find the function of the Feedback control
that minimizes the cost as follows:
where
We obtain
such that
and
verify the following optimality and transversality conditions:
This boundary value problem may diverge depending on the initial guess. It is the reason for which PDE of order 1 is not sufficient to solve the problem of optimal control in stochastic case. It is necessary to pass to PDE of order 2 gotten by the application of DPP for CSDE therefore.
The field of stochastic control focuses on finding the best control strategy to achieve the desired objective while dealing with the inherent randomness of the system as propagation of COVID-19 in the human population [1]. This involves using mathematical techniques to model the system, analyze the uncertainty, and determine the optimal control actions.
3. Presentation of a Stochastic Model of COVID-19
In this section, we present a stochastic model of COVID-19 formulated from a deterministic model given in [1] while taking in account the random noise of the propagation of COVID-19.
Stochastic Model of COVID-19 Control
A stochastic differential equation describes the random spread of coronavirus (SARS-CoV-2 virus precisely) in the human population subdivided into susceptible individuals
, exposed individuals
, infected individuals with middle symptoms
, and severe symptoms
, and the recovered persons
. The concentration of coronavirus on surfaces is noted by
. The interaction between humans and COVID-19 spread is characterized by parameters of model represented in Figure 1 and described in Table 1.
Table 1. Description of model variable and model parameters.
Random |
Description |
variables |
|
|
Random variable giving Susceptible individuals number |
|
Random variable giving Exposed individuals number |
|
Random variable giving Mildly clinically number |
|
Random variable giving Severely symptomatic number |
|
Random variable giving Recovered individuals number |
|
Random variable giving Concentration of virus on surfaces |
Para. |
Description [1] |
|
Recruitment rate |
|
Probability of infection per contact |
|
Average contacts of infectious individual per time |
|
Rate of loss of immunity after recovery |
|
Rate of recovered individuals from COVID-19 |
|
Rates of progression from
to
and
stage |
|
Rates of progression from
to
stage |
|
Natural death rate in humans |
|
COVID-19-infected death rate in humans |
|
Death rate coronavirus on surfaces |
|
Proportions of exposed persons |
|
Proportions of mildly symptomatic immigrants |
|
Coefficients of infectivity of exposed individuals |
|
Coefficients of infectivity of severely symptomatic individuals |
|
Coefficients of viral shedding of severely symptomatic persons |
|
Efficacy of quarantine to prevent transmission |
|
Surface to human transmission probability |
|
Rate of disinfection of the environment |
|
Viral shedding rate of infected individuals |
|
Coronavirus concentration on surfaces |
![]()
Figure 1. Diagram of stochastic model of COVID-19.
Considering that
is a random variables vector during a time variation
, we have from the deterministic model, the distribution of probabilities denoted
of state changes
for
summarized in Table 2. then from the mean and the variance of
, we can formulate the stochastic model while using Poison’s law and same formulation technique in literature [10] [11].
Table 2. Distribution of probability state change.
State change (
) |
Probability
|
State change (
) |
Probability
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Otherwise |
|
wherein
.
The stochastic model of CoVID-19 is represented by a following diagram (Figure 1) and by a stochastic differential Equation (1) written under the compact form.
(1)
where
is a 6-dimensional random vector of state variables,
, it differential expression,
, for
is a 18-dimensional Brownian motion process and is defined on a space
,
is a vector of controls,
and
are the deterministic function and the random matrix respectively defined by:
, wherein
with
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
.
Human infection force
and viral spread force
expressed by:
where
, and are modification factors accounting for reduced infection of exposed persons and those with severe symptoms;
is the half-saturation constant of the corona-virus from corona-virus-infected surfaces. Parameter
is efficacy of quarantine to prevent transmission.
The parameters
and
are, respectively, the transmission probability and the average number of contacts of the infected per day. The parameter
is taken to be physical distancing control, such that
and
are respectively the perfect observation of preventive protocols and the no-compliance cols. Finally, the parameter
is a control measure accounting for avoidance of touching of infected surfaces and / or washing of hands.
The random variables and the parameters of model are further summarized in Table 1.
Remark. When the random noise is not taken in account in the propagation of COVID-19, i.e. that
with
, then stochastic model (1) formulated amounts to the deterministic model constructs in [1]. This deterministic model is presented briefly by Equation (2) in the following subsection.
4. Analysis of the Stochastic Model of COVID-19
Herein, we present firstly some important and exploratory results about deterministic ordinary differential model (2) in [1].
4.1. Analysis of Deterministic Model
4.1.1. Positivity and Boundedness of Deterministic Model
This deterministic model of CoVID-19 is represented by a mathematical model under the compact form:
(2)
where
is a deterministic function defined previously in (1) with
.
As given in [1], a population of the time-dependant size of
that is subdided into susceptibles,
, asymptomatically infected,
, clinically infected (those with mild symptoms
and those with severe symptoms
), and recovered,
, so that
, and the concentration of coronavirus on surfaces noted by
, a deterministic model to describe the spread of coronavirus in such a population is constructed and analysed mathematically; also the main results has been gotten. The population is increased due to immigrants at rate Λ with proportions
,
being asymptomatic and infected with mild symptoms, respectively, and the remainder being susceptible. Susceptible individuals get infected due to effective contact with infectious
,
and
at rate
. The infected persons may deposit the virus on surfaces which can stay for up to 72 hours [12] and may be picked up by susceptibles at rate
.
Lemma 3. Given the set
all solutions of (2) starting in Ω remain in Ω for all
. Also, the region is a positively invariant set for the deterministic model (2).
Proof. (See [1])
The author shows of it clearly that for
,
,
,
,
and
, and thus, all solutions with nonnegative initial conditions are nonnegative.
Further, adding the first five subequations of (2)
Thus,
.
Therefore, if
, then
. The last Equation of (2) implies that
So, if
, then
.
Thus, all solutions starting within Ω remain inside Ω. This marks the end of the proof of the Lemma. ☐
4.1.2. Equilibra and Basic Reproduction Number
Lemma 4. (See in [1])
In the absence of immigration of infective individuals, the deterministic COVID-19 model does not have a disease free equilibrium. However, where there are no infective immigrants, the disease free equilibrium is given by
. Using the Next Generation Method [13], in the absence of infective immigrants, the Basic Reproduction Number is defined by:
(3)
where
(4)
Theorem 5. ([1] [13])
In the absence of immigration of infective individuals, the deterministic COVID-19 model has a disease free equilibrium
which is locally asymptotically stable whenever
and unstable whenever
.
In the presence of infective individuals, the deterministic model (2) possesses an endemic equilibrium
, such that:
(5)
where
are the auxiliary parameters defined by:
and
is the human infection force plus Viral spread force in equilibria, characteristic parameter of the endemic equilibrium satisfying a polynomial equation of third degree in [1].
4.1.3. Sensitivity Analysis of Deterministic Model
To estimate parameters of Incidence Force
, Basic Reproduction Number
and endemic equilibrium
as example, the survey of sensitivity of these parameters is very important to determine the conditions necessary of parameter evaluation. The evaluation separated of parameters is possible when the sensitivity of
,
and
don’t have a strong interrelationship with respect to each their parameters. e.g. for
, we have
then, the report of sensitivities of
reduced to parameters
,
,
,
,
and
gives
In the first case where the report of two parameter sensitivities (
and
) is constant the evaluation of these two parameters is impossible, their values are
chosen in [14] and [15]; but in the other cases the evaluation is possible.
is simulated by curve fitting under MATLAB Software is represented by Figure 2 knowing some initial values. Furthermore to the estimations values of parameters
and
are given in Table 3. For to estimate parameters of
, we use the derivative of the following formula with respect to parameters vector
(a) Curve fitting of model
(b) Real data of COVID-19 in Chad 2020-03-15 to 2021-10-02
(c) Model and residuals
Figure 2. Curve fitting
of model; Extract from real data of Chad [19] and Model simulation.
Table 3. Description of model variable and model parameters.
Para. |
values |
References |
Para. |
values |
References |
|
150 |
Assumed |
|
0.5 |
Assumed |
|
8.073 × 10−3 |
[14] |
|
3.33 × 10−1 |
[1] |
|
1/10 |
[14] |
|
0.001 |
Estimated |
|
0.015 |
[14] |
|
0.10 |
[1] |
|
0.5297 |
[15] |
|
0.01 |
[1] |
|
1/5.2 |
[16] |
|
1.5 |
Estimated |
|
1/5.8 |
[16] |
|
0.10 |
Estimated |
|
0.0186 |
[1] |
|
0.001 |
[1] |
|
0.0357 |
[1] |
|
0.5 |
[1] |
|
0.001 |
[1] |
|
0.5 |
Estimated |
|
100 cells/day |
[1] |
|
103 cells/m2 |
[1] |
wherein
is the vector parameters of model (2) at which the sensitivity are evaluated. The same technique used high here then sensitivities the evaluation of parameters of
and
can be achieved.
Then there were some important results about the sensitivity of Basic Reproduction Number
and endemic equilibrium
for the deterministic model parameters is discussed and given in [1]. It is important to remember here that, the study of sensitivity of the parameters of a deterministic model is necessary. It consists of analyzing how the variations of the parameters influence
and consequently
. Indeed, this sensitivity analysis made it possible to identify the parameters such that
,
,
,
,
,
,
, and
whose value variations in growth have the greatest impact on the increase of
(consequently increases
,
, and
); and the parameters such that
,
,
,
,
and
whose value variations in decrease have the greatest impact on the decrease of
(consequently decreases
,
, and
). The acceptable values of a model parameters were identified and estimated in Table 3 wherein values are chosen in [1] [14]-[16], given
.
4.2. Analysis of Stochastic Model
4.2.1. Positivity and Boundedness of Stochastic Model
Let we denote the following set:
where
.
Lemma 6. Let
a filtered probability space. For any positive initial condition
, the stochastic model (1) admits an unique solution
dependent of
. Moreover, for all
; this solution
remains in
with probability 1, i.e.
.
Proof. For any positive initial condition
, For any positive initial condition
, since
and
are locally continuous Lipschitz, then there exists an unique local solution
, for all
, where
is the explosion time. This local solution is non negative by Itô’s Formula.
Let
, the random variable giving the total number of humans population and corona-virus on surface to date
. Then we have:
(6)
what implies that if
, for all
almost surely (a.s.), then
So, if
, then
for
a.s.
From where
While using Gronwall’s lemma, we obtain
As initial condition
, i.e. that
, then
. So, for all
, we have
Now, let’s show that
for all
is global solution, i.e. that
a.s. Let’s choose an integer
sufficiently large for that
, and two others integers:
Let
be the empty set such that set
. For each integer
, the stop-times is defined by
Note that
is increasing as
, if
, then we have
a.s.
It remains to show that
a.s. Suppose by absurd that
a.s., there exists a constant
and for any
such that
(7)
Consequently, there exists an integer
such that
Let’s define a Lyapunov function
by:
Using the Itô’s Formula, we compute
where
Using
,
,
for all
, and
almost surely, then
from where, we find that for
almost surely
(8)
where
Integrating inequality (8), then taking the mathematical expectation
in (8), we obtain that
Because
, we have:
Finally, we have all
:
Let
is the characteristic function of
with
her complementary. From (7), we have
.
Denote
. Since
, then
Thus
. It then follows that
Note that, for each
there is at least one of the components
of
equal either
or
, therefore
, hence
(9)
Passing to limit in (9) as
, we have that
is a contradiction. Thus
almost surely. Therefore, this end the proof lemma. ☐
4.2.2. Global Behavior of Coronavirus Propagation Model
In this subsection, we analyse the global behavior, the stability of the endemic equilibrium for the stochastic model of COVID-19 (1). But before, we look at the behavior of a deterministic mean system of model (1)
Lemma 7. Let denoted
such that
,
,
,
,
and
. Then the determistic mean system (10) of model (1) gotten admits one disease-free equilibrium
which is globally asymptotically attractive if
and
.
Proof. Let denoted
such that
,
,
,
,
and
. Then the deterministic mean system of model (1) is given by:
(10)
wherein
is the mean infectious for humans and coronaviris.
So, if
, then from Equation (6), we compute mathematical expectation and we obtain for
,
that:
by Gronwall’s lemma, one obtain
Therefore, there exists a non negative real number
and a time
such that
Thus, for all
, the mean infectious force
verifies the following inequality
(11)
with
as
.
Let denoted here
is a matrix satisfying the following linearzed system around
:
where
is linear operator such that
where
What remains is find the global stability of
and the basic reproduction number of mean system (10).
Let us choose
such that for all variable state of the mean system denoted
, we have
In the Stochastic model (1), since (11) is satisfied for or all
, we have
In [1], it is shown that the basic reproduction number
for the deterministic model (2), is given while using the Next-Generation matrix
in [13]. It’s the spectral radius of a linear operator
.
The comparison with the following auxiliary system
(12)
Then, us find that his system (12) has basic reproduction ratio
. A globale solution of system (12) is given by
If
, then
.
There exists
such that for all
,
. Thus, there exists a positive solution bounded of system (12) and expressed by
Consequently, because
, we have
according the comparison theorem in [17]. Moreover we have
Hence
, as
. Thus,
is globally asymptotically attractive if
and
. ☐
Theorem 8. The random disease-free equilibrium for the stochastic model (1) is globally asymptomatically stable and exponentially p-stable.
Proof. Let’s define a Lyapunov
, with
is an integer and
are non negative constants for all
.
That is for
,
,
,
,
,
,
Considering an infinitesimal generating operator
defined by
Using the inequalities of lemma 7 in [10] as follows:
Let an integer
,
, and
chosen sufficiently small, we have
and Young’s inequalities for
We get finally
wherein all coefficients of
are non negative. Therefore, the random disease-free equilibrium for the stochastic model (1) is exponentially p-stable because there exists a function
satisfying the following conditions for
ans
:
When
, it’s exponentially stable in mean square and is globally asymptotically stable. ☐
Theorem 9. The endemic equilibrium, for the stochastic model (1)
, is locally asymptotically stable if
.
Proof. Let suppose a stochastic perturbation of while noise type, directly proportional to distance
. and influence model (1) expresses by the following stochastic equation:
(13)
where
, and
Let be centred this dynamic at its endemic equilibria
by change of random variables as:
,
. Thus, we obtain an equivalent model because of the same law of probability of the random variables
and
(14)
where
and
are determined by Itô formula as in [10] [11] [18].
It is easy to show that the equilibria
of model (14) is locally asymptotically stable, so that
is locally asymptotically stable stable if
. Let define a Lyapunov function
given for
an integer by:
Using the differential operator
associated with model 1 for
and by the Itô formula, we compute and obtain
where
an know function and
So that with
a non negative constant, we have
what implies clearly
with
the stopping time defined for each integer
by
and
be sufficiently large such that
lying within the interval
. When
then
yields:
According that
and using the fact that equilibria
is p-stable, then
is p-stable also. ☐
5. Stochastic Optimal Control of COVID-19 Spread
5.1. Optimal Control of Model without Random Noise
In this Subsection, the deterministic model is submitted into an optimal control problem by seeking to minimize an objective functional that measures total infected individuals and surface viral concentration, and the total cost associated with implementing the various controls.
To determine the best strategy adapted to the struggle against COVID-19 spread. The theory of the optimal control is used by formulating the optimization problem which minimize the objective functional as follows for
:
(15)
wherein
is a variable of state and
is the functional cost:
(16)
the coefficients
(respectively
),
are balancing factors accounting for the differences in the importance of the state variables (respectively the various controls) objective functional measures the total infections and total costs associated with the controls and without a random noise in model.
The Pontryagin’s Maximum Principle produces, using the minimization problem of the Hamiltonian, the necessary optimality conditions for the quadruple optimal controls solutions of the optimization problem (15).
Theorem 10. Let
be the solution associated with the quadruple optimal controls
, solution of (15). Then,
1) The Hamiltonian
is given by
(17)
where, the
are the ad-joint variables associated with the state variables
such that
(18)
2) The following transversality conditions hold
(19)
3) The admissible controls
is given by
(20)
where
is found in [1]
These results gotten in [1] for the deterministic optimal control that we have just recalled are necessary for the analysis of the stochastic model (1).
5.2. Optimal Control of Model with Random Noise
The optimal strategies of the stochastic control model of COVID are gotten on the one hand here in this section, as minimizing under the stochastic dynamics controlled of the COVID-19 forces it of people infection in human population because this strength depends in majority by variables of people state exposed and tainted having some middle and stern symptoms, of the concentration of the coronavirus in surface and in minimising on the other hand, the total number of expositions and tainted as well as the concentration in surfaces of the coronavirus under the same stochastic dynamics.
5.2.1. Cost Function Resulting Some Development Limited
As minimizing subject to the stochastic dynamics controlled of the COVID-19, the mathematical expectation of infectious force
of human population because this force depends in majority by the state variables vector
and the control vector
.
To minimisze the total force of infection
over the finite time horizon
, dependent on random states, amounts to bringing it absolutely back to the controlled state disease free, i.e. by making
when
tends towards
by
for all
. As the minimization with respect to control
of the cost functional
depends on this random force
, then for the optimum to exist, the mathematical expectation of the cost to be minimized depends on a convex function. This is why,
we add a quadratic combinaison of controls
, i.e.
and we obtain a cost functional qualified as a pseudo-quadratic given by (21).
Considering the pseudo-quadratic cost functional of the following form for each integer
:
(21)
wherein
is a non constant functional term resulting some development limited of infectious force
around
at order
,
is it absolute value and
it constant term representing the total force of human infection and viral spread at disease-free equilibrium
, i.e.
without control. The choice of
follows from relation (16) giving the cost functional which measures the total number of exposed people, mildly and severely symptomatic people and surface concentration of virus; linear relation in which the constants
independent of the controls represent the important weights of the state variables of deterministic model. In the case of the stochastic model whose variables are random, these coefficients can vary depending on the control, this is the case here. Therefore, the choice
is explained by this linear relation similar to that of cost functional which measures total infected individuals and surface viral concentration, and the total cost associated with implementing the various controls.
Development limited of
around
at order
:
then, we find
and
Let
the terminal time is equal to final date of the epidemic by
Let
and
are respectively the functions of instantaneous cost and terminal cost such that:
Thus, the cost functional is given by
(22)
5.2.2. Controlled Evolution Process of COVID-19
• Problem: Control of evolution by minimizing the cost functional
Here, the controlled process
of COVID-19 evolves like a diffusion non-controlled, but the "controller" can influence the behavior of
by modifying its evolution vector
or diffusion matrix
at each time t through choice of the value
.
Thus, one of the main objectives in this part is to find the optimality controlling variables
using cost functional (22) such that
(23)
where
i.e
wherein
such that
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
.
In applying the Pontryagin’s Minimum Principle (PMP) for the stochastic model [7], we give definition of Hamiltonian
corresponding to optimal problem 23 as follows:
where
, for
are the diagonal components of
defined by:
with
and
are the adjoints process such that
from where
(24)
Theorem 11. Let
the optimal control,
an optimal way of
solution of EDS in (23) and
solution of Equation (24). Then under the above hypotheses, for
the optimal control
verify the following optimality controlling:
(25)
Proof. See in Book [6]-[8]. ☐
Corollary 2. Let’s suppose that hypotheses of Theorem 11 are true. Then, for
the optimal control
ts characterised by
what implies
By application of Theorem 11 and Corollary 2 to the stochastic model of COVID-19, i.e. that on derivative of Hamiltonian formula [8] [9] with respect to
and we obtain
such that:
where
(26)
We note this result depends
and
only but doesn’t depend
because
i.e.
.
Although the objective aimed very well to control the evolution and the diffusion of the propagation of the COVID-19 at a time, the control of the evolution has just been done while waiting for the control of the evolution and the diffusion of the same in next publications.
6. Numerical Implementation of Data and Stochastic Model Controlled
6.1. Curve Fitting for the Estimation Values of Parameters
The new model 1 that goes simulated is similar to the stochastic in [10] and [11]. In Table 3, we have two values assumed of parameters of our models, Λ and
. These assumed values determine from the mean model 10 depending on the mathematical expectation. For
e.g., from 4th equation of the mean model, we used the mathematical expectaion of state variables
,
,
known in two instants
(initial time) and
(intermediate time) and the parameters
. The other parameters being already estimated and chosen of data in the literature as
, then parameter unknown
is calculated therefore.
From real data of the COVID-19 pandemic in 4 localities in Chad, data 1, 2, 3 and 4 given from 2020-01-03 to 2021-01-10 (see [19]), we extracted that of data 2 from 2020-03-15 to 2020-10-02 (see Figure 2) for to validate our model.
With a particular case of sensitivity and parameters value evaluated, we constructed a curve fitting in Figure 2. Extension of this case permitted us to identify (assumed) and to estimate the values of certain parameters on the Table 3.
6.2. Numerical Simulation of Stochastic Model of COVID-19 Control
To observe what would happen with the numerical simulations of states
,
,
,
,
and
of our model, a certain number of scenarios in relation with the government’s decision is predefined in order to eradicate COVID-19.
Scenario No. 1: Simulation of model 1 with implementation the various controls.
With 0%, 25%, 50%, 95% and 100% implementation of the controls constant
the simulation of stochastic model 1 is performed in Figure 3 revealing that human infection force decreases when values of four controls are constantly increasing. Consequently
,
,
,
, and
have the tendency to disappear (become hopeless) when theses controls constantly offer toward 100%. Therefore an effective implementation of all controls at 100% by the government, COVID-19 can be eradicated.
Scenario No. 2: Effective implementation of controls
, but with infective immigrants.
With infective immigrants, i.e. that the proportions of exposed immigrants and mildly symptomatic are not controlled are such that
and
. Figure 4 compares the simulation at 100% implementation of controls with and without infective immigrants:
and
on the hand and
and
on the other hand, then the simulations of states
,
,
,
,
and
are performed in Figure 4. It is shown that disease persists in the population during the period of simulation when infective immigrants are allowed into the country, even when
and
implementation of controls. This persistence is reduced distinctly to the neighborhood of zero, even stable when the infective immigrants are not allowed in the country.
(a) 0% controls
(b) 25% controls
(c) 50% controls
(d) 95% controls
(e) 100% controls
Figure 3. Numerical simulation of model 1 for
.
(a)
controls
(b)
controls
(c) 100% controls
(d) 100% controls
(e) 100% controls
(f)
controls
Figure 4. Numerical simulation of model 1 with and without infective immigrants for 100% controls.
Scenario No. 3: No-control with immigration temporary or extended border restriction.
This scenario is illustrated by two scripts as follows:
• 0% implementation of all control with immigration permanent border restriction during the period of simulation for all
;
• Before a short stopping time
, immigration temporary border restiction was allowed. i.e. that a proportion of exposed immigrants
and another proportion of those mildly symptomatic
verifying
(27)
where
and
are non negatives values;
is the characteristic function in
.
With
(resp
) and
(resp
) the simulations of states
,
,
,
,
and
are performed in Figure 5 to compare these two scripts avec
. It is observed from Figure 5 that after a short stopping time
, each state of model 1 oscillate around the uncertain equilibria that is locally steady asymptotically stable.
When one changes 0% in the first script appropriate by 100% implementation of controls, then the simulations of states
,
,
,
,
and
are performed in Figure 6 showing that after a short stopping time
, COVID-19 is eradicated with
.
(a) 50% controls
(b) 50% controls
(c) 50% controls
(d) 50% controls
(e) 50% controls
(f) 50% controls
Figure 5. States
,
,
,
,
and
simulated at
. implementation of controls with extended and temporary border closure for viral shedding rate of infected persons
cells/day.
(a) 100% controls
(b) 100% controls
(c) 100% controls
(d) 100% controls
(e) 100% controls
(f) 100% controls
Figure 6. States
,
,
,
,
and
simulated at
implementation of controls with extended and temporary border closure for viral shedding rate of infected persons
cells/day.
Scenario No. 4: 100%-control with immigration temporary or extended border restriction.
• 100% implementation of all control with immigration permanent border restriction during the period of simulation for all
;
• After a short stopping time
, unrestricted immigration was allowed.
After a short stopping time
, immigration no-restraining was allowed. i.e. that a proportion of exposed immigrants
and another proportion of those mildly symptomatic
verifying
(28)
where
and
are non negatives values;
is the characteristic function in interval
.
With 100% implementation of controls and with the decreasing values of the proportions
(
and
per e.g.), we obtain Figure 7. It shows that when
and
converge toward zero, then the different states of the model 1 oscillate around random disease-free equilibria. Therefore with 100% implementation of controls plus a strict restriction for exposed immigrants and those mildly symptomatic infected, then COVID-19 can be eradicate (e.g. see Figure 7 in a period
).
Scenario No. 5: Simulation of controlled model with combination of the four controls
Simulations of
,
,
,
,
and
are performed with controls combination
,
,
, and
at two values
in Table 4 and Table 5 for each
in Figure 8. It is observed that with these Strategies of control combination in
are unprofitable in certain cases because of the environment that remained contaminated strongly by coronavirus with a growth important of the viral concentration
(see the Strategies 3, 4, 7, 8, 11, 12 and 15 in Table 5 represented by Figure 8).
(a) 100% controls with temporary and permanent immigration
(b) 100% controls controls with temporary and permanent immigration
(c) 100% controls with temporary and permanent immigration
(d) 100% controls controls with temporary and permanent immigration
(e) 100% controls with temporary and permanent immigration
(f) 100% controls controls with temporary and permanent immigration
Figure 7. States
,
,
,
,
and
are simulated at
implementation of controls with permanent border restriction on
/ solid curve (−∙−∙):
and temporary border restriction before a time
days/dash-dash curve (−−−):
;
and dash-dot (~):
;
.
Table 4. Numerical results (Figure 8) of optimal strategies:
,
.
Strategy |
Control combination |
|
|
|
|
|
1 |
|
3.0038 |
1.8453 |
3.0604 |
46.3145 |
103,100,000 |
2 |
|
2.8367 |
1.9724 |
2.5193 |
50.8881 |
13,100,000 |
5 |
|
3.4390 |
2.3352 |
3.1835 |
72.6912 |
102,800,000 |
6 |
|
3.3159 |
1.9459 |
3.4645 |
53.4757 |
12,800,000 |
9 |
|
3.3188 |
2.2539 |
2.7147 |
51.9319 |
93,100,000 |
10 |
|
2.8744 |
2.2348 |
3.4293 |
64.3991 |
3,100,000 |
13 |
|
3.7935 |
3.1679 |
3.7962 |
60.9383 |
92,800,000 |
14 |
|
3.4447 |
2.7469 |
3.6237 |
57.0152 |
2,800,000 |
Table 5. Numerical results (Figure 8) of unprofitable strategies:
,
.
Strategy |
Control combination |
|
|
|
|
|
3 |
|
3.7212 |
1.9645 |
3.0746 |
89,416 |
100,300,000 |
4 |
|
3.5647 |
2.0380 |
3.2427 |
91,561 |
10,300,000 |
7 |
|
8.6163 |
4.7340 |
9.5011 |
427,330 |
10,040,000 |
8 |
|
7.7826 |
5.2573 |
9.7446 |
431,480 |
10,043,000 |
11 |
|
3.9965 |
2.0731 |
2.4844 |
98,057 |
90,300,000 |
12 |
|
3.8869 |
2.3990 |
2.9101 |
90,493 |
300,000 |
15 |
|
8.2471 |
6.0573 |
9.7234 |
4.25710 |
90,043,000 |
(a) Strategy 1
(b) Strategy 2
(c) Strategy 3
(d) Strategy 5
(e) Strategy 6
(f) Strategy 4
(g) Strategy 7
(h) Strategy 8
(i) Strategy 11
(j) Strategy 10
(k) Strategy 9
(l) Strategy 12
(m) Strategy 13
(n) Strategy 14
(o) Strategy 15
Figure 8. States
,
,
,
,
and
are simulated with controls combination
,
,
, and
at two values
in Table 4 and Table 5 for each
.
As for the eight strategies summarized in Table 4, it is about the Optimal Strategies 1, 2, 5, 6, 9, 10, 13 and 14 of which simulations in Figure 8 are profitable while minimizing the cost bound to the human infection force and the viral spread force at a time. Among these profitable strategies for COVID-19 control with controls combination taking values extreme 0 or 1, only one strategy is optimal for the minimal mathematical expectation of state
,
,
, and
(see Figure 9. This optimal strategy is represented at 14th strategy, with the optimal cost
, consistent of 10th then 6th strategy).
The last point of this scenario that remains to be explored is the case of the control combination with controls taking intermediate values of the optimal control
linked to the values
given by Equation (26) such that
, i.e. .
Figure 9. Simulation (Interpolation and fitting) of
,
,
,
— Histogram, Interpolation and fitting of cost per strategies in Table 4.
Considering the intermediate value multiplicity combined that can take controls
such that
, a numeric script in MATLAB is written to simulate the behavior of these intermediate values so the functional associated cost. For each intermediate value taking by the controls, Figure 10 simulates these optimal controls so the cost. The optimal values are given in Figure 10 by Software MATLAB. Then, the optimal value of cost is
situated between 10th and 12th day of beginning of disease for this scenario with controls combination taking intermediate values between 0 and 1, i.e.
.
Figure 10. Simulation of cost
with the intermediate values of controls
per day.
The optimal strategy first recommended for theses scenarios consists in applying control
and
, then to make efficient controls
and
with a permanent restriction of border closing preventing the entry of exposed immigrants and those mildly symptomatic. Results given in Figure 11 are favourable to the minimization of the cost and compliant those given by Figure 10.
The optimal values are given in Figure 10 by Software MATLAB e.g.
by 14th strategy.
Figure 11. Simulation of
,
,
,
,
and
with 100% implementation of controls and with a permanent restriction of border closing after 21 th days.
7. Conclusions and Perspectives
A new stochastic model of COVID-19 with two terms is formulated and presented. The mathematical analysis of this model permitted to get some important results focused on the positivity and boundedness of the solutions, the global behavior of the intermediate system, under the sole condition of stability of the disease-free equilibria. These results reveal that disease-free equilibria and the endemic equilibria of model are exponentially p-stable and globally asymptotically stable; finally, that the endemic equilibria are locally asymptotically stable.
In this dynamics of coronavirus propagation described by this new model, the first term determines its evolution and the second, which is a matrix, expresses its diffusion within a susceptible population and exposed vulnerable people. The force of human infection, accentuated by that of viral propagation, dangerously affects the population. Minimizing the cost of these forces due to the coronavirus becomes a necessity, even an obligation, in government action. Thus, in order to eradicate this pandemic, an optimal control problem is formulated by minimizing the cost evaluated in the form of a mathematical expectation of the integral over a finite time horizon of the approximate value of the total forces due to COVID-19. Pontryagin’s Minimum Principle is used to solve this minimization problem and characterize the optimal control as well as the mathematical expectation of the states of exposed, moderately and severely symptomatic people. However, control without optimal strategies seems ineffective, which is why a class of 5 scenarios is proposed and explored in order to determine the optimal control strategies. This results in eight favorable strategies, including an optimal and least costly one, strategy 14, which requires compliance with and application of hygiene, health and treatment measures as priority, then the other strategies 10, 2 and 6 which, in turn, also require compliance with and application of barrier measures and physical and social distancing such as strict compliance with border closure restrictions with quarantine, not shaking hands; disinfection measures and preventive protocols such as hand washing, wearing helmets. In addition to these optimal strategies, strategy 1, which is similar to the first scenario, is certainly advantageous because it requires 100% compliance and application of all controls, but it is very costly. In the absence of significant means of combating the coronavirus, we encourage the government to pursue the policy of implementing these optimal strategies, which are effective ways to eradicate the coronavirus at a lower cost.
Finally, it was proved that this class of 5 scenarios, provided optimal strategies for the control of COVID-19 in a process that is not only deterministic (not regarding diffusion), but also exists in a stochastic process focused on both evolution and diffusion.
The aspect of diffusion control in this process is part of the future prospects with another control article on this same model.
Acknowledgements
Sincere thanks to the anonymous referee, and special thanks to the members of journal Applied Mathematics for their professional performance and to managing editor for a rare attitude of high quality.