<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">WJET</journal-id><journal-title-group><journal-title>World Journal of Engineering and Technology</journal-title></journal-title-group><issn pub-type="epub">2331-4222</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/wjet.2016.43D028</article-id><article-id pub-id-type="publisher-id">WJET-72368</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Chemistry&amp;Materials Science</subject><subject> Engineering</subject></subj-group></article-categories><title-group><article-title>
 
 
  Dynamic Programming to Identification Problems
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Nina</surname><given-names>N. Subbotina</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Evgeniy</surname><given-names>A. Krupennikov</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib></contrib-group><aff id="aff2"><addr-line>Ural Federal University, Ekaterinburg, Russia</addr-line></aff><aff id="aff1"><addr-line>Krasovskii Institute of Mathematics and Mechanics, Ekaterinburg, Russia</addr-line></aff><pub-date pub-type="epub"><day>20</day><month>10</month><year>2016</year></pub-date><volume>04</volume><issue>03</issue><fpage>228</fpage><lpage>234</lpage><history><date date-type="received"><day>June</day>	<month>11,</month>	<year>2016</year></date><date date-type="rev-recd"><day>Accepted:</day>	<month>October</month>	<year>22,</year>	</date><date date-type="accepted"><day>October</day>	<month>29,</month>	<year>2016</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
   
   An identification problem is considered as inaccurate measurements of dynamics on a time interval are given. The model has the form of ordinary differential equations which are linear with respect to unknown parameters. A new approach is presented to solve the identification problem in the framework of the optimal control theory. A numerical algorithm based on the dynamic programming method is suggested to identify the unknown parameters. Results of simulations are exposed. 
  
 
</p></abstract><kwd-group><kwd>Nonlinear System</kwd><kwd> Optimal Control</kwd><kwd> Identification</kwd><kwd> Discrepancy</kwd><kwd>  Dynamic Programming</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>Mathematical models described by ordinary differential equations are considered. The equations are linear with respect to unknown constant parameters. Inaccurate measurements of the basic trajectory of the model are given with known restrictions on admissible small errors.</p><p>The history of study of identification problems is rich and wide. See, for example, [<xref ref-type="bibr" rid="scirp.72368-ref1">1</xref>] [<xref ref-type="bibr" rid="scirp.72368-ref2">2</xref>]. Nevertheless, the problems stay to be actual.</p><p>In the paper a new approach is suggested to solve them. The identification problems are reduced to auxiliary optimal control problems where unknown parameters take the place of controls. The integral discrepancy cost functionals with a small regularization parameter are implemented. It is obtained that applications of dynamic programming to the optimal control problems provide approximations of the solution of the identification problem.</p><p>See [<xref ref-type="bibr" rid="scirp.72368-ref3">3</xref>] [<xref ref-type="bibr" rid="scirp.72368-ref4">4</xref>] to compare different close approaches to the considered problems.</p></sec><sec id="s2"><title>2. Statement</title><p>We consider a mathematical model of the form</p><disp-formula id="scirp.72368-formula80"><label>(1)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/72368x2.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x3.png" xlink:type="simple"/></inline-formula> is the state vector, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x4.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x5.png" xlink:type="simple"/></inline-formula>is the vector of unknown para- meters satisfying the restrictions</p><disp-formula id="scirp.72368-formula81"><label>(2)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/72368x6.png"  xlink:type="simple"/></disp-formula><p>Let the symbol <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x7.png" xlink:type="simple"/></inline-formula> denote the Euclidean norm of the vector<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x8.png" xlink:type="simple"/></inline-formula>.</p><p>It is assumed that a measurement <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x9.png" xlink:type="simple"/></inline-formula> of a realized (basic) solution <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x10.png" xlink:type="simple"/></inline-formula> of Equation (1) is known, and</p><disp-formula id="scirp.72368-formula82"><label>(3)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/72368x11.png"  xlink:type="simple"/></disp-formula><p>We consider the problem assuming that the elements <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x12.png" xlink:type="simple"/></inline-formula> of the <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x13.png" xlink:type="simple"/></inline-formula> matrix <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x14.png" xlink:type="simple"/></inline-formula> are twice continuously differentiable functions in<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x15.png" xlink:type="simple"/></inline-formula>. The coordinates <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x16.png" xlink:type="simple"/></inline-formula> of the measurement <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x17.png" xlink:type="simple"/></inline-formula> are twice continuously differentiable functions in<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x18.png" xlink:type="simple"/></inline-formula>, too. The coordinates <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x19.png" xlink:type="simple"/></inline-formula> of the vector- function <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x19.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x20.png" xlink:type="simple"/></inline-formula> are continuous functions on the interval<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x19.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x20.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x21.png" xlink:type="simple"/></inline-formula>.</p><p>We assume also that the following conditions are satisfied</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x22.png" xlink:type="simple"/></inline-formula>There exists such constants <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x22.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x23.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x22.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x23.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x24.png" xlink:type="simple"/></inline-formula> that for all <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x22.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x23.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x24.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x25.png" xlink:type="simple"/></inline-formula> the inequalities</p><disp-formula id="scirp.72368-formula83"><label>(4)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/72368x26.png"  xlink:type="simple"/></disp-formula><p>are true.</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x27.png" xlink:type="simple"/></inline-formula>There exist such constant <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x27.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x28.png" xlink:type="simple"/></inline-formula> (<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x27.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x28.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x29.png" xlink:type="simple"/></inline-formula>from<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x27.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x28.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x29.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x30.png" xlink:type="simple"/></inline-formula>) and such compact set <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x27.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x28.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x29.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x30.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x31.png" xlink:type="simple"/></inline-formula> that for any <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x27.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x28.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x29.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x30.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x31.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x32.png" xlink:type="simple"/></inline-formula> the following conditions are held</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x33.png" xlink:type="simple"/></inline-formula>;</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x34.png" xlink:type="simple"/></inline-formula>.</p><p>Here<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x35.png" xlink:type="simple"/></inline-formula>.</p><p>The identification problem is to create parameters <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x36.png" xlink:type="simple"/></inline-formula> such, that</p><disp-formula id="scirp.72368-formula84"><label>(5)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/72368x37.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x38.png" xlink:type="simple"/></inline-formula> is the solution of Equation (1), as <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x38.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x39.png" xlink:type="simple"/></inline-formula></p></sec><sec id="s3"><title>3. Solution</title><sec id="s3_1"><title>3.1. An Auxiliary Optimal Control Problem</title><p>Let us introduce the following auxiliarly optimal control problem for the system</p><disp-formula id="scirp.72368-formula85"><label>(6)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/72368x40.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x41.png" xlink:type="simple"/></inline-formula> is a control papameter satisfying the restrictions</p><disp-formula id="scirp.72368-formula86"><label>(7)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/72368x42.png"  xlink:type="simple"/></disp-formula><p>for a large constant<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x43.png" xlink:type="simple"/></inline-formula>.</p><p>Admissible controls are all measurable functions<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x44.png" xlink:type="simple"/></inline-formula>. For any initial state<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x44.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x45.png" xlink:type="simple"/></inline-formula>, the goal of the optimal control problem is to reach the state <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x44.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x45.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x46.png" xlink:type="simple"/></inline-formula> and minimize the integtal discrepancy cost functional</p><disp-formula id="scirp.72368-formula87"><label>(8)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/72368x47.png"  xlink:type="simple"/></disp-formula><p>Here <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x48.png" xlink:type="simple"/></inline-formula> is the given measurment; <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x48.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x49.png" xlink:type="simple"/></inline-formula>is a small regularization parameter, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x48.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x49.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x50.png" xlink:type="simple"/></inline-formula>is the trajectoty of the system (6), (7) generated under an admissible control <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x48.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x49.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x50.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x51.png" xlink:type="simple"/></inline-formula> out the initial point<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x48.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x49.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x50.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x51.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x52.png" xlink:type="simple"/></inline-formula>. The sign minus in the integrand allows to get solutions which are stable to perturbations of the input data.</p><p>N o t e 1. A solution <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x53.png" xlink:type="simple"/></inline-formula> of the optimal control problem (6), (7), (8) allows us to construct the averaging value <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x53.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x54.png" xlink:type="simple"/></inline-formula></p><disp-formula id="scirp.72368-formula88"><label>(9)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/72368x55.png"  xlink:type="simple"/></disp-formula><p>which can be considered as an approximstion of the solution of the identification problem (1), (2).</p></sec><sec id="s3_2"><title>3.2. Necessary Optimality Conditions: The Hamiltonian</title><p>Recall necessary optimality conditions to problem (6), (7), (8) in terms of the hami- ltonian system [<xref ref-type="bibr" rid="scirp.72368-ref5">5</xref>] [<xref ref-type="bibr" rid="scirp.72368-ref6">6</xref>].</p><p>It is known that the Hamiltonian <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x56.png" xlink:type="simple"/></inline-formula> to problem (6), (7), (8) has the form</p><disp-formula id="scirp.72368-formula89"><graphic  xlink:href="http://html.scirp.org/file/72368x57.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x58.png" xlink:type="simple"/></inline-formula> is an ajoint variable, the symbol <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x58.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x59.png" xlink:type="simple"/></inline-formula> denotes the transpose operation.</p><p>It is not difficult to get</p><disp-formula id="scirp.72368-formula90"><graphic  xlink:href="http://html.scirp.org/file/72368x60.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x61.png" xlink:type="simple"/></inline-formula></p><disp-formula id="scirp.72368-formula91"><graphic  xlink:href="http://html.scirp.org/file/72368x62.png"  xlink:type="simple"/></disp-formula><p>Here the vector-column <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x63.png" xlink:type="simple"/></inline-formula> has the form</p><disp-formula id="scirp.72368-formula92"><label>(10)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/72368x64.png"  xlink:type="simple"/></disp-formula></sec><sec id="s3_3"><title>3.3. The Hamiltonian System</title><p>Necessary optimality conditions can be expressed in the hamiltonian form. An optimal trajectory <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x65.png" xlink:type="simple"/></inline-formula> generating by an optimal admissible control <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x65.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x66.png" xlink:type="simple"/></inline-formula> in problem (6), (7), (8) have to satisfy the hamiltonian system of differential inclusions</p><disp-formula id="scirp.72368-formula93"><label>(11)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/72368x67.png"  xlink:type="simple"/></disp-formula><p>and the boundary conditions</p><disp-formula id="scirp.72368-formula94"><label>(12)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/72368x68.png"  xlink:type="simple"/></disp-formula><p>where symbols <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x69.png" xlink:type="simple"/></inline-formula> denote Clarke’s subdifferentials [<xref ref-type="bibr" rid="scirp.72368-ref7">7</xref>] and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x69.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x70.png" xlink:type="simple"/></inline-formula>,<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x69.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x70.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x71.png" xlink:type="simple"/></inline-formula>.</p><p>Parameters <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x72.png" xlink:type="simple"/></inline-formula> belong to the intervals <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x72.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x73.png" xlink:type="simple"/></inline-formula> where values <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x72.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x73.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x74.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x72.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x73.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x74.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x75.png" xlink:type="simple"/></inline-formula> are choosen from the conditions</p><disp-formula id="scirp.72368-formula95"><label>(13)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/72368x76.png"  xlink:type="simple"/></disp-formula><p>We introduce the last important assumption.</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x77.png" xlink:type="simple"/></inline-formula>There exists a constant <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x77.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x78.png" xlink:type="simple"/></inline-formula> such that restrictions on controls in problem (6), (7), (8) satisfy the relations</p><disp-formula id="scirp.72368-formula96"><label>(14)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/72368x79.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.72368-formula97"><graphic  xlink:href="http://html.scirp.org/file/72368x80.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x81.png" xlink:type="simple"/></inline-formula> are from (10).</p><p>N o t e 2. Using definition (10) one can check that constant K, satisfying assumtion<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x82.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x82.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x83.png" xlink:type="simple"/></inline-formula>can be taken as</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x84.png" xlink:type="simple"/></inline-formula>,</p><p>where</p><disp-formula id="scirp.72368-formula98"><graphic  xlink:href="http://html.scirp.org/file/72368x85.png"  xlink:type="simple"/></disp-formula><p>Here<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x86.png" xlink:type="simple"/></inline-formula> are components of matrix <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x86.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x87.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x86.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x87.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x88.png" xlink:type="simple"/></inline-formula> are components of matrix<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x86.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x87.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x88.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x89.png" xlink:type="simple"/></inline-formula>.</p><p>If <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x90.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x90.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x91.png" xlink:type="simple"/></inline-formula> the Hamiltonian has the simple form</p><disp-formula id="scirp.72368-formula99"><graphic  xlink:href="http://html.scirp.org/file/72368x92.png"  xlink:type="simple"/></disp-formula><p>and the differential inclusions (11) transform into the ODEs.</p><disp-formula id="scirp.72368-formula100"><label>(15)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/72368x93.png"  xlink:type="simple"/></disp-formula><p>Let us introduce the discrepancies<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x94.png" xlink:type="simple"/></inline-formula>, and obtain from (15) the following equations</p><disp-formula id="scirp.72368-formula101"><label>(16)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/72368x95.png"  xlink:type="simple"/></disp-formula><p>and the boundary conditions</p><disp-formula id="scirp.72368-formula102"><label>(17)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/72368x96.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x97.png" xlink:type="simple"/></inline-formula> saisfy (13).</p></sec><sec id="s3_4"><title>3.4. Main Result: Dynamic Programming</title><p>Using skims of proof for similar results in papers [<xref ref-type="bibr" rid="scirp.72368-ref8">8</xref>] [<xref ref-type="bibr" rid="scirp.72368-ref9">9</xref>] [<xref ref-type="bibr" rid="scirp.72368-ref10">10</xref>] we have provided the following assertion.</p><p>Theorem 1 Let assumptions <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x98.png" xlink:type="simple"/></inline-formula> be satisfied and the concordance of para- meters<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x98.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x99.png" xlink:type="simple"/></inline-formula>: <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x98.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x99.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x100.png" xlink:type="simple"/></inline-formula>takes place, then solutions of problem (11), (12), (13) <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x98.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x99.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x100.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x101.png" xlink:type="simple"/></inline-formula>are extendable and unique on <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x98.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x99.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x100.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x101.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x102.png" xlink:type="simple"/></inline-formula> for any <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x98.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x99.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x100.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x101.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x102.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x103.png" xlink:type="simple"/></inline-formula> saisfying (13) and</p><disp-formula id="scirp.72368-formula103"><label>(18)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/72368x104.png"  xlink:type="simple"/></disp-formula><p>It follows from theorem 1, that the average values <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x105.png" xlink:type="simple"/></inline-formula> (9) obtained with the help of dynamic programmig satisfy the desired relation</p><disp-formula id="scirp.72368-formula104"><label>(19)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/72368x106.png"  xlink:type="simple"/></disp-formula></sec></sec><sec id="s4"><title>4. Numerical Example</title><p>A series of numerical experiments, realizing suggested method, has been carried out. As an example a simple mechanical model has been taken into consideration.</p><p>This simplified model describes a vertical rocket launch after engines depletion. The dynamics are described as</p><disp-formula id="scirp.72368-formula105"><label>(20)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/72368x107.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x108.png" xlink:type="simple"/></inline-formula> is a vertical coordinate of the rocket, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x108.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x109.png" xlink:type="simple"/></inline-formula>is an unknown windage coefficient and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x108.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x109.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x110.png" xlink:type="simple"/></inline-formula> =9.8 is a free fall acceleration.</p><p>A function <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x111.png" xlink:type="simple"/></inline-formula> is known and satisfies assumption<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x111.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x112.png" xlink:type="simple"/></inline-formula>. This function was obtained by random perturbing of the basic solution <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x111.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x112.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x113.png" xlink:type="simple"/></inline-formula> for <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x111.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x112.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x113.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x114.png" xlink:type="simple"/></inline-formula> =0.3.</p><p>The suggested method is applied to solve the identification problem for <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x115.png" xlink:type="simple"/></inline-formula> = 0.3.</p><p>We introduce new variables <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x116.png" xlink:type="simple"/></inline-formula> and transform Equation (20) into</p><disp-formula id="scirp.72368-formula106"><label>(21)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/72368x117.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x118.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x118.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x119.png" xlink:type="simple"/></inline-formula> is a fictitious control, which was introduced in order to get <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x118.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x119.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x120.png" xlink:type="simple"/></inline-formula> matrix <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x118.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x119.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x120.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x121.png" xlink:type="simple"/></inline-formula> in (1) satisfying dimentions restriction<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x118.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x119.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x120.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x121.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x122.png" xlink:type="simple"/></inline-formula>.</p><p>We put<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x123.png" xlink:type="simple"/></inline-formula>.</p><p>The corresponding hamiltonian system (16) for problem (21),(8) has the form</p><disp-formula id="scirp.72368-formula107"><label>(22)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/72368x124.png"  xlink:type="simple"/></disp-formula><p>with initial conditions</p><disp-formula id="scirp.72368-formula108"><label>(23)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/72368x125.png"  xlink:type="simple"/></disp-formula><p>The solutions were obtained numerically. On the <xref ref-type="fig" rid="fig1">Figure 1</xref> and <xref ref-type="fig" rid="fig2">Figure 2</xref> the graphs</p><fig id="fig1"  position="float"><label><xref ref-type="fig" rid="fig1">Figure 1</xref></label><caption><title> k(t) graph for δ = 5; k(α, δ) = 0.375</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/72368x126.png"/></fig><fig id="fig2"  position="float"><label><xref ref-type="fig" rid="fig2">Figure 2</xref></label><caption><title> k(t) graph for δ = 2; k(α, δ) = 0.325</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/72368x127.png"/></fig><p>of functions <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/72368x128.png" xlink:type="simple"/></inline-formula> are exposed. The graphs illustrate convergence of the suggested method. The calculated corresponding average values (9) are exposed as well.</p></sec><sec id="s5"><title>Acknowledgements</title><p>This work was supported by the Russian Foundation for Basic Research (projects no. 14-01-00168 and 14-01-00486) and by the Ural Branch of the Russian Academy of Sciences (project No. 15-16-1-11).</p></sec><sec id="s6"><title>Cite this paper</title><p>Subbotina, N.N. and Krupennikov, E.A. (2016) Dynamic Program- ming to Identification Problems. World Jour- nal of Engineering and Technology, 4, 228-234. http://dx.doi.org/10.4236/wjet.2016.43D028</p></sec></body><back><ref-list><title>References</title><ref id="scirp.72368-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Billings, S.A. (1980) Identification of Nonlinear Systems—A Survey. IEE Proceedings D— Control Theory and Applications, 127, 272-285. http://dx.doi.org/10.1049/ip-d.1980.0047</mixed-citation></ref><ref id="scirp.72368-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Nelles, O. (2001) Nonlinear System Identification: From Classical Approaches to Neural Networks and Fuzzy Models. Springer, New York.  
http://dx.doi.org/10.1007/978-3-662-04323-3</mixed-citation></ref><ref id="scirp.72368-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Kryazhimskiy, A.V. and Osipov, Yu.S. (1983) Modelling of a Control in a Dynamic Sys-tem. Engrg. Cybernetics, 21, 38-47.</mixed-citation></ref><ref id="scirp.72368-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Osipov, Yu.S. and Kryazhimskiy, A.V. (1995) Inverse Problems for Ordinary Differential Equa-tions: Dynamical Solutions. Gordon and Breach, London.</mixed-citation></ref><ref id="scirp.72368-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Pontryagin, L.S., Boltyanskij, V.G., Gamkrelidze, R.V. and Mishchenko, E.F. (1962) The Mathematical Theory of Optimal Processes. Interscience Publishers, a Division of John Wiley and Sons, Inc., New York and London.</mixed-citation></ref><ref id="scirp.72368-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Krasovskii, N.N. and Subbotin, A.I. (1977) Game Theoretical Control Problem. Springer- Verlag, New York.</mixed-citation></ref><ref id="scirp.72368-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Clarke, F.H. (1983) Optimization and Nonsmooth Analysis. John Wiley and Sons, New York.</mixed-citation></ref><ref id="scirp.72368-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Subbotina, N.N., Kolpakova, E.A., Tokmantsev, T.B. and Shagalova, L.G. (2013) The Method of Characteristics to Hamilton-Jacobi-Bellman Equations (Metod Harakteristik Dlja Uravnenija Gamil’tona-Jakobi-Bellmana) (in Russian). Ekaterinburg: RIO UrO RAN.</mixed-citation></ref><ref id="scirp.72368-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Subbotina, N.N., Tokmantsev, N.B. and Krupennikov, E.A. (2015) On the Solution of Inverse Problems of Dynamics of Linearly Controlled Systems by the Negative Discrepancy Method. Optimal Control, Collected Papers. In Commemoration of the 105th Anniversary of Academician Lev Semenovich Pontryagin, Tr. Mat. Inst. Steklova, 291 MAIK. Nauka/ Interperiodica, Moscow.</mixed-citation></ref><ref id="scirp.72368-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Subbotina, N.N. and Tokmantsev, N.B. (2015) A Study of the Stability of Solutions to Inverse Problems of Dynamics of Control Systems under Perturbations of Initial Data. Proceedings of the Steklov Institute of Mathematics December 2015, 291, 173-189.  
http://dx.doi.org/10.1134/s0081543815090126</mixed-citation></ref></ref-list></back></article>