<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">IJCNS</journal-id><journal-title-group><journal-title>International Journal of Communications, Network and System Sciences</journal-title></journal-title-group><issn pub-type="epub">1913-3715</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/ijcns.2013.612055</article-id><article-id pub-id-type="publisher-id">IJCNS-41061</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Computer Science&amp;Communications</subject></subj-group></article-categories><title-group><article-title>
 
 
  Adaptation in Stochastic Dynamic Systems—Survey and New Results IV: Seeking Minimum of API in Parameters of Data
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>nnokentiy</surname><given-names>V. Semushin</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Julia</surname><given-names>V. Tsyganova</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib></contrib-group><aff id="aff1"><addr-line>School of Mathematics and Information Technology, Ulyanovsk State University, Ulyanovsk, Russia</addr-line></aff><pub-date pub-type="epub"><day>16</day><month>12</month><year>2013</year></pub-date><volume>06</volume><issue>12</issue><fpage>513</fpage><lpage>518</lpage><history><date date-type="received"><day>October</day>	<month>9,</month>	<year>2013</year></date><date date-type="rev-recd"><day>November</day>	<month>9,</month>	<year>2013</year>	</date><date date-type="accepted"><day>November</day>	<month>16,</month>	<year>2013</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
   This paper investigates the problem of seeking minimum of API (Auxiliary Performance Index) in parameters of Data Model instead of parameters of Adaptive Filter in order to avoid the phenomenon of over parameterization. This problem was stated by Semushin in [2]. The solution to the problem can be considered as the development of API approach to parameter identification in stochastic dynamic systems.
      
      
   
    
  
 
</p></abstract><kwd-group><kwd>Linear Stochastic Systems; Parameter Estimation; Model Identification; Identification for Control; Adaptive Control MSC (2010); 93E10; 93E12; 93E35</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>The recent papers [1,2] gave a survey of the field of adaptation in stochastic systems as it has developed over the last four decades. The author’s research in this field was summarized and a novel solution for fitting an adaptive model in state space (instead of response space) was given.</p><p>In this paper, we further develop the Active Principle of Adaptation for linear time-invariant state-space stochastic MIMO filter systems included into the feedback or considered independently.</p><p>We solve the problem of seeking minimum of Auxiliary Performance Index (API) in parameters of Data Source Model (DSM) instead of parameters of Adaptive Filter (AF) in order to avoid difficulties known as Phenomenon of Over Parameterization (PhOP). The PhOP means that the number of parameters to be adjusted in AF is usually much greater than that in DSM. The solution of this problem will enable identification in the space of lower dimension and at the same time provide estimates of the given system state vector according to Original Performance Index (OPI). We verify the obtained theoretical results by two numerical simulation examples.</p></sec><sec id="s2"><title>2. Parameterized Data Models <img src="5-9701802\6efa74c6-fff8-4e0c-9273-c1dcc1144076.jpg" /></title><p>Following the previous results of [1,2], we assume that all data models <img src="5-9701802\0b49105e-f34c-4246-91cb-d4925c5e5a92.jpg" /> forming a set <img src="5-9701802\cf36257d-8868-41cf-9cdd-fc8002662714.jpg" /> are parameterized by an <img src="5-9701802\8b1b1727-0c1e-471b-aa12-d20866d6dfff.jpg" />-component vector<img src="5-9701802\3573fd9a-f616-4c96-b0ab-a879c23b0b47.jpg" />. Each particular value of <img src="5-9701802\827bfe6a-34a1-4dbd-b1b8-5a87ab0bdb99.jpg" /> (which does not depend on time) specifies a<img src="5-9701802\44973841-9a63-4de5-9d4a-f889837838b6.jpg" />. Hence</p><disp-formula id="scirp.41061-formula117374"><label>(1)</label><graphic position="anchor" xlink:href="5-9701802\d3124109-162f-4b68-8b75-722aebf6f6b0.jpg"  xlink:type="simple"/></disp-formula><p>where <img src="5-9701802\3de46e89-f0a2-4e83-b656-7d5b65206d5a.jpg" /> is the compact subset of<img src="5-9701802\fe66c8d1-8b37-4f7b-881c-27c1a896ad47.jpg" />. A given physical data model (PhDM) is described by the following equations:</p><disp-formula id="scirp.41061-formula117375"><label>(2)</label><graphic position="anchor" xlink:href="5-9701802\49847e36-cbf8-4bd7-8ed1-16fd6e1717b5.jpg"  xlink:type="simple"/></disp-formula><p>where <img src="5-9701802\6f8d2540-3248-4ffc-88cc-5920e520df6c.jpg" /> denotes nonnegative integers, <img src="5-9701802\b2d5d527-0272-4d19-89c2-d5616fe0bfeb.jpg" />strictly positive integers, and <img src="5-9701802\d57062f4-fa2f-418d-b4fc-55a105c06b57.jpg" /> all integers.</p><p>Every model <img src="5-9701802\eb3964e8-bf73-4f9f-b1cb-429bd4f25d7d.jpg" /> (2) is assumed to be acting between adjacent switches as long as it is sufficient for accepting as correct the basic theoretical statement (BTS) that all processes related to the <img src="5-9701802\d0c98a5d-7d8f-4085-810b-94f63c829c58.jpg" /> are wide-sense stationary. This statement amounts to the following assumptions. The random <img src="5-9701802\3cfdf0a0-2a2e-414c-8a2b-f479a51d14a5.jpg" /> with <img src="5-9701802\b0264f6b-41ec-409f-a2e4-e7315504fda9.jpg" /> is orthogonal [<xref ref-type="bibr" rid="scirp.41061-ref3">3</xref>] to <img src="5-9701802\ad11cbe5-9736-4291-b7c3-64e6c7bfbfc1.jpg" /> and<img src="5-9701802\54a61400-ab0f-4973-a53a-895474985436.jpg" />, the zero-mean mutually orthogonal wide-sense stationary orthogonal sequences with <img src="5-9701802\6cc7cf84-c802-42d0-8a50-f28822864dc5.jpg" /> and <img src="5-9701802\02ac4612-8843-40de-bfe6-2826402d027c.jpg" /> for all<img src="5-9701802\b55dbf70-d4d4-49c8-b2db-e643d5a4ff6b.jpg" />; <img src="5-9701802\1bb175be-b67b-4fbd-bddf-89bf0ce12dd9.jpg" />is orthogonal to <img src="5-9701802\dff980a0-9c1e-44b9-a2d9-a3b47f95e7a9.jpg" /> and <img src="5-9701802\1fa6ae79-39a1-4d32-b311-9109d1f8f286.jpg" /> for all<img src="5-9701802\b090e07f-8463-4942-b49b-ae66de81ceeb.jpg" />; <img src="5-9701802\e1011271-961d-4337-80eb-a445d0172e9e.jpg" />is a given signal; it is an “external input” when considering the open-loop case or a control strategy function</p><disp-formula id="scirp.41061-formula117376"><label>(3)</label><graphic position="anchor" xlink:href="5-9701802\672b7814-8a8b-432f-8410-167ae1f7cc11.jpg"  xlink:type="simple"/></disp-formula><p>when considering the closed-loop setup.</p><p>Stackable vectors of previous values</p><disp-formula id="scirp.41061-formula117377"><label>(4)</label><graphic position="anchor" xlink:href="5-9701802\0adb26f5-e413-4f93-afca-0a63a96b4596.jpg"  xlink:type="simple"/></disp-formula><p>constitute the experimental condition <img src="5-9701802\24a770f8-4803-4bf4-a4a1-3171231001ee.jpg" /> (cf. Ljung [<xref ref-type="bibr" rid="scirp.41061-ref4">4</xref>]).</p><p>By assumption, <img src="5-9701802\fd88fb00-2ffa-40dc-895e-1fdb197c58af.jpg" />is generated by the completely observable PhDM (2), so we can move from the physical state variables <img src="5-9701802\30c6943a-9b21-4a4b-b912-7a58831da135.jpg" /> in (2) to another <img src="5-9701802\3b330dff-1190-45ce-8079-23633156c508.jpg" /> through the similarity transformation<img src="5-9701802\bfe2bfa3-1625-480c-a8c2-60af4f4f4a60.jpg" />. Such transformation uniquely determines a new state representation</p><disp-formula id="scirp.41061-formula117378"><label>(5)</label><graphic position="anchor" xlink:href="5-9701802\a2202406-728c-4ce1-8f5f-d69ac268068c.jpg"  xlink:type="simple"/></disp-formula><p>of the standard observable data model (SODM) (cf. Semushin [<xref ref-type="bibr" rid="scirp.41061-ref2">2</xref>]).</p><p>For convenience in the below we shall omit the subscript <img src="5-9701802\d3e4fa13-980a-4d50-9cd4-41c2acb9d6ce.jpg" /> for all the matrices describing PhDM or SODM.</p></sec><sec id="s3"><title>3. Parameterized Innovations</title><p>As before, the above data model of a time-invariant data source will be referred to as the conventional model, no matter whether it is PhDM (2) or SODM (5). Here we use another innovation model, that differs from the timeinvariant (due to BTS) innovation model, presented in [<xref ref-type="bibr" rid="scirp.41061-ref2">2</xref>]:</p><disp-formula id="scirp.41061-formula117379"><label>(6)</label><graphic position="anchor" xlink:href="5-9701802\a4a2613d-8b2a-474b-9643-8f924273a96f.jpg"  xlink:type="simple"/></disp-formula><p>with<img src="5-9701802\47e3fe61-8f2f-471a-b05e-b326132a50b7.jpg" />, the initial<img src="5-9701802\aec6fdec-1998-49e8-9a23-fff7db48e9e2.jpg" />, and<img src="5-9701802\ee3a46da-0def-4b45-9ce6-e172568833cc.jpg" />which is the well-known (not necessarily steady-state) Kalman filter with the innovation process<img src="5-9701802\186088db-afdb-482d-9f5b-0ad69c885ee0.jpg" />, the optimal state predictor<img src="5-9701802\5a4d1a9d-707a-454d-9206-05f8cea21e0b.jpg" />, the gain</p><disp-formula id="scirp.41061-formula117380"><label>(7)</label><graphic position="anchor" xlink:href="5-9701802\1335729c-6611-49af-a340-969c964c2507.jpg"  xlink:type="simple"/></disp-formula><p>and <img src="5-9701802\dff3648b-b7b9-41b5-8ad9-e4bb679ba0b7.jpg" /> satisfying the discrete Riccati iterations [<xref ref-type="bibr" rid="scirp.41061-ref5">5</xref>]</p><disp-formula id="scirp.41061-formula117381"><label>(8)</label><graphic position="anchor" xlink:href="5-9701802\7cfd8aee-19d0-4dbe-a610-725e73efcaa1.jpg"  xlink:type="simple"/></disp-formula><p>Concurrently, another form</p><disp-formula id="scirp.41061-formula117382"><label>(9)</label><graphic position="anchor" xlink:href="5-9701802\75dbf49b-c5bd-4f61-8d69-4270e5e3713b.jpg"  xlink:type="simple"/></disp-formula><p>with the initial<img src="5-9701802\766fb04f-3101-4791-8fa6-133696546e4b.jpg" />, which is equivalent to (6), can be used where <img src="5-9701802\ee5d0b1b-af65-4ce0-8856-fae1b1edb6c2.jpg" /> is the optimal “filtered” estimator for <img src="5-9701802\fb78c342-1454-4a5e-acba-c24740b4af51.jpg" /> based on experimental condition <img src="5-9701802\de237534-6a40-4cf1-8f73-16a55dac5776.jpg" /> (4). When <img src="5-9701802\ab8e90e3-954d-49d3-bf82-199f8f2c5fd1.jpg" /> ranges (or switches) over <img src="5-9701802\6f0761d6-41e6-44a1-a19f-890392b95726.jpg" /> as in (1), we obtain the set of Kalman filters</p><disp-formula id="scirp.41061-formula117383"><label>(10)</label><graphic position="anchor" xlink:href="5-9701802\45665de0-c37f-4fc0-b8d1-7c612d5154f5.jpg"  xlink:type="simple"/></disp-formula><p>We consider the mean-square criterion</p><disp-formula id="scirp.41061-formula117384"><label>(11)</label><graphic position="anchor" xlink:href="5-9701802\19c05aa9-92b2-4d44-976a-b344d8dc0df0.jpg"  xlink:type="simple"/></disp-formula><p>defined for a one-step predictor <img src="5-9701802\15ddd392-66ac-45ea-9ac4-23e3b4db9829.jpg" /> through its error <img src="5-9701802\620a40b1-02da-4999-a528-b55cfe3ca92d.jpg" /> in the Kalman filter. Thus in the basis forming the state-space, <img src="5-9701802\3f3ce126-d5b0-4e6a-98cd-5a0dfa83d8f1.jpg" />(9) is the model minimizing the Original Performance Index (OPI) <img src="5-9701802\48e91e5a-3530-4627-bc29-4adc5dfba7ad.jpg" />(11) at any<img src="5-9701802\0e6793f5-29ad-4c0b-8cf4-f8f8cf4d5476.jpg" />, which is large enough for BTS to hold, so that writing <img src="5-9701802\a79cac0c-ad54-47e2-9d81-44ed8d86cd74.jpg" /> or <img src="5-9701802\9a819c53-9874-4439-88e1-507079b66f4a.jpg" /> as well as any other finitely shifted time in (11) makes no difference.</p></sec><sec id="s4"><title>4. Uncertainty Parameterization</title><p>In contrast to our previous work [<xref ref-type="bibr" rid="scirp.41061-ref2">2</xref>], we do not consider the four levels of uncertainty. Assume that system (2) (and also the SODM (5)) is parameterized by an <img src="5-9701802\af549351-d786-4462-8331-c13ccb98f1ab.jpg" />- component vector <img src="5-9701802\cdbcd78e-43df-4c21-9b3b-0fee8a9df235.jpg" /> of unknown system parameters, which needs to be identified. This means that the entries of the matrices<img src="5-9701802\dd01d66f-700a-4586-9078-55da0b627a99.jpg" />, <img src="5-9701802\09305b66-f14d-44eb-89e7-6d2a001ef3d1.jpg" />, <img src="5-9701802\411d264d-df00-4edd-929b-16e4bd7d8a3f.jpg" />, <img src="5-9701802\4df67abe-a717-482a-896d-c65d1a2c04c8.jpg" />, <img src="5-9701802\ece251f1-8e42-49a2-9f55-cc8be50f0a3b.jpg" />, <img src="5-9701802\01572aed-b75c-4b9e-8012-b557a24d781e.jpg" />are functions of<img src="5-9701802\087b047b-c97c-4321-af25-42e33aa9c0d4.jpg" />. However, for the sake of simplicity we will supress the corresponding notations below, i.e. instead of<img src="5-9701802\ac4948f0-83f8-4a1b-beef-6180c86d143d.jpg" />, <img src="5-9701802\e445f440-b271-410e-ad93-25648e967ad7.jpg" />, <img src="5-9701802\3278c856-5bce-44ea-ad6e-b70381189099.jpg" />, <img src="5-9701802\65bb7f54-1286-4668-a584-2aba04da75dd.jpg" />, <img src="5-9701802\8d25eee5-00c6-41c0-81b4-8a84e25950ed.jpg" />, <img src="5-9701802\ae85ed9f-480c-4e96-bf30-3db8b067b73d.jpg" />we will write<img src="5-9701802\5c28cedd-a775-4cf5-829a-38cbbdceea74.jpg" />, <img src="5-9701802\875b40e5-1ae7-42fd-af15-f46b81a6ba96.jpg" />, <img src="5-9701802\9fcfeace-ed00-40f2-9c1f-99d3e59e972c.jpg" />, <img src="5-9701802\eb9bc44d-30d1-49ca-8df9-f7262730459e.jpg" />, <img src="5-9701802\88ea69d1-271e-45c8-b4a3-1236334a111b.jpg" />,<img src="5-9701802\7078f8cb-69ca-462f-a298-54b641f98793.jpg" />. We make the same assumptions about the SODM.</p></sec><sec id="s5"><title>5. The Set <img src="5-9701802\8c91dfef-eda2-4e7a-9261-39f4ca08c49e.jpg" /> of Adaptive Models <img src="5-9701802\71a55e62-a1b5-4309-bb7f-d59161714358.jpg" /></title><p>Let us consider the set of adaptive models</p><disp-formula id="scirp.41061-formula117385"><label>(12)</label><graphic position="anchor" xlink:href="5-9701802\8892ac78-e112-4b79-87ea-2046f0017913.jpg"  xlink:type="simple"/></disp-formula><p>Here we emphasize the fact that we construct adaptive models in the same class as <img src="5-9701802\d9bde6f9-80a8-4c39-bfbf-8de8c154ae76.jpg" /> belongs to with the only difference that the unknown parameter <img src="5-9701802\800f9e5d-e3a7-4b2d-9039-62d5948d3974.jpg" /> in <img src="5-9701802\40eb87aa-210b-45ba-bf13-20863a3126ac.jpg" /> is replaced by <img src="5-9701802\3785491b-ee83-4026-9520-2c0672eaac07.jpg" /> to obtain<img src="5-9701802\7e45fd1b-30f8-48a3-b77f-3bb20574c8c5.jpg" />. In so doing, each particular value of<img src="5-9701802\8b1b6bf8-bbcd-44e6-9fdd-c6ff74289c45.jpg" />, an estimate of<img src="5-9701802\fd8685ef-c453-43d3-a903-1e82ba57996e.jpg" />, leads to a fixed model<img src="5-9701802\91a72cc9-2f9b-49be-8bba-2126fe2d48ac.jpg" />. In accordance with The Active Principle of Adaptation (APA) [<xref ref-type="bibr" rid="scirp.41061-ref1">1</xref>], only when <img src="5-9701802\f2d7761f-9c27-4825-b3ce-b9b2ba6940c7.jpg" /> ranges over <img src="5-9701802\f7c94a62-ba77-41f8-967d-f70cc78a3402.jpg" /> in search of <img src="5-9701802\616406c5-edd8-46c9-bc64-7af9c6b66ec4.jpg" /> for the goal <img src="5-9701802\291ced4a-f9a2-4c4f-9fd8-a0345458f3d1.jpg" /> or <img src="5-9701802\d59cc331-2b5e-451c-939d-51a4ae7bae32.jpg" /> as governed by a smart, unsupervised helmsman equipped by a vision of the goal in state space and able to pursue it, we obtain a model <img src="5-9701802\1badb297-4967-42a2-af00-29914c839ced.jpg" /> of active type within the set <img src="5-9701802\4e98ca62-347e-46b5-8f87-c6bb32850530.jpg" /> (12). In this case, <img src="5-9701802\2fdff1d9-19e1-4a1f-a8f5-3a2771b9825a.jpg" />will act as a self-tuned model parameter and so should be labeled by<img src="5-9701802\b7086bd3-ff2e-4925-aeac-31e4cdddcc95.jpg" />, the time instant of model’s inner clock, in order to get thereby the emphasized notations <img src="5-9701802\9de7a9c2-0c13-4b22-b888-5ac0df16bc08.jpg" /> and <img src="5-9701802\53cfaf97-6941-45b7-a089-0b54fffae392.jpg" /> in describing parameter identification algorithms (PIAs) to be developed. From this point on <img src="5-9701802\f5d70749-8127-4890-8ea8-86023e58a258.jpg" /> becomes an adaptive estimator.</p><p>Remark 1 Note in passing that pace of <img src="5-9701802\1336dcfe-c66c-4ab0-a3dd-6062ad2135eb.jpg" /> may differ from that of<img src="5-9701802\c4166a18-e73b-4ba9-8e2a-a6c591140b1f.jpg" />. We shall need to discriminate between <img src="5-9701802\38b9a59b-0a74-46eb-94de-c90a42ca4c78.jpg" /> and <img src="5-9701802\a2b011b3-fc6b-4866-baa7-dd6db105cbad.jpg" /> later when developing a PIA.</p><p>Remark 2 If we work in the context of SODM, the set</p><disp-formula id="scirp.41061-formula117386"><label>(13)</label><graphic position="anchor" xlink:href="5-9701802\5d451be1-8d60-4c09-a434-6a46d120b011.jpg"  xlink:type="simple"/></disp-formula><p>instead of (12) should be used.</p><p>At this junction, we identify the following tasks as pending:</p><p>1) Express <img src="5-9701802\29630a11-9f1e-47db-b3a7-be11dbc30f94.jpg" /> or <img src="5-9701802\522d8451-1f12-4bc7-8a31-2638c708d0f2.jpg" /> in an explicit form.</p><p>2) Build up APIs that could offer vision of the goal.</p><p>3) Examine APIs’ capacity to visualize the goal.</p><p>4) Develop a PIA that could help pursuing the goal.</p><p>Consider here the first three points consecutively.</p><sec id="s5_1"><title>5.1. Parameterized Adaptive Models</title><p>Reasoning from (6), (9), we set the adaptive model</p><disp-formula id="scirp.41061-formula117387"><label>(14)</label><graphic position="anchor" xlink:href="5-9701802\73422370-cc83-42a3-8f2e-8919ce262c1c.jpg"  xlink:type="simple"/></disp-formula><p>or equivalently (due to<img src="5-9701802\97e07cc7-dfa5-436c-8ded-357a3c32518a.jpg" />) the model</p><disp-formula id="scirp.41061-formula117388"><label>(15)</label><graphic position="anchor" xlink:href="5-9701802\680f5f57-d46a-4afe-aa33-a4ae8c80da2c.jpg"  xlink:type="simple"/></disp-formula><p>as a member of <img src="5-9701802\2960f5a3-edef-4768-b6e9-c70559a97f3c.jpg" /> (12). Here <img src="5-9701802\1fd2695e-4127-43ee-9f38-735041e186ba.jpg" /> is the self-tuned parameter intended to estimate (in one-to-one corresponddence) parameter θ. In parallel, reasoning from<img src="5-9701802\72d40139-32b5-4e7b-940c-fd70d08393f1.jpg" />, we build the adaptive model</p><disp-formula id="scirp.41061-formula117389"><label>(16)</label><graphic position="anchor" xlink:href="5-9701802\4fce56c3-f8d9-4356-9ec3-854e43321641.jpg"  xlink:type="simple"/></disp-formula><p>or equivalently (due to<img src="5-9701802\b63556d8-2792-44f2-8281-ad27ea974faf.jpg" />) the model</p><disp-formula id="scirp.41061-formula117390"><label>(17)</label><graphic position="anchor" xlink:href="5-9701802\82c57f3e-1891-4cda-9c35-98cbb5c82791.jpg"  xlink:type="simple"/></disp-formula><p>where <img src="5-9701802\e5970823-35b8-4cbc-8cd0-16aae485639f.jpg" /> does not depend on<img src="5-9701802\4dc9e75a-6998-4298-9931-be939d2f4704.jpg" />. Matrices <img src="5-9701802\51e00d7e-b375-4537-925f-a60326e558af.jpg" /></p><p>and <img src="5-9701802\423f2af6-0ea1-4bd5-9e07-8e9d95ee5d9f.jpg" /> are evaluated according to (7), (8).</p><p>Adaptor <img src="5-9701802\974aa420-9770-4a17-9022-e7caf628cbf8.jpg" /> using (14)-(15) (or alternatively, <img src="5-9701802\cd438361-54bf-40e1-805e-5a1384358ae9.jpg" />using (16)-(17)) is supposed to contain a PIA to offer the prospect of convergence. For convergence in parameter space, we anticipate almost surely (a. s.) convergence, as it is the case for MPE identification methods [3,4]. It actuates either or both of the two other types of convergence. The type of convergence in state space, as well as in response space, is induced by the type of Proximity Criterion, PC (cf. [<xref ref-type="bibr" rid="scirp.41061-ref2">2</xref>], Figures 1-3). As seen from (11), we are oriented to the PC, which is quadratic in error; this being so, it would appear reasonable that these convergences would be in mean square (m. s.). Thus we anticipate the following properties of our estimators:</p><disp-formula id="scirp.41061-formula117391"><label>(18)</label><graphic position="anchor" xlink:href="5-9701802\c00eac69-0a3d-46e0-89a5-e0cbd10ee39e.jpg"  xlink:type="simple"/></disp-formula><p>With the understanding that errors for PC</p><disp-formula id="scirp.41061-formula117392"><label>(19)</label><graphic position="anchor" xlink:href="5-9701802\8d4e24e9-fcf2-4096-8dd3-a2dd42da3de4.jpg"  xlink:type="simple"/></disp-formula><p>are fundamentally invisible for any measurement, we search for a function</p><disp-formula id="scirp.41061-formula117393"><label>(20)</label><graphic position="anchor" xlink:href="5-9701802\022d9d9f-6ec7-4088-a1a5-57fb7fab14e9.jpg"  xlink:type="simple"/></disp-formula><p>of the difference in two terms: outputs <img src="5-9701802\9d341f95-f527-48ec-8ae4-29b928180b26.jpg" /> generated by Data Source described in any appropriate form (2), (5)(6), or (9), and their estimates <img src="5-9701802\71b3b361-4279-4ec6-9dd5-4fd4a1e12d27.jpg" /> generated by the adaptive model <img src="5-9701802\df09a9d5-1a9f-4816-af29-ad12982b0e37.jpg" /> (or<img src="5-9701802\1f7734fa-6ab0-49d3-bfe3-c0103f8120a2.jpg" />). For <img src="5-9701802\02c09d1e-3184-4cb5-83cc-02120121f63a.jpg" /> in</p><p>(20), we will also use notations <img src="5-9701802\6234bb90-1a12-4425-ad43-72d8fb7d6eda.jpg" /> or<img src="5-9701802\885ea93a-422a-460a-93aa-febb88828564.jpg" />, thus bringing them into correlation with <img src="5-9701802\dd7a1bff-8da2-4883-9dfd-eae7edadef14.jpg" /> or <img src="5-9701802\32b09fb3-bb19-48ec-9126-c8a7873c2000.jpg" /> (correspondingly, with <img src="5-9701802\9c421312-ba99-4b2a-9cce-898de468543a.jpg" /> or<img src="5-9701802\125ad1f1-7d21-470a-9e62-fcfdd7774894.jpg" />) from (19). Then</p><disp-formula id="scirp.41061-formula117394"><label>(21)</label><graphic position="anchor" xlink:href="5-9701802\058fe8ba-eb4c-4d4a-9829-61c45b9d9262.jpg"  xlink:type="simple"/></disp-formula><p>will be taken as the PC and determined with the key aim:</p><p>True (Unbiased) System Identifiability</p><p><img src="5-9701802\f8f78787-c059-4502-b230-3b8c081a78f5.jpg" /><img src="5-9701802\8614c30e-cf02-49ec-be44-5eba315221b3.jpg" /></p><p>Here, the equivalence symbol <img src="5-9701802\26f61eb9-6806-4b02-8094-3f1afbacab8c.jpg" /> needs clarification. Its sense correlates with the above concept of convergence (18). Necessary refinements will be done (in Theorem 1).</p></sec><sec id="s5_2"><title>5.2. API Identifiability of <img src="5-9701802\45cc4410-74fe-41dd-9662-ccf33420cad4.jpg" /></title><p>Let the auxiliary process (20) be built for the API (21) as</p><disp-formula id="scirp.41061-formula117395"><label>(22)</label><graphic position="anchor" xlink:href="5-9701802\d00e0c3d-62e8-44f3-bef4-90540df8d3cc.jpg"  xlink:type="simple"/></disp-formula><p>or, equivalently, as</p><disp-formula id="scirp.41061-formula117396"><label>(23)</label><graphic position="anchor" xlink:href="5-9701802\ba32165d-6449-4d47-930d-e917f4b4d65a.jpg"  xlink:type="simple"/></disp-formula><p>where special matrix transformations are used (see the section “Ancillary Matrix Transformations” of [<xref ref-type="bibr" rid="scirp.41061-ref2">2</xref>]).</p><p>Theorem 1 Let <img src="5-9701802\6480c0fb-2dec-4749-b4d4-f86497795ca4.jpg" /> (20) be a vector-valued ncomponent function of<img src="5-9701802\67fb92ee-7abf-404b-8f99-c86f969218b9.jpg" />. If <img src="5-9701802\9feb6d63-46cf-43aa-8772-ab29b8487b5c.jpg" /> is defined by</p><p>(22) or (equivalently) (23) in order to form the API (21), then minimum in <img src="5-9701802\81f5c071-1603-4ddc-abfa-33b9f0e6db67.jpg" /> of the API fixed out at any instant t is the necessary and sufficient condition for adaptive model <img src="5-9701802\37ee6550-acec-4cd9-822f-0b29ba7c69aa.jpg" /> to be consistent estimator of <img src="5-9701802\6455aacb-4984-4b93-8160-996ba031ffc7.jpg" /> in mean square,</p><p><img src="5-9701802\a8cc1238-5dba-4894-9e68-4b1612a287ea.jpg" />, that is True (Unbiased) m.s. System Identifiability</p><p><img src="5-9701802\0a9fd7c1-51c9-46ac-851d-0466fbb8a81a.jpg" /></p><p>in the following three setups:</p><p>Setup 1 (Random Control Input) <img src="5-9701802\cccbded0-a114-41b2-be2b-915f33ee7990.jpg" />is a preassigned zero-mean orthogonal wide-sence stationary process orthogonal to <img src="5-9701802\c4fb2523-5a30-4109-911a-22232b1aeeee.jpg" /> but in contrast to <img src="5-9701802\bbc71653-4204-494d-ac69-1eef6a0718c6.jpg" /> and<img src="5-9701802\eeac3573-b5d7-4cd8-bd9d-ab83396d249b.jpg" />, known and serving as a testing signal;</p><p>Setup 2 (Pure Filtering)<img src="5-9701802\1811a654-c448-48f6-ab8a-030bd74ac3ed.jpg" />, and Setup 3 (Close-loop Control) with<img src="5-9701802\982366c6-6131-4211-8cb7-fe8cbccdf479.jpg" />, which does not depend on<img src="5-9701802\70fdb8e9-b930-4a8f-9de2-690f814c8b48.jpg" />.</p><p>Proof is similar to the proof of Theorem 2 in [<xref ref-type="bibr" rid="scirp.41061-ref2">2</xref>].</p><p>Remark 3 Our main goal is to identify the vector <img src="5-9701802\2d7f7b43-f512-4ab3-a761-66010f8b43a2.jpg" /> of unknown parameters. The minimization of API by some PIA allows us to determine the optimal value<img src="5-9701802\5dc66009-95b7-44aa-835d-ed62b0b3efa5.jpg" />. Then it must be substituted into (14)-(15) (or (16)-(17))</p><p>to get the optimal model <img src="5-9701802\c64605a1-c3fc-4c82-a2eb-a274f44e51ea.jpg" /> (or<img src="5-9701802\58fcb4a7-ec39-4595-a1b0-b8c2f2de21fc.jpg" />). At the same time, we obtain the optimal estimates <img src="5-9701802\1efc1c5f-06e6-4b52-9f96-92571fe7911d.jpg" /> (or<img src="5-9701802\33f04bb5-c649-44b2-82ac-90913f561b05.jpg" />) according to OPI.</p></sec><sec id="s5_3"><title>5.3. Main Conceptual Novelty</title><p>Seeking minimum of API in parameters of Data Model instead of parameters of Adaptive Filter is more profitable, as:</p><p>• It takes into account the dynamics of the discrete Riccati equations, which positively affects the quality of parameter and state vector estimates.</p><p>• The number of unknown parameters can be substantially (an order of magnitude or more) reduced thus helping avoid the difficulties of PhOP.</p><p>• API gradient is calculated easily—without the construction of sensitivity model of adaptive filter.</p><p>• It can be implemented in the case of non-stationary systems, which is critical, for example, to handle the navigation data.</p><p>Thus, the proposed variant of API method is a new, thanks to the solution of its important tasks:</p><p>1) Numerical construction of API, which has the same minimizing argument that the OPI does;</p><p>2) The numerical minimization of the API by conventional optimization methods such as Newton-Raphson method, and 3) The combination of parameter identification of the system with the process of adaptive estimation of its states.</p></sec></sec><sec id="s6"><title>6. Simulation Examples</title><p>We take two examples to simulate:</p><p>E1 Second order open-loop system with unknown parameters <img src="5-9701802\fc19a31c-a2d6-4d9a-9ce5-6459482cf4c5.jpg" /> is given by</p><p><img src="5-9701802\b904afb6-f8f9-40f7-bf3f-54f285d65826.jpg" /></p><p>Unknown parameters should be identified. Adaptive model parameter is the four-component vector</p><p><img src="5-9701802\73ea4389-5bd2-4be7-921b-ae58ee27b54a.jpg" />.</p><p>Its true value is</p><p><img src="5-9701802\34dd1b89-223c-4de7-af36-65a1c8272381.jpg" />.</p><p>Covariances <img src="5-9701802\58301495-6294-44d2-94d9-e76866f2a403.jpg" /> and <img src="5-9701802\bf88c848-2d2a-4758-b084-76e42498fc9c.jpg" /> of the noises <img src="5-9701802\00767696-b284-4dff-a5a1-642628ddf0b1.jpg" /> and <img src="5-9701802\2531d7ac-0843-4034-be36-f4a59e9d7fec.jpg" /> are equal to 0.04 and 0.06, correspondingly.</p><p>E2 The same (but closed-loop) system as in E1. The system is designed to operate with a minimum expected control cost</p><p><img src="5-9701802\8d0060ac-a571-4c30-a879-b494779d0027.jpg" /></p><p>Unknown parameters<img src="5-9701802\b5b91fba-dbeb-4664-86b6-38258581a252.jpg" />, <img src="5-9701802\18914c48-6e90-4a2b-9531-4c6d7793233b.jpg" />, <img src="5-9701802\1276201d-e4fb-46c3-af9e-9ffa370472f5.jpg" />and <img src="5-9701802\966cc415-99fe-4db4-9ebb-43a85d8074e4.jpg" /> should be identified. The true values of parameters are the same as in E1.</p><p>Simulation results of Figures 1-4 and 5-7 obtained from Julia Tsyganova’s MATLAB programs demonstrate equimodality (coincidence of the minimizing arguments) of the auxiliary performance index with the original performance index. It is seen that the minimums of OPI and API coincide near<img src="5-9701802\c40531e7-3e79-4473-99be-9b80e018416e.jpg" />. Thus, the obtained results confirm applicability of the presented method.</p></sec><sec id="s7"><title>7. Conclusion</title><p>The present paper gives a comprehensive solution to the problem of seeking minimum of <img src="5-9701802\d54a9dc1-60b7-49ac-a0a3-62719a4b8574.jpg" /> in parameters</p><p><img src="5-9701802\606a0cb7-d02b-4164-9a24-2fe3a50b3e24.jpg" />of Data Model <img src="5-9701802\3333bcdc-ef31-41f6-b022-c3270b0561bf.jpg" /> or <img src="5-9701802\25e4290f-0f80-4eb8-a181-2819a827859c.jpg" /> instead of parameters of Adaptive Filter <img src="5-9701802\a98649f5-35a8-4393-81b2-e9935d4611d2.jpg" /> or<img src="5-9701802\b22fef7d-4f3f-4af0-8f46-2aa5265bd951.jpg" />. The obtained results were verified by two numerical simulation examples.</p><p>Our further research is aimed at obtaining solutions to the following issues:</p><p>• Economic feasibility, numeric stability and convergence reliability of each proposed parameter identification algorithm.</p><p>• Numerical testing of the approach and determining the scope of its appropriate use in real life problems, for example, in Health Care field [<xref ref-type="bibr" rid="scirp.41061-ref6">6</xref>].</p></sec><sec id="s8"><title>8. Acknowledgements</title><p>This work was partly supported by the RFBR Grant No. 13-01-97035.</p></sec><sec id="s9"><title>REFERENCES</title></sec></body><back><ref-list><title>References</title><ref id="scirp.41061-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">I. V. Semushin, “Adaptation in Stochastic Dynamic Systems—Survey and New Results I,” International Journal of Communications, Network and System Sciences, Vol. 4, No. 1, 2011, pp. 17-23. http://dx.doi.org/10.4236/ijcns.2011.41002</mixed-citation></ref><ref id="scirp.41061-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">I. V. Semushin, “Adaptation in Stochastic Dynamic Systems—Survey and New Results II,” International Journal of Communications, Network and System Sciences, Vol. 4, No. 4, 2011, pp. 266-285. http://dx.doi.org/10.4236/ijcns.2011.44032</mixed-citation></ref><ref id="scirp.41061-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">P. E. Caines, “Linear Stochastic Systems,” John Wiley and Sons, Inc., New York, 1988.</mixed-citation></ref><ref id="scirp.41061-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">L. Ljung, “Convergence Analysis of Parametric Identification Methods,” IEEE Transactions on Automatic Control, Vol. 23, No. 5, 1978, pp. 770-783. http://dx.doi.org/10.1109/TAC.1978.1101840</mixed-citation></ref><ref id="scirp.41061-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">E. Mosca, “Optimal, Predictive, and Adaptive Control,” Prentice Hall, Inc., Englewood Cliffs, 1995.</mixed-citation></ref><ref id="scirp.41061-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">I. V. Semushin, J. V. Tsyganova and A. G. Skovikov, “Identification of a Simple Homeostasis Stochastic Model Based on Active Principle of Adaptation,” Book of Abstracts Applied Stochastic Models and Data Analysis ASMDA 2013 &amp; Demographics, Barcelona, 25-28 June 2013, p. 191.</mixed-citation></ref></ref-list></back></article>