<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">AM</journal-id><journal-title-group><journal-title>Applied Mathematics</journal-title></journal-title-group><issn pub-type="epub">2152-7385</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/am.2015.610152</article-id><article-id pub-id-type="publisher-id">AM-59733</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Physics&amp;Mathematics</subject></subj-group></article-categories><title-group><article-title>
 
 
  An Implicit Smooth Conjugate Projection Gradient Algorithm for Optimization with Nonlinear Complementarity Constraints
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>ong</surname><given-names>Zhang</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Limin</surname><given-names>Sun</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Zhibin</surname><given-names>Zhu</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Minglei</surname><given-names>Fang</given-names></name><xref ref-type="aff" rid="aff3"><sup>3</sup></xref></contrib></contrib-group><aff id="aff1"><addr-line>Huarui College, Xinyang Normal University, Xinyang, China</addr-line></aff><aff id="aff2"><addr-line>School of Mathematics &amp;amp; Computational Science, Guilin University of Electronic Technology, Guilin, China</addr-line></aff><aff id="aff3"><addr-line>College of Science, Anhui University of Science and Technology, Huainan, China</addr-line></aff><author-notes><corresp id="cor1">* E-mail:<email>zhcopt@126.com(OZ)</email>;</corresp></author-notes><pub-date pub-type="epub"><day>08</day><month>09</month><year>2015</year></pub-date><volume>06</volume><issue>10</issue><fpage>1712</fpage><lpage>1726</lpage><history><date date-type="received"><day>26</day>	<month>July</month>	<year>2015</year></date><date date-type="rev-recd"><day>accepted</day>	<month>15</month>	<year>September</year>	</date><date date-type="accepted"><day>18</day>	<month>September</month>	<year>2015</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  This paper discusses a special class of mathematical programs with equilibrium constraints. At first, by using a generalized complementarity function, the discussed problem is transformed into a family of general nonlinear optimization problems containing additional variable 
  <em>μ</em>. Furthermore, combining the idea of penalty function, an auxiliary problem with inequality constraints is presented. And then, by providing explicit searching direction, we establish a new conjugate projection gradient method for optimization with nonlinear complementarity constraints. Under some suitable conditions, the proposed method is proved to possess global and superlinear convergence rate.
 
</p></abstract><kwd-group><kwd>Mathematical Programs with Equilibrium Constraints</kwd><kwd> Conjugate Projection Gradient</kwd><kwd> Global Convergence</kwd><kwd> Superlinear Convergence</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>Mathematical programs with equilibrium constraints (MPEC) include the bilevel programming problem as its special case and have extensive applications in practical areas such as traffic control, engineering design, and economic modeling. So many scholars are interested in this kind of problems and make great achievements, (see [<xref ref-type="bibr" rid="scirp.59733-ref1">1</xref>] -[<xref ref-type="bibr" rid="scirp.59733-ref10">10</xref>] ).</p><p>In this paper, we consider an important subclass of MPEC problem, which is called mathematical program with nonlinear complementarity constraints (MPCC):</p><disp-formula id="scirp.59733-formula1290"><label>(1.1)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x6.png"  xlink:type="simple"/></disp-formula><p>where<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x7.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x8.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x9.png" xlink:type="simple"/></inline-formula>are all continuously differential functions,<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x10.png" xlink:type="simple"/></inline-formula>. <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x11.png" xlink:type="simple"/></inline-formula>denotes orthogonality of the vectors y and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x12.png" xlink:type="simple"/></inline-formula>, i.e.,<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x13.png" xlink:type="simple"/></inline-formula>.</p><p>In order to eliminate the complementary constraints, which can not satisfy the standard constraint qualification [<xref ref-type="bibr" rid="scirp.59733-ref11">11</xref>] , we introduce the generalized nonlinear complementary function</p><disp-formula id="scirp.59733-formula1291"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x14.png"  xlink:type="simple"/></disp-formula><p>Obviously, the following practical results about function <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x15.png" xlink:type="simple"/></inline-formula> hold:</p><p>• if <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x16.png" xlink:type="simple"/></inline-formula> and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x17.png" xlink:type="simple"/></inline-formula>, then</p><disp-formula id="scirp.59733-formula1292"><label>(1.2)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x18.png"  xlink:type="simple"/></disp-formula><p>•</p><disp-formula id="scirp.59733-formula1293"><label>(1.3)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x19.png"  xlink:type="simple"/></disp-formula><p>By means of the function<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x20.png" xlink:type="simple"/></inline-formula>, problem (1.1) is transformed equivalently into the following standard nonlinear optimization problem</p><disp-formula id="scirp.59733-formula1294"><label>(1.4)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x21.png"  xlink:type="simple"/></disp-formula><p>Similar to [<xref ref-type="bibr" rid="scirp.59733-ref12">12</xref>] , we define the following penalty function</p><disp-formula id="scirp.59733-formula1295"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x22.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x23.png" xlink:type="simple"/></inline-formula> is a penalty parameter. Therefore, our approach consists of solving an auxiliary inequality constrained problem which is defined by</p><disp-formula id="scirp.59733-formula1296"><label>(1.5)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x24.png"  xlink:type="simple"/></disp-formula></sec><sec id="s2"><title>2. Preliminaries and Algorithm</title><p>For the sake of simplicity, we denote</p><disp-formula id="scirp.59733-formula1297"><label>(2.1)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x25.png"  xlink:type="simple"/></disp-formula><p>Throughout this paper, the following basic assumptions are assumed.</p><p>H 2.1. The feasible set of (1.1) is nonempty, i.e.,<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x26.png" xlink:type="simple"/></inline-formula>.</p><p>H 2.2. The functions <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x27.png" xlink:type="simple"/></inline-formula> are twice continuously differentiable.</p><p>H 2.3.<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x28.png" xlink:type="simple"/></inline-formula>, the vectors <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x28.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x29.png" xlink:type="simple"/></inline-formula> are linearly independent.</p><p>The following definition and proposition can be refereed to in [<xref ref-type="bibr" rid="scirp.59733-ref13">13</xref>] .</p><p>Definition 2.1. Suppose that <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x30.png" xlink:type="simple"/></inline-formula> satisfies the so-called nondegeneracy condition:</p><disp-formula id="scirp.59733-formula1298"><label>(2.2)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x31.png"  xlink:type="simple"/></disp-formula><p>If there exists multipliers <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x32.png" xlink:type="simple"/></inline-formula> such that</p><disp-formula id="scirp.59733-formula1299"><label>(2.3)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x33.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.59733-formula1300"><label>(2.4)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x34.png"  xlink:type="simple"/></disp-formula><p>hold, then <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x35.png" xlink:type="simple"/></inline-formula> is said to be a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x35.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x36.png" xlink:type="simple"/></inline-formula> point of (1.1).</p><p>Proposition 2.1. Suppose that <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x37.png" xlink:type="simple"/></inline-formula> satisfies the so-called nondegeneracy condition (2.2), then <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x37.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x38.png" xlink:type="simple"/></inline-formula> is a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x37.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x38.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x39.png" xlink:type="simple"/></inline-formula> point of (1.1) if and only if <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x37.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x38.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x39.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x40.png" xlink:type="simple"/></inline-formula> satisfies</p><disp-formula id="scirp.59733-formula1301"><label>(2.5)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x41.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.59733-formula1302"><label>(2.6)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x42.png"  xlink:type="simple"/></disp-formula><p>where</p><disp-formula id="scirp.59733-formula1303"><label>(2.7)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x43.png"  xlink:type="simple"/></disp-formula><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x44.png" xlink:type="simple"/></inline-formula>and.</p><p>Proposition 2.2. (1) s is a feasible point of (1.1) if and only if <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x46.png" xlink:type="simple"/></inline-formula> with <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x46.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x47.png" xlink:type="simple"/></inline-formula> is a feasible point of (1.4).</p><p>(2) <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x48.png" xlink:type="simple"/></inline-formula>is a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x48.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x49.png" xlink:type="simple"/></inline-formula> point of (1) if and only if <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x48.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x49.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x50.png" xlink:type="simple"/></inline-formula> with <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x48.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x49.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x50.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x51.png" xlink:type="simple"/></inline-formula> is a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x48.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x49.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x50.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x51.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x52.png" xlink:type="simple"/></inline-formula> point of (1.4).</p><p>Proof. (1) According to the property of function<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x53.png" xlink:type="simple"/></inline-formula>, the conclusion follows immediately from (1.3).</p><p>(2) Suppose that <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x54.png" xlink:type="simple"/></inline-formula> is a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x54.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x55.png" xlink:type="simple"/></inline-formula> point of (1.1). If set <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x54.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x55.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x56.png" xlink:type="simple"/></inline-formula> and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x54.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x55.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x56.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x57.png" xlink:type="simple"/></inline-formula>, then, from (1), we see <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x54.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x55.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x56.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x57.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x58.png" xlink:type="simple"/></inline-formula> is a feasible point of (1.4). While, it follows from proposition 2.1 that there exists vector <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x54.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x55.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x56.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x57.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x58.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x59.png" xlink:type="simple"/></inline-formula> such that (2.5) and (2.6) hold. Define</p><disp-formula id="scirp.59733-formula1304"><label>(2.8)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x60.png"  xlink:type="simple"/></disp-formula><p>So, it is not difficult to prove that <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x61.png" xlink:type="simple"/></inline-formula> satisfies the <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x61.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x62.png" xlink:type="simple"/></inline-formula> system of (1.4), according to (1.3), (2.5) and (2.6).</p><p>Conversely, if <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x63.png" xlink:type="simple"/></inline-formula> is a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x63.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x64.png" xlink:type="simple"/></inline-formula> point of (1.4), then it follows that</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x65.png" xlink:type="simple"/></inline-formula> and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x65.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x66.png" xlink:type="simple"/></inline-formula>,</p><p>which shows that <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x67.png" xlink:type="simple"/></inline-formula> is a feasible point of (1.1). Suppose <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x67.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x68.png" xlink:type="simple"/></inline-formula> is a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x67.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x68.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x69.png" xlink:type="simple"/></inline-formula> multiplier corresponding to <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x67.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x68.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x69.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x70.png" xlink:type="simple"/></inline-formula> of (1.4). Define <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x67.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x68.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x69.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x70.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x71.png" xlink:type="simple"/></inline-formula> as follows:</p><disp-formula id="scirp.59733-formula1305"><label>(2.9)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x72.png"  xlink:type="simple"/></disp-formula><p>Then, it is easy to see, from (1.2) and the <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x73.png" xlink:type="simple"/></inline-formula> system of (4) at<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x73.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x74.png" xlink:type="simple"/></inline-formula>, that <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x73.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x74.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x75.png" xlink:type="simple"/></inline-formula> with the multiplier <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x73.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x74.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x75.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x76.png" xlink:type="simple"/></inline-formula> satisfies (2.5) and (2.6). Therefore, we assert <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x73.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x74.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x75.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x76.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x77.png" xlink:type="simple"/></inline-formula> is a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x73.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x74.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x75.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x76.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x77.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x78.png" xlink:type="simple"/></inline-formula> point of (1.1) according to proposition 2.1.</p><p>Now, we present the definition of multiplier function associated with <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x79.png" xlink:type="simple"/></inline-formula>-active set [<xref ref-type="bibr" rid="scirp.59733-ref14">14</xref>] .</p><p>Definition 2.2. A continuous function <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x80.png" xlink:type="simple"/></inline-formula> is said to a multiplier function, if <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x80.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x81.png" xlink:type="simple"/></inline-formula> satisfies the <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x80.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x81.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x82.png" xlink:type="simple"/></inline-formula> system of (1.5) with corresponding multipliers<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x80.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x81.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x82.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x83.png" xlink:type="simple"/></inline-formula>.</p><p>Firstly, for a given point<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x84.png" xlink:type="simple"/></inline-formula>, by using the pivoting operation, we obtain an approximate active<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x84.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x85.png" xlink:type="simple"/></inline-formula>.</p><p>Algorithm A:</p><p>Step 1. For the current point <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x86.png" xlink:type="simple"/></inline-formula> and parameter<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x86.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x87.png" xlink:type="simple"/></inline-formula>. Set<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x86.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x87.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x88.png" xlink:type="simple"/></inline-formula>,<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x86.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x87.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x88.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x89.png" xlink:type="simple"/></inline-formula>;</p><p>Step 2. If<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x90.png" xlink:type="simple"/></inline-formula>, let<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x90.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x91.png" xlink:type="simple"/></inline-formula>, stop; otherwise, goto Step 3, where</p><disp-formula id="scirp.59733-formula1306"><label>(2.10)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x92.png"  xlink:type="simple"/></disp-formula><p>Step 3.<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x93.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x93.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x94.png" xlink:type="simple"/></inline-formula>, go back to Step 2.</p><p>Lemma 2.1. For any iteration index k, algorithm A terminates in finite iteration.</p><p>For the current point <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x95.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x95.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x96.png" xlink:type="simple"/></inline-formula>-active set<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x95.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x96.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x97.png" xlink:type="simple"/></inline-formula>, compute</p><disp-formula id="scirp.59733-formula1307"><label>(2.11)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x98.png"  xlink:type="simple"/></disp-formula><p>Now we give some notations and the explicit search direction in this paper.</p><disp-formula id="scirp.59733-formula1308"><label>(2.12)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x99.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.59733-formula1309"><label>(2.13)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x100.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.59733-formula1310"><label>(2.14)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x101.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.59733-formula1311"><label>(2.15)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x102.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.59733-formula1312"><label>(2.16)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x103.png"  xlink:type="simple"/></disp-formula><p>where<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x104.png" xlink:type="simple"/></inline-formula>.</p><p>According to the above analysis, the algorithm for the solution of the problem (1.1) can be stated as follows.</p><p>Algorithm B:</p><p>Step 0. Given a starting point<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x105.png" xlink:type="simple"/></inline-formula>, and an initial symmetric positive definite matrix<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x105.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x106.png" xlink:type="simple"/></inline-formula>.</p><p>Choose parameters<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x107.png" xlink:type="simple"/></inline-formula>.</p><p>Step 1. By means of Algorithm A, compute <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x108.png" xlink:type="simple"/></inline-formula> and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x108.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x109.png" xlink:type="simple"/></inline-formula>.</p><p>Step 2. Compute <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x110.png" xlink:type="simple"/></inline-formula> according to (2.13). If<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x110.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x111.png" xlink:type="simple"/></inline-formula>, stop; otherwise, compute <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x110.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x111.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x112.png" xlink:type="simple"/></inline-formula> according to (2.14). If</p><disp-formula id="scirp.59733-formula1313"><label>(2.17)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x113.png"  xlink:type="simple"/></disp-formula><p>goto Step 3; otherwise, goto Step 4.</p><p>Step 3. Let<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x114.png" xlink:type="simple"/></inline-formula>.</p><p>(1) If</p><disp-formula id="scirp.59733-formula1314"><label>(2.18)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x115.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.59733-formula1315"><label>(2.19)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x116.png"  xlink:type="simple"/></disp-formula><p>Set<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x117.png" xlink:type="simple"/></inline-formula>, goto Step 5.</p><p>(2) Let<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x118.png" xlink:type="simple"/></inline-formula>. if<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x118.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x119.png" xlink:type="simple"/></inline-formula>, goto Step 4; otherwise, repeat (1).</p><p>Step 4. Obtain feasible descent direction <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x120.png" xlink:type="simple"/></inline-formula> from (2.16), and compute β<sub>k</sub>, the first number β in the sequence</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x121.png" xlink:type="simple"/></inline-formula>satisfying</p><disp-formula id="scirp.59733-formula1316"><label>(2.20)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x122.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.59733-formula1317"><label>(2.21)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x123.png"  xlink:type="simple"/></disp-formula><p>Let<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x124.png" xlink:type="simple"/></inline-formula>.</p><p>Step 5. Define<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x125.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x125.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x126.png" xlink:type="simple"/></inline-formula>and set</p><disp-formula id="scirp.59733-formula1318"><label>(2.22)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x127.png"  xlink:type="simple"/></disp-formula><p>and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x128.png" xlink:type="simple"/></inline-formula>. Obtain <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x128.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x129.png" xlink:type="simple"/></inline-formula> by updating the positive definite matrix <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x128.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x129.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x130.png" xlink:type="simple"/></inline-formula> using some quasi- Newton formulas, and set k = k + 1. Go back to Step 1.</p><p>In the remainder of this section, we give some results to show that Algorithm B is correctly stated.</p><p>Lemma 2.2. (1) If<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x131.png" xlink:type="simple"/></inline-formula>, then we have</p><disp-formula id="scirp.59733-formula1319"><label>(2.23)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x132.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.59733-formula1320"><label>(2.24)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x133.png"  xlink:type="simple"/></disp-formula><p>(2) If the sequence <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x134.png" xlink:type="simple"/></inline-formula> is bounded, then there exists a constant <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x134.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x135.png" xlink:type="simple"/></inline-formula> such that</p><disp-formula id="scirp.59733-formula1321"><label>(2.25)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x136.png"  xlink:type="simple"/></disp-formula><p>Proof. (1) If<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x137.png" xlink:type="simple"/></inline-formula>, then</p><disp-formula id="scirp.59733-formula1322"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x138.png"  xlink:type="simple"/></disp-formula><p>In view of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x139.png" xlink:type="simple"/></inline-formula>, we get<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x139.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x140.png" xlink:type="simple"/></inline-formula>. Since</p><disp-formula id="scirp.59733-formula1323"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x141.png"  xlink:type="simple"/></disp-formula><p>so we have</p><disp-formula id="scirp.59733-formula1324"><label>(2.26)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x142.png"  xlink:type="simple"/></disp-formula><p>(2) Note that the boundedness of sequence <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x143.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x143.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x144.png" xlink:type="simple"/></inline-formula> positive definite, we know that <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x143.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x144.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x145.png" xlink:type="simple"/></inline-formula> are bounded. By (2.16), there exists constant <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x143.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x144.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x145.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x146.png" xlink:type="simple"/></inline-formula> such that<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x143.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x144.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x145.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x146.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x147.png" xlink:type="simple"/></inline-formula>. Thus, there exists constant <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x143.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x144.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x145.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x146.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x147.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x148.png" xlink:type="simple"/></inline-formula> such that</p><disp-formula id="scirp.59733-formula1325"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x149.png"  xlink:type="simple"/></disp-formula><p>So, the claim holds.</p><p>According to Lemma 2.2 and the continuity of functions <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x150.png" xlink:type="simple"/></inline-formula> and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x150.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x151.png" xlink:type="simple"/></inline-formula>, the following result is true.</p><p>Lemma 2.3. Algorithm B is well defined.</p></sec><sec id="s3"><title>3. Global Convergence</title><p>In this section, we consider the global convergence of the algorithm B. Firstly, we show that <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x152.png" xlink:type="simple"/></inline-formula> is an exact stationary point of (1.1) if the Algorithm B terminates at the current iteration point<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x152.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x153.png" xlink:type="simple"/></inline-formula>.</p><p>Lemma 3.1. (1) <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x154.png" xlink:type="simple"/></inline-formula>is a K − T point of (1.5) if and only if<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x154.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x155.png" xlink:type="simple"/></inline-formula>.</p><p>(2) If <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x156.png" xlink:type="simple"/></inline-formula> is a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x156.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x157.png" xlink:type="simple"/></inline-formula> point of (1.5), then <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x156.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x157.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x158.png" xlink:type="simple"/></inline-formula> with <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x156.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x157.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x158.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x159.png" xlink:type="simple"/></inline-formula> is a K − T point of (1.4).</p><p>Proof. (1) If <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x160.png" xlink:type="simple"/></inline-formula> is a K − T point of (1.5), then from the definition of index set J<sub>k</sub>, we know the K − T multiplier corresponding to constraints about index <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x160.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x161.png" xlink:type="simple"/></inline-formula> is 0. Thus, there exists vector <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x160.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x161.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x162.png" xlink:type="simple"/></inline-formula> such that</p><disp-formula id="scirp.59733-formula1326"><label>(3.1)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x163.png"  xlink:type="simple"/></disp-formula><p>Note that matrix <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x164.png" xlink:type="simple"/></inline-formula> is full of column rank, and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x164.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x165.png" xlink:type="simple"/></inline-formula> positive definite. Thus we have <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x164.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x165.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x166.png" xlink:type="simple"/></inline-formula> exists. Furthermore, it follows from (3.1) that</p><disp-formula id="scirp.59733-formula1327"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x167.png"  xlink:type="simple"/></disp-formula><p>By (2.14) and (3.1), we have</p><disp-formula id="scirp.59733-formula1328"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x168.png"  xlink:type="simple"/></disp-formula><p>so <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x169.png" xlink:type="simple"/></inline-formula></p><p>On the other hand, it is easy to verify that</p><disp-formula id="scirp.59733-formula1329"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x170.png"  xlink:type="simple"/></disp-formula><p>It follows from <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x171.png" xlink:type="simple"/></inline-formula> that</p><disp-formula id="scirp.59733-formula1330"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x172.png"  xlink:type="simple"/></disp-formula><p>From the positive definiteness of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x173.png" xlink:type="simple"/></inline-formula> and (2.12), (2.13) and (2.14), we have</p><disp-formula id="scirp.59733-formula1331"><label>(3.2)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x174.png"  xlink:type="simple"/></disp-formula><p>which implies that <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x175.png" xlink:type="simple"/></inline-formula> is a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x175.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x176.png" xlink:type="simple"/></inline-formula> point of (1.5).</p><p>(2) In view of the definition of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x177.png" xlink:type="simple"/></inline-formula>, we obtain from (3.2) that</p><disp-formula id="scirp.59733-formula1332"><label>(3.3)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x178.png"  xlink:type="simple"/></disp-formula><p>Since the vectors <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x179.png" xlink:type="simple"/></inline-formula> are linearly independent, we have</p><disp-formula id="scirp.59733-formula1333"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x180.png"  xlink:type="simple"/></disp-formula><p>i.e.</p><disp-formula id="scirp.59733-formula1334"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x181.png"  xlink:type="simple"/></disp-formula><p>Thus, we deduce</p><disp-formula id="scirp.59733-formula1335"><label>(3.4)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x182.png"  xlink:type="simple"/></disp-formula><p>In view of the definition of penalty parameter<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x183.png" xlink:type="simple"/></inline-formula>, from (3.4), we have</p><disp-formula id="scirp.59733-formula1336"><label>(3.5)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x184.png"  xlink:type="simple"/></disp-formula><p>Combining with (3.2) and (3.5), it holds that</p><disp-formula id="scirp.59733-formula1337"><label>(3.6)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x185.png"  xlink:type="simple"/></disp-formula><p>Let <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x186.png" xlink:type="simple"/></inline-formula> where<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x186.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x187.png" xlink:type="simple"/></inline-formula>. From (3.3) and (3.6), we can easily see that <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x186.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x187.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x188.png" xlink:type="simple"/></inline-formula> is a K − T point pair of (1.4).</p><p>Theorem 3.1. Suppose the nondegeneracy condition holds at<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x189.png" xlink:type="simple"/></inline-formula>. If <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x189.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x190.png" xlink:type="simple"/></inline-formula> is a K − T point of (1.4), then <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x189.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x190.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x191.png" xlink:type="simple"/></inline-formula> is a K − T point of (1.1).</p><p>Proof. According to the K − T system of (1.4) and the relationship of index i and j in (2.1), we see that</p><disp-formula id="scirp.59733-formula1338"><label>(3.7)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x192.png"  xlink:type="simple"/></disp-formula><p>Then, combining with Proposition 2.1 and Proposition 2.2, we can conclude that <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x193.png" xlink:type="simple"/></inline-formula> is a K − T point of (1.1).</p><p>In the sequel, it is assumed that the Algorithm B generates an infinite sequence<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x194.png" xlink:type="simple"/></inline-formula>. The following further assumption about <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x194.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x195.png" xlink:type="simple"/></inline-formula> is required in subsequent discussions.</p><p>H 3.1. (1) The sequence <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x196.png" xlink:type="simple"/></inline-formula> is bounded.</p><p>(2) The accumulation point <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x197.png" xlink:type="simple"/></inline-formula> of infinite sequence <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x197.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x198.png" xlink:type="simple"/></inline-formula> satisfies (2.2).</p><p>From H 3.1 and the fact that there are only finitely many choices for sets<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x199.png" xlink:type="simple"/></inline-formula>, we may assume that there exists a subsequence K, such that</p><disp-formula id="scirp.59733-formula1339"><label>(3.8)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x200.png"  xlink:type="simple"/></disp-formula><p>where J is a constant set. Correspondingly, the following results hold:</p><disp-formula id="scirp.59733-formula1340"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x201.png"  xlink:type="simple"/></disp-formula><p>Lemma 3.2. Suppose<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x202.png" xlink:type="simple"/></inline-formula>, then for <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x202.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x203.png" xlink:type="simple"/></inline-formula> large enough, we have</p><p>(1) there exists a constant <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x204.png" xlink:type="simple"/></inline-formula> such that<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x204.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x205.png" xlink:type="simple"/></inline-formula>.</p><p>(2) there exists a constant <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x206.png" xlink:type="simple"/></inline-formula> such that<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x206.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x207.png" xlink:type="simple"/></inline-formula>.</p><p>Proof. (1) suppose, by contradiction, that there exists an index set <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x208.png" xlink:type="simple"/></inline-formula> such that<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x208.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x209.png" xlink:type="simple"/></inline-formula>. Let<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x208.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x209.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x210.png" xlink:type="simple"/></inline-formula>. For <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x208.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x209.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x210.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x211.png" xlink:type="simple"/></inline-formula> large enough, from Algorithm A, we have</p><disp-formula id="scirp.59733-formula1341"><label>(3.9)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x212.png"  xlink:type="simple"/></disp-formula><p>Since there are only finite possible subsets of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x213.png" xlink:type="simple"/></inline-formula>, there must be an infinite subset <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x213.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x214.png" xlink:type="simple"/></inline-formula> such that for any<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x213.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x214.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x215.png" xlink:type="simple"/></inline-formula>. Thus, it follows from (3.9) that</p><disp-formula id="scirp.59733-formula1342"><label>(3.10)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x216.png"  xlink:type="simple"/></disp-formula><p>which contradicts the condition H 2.3.</p><p>(2) Suppose by contradiction, there exists a subsequence <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x217.png" xlink:type="simple"/></inline-formula> such that<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x217.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x218.png" xlink:type="simple"/></inline-formula>, then from the definition of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x217.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x218.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x219.png" xlink:type="simple"/></inline-formula>, we have</p><disp-formula id="scirp.59733-formula1343"><label>(3.11)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x220.png"  xlink:type="simple"/></disp-formula><p>From the finite selectivity of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x221.png" xlink:type="simple"/></inline-formula>, we can suppose without loss of generality that<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x221.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x222.png" xlink:type="simple"/></inline-formula>. By (1), we can see that <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x221.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x222.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x223.png" xlink:type="simple"/></inline-formula> is bounded, i.e., <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x221.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x222.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x223.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x224.png" xlink:type="simple"/></inline-formula>for some<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x221.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x222.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x223.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x224.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x225.png" xlink:type="simple"/></inline-formula>. Let M be such an integer that<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x221.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x222.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x223.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x224.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x225.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x226.png" xlink:type="simple"/></inline-formula>, then we have</p><disp-formula id="scirp.59733-formula1344"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x227.png"  xlink:type="simple"/></disp-formula><p>a contradiction, and the result is proved.</p><p>Lemma 3.3. Suppose that<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x228.png" xlink:type="simple"/></inline-formula>, and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x228.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x229.png" xlink:type="simple"/></inline-formula> which is generated by Step 4 and Step 5. If <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x228.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x229.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x230.png" xlink:type="simple"/></inline-formula> is not a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x228.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x229.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x230.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x231.png" xlink:type="simple"/></inline-formula> point of (1.5), then we have</p><p>(1)<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x232.png" xlink:type="simple"/></inline-formula>,</p><p>(2)<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x233.png" xlink:type="simple"/></inline-formula>.</p><p>Proof. (1) Suppose<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x234.png" xlink:type="simple"/></inline-formula>. Since <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x234.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x235.png" xlink:type="simple"/></inline-formula> is not a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x234.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x235.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x236.png" xlink:type="simple"/></inline-formula> of (1.5), so we have <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x234.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x235.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x236.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x237.png" xlink:type="simple"/></inline-formula> and</p><disp-formula id="scirp.59733-formula1345"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x238.png"  xlink:type="simple"/></disp-formula><p>Therefore, for <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x239.png" xlink:type="simple"/></inline-formula> large enough, we obtain</p><disp-formula id="scirp.59733-formula1346"><label>(3.12)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x240.png"  xlink:type="simple"/></disp-formula><p>(2) For (2.20), denote</p><disp-formula id="scirp.59733-formula1347"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x241.png"  xlink:type="simple"/></disp-formula><p>From (3.12), for <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x242.png" xlink:type="simple"/></inline-formula> large enough and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x242.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x243.png" xlink:type="simple"/></inline-formula> small enough, it holds that<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x242.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x243.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x244.png" xlink:type="simple"/></inline-formula>.</p><p>For (2.21), when<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x245.png" xlink:type="simple"/></inline-formula>, the fact <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x245.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x246.png" xlink:type="simple"/></inline-formula> and the continuity of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x245.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x246.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x247.png" xlink:type="simple"/></inline-formula> imply that (4.5) holds. When<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x245.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x246.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x247.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x248.png" xlink:type="simple"/></inline-formula>, it holds that<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x245.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x246.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x247.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x248.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x249.png" xlink:type="simple"/></inline-formula>. From (3.12), for <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x245.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x246.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x247.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x248.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x249.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x250.png" xlink:type="simple"/></inline-formula> large enough and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x245.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x246.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x247.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x248.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x249.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x250.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x251.png" xlink:type="simple"/></inline-formula> small enough, we have</p><disp-formula id="scirp.59733-formula1348"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x252.png"  xlink:type="simple"/></disp-formula><p>According to the analysis above, the result is true.</p><p>Lemma 3.4. Algorithm B generates infinite sequence<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x253.png" xlink:type="simple"/></inline-formula>, whose any accumulation points <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x253.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x254.png" xlink:type="simple"/></inline-formula> are <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x253.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x254.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x255.png" xlink:type="simple"/></inline-formula> points of (1.1).</p><p>Proof. Suppose that<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x256.png" xlink:type="simple"/></inline-formula>. From (2.17), (2.18), (2.20) and Lemma 2.2, we know that <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x256.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x257.png" xlink:type="simple"/></inline-formula> is a descent sequence. While, for<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x256.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x257.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x258.png" xlink:type="simple"/></inline-formula>, it is obvious that<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x256.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x257.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x258.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x259.png" xlink:type="simple"/></inline-formula>. So</p><disp-formula id="scirp.59733-formula1349"><label>(3.13)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x260.png"  xlink:type="simple"/></disp-formula><p>Now we consider the following two cases:</p><p>(1) Suppose there exists an infinite subset <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x261.png" xlink:type="simple"/></inline-formula> such that</p><disp-formula id="scirp.59733-formula1350"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x262.png"  xlink:type="simple"/></disp-formula><p>which is obtained by Step 3 and Step 5. In view of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x263.png" xlink:type="simple"/></inline-formula> in Step 3, it follows from (2.17) and (2.18) that</p><disp-formula id="scirp.59733-formula1351"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x264.png"  xlink:type="simple"/></disp-formula><p>Obvious,<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x265.png" xlink:type="simple"/></inline-formula>. Again, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x265.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x266.png" xlink:type="simple"/></inline-formula>, so we have<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x265.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x266.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x267.png" xlink:type="simple"/></inline-formula>. Imitating the proof of Lemma 3.1, it is easy to see that <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x265.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x266.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x267.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x268.png" xlink:type="simple"/></inline-formula> is a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x265.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x266.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x267.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x268.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x269.png" xlink:type="simple"/></inline-formula> point of (1.5).</p><p>(2) Assume the iteration <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x270.png" xlink:type="simple"/></inline-formula> is generated by Step 4 and Step 5. Suppose by contradiction that <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x270.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x271.png" xlink:type="simple"/></inline-formula> is not a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x270.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x271.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x272.png" xlink:type="simple"/></inline-formula> point of (1.5). Then, from (3.12) and Lemma 3.3, we have</p><disp-formula id="scirp.59733-formula1352"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x273.png"  xlink:type="simple"/></disp-formula><p>which is a contradiction. Thus, the claim holds.</p><p>Theorem 3.2. The <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x274.png" xlink:type="simple"/></inline-formula> point <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x274.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x275.png" xlink:type="simple"/></inline-formula> of (1.5) must be the one of (1.4), where<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x274.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x275.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x276.png" xlink:type="simple"/></inline-formula>.</p><p>Proof. If <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x277.png" xlink:type="simple"/></inline-formula> is a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x277.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x278.png" xlink:type="simple"/></inline-formula> point of (1.5), then there exists multiplier <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x277.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x278.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x279.png" xlink:type="simple"/></inline-formula> such that</p><disp-formula id="scirp.59733-formula1353"><label>(3.14)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x280.png"  xlink:type="simple"/></disp-formula><p>Set</p><disp-formula id="scirp.59733-formula1354"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x281.png"  xlink:type="simple"/></disp-formula><p>Obvious,<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x282.png" xlink:type="simple"/></inline-formula>. While, from (3.14) we get</p><disp-formula id="scirp.59733-formula1355"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x283.png"  xlink:type="simple"/></disp-formula><p>i.e.</p><disp-formula id="scirp.59733-formula1356"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x284.png"  xlink:type="simple"/></disp-formula><p>Thereby,</p><disp-formula id="scirp.59733-formula1357"><label>(3.15)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x285.png"  xlink:type="simple"/></disp-formula><p>According to the definition of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x286.png" xlink:type="simple"/></inline-formula>, it is clear that</p><disp-formula id="scirp.59733-formula1358"><label>(3.16)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x287.png"  xlink:type="simple"/></disp-formula><p>In addition, combining with (3.2) (3.16), we obtain</p><disp-formula id="scirp.59733-formula1359"><label>(3.17)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x288.png"  xlink:type="simple"/></disp-formula><p>Let<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x289.png" xlink:type="simple"/></inline-formula>, where<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x289.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x290.png" xlink:type="simple"/></inline-formula>. It follows from (3.14) and (3.17) that <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x289.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x290.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x291.png" xlink:type="simple"/></inline-formula> is a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x289.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x290.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x291.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x292.png" xlink:type="simple"/></inline-formula> point pair of (1.4).</p><p>Theorem 3.3. Suppose (2.2) holds at<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x293.png" xlink:type="simple"/></inline-formula>. If <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x293.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x294.png" xlink:type="simple"/></inline-formula> is a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x293.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x294.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x295.png" xlink:type="simple"/></inline-formula> point of (1.4), then <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x293.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x294.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x295.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x296.png" xlink:type="simple"/></inline-formula> is a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x293.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x294.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x295.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x296.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x297.png" xlink:type="simple"/></inline-formula> point of (1.1).</p><p>Proof. According to Theorem 3.2 and (2.1), Proposition 2.1 and Proposition 2.2 imply <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x298.png" xlink:type="simple"/></inline-formula> is a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x298.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x299.png" xlink:type="simple"/></inline-formula> point of (1.1).</p></sec><sec id="s4"><title>4. Superlinear Convergence</title><p>Now we discuss the convergence rate of the Algorithm B, and prove that the sequence <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x300.png" xlink:type="simple"/></inline-formula> generated by the Algorithm B is one-step superlinearly convergent. For this purpose, we add some stronger regularity assumptions.</p><p>H 4.1. The bounded sequence <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x301.png" xlink:type="simple"/></inline-formula> possesses an accumulation point<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x301.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x302.png" xlink:type="simple"/></inline-formula>, at which second-order sufficiency condition and strict complementary slackness hold, where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x301.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x302.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x303.png" xlink:type="simple"/></inline-formula> is the corresponding multiplier of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x301.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x302.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x303.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x304.png" xlink:type="simple"/></inline-formula>.</p><p>Lemma 4.1. Under H 2.1-H 4.2, we have that</p><disp-formula id="scirp.59733-formula1360"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x305.png"  xlink:type="simple"/></disp-formula><p>Proof. For <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x306.png" xlink:type="simple"/></inline-formula> generated by Step 3 and Step 5, from (2.17) and (2.18), it holds that</p><disp-formula id="scirp.59733-formula1361"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x307.png"  xlink:type="simple"/></disp-formula><p>While, for <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x308.png" xlink:type="simple"/></inline-formula> generated by Step 4 and Step 5, from (2.17), (2.20) and Lemma 2.2, we have</p><disp-formula id="scirp.59733-formula1362"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x309.png"  xlink:type="simple"/></disp-formula><p>So</p><disp-formula id="scirp.59733-formula1363"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x310.png"  xlink:type="simple"/></disp-formula><p>Passing to the limit <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x311.png" xlink:type="simple"/></inline-formula> and from (3.13), we obtain</p><disp-formula id="scirp.59733-formula1364"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x312.png"  xlink:type="simple"/></disp-formula><p>Thereby</p><disp-formula id="scirp.59733-formula1365"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x313.png"  xlink:type="simple"/></disp-formula><p>Theorem 4.1. The entire sequence <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x314.png" xlink:type="simple"/></inline-formula> converges to<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x314.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x315.png" xlink:type="simple"/></inline-formula>, i.e.,<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x314.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x315.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x316.png" xlink:type="simple"/></inline-formula>.</p><p>In order to obtain the superlinear convergence rate, we make the following assumption.</p><p>H 4.2. <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x317.png" xlink:type="simple"/></inline-formula>positive definite.</p><p>Lemma 4.2. If H 2.1-H 4.2 hold, then we get that</p><p>(1) for k large enough,<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x318.png" xlink:type="simple"/></inline-formula>.</p><p>(2)<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x319.png" xlink:type="simple"/></inline-formula>.</p><p>Proof. (1) On one hand, by Lemma 3.2, for k large enough, there exists a constant <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x320.png" xlink:type="simple"/></inline-formula> such that <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x320.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x321.png" xlink:type="simple"/></inline-formula> in Algorithm A. It follows from H 4.1 and the fact <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x320.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x321.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x322.png" xlink:type="simple"/></inline-formula> that, for k large enough,<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x320.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x321.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x322.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x323.png" xlink:type="simple"/></inline-formula>.</p><p>On the other hand, we assert that<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x324.png" xlink:type="simple"/></inline-formula>. Otherwise, there exists some index t and infinite subset K such that</p><disp-formula id="scirp.59733-formula1366"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x325.png"  xlink:type="simple"/></disp-formula><p>Let<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x326.png" xlink:type="simple"/></inline-formula>, then</p><disp-formula id="scirp.59733-formula1367"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x327.png"  xlink:type="simple"/></disp-formula><p>It is a contradiction with the complementary slackness condition, which shows that<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x328.png" xlink:type="simple"/></inline-formula>, i.e.,<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x328.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x329.png" xlink:type="simple"/></inline-formula>.</p><p>(2) According to <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x330.png" xlink:type="simple"/></inline-formula> and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x330.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x331.png" xlink:type="simple"/></inline-formula>, the fact <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x330.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x331.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x332.png" xlink:type="simple"/></inline-formula> implies<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x330.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x331.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x332.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x333.png" xlink:type="simple"/></inline-formula>. Again, since <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x330.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x331.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x332.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x333.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x334.png" xlink:type="simple"/></inline-formula> is a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x330.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x331.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x332.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x333.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x334.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x335.png" xlink:type="simple"/></inline-formula> point of (1.5), imitating the proof of Lemma 3.1, we get that</p><disp-formula id="scirp.59733-formula1368"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x336.png"  xlink:type="simple"/></disp-formula><p>So the uniqueness of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x337.png" xlink:type="simple"/></inline-formula> multiplier shows<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x337.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x338.png" xlink:type="simple"/></inline-formula>.</p><p>Lemma 4.3. Under H 2.1-H 4.2, for k large enough, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x339.png" xlink:type="simple"/></inline-formula>with the corresponding multiplier</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x340.png" xlink:type="simple"/></inline-formula>is a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x340.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x341.png" xlink:type="simple"/></inline-formula> point of the following quadratic program</p><disp-formula id="scirp.59733-formula1369"><label>(4.1)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x342.png"  xlink:type="simple"/></disp-formula><p>Proof. Suppose that <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x343.png" xlink:type="simple"/></inline-formula> is a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x343.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x344.png" xlink:type="simple"/></inline-formula> point pair of (4.1). From (2.12), (2.14) and (4.1), it holds that</p><disp-formula id="scirp.59733-formula1370"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x345.png"  xlink:type="simple"/></disp-formula><p>In addition, for k large enough, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x346.png" xlink:type="simple"/></inline-formula>holds from fact <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x346.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x347.png" xlink:type="simple"/></inline-formula> and strict complementarity condition. While, from the definition of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x346.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x347.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x348.png" xlink:type="simple"/></inline-formula>, it holds that<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x346.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x347.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x348.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x349.png" xlink:type="simple"/></inline-formula>. So the claim holds.</p><p>Lemma 4.4. (1) For k large enough, there exist constants <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x350.png" xlink:type="simple"/></inline-formula> such that</p><disp-formula id="scirp.59733-formula1371"><label>(4.2)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x351.png"  xlink:type="simple"/></disp-formula><p>(2) <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x352.png" xlink:type="simple"/></inline-formula>obtained by (2.15) satisfies</p><disp-formula id="scirp.59733-formula1372"><label>(4.3)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x353.png"  xlink:type="simple"/></disp-formula><p>Proof. (1) Since<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x354.png" xlink:type="simple"/></inline-formula>, and for k large enough, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x354.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x355.png" xlink:type="simple"/></inline-formula>, it is easy to see</p><disp-formula id="scirp.59733-formula1373"><label>(4.4)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x356.png"  xlink:type="simple"/></disp-formula><p>Obviously, for k large enough,<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x357.png" xlink:type="simple"/></inline-formula>. Thereby, there exists a constant <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x357.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x358.png" xlink:type="simple"/></inline-formula> such that</p><disp-formula id="scirp.59733-formula1374"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x359.png"  xlink:type="simple"/></disp-formula><p>In addition, from Lemma 4.3, we see</p><disp-formula id="scirp.59733-formula1375"><label>(4.5)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x360.png"  xlink:type="simple"/></disp-formula><p>So</p><disp-formula id="scirp.59733-formula1376"><label>(4.6)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x361.png"  xlink:type="simple"/></disp-formula><p>(2) Since</p><disp-formula id="scirp.59733-formula1377"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x362.png"  xlink:type="simple"/></disp-formula><p>we know</p><disp-formula id="scirp.59733-formula1378"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x363.png"  xlink:type="simple"/></disp-formula><p>From <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x364.png" xlink:type="simple"/></inline-formula> and the boundedness of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x364.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x365.png" xlink:type="simple"/></inline-formula>, it follows that</p><disp-formula id="scirp.59733-formula1379"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x366.png"  xlink:type="simple"/></disp-formula><p>So, the result is true.</p><p>In order to obtain the superlinear convergence rate, we make another assumption.</p><p>H 4.3. The sequence of symmetric matrices <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x367.png" xlink:type="simple"/></inline-formula> satisfies</p><disp-formula id="scirp.59733-formula1380"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x368.png"  xlink:type="simple"/></disp-formula><p>where</p><disp-formula id="scirp.59733-formula1381"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x369.png"  xlink:type="simple"/></disp-formula><p>Lemma 4.5. For k large enough, Algorithm B is not implemented on Step 4, and</p><disp-formula id="scirp.59733-formula1382"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x370.png"  xlink:type="simple"/></disp-formula><p>holds in Step 3.</p><p>Proof. According to <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x371.png" xlink:type="simple"/></inline-formula> and Lemma 4.4, we have</p><disp-formula id="scirp.59733-formula1383"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x372.png"  xlink:type="simple"/></disp-formula><p>which shows (2.17) hold. Now we prove that, the arc search (2.19) and (2.18) eventually accept unit step, i.e., <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x373.png" xlink:type="simple"/></inline-formula>, for k large enough.</p><p>Firstly, for (2.19), when<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x374.png" xlink:type="simple"/></inline-formula>, the fact that <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x374.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x375.png" xlink:type="simple"/></inline-formula> and the continuity of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x374.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x375.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x376.png" xlink:type="simple"/></inline-formula> imply</p><disp-formula id="scirp.59733-formula1384"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x377.png"  xlink:type="simple"/></disp-formula><p>when<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x378.png" xlink:type="simple"/></inline-formula>, using Taylor expansion, we get</p><disp-formula id="scirp.59733-formula1385"><label>(4.7)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x379.png"  xlink:type="simple"/></disp-formula><p>Again, from</p><disp-formula id="scirp.59733-formula1386"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x380.png"  xlink:type="simple"/></disp-formula><p>we see</p><disp-formula id="scirp.59733-formula1387"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x381.png"  xlink:type="simple"/></disp-formula><p>Thus, (4.7) yields</p><disp-formula id="scirp.59733-formula1388"><label>(4.8)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x382.png"  xlink:type="simple"/></disp-formula><p>In view of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x383.png" xlink:type="simple"/></inline-formula>, (2.19) obviously holds when<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x383.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x384.png" xlink:type="simple"/></inline-formula>.</p><p>Secondly, we prove that, for k large enough, (2.18) holds for<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x385.png" xlink:type="simple"/></inline-formula>. Denote</p><disp-formula id="scirp.59733-formula1389"><label>(4.9)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x386.png"  xlink:type="simple"/></disp-formula><p>From (4.5), we have</p><disp-formula id="scirp.59733-formula1390"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x387.png"  xlink:type="simple"/></disp-formula><p>Also, by (4.8), it holds that</p><disp-formula id="scirp.59733-formula1391"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x388.png"  xlink:type="simple"/></disp-formula><p>So</p><disp-formula id="scirp.59733-formula1392"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x389.png"  xlink:type="simple"/></disp-formula><p>Thus, (4.6) yields</p><disp-formula id="scirp.59733-formula1393"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x390.png"  xlink:type="simple"/></disp-formula><p>Denote<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x391.png" xlink:type="simple"/></inline-formula>, then<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x391.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x392.png" xlink:type="simple"/></inline-formula>. Set</p><disp-formula id="scirp.59733-formula1394"><label>(4.10)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-7402837x393.png"  xlink:type="simple"/></disp-formula><p>Clearly,</p><disp-formula id="scirp.59733-formula1395"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x394.png"  xlink:type="simple"/></disp-formula><p>while, from (2) and (10), it holds that</p><disp-formula id="scirp.59733-formula1396"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x395.png"  xlink:type="simple"/></disp-formula><p>So</p><disp-formula id="scirp.59733-formula1397"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x396.png"  xlink:type="simple"/></disp-formula><p>which implies the theorem hold.</p><p>According to Lemma 4.3, Lemma 4.4 and Lemma 4.5, combining with Theorem 12.3.3 in [<xref ref-type="bibr" rid="scirp.59733-ref15">15</xref>] , the following state holds.</p><p>Theorem 4.2. The Algorithm B is superlinearly convergent, i.e.,</p><disp-formula id="scirp.59733-formula1398"><graphic  xlink:href="http://html.scirp.org/file/5-7402837x397.png"  xlink:type="simple"/></disp-formula></sec><sec id="s5"><title>5. Conclusion</title><p>By means of perturbed technique and generalized complementarity function, we, using implicit smoothing strategy, equivalently transform the original problem into a family of general optimization problems. Based on the idea of penalty function, the discussed problem is transformed an associated problem with only inequality constraints containing parameter. And then, by providing explicit searching direction, a new variable metric gradient projection method for MPCC is established. The smoothing factor <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-7402837x398.png" xlink:type="simple"/></inline-formula> regarded as a variable ensures that we can obtain an exact stationary point of original problem once the algorithm terminates in finite iteration. What’s more, the proposed algorithm adjusts penalty parameter automatically. Under some mild conditions, the global convergence is obtained as well as the superlinear convergence rate.</p></sec><sec id="s6"><title>Acknowledgements</title><p>The authors are indebted to the anonymous referees for valuable comments and remarks that helped them improve the original version of the paper.</p></sec><sec id="s7"><title>Funding</title><p>This work was supported in part by the National Natural Science Foundation (No. 11361018), the Natural Sci- ence Foundation of Guangxi Province (No. 2014GXNSFFA118001), the Key Program for Science and Techno- logy in Henan Education Institution (No. 15B110008) and Huarui College Science Foundation (No. 2014qn35) of China.</p></sec><sec id="s8"><title>Cite this paper</title><p>CongZhang,LiminSun,ZhibinZhu,MingleiFang, (2015) An Implicit Smooth Conjugate Projection Gradient Algorithm for Optimization with Nonlinear Complementarity Constraints. Applied Mathematics,06,1712-1726. doi: 10.4236/am.2015.610152</p></sec><sec id="s9"><title>NOTES</title></sec></body><back><ref-list><title>References</title><ref id="scirp.59733-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Kocvara, M. and Outrata, J. (1994) On Optimization Systems Govern by Implicit Complementarity Problems. Numerical Functional Analysis and Optimization, 15, 869-887. http://dx.doi.org/10.1080/01630569408816597</mixed-citation></ref><ref id="scirp.59733-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Fletcher, R., Leyffer, S., Ralph, D. and Scholtes, S. (2006) Local Convergence of SQP Methods for Mathematical Programs with Equilibrium Constraints. SIAM: SIAM Journal on Optimization, 17, 259-286.  
http://dx.doi.org/10.1137/S1052623402407382</mixed-citation></ref><ref id="scirp.59733-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Luo, Z.Q., Pang, J.S. and Ralph, D. (1996) Mathmetical Programs with Equilibrium Constraints. Cambridge University Press, Cambridge. http://dx.doi.org/10.1017/CBO9780511983658</mixed-citation></ref><ref id="scirp.59733-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Jiang, H. (2000) Smooth SQP Methods for Mathematical Programs with Nonlinear Complementarity Constaints. SIAM Journal of Optimization, 10, 779-808. http://dx.doi.org/10.1137/S1052623497332329</mixed-citation></ref><ref id="scirp.59733-ref5"><label>5</label><mixed-citation publication-type="book" xlink:type="simple">Kocvara, M. and Outrata, J. (1995) A Nonsmmoth Approach to Optimization Problems with Equilibrium Constraints. In: Ierns, M.C. and Pang, J.D., Eds., Proceedings of the International Conference on Complementatity Problems, SIAM Publications, Baltimore, 148-164.</mixed-citation></ref><ref id="scirp.59733-ref6"><label>6</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Outrata</surname><given-names> J. </given-names></name>,<etal>et al</etal>. (<year>1990</year>)<article-title>On the Numberical Solution of a Class of Stachelberg Problems</article-title><source> Zeitschrift for Operations Research</source><volume> 4</volume>,<fpage> 255</fpage>-<lpage>278</lpage>.<pub-id pub-id-type="doi"></pub-id></mixed-citation></ref><ref id="scirp.59733-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Zhang, C., Zhu, Z.B., Chen, F.H. and Fang, M.L. (2010) Sequential System of Linear Equations Algorithm for Optimization with Complementary Constraints. Mathematics Modelling and Applied Computing, 1, 71-80.</mixed-citation></ref><ref id="scirp.59733-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Zhang, C., Zhu, Z.B. and Fang, M.L. (2010) A Superlinearly Covergent SSLE Algorithm for Optimization Problems with Linear Complementarity Constraints. Journal of Mathematical Science: Advance and Application, 6, 149-164.</mixed-citation></ref><ref id="scirp.59733-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Huang, Z.H., Lin, G.H. and Xiu, N.H. (2014) Several Developments of Variational Inequalities and Complementarity Problems, Bilevel Programming and MPEC. Operations Research Transactions, 18, 113-133.</mixed-citation></ref><ref id="scirp.59733-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Zhang, C., Sun, L.M., Zhu, Z.B. and Fang, M.L. (2015) Levenberg-Marquardt Method for Mathematical Programs with Linearly Complementarity Constraints. American Journal of Computational Mathematics, 5, 239-242. 
http://dx.doi.org/10.4236/ajcm.2015.53020</mixed-citation></ref><ref id="scirp.59733-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Outrata, J., Kocvara, M. and Zowe, J. (1998) Nonsmmoth Approach to Aptimization Problems with Equilibrium Constraints. Kluwer Academic Publishers, The Netherland. http://dx.doi.org/10.1007/978-1-4757-2825-5</mixed-citation></ref><ref id="scirp.59733-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Gao, Z.Y., He, G.P. and Wu, F. (2004) Sequential Systems of Linear Equations Algorithm for Nonlinear Optimization Problems—General Constrained Problems. Applied Mathematics and Computation, 147, 211-226. 
http://dx.doi.org/10.1016/S0096-3003(02)00662-8</mixed-citation></ref><ref id="scirp.59733-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Jian, J.B., Qin, Y. and Liang, Y.M. (2007) A Generalized Strongly Sub-Feasible Algorithm for Mathematical Problems with Nonliear Complementarity Constraints. Numerical Mathematics: A Journal of Chinese Universities, 29, 15-27.</mixed-citation></ref><ref id="scirp.59733-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">Zhu, Z.B. and Zhang, K.C. (2004) A New Conjugate Projuction Gradient Method and Superlinear Convergence. Acta Mathematicae Applicatae Sinica, 27, 149-161.</mixed-citation></ref><ref id="scirp.59733-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Yuan, Y.X. and Sun, W.Y. (1997) Optimization Theory and Method. Science Press, Beijing.</mixed-citation></ref></ref-list></back></article>