<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">AJOR</journal-id><journal-title-group><journal-title>American Journal of Operations Research</journal-title></journal-title-group><issn pub-type="epub">2160-8830</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/ajor.2013.31A010</article-id><article-id pub-id-type="publisher-id">AJOR-27537</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Physics&amp;Mathematics</subject></subj-group></article-categories><title-group><article-title>
 
 
  Hierarchical Modeling by Recursive Unsupervised Spectral Clustering and Network Extended Importance Measures to Analyze the Reliability Characteristics of Complex Network Systems
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>iping</surname><given-names>Fang</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Enrico</surname><given-names>Zio</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib></contrib-group><aff id="aff1"><addr-line>Chair on Systems Science and the Energetic Challenge, Ecole Centrale Paris and Supelec, Paris, France</addr-line></aff><aff id="aff2"><addr-line>Chair on Systems Science and the Energetic Challenge, Ecole Centrale Paris and Supelec, Paris, France&amp;amp;Energy Department, Politecnico di Milano, Milano, Italy</addr-line></aff><author-notes><corresp id="cor1">* E-mail:<email>yiping.fang@ecp.fr(IF)</email>;</corresp></author-notes><pub-date pub-type="epub"><day>30</day><month>01</month><year>2013</year></pub-date><volume>03</volume><issue>01</issue><fpage>101</fpage><lpage>112</lpage><history><date date-type="received"><day>November</day>	<month>30,</month>	<year>2012</year></date><date date-type="rev-recd"><day>December</day>	<month>30,</month>	<year>2012</year>	</date><date date-type="accepted"><day>January</day>	<month>13,</month>	<year>2013</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
   The complexity of large-scale network systems made of a large number of nonlinearly interconnected components is a restrictive facet for their modeling and analysis. In this paper, we propose a framework of hierarchical modeling of a complex network system, based on a recursive unsupervised spectral clustering method. The hierarchical model serves the purpose of facilitating the management of complexity in the analysis of real-world critical infrastructures. We exemplify this by referring to the reliability analysis of the 380 kV Italian Power Transmission Network (IPTN). In this work of analysis, the classical component Importance Measures (IMs) of reliability theory have been extended to render them compatible and applicable to a complex distributed network system. By utilizing these extended IMs, the reliability properties of the IPTN system can be evaluated in the framework of the hierarchical system model, with the aim of providing risk managers with information on the risk/safety significance of system structures and components. 
 
</p></abstract><kwd-group><kwd>Complex Network System; Hierarchical Modeling; Spectral Clustering; Extended Importance Measure</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>Critical infrastructures are engineered distributed systems which provide the fundamental support to modern Industry and society. Examples are computer and communication systems, power transmission and distribution systems, rail and road transportation systems, oil/gas systems and water distribution systems. Failures of such systems can have multiple, transnational impacts of significant size [1-3]. Hence, identifying and quantifying the reliability and vulnerability of such systems is crucial for designing the adequate protections, mitigation and emergency actions against failures [<xref ref-type="bibr" rid="scirp.27537-ref2">2</xref>].</p><p>These systems are exposed to multiple hazards and threats, some of which are even unexpected and emergent, and consist of a large number of elements whose interactions are not easily modeled and quantified, so that a complete analysis by exhaustive treatment cannot be pursued. As a result, the performance and reliability assessment of such “complex” systems has proved to be a non-trivial task in practice.</p><p>Recent studies suggest that many real complex network systems exhibit a modularized organization [4,5]. In many cases, these modularized structures are found to correspond to functional units within networks (ecological niches in food webs, modules in biochemical networks) [<xref ref-type="bibr" rid="scirp.27537-ref6">6</xref>]. Broadly speaking, clusters (also called communities or modules) are found in the network, forming groups of elements that are densely interconnected with each other but only sparsely connected with the rest of the network. Furthermore, hierarchically modularized organization, which is a central idea for the life process in biology [5,7], is also found to characterize the internal structure of many technological networks [<xref ref-type="bibr" rid="scirp.27537-ref8">8</xref>]. This sparks the idea of utilizing the hierarchical, modularized structure as a basis to model these complex systems, for their analysis and understanding [<xref ref-type="bibr" rid="scirp.27537-ref9">9</xref>].</p><p>In the analysis of systems with respect to their failure behavior, Importance Measures (IMs) are used to identify the weak points and quantify the impact of component failures [10,11]. IMs provide numerical indicators to determine which components are most important for system reliability improvement or most critical for system failure. Many different IMs have been proposed in the literature [12,13], among which classical and relevant statistics are Birnbaum [<xref ref-type="bibr" rid="scirp.27537-ref14">14</xref>], Fussell-Vesely [<xref ref-type="bibr" rid="scirp.27537-ref15">15</xref>] and Criticality Importance [16,17]. However, none of these</p><p>measures can be applied directly to complex network systems, because of the distributed character of functionality and service that they provide.</p><p>The purpose of this paper is twofold: firstly to propose a scheme of recursive clustering to obtain a hierarchical modeling framework associated with different variedsize grained virtual networks; then to introduce Extended Importance Measures (EIMs) which are compatible with the distributed characteristics of complex network systems, to evaluate the components importance in the framework of the hierarchical system representation.</p><p>The remainder of this paper is organized as follows: Section 2 presents the methodology of hierarchical modeling, taking the structure of the 380 kV Italian Power Transmission Network (IPTN) as an example for illustration; in Section 3, the basic terminal-pair connection reliability problem is first introduced, based on which the traditional IMs are extended and then calculated for the IPTN system; conclusions are drawn in Section 4.</p></sec><sec id="s2"><title>2. Hierarchical Modeling of Complex Network System</title><sec id="s2_1"><title>2.1. Network Representation</title><p>Graph Theory provides a framework for the mathematical representation of complex networks. A graph is an ordered pair <img src="4-1040202\65d3270e-1c35-48c2-8b15-139837790430.jpg" />comprising a set of vertices (nodes) <img src="4-1040202\593e01a1-110b-46d4-b3eb-2ff82dbcb0f8.jpg" />together with a set of edges (also called arcs or links)<img src="4-1040202\20351712-1ae0-4b6e-9c31-ea2c7e65c366.jpg" />, which are twoelement subsets of V. The network structure is usually defined by the <img src="4-1040202\040d1d2c-47b8-4f80-8804-cfea7567f2c4.jpg" /> adjacency matrix, which defines which two nodes are connected by assigning a 1 to the corresponding element of the matrix; otherwise, the value in the matrix is 0 if there is no connection between the two nodes. As described, this type of graph is unweighted and undirected. A graph is weighted if a value (weight) is assigned to each edge representing properties of the connection like cost, reliability, capacities, etc. For example, the matrix of physical distances is often used in conjunction with the adjacency matrix to describe a network also with respect to its spatial dimension [18,19].</p><p>In this paper, we take for exemplification of the analyses proposed the 380 kV Italian power transmission network (IPTN) (<xref ref-type="fig" rid="fig1"><xref ref-type="fig" rid="fig">Figure </xref>1</xref>). This network is a branch of the high-voltage-level transmission network, which can be modeled as a graph of <img src="4-1040202\00958b00-9657-4a10-9034-2fac3912b1f3.jpg" /> (<img src="4-1040202\1decc541-99b7-4992-8e74-178bf3e64130.jpg" />generators and <img src="4-1040202\e4ab2095-028a-4772-823f-2858042d5ba7.jpg" /> distributors) connected by M = 171 links [20,21], defined by its <img src="4-1040202\1cdca4eb-c7a3-407b-8e67-2db385a18563.jpg" /> adjacency matrix A whose entries <img src="4-1040202\70191483-0ab7-4f12-b831-bb8a9eed98e7.jpg" /> are 1 if there is an edge joining node i to node j or 0 otherwise. In <xref ref-type="fig" rid="fig1"><xref ref-type="fig" rid="fig">Figure </xref>1</xref>, the generators, i.e. hydro and thermal power plants, are represented by squares whereas the distribution substations are represented by circles.</p></sec><sec id="s2_2"><title>2.2. Construct Network Hierarchy by Successive Clustering</title><p>Modularity is ubiquitous in many networks of scientific and technological interest, ranging from the World Wide Web to biological networks [7,22]. As a result, it is often possible to identify groups of elements that are highly interconnected with each other, but have only a few links to components outside of the group to which they belong to. These communities usually combine into each other in a hierarchical manner [<xref ref-type="bibr" rid="scirp.27537-ref7">7</xref>], in which nodes form groups and then join the groups of groups, and so forth, starting from the lowest levels of organization (individual nodes) up to the level of the entire system. This suggests the development of a hierarchical structure to describe a complex network system at different levels of resolution, with the aim of managing the complexity of the system more effectively.</p><p>A successive Unsupervised Spectral Clustering Algorithm (USCA) [<xref ref-type="bibr" rid="scirp.27537-ref23">23</xref>], which is invariant to cluster shapes and densities and simple to implement, has been adopted in this study to build the hierarchical structure of the IPTN system. Cluster analysis aims at recognizing natural groups within classes of entities [<xref ref-type="bibr" rid="scirp.27537-ref24">24</xref>]. The problem is to assign categories to unlabelled data, encouraging the search of implicit information in the network structure encoded in its graph [<xref ref-type="bibr" rid="scirp.27537-ref25">25</xref>]. Consequently, modularity patterns within a complex network system can be revealed without a priori knowledge of their existence. The detailed description of different clustering methods is beyond the scope of this article. For a systematic and synthetic review, the reader is encouraged to look at [24-26].</p><p>The USCA makes use of the spectrum (eigenvalues) of the similarity matrix of the data to perform dimensionality reduction before Fuzzy c-Means (FCM)—clustering in fewer dimensions. Schematically, it is performed by the steps [<xref ref-type="bibr" rid="scirp.27537-ref23">23</xref>] in <xref ref-type="table" rid="table1">Table 1</xref>.</p><p>In the first step, the Laplacian matrix <img src="4-1040202\af6e5f6c-d7c2-4b42-9a31-e0a82dfabf73.jpg" /> is calculated from the similarity (affinity) matrix as follows. The input similarity matrix <img src="4-1040202\538199c3-1452-4394-aa8a-ad0b20b5c961.jpg" /> is of size <img src="4-1040202\f993f426-f014-46e8-bb65-ac20227cedbb.jpg" /> and its generic element <img src="4-1040202\a9957d19-b97c-4862-bb45-4058b1bf09b7.jpg" /> represents the similarity between nodes i and j in the network. The diagonal components <img src="4-1040202\6af7fc6b-f0ca-41f1-ac25-9ca99537d10c.jpg" /> are set to 1 and the matrix is symmetric<img src="4-1040202\d60c0bed-144f-4973-9f09-6622ad6bc45e.jpg" />. The degree matrix <img src="4-1040202\6b2e39f0-3100-45b2-a7fa-6d97ad30558d.jpg" /> is the diagonal matrix with diagonal entries <img src="4-1040202\a2da72ad-16a3-4674-a4e2-1295625417d8.jpg" /> defined by</p><disp-formula id="scirp.27537-formula89458"><label>(1)</label><graphic position="anchor" xlink:href="4-1040202\22fd2760-7726-468f-8534-156d21516079.jpg"  xlink:type="simple"/></disp-formula><p>Then, the normalized graph Laplacian matrix can be obtained:</p><disp-formula id="scirp.27537-formula89459"><label>(2)</label><graphic position="anchor" xlink:href="4-1040202\31cb8922-9a27-4978-a50b-aa5828850ab5.jpg"  xlink:type="simple"/></disp-formula><p>where <img src="4-1040202\8fea4fa3-d049-438c-884a-f58a1ebfcb0c.jpg" /> and <img src="4-1040202\32953c5e-0ab4-4bdf-a887-2b9b08c472ee.jpg" /> is the identity matrix of size<img src="4-1040202\ed2d0424-2759-4da1-973c-87186c02650a.jpg" />.</p><p>By recursively operating the USCA on the data of the IPTN presented in Section 2.1 above, a 5-levels hierarchical structure of the system is constructed which contains the complete system at the top and individual elements at the bottom (the top panel of <xref ref-type="fig" rid="fig2"><xref ref-type="fig" rid="fig">Figure </xref>2</xref> gives out the structure of the hierarchy, detailed in the first 3 levels).</p></sec><sec id="s2_3"><title>2.3. Hierarchical Modeling of the Network</title><p>Based on the hierarchy structure resulting from the successive application of USCA, artificial networks can be</p><p><xref ref-type="table" rid="table1">Table 1</xref>. Unsupervised spectral clustering algorithm.</p><p>defined at each layer. The artificial network at level l of the hierarchy is described as a graph <img src="4-1040202\b8d058cd-6042-4b95-ad6c-77ef261331fb.jpg" /> with<img src="4-1040202\db59deb8-7b0b-4105-8a40-d508b2a8b647.jpg" />, where<img src="4-1040202\507c90df-ba52-406f-accf-5185a0ba8b20.jpg" />is the number of levels of the hierarchy. We use <img src="4-1040202\0b0a90df-27c7-49db-9ae7-e179648e9b1a.jpg" /> to represent the artificial node i</p><p><img src="4-1040202\e2593b42-ad50-485d-901b-7897492d2c56.jpg" />at level l, which corresponds to a cluster of real network nodes. Artificial nodes are connected by artificial links</p><p><img src="4-1040202\aa9eb435-9d92-4d80-b317-81832b55f09f.jpg" />composed by those actual network links connecting (in parallel) the actual nodes in the clusters forming the artificial nodes,</p><p><img src="4-1040202\69092bf4-ff27-471f-8acc-32f17e6971c7.jpg" />.</p><p>The connection pattern between artificial nodes at level l is illustrated by an adjacency matrix <img src="4-1040202\4b612a43-21e3-4f59-9397-d8af0ad06774.jpg" />whose element</p><p><img src="4-1040202\f95d1584-4a5e-4889-8166-803abf60f36f.jpg" />if<img src="4-1040202\3be94c24-e0e1-4fdd-86f5-cc56ddb72441.jpg" />i.e. if in the artificial nodes <img src="4-1040202\83fdbe80-4487-4091-ae79-1d05eaf65aca.jpg" /> and <img src="4-1040202\b53f147f-1c0d-4c3d-9ea4-8d61b8179258.jpg" /> there is at least one actual link connecting two actual nodes, and 0 otherwise.</p><p><xref ref-type="fig" rid="fig2"><xref ref-type="fig" rid="fig">Figure </xref>2</xref> presents the hierarchy structure of the IPTN system and the artificial networks associated with the first 3 levels of the hierarchy. At the top of the hierarchy (i.e. l = 1), the network is a single unit, i.e. one artificial node<img src="4-1040202\a3422137-9fea-4834-aba6-8e63ac701b2a.jpg" />, which consist of all actual nodes. At the second level<img src="4-1040202\ca636138-1536-40a3-b154-f24fa31671c3.jpg" />, we have</p><p><img src="4-1040202\8a1ef5e8-cc77-4e15-85a2-f08b000fddba.jpg" /></p><p>and <img src="4-1040202\125a21f4-8802-4139-8e16-cb5332b5b8c1.jpg" /></p><p>with<img src="4-1040202\38709070-32a9-4a92-b441-7fe119bcbc03.jpg" />.</p><p>The integer that is indicated in the <xref ref-type="fig" rid="fig">Figure </xref>in proximity of the generic i-th artificial node <img src="4-1040202\6d640ab7-761b-432b-8b1c-6f68550bb2ed.jpg" /> indicates the number of actual nodes which compose it, e.g. <img src="4-1040202\41e21be4-da99-4bd4-b516-5c1a4be12db7.jpg" />is representative of a group of 38 actual network nodes. Note that at the bottom of the hierarchy, we find the original network, i.e. each artificial node is an actual node and each artificial edge corresponds to an actual link.</p><p>The hierarchical model offers different levels of resolution at the different levels of the hierarchy. The artificial networks at the top of the hierarchy contain limited detail information of the local connectivity patterns (in the limit, only one node represents the whole network at the first level of the hierarchy); as we move down the hierarchy, more local information enters the model, at the expense of an increase in the dimension of the network. These characteristics can be leveraged efficiently to manage the complexity of a complex network system.</p></sec></sec><sec id="s3"><title>3. Reliability Analysis Based on the Hierarchical Model</title><p>It is known that most network reliability problems are NP-hard and therefore there is a significant gap between theoretical analysis and the ability to compute different reliability parameters for large or even moderate network systems [<xref ref-type="bibr" rid="scirp.27537-ref11">11</xref>]. In this respect, hierarchical modeling sets up a framework based on which reliability and vulnerability characteristics of complex network systems can be computed efficiently, thanks to the multi-scaled information representation scheme.</p><sec id="s3_1"><title>3.1. Terminal-Pairs Reliability Assessment</title><p>The terminal-pair or node-pair reliability (TPR) problem amounts to determining the probability of successful communication between a specified source node and a terminal node in a network, given the probability of success of each link and node in the network. Let us introduce a binary vector <img src="4-1040202\944aa0db-e89d-4806-82f4-e482893f96b2.jpg" /> to represent the state of the network, i.e. the state <img src="4-1040202\066ea767-073f-43a3-96ce-07437684d5db.jpg" />of each of its <img src="4-1040202\27f7b6e5-89d4-4d18-8526-c2d68fd2688f.jpg" /> edges and the state <img src="4-1040202\fc48403f-0c69-4124-944c-2353e3f61273.jpg" /> of each of its <img src="4-1040202\6d3fef59-42bd-4240-94d6-362c0ebbc573.jpg" /> nodes, where <img src="4-1040202\e8fe72b4-5635-473c-9eae-9d43ba6a20c6.jpg" /> if edge <img src="4-1040202\81f87074-a472-4173-888a-23531e761f2f.jpg" /> is operating and 0 otherwise (<img src="4-1040202\cc92e140-0b8f-4ccd-bc1b-e735c80671fa.jpg" />for node). For simplicity of illustration, we assume that nodes cannot fail, while edges can (thus <img src="4-1040202\59457506-1a8b-4c6d-865a-112475ef8289.jpg" /> is no longer considered hereafter). The state of the network is defined as being non-failure if the specified terminal-pair is connected by at least one path of operating edges; otherwise it is failure. All possible failure states are included in the subset <img src="4-1040202\317bab19-978a-43aa-9f86-018fea332b4a.jpg" /> of the set <img src="4-1040202\cc167afa-2152-4bd0-9fb9-7a33589607d4.jpg" /> containing all possible scenarios (failure and non-failure). An inclusive TPR analysis requires considering all elements in<img src="4-1040202\81d47408-11bc-43b3-a0cb-e2fdea51c51a.jpg" />. We then define the TPR as:</p><disp-formula id="scirp.27537-formula89460"><label>(3)</label><graphic position="anchor" xlink:href="4-1040202\5beb3f9d-e2a1-404e-aed1-bf09dd91c3f2.jpg"  xlink:type="simple"/></disp-formula><p>where <img src="4-1040202\ac53c095-c5a2-4025-b1a0-3665045de890.jpg" /> &#160;is a binary function which indicates the connection availability between node-pair s and d (1 = connection; 0 = no-connection). Let us assume that each edge <img src="4-1040202\07443c41-ed4d-4cdd-8f90-04ab8d1754a8.jpg" /> has associated a probability <img src="4-1040202\7da079e5-3bbb-4591-acf8-1d1f80726179.jpg" /> of being operating and a probability <img src="4-1040202\962e23d8-6efa-416b-a205-f5348569676f.jpg" /> of being failed; then, the TPR of the network can be calculated as:</p><disp-formula id="scirp.27537-formula89461"><label>(4)</label><graphic position="anchor" xlink:href="4-1040202\18ed31bb-33a2-49ee-b2fa-99caa2e57f2a.jpg"  xlink:type="simple"/></disp-formula><p>where <img src="4-1040202\7a723a99-ba60-4e19-a37b-8ca98f0099b8.jpg" /> represents the state of network edge <img src="4-1040202\c554dd62-a2a1-498e-817c-2da8e85b32d1.jpg" /> and <img src="4-1040202\33cb4721-2645-4bc0-ad9c-4026a1559b2b.jpg" /> is the set of failed edges for a given state<img src="4-1040202\44529f67-e5bf-43fa-bce1-3073b007fc6d.jpg" />. Note that the implicit assumption underpinning Equation (4) is that the network edges are independent.</p><p>When the computational cost of the network is high (it grows exponentially with the number of network components), then, the artificial network at a suitable level of the hierarchy can be leveraged to carry out the TPR. At the generic level of the hierarchy, the artificial link <img src="4-1040202\9bfd2da7-b7c5-49e8-9bdd-6b347a4602b4.jpg" /> connecting nodes (clusters) <img src="4-1040202\b7d36ddb-79e5-4191-b6ab-37bb2693c5e0.jpg" />and <img src="4-1040202\8627b63b-2d92-4d20-96b4-6946034c9895.jpg" /> is composed by actual network links in parallel,</p><p><img src="4-1040202\c0a89ddd-5827-41e8-8311-c4c5e32060d5.jpg" />;</p><p>then, the reliability of the artificial edge <img src="4-1040202\126bb7bb-4710-4baa-b391-816565ca9066.jpg" /> at level l can be calculated by:</p><disp-formula id="scirp.27537-formula89462"><label>(5)</label><graphic position="anchor" xlink:href="4-1040202\6bfae8bc-d641-40a0-99dd-5e854f5e3ce3.jpg"  xlink:type="simple"/></disp-formula><p>where <img src="4-1040202\593a546d-158a-4b96-a631-7f3bcbb4fa2b.jpg" /> indicates the failure probability of the actual link <img src="4-1040202\9d526398-9ae4-425f-b96f-09fc7ae81fc0.jpg" />that in the real network connects nodes <img src="4-1040202\f3f69d6f-21b6-4795-b070-07615c6c5ddc.jpg" /> and<img src="4-1040202\a7d7b799-0936-4db0-a26c-8d6d5b511604.jpg" />.</p><p>Various algorithms to solve the classic TPR problem have been reported in literature, with various computational efficiencies [29-31]. A so-called Modified Dotson algorithm [<xref ref-type="bibr" rid="scirp.27537-ref30">30</xref>], which has been claimed and tested to subdue others in computational time, is used here for the TPR assessment based on the hierarchical modeling. The failure probability of the transmission lines in the IPTN system is computed based on outage statistics provided in [<xref ref-type="bibr" rid="scirp.27537-ref32">32</xref>], by assuming that the edge failure probability is proportional to its length with an average failure rate <img src="4-1040202\5330005a-ca30-4950-aebd-c1356cf5ea67.jpg" /> occ/100 mile-year, and average outage duration time t = 64.81 hours/occ.</p><p>In <xref ref-type="fig" rid="fig">Figure </xref>3 right-panel, the connection reliability between nodes 1 and 127 in the IPTN network system (left panel in <xref ref-type="fig" rid="fig">Figure </xref>3) is shown as resulting from evaluations at each of the five levels of the hierarchical model described in the previous section. The right panel of <xref ref-type="fig" rid="fig">Figure </xref>3 gives the probabilities of connectivity failure between nodes 1 and 127 from level 2 to level 5 (top) and</p><p>the computational time needed for the analysis (bottom); the values have been normalized with respect to the maximum values of connectivity failure probability and computational time, which occur at the bottom of the hierarchy (level 5) corresponding to the whole network. The result at the first level has not been shown since its value is simply 0, i.e., node 1 and 127 are in a single unit and will not disconnect. One can see that the difference between the actual and estimated failure probabilities decreases as the assessment moves downs to the bottom of the hierarchy, balanced by the computation time which instead increases significantly. The decision maker can obtain satisfying estimations of the failure probability at a hierarchical level of lower complexity, e.g. level 3, thus saving significantly in computation time.</p></sec><sec id="s3_2"><title>3.2. Component Extended Importance Measures</title><p>Component importance measures are widely used in system engineering to identify components within the system that most significantly influence the system behavior with respect to reliability, risk and/or safety. The indications drawn are valuable for establishing direction and prioritization of actions, related to reliability improvement during system design and optimization of operation and maintenance.</p><p>A well known IM is the so called Birnbaum IM defined as (with reference to system reliability<img src="4-1040202\548eecce-d298-45d9-83d2-9a7126eba007.jpg" />, as the system performance indicator) [<xref ref-type="bibr" rid="scirp.27537-ref14">14</xref>]:</p><disp-formula id="scirp.27537-formula89463"><label>(6)</label><graphic position="anchor" xlink:href="4-1040202\d546fca9-fa7a-471a-a3ce-80595799ad58.jpg"  xlink:type="simple"/></disp-formula><p>where <img src="4-1040202\8978eb90-d9de-48de-995f-31d9c5545ca4.jpg" /> is the Birnbaum Importance (BI) of component i; <img src="4-1040202\deeb4d3d-184a-4160-aeaa-0f7b6d6559c7.jpg" />represents the reliability of the system; <img src="4-1040202\5c024958-c6a0-4da5-89ba-b1e21e98d665.jpg" />is the reliability of component i ; <img src="4-1040202\5d5c3e49-c16a-4e6c-8054-aa8684424934.jpg" />is the system reliability calculated assuming that component i is perfectly operating and <img src="4-1040202\4d4e1663-5691-4a48-baa7-bc851b14aaac.jpg" /> the system reliability in the opposite case of component i failed. The BI measures the significance of component i to system reliability by the rate at which system reliability improves with the reliability of component i. As shown in Equation (6), the BI of component i does not depend on <img src="4-1040202\95a2b68c-5882-4c9c-9d1e-0acee85065bf.jpg" /> itself, so that two components i and j may have a similar value <img src="4-1040202\7a6939f4-346b-4c37-a753-b007787b1c44.jpg" /> although they have different reliability values <img src="4-1040202\27d4ea7d-ef40-4c23-a21e-7ffcdff0e988.jpg" /> and<img src="4-1040202\bce2c455-a3fa-4745-a113-ac08aa4b29b6.jpg" />, respectively; this could be seen as a limitation of BI.</p><p>The Criticality Importance (CI) measure overcomes the above limitation by considering component unreliability [<xref ref-type="bibr" rid="scirp.27537-ref17">17</xref>]. It is defined as:</p><disp-formula id="scirp.27537-formula89464"><label>(7)</label><graphic position="anchor" xlink:href="4-1040202\11d53a77-8ab6-46a9-b5f3-51daafdb0549.jpg"  xlink:type="simple"/></disp-formula><p>where <img src="4-1040202\f54a49a8-3931-47c8-b70e-80688529793d.jpg" /> is the unreliability of component i and <img src="4-1040202\df6428c0-6e77-44e7-a95a-3a3ad7f1e894.jpg" /> is the system unreliability. Now, a less reliable component is more critical than another one with same value of BI.</p><p>Fuessell &amp; Vesely [<xref ref-type="bibr" rid="scirp.27537-ref15">15</xref>] proposed an alternative importance measure according to which the importance of a component in the system depends on the number and on the order of the cut sets in which it appears [<xref ref-type="bibr" rid="scirp.27537-ref17">17</xref>]. Most commonly used as a risk reduction indicator, Fuessell &amp; Vesely Importance (FVI) quantifies the maximum decrement in system reliability caused by a particular component being failed<img src="4-1040202\d65441ee-6aee-4ce0-8ded-84c5bade5ffe.jpg" />:</p><disp-formula id="scirp.27537-formula89465"><label>(8)</label><graphic position="anchor" xlink:href="4-1040202\4b96bf96-ba65-4850-8aca-f89b765d86b4.jpg"  xlink:type="simple"/></disp-formula><p>The previously proposed IMs (BI, CI and FVI) are functionally different. They evaluate subtly different properties of the system behavior, and therefore, are often used in a complementary fashion to infer different information. To apply the IMs for analyzing a network system such as the IPTN, it is necessary to extend the definition of the IMs to account for the multiple terminal or node pairs (e.g. generator-distributor pairs) where connectivity defines the network functionality.</p><p>Specializing such extension for the analysis of the importance of components of the IPTN system, we introduce the Extended Birnbaum Importance (EBI) measure as the average of all BI values obtained considering all possible Generator-Distributor pairs reliabilities in the network system:</p><disp-formula id="scirp.27537-formula89466"><label>(9)</label><graphic position="anchor" xlink:href="4-1040202\1cbe9e36-46dd-4712-91ae-ec0f007e7ce0.jpg"  xlink:type="simple"/></disp-formula><p>where <img src="4-1040202\eae40103-bddc-4d8a-b3fb-4c72c5ebdeba.jpg" /> and <img src="4-1040202\d85ec247-cb5c-4f93-bf0d-0c1c9f1351bd.jpg" /> are the number of generators and distributors in the network respectively; <img src="4-1040202\d929971b-47cc-44b0-b630-efce1971226e.jpg" />and <img src="4-1040202\0bb9104f-1174-4f7d-a5b4-95e320d66dc7.jpg" /> are sets of node generators and distributors respectively; <img src="4-1040202\9b03ba9b-b6de-467b-8b11-7bdd3fb16211.jpg" />is the TPR between node s and node d; <img src="4-1040202\668d7426-fae3-4a63-ba82-5be5f63583e6.jpg" />and <img src="4-1040202\93f82ce3-fda6-464e-bbd3-cd51b42d64ec.jpg" />represent the terminal pair reliabilities between node s and node d, in the condition that component i is perfectly operating and completely failed, respectively.</p><p>Similarly, we can define Extended Criticality Importance (ECI) and Extended Fussell &amp; Vesely Importance (EFVI) measures:</p><disp-formula id="scirp.27537-formula89467"><label>(10)</label><graphic position="anchor" xlink:href="4-1040202\f352b645-06d1-4183-942a-bf6e07ed5b25.jpg"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.27537-formula89468"><label>(11)</label><graphic position="anchor" xlink:href="4-1040202\9619f0f9-2023-47e1-a4d3-3cb746f3ff6f.jpg"  xlink:type="simple"/></disp-formula><p>where <img src="4-1040202\d5fc45ea-1c51-4f69-8041-b890cdb1ef52.jpg" /> is the Extended Criticality Importance (ECI) measure of component i and <img src="4-1040202\e2ddbc51-c878-4a9f-a66f-7abd54bc9473.jpg" /> is the Extended Fussell &amp; Vesely Importance measure.</p></sec><sec id="s3_3"><title>3.3. Numerical Example: Results and Discussions</title><p>The EIMs introduced have been calculated for the IPTN system at different levels of the hierarchical model of the system developed. For the evaluation, an artificial node functions as a generator as long as there is at least one actual generator node within it; otherwise it is simply a distributor.</p><p>Tables 2 and 3 report the results of the importance assessment (EBI, EFVI are given in <xref ref-type="table" rid="table2">Table 2</xref> and ECI in <xref ref-type="table" rid="table3">Table 3</xref>) for the artificial edges of the network at level 2 of the hierarchy. For EBI and EFVI, all components in the artificial network have the same importance rank, but with slight differences between EBI and EFVI values, and the artificial edge {2-4} is the most important in the artificial network (see the bottom panel of <xref ref-type="fig" rid="fig2"><xref ref-type="fig" rid="fig">Figure </xref>2</xref>). This is due to the fact that this artificial edge is the only possible link between a generator in artificial node <img src="4-1040202\01b4000d-057d-4b36-935e-a93d69ea4d9e.jpg" /> and the distributors in other artificial nodes, and thus its disconnection would cause a large-scale generator-distributor connectivity failure. The rank based on the ECI is different from that of EBI and EFVI, and the most important artificial edge is {3-4}; the difference lies in the definition, as discussed before: EBI depends only on the structure of the system and not on the reliability of the considered component, whereas ECI takes the unreliability of the component into consideration, and in fact, the artificial edge {3-4} is made of only one actual edge with relatively high probability of failure, which leads to the highest ECI value.</p><p>By combining the indications of EBI and ECI, it is advisable to offer advices to the decision maker for the purpose of system maintenance and operation optimization [<xref ref-type="bibr" rid="scirp.27537-ref10">10</xref>]. When EBI &amp; EFVI is high and ECI is low like in the case of artificial edge {2-4}, the system safety can be improved by protecting against failure of each component, e.g., adding alternative edges between artificial node <img src="4-1040202\ec20bad0-0ac5-49a7-aa53-c58b5e4418a8.jpg" /> and node <img src="4-1040202\8e8dfae8-9c6e-427b-bffa-e444578b1b70.jpg" /> (or<img src="4-1040202\88eafe58-0496-4dd9-b3d5-b07f585dfd25.jpg" />). For the case of low EBI &amp; EFVI and high ECI (artificial edge {3-4}), the decision maker should invest in improvements of the component itself, to decrease the failure probability.</p><p>Tables 4 and 5 report the evaluation results at level 3 of the hierarchy. Fictitious edge {4-9}, composed by actual edges {110-111, 112-114, 107-109}, has highest EBI and EFVI values but relatively low ECI value (ranked 15th among all 17 artificial edges), indicating that the system reliability is highly sensitive to its failure, whereas the component itself is relatively reliable. On the contrary, the artificial edge {1-10} composed by only one actual edge {64-78} is highly unreliable itself, and its EBI and EFVI values are both ranked 8th among all 17 edges. It is important to pay attention to these artificial edges with both relatively high EBI &amp; EFVI ranks and ECI ranks, which means not only that their failures cause a significant deterioration of the system reliability but also that they are vulnerable themselves. In this respect, by combining Tables 4 and 5, we find that artificial edges {1-11} (whose actual network link is {71-83}), {6-10} (which is composed by actual link {76-79}), and {10-12} (which is composed by actual links {75-88, 80-95}) are the three artificial edges most critical for the system reliability.</p><p>The bold edges in <xref ref-type="fig" rid="fig">Figure </xref>4 represent the edges of the actual network system which have resulted most critical based on the extended importance measure evaluation carried out at level 3 of the hierarchy model. These edges should be paid special attention. For links {110-111, 112-114, 107-109}, improving the defense in depth against</p><p><xref ref-type="table" rid="table2">Table 2</xref>. EBI and EFVI at level 2 of the hierarchical model.</p><p><img src="4-1040202\7c8010e5-ce5e-4817-a529-a8f44aaeef5b.jpg" /></p><p><xref ref-type="table" rid="table3">Table 3</xref>. ECI at level 2 of the hierarchical model.</p><p><img src="4-1040202\39ca9e25-fdf3-4ee8-b22a-e6ddadce769b.jpg" /></p><p><xref ref-type="table" rid="table4">Table 4</xref>. EBI and EFVI at level 3 of the hierarchical model.</p><p><xref ref-type="table" rid="table5">Table 5</xref>. The results of ECI assessment at level 3 of the hierarchical model.</p><p><img src="4-1040202\83dd6d8f-c3c9-4e05-8b77-ee2c40b46911.jpg" /></p><p>their failures is advisable to improve the reliability of the system, while for links {64-78, 71-83, 76-79, 80-95, 75-88}, the edge unreliability should also be mitigated.</p><p>Tables 6 and 7 report the results of the EIMs evaluation at level 4 of the IPTN hierarchical model. It turns out that artificial edge {7-11} (corresponding to actual link {119-122}) has the highest EBI and EFVI values and artificial edge {1-22} (corresponding to actual link {64-78}) has the highest ECI rank and relatively high EBI and EFVI ranks, indicating its criticality to system reliability.</p><p>Finally, <xref ref-type="table" rid="table8">Table 8</xref> reports the computation times required for the calculations of the EIMs at different levels in the hierarchy: as expected, the more we go down in the hierarchy the higher the computation time.</p></sec></sec><sec id="s4"><title>4. Conclusions</title><p>The modeling and analysis of complex network systems is a non-trivial task. Related decision-making regarding reliability and vulnerability is limited by computational resources.</p><p>In this work, we have introduced a framework for hierarchical modeling of complex network systems, which leads to the definition of different varied-size grained artificial networks. The construction of the hierarchical model is obtained by a recursive unsupervised spectral clustering method. The hierarchical model thereby obtained provides a multi-scaled representation of the original network system, with more detailed information but high complexity at the lower levels of the hierarchy, and simplified structure but relatively low complexity at the higher levels. The availability of different scales of modeling resolution allows a flexible management of the analysis, at the level of details desired for its purposes. The 380 kV Italian Power Transmission Network (IPTN) has been taken as an illustration.</p><p>Furthermore, Importance Measures (IMs) such as Birnbaum, Fuessell &amp; Vesely and Criticality, have been extended for application to the terminal-pair reliability problem in complex distributed network systems.</p><p>The calculation of the extended IMs at different levels of the hierarchical system modeling has demonstrated the effectiveness of the proposed hierarchical modeling, with the IM-ranking of the IPTN elements offering insights on how to improve the system against failures of most critical elements.</p></sec><sec id="s5"><title>5. Acknowledgements</title><p>The authors are thankful to Dr. Giovanni Sansavini of Politecnico di Milano for supporting the work with rele-</p><p><xref ref-type="table" rid="table6">Table 6</xref>. EBI and EFVI at level 4 of the hierarchical model (only the top 20 elements are reported).</p><p><img src="4-1040202\ca9aba5f-b232-4439-9bc7-ca721c1d41f2.jpg" /></p><p><xref ref-type="table" rid="table7">Table 7</xref>. ECI at level 4 of the hierarchical model (only the top 20 elements are reported).</p><p><img src="4-1040202\ae226716-4688-4f94-aa0a-18ae9827c900.jpg" /></p><p><xref ref-type="table" rid="table8">Table 8</xref>. EIMs evaluation time at each level of the hierarchical model.</p><p><img src="4-1040202\c3c219e5-edd7-473a-a7d9-86a59aa32138.jpg" /></p><p>vant information on the network structure used as reference system and to Dr. Yanfu Li of Supelec for fruitful discussions.</p></sec><sec id="s6"><title>REFERENCES</title></sec></body><back><ref-list><title>References</title><ref id="scirp.27537-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">W. Kroger, “Critical Infrastructures at Risk: A Need for a New Conceptual Approach and Extended Analytical Tools,” Reliability Engineering &amp; System Safety, Vol. 93, No. 12, 2008, pp. 1781-1787.  
doi:10.1016/j.ress.2008.03.005</mixed-citation></ref><ref id="scirp.27537-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">E. Zio, “Reliability Engineering: Old Problems and New Challenges,” Reliability Engineering &amp; System Safety, Vol. 94, No. 2, 2009, pp. 125-141.  
doi:10.1016/j.ress.2008.06.002</mixed-citation></ref><ref id="scirp.27537-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">W. Kroger and E. Zio, “Vulnerable Systems,” Springer, Berlin, 2011. doi:10.1007/978-0-85729-655-9</mixed-citation></ref><ref id="scirp.27537-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">A. Mason, J. Onnela and P. Mucha, “Communities in Networks,” Notices of the American Mathematical Society, Vol. 56, No. 9, 2009, pp. 1082-1166.</mixed-citation></ref><ref id="scirp.27537-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">S. Fortunato, “Community Detection in Graphs,” Physics Reports, Vol. 486, No. 3, 2010, pp. 75-174.  
doi:10.1016/j.physrep.2009.11.002</mixed-citation></ref><ref id="scirp.27537-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">B. Karrer, E. Levina and M. Newman, “Robustness of Community Structure in Networks,” Physical Review E, Vol. 77, No. 4, 2008, Article ID: 046119.  
doi:10.1103/PhysRevE.77.046119</mixed-citation></ref><ref id="scirp.27537-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">A. Clauset, C. Moore and M. E. J. Newman, “Hierarchical Structure and the Prediction of Missing Links in Networks,” Nature, Vol. 453, No. 7191, 2008, pp. 98-101.  
doi:10.1038/nature06830</mixed-citation></ref><ref id="scirp.27537-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">M. Sales-Pardo, R. Guimerá, A. Moreira, A. Moreira and L. A. N. Amaral, “Extracting the Hierarchical Organization of Complex Systems,” Proceedings of the National Academy of Sciences, Vol. 104, No. 39, 2007, pp. 15224-15229. doi:10.1073/pnas.0703740104</mixed-citation></ref><ref id="scirp.27537-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">C. Gómez, M. Sánchez-Silva and L.Duenas-Osorio, “Clustering Methods for Risk Assessment of Infrastructure Network Systems,” In: Faber, Kohler and Nishijima, Eds., Applications of Statistics and Probability in Civil Engineering, CRC Press, Boca Raton, 2011.</mixed-citation></ref><ref id="scirp.27537-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">M. Van der Borst and H. Schoonakker, “An Overview of PSA Importance Measures,” Reliability Engineering &amp; System Safety, Vol. 72, No. 3, 2001, pp. 241-245.  
doi:10.1016/S0951-8320(01)00007-2</mixed-citation></ref><ref id="scirp.27537-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">I. Gertsbakh and Y. Shpungin, “Network Reliability Importance Measures: Combinatorics and Monte Carlo Based Computations,” WSEAS Transactions on Computers, Vol. 7, No. 4, 2008, pp. 216-227.</mixed-citation></ref><ref id="scirp.27537-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">E. Zio, “Computational Methods for Reliability and Risk Analysis,” World Scientific Publishing, Singapore, 2009.  
doi:10.1142/7190</mixed-citation></ref><ref id="scirp.27537-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">E. Zio, “Risk Importance Measures,” In: Safety and Risk Modeling and its Applications, Springer, Berlin, 2011.</mixed-citation></ref><ref id="scirp.27537-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">Z. W. Birnbaum, “On the Importance of Different Components in a Multicomponent System,” In: P. R. Krishnaiah, Ed., Multivariate Analysis II, Academic Press, New York, 1969.</mixed-citation></ref><ref id="scirp.27537-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">J. B. Fussell, “How to Hand-Calculate System Reliability and Safety Characteristics,” IEEE Transactions on Reliability, Vol. 24, No. 3, 1975, pp. 169-174.  
doi:10.1109/TR.1975.5215142</mixed-citation></ref><ref id="scirp.27537-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">M. C. Cheok, W. P. Gareth and R. Sherry, “Use of Importance Measures in Risk-informed Regulatory Applications,” Reliability Engineering &amp; System Safety, Vol. 60, No. 3, 1998, pp. 213-226.  
doi:10.1016/S0951-8320(97)00144-0</mixed-citation></ref><ref id="scirp.27537-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">J. F. Espiritu, D. W. Coit and U. Prakash, “Component Criticality Importance Measures for the Power Industry,” Electric Power Systems Research, Vol. 77, No. 5, 2007, pp. 407-420. doi:10.1016/j.epsr.2006.04.003</mixed-citation></ref><ref id="scirp.27537-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">V. Latora and M. Marchiori, “Economic Small-World Behavior in Weighted Networks,” The European Physical Journal B—Condensed Matter and Complex Systems, Vol. 32, No. 2, 2003, pp. 249-263.  
doi:10.1140/epjb/e2003-00095-5</mixed-citation></ref><ref id="scirp.27537-ref19"><label>19</label><mixed-citation publication-type="other" xlink:type="simple">U. Brandes and T. Erlebach, “Network Analysis: Methodological Foundations,” Springer, Berlin, 2005.</mixed-citation></ref><ref id="scirp.27537-ref20"><label>20</label><mixed-citation publication-type="other" xlink:type="simple">E. Zio and G. Sansavini, “Component Criticality in Failure Cascade Processes of Network Systems,” Risk Analysis, Vol. 31, No. 8, 2011, pp. 1196-1210.  
doi:10.1111/j.1539-6924.2011.01584.x</mixed-citation></ref><ref id="scirp.27537-ref21"><label>21</label><mixed-citation publication-type="other" xlink:type="simple">V. Rosato, S. Bologna and F. Tiriticco “Topological Properties of High-Voltage Electrical Transmission Networks,” Electric Power Systems Research, Vol. 77, No. 2, 2007, pp. 99-105. doi:10.1016/j.epsr.2005.05.013</mixed-citation></ref><ref id="scirp.27537-ref22"><label>22</label><mixed-citation publication-type="other" xlink:type="simple">E. Ravasz and B. Albert-László, “Hierarchical Organization in Complex Networks,” Physical Review E, Vol. 67, No. 2, 2003, Article ID: 026112.  
doi:10.1103/PhysRevE.67.026112</mixed-citation></ref><ref id="scirp.27537-ref23"><label>23</label><mixed-citation publication-type="other" xlink:type="simple">Von Luxburg and Ulrike, “A Tutorial on Spectral Clustering,” Statistics and Computing, Vol. 17, No. 4, 2007, pp. 395-416. doi:10.1007/s11222-007-9033-z</mixed-citation></ref><ref id="scirp.27537-ref24"><label>24</label><mixed-citation publication-type="other" xlink:type="simple">A. K. Jain, M. Narasimha Murty and P. J. Flynn, “Data Clustering: A Review,” ACM Computing Surveys, Vol. 31, No. 3, 1999, pp. 264-323.</mixed-citation></ref><ref id="scirp.27537-ref25"><label>25</label><mixed-citation publication-type="other" xlink:type="simple">M. Filippone, F. Camastra, F. Masulli and S. Rovetta, “A Survey of Kernel and Spectral Methods for Clustering,” Pattern Recognition, Vol. 41, No. 1, 2008, pp. 176-190.  
doi:10.1016/j.patcog.2007.05.018</mixed-citation></ref><ref id="scirp.27537-ref26"><label>26</label><mixed-citation publication-type="other" xlink:type="simple">S. E. Schaeffer, “Graph Clustering,” Computer Science Review, Vol. 1, No. 1, 2007, pp. 27-64.  
doi:10.1016/j.cosrev.2007.05.001</mixed-citation></ref><ref id="scirp.27537-ref27"><label>27</label><mixed-citation publication-type="other" xlink:type="simple">S. Leguizemón, H. Pelgrum and S. Azzali, “Unsupervised Fuzzy C-means Classification for the Determination of Dynamically Homogeneous Areas,” Revista SELPER, Vol. 12, No. 12, 1996, pp. 20-24.</mixed-citation></ref><ref id="scirp.27537-ref28"><label>28</label><mixed-citation publication-type="other" xlink:type="simple">M. Alata, M. Molhim and A. Ramini, “Optimizing of Fuzzy C-Means Clustering Algorithm Using GA,” World Academy of Science, Engineering and Technology, Vol. 1, No. 5, 2008, pp. 224-229.</mixed-citation></ref><ref id="scirp.27537-ref29"><label>29</label><mixed-citation publication-type="other" xlink:type="simple">W. Dotson and J. Gobien, “A New Analysis Technique for Probabilistic Graphs,” IEEE Transactions on Circuits and Systems, Vol. 26, No. 10, 1979, pp. 855-865.  
doi:10.1109/TCS.1979.1084573</mixed-citation></ref><ref id="scirp.27537-ref30"><label>30</label><mixed-citation publication-type="other" xlink:type="simple">Y. B. Yoo and N. Deo., “A Comparison of Algorithms for Terminal-pair Reliability,” IEEE Transactions on Reliability, Vol. 37, No. 2, 1988, pp. 210-215.</mixed-citation></ref><ref id="scirp.27537-ref31"><label>31</label><mixed-citation publication-type="other" xlink:type="simple">C.-C. Jane, W.-H. Shen and Y.-W. Laih, “Practical Sequential Bounds for Approximating Two-Terminal Reliability,” European Journal of Operational Research, Vol. 195, No. 2, 2009, pp. 427-441.  
doi:10.1016/j.ejor.2008.02.022</mixed-citation></ref><ref id="scirp.27537-ref32"><label>32</label><mixed-citation publication-type="other" xlink:type="simple">A. A. Chowdhury and D. O. Koval, “High Voltage Transmission Equipment Forced Outage Statistics Including Different Fault Types,” Proceedings of the 10th International Conference on Probabilistic Methods Applied to Power Systems, 25-29 May 2008, pp.1-8, 25-29.</mixed-citation></ref></ref-list></back></article>