<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">SGRE</journal-id><journal-title-group><journal-title>Smart Grid and Renewable Energy</journal-title></journal-title-group><issn pub-type="epub">2151-481X</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/sgre.2018.910014</article-id><article-id pub-id-type="publisher-id">SGRE-88227</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Earth&amp;Environmental Sciences</subject><subject> Engineering</subject></subj-group></article-categories><title-group><article-title>
 
 
  Development of a Model Driven ACSI Conformance Testing for IEC 61850-Based IED
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Byungtae</surname><given-names>Jang</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Alidu</surname><given-names>Abubakari</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Namdae</surname><given-names>Kim</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib></contrib-group><aff id="aff1"><addr-line>Power System Technology Group, Korea Electric Power Corporation (KEPCO), Daejeon, South Korea</addr-line></aff><pub-date pub-type="epub"><day>19</day><month>10</month><year>2018</year></pub-date><volume>09</volume><issue>10</issue><fpage>215</fpage><lpage>236</lpage><history><date date-type="received"><day>2,</day>	<month>October</month>	<year>2018</year></date><date date-type="rev-recd"><day>28,</day>	<month>October</month>	<year>2018</year>	</date><date date-type="accepted"><day>31,</day>	<month>October</month>	<year>2018</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  Globally, traditional power systems are rapidly transforming towards the adoption of smart grid platforms. Substations which are at the center of the electric power transformation from the power plant are changing to IEC 61850 based digital substations. Therefore, within substation, there is a growing demand for the IEC 61850 based Intelligent Electronic Devices (IEDs). The operation of multiple manufacturers of IEDs in a single digital substation network increases the need for IEC 61850 communications specification conformance diagnosis to ensure interoperability for efficient data exchange between IEDs. The IEC 61850-10 presents test items for diagnosing communication specification conformance. There are many test tools available in the market today to test the compliance of the IEC 61850 communications specifications to the IED. In this paper, we propose a model-based diagnostic method for IED communication conformance testing. The proposed model-based software therefore uses the “drag and drop” technique to select the various IEC 61850 communication services (objects) required to design the test case in a user friendly Graphical User Interface (GUI). This makes the service conformance testing more flexible for test engineers and system integrators especially in situations that require test case modifications. Also, the proposed software tool makes it easy to understand the various IEC 61850 services using the friendly GUI.
 
</p></abstract><kwd-group><kwd>IEC 61850</kwd><kwd> Intelligent Electronic Devices (IEDs)</kwd><kwd> Conformance Testing</kwd><kwd> Model-Based Tool</kwd><kwd> Client-Server Communication</kwd><kwd> Digital Substation Network</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. General Introduction</title><p>Electric power flows through several transmission and/or distribution substations from the generation source to the end consumer. An electrical substation is a node in a power system network where voltage is transformed from high to low or vice versa using transformers. It comprises of primary or field equipment, such as bus bars, switches, switch yard instrument transformers electrical cable lines etc. The control, protection and constant monitoring of these primary devices are conducted using an integrated mechanism known as the Substation Automation (SA) System [<xref ref-type="bibr" rid="scirp.88227-ref1">1</xref>] [<xref ref-type="bibr" rid="scirp.88227-ref2">2</xref>] [<xref ref-type="bibr" rid="scirp.88227-ref3">3</xref>] . The SA System consists of micro-processor based secondary device known as an IED (server) which monitors, measures and collects data from the primary equipment via a process bus interface. The collected data is then transmitted to a higher central or distributed control system (client) which guarantees an informed and intelligent administration of all SA system devices [<xref ref-type="bibr" rid="scirp.88227-ref4">4</xref>] .</p><p>The SA system serves as an important method for the maintenance and control of various substation equipments. Historically, in order to transmit equipment data between SAS devices, the implemented IEDs employ different communication protocol which used to be propriety-based [<xref ref-type="bibr" rid="scirp.88227-ref5">5</xref>] . This hindered the smooth inter-IED communication as each IED uses a different protocol for communication [<xref ref-type="bibr" rid="scirp.88227-ref6">6</xref>] . Modern substations require multi-vendor interoperability of IEDs using a single easy-to-configure communication protocol to enable simplicity of design. Thus, IEC 61850 “communication networks and systems in substation” has been proposed and internationally accepted as a standard to enable manufacturer independent communication in a digital substation system [<xref ref-type="bibr" rid="scirp.88227-ref7">7</xref>] [<xref ref-type="bibr" rid="scirp.88227-ref8">8</xref>] [<xref ref-type="bibr" rid="scirp.88227-ref9">9</xref>] . The IEC 61850 System architecture is illustrated in <xref ref-type="fig" rid="fig1">Figure 1</xref>. It consists of hierarchical three networked levels, namely the station-level, the bay-level and the process level. The station-level consists of devices like the Human Machine Interface (HMI), and the gateway to the Network Control Center (NCC). The bay-level network includes protection and control bay units while the process</p><p>level network interconnects the switch control, sensors for voltage and current measurements and circuit breaker or disconnector control. Recently, the IEC 61850 based digital substation has expanded, and the demand for IEC 61850 based IEDs has increased [<xref ref-type="bibr" rid="scirp.88227-ref10">10</xref>] . The availability of multiple manufacturers IEDs in a single network within a digital substation increases the need for IEC 61850 communications specification diagnostics to ensure interoperability between products.</p><p>IEC 61850 Part 10 presents the test items for testing the conformance of communication specifications and provides the following details. Basic Exchange, Data Sets, Data Set Definition, Substitution, Setting Group Selection, Setting Group Definition, Logging, GOOSE publish, GOOSE subscribe, GOOSE management, control general, direct control, Select Before Operate (SBO) control, enhanced SBO control, etc. [<xref ref-type="bibr" rid="scirp.88227-ref11">11</xref>] . The International Users Group (UCAIUG) develops and manages the detailed procedures for conducting internationally authorized certification tests based on IEC 61850-10 [<xref ref-type="bibr" rid="scirp.88227-ref12">12</xref>] . For reliable substation operations, the IEDs must pass accredited testing to be installed to digital substations. A test system is developed and widely used at test institutions and sites of power utilities so that the test items can be tested using program-based tools rather than manually performed by the tester during the communication specification conformance test. However, these test systems are conventionally scripted-based systems that can only be used if the tester has a basic knowledge of the computer-based language for setting up a test environment [<xref ref-type="bibr" rid="scirp.88227-ref13">13</xref>] [<xref ref-type="bibr" rid="scirp.88227-ref14">14</xref>] . This paper presents model-based testing system which, due to the fact that it is not scripted, is easy use by test engineers to use. Our proposed model uses the drag-and-drop method for the design of the test procedure and would thereby make it easy to use. The paper is divided into the following sections; Section 2 introduces the conformance testing for IEC 61850. In Section 3, we discuss the practical implementation of the proposed model-based conformance tool. We also discuss the step-by-step process of using the tool including the all configurations for both the DUT and the software. The IEC 61850 reporting service under test together with the implementation of the model-based test process is also discussed into details. Results and analysis are presented in this section too. Section 4 presents the conclusion.</p>Review of Related Work<p>Research in [<xref ref-type="bibr" rid="scirp.88227-ref15">15</xref>] [<xref ref-type="bibr" rid="scirp.88227-ref16">16</xref>] discussed the importance of IEC 61850 service conformance testing. A more detailed discussion on the purpose and value of service conformance testing was presented by [<xref ref-type="bibr" rid="scirp.88227-ref17">17</xref>] and [<xref ref-type="bibr" rid="scirp.88227-ref18">18</xref>] . The authors in [<xref ref-type="bibr" rid="scirp.88227-ref17">17</xref>] studied the standardized service conformance testing procedure as stipulated by the IEC 61850-10 in comparison with other functional testing techniques. The testing and certification system for specific substation equipment including client/server devices, IEDs, gateways servers etc. are also described. A similar approach is adopted by [<xref ref-type="bibr" rid="scirp.88227-ref19">19</xref>] where the purpose and certification of the IEC 61850 service conformance testing is discussed. A complete tutorial on the general procedure for service conformance testing has been explained by authors in [<xref ref-type="bibr" rid="scirp.88227-ref20">20</xref>] . The authors provided a detailed account of the procedure to implement service conformance testing for an IED. This procedure includes the verification of the syntax, data models and how to ensure the conformity of extended logical nodes and data. Authors of [<xref ref-type="bibr" rid="scirp.88227-ref21">21</xref>] [<xref ref-type="bibr" rid="scirp.88227-ref22">22</xref>] focused on the client conformance testing and presented an evaluation of the method for testing the data communication services. By focusing on the reporting services of IEC 61850 including buffered and unbuffered, the authors in [<xref ref-type="bibr" rid="scirp.88227-ref17">17</xref>] developed the client testing system which can request and analyze Manufacturing Message Specification (MMS) reports Packet Data Unit (PDU). This research emphasized the importance of client conformance testing using IEC 61850 reporting service as an example. Finally, a close-loop testing system was developed by researchers in [<xref ref-type="bibr" rid="scirp.88227-ref23">23</xref>] . The researchers designed an automated system to enable the complete IEC 61850 service conformance testing therefore eliminating the possibility of errors caused by human intervention. The limitations of existing tools in literature can be summed up in the fact that some are designed for the implementation of client conformance testing only while other tools are also based on the computer programmable script language. The computer programmable script is quite difficult for most substation engineers or system integrators to use due to the fact that it requires an understanding of programming language like C#. These limitations are addressed by our paper by using object-based modelling approach to the implementation of the service conformance test cases.</p></sec><sec id="s2"><title>2. Introduction to Conformance Testing</title><p>The Utility Communication Association International Users Group (UCAIUG) created the testing committee to develop a set of standardized test cases to allow the conformance inspection of multi-vendor devices based on the IEC 61850 standard. This ensures that all device manufacturers comply with the application requirements making the “IEC 61850” a global standard. The serve conformance testing consists of techniques used to check the conformity of the IED to the IEC 61850 standard. As can be observed in <xref ref-type="fig" rid="fig2">Figure 2</xref>, the server conformance test consists of two parts which are the static conformance and the dynamic conformance.</p><p>The static conformance consists of document version management and the Substation Configuration Description Language (SCL) validation while the dynamic conformance consists of the data and communication model testing. Document version management includes checking the PICS, PIXIT, MICS and TICS. These are explained in <xref ref-type="table" rid="table1">Table 1</xref>.</p><p>These documents, although not standardized by IEC 61850 are required to assist the test engineer when selecting test parameters. The SCL file also has to be checked for semantics and syntax errors. Finally, the dynamic test case is where the actual testing is implemented. Each test case from the conformance test suite is selected, implemented and analyzed for conformance. A basic equipment setup is required to enable the proposer analysis of the server test results. The architecture as can be observed in <xref ref-type="fig" rid="fig3">Figure 3</xref> consists of the DUT, the device running the conformance tool and the test protocol analyzer all connected to an Ethernet switch.</p><p>Components of the conformance testing setup are explained in <xref ref-type="table" rid="table2">Table 2</xref>.</p><p>All related test cases are categorized into tables as can be seen in <xref ref-type="table" rid="table3">Table 3</xref>. Each test group consists of multiple positive and negative test cases. The positive test case verifies device conditions which results in a positive response while a negative test is the opposite.</p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> Various documentation for conformance testing</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Document</th><th align="center" valign="middle" >Explanation</th></tr></thead><tr><td align="center" valign="middle" >Protocol Implementation Extra Information for testing (PIXIT)</td><td align="center" valign="middle" >Device specific document which details the communication capabilities of the DUT</td></tr><tr><td align="center" valign="middle" >Protocol Implementation Conformance Statement (PICS)</td><td align="center" valign="middle" >Device specific document concerning the DUT communication capability</td></tr><tr><td align="center" valign="middle" >Model Implementation Conformance Statement (MICS)</td><td align="center" valign="middle" >Document which details standard data model of the DUT</td></tr><tr><td align="center" valign="middle" >Tissue Implementation Conformance Statement (TICS)</td><td align="center" valign="middle" >Document which lists the implemented technical issues (Tissues).</td></tr></tbody></table></table-wrap><table-wrap id="table2" ><label><xref ref-type="table" rid="table2">Table 2</xref></label><caption><title> Uses of each Conformance testing device</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Device</th><th align="center" valign="middle" >Application</th></tr></thead><tr><td align="center" valign="middle" >Signal Generator</td><td align="center" valign="middle" >To create binary and analog events</td></tr><tr><td align="center" valign="middle" >Protocol Analyzer</td><td align="center" valign="middle" >To store and analyze all network traffic packets</td></tr><tr><td align="center" valign="middle" >DUT</td><td align="center" valign="middle" >IED device which is under test</td></tr><tr><td align="center" valign="middle" >Client Simulator</td><td align="center" valign="middle" >To initiate connection Two-party association application (TPAA) if needed</td></tr><tr><td align="center" valign="middle" >Goose simulator</td><td align="center" valign="middle" >Generate the correct (incorrect) goose packets</td></tr><tr><td align="center" valign="middle" >Test Master</td><td align="center" valign="middle" >Control the complete conformance process</td></tr><tr><td align="center" valign="middle" >Time master</td><td align="center" valign="middle" >For time synchronization</td></tr></tbody></table></table-wrap><table-wrap-group id="3"><label><xref ref-type="table" rid="table3">Table 3</xref></label><caption><title> Uses of each Conformance testing device</title></caption><table-wrap id="3_1"><table><tbody><thead><tr><th align="center" valign="middle" >Test</th><th align="center" valign="middle" >Meaning</th></tr></thead><tr><td align="center" valign="middle" >sAss</td><td align="center" valign="middle" >Application Association</td></tr><tr><td align="center" valign="middle" >sSrv</td><td align="center" valign="middle" >Server, LD, LN, DA etc.</td></tr><tr><td align="center" valign="middle" >sDs</td><td align="center" valign="middle" >Data set model</td></tr><tr><td align="center" valign="middle" >sTrk</td><td align="center" valign="middle" >Service Tracking</td></tr><tr><td align="center" valign="middle" >sSub</td><td align="center" valign="middle" >Substitution Model</td></tr><tr><td align="center" valign="middle" >sSG</td><td align="center" valign="middle" >Setting group model</td></tr><tr><td align="center" valign="middle" >sRp</td><td align="center" valign="middle" >Unbuffered Report Control Model</td></tr><tr><td align="center" valign="middle" >sBr</td><td align="center" valign="middle" >Buffered Report Control model</td></tr></tbody></table></table-wrap><table-wrap id="3_2"><table><tbody><thead><tr><th align="center" valign="middle" >sLog</th><th align="center" valign="middle" >Log Control Model</th></tr></thead><tr><td align="center" valign="middle" >sGop and sGos</td><td align="center" valign="middle" >Generic Object oriented substation events</td></tr><tr><td align="center" valign="middle" >sCtl</td><td align="center" valign="middle" >Control model</td></tr><tr><td align="center" valign="middle" >sTm</td><td align="center" valign="middle" >Time synchronization</td></tr><tr><td align="center" valign="middle" >sFt</td><td align="center" valign="middle" >File transfer model</td></tr></tbody></table></table-wrap></table-wrap-group><sec id="s2_1"><title>2.1. Techniques for Implementing the Conformance Testing</title><p>Conventional IED conformance tool are script-based. This implies that the test engineer has to explicitly write the sequence of conformance test instructions to be interpreted by another program. For most tools, the preferred scripting language is Visual Basic due to its support for Rapid Application Development (RAD). This is quite difficult for utility test engineers who have very limited expertise of computer programming. That is the why we propose the model-based tool for conformance testing. Thus instead of writing down several lines of code in order to implement a test case, the test engineer can select the objects which encapsulates the standard IEC 61850 communication services and foundational programming concepts. The model-based tool is designed such that after a test case is created, the script is automatically generated. The test engineer creates the test case by “dragging and dropping” the test models (objects) which simplifies the testing process for the ordinary substation engineer. In order to demonstrate the implementation of the object model based IEC 61850 conformance test tool, we select sAss1 as an example. <xref ref-type="table" rid="table4">Table 4</xref> shows the details of the test procedure as recommended by UCAIUG.</p></sec><sec id="s2_2"><title>2.2. Script-Based and Model-Based Testing</title><p>The script-based conformance tool would require the test engineer to translate the test description in <xref ref-type="table" rid="table5">Table 5</xref> into an algorithm before converting it into a script-language as shown in <xref ref-type="fig" rid="fig4">Figure 4</xref>. To write this script the test engineer needs to understand syntax, semantics, statements and variables, which is usually difficult for them. This also means that it cannot easily be edited. Thus we propose the use of the model-based tool for conformance testing. <xref ref-type="fig" rid="fig5">Figure 5</xref> shows the implementation of test sAss1 using the proposed model-based tool. After selecting the desired service objects, the test engineer would then link them in accordance with the specification of the IEC 61850-10 test under consideration. This is a much easier to use version as compared with the script-based model. The general list consists of the commands like start, end, log, repeat, select etc. required to create the test case. The service list contains IEC 61850 communication service for each test suite. After selecting the services and creating the test case, each service object can be edited to take on specifications required for the test case.</p><table-wrap id="table4" ><label><xref ref-type="table" rid="table4">Table 4</xref></label><caption><title> Conformance test procedure for sAss1</title></caption><table><tbody><thead><tr><th align="center" valign="middle"  rowspan="2"  >sAss1</th><th align="center" valign="middle" >Expected result 2. DUT sends Associate response + 3. DUT sends Release response +</th></tr></thead><tr><td align="center" valign="middle" >Test description 1. Configure the Client and DUT with the correct association and authentication parameters 2. Client request Associate 3. Client request Release 4. Repeat step 2 and 3 250 times</td></tr></tbody></table></table-wrap><table-wrap id="table5" ><label><xref ref-type="table" rid="table5">Table 5</xref></label><caption><title> IEC 61850 ACSI-MMS Mapping</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >IEC 61850 Services</th><th align="center" valign="middle" >MMS services</th></tr></thead><tr><td align="center" valign="middle" >GetDataValues</td><td align="center" valign="middle" >Read</td></tr><tr><td align="center" valign="middle" >SetDataValues</td><td align="center" valign="middle" >Write</td></tr><tr><td align="center" valign="middle" >CreateDataSet</td><td align="center" valign="middle" >CreateNamedVariableList</td></tr><tr><td align="center" valign="middle" >DeleteDataSet</td><td align="center" valign="middle" >DeleteNamedVariableList</td></tr><tr><td align="center" valign="middle" >Cancel</td><td align="center" valign="middle" >Write</td></tr><tr><td align="center" valign="middle" >Select</td><td align="center" valign="middle" >Read/Write</td></tr><tr><td align="center" valign="middle" >Report (Buffered and Unbuffered)</td><td align="center" valign="middle" >Information Report</td></tr></tbody></table></table-wrap></sec><sec id="s2_3"><title>2.3. IEC 61850 Application Layer Diagnostics</title><p>To achieve successful real-time monitoring and operation of the substation system, communication is essential. As we progress towards the digital age, the fact that communication bandwidth is no longer a limiting factor plays a major role in providing thousands of data points to be processed by a single IED server device.</p><p>The basis for service conformance testing is the client-server communication model which is based on the Two-Party Application Association (TPAA). It uses both the Abstract Communication Service Interface (ACSI) and the MMS protocols to achieve TPAA. <xref ref-type="fig" rid="fig6">Figure 6</xref> shows the TPAA client-server communication profile applied in service conformance testing. The IEC 61850 established the ACSI in order to create a vendor-neutral method of transmitting and receiving data stored in the IED. The abstract data objects and services defined by IEC 61850 ACSI provides a standardized means by which power system devices model and present their data. This therefore enables multiple vendors to design devices which operate in a similar manner from a network perspective achieving interoperability. It is used for the definition of the various abstract communication objects and services of utility field devices. “Abstract definition” implies that the standard provides the description of both input/output parameters but does not provide information on how to achieve real-world implementation. The standard focuses on abstraction in order to make it convenient to map the communication services to any existing communication stack as seen in <xref ref-type="fig" rid="fig7">Figure 7</xref>. The Open Systems Interconnection 7-layer model is currently being used by many vendors and is supported by the IEC 61850 standard. The ACSI services are mapped to the MMS-based OSI model using the Specific Communication Service Mapping (SCSM) which is well defined in IEC 61850 part 8. The MMS protocol operates as the application layer and uses the TCP-IP which implies dedicated IP address for dedicates communication with each server. The MMS is selected as the “real” protocol due to the fact that it enables direct mapping of ACSI objects to an array of complex named object and services.</p><p>The mapping of the ACSI services to the MMS enables the transformation of the abstract model (object) into a unique and unambiguous reference for device implementation and easy comprehension by substation engineer. <xref ref-type="table" rid="table5">Table 5</xref> below provides a partial list of the mapping of ACSI to MMS according to IEC 61850-8-1.</p><p>Performing an IEC 61850 service conformance test requires the diagnostics of the communication packets or PDU’s to ensure correct implementation in accordance to the standard. To successfully conduct this diagnostics, most engineers focus only on the application layer (IEC 61850 service layer) since the lower layers of the communication stack is independent of the upper layers i.e. the communication service layer is independent of the TCP/IP layer. The separation of the application layer from the lower layer communication stack enables the incorporation of different types of network technologies into IEC 61850 design. Thus diagnostics are performed by focusing on the ACSI and the MMS. Typically, many utility engineer appreciate the simplicity of the MMS protocol as compared to the “abstract” nature of the ACSI, although the standard makes provisions for both service protocols.</p><p><xref ref-type="fig" rid="fig8">Figure 8</xref> shows an example of the complete OSI packets for the release communication service which shows the details of all parameters necessary for the transmission of the PDU across the TCP/IP layer.</p></sec></sec><sec id="s3"><title>3. Practical Test Implementation</title><p><xref ref-type="fig" rid="fig9">Figure 9</xref> represents the Graphical User Interface (GUI) of the proposed conformance test tool. It consists of the list of conformance test cases, the modelling view where the test cases are modelled and the device view which enables a full self-description of the IED under test. There is also the log view which provides a summary of the test results as implemented. A pass or fail can be seen at the log view. The last major part is the system view which shows the client and server connection and communication. <xref ref-type="fig" rid="fig1">Figure 1</xref>0 shows the flowchart for implementing the proposed model-based conformance testing tool. After starting the program there is the need to create a new session or use already available ones. A session contains a set of already pre-configured test cases based on the recommendations of UCAIUG. The device setting shown in <xref ref-type="fig" rid="fig1">Figure 1</xref>1 involves the configuration of both the server information.</p><p>And also the local computer IP addresses to enable device-to-device communication. The time server is also configured in case there is the need to perform time synchronization test. It also helps with accurate time stamping of transmitted signal between client and server. The next step is to extract the IED self-description including all information on the logical devices, logical nodes, data objects and data attributes. The global variables consist of values for each conformance/communication service group as can be seen in <xref ref-type="fig" rid="fig1">Figure 1</xref>2. By running the initializations, all default values and IED specific data reference required for the test are generated and stored. An example can be observed in <xref ref-type="fig" rid="fig1">Figure 1</xref>3 where initialization for the association test case generates correct values for the MMS Access Point (AP), Presentation Selector value (PSEL), Session selector (SSEL) and Transport selector (TSEL). The test case under consideration is then selected from the list as can be seen in <xref ref-type="fig" rid="fig1">Figure 1</xref>3 and then modelled using object models provided. For this purposes, as can be seen in <xref ref-type="fig" rid="fig1">Figure 1</xref>4 the test engineer can use the model from the service list and the general list.</p><p>The service list contains conformance specific objects like associate, release, setDataValues etc. while the general list contains general objects like the start, end, if, wait, invoke etc. After all the configuration and settings are completed, the next step is to run the selected case in order to test the DUT. The results are then analyzed using the log results and/or the communication packets. The pass or fail is automatically detected by also configuring the logic decision maker of the test tool as illustrated in <xref ref-type="fig" rid="fig1">Figure 1</xref>5 and then the program comes to an end.</p><sec id="s3_1"><title>3.1. Understanding the Test Case (Reporting Service)</title><p>The IED 61850 IED provides different services for the client (HMI) including the reporting service. Details of the reporting service are provided in IEC 61850 Part 7-2 which specifies the Abstract Communication Service Interface (ACSI). The events in the SA system are known as data objects and are grouped into datasets as can be seen in <xref ref-type="fig" rid="fig1">Figure 1</xref>6 for reporting. The reporting model enables the transfer of events (data values) from a logical Node (LN) to a client either instantly by way of the Unbuffered reporting or after some time using the buffered reporting. The Report Control Block (RCB) enables the attribute values to be set or read by the controlling the operation of both the report handler and the event monitor. The main condition for generating a report is in case there is an update or a change in the original data attribute in the dataset. There are three (3) types of these changes known as Trigger options (TrigOps). <xref ref-type="table" rid="table6">Table 6</xref> summarizes the TrigOps.</p><p>The standard defines two (2) classes of the report control block namely Buffered Report Control Block (BRCB) and Unbuffered Report Control Block (URCB). The BRCB class permits the immediate release of the dataset after being issued or for the data changes to be buffered for a specific time period (using bufTm) property. By using the sequence-of-events functionality, it is possible to buffer data in case of disconnection and later submit the data when connection is established. The URCB allows transmission of reports based on the time specified in the BufTm. In case connection is lost, no buffering occurs and the data is lost. The generated reports are sent to the recipient application via TPAA or MPAA mechanism.</p><table-wrap id="table6" ><label><xref ref-type="table" rid="table6">Table 6</xref></label><caption><title> List of the Report Service Trigger options in IEC 61850</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Changes</th><th align="center" valign="middle" >TrigOps</th><th align="center" valign="middle" >Meaning</th></tr></thead><tr><td align="center" valign="middle" >Data Change</td><td align="center" valign="middle" >Dchg</td><td align="center" valign="middle" >A change in the value of the data (process-related)</td></tr><tr><td align="center" valign="middle" >Quality change</td><td align="center" valign="middle" >Qchg</td><td align="center" valign="middle" >Caused by a change in the quality value of a process-based data attribute.</td></tr><tr><td align="center" valign="middle" >Data update</td><td align="center" valign="middle" >Dupd</td><td align="center" valign="middle" >A freeze event in a value of the original process-related attribute. Free event implies that the original data was updated with the same value as before.</td></tr></tbody></table></table-wrap></sec><sec id="s3_2"><title>3.2. Reporting Service Test Case Description</title><p>As explained previously the report service enables the transmission of data from the IED (server) to the client. In order to present the model based conformance test approach of our proposed tool, we implement a test case involving the report service. The report test case six (6) which involves testing the configuration revision of unbuffered RCB is selected from the list of test cases. The configuration revision is a counter which represents the number of times a referenced dataset has been changed. <xref ref-type="fig" rid="fig1">Figure 1</xref>7 shows the details of the test procedure according to UCAIUG. As can be observed the main communication service used in the test procedure is the GetURCBValues which enables the client to read attributes from the IED.</p><p>While implementing this test case, the main references to ensure successful conformance would be the IEC 61850-8-1 subclause 17.2 and Tissue number 453 subclause 1.2.2.7.</p></sec><sec id="s3_3"><title>3.3. Model-Based Implementation of Conformance Test</title><p>The following illustrates how to implement the Rp6 test case using the proposed model-based approach. In Figures 18(a)-18(c) each object is described for easy comprehension of the test procedure. Step 2 creates a TCP association between the client testing software or device and the server (DUT). To obtain the initial values of the DUT, the client uses the GetURCBValues to inquire data from the server. The invoke object in step 4 of <xref ref-type="fig" rid="fig1">Figure 1</xref>8(b) is used to create a temporary dataset for testing purposes. By using the SetURCBvalues, the client testing device causes default values in the dataset to be changed. The ConfRev value is then compared to previous data and it is expected that the value increases.</p><p>The process is then repeated from step 8 to step 10 for different datasets associated with the same URCB. The dataset that was created temporarily is then deleted using the invoke in step 11. The test client device releases the DUT at step 12 and then the test ends at step 13 as illustrated in <xref ref-type="fig" rid="fig1">Figure 1</xref>8(c).</p><p>In order to generate this flowchart, each model is selected from the list of communication and service objects as discussed earlier. Also a unique feature of the proposed tool is that after creating the model based flowchart as shown above, the corresponding script file is generated as shown in <xref ref-type="fig" rid="fig1">Figure 1</xref>9.</p></sec><sec id="s3_4"><title>3.4. Results and Analysis</title><p>To analyze the results, the log reports and the packet analyzer are typically used. As can be seen in <xref ref-type="fig" rid="fig2">Figure 2</xref>0, the log result shows how each step in the algorithm shown in Figures 18(a)-18(c) is implemented. Example at step [<xref ref-type="bibr" rid="scirp.88227-ref3">3</xref>] , the client requests the URCB values from the server (DUT) using the GetURCBValues. A positive response is classified as positive if the response shows a successful implementation of the client request. Thus the GetURCBValues results in a positive response which includes the Report ID, Report enabled, reference dataset, optional fields, buffer time, sequence number, trigger options, integrity period and general interrogation as seen in <xref ref-type="fig" rid="fig2">Figure 2</xref>0 The initial value of the ConfRev is 10,001. The invoke is used to create a new dataset in the server with IP (192.168.1.210). The name of the dataset is known as Temp_Dataset. Values are written to newly created dataset by using the SetURCBValues. It can be observed in <xref ref-type="fig" rid="fig2">Figure 2</xref>1 that when GetURCBValue is requested, the ConfRev value increases to 1002.</p><p>The similar procedure is repeated with the same URCB and a new dataset. It can be observed again that the ConfRev values increases from 1002 to 1003. Thus, as can be observed in <xref ref-type="fig" rid="fig2">Figure 2</xref>2, the test case passes due to the fact that the ConfRev value increases with every new dataset configuration.</p></sec><sec id="s3_5"><title>3.5. Advantages of Object-Based Implementation</title><p>There are several advantages of the object model based conformance testing tool as compared to the script-based conformance tool. The most obvious advantage is the ease in generating new test cases or modifying existing cases without the need to write multiple lines of script. Another dimension of this benefit is the fact that by using our proposed object model based conformance tool, the script language is automatically generated. The proposed tool can support all the required IEC 61850 conformance test cases defined by UCAIUG and can also support special cases as defined by the test engineer. The tool has been integrated with a detailed packet analysis software which can help check the network packet traffic including ACSI, MMS and Goose packets. With the object model based tool, it is relatively easier to change the device parameters while testing without having to look through multiple lines of script. For example, for sAss1 conformance testing, the associate service parameters including the AP title, AE qualifier, Transport selector, presentation selector and session selector can easily be selected and edited.</p></sec></sec><sec id="s4"><title>4. Conclusion</title><p>This paper presents the structure, algorithms, and test cases of a model-based diagnostic system to verify the compliance of the IEDs with IEC 61850 communications specifications. Traditional script-based testing methods were inconvenient because the tester had an understanding of the computer language and edited the program directly for setting up the test environment. This test method suggested that the tester may not know the language of the computer, but may test it. Because test objects based on GUI model are developed and the tester edits only the visual model, the test configuration is easier to configure and perform. This is important as it helps test engineers to focus on the test results instead of the test implementation process which can sometimes be very complicated especially in cases where the test engineer has limited understanding of the IEC 61850 standard.</p></sec><sec id="s5"><title>Conflicts of Interest</title><p>The authors declare no conflicts of interest regarding the publication of this paper.</p></sec><sec id="s6"><title>Cite this paper</title><p>Jang, B., Abubakari, A. and Kim, N. (2018) Development of a Model Driven ACSI Conformance Testing for IEC 61850-Based IED. Smart Grid and Renewable Energy, 9, 215-236. https://doi.org/10.4236/sgre.2018.910014</p></sec></body><back><ref-list><title>References</title><ref id="scirp.88227-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Kezunovic, M. (2009) Substation Automation Research Frontiers. Proceedings of the IEEE/PES Power Systems Conference and Exposition, Seattle, WA, 15-18 March 2009, 1-2. https://doi.org/10.1109/PSCE.2009.4840104</mixed-citation></ref><ref id="scirp.88227-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Kirkman, R. (2007) Development in Substation Automation Systems. Proceedings of the 14th International Conference on Intelligent System Applications to Power Systems, Kaohsiung, 5-8 November 2007, 1-6.  
https://doi.org/10.1109/ISAP.2007.4441690</mixed-citation></ref><ref id="scirp.88227-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Leonardi, A., Mathioudakis, K., Wiesmaier, A. and Zeiger, F. (2014) Towards the Smart Grid: Substation Automation Architecture and Technologies. Advances in Electrical Engineering, 2014, Article ID: 896296.</mixed-citation></ref><ref id="scirp.88227-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Ozansoy, C.R., Zayegh, A. and Kalam, A. (2002) Communications for Substation Automation and Integration, School of Communications and Informatics. Victoria University of Technology, Melbourne.  
http://www.krec.ir/Automation/COMMUNICATIONS_FOR_SUBSTATION_AUTOMATION_AND_ 
INTEGRATION.pdf</mixed-citation></ref><ref id="scirp.88227-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Pruthvi, P., Bhuvaneswari, H.B. and Sudheendran, L. (2013) Analysis of Utility Communication Protocol IEC 61850 for Substation Automation Systems. Proceedings of the National Conference on Challenges in Research &amp; Technology in the Coming Decades (CRT 2013), Ujire, 27-28 September 2013, 1-8.  
https://doi.org/10.1049/cp.2013.2504</mixed-citation></ref><ref id="scirp.88227-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Matsuda, S., Watabe, Y., Asrizal, I.I., Katayama, S., Okuno, K. and Kasuga, K. (2011) Issues Overcome in the Design and Application of IEC 61850-Compliant Substation Automation Systems. Proceedings of the International Conference on Advanced Power System Automation and Protection, Beijing, 16-20 October 2011, 198-202. https://doi.org/10.1109/APAP.2011.6180408</mixed-citation></ref><ref id="scirp.88227-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Roostaee, S., Hooshmand, R. and Ataei, M. (2011) Substation Automation System using IEC 61850. Proceedings of the 5th International Power Engineering and Optimization Conference, Shah Alam, 6-7 June 2011, 393-397.  
https://doi.org/10.1109/PEOCO.2011.5970443</mixed-citation></ref><ref id="scirp.88227-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Gao, C., Zhou, H., Deng, Q.J. and Zhang, Z.Y. (2010) The Research and Implementation of IEC 61850 Communication Protocol for Smart Grid. Proceedings of the 2nd International Conference on Information Science and Engineering, China, 4-6 December 2010, 2463-2466.</mixed-citation></ref><ref id="scirp.88227-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Janssen, M.C., Crossley, P.A. and Yang, L. (2011) Bringing IEC 61850 and Smart Grid Together. Proceedings of the 2nd IEEE PES International Conference and Exhibition on Innovative Smart Grid Technologies, Manchester, 5-7 December 2011, 1-5. https://doi.org/10.1109/ISGTEurope.2011.6162749</mixed-citation></ref><ref id="scirp.88227-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Apostolov, A. (2017) Impact of IEC 61850 Edition 2 on the Object Modelling of Distribution Protection IEDs. CIRED-Open Access Proceedings Journal, 2017, 1184-1187. https://doi.org/10.1049/oap-cired.2017.0495</mixed-citation></ref><ref id="scirp.88227-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">(2013) Communication Networks and Systems for Power Utility Automation Part 10: Conformance Testing, IEC 61850 Standard, 2013.</mixed-citation></ref><ref id="scirp.88227-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Richard Schimmel (2011) Conformance Test Procedures for Server Devices with IEC 61850-8-1 Interface. Revision 2.3, on request of the UCA International Users Group.  
http://testing.ucaiug.org/Testing/UCAIug%20Testing%20Quality%20Assurance%20Program/ 
Current%20IEC%2061850%20Testing%20Procedures/UCATestProceduresServer61850-8-1_Rev2p3.pdf</mixed-citation></ref><ref id="scirp.88227-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Choi, C., Park, J., Han, J., Shin, Y., Kim, Y. and Shim, E. (2011) The Development of a Client Conformance Tool based on IEC 61850. Proceedings International Conference on Electrical Machines and Systems, Beijing, 20-23 August 2011, 1-5.  
https://doi.org/10.1109/ICEMS.2011.6073718</mixed-citation></ref><ref id="scirp.88227-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">UniCA 61850 Conformance Test Set.</mixed-citation></ref><ref id="scirp.88227-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Tan, J.C., Zhang, C. and Bo, Z.Q. (2008) The Importance of IEC 61850 Interoperability Testing. Proceedings of 43rd International Universities Power Engineering Conference, Padova, 1-4 September 2008, 1-5.</mixed-citation></ref><ref id="scirp.88227-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">Tan, J., Ciufo, J., Kueng, F. and Martin, D. (2010) Proof-of-Concept Testing for IEC 61850 DESN Substations. Proceedings IEEE PES General Meeting, Providence, 25-29 July 2010, 1-6.</mixed-citation></ref><ref id="scirp.88227-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">Udren, E.A., Willem, S. and Dolezilek, D. (2007) IEC 61850: Role of Conformance Testing in Successful Integration. Proceedings of the 19th International Conference on Electricity Distribution, Vienna, 21-24 May 2007, 1-4.</mixed-citation></ref><ref id="scirp.88227-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">Muschlitz, B. (2006) IEC 61850 Conformance Testing: Goals, Issues and Status (“IEC 61850 Conformance Testing: This One is Different”?). EnerNex Corporation DistribuTECH, Tampa.</mixed-citation></ref><ref id="scirp.88227-ref19"><label>19</label><mixed-citation publication-type="other" xlink:type="simple">Rim, S., Lee, Y. and Lee, W. (2009) Test and Evaluation for Power IT Apparatus. Proceedings of the Transmission &amp; Distribution Conference &amp; Exposition: Asia and Pacific, Seoul, 26-30 October 2009, 1-5.  
https://doi.org/10.1109/TD-ASIA.2009.5356846</mixed-citation></ref><ref id="scirp.88227-ref20"><label>20</label><mixed-citation publication-type="other" xlink:type="simple">Casta&amp;ntilde;o, A., Zapata, G. and García R. (2013) Monitoring and Checking Standard IEC 61850, Respect to the Manufacturer. Proceedings of Simposio Internacional sobre Calidad de la Energia Electrica, Medellín, 27-29 November 2014.  
http://grupotyt.medellin.unal.edu.co/descargas/Monitoring_Standard_IEC_61850.pdf</mixed-citation></ref><ref id="scirp.88227-ref21"><label>21</label><mixed-citation publication-type="other" xlink:type="simple">Lee, N.H., Jang, B.T. and Song, I.J. (2009) The Testing Method of Data Transmission Services of IEC 61850 Based Client. Proceedings of the Transmission &amp; Distribution Conference &amp; Exposition: Asia and Pacific, Seoul, 26-30 October 2009, 1-4.</mixed-citation></ref><ref id="scirp.88227-ref22"><label>22</label><mixed-citation publication-type="other" xlink:type="simple">Lee, N.H., Jang, B.T., An, Y.H. and Shim, E.B. (2012) A Study on the Development of Model Based SA Client Conformance Testing System. Journal of International Council on Electrical Engineering, 2, 1-5.  
https://doi.org/10.5370/JICEE.2012.2.1.001</mixed-citation></ref><ref id="scirp.88227-ref23"><label>23</label><mixed-citation publication-type="other" xlink:type="simple">Zheng, Y., Wu, M. and Peng, Z. (2016) A Close-Loop Conformance Testing System of IEC 61850. Journal of Communications, 11, 779-784.  
https://doi.org/10.12720/jcm.11.8.779-784</mixed-citation></ref></ref-list></back></article>