<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">AM</journal-id><journal-title-group><journal-title>Applied Mathematics</journal-title></journal-title-group><issn pub-type="epub">2152-7385</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/am.2022.1311057</article-id><article-id pub-id-type="publisher-id">AM-121561</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Physics&amp;Mathematics</subject></subj-group></article-categories><title-group><article-title>
 
 
  Research on Intelligent Identification of PD Patterns Based on the Fingerprint Features
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Qiuping</surname><given-names>Zheng</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Ting</surname><given-names>Chen</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Haitao</surname><given-names>Hu</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Yingli</surname><given-names>Wang</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Dawei</surname><given-names>Zhao</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Chuntian</surname><given-names>Chen</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Dianchun</surname><given-names>Zheng</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib></contrib-group><aff id="aff1"><addr-line>Instrumentation Technology &amp;amp; Economy Institute, Beijing, China</addr-line></aff><aff id="aff2"><addr-line>Harbin University of Science and Technology, Harbin, China</addr-line></aff><pub-date pub-type="epub"><day>08</day><month>11</month><year>2022</year></pub-date><volume>13</volume><issue>11</issue><fpage>896</fpage><lpage>916</lpage><history><date date-type="received"><day>21,</day>	<month>October</month>	<year>2022</year></date><date date-type="rev-recd"><day>27,</day>	<month>November</month>	<year>2022</year>	</date><date date-type="accepted"><day>30,</day>	<month>November</month>	<year>2022</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  Five-electrode configurations were designed to simulate the distribution inhomogeneity of electric field intensities in the air-insulating medium, and the characteristic data waveforms of partial discharge generated by different electrode configurations under the excitation of power frequency AC voltage were carefully collected in this paper. Furthermore, the feature vectors of the corresponding fingerprint, contained in partial discharge data, were extracted by rigorous mathematical algorithms, and the artificial neural network was employed to realize the pattern recognition of partial discharge caused by the inhomogeneity of electric field intensity with different electrode configurations. The results indicate that the 
  <em>J</em>
  <sub>4</sub> value in the space of 7 feature quantities is 1905.6, and the recognition rate is 100% when the hidden layer neuron of the network is 19. However, the 
  <em>J</em>
  <sub>5</sub> value of 9 feature quantities is 1589.9, and the purpose of recognition has been achieved when the number of hidden layer neurons of the network is 6. Increasing the number of hidden layer neurons will only waste computing resources. Of course, PD information collection mode, feature quantity selection, optimal feature space composition, network structure and classification algorithm are the key to realizing PD fault intelligence identification.
 
</p></abstract><kwd-group><kwd>PD</kwd><kwd> Fingerprint</kwd><kwd> Feature Extraction</kwd><kwd> Pattern Recognition</kwd><kwd> Class Separability</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>Practical experience and rigorous theoretical studies have proved that the Partial Discharge (abbreviated PD) phenomena are closely related to the insulation defects or failures that happen in operating equipment such as switchgear, power transformers, cables, as well as motor and generator stator windings [<xref ref-type="bibr" rid="scirp.121561-ref1">1</xref>] [<xref ref-type="bibr" rid="scirp.121561-ref2">2</xref>] [<xref ref-type="bibr" rid="scirp.121561-ref3">3</xref>]. Therefore, in addition to detection technology, data mining algorithms and processing techniques of PD signals and information have become a research hotspot in recent years.</p><p>With the advancement of high-precision detection technology and the wide application of artificial intelligence algorithms, the great improvement of online monitoring and diagnosis technology for insulation faults of high-voltage equipment has been achieved to a large extent [<xref ref-type="bibr" rid="scirp.121561-ref4">4</xref>] [<xref ref-type="bibr" rid="scirp.121561-ref5">5</xref>].</p><p>Over the past couple of decades, several classification algorithms of PD patterns have been proposed and tested, which adopt different approaches, using one or more of the different PD data patterns [<xref ref-type="bibr" rid="scirp.121561-ref6">6</xref>].</p><p>As well known, the PD phenomenon of gas insulation systems strongly depends on the non-uniformity of the electric field and the characteristics of PD signals also obey certain mathematical statistical laws, so five kinds of electrode structures are designed to artificially simulate non-uniformity of the electric field, and PD signals of time-domain for five models are collected by specially designed experimental circuit, and the corresponding PD fingerprints are obtained through analysis and calculation of the data information. Furthermore, different combinations of fingerprint features extracted from histograms are taken as input feature vectors to neural networks for training the classifier of BPNN and identifying the corresponding five PD modes. The above research work and the results obtained are fully described in this paper.</p><p>The article is organized as follows: Section 1 is a summary of the content related to this research subject. Experimental models of PD, original data of PD and fingerprint of PD are elaborated on in Section 2, and the feature extraction, rationality verification and class separability criterion are all analyzed and demonstrated in Section 3. Section 4 includes the discussion of recognition results and analysis of the effect of hidden layers in BPNN on recognition rate, and Section 5 illustrates some valuable conclusions. The contribution of this paper is to demonstrate the separability of partial discharge signal modes in gas dielectrics caused by the inhomogeneity of electric field intensity by experiments and theory.</p></sec><sec id="s2"><title>2. PD Model and Fingerprint Features</title><p>As known by dielectric physics, the primary cause of triggering PD is the uneven electric field distribution in the local region of the insulation system, especially in high-voltage electrical equipment whose gas medium is the main insulation dielectrics, such as GIS (Gas Insulated Switchgear), gas-insulated power transformers and so on, this type of problem is particularly obvious. Excluding the influence of impurities contained in the gas, the gas dielectric itself is especially sensitive to the unevenness of the electric field, and most of the triggers for PD are protrusions existing on electrode surface, metal fine particles freely moving between electrodes, and cracks rest in the supporting insulator [<xref ref-type="bibr" rid="scirp.121561-ref7">7</xref>] [<xref ref-type="bibr" rid="scirp.121561-ref8">8</xref>]. Although different detection techniques can obtain various manifestations of the PD signals, “fingerprints” of the PD occurred due to defective insulation always having been deposited in the data pool. Hence, it is very practical significance for modeling the PD triggered by the uneven electric field, collecting the signal waveform of PD, extracting fingerprint characteristics with the data mining techniques, establishing a set of vector spaces depicting the heterogeneity of each specific electric field, employing artificial intelligence algorithms to train the classifier ANN and finally realizing the intelligent identification of inhomogeneity of electric field intensity. The research methods and experimental results in this paper have reference significance for the diagnosis, prediction and residual life prediction of partial discharge faults of gas-insulated electrical equipment.</p><sec id="s2_1"><title>2.1. PD Model and Experimental Procedure</title><p>Based on the design principle of SCR series dry-type transformer insulation structure, this paper collects PD data information online during its operation and conducts on-site anatomy of the equipment [<xref ref-type="bibr" rid="scirp.121561-ref9">9</xref>]. Meanwhile, one-to-one correspondence related the geometric configuration of the PD fault location to the corresponding PD information characteristics is analyzed and summarized in details. Therefore, five types of PD models are designed to provide experimental and theoretical basis for establishing standard database of PD fault diagnosis, location, classification and life prediction of SCR series dry-type transformer in service, and the aim is to realize finally the intelligent monitoring and warning for the equipment operating status [<xref ref-type="bibr" rid="scirp.121561-ref10">10</xref>].</p><p>For artificially simulating the unevenness of the electric field distribution, five pairs of experimental models are designed and made from the industry standard brass material, they are needle-needle, needle-plate, needle-sphere, sphere-plate and sphere-sphere electrode system respectively, the clearance distances of needle-needle, needle-plate and needle-sphere are all 12 mm, while gaps of the sphere-plate and sphere-sphere equals to 10 mm. The needle electrodes are all copper cylindrical with a diameter of 4 mm, and the tip angle is 30˚. Then the plate electrodes are made from copper circular plate, diameter is of 100 mm, surface polishing and edge chamfering, and two sphere electrodes are all solid copper ball, and their diameters are of 10 mm and 20 mm respectively while the sphere surface polished. These five pairs of PD model are shown as in <xref ref-type="fig" rid="fig1">Figure 1</xref>.</p><p>The discharge chamber is a cylinder made of plexiglass material with a diameter of 450 mm, a height of 600 mm, and a wall thickness of 15 mm, as shown in <xref ref-type="fig" rid="fig2">Figure 2</xref>. Moreover, the chamber must be cleaned, dried and evacuated before the experiment, and then injected with clean and dry air. The experiment is carried out under the conditions of IEC and GB, and the standard specifies that the atmospheric pressure equals to 0.1013 MPa, temperature is T= 20˚C and absolute humidity 11 g/m<sup>3</sup>. In the field of electrical insulation technology, the four parameters that describe the insulating properties of gas dielectrics respectively are relative permittivity ε r , electrical conductivity γ , dielectric loss angle tangent</p><p>tg     δ and breakdown field strength E → . Under IEC and GB conditions, the relative permittivity of air is ε r ≈ 1 , and the electrical conductivity is γ ≈ 1.8 &#215; 10 − 17 S / m , the dielectric loss angle tangent under power frequency is tg     δ = 10 − 9 , and the electric field strength of air is E → = 30   kV / cm .</p><p>The pressure of the gas in the chamber depends on the needs of the experiment, and the temperature is always maintained at 20 degrees Celsius. According to the requirements of the experiment, five pairs of PD electrode are fixed in sequence on the base of the chamber, not only the electrode gap can be adjusted free, but the electrode itself should also be easy to install and remove.</p><p>The experiment work is carried out in an electromagnetic shielded laboratory, and the experimental principle is shown in <xref ref-type="fig" rid="fig3">Figure 3</xref>. The acquisition of the PD signals is performed by the Hipotronics DDX-7000 digital PD detector. In order to meet the needs of signal analysis, processing and PD identification classification, PD signals are quickly acquired, stored and intercepted in integer multiple cycle lengths. In the whole experiment process of this project, 1000 original PD data are collected, that is to say 200 basic data were collected for each PD model, and the length of each data was 100 complete cycles.</p><p>Therefore, the original PD data, corresponding to the five electrode structures described herein, are illustrated in <xref ref-type="fig" rid="fig4">Figure 4</xref>, which are triggered by power frequency AC voltage.</p></sec><sec id="s2_2"><title>2.2. Basic Quantities of PD</title><p>For the registration of basic quantities, the momentary values of the experimental voltage and the discharge signal were processed [<xref ref-type="bibr" rid="scirp.121561-ref11">11</xref>]. It is known that using conventional detection methods and the electrical activity of PD is represented by three independent quantities only: the discharge magnitude q i , the ignition voltage u i and the position of the discharge related to the phase angle φ i of the test voltage. If during one half cycle of the test voltage more discharges occur, on the basis of q i , u i and φ i several quantities can be calculated [<xref ref-type="bibr" rid="scirp.121561-ref12">12</xref>]. In this study, the following basic quantities were measured and processed as shown in Figure5: the inception voltage U i n c as a voltage at the sample at which discharge pattern in a half cycle of the test voltage starts, and N q as the number of discharges for each halve period of the voltage cycle. Therefore, finally PD φ − q − n maps generated by the corresponding electrode have been gained shown in FigureA1 (See Appendix to this article).</p><p>According to reference [<xref ref-type="bibr" rid="scirp.121561-ref13">13</xref>] and reference [<xref ref-type="bibr" rid="scirp.121561-ref14">14</xref>], it is known that the statistical</p><p>variation in PD occurs, both in magnitude and in the temporal behavior of partial discharges. This variation in the time is partly caused by statistical variations in the discharge phenomenon itself and is also partly the result of the changes in the discharge site. Therefore, the voltage cycle is divided into phase windows representing the phase angle axis (0˚ to 360˚). If the observation takes place over several voltage cycles, four quantities can be determined in each phase window, i.e. the sum of the discharge magnitudes, the number of discharges, the average value of discharges and the maximum value of discharges. In the research process of this paper, the following phase-position quantities are processed just as reference [<xref ref-type="bibr" rid="scirp.121561-ref15">15</xref>]: the impulse count distribution H n ( φ ) , which represents the number of observed discharges in each phase window as a function of the phase angle; the mean impulse height distribution H q n ( φ ) , which represents the average amplitude in each phase window as a function of the phase angle. H q n ( φ ) is calculated by dividing the total discharge amount in each phase window by the impulse number of discharges in the same phase window. These quantities, observed throughout the whole angle axis, result in distributions of discharge recurrence as a function of phase angle. Based on previous research, we already know that the discharges occur during a voltage cycle in two sequences, and for each half of the voltage cycle separate discharge patterns can be measured. But in the case of similar inception conditions for each half of the voltage cycle, similar discharge patterns can be expected. Therefore, H q n ( φ ) and H n ( φ ) are characterized by two distributions, i.e. H q n + ( φ ) and H n + ( φ ) for the positive half of the voltage cycle, and H q n − ( φ ) and H n − ( φ ) for the negative half of the voltage cycle.</p></sec><sec id="s2_3"><title>2.3. Fingerprint of PD</title><p>As mentioned above, the five different PD signal waveforms (shown in <xref ref-type="fig" rid="fig4">Figure 4</xref>) over a sinusoidal period are respectively divided into N phase windows, as illustrated in <xref ref-type="fig" rid="fig5">Figure 5</xref>. For each phase window n (pulse count), q (discharge quantity) and φ (phase angle) are calculated. Usually two distributions are determined: 1) H n ( φ ) gives the number of discharge impulses in each phase window, 2) H q n ( φ ) takes the average magnitude of the discharge pulses as a function of the phase angle. Therefore, the characteristic quantities of PD can be defined as the reference [<xref ref-type="bibr" rid="scirp.121561-ref16">16</xref>].</p><p>Fingerprints obtained in the experiments are shown as a set of the histograms composed of PD statistical characteristic parameters, and the shape of each histogram could present the essential nature of PD signals. Then each feature of a histogram has statistical characteristics for specified PD type. Therefore, these statistical features are used as pattern character vectors of PD classification for our research objectives. In this paper, these statistical features include skewness ( S k ), kurtosis ( k u ), asymmetry (A), cross correlation (cc) and phase factor ( P f ) that are all calculated based on the PD signals. These parameters are defined as follows:</p><p>S k = ∑ i = 1 w ( x i − μ ) 3 &#215; p i σ 3 (1)</p><p>where, x i is the discrete value of phase window i, p i is the probability of frequency of appearance for that value x i in phase window i, μ is the mean value ∑ x i ⋅ p i , and σ is the variance σ 2 = ∑ ( x i − μ ) 2 ⋅ p i . The skewness represents the asymmetry of the distribution. If the distribution is symmetric, S k = 0 . If it is asymmetric to the left, S k &gt; 0 , otherwise S k &lt; 0 .</p><p>k u = ∑ i = 1 w ( x i − μ ) 4 &#215; p i σ 4 − 3 (2)</p><p>The kurtosis represents the sharpness of the distribution. If the distribution has the same sharpness as a normal distribution, k u = 0 . If it is sharper than normal, k u &gt; 0 , and k u &lt; 0 means it is flatter. Examples of these two statistical parameters are demonstrated in <xref ref-type="fig" rid="fig6">Figure 6</xref>.</p><p>The discharge factor A describes the difference in the mean discharge level in the negative and positive distributions. It is defined as following:</p><p>A = Q s − / n − Q s + / n + (3)</p><p>where, Q s + and Q s − are the sum of discharges of the mean pulse height distribution in the positive and the negative half of the voltage cycle; n + and n − are the number of discharges of the mean pulse height distribution in the positive and the negative half of the voltage cycle.</p><p>The cross correlation factor is calculated as:</p><p>c c = ∑ q i + q j − − ∑ q i + q j − / N ′ ( ∑ ( q i + ) 2 − ∑ ( q j + ) 2 / N ′ ) ( ∑ ( q i − ) 2 − ∑ ( q j − ) 2 / N ′ ) (4)</p><p>where, q i + is the mean discharge magnitude in window i of the positive half cycle and q i − the mean discharge magnitude in the corresponding window in</p><p>the negative half cycle; N ′ is the number of phase windows per half cycle. Thus, if the shapes are the same, then c c = 1 ; if they differ completely, then c c = 0 .</p><p>Phase asymmetry is:</p><p>P f = φ i n − φ i n + (5)</p><p>where, φ i n + and φ i n − are the inception discharge phase of the positive and the negative half of the voltage cycle. The phase asymmetry P f is used to study the difference in inception voltage of the positive and negative half of the voltage cycle.</p><p>As known from the aforementioned discussion, statistical parameters of the PD pulse sequence are useful to describe the distribution histograms of the several quantities of PD pulses. In general, it seems to be a better choice to use parameters which describe the shape of the distribution, rather than using absolute values which depend on the real data such as the mean value of the discharge magnitudes. <xref ref-type="fig" rid="fig7">Figure 7</xref> shows 5 types of PD fingerprint acquired respectively, and each fingerprint contains 29 quantitative values, which is a set of unique spatial vectors that correspond to the PD events of the specified electrode configuration under periodic 50 Hz AC voltage. Therefore, these 5 types of PD fingerprint represent their intrinsic characteristics in the nature. In other words, five vector spaces are constructed and each is 29-dimension. Nevertheless, they are not directly utilized to carry out PD pattern classification. The reason is that due to the large number of data vectors, the structure of the classifier may be very complex and hence, the recognition algorithm cannot be completed successfully, then eventually the ideal classification effect may not be achieved.</p><p>As well known, the high-dimensional data space vector can be reduced to a low-dimensional space through related operations. This can not only reduce the data amount, but also convert complex problems into simple and easy-to-handle ones. There have been effective analytical methods applied in different fields of Artificial intelligence recognition for fault detection, diagnosis and prediction. Further, such methods have also been successfully applied in PD pattern recognition and fault classification [<xref ref-type="bibr" rid="scirp.121561-ref17">17</xref>].</p></sec></sec><sec id="s3"><title>3. Feature Extraction of PD Fingerprint</title><p>In general, intelligent recognition procedures include signal process, feature extraction, classifier design, classification algorithm and result verification. However, any patterns which can be recognized and classified all have a number of discriminative features. Thus, the first step in any recognition process is to consider the problem of what discriminatory features to select and how to extract these features from the signal data. It is quite clear that the number of features needed for successful classification depends on the discriminative quality of the chosen features.</p><sec id="s3_1"><title>3.1. Class Separability Criterion</title><p>One of the crucial issues in classification is the curse of dimensionality, hence, a low-dimension feature space is desired for simplifying calculation and reducing costs. Therefore, features should be carefully selected for preserving the maximum class separability. In our study, the criterion based on within and between-class scatter values is adopted as the measure of discrimination at a set of histogram values. The within-class scatter value measures the scatter of feature vectors of different classes around their respective mean values, and the between-class scatter value is defined as the scatter of the conditional mean values around the overall mean value [<xref ref-type="bibr" rid="scirp.121561-ref18">18</xref>] [<xref ref-type="bibr" rid="scirp.121561-ref19">19</xref>]. Therefore, the class separability criteria are expressed as follows:</p><p>1) Within-class scatter matrix:</p><p>S w = ∑ i = 1 M P i S i (6)</p><p>where, S i is covariance matrix of w i , which is calculated as follows:</p><p>S i = E [ ( x − μ i ) ( x − μ i ) T ] (7)</p><p>Here, P i is a prior probability of the class w i . Namely, P i ≈ n i / N , where n i is the sample number of w i in all samples N.</p><p>2) Between-class scatter matrix:</p><p>S b = ∑ i = 1 M P i ( μ i − μ 0 ) ( μ i − μ 0 ) T (8)</p><p>where, μ 0 is a global average vector μ 0 = ∑ i M P i μ i .</p><p>3) Mixed scatter matrix:</p><p>S m = S w + S b (9)</p><p>4) Distance separability criterion:</p><p>J = t r { S w − 1 S m } (10)</p><p>All in all, J presents the dispersion of vectors within the class and also the dispersion between the classes, and it is a criterion for judging the structure of vector space within a class and the separability between classes. A large value of J indicates that the space vectors within the class are reasonably constituted. The feature quantity extracted from the fingerprint of the class not only is able to completely characterize its similarity, but also can indicate that the distance between the classes is also large meaning that there is separation [<xref ref-type="bibr" rid="scirp.121561-ref20">20</xref>].</p></sec><sec id="s3_2"><title>3.2. Feature Selection</title><p>It is shown from <xref ref-type="fig" rid="fig7">Figure 7</xref> that 29 characteristic quantities are included in fingerprint for each PD model. As evidenced by well-known theories and practices, too many characteristic quantities for recognition can make the structure of the neural network more complex and the training process more difficult and time-consuming. Therefore, it is a very important task to carefully select different combinations of feature quantities. This task not only requires a certain amount of practical experience and multiple experiments, but also it must be met principle of classification and verified by the class separability criterion. Hence, nine characteristic quantities are picked from the distribution function H q n ( φ ) in each fingerprint of PD models, which are respectively S k + , S k − , K u + , K u − , Q s + , Q s − , A, cc, P f . At the same time, the nine characteristics can be divided into 5 groups, the first group X<sub>1</sub> contains three quantities (A, cc, P f ), the second group X<sub>2</sub> has four quantities ( S k + , S k − , K u + , K u − ), the third group X<sub>3</sub> has five quantities ( S k + , S k − , K u + , K u − , A), the fourth group X<sub>4</sub> contains seven quantities ( S k + , S k − , K u + , K u − , Q s + , Q s − , A), and last group X<sub>5</sub> Contains all nine characteristic quantities ( S k + , S k − , K u + , K u − , Q s + , Q s − , A,cc, P f ).</p><p>Based on the distance separability criteria according to Section 3.1, we derive J X 1 = 177.3 , J X 2 = 41.9 , J X 3 = 1243.8 , J X 4 = 1905.6 and J X 5 = 1589.9 respectively. The Jvalues show that 5 groups of feature combinations all satisfy the requirements of classification and have obvious separability, and moreover, X<sub>4</sub> is particularly distinct.</p></sec><sec id="s3_3"><title>3.3. BPNN Classifier</title><p>In this study, Back-Propagation Neural Network (BPNN) is used as classifier. Numerous studies show that BPNN, a rich learning algorithm, achieves good performance in the presence of memory, and is well-preforming in PD pattern recognition as well. The BPNN structure is shown in <xref ref-type="fig" rid="fig8">Figure 8</xref>.</p><p>The BP algorithm is a form of supervised learning for the feed-forward ANN and it consists of two steps, namely forward and backward learning. Although the back-propagation algorithm can calculate the modified weights of the hidden layer in learning, there are several problems should pay attention to in the process of learning and training of BPNN. For example, the number of neurons each hidden layer, the initial weight settings, the setting of the learning step and inertial coefficient, and the case if the learning is trapped in local minimum, etc. These issues may affect the recognition performance of BPNN, and may even cause BPNN to fail to converge in the training process [<xref ref-type="bibr" rid="scirp.121561-ref21">21</xref>].</p></sec></sec><sec id="s4"><title>4. Result and Discussion</title><p>The five sets of characteristic quantities selected are changed into five group input-eigenvectors, and a three-layer neural network is built using the neural network toolbox of the MATLAB. Then, each group input-eigenvector is used to train the specified neural network, and the optimal convergence effect of the neural network is obtained by changing the number of hidden neurons and network parameters.</p><sec id="s4_1"><title>4.1. Recognition Results</title><p>Among all 200 sets of samples for each type of PD fingerprint, 75 sets are as training samples, the other 75 sets take as test samples and the last 50 sets are as verification samples. The training function is “traingdx”, and the training error curves of characteristic quantities X<sub>1</sub>, X<sub>2</sub>, X<sub>3</sub>, X<sub>4</sub> and X<sub>5</sub> are shown in <xref ref-type="fig" rid="fig9">Figure 9</xref>. Further, the number of hidden layer neurons is 6, 8, 10, 13 and 19 respectively. The recognition results are presented in <xref ref-type="table" rid="table1">Table 1</xref>.</p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> Recognition results</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Characteristics Recognition rate Test model</th><th align="center" valign="middle" >X<sub>1</sub></th><th align="center" valign="middle" >X<sub>2</sub></th><th align="center" valign="middle" >X<sub>3</sub></th><th align="center" valign="middle" >X<sub>4</sub></th><th align="center" valign="middle" >X<sub>5</sub></th></tr></thead><tr><td align="center" valign="middle" >Needle-needle</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >95%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td></tr><tr><td align="center" valign="middle" >Needle-plate</td><td align="center" valign="middle" >95%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >95%</td></tr><tr><td align="center" valign="middle" >Needle-sphere</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td></tr><tr><td align="center" valign="middle" >Sphere-plate</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >0%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td></tr><tr><td align="center" valign="middle" >Sphere-sphere</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td></tr><tr><td align="center" valign="middle" >Total</td><td align="center" valign="middle" >99%</td><td align="center" valign="middle" >99%</td><td align="center" valign="middle" >80%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >99%</td></tr></tbody></table></table-wrap><p>It should be emphasized here that the five groups of curves in <xref ref-type="fig" rid="fig9">Figure 9</xref> have implied the influence of neurons on the recognition results of the neural network. For X<sub>1</sub>, X<sub>2</sub>, X<sub>3</sub>, X<sub>4</sub> and X<sub>5</sub>, using the network structure of <xref ref-type="fig" rid="fig8">Figure 8</xref>, their input the number of feature quantities is 3, 4, 5, 7, and 9, respectively. Because the number of neurons in the input layer of each neural network should match it, the number of neurons in the input layer should be 3, 4, 5, 7, and 9, respectively. On this basis, the corresponding optimized neural network structure was obtained through repeated experiments. The corresponding number of neurons in the hidden layer of the neural network were respectively 6, 8, 10, 13 and 19, and the output layer of the neural network must be the number of neurons is 5, because this paper is to identify five PD patterns, and according to the machine learning criterion described in the literature [<xref ref-type="bibr" rid="scirp.121561-ref22">22</xref>], the convergence criterion of the neural network learning and training in this paper is given.</p></sec><sec id="s4_2"><title>4.2. Effect of Hidden Layer Structure</title><p><xref ref-type="table" rid="table1">Table 1</xref> shows that selected fingerprint can be a useful and informative characteristic to identify PD modes under the condition that the hidden layer neurons are 19 except x<sub>3</sub>, but this does not mean that the more feature quantities, the higher the recognition result. Actually, the identification rate of characteristic quantity X<sub>4</sub> is the highest out of 5 sets of input feature vectors, because the vector x<sub>4</sub> best satisfies the class separability criterion.</p></sec><sec id="s4_3"><title>4.3. Effect of Hidden Layer Structure</title><p>How to select the number of hidden layer neurons is a very complex issue, which often needs the designer’s experience and numerous experiments. There are</p><table-wrap id="table2" ><label><xref ref-type="table" rid="table2">Table 2</xref></label><caption><title> Recognition results of X<sub>5</sub></title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Hidden layer Recognition neuron rate Test model</th><th align="center" valign="middle" >1</th><th align="center" valign="middle" >2</th><th align="center" valign="middle" >3</th><th align="center" valign="middle" >4</th><th align="center" valign="middle" >5</th><th align="center" valign="middle" >6</th><th align="center" valign="middle" >10</th><th align="center" valign="middle" >15</th><th align="center" valign="middle" >20</th></tr></thead><tr><td align="center" valign="middle" >Needle-needle</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td></tr><tr><td align="center" valign="middle" >Needle-plate</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td></tr><tr><td align="center" valign="middle" >Needle-sphere</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >0%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td></tr><tr><td align="center" valign="middle" >Sphere-plate</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td></tr><tr><td align="center" valign="middle" >Sphere-sphere</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >0%</td><td align="center" valign="middle" >0%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td></tr><tr><td align="center" valign="middle" >Total</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >80%</td><td align="center" valign="middle" >80%</td><td align="center" valign="middle" >80%</td><td align="center" valign="middle" >80%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td><td align="center" valign="middle" >100%</td></tr></tbody></table></table-wrap><p>currently no ideal analytic formulas and rules to follow. In this paper, the number of neurons in the hidden layer is chosen according to Kolmogorov’s theorem [<xref ref-type="bibr" rid="scirp.121561-ref23">23</xref>]. <xref ref-type="table" rid="table2">Table 2</xref> shows that the hidden layer structure of BPNN has an obvious effect on the recognition results, especially for a certain type of electrode model. When the number of hidden layer neurons is 6 or above, the neural network can obtain a recognition rate of 100%. However, excessive hidden layer neurons in artificial neural networks may have the following problems:</p><p>1) The structure of artificial neural networks is too complex, which not only requires more time to train, but also increases the cost.</p><p>2) Because the network structure is too complex, its convergence becomes slow or even fails to converge.</p><p>3) Due to the complex network structure, its robustness and fault tolerance rate are greatly reduced.</p><p>To sum up, the artificial neural network structure optimization is also a technical problem that cannot be ignored besides the correct acquisition of the original signal of the PD, the determination of the PD mode class and the selection of a reasonable PD feature vector. As shown in <xref ref-type="table" rid="table2">Table 2</xref>, X<sub>5</sub> is a reasonable set of the PD feature vector in the midst of the PD fingerprint, and when there are 6 neurons in the hidden layer, the recognition rate of the network has reached 100%, which means that the network structure and performance at this time are the best, at the same time, having the best classification effect is a matter of course.</p></sec></sec><sec id="s5"><title>5. Conclusions</title><p>The research in this paper deliberately simulates five kinds of electric field intensity distributions. Through the experiments, the original PD signals are collected, and five kinds of PD fingerprint patterns are established. According to the class separability criterion, the input feature vectors of the ANN are carefully selected from the PD fingerprint, they are X<sub>1</sub>, X<sub>2</sub>, X<sub>3</sub>, X<sub>4</sub> and X<sub>5</sub>. The J values show that 5 groups of feature combinations satisfy the requirements of classification and have obvious separability. Furthermore, the effect of input feature vectors, the number of neurons in the hidden layer and the recognition rate of ANN are discussed experimentally. The conclusions obtained are as follows:</p><p>1) The PD models structured five kinds of electrode systems truly simulate different electric field distributions, and these PD signals have obviously statistical behaviors. Further, the extracted fingerprint features not only can correctly characterize the intrinsic difference of gas-insulation PD, but also have distinct class separability. These findings are supported by the experimental results shown in <xref ref-type="fig" rid="fig4">Figure 4</xref> and <xref ref-type="fig" rid="fig7">Figure 7</xref>.</p><p>2) Although the feature selection and extraction from PD fingerprint is a complex process, it can be implemented using effective algorithms. Therefore, a reasonable set of PD characteristics can not only avoid the curse of dimensionality, but also it can simplify the design of the classifier and improve the effect of pattern classification. This conclusion has reference value and guiding significance for further research on PD pattern classification technology, as shown in <xref ref-type="table" rid="table1">Table 1</xref>.</p><p>3) After the PD pattern characteristics and pattern classes are determined, the choice of the hidden layer structure is a key issue, and even it is decisive. As shown in <xref ref-type="table" rid="table2">Table 2</xref>, 6 neurons in the hidden layer are the best structure of the network. If less than 6 neurons, a low recognition rate is caused. However, if there are more than 6 neurons, the recognition rate can be guaranteed, but the network structure becomes complicated and the learning process may be time-consuming, and can be not even converged.</p><p>Although intelligent PD pattern recognition is a complicated task, with the advancement of computing technology and the improvement of artificial intelligence, PD pattern recognition technology is also developing rapidly towards the intelligent direction. However, there are still many problems to be further explored to meet the needs of industrial development.</p></sec><sec id="s6"><title>Funding</title><p>This work was supported by National Natural Science Foundation of China (Grant No. 51077032).</p></sec><sec id="s7"><title>Conflicts of Interest</title><p>The authors declare no conflicts of interest regarding the publication of this paper.</p></sec><sec id="s8"><title>Cite this paper</title><p>Zheng, Q.P., Chen, T., Hu, H.T., Wang, Y.L., Zhao, D.W., Chen, C.T. and Zheng, D.C. (2022) Research on Intelligent Identification of PD Patterns Based on the Fingerprint Features. Applied Mathematics, 13, 896-916. https://doi.org/10.4236/am.2022.1311057</p></sec><sec id="s9"><title>Appendix</title></sec></body><back><ref-list><title>References</title><ref id="scirp.121561-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Yazici, B. (2004) Statistical Pattern Analysis of Partial Discharge Measurements for Quality Assessment of Insulation Systems in High-Voltage Electrical Machinery. IEEE Transactions on Industry Applications, 40, 1579-1594. https://doi.org/10.1109/TIA.2004.836174</mixed-citation></ref><ref id="scirp.121561-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Fwenando, F.G., Jacinto, T.J., Ruben, J.V., et al. (2017) Analysis of Insulating Material of XLPE Cables Considering Innovative Patterns of Partial Discharges. Mathematical Problems in Engineering, 2017, Article ID: 23794118. https://doi.org/10.1155/2017/2379418</mixed-citation></ref><ref id="scirp.121561-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Zheng, D.C. (2019) Dielectric Characteristics and Application of the SF6(M). Science Press, Beijing.</mixed-citation></ref><ref id="scirp.121561-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Firuzi, K., Vakilian, M. and Phung, B.T. (2019) Partial Discharges Pattern Recognition of Transformer Defect Model by LBP &amp; HOG Features. IEEE Transactions on Power Delivery, 34, 542-550. https://doi.org/10.1109/TPWRD.2018.2872820</mixed-citation></ref><ref id="scirp.121561-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Gao, K. Tan, K.X., Li, F.Q., et al. (2002) PD Pattern Recognition for Stator Bar Models with Six Kinds of Characteristic Vectors Using BP Network. IEEE Transactions on Dielectrics and Electrical Insulation, 9, 381-389. https://doi.org/10.1109/TDEI.2002.1007700</mixed-citation></ref><ref id="scirp.121561-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Wong, J.K.R., Hazlee, A., Ab, H.A., et al. (2015) Partial Discharge Classifications: Review of Recent Progress. Measurement, 68, 164-181. https://doi.org/10.1016/j.measurement.2015.02.032</mixed-citation></ref><ref id="scirp.121561-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Si, W.R., Li, J.H., Yuan, P., et al. (2008) Digital Detection, Grouping and Classification of Partial Discharge Signals at DC Voltage. IEEE Transactions on Dielectrics and Electrical Insulation, 15, 1663-1674. https://doi.org/10.1109/TDEI.2008.4712671</mixed-citation></ref><ref id="scirp.121561-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Callender, G. (2018) Modelling Partial Discharge in Gaseous Voids. University of Southampton, Southampton.</mixed-citation></ref><ref id="scirp.121561-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Lu, C.B. (2002) Dry-Type Power Transformer Theory and Calculation. Liaoning Science and Technology Press (China), Shenyang.</mixed-citation></ref><ref id="scirp.121561-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Yan, Z. and Zhu, D.H. (2007) High Voltage Insulation Technology. China Electric Power Press (China), Beijing.</mixed-citation></ref><ref id="scirp.121561-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Krivda, A. (1995) Automated Recognition of Partial Discharge. IEEE Transactions on Dielectrics and Electrical Insulation, 2, 796-821. https://doi.org/10.1109/94.469976</mixed-citation></ref><ref id="scirp.121561-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Pearson, J.S., Farish, O., Hampton, B.F., et al. (2002) Partial Discharge Diagnostics for Gas Insulated Substations. IEEE Transactions on Dielectrics and Electrical Insulation, 5, 893-905. https://doi.org/10.1109/94.469984</mixed-citation></ref><ref id="scirp.121561-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Zheng, D.C. (2005) PD Pattern Recognition Based on BP Network. Ph.D. Dissertation, Harbin University of Science and Technology, Harbin.</mixed-citation></ref><ref id="scirp.121561-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">Mas’ud, A.A., Stewart, B.G. and McMeekin, S.G. (2014) Application of an Ensemble Neural Network for Classifying Partial Discharge Patterns. Electric Power Systems Research, 110, 154-162. https://doi.org/10.1016/j.epsr.2014.01.010</mixed-citation></ref><ref id="scirp.121561-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Kreuger, F.H., Gulski, E. and Krivda, A. (1993) Classification of Partial Discharges. IEEE Transactions on Electrical Insulation, 28, 917-931. https://doi.org/10.1109/14.249365</mixed-citation></ref><ref id="scirp.121561-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">Thummapal, D., Jain, A. and Kushare, B.E. (2014) Partial Discharge Pattern Recognition of HVGIS by Using Artificial Neural Networks. International Journal of Engineering Research &amp; Technology, 3, 449-454.</mixed-citation></ref><ref id="scirp.121561-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">Sahoo, N.C. and Salama, M.M.A. (2005) Trends in Partial Discharge Pattern Classification: A Survey. IEEE Transactions on Dielectrics and Electrical Insulation, 12, 248-264. https://doi.org/10.1109/TDEI.2005.1430395</mixed-citation></ref><ref id="scirp.121561-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">Heidari, M. (2016) Combined Diagnosis of PD Based on the Multidimensional Parameters. Modelling and Simulation in Engineering, 2016, Article ID: 5949140. https://doi.org/10.1155/2016/5949140</mixed-citation></ref><ref id="scirp.121561-ref19"><label>19</label><mixed-citation publication-type="other" xlink:type="simple">Contin, A., Cavallini, A., Montanari, G.C., et al. (2000) Artificial Intelligence Methodology for Separation and Classification of Partial Discharge Signals. 2000 Annual Report Conference on Electrical Insulation and Dielectric Phenomena, Victoria, 15-18 October 2000, 522-526.</mixed-citation></ref><ref id="scirp.121561-ref20"><label>20</label><mixed-citation publication-type="other" xlink:type="simple">Nguyen, C.H. and Ho, T.B. (2008) Pattern Recognition. Pattern Recognition, 41, 366-372. https://doi.org/10.1016/j.patcog.2008.04.005</mixed-citation></ref><ref id="scirp.121561-ref21"><label>21</label><mixed-citation publication-type="other" xlink:type="simple">Ho, T.K. and Basu, M. (2002) Complexity Measures of Supervised Classification Problems. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24, 289-300. https://doi.org/10.1109/34.990132</mixed-citation></ref><ref id="scirp.121561-ref22"><label>22</label><mixed-citation publication-type="other" xlink:type="simple">Srivastava, N., Hinton, G.E., Krizhevsky, A., et al. (2014) Dropout: A Simple Way to Prevent Neural Networks from Overfitting. Journal of Machine Learning Research, 15, 1929-1958.</mixed-citation></ref><ref id="scirp.121561-ref23"><label>23</label><mixed-citation publication-type="other" xlink:type="simple">Sergios, T. and Konstantinos, K. (2004) Pattern Recognition. 2nd Edition, Publishing House of Electronics Industry (China), Beijing, 116-117.</mixed-citation></ref></ref-list></back></article>