<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">AM</journal-id><journal-title-group><journal-title>Applied Mathematics</journal-title></journal-title-group><issn pub-type="epub">2152-7385</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/am.2013.45111</article-id><article-id pub-id-type="publisher-id">AM-31454</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Physics&amp;Mathematics</subject></subj-group></article-categories><title-group><article-title>
 
 
  Mathematical Tools of Cluster Analysis
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>eter</surname><given-names>Trebuňa</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Jana</surname><given-names>Halčinová</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib></contrib-group><aff id="aff1"><addr-line>Department of Industrial Engineering and Management, Technical University of Ko?ice, Ko?ice, Slovakia </addr-line></aff><author-notes><corresp id="cor1">* E-mail:<email>peter.trebuna@tuke.sk(ET)</email>;<email>jana.halcinova@tuke.sk(JH)</email>;</corresp></author-notes><pub-date pub-type="epub"><day>13</day><month>05</month><year>2013</year></pub-date><volume>04</volume><issue>05</issue><fpage>814</fpage><lpage>816</lpage><history><date date-type="received"><day>March</day>	<month>1,</month>	<year>2013</year></date><date date-type="rev-recd"><day>April</day>	<month>5,</month>	<year>2013</year>	</date><date date-type="accepted"><day>April</day>	<month>12,</month>	<year>2013</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
   The paper deals with cluster analysis and comparison of clustering methods. Cluster analysis belongs to multivariate statistical methods. Cluster analysis is defined as general logical technique, procedure, which allows clustering variable objects into groups-clusters on the basis of similarity or dissimilarity. Cluster analysis involves computational procedures, of which purpose is to reduce a set of data on several relatively homogenous groups-clusters, while the condition of reduction is maximal and simultaneously minimal similarity of clusters. Similarity of objects is studied by the degree of similarity (correlation coefficient and association coefficient) or the degree of dissimilarity-degree of distance (distance coefficient). Methods of cluster analysis are on the basis of clustering classified as hierarchical or non-hierarchical methods. 
 
</p></abstract><kwd-group><kwd>Cluster Analysis; Hierarchical Cluster Analysis Methods; Non-Hierarchical Cluster Analysis Methods</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>“Cluster analysis is a general logic process, formulated as a procedure by which groups together objects into groups based on their similarities and differences.” [<xref ref-type="bibr" rid="scirp.31454-ref1">1</xref>]</p><p>Having a data matrix X type n &#215; p, where n is the number of objects and p is the number of variables (features, characteristics). Next there is a decomposition S(k) of set n objects to k certain groups (clusters), i.e.</p><p><img src="10-7401421\bbb9606d-8657-4920-9887-539e0fdacb96.jpg" />, [<xref ref-type="bibr" rid="scirp.31454-ref2">2</xref>]:</p><p><img src="10-7401421\0de77fcf-b900-4006-a5a6-cf260415d3b1.jpg" /></p><p><img src="10-7401421\8e30bf01-2cec-4073-8a6a-c9eef58e374d.jpg" />comprises all the space.</p><p>If that set of objects <img src="10-7401421\feefc4ab-c06e-49a2-a2dc-e887b51052eb.jpg" /> and any dissimilarity coefficient of objects D, then a cluster is called a subset of p sets of objects o to which it applies [<xref ref-type="bibr" rid="scirp.31454-ref2">2</xref>]:</p><p><img src="10-7401421\878a2a57-dd0d-4b29-a0e5-6059de7a7649.jpg" /></p><p>where <img src="10-7401421\df3fb047-aa08-4330-9d1b-41893fab6489.jpg" /> and<img src="10-7401421\d121a71f-6ac2-40cf-9609-793de0dac9a4.jpg" />. This means that the maximum distance of objects belonging to the cluster must always be less than the minimum distance any object from the cluster and object outside cluster.</p><p>The input for the clustering of the input data matrix and output are specific identification of clusters. The input matrix X of size n &#215; p contains the i-th row of characters x<sub>ij</sub> object A<sub>i</sub>, where <img src="10-7401421\9b25709d-30c2-4eec-9ae0-a93e0ebf0f31.jpg" /> and<img src="10-7401421\ff37d9a3-9cf7-4410-864d-5aa661427280.jpg" />. Therefore</p><p><img src="10-7401421\0b2f3220-e061-4f30-aaa9-ac296135df3c.jpg" />.</p></sec><sec id="s2"><title>2. Cluster Analysis Methods</title><p>Classification of cluster analysis methods is shown in <xref ref-type="fig" rid="fig1">Figure 1</xref>.</p><sec id="s2_1"><title>2.1. Hierarchical Cluster Analysis Methods</title><p>Hierarchical cluster analysis methods included of the analyzed objects into a hierarchical system of clusters. This system is defined as a system of mutually distinct non-empty subsets of the original set of objects. The main characteristic of hierarchical methods of cluster analysis is creating a decomposition of the original set of objects, in which each of the partial decomposition refines next or previous decomposition.</p><p>According to the way of creating decompositions (<xref ref-type="fig" rid="fig2">Figure 2</xref>) the hierarchical clustering methods are divided into several groups:</p><p>• Agglomerative clustering—at the beginning of clustering are considered individual objects as separate</p><p>clusters. The next steps will then be the most similar clusters combine into larger clusters until the specified criteria of quality decomposition is fulfilled.</p><p>• Divisional clustering—at the beginning of the clustering process all objects are in one cluster. This cluster is then divided into smaller clusters.</p><p>Agglomerative hierarchical clustering methods assign to set of objects O the sequence of its decomposition <img src="10-7401421\0c5548e2-51fc-43a2-a678-ebd8fe4762ed.jpg" />to clusters and hereby the real nonnegative number <img src="10-7401421\edc79179-785e-467f-b517-20cf43b0be69.jpg" /> is assigned to each cluster<img src="10-7401421\3487d921-e6e5-4024-a30f-f9fc1b6ca773.jpg" />.</p><p>1) The decomposition of the set of objects <img src="10-7401421\d57b33cb-8abd-4855-9a1a-e61f3db61151.jpg" /> are its individual objects, i.e., single element clusters whereby the number <img src="10-7401421\e364e6a8-1a92-482d-8f1d-5ce41f99e4b8.jpg" /> for <img src="10-7401421\aa2e9865-0a1f-406e-b309-2fb55e822551.jpg" /> belongs to each single element cluster<img src="10-7401421\030ecdb3-681d-49da-b663-292835ca4b2c.jpg" />.</p><p>2) There is a decomposition <img src="10-7401421\ee134b94-3579-4835-b304-f828921db7a6.jpg" /> and the numbers <img src="10-7401421\77f70f2c-67a6-486e-86f2-a6563225ac87.jpg" /> for <img src="10-7401421\09c09a0d-a6ec-490c-9f22-1f05a831cecd.jpg" /> are assigned to clusters. A pair of cluster which has the minimal dissimilarity of coefficient D is chosen, it means, they are the most similar. These clusters are combined to form one cluster. Other clusters stay unchanged and they pass to next decomposition.</p><sec id="s2_1_1"><title>2.1.1. Simple Linkage Method</title><p>The simple linkage method can be defined as follows: if D is a random coefficient of dissimilarity, symbols C<sub>1</sub>, C<sub>2</sub> are two different clusters, A<sub>i</sub> object belongs to a cluster C<sub>1</sub> and object A<sub>j</sub> belongs to cluster C<sub>2</sub> then</p><p><img src="10-7401421\da9942c0-3a97-46fe-9dc8-4f20dd3edfd4.jpg" /></p><p>determines the distance of clusters for the Simple linkage method [<xref ref-type="bibr" rid="scirp.31454-ref3">3</xref>].</p></sec><sec id="s2_1_2"><title>2.1.2. Complete Linkage Method</title><p>The complete linkage method is a dual method to the simple linkage method its principle is following [<xref ref-type="bibr" rid="scirp.31454-ref3">3</xref>]:</p><p>If D is a random coefficient of dissimilarity, symbols C<sub>1</sub>, C<sub>2</sub> are two different clusters, A<sub>i</sub> object belongs to a cluster C<sub>1</sub> and object A<sub>j</sub> belongs to cluster C<sub>2</sub> then</p><p><img src="10-7401421\5630531a-2620-4b41-a82f-63a7b20668d1.jpg" /></p><p>determines the distance of clusters for the complete linkage method.</p></sec><sec id="s2_1_3"><title>2.1.3. Average Linkage Method</title><p>The distance between the clusters for the average linkage method is defined as follows [<xref ref-type="bibr" rid="scirp.31454-ref3">3</xref>]:</p><p>If D is a random coefficient of dissimilarity, symbols C<sub>1</sub>, C<sub>2</sub> are two different clusters, A<sub>i</sub> object belongs to a cluster C<sub>1</sub> and object A<sub>j</sub> belongs to cluster C<sub>2</sub> then</p><p><img src="10-7401421\8500b61b-ba01-431e-adf5-21cab2f5997e.jpg" /></p><p>determines the distance of clusters for the average linkage method, where n<sub>1</sub> and n<sub>2 </sub>are the number of objects in clusters C<sub>1</sub> and C<sub>2</sub>.</p></sec><sec id="s2_1_4"><title>2.1.4. Centroid’s Method</title><p>In Centroid’s method the dissimilarity of 2 clusters is expressed as the distance of centroids of these clusters. Each cluster is represented by the average of its elements, which is called the centroid. The distance between clusters is determined by the Lance-William correlation:</p><p><img src="10-7401421\ac98e11d-e527-4ce9-9f36-b3fe992836d0.jpg" /></p><p>where n<sub>1</sub>, n<sub>2</sub> and n<sub>3</sub> are the number of objects in clusters C<sub>1</sub>, C<sub>2</sub> and C<sub>3</sub>.</p></sec><sec id="s2_1_5"><title>2.1.5. The Median Method</title><p>If the size of the clusters is different, the centroid of new cluster may lie within a larger cluster or near the larger cluster. The median method tries to reduce this deficiency in that way that it does not reflect the size of clusters, but it reflects its average. The distance between newly-formed clusters and other clusters is calculated by equation [<xref ref-type="bibr" rid="scirp.31454-ref3">3</xref>]:</p><p><img src="10-7401421\b0cce122-cd67-4671-88bd-fcb9202e5dbf.jpg" /></p></sec><sec id="s2_1_6"><title>2.1.6. Ward’s Method</title><p>Ward’s method is also marked as a method of minimizing the increases of errors of sum squares. It is based on optimizing the homogeneity of clusters according to certain criteria, which is minimizing the increase of errors of sum squares of deviation points from centroid. This is the reason why this method is different from previous methods of hierarchical clustering, which are based on optimization of the distance between clusters [<xref ref-type="bibr" rid="scirp.31454-ref4">4</xref>].</p><p>The loss of information is determined at each level of clustering, which is expressed as the increase of total sum of aberrance square of each cluster point from the average ESS value. Then it comes to a connection of clusters where there is a minimal increase in the errors of sum of squares [<xref ref-type="bibr" rid="scirp.31454-ref5">5</xref>].</p><p>The accruement of ESS function is calculated according to [<xref ref-type="bibr" rid="scirp.31454-ref5">5</xref>]:</p><p><img src="10-7401421\36f0f9fb-7d65-42e5-93fa-10e2172a17a8.jpg" /></p><p>where<img src="10-7401421\a1970153-a88c-47d1-a1e1-7664443279b9.jpg" />.</p></sec></sec><sec id="s2_2"><title>2.2. Non-Hierarchical Cluster Analysis Methods</title><p>For non-hierarchical cluster analysis methods is the typical classification of objects into a predetermined number of disjunctive clusters. These clustering methods can be divided into 2 groups [<xref ref-type="bibr" rid="scirp.31454-ref6">6</xref>]:</p><p>• Hard clustering methods—assignment an object to a cluster is clear;</p><p>• Fuzzy cluster analysis—it calculates the rate of relevancy of objects to clusters.</p></sec></sec><sec id="s3"><title>3. Conclusion</title><p>In recent years, many companies, institutions and organizations collect a full range of database. The process of accumulation of data has an explosive character, that it’s why it is important to find one’s way in these data and extract some relevant information. The importance of clustering methods increases for that reason.</p></sec><sec id="s4"><title>REFERENCES</title></sec><sec id="s5"><title>NOTES</title></sec></body><back><ref-list><title>References</title><ref id="scirp.31454-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">M. Palumbo, C. N. Lauro and M. J. Greenacre, “Data Analysis and Classification,” Springer, Berlin, 2010, p. 505. doi:10.1007/978-3-642-03739-9</mixed-citation></ref><ref id="scirp.31454-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">L. Kaufmann, “Finding Groups in Data: An Introduction in Cluster Analysis,” Wiley, Hoboken, 2005, p. 342.</mixed-citation></ref><ref id="scirp.31454-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">B. S. Everitt, S. Landau, M. Leese and D. Stahl, “Cluster Analysis,” Wiley, London, 2011, p. 348.</mixed-citation></ref><ref id="scirp.31454-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">J. Bacher, A. Poge and K. Wenzig, “Clusteranalyse— Anwendungsorientierte Einfuhrung in Klassifikationsverfahren,” Oldenbourg, Munchen, 2010, p. 432. 
doi:10.1524/9783486710236</mixed-citation></ref><ref id="scirp.31454-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">J. Han and M. Kamber, “Data Mining—Concepts and Techniques,” MK Publisher, San Francisco, 2006, p. 772.</mixed-citation></ref><ref id="scirp.31454-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">P. Trebuňa and J. Halcinová, “Experimental Modelling of the Cluster Analysis Processes,” Procedia Engineering, Vol. 48. 2012, pp. 673-678. 
doi:10.1016/j.proeng.2012.09.569</mixed-citation></ref></ref-list></back></article>