<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">OALibJ</journal-id><journal-title-group><journal-title>Open Access Library Journal</journal-title></journal-title-group><issn pub-type="epub">2333-9705</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/oalib.1103139</article-id><article-id pub-id-type="publisher-id">OALibJ-72046</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Biomedical&amp;Life Sciences</subject><subject> Business&amp;Economics</subject><subject> Chemistry&amp;Materials Science</subject><subject> Computer Science&amp;Communications</subject><subject> Earth&amp;Environmental Sciences</subject><subject> Engineering</subject><subject> Medicine&amp;Healthcare</subject><subject> Physics&amp;Mathematics</subject><subject> Social Sciences&amp;Humanities</subject></subj-group></article-categories><title-group><article-title>
 
 
  Parkinson’s Disease Diagnosis: Detecting the Effect of Attributes Selection and Discretization of Parkinson’s Disease Dataset on the Performance of Classifier Algorithms
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Gamal</surname><given-names>Saad Mohamed</given-names></name><xref ref-type="aff" rid="aff1"><sub>1</sub></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib></contrib-group><aff id="aff1"><label>1</label><addr-line>Computer Science Department, Faculty of Science, North Border University, Ar’ar, Saudi Arabia</addr-line></aff><author-notes><corresp id="cor1">* E-mail:<email>jamalziena@gmail.com</email></corresp></author-notes><pub-date pub-type="epub"><day>02</day><month>11</month><year>2016</year></pub-date><volume>03</volume><issue>11</issue><fpage>1</fpage><lpage>11</lpage><history><date date-type="received"><day>October</day>	<month>13,</month>	<year>2016</year></date><date date-type="rev-recd"><day>Accepted:</day>	<month>November</month>	<year>12,</year>	</date><date date-type="accepted"><day>November</day>	<month>16,</month>	<year>2016</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  Precise detection of PD is important in its early stages. Precise result can be achieved through data mining, classification techniques such as Naive Bayes, support vector machine (SVM), multilayer perceptron neural network (MLP) and decision tree. In this paper, four types of classifiers based on Naive Bayes, SVM, MLP neural network, and decision tree (j48) are used to classify the PD dataset and the performances of these classifiers are examined when they are implemented upon the actual PD dataset, discretized PD dataset, and selected set of attributes from PD dataset. The dataset used in this study comprises a range of voice
   signals from 31 people: 23 with PD and 8 healthy people. The result shows that Naive Bayes and decision tree (j48) yield better accuracy when performed upon the discretized PD dataset with cross-validation test mode without applying any attributes selection algorithms. SVM gives high accuracy of 70% for training and 30% for the test when implemented on a discretized PD dataset and a splitting dataset. The MLP neural network gives the highest accuracy when used to classify actual PD dataset without discretization, attribute selection, or changing test mode.
 
</p></abstract><kwd-group><kwd>PD</kwd><kwd> SVM</kwd><kwd> MLP</kwd><kwd> Decision Tree</kwd><kwd> Naive Bayes</kwd><kwd> Classifier</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>Parkinson’s disease (PD) is a progressive, neurodegenerative disease that belongs to the group of conditions called motor system disorders. Parkinson’s disease sufferers get worse over time as the normal bodily functions, including breathing, balance, movement, and heart function worsen [<xref ref-type="bibr" rid="scirp.72046-ref1">1</xref>] .</p><p>Other neurodegenerative disorders include Alzheimer’s disease, Huntington’s disease, and amyotrophic lateral sclerosis or Lou Gehrig’s disease. An estimated seven to 10 million people worldwide are suffering from Parkinson’s disease. Occurrence of Parkinson’s increases with age, but an estimated four percent of people with PD are diagnosed before the age of 50 [<xref ref-type="bibr" rid="scirp.72046-ref2">2</xref>] [<xref ref-type="bibr" rid="scirp.72046-ref3">3</xref>] . There is no cure or prevention for PD. However, the disease can be controlled in early stage. Hence data mining techniques can play effective role in early detection and diagnosis.</p><p>Data mining techniques in medicine is a research area that combines sophisticated representational and computing techniques with the insights of expert physicians to produce tools for improving healthcare. Data mining is a computational process to find hidden patterns in datasets by building predictive or classification models that can be learnt from past experience and applied to future cases. With the vast amount of medical data available to hospitals, medical centers, and medical research organizations, the field of medicine supported by data mining techniques can increase healthcare quality and can help physicians make decisions about their patients’ care. There are various techniques for classification such as support vector machine (SVM), neural networks, decision tree, and Na&#239;ve Bayes. The objective of the study is to analyze and compare four of the abovementioned classification techniques’ performances upon Parkinson’s diagnosis. First, we compare the classifiers’ performance on actual and discretized PD dataset and then compare their performance using the attributes selection algorithm.</p></sec><sec id="s2"><title>2. Related Work</title><p>Several researches have focused on using data mining techniques for the automatic identification of Parkinson’s disease.</p><p>Mohammad S. Islam et al. [<xref ref-type="bibr" rid="scirp.72046-ref4">4</xref>] conducted a comparative analysis for effective detection on Parkinson’s disease using Random tree (RT), SVM and Feedfoward back propagation neural network (FBANN). A 10-flod cross validation analysis has been carried out for all classification. The proposed model achieved 97.37%</p><p>Aprajita Sharma and Ram Nivas [<xref ref-type="bibr" rid="scirp.72046-ref5">5</xref>] evaluated the performance of the model build using artificial neural networks (ANN), K-nearest neighbor (KNN), and SVM with radial basis function. The models offered a high accuracy of ~85.29%.</p><p>Shian Wu and Jiannjong Guo [<xref ref-type="bibr" rid="scirp.72046-ref6">6</xref>] applied factor analysis, logistic regression, decision tree, and ANN to analyze whether voice features can discriminate a PD patient from a healthy one. They stated that among all three methods, decision tree has the lowest classification error and logistic regression model has second lowest, while ANN has a higher classification error.</p><p>Geetha Ramani and G. Sivagami [<xref ref-type="bibr" rid="scirp.72046-ref7">7</xref>] provide a survey of data mining techniques that are in use today for classification. They concluded by showing that the random tree algorithm classified the Parkinson’s disease dataset accurately and offer 100% accuracy. The linear discriminante analysis C4.5, Cs-MC4, and KNN yields the accuracy result of above 90%.</p><p>A. H. Hadjahamadi and Taiebeh J. Askari [<xref ref-type="bibr" rid="scirp.72046-ref8">8</xref>] compared the classification methods (Bayesian Network, C5.1, SVM, ANN, and C&amp;R (Classification and Regression)). C&amp;R has an accuracy of 93.75% whereas ANN and SVM are the next best classifiers. They indicated that the computing of the variable (feature) importance is an important issue in many applied problems complementing variable selection by interpretation issues.</p><p>Yahia Alemami and Laiali Almazaydeh [<xref ref-type="bibr" rid="scirp.72046-ref9">9</xref>] developed and validated classification algorithms based on Na&#239;ve Bayes and KNN; their results show that the automated classification algorithm, Na&#239;ve Bayes, and KNN obtained a high degree of accuracy around 93.3%.</p><p>Rashidah et al. [<xref ref-type="bibr" rid="scirp.72046-ref10">10</xref>] proposed a modelin early detection and diagnosis of PD by using the Multilayer Feedforward Neural Network (MLFNN) with Back-propagation (BP) algorithm. The output of the network is classified into healthy or PD by using K-Means Clustering algorithm. The result shows that the model can be used in diagnosis and detection of PD due to the good performance, which is 83.3% for sensitivity, 63.6% for specificity, and 80% for accuracy.</p></sec><sec id="s3"><title>3. Parkinson Dataset</title><p>We conduct an analysis on real world PD data, where the disease is diagnosed using several features extracted from human voice [<xref ref-type="bibr" rid="scirp.72046-ref11">11</xref>] . The dataset contains 22 features extracted from 31 people, of which 23 suffered from PD. As shown in <xref ref-type="table" rid="table1">Table 1</xref>, each column denotes a particular voice feature, and each row corresponds to one of 195 voice recordings from these individuals. The dataset was created by Max Little of the University of Oxford in collaboration with the National Centre for Voice and Speech, Denver, Colorado.</p><p>These extracted features of human voices are used to diagnose PD and to determine who had actually entered the stages of the disease and who were healthy.</p></sec><sec id="s4"><title>4. Method</title><p>This study applies several classification methods, including Na&#239;ve Bayes, SVM, and decision tree (j48) on the PD dataset. The goals of this study are as follows:</p><p>1) Examine which of the above classifiers give better performance, when applied to the actual PD dataset.</p><p>2) Examine the effects of attributes selection for PD dataset on the performances of the mentioned classifiers.</p><p>3) Examine the effects of discretizing PD dataset on the performances of the classifiers.</p><p>Attribute selection, is the process of selecting a subset of relevant features for use in model construction. The central assumption when using a feature selection technique is that the data contains many redundant or irrelevant features [<xref ref-type="bibr" rid="scirp.72046-ref12">12</xref>] . The discretization of</p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> Parkinson disease features</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >No.</th><th align="center" valign="middle" >Feature name</th><th align="center" valign="middle" ></th><th align="center" valign="middle" >Meaning</th></tr></thead><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >MDVP: Fo (Hz)</td><td align="center" valign="middle" >F1</td><td align="center" valign="middle" >Average vocal fundamental frequency</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >MDVP: Fhi (Hz)</td><td align="center" valign="middle" >F2</td><td align="center" valign="middle" >Maximum vocal fundamental frequency</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >MDVP: Flo (Hz)</td><td align="center" valign="middle" >F3</td><td align="center" valign="middle" >Minimum vocal fundamental frequency</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >MDVP: Jitter (%)</td><td align="center" valign="middle" >F4</td><td align="center" valign="middle" >Jitter as percentage</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >MDVP:Jitter(Abs)</td><td align="center" valign="middle" >F5</td><td align="center" valign="middle" >Absolute jitter in micro second</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >MDVP: RAP</td><td align="center" valign="middle" >F6</td><td align="center" valign="middle" >Amplitude perturbation</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >MDVP: PPQ</td><td align="center" valign="middle" >F7</td><td align="center" valign="middle" >Period perturbation quotient</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >Jitter DDP</td><td align="center" valign="middle" >F8</td><td align="center" valign="middle" >Average absolute differences between cycle, divided by the average period.</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >MDVP: Shimmer</td><td align="center" valign="middle" >F9</td><td align="center" valign="middle" >Local shimmer</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >Shimmer dB</td><td align="center" valign="middle" >F10</td><td align="center" valign="middle" >Local shimmer in decibels</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >Shimmer APQ3</td><td align="center" valign="middle" >F11</td><td align="center" valign="middle" >3 points amplitude perturbation quotient</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >Shimmer APQ5</td><td align="center" valign="middle" >F12</td><td align="center" valign="middle" >5 points amplitude perturbation quotient</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >MDVP: APQ</td><td align="center" valign="middle" >F13</td><td align="center" valign="middle" >11 points amplitude perturbation quotient</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >Shimmer DDA</td><td align="center" valign="middle" >F14</td><td align="center" valign="middle" >Absolute differences between the amplitude of consecutive periods.</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >NHR</td><td align="center" valign="middle" >F15</td><td align="center" valign="middle" >Noise-to-harmonic ratio</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >HNR</td><td align="center" valign="middle" >F16</td><td align="center" valign="middle" >Harmonic-to-noise ratio</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >DFA</td><td align="center" valign="middle" >F17</td><td align="center" valign="middle" >Signal fractal scaling exponent</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >PPE</td><td align="center" valign="middle" >F18</td><td align="center" valign="middle" >Pitch period entropy</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >spread1</td><td align="center" valign="middle" >F19</td><td align="center" valign="middle"  rowspan="3"  >Three nonlinear measures of fundamental frequency variation</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >spread2</td><td align="center" valign="middle" >F20</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >RPDE</td><td align="center" valign="middle" >F21</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >D2</td><td align="center" valign="middle" >F22</td><td align="center" valign="middle" >Recurrence period density analysis</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >Status</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Health status of the subject (one) Parkinson’s, (zero) healthy</td></tr></tbody></table></table-wrap><p>a continuous-valued attribute consists of transforming it into a finite number of intervals and to re-encode, for all instances, each value of this attribute by associating it with its corresponding interval. There are many ways to realize this process [<xref ref-type="bibr" rid="scirp.72046-ref13">13</xref>] . In this study, we implement Weka 3.6.11 software; the Weka tools used for attribute selection and discretization are CfsSubsetEval-BestFirst-D1-N5 and Discretize-R first-last, respectively (<xref ref-type="fig" rid="fig1">Figure 1</xref> and <xref ref-type="fig" rid="fig2">Figure 2</xref>).</p><sec id="s4_1"><title>4.1. Na&#239;ve Bayes</title><p>Na&#239;ve Bayes classifier is used in supervised learning method and it is based on “probability” concept to classify new entities. It assigns a new observation to the most probable class. The classification process comprises two stages as follows [<xref ref-type="bibr" rid="scirp.72046-ref14">14</xref>] :</p><fig id="fig1"  position="float"><label><xref ref-type="fig" rid="fig1">Figure 1</xref></label><caption><title> Compute and analysis accuracy for both actual and discretized PD datasets</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/72046x2.png"/></fig><fig id="fig2"  position="float"><label><xref ref-type="fig" rid="fig2">Figure 2</xref></label><caption><title> Compute and analysis accuracy of classifiers for actual PD data with and without attributes selection</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/72046x3.png"/></fig><p>1) Training stage: Using the training samples, the method computes the probability distribution of that sample.</p><p>2) Prediction stage: For test sample, the method computes the posterior probability of that unknown instance. The posterior is predicting that the sample belonging to each class according to the largest posterior probability, which is called Maximum A Posterior (MAP).</p></sec><sec id="s4_2"><title>4.2. SVM</title><p>It is used in supervised learning models with associated learning algorithms that analyze data and recognize patterns used for classification. Given a set of training samples, each marked as belonging to one of two classes, an SVM training algorithm builds a model that assigns new examples into one class or the other, making it a non-probabil- istic binary linear classifier. An SVM model is a representation of the examples as points in space, mapped so that the examples of the separate classes are divided by a clear gap that is as wide as possible. New examples are then mapped into that space and are predicted to belong to a class based on which side of the gap they fall in [<xref ref-type="bibr" rid="scirp.72046-ref15">15</xref>] .</p></sec><sec id="s4_3"><title>4.3. Multilayer Perceptron (MLP)</title><p>MLP network comprises three layers. A three-layer MLP network is an entirely linked feed forward neural network consisting of an input layer, which is not calculated because its neurons are only for demonstration and therefore do no processing. In addition, a hidden layer and an output layer (PD or healthy), which correspond to the categorization result [<xref ref-type="bibr" rid="scirp.72046-ref16">16</xref>] [<xref ref-type="bibr" rid="scirp.72046-ref17">17</xref>] . <xref ref-type="fig" rid="fig3">Figure 3</xref> shows the Architecture of the Multilayer Perceptron Neural Network used. Each neuron in the input and hidden layers is linked to all neurons in the subsequent layer through weighted connections. These neurons calculate the weighted sums of their inputs and add a threshold. These sums are used to calculate the neurons’ actions by applying a sigmoid activation function. The MLP network utilizes the backpropagation algorithm which is a gradient descent method for weight adjustment. The backpropagation MLP is a supervised ANN. This means the network is presented with input example in addition to the resulting desired output.</p></sec><sec id="s4_4"><title>4.4. Decision Tree (j48)</title><p>Decision trees represent a supervised approach to classification. A decision tree is a simple structure where non-terminal nodes represent tests on one or more attributes and terminal nodes reflect decision outcomes. j48 is modified C4.5. The C4.5 algorithm</p><fig id="fig3"  position="float"><label><xref ref-type="fig" rid="fig3">Figure 3</xref></label><caption><title> Architecture of the multilayer perceptron neural network</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/72046x4.png"/></fig><p>generates a classification decision tree for the given dataset by recursive partitioning of data. The decision is grown using depth-first search strategy. The algorithm considers all the possible tests that can split the data set and selects a test that gives the best information gain. For each discrete attribute, one test with outcomes as many as the number of distinct values of the attribute is considered. For each continuous attribute, binary tests involving every distinct value of the attribute are considered. In order to gather the entropy gain of all these binary tests efficiently, the training data set belonging to the considered node is sorted for the values of the continuous attribute. Further, the entropy gains of the binary cut based on each distinct value are calculated in a single pass of the sorted data. This process is repeated for each continuous attributes [<xref ref-type="bibr" rid="scirp.72046-ref18">18</xref>] .</p></sec></sec><sec id="s5"><title>5. Accuracy Analysis</title><p>The supervised learning algorithms are applied one after the other. The confusion matrix is a useful tool that determines how well the classifier classifies the instances of different classes. This also shows values such as true positive (TP), true negative (TN), false positive (FP), and false negative (FN). The classifier accuracy is calculated and a comparative study is done to retrieve the best classifier algorithm.</p></sec><sec id="s6"><title>6. Experimental Results</title><p>The PD dataset was divided as follows: 70% for training and 30% for testing. The experiment was performed on the abovementioned algorithms as follows:</p><p> Apply the abovementioned algorithms one by one on the actual PD dataset without applying filter algorithm. The Na&#239;ve Bayes Algorithm classifies the PD dataset and provides 58.6% accuracy. The SVM yields 86% accuracy. The MLP neural network offers 94.8% accuracy. The decision tree (j48) provides 74% accuracy. <xref ref-type="table" rid="table2">Table 2</xref> shows the accuracy obtained and the value of TP, TN, FP, and FN for each algorithm.</p><p> Using attributes selection algorithm CfsSubsetEval-BestFirst-D1-N5 to the filter PD dataset, the attributes selected were MDVP: Fo (Hz), MDVP: Fhi (Hz), MDVP: Flo (Hz), MDVP: RAP, MDVP:APQ, NHR, Spread1, Spread2, and D2. The accuracy obtained for this case are: Na&#239;ve Bayes, 72.4%; MLP neural network, 91.3%; SVM, 86.2%; and decision tree (j48), 82.7%. <xref ref-type="table" rid="table3">Table 3</xref> shows the accuracy obtained when applying attribute selection algorithm and the value of TP, TN, FP, and FN for each algorithm.</p><table-wrap id="table2" ><label><xref ref-type="table" rid="table2">Table 2</xref></label><caption><title>Shows the accuracy obtained when applying a classifier upon the actual PD dataset</title></caption><table><tbody><thead><tr><th align="center" valign="middle"  rowspan="2"  >Classifier</th><th align="center" valign="middle"  rowspan="2"  >Number of tested Instances</th><th align="center" valign="middle"  colspan="4"  >Confusion Results</th><th align="center" valign="middle"  rowspan="2"  >Accuracy</th></tr></thead><tr><td align="center" valign="middle" >FN</td><td align="center" valign="middle" >FP</td><td align="center" valign="middle" >TN</td><td align="center" valign="middle" >TP</td></tr><tr><td align="center" valign="middle" >Na&#239;ve bayes</td><td align="center" valign="middle" >58 (30%)</td><td align="center" valign="middle" >23</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >24</td><td align="center" valign="middle" >58.6%</td></tr><tr><td align="center" valign="middle" >SVM</td><td align="center" valign="middle" >58 (30%)</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >7</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >46</td><td align="center" valign="middle" >86.2%</td></tr><tr><td align="center" valign="middle" >MLP</td><td align="center" valign="middle" >58 (30%)</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >9</td><td align="center" valign="middle" >46</td><td align="center" valign="middle" >94.8%</td></tr><tr><td align="center" valign="middle" >Decision tree</td><td align="center" valign="middle" >58 (30%)</td><td align="center" valign="middle" >6</td><td align="center" valign="middle" >9</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >38</td><td align="center" valign="middle" >74%</td></tr></tbody></table></table-wrap><table-wrap id="table3" ><label><xref ref-type="table" rid="table3">Table 3</xref></label><caption><title>Shows the accuracy obtained when applying attribute selection algorithm</title></caption><table><tbody><thead><tr><th align="center" valign="middle"  rowspan="2"  >Classifier</th><th align="center" valign="middle"  rowspan="2"  >Number of tested Instances</th><th align="center" valign="middle"  colspan="4"  >Confusion Results</th><th align="center" valign="middle"  rowspan="2"  >Accuracy</th></tr></thead><tr><td align="center" valign="middle" >FN</td><td align="center" valign="middle" >FP</td><td align="center" valign="middle" >TN</td><td align="center" valign="middle" >TP</td></tr><tr><td align="center" valign="middle" >Na&#239;ve bayes</td><td align="center" valign="middle" >58 (30%)</td><td align="center" valign="middle" >14</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >9</td><td align="center" valign="middle" >33</td><td align="center" valign="middle" >72.4%</td></tr><tr><td align="center" valign="middle" >SVM</td><td align="center" valign="middle" >58 (30%)</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >7</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >46</td><td align="center" valign="middle" >86.2%</td></tr><tr><td align="center" valign="middle" >MLP</td><td align="center" valign="middle" >58 (30%)</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >6</td><td align="center" valign="middle" >47</td><td align="center" valign="middle" >91.3%</td></tr><tr><td align="center" valign="middle" >Decision tree</td><td align="center" valign="middle" >58 (30%)</td><td align="center" valign="middle" >7</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >8</td><td align="center" valign="middle" >40</td><td align="center" valign="middle" >82.7%</td></tr></tbody></table></table-wrap><p> Applying the classifiers on discretized PD dataset, we obtained different values of accuracy: Na&#239;ve Bayes, 79.3%; MLP, 94.8%; SVM, 96.5%; and decision tree (j48), 89.6%. <xref ref-type="table" rid="table4">Table 4</xref> shows the accuracy and confusion result for classifiers with the discretized PD dataset.</p><p> When test mode is changed, the classifiers give different values of accuracy. Using cross validation test mode instead of presenting the split of dataset between training and test set, lead to significant change in the accuracy of some classifiers while others showed no change. <xref ref-type="table" rid="table5">Table 5</xref> shows the changes in classifiers’ accuracy upon changing the test mode.</p><p>As a result, we conclude the following:</p><p> Na&#239;ve Bayes gives better performance when it implemented on the discretized PD dataset with cross-validation test mode, yielding 84.6%, which is the best accuracy obtained compared with its performance when implemented on the actual PD data and on selected attributes from PD data.</p><p> SVM yields 96.5%, which is a high accuracy when implemented on discretized PD data and percentage spilt test mode (70% training, 30% test).</p><p> Decision Tree (j48) gives better performance when implemented on discretized PD data yielding 89.6%. Its performance can be enhanced using cross-validation test mode, through which it yields 92.3%.</p><p>The results show that the best performance can be obtained by MLP neural network for both actual and discretized PD data, i.e., 94.8%. Moreover, the attributes selection algorithm and cross-validation test model had no significant effect on MLP performance when it is used in PDclassification (<xref ref-type="fig" rid="fig4">Figure 4</xref> and <xref ref-type="fig" rid="fig5">Figure 5</xref>).</p></sec><sec id="s7"><title>7. Conclusions</title><p>The aim of this study was to recognize how different classifiers would perform when implemented across the PD dataset and to evaluate their performance and examine the effectiveness of attribute selection, discretization, and test mode on the selected classifier performance when implemented on the PD dataset. A comparative study of Na&#239;ve Bayes, SVM, MLP, and decision tree (j48) classifiers on PD dataset is performed. This is done by implementing the classifiers upon the following datasets:</p><p> Actual PD dataset.</p><p> Discretized PD dataset.</p><fig id="fig4"  position="float"><label><xref ref-type="fig" rid="fig4">Figure 4</xref></label><caption><title> Comparison of classification accuracy for classifiers when implemented on the actual PD dataset, discretized PD dataset, and the selected attributes from the PD dataset</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/72046x5.png"/></fig><fig id="fig5"  position="float"><label><xref ref-type="fig" rid="fig5">Figure 5</xref></label><caption><title> Comparison of classification accuracy for classifiers when performed upon the actual PD dataset, discretized PD dataset, and the selected attributes from the PD dataset using 10-fold cross-validation test mode</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/72046x6.png"/></fig><table-wrap id="table4" ><label><xref ref-type="table" rid="table4">Table 4</xref></label><caption><title>Shows the accuracy and confusion result for classifiers with discretized PD dataset</title></caption><table><tbody><thead><tr><th align="center" valign="middle"  rowspan="2"  >Classifier</th><th align="center" valign="middle"  rowspan="2"  >Number of tested Instances</th><th align="center" valign="middle"  colspan="4"  >Confusion Results</th><th align="center" valign="middle"  rowspan="2"  >Accuracy</th></tr></thead><tr><td align="center" valign="middle" >FN</td><td align="center" valign="middle" >FP</td><td align="center" valign="middle" >TN</td><td align="center" valign="middle" >TP</td></tr><tr><td align="center" valign="middle" >Na&#239;ve bayes</td><td align="center" valign="middle" >58 (30%)</td><td align="center" valign="middle" >9</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >8</td><td align="center" valign="middle" >38</td><td align="center" valign="middle" >79.3%</td></tr><tr><td align="center" valign="middle" >SVM</td><td align="center" valign="middle" >58 (30%)</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >46</td><td align="center" valign="middle" >96.5%</td></tr><tr><td align="center" valign="middle" >MLP</td><td align="center" valign="middle" >58 (30%)</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >11</td><td align="center" valign="middle" >44</td><td align="center" valign="middle" >94.8%</td></tr><tr><td align="center" valign="middle" >Decision tree</td><td align="center" valign="middle" >58 (30%)</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >9</td><td align="center" valign="middle" >43</td><td align="center" valign="middle" >89.6%</td></tr></tbody></table></table-wrap><table-wrap id="table5" ><label><xref ref-type="table" rid="table5">Table 5</xref></label><caption><title>Accuracy when using cross-validation testing mode</title></caption><table><tbody><thead><tr><th align="center" valign="middle"  rowspan="2"  >Classifiers</th><th align="center" valign="middle"  colspan="3"  >Testing mode: 10-fold cross-validation</th></tr></thead><tr><td align="center" valign="middle" >Actual PD dataset</td><td align="center" valign="middle" >Applying discretization</td><td align="center" valign="middle" >Applying attributes selection</td></tr><tr><td align="center" valign="middle" >Na&#239;ve Bayes</td><td align="center" valign="middle" >69%</td><td align="center" valign="middle" >84.6</td><td align="center" valign="middle" >77.9</td></tr><tr><td align="center" valign="middle" >SVM</td><td align="center" valign="middle" >87.6%</td><td align="center" valign="middle" >93.8%</td><td align="center" valign="middle" >87.1%</td></tr><tr><td align="center" valign="middle" >Neural network</td><td align="center" valign="middle" >91%</td><td align="center" valign="middle" >91%</td><td align="center" valign="middle" >90%</td></tr><tr><td align="center" valign="middle" >Decision Tree</td><td align="center" valign="middle" >85.6%</td><td align="center" valign="middle" >92.3%</td><td align="center" valign="middle" >87.6%</td></tr></tbody></table></table-wrap><p> Selected set of attributes from PD dataset.</p><p> Shifting between percentage split and 10-fold cross validation test modes.</p><p>From the experimental result, we conclude that Na&#239;ve Bayes and decision tree (j48) yield better accuracy when implemented upon the discretized PD dataset with cross- validation test mode without applying any attributes selection algorithms. SVM gives high accuracy when implemented on discretized PD dataset and splitting dataset (70% for training and 30% for test). The MLP neural network gives the highest accuracy when used to classify actual PD dataset without discretization, attribute selection, or by changing test mode.</p><p>In conclusion, data discretization enhanced the performance of all classifiers except MLP. Attribute selection algorithm increases only the performance of Naive Bayes and Decision Tree (j48). The training methods had no significant impact on all classifiers performances.</p></sec><sec id="s8"><title>Cite this paper</title><p>Mohamed, G.S. (2016) Parkinson’s Disease Diagnosis: De- tecting the Effect of Attributes Selection and Discretization of Parkinson’s Disease Data- set on the Performance of Classifier Algori- thms. Open Access Library Journal, 3: e3139. http://dx.doi.org/10.4236/oalib.1103139</p></sec></body><back><ref-list><title>References</title><ref id="scirp.72046-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Shen-Yang, L., Puvanarajah, S.D. and Ibrahim, N.M. (2011) Parkinson’s Disease: Information for People Living with Parkinson’s. Novartis Corporation (Malaysia) Sdn. Bhd. and Orient Europharma (M) Sdn. Bhd.</mixed-citation></ref><ref id="scirp.72046-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">http://www.pdf.org/en/parkinson_statistics</mixed-citation></ref><ref id="scirp.72046-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">http://www.ninds.nih.gov/disorders/parkinsons_disease/parkinsons_disease_backgrounder.htm</mixed-citation></ref><ref id="scirp.72046-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Islam, M.S., Parvez, I., Deng, H. and Goswami, P. (2014) Performance Comparison of Heterogeneous Classifiers for Detection of Parkinson’s Disease Using Voice Disorder (Dysphonia). 3rd International Conference on Informatics, Electronics &amp; Vision.</mixed-citation></ref><ref id="scirp.72046-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Sharma, A. and Giri, R.N. (2014) Automatic Recognition of Parkinson Disease via Artificial Neural Network and Support Vicyor Machine. IJITEE, 4, 35-41.</mixed-citation></ref><ref id="scirp.72046-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Wu, S. and Guo, J. (2011) A Data Mining Analysis of Parkinson’s Disease. Scientific Research. http://www.SciRp.org/journal</mixed-citation></ref><ref id="scirp.72046-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Ramani, G. and Sivagami, G. (2011) Parkinson Disease Classification Using Data Mining Algorithms. International Journal of Computer Application, 32.</mixed-citation></ref><ref id="scirp.72046-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Hadjahamadi, A.H. and Askari, T.J. (2012) A Detection Support System for Parkinson’s Disease Diagnosis Using Classification and Regression Tree. Journal of Mathematics and Computer Science, 4, 257-263.</mixed-citation></ref><ref id="scirp.72046-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Alemami, Y. and Almazaydeh, L. (2014) Detecting of Parkinson Disease through Voice Signal Features. Journal of American Science, 10.</mixed-citation></ref><ref id="scirp.72046-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Olanrewaju, R.F., Sahari, N.S., Musa, A.A. and Hakiem, N. (2014) Application of Neural Networks in Early Detection and Diagnosis of Parkinson’s Disease. International Conference on Cyber and IT Service Management.</mixed-citation></ref><ref id="scirp.72046-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Little, M.A., McSharry, P.E., Hunter, E.J. and Ramig, L.O. (2008), Suitability of Dysphonia Measurements for Telemonitoring of Parkinson’s Disease. IEEE Transactions on Biomedical Engineering, 56, 1015-1022. http://dx.doi.org/10.1109/TBME.2008.2005954</mixed-citation></ref><ref id="scirp.72046-ref12"><label>12</label><mixed-citation publication-type="book" xlink:type="simple">Muhlenbach, F. and Rakotomalala, R. (2005) Discretization of Continuous Attributes. In: Wang, J., Ed., Encyclopedia of Data Ware-housing and Mining, Idea Group Reference, 397-402.</mixed-citation></ref><ref id="scirp.72046-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Fayyad, U.M. and Irony, K.B. (1993) Multi-Interval Discretization of Continuous Valued Attributes for Classification Learning. 13th International Joint Conference on Artificial Intelligence, 1022-1027.</mixed-citation></ref><ref id="scirp.72046-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">http://www.mathworks.com/help/stats/compactclassificationnaivebayesclass.html?searchHighlight=naive%20bayes%20documentation</mixed-citation></ref><ref id="scirp.72046-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Cristianini, N. and Shawe-Taylor, J. (2000) An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods. Cambridge University Press, Cambridge. http://dx.doi.org/10.1017/CBO9780511801389</mixed-citation></ref><ref id="scirp.72046-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">Haykin, S. (1998) Neural Networks: A Comprehensive Foundation. Prentice-Hall, Englewood Cliffs.</mixed-citation></ref><ref id="scirp.72046-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">CM Bishop. (1995) Neural Networks for Pattern, Recognition. Oxford University Press, Oxford.</mixed-citation></ref><ref id="scirp.72046-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">Zhao, Y.H. and Zhang, Y.X. (2008) Comparison of Decision Tree Methods for Finding Active Objects. Advances in Space Research, 41, 1955-1959. http://dx.doi.org/10.1016/j.asr.2007.07.020</mixed-citation></ref></ref-list></back></article>