parkinson 's disease was first introduced in 1817 by doctor james parkinson as  shaking palsy  .
it is the second common neurological disease coming afterwards alzheimer and is mostly common among elders [ 2 , 3 ] .
pd is a kind of progressive disease in which an area of brain becomes damaged over the years .
, these signs and symptoms can be grouped into two major categories : motor symptoms and nonmotor symptoms .
motor symptoms are those that affect movement and muscles and nonmotor symptoms include neurobehavioral and cognitive problems , sleep problems , sensory problems , and autonomic neuropathy ( dysautonomia ) .
research has shown that about 90% of pwp are affected with motor problems , especially speech impairment [ 5 , 6 ] .
in addition to the prevalence of vocal impairments in pd patients , gathering speech samples and doing signal processing of their voice has low cost and it is appropriate for telemonitoring and telediagnosis systems [ 7 , 8 ] .
therefore , pd diagnosis from speech impairments is becoming more widespread . in parkinsonism patients ,
speech disorders result from neurologic impairments which are associated with weakness , slowness , or incoordination of the muscles used to produce speech [ 9 , 10 ] .
speech disturbance usually occurs in the following forms : hypophonia , which is soft speech that results from weakness in the vocal musculature , monotonic speech , which deals with speech quality in the cases that are soft , hoarse , and monotonous , and festination speech , which is when the speech becomes excessively rapid , soft , breathy , and poorly intelligible .
many approaches have been proposed in order to find the severity of each speech impairment sign .
there are two types of the best known vocal tests for this purpose : sustained phonation [ 11 , 12 ] and running speech   tests .
in sustained phonation , the patient is asked to say a single vowel , while holding its pitch as constant and long as possible . in running speech
, the patient says a standard sentence which includes representative linguistic units that can show possible impairment signs of vocal disorder .
previous researches had two main flaws : ( a ) all the voice samples were classified by a single classifier ; ( b ) the vocal samples of each subject were summarized with the help of statistical metrics irrespective of discriminating ability of each vocal test . since most studies in the area of pd detections based on speech are done on datasets gathered on just one or a few types of vocal tests , we have brought our attention to a dataset with multiple sound recordings .
the main contributions of this study are twofold : ( 1 ) to suggest a new distinctive classification framework which proposes to apply a unique classifier to vocal samples of each type , for example , have a classifier just for vowel  a ,  rather than applying a single classifier for all vocals and ( 2 ) to present which vocal tests are more representative and to indirectly omit less discriminating vocal tests by embedding majority voting in our proposed method .
section 2 reviews previous studies of this domain . in section 3 , a brief description of the dataset , evaluation metrics , and the proposed method can be found .  
section 4 demonstrates the results of this work and , finally , section 5 presents the conclusion of this study .
in recent years the detection of vocal disorders with the help of machine learning turned into a hot topic .
various research papers have attempted to solve this problem by considering acoustic measurements of dysphonia as effective features to distinguish normal ( control ) from disordered cases [ 7 , 8 , 13 , 14 ] .
studies in this field can be categorized into two main groups : ( 1 ) those that attempt to find the most effective vocal features and produce new datasets [ 8 , 13 , 15 ] and ( 2 ) those that try to find more effective features from existing datasets and concentrate on enhancing classification accuracy [ 14 , 1626 ] .
their work led to the introduction of a new dysphonia measurement named as ppe ( pitch period entropy ) . in their study ,
phonations from 31 subjects of which 23 were pd patients and they reached the classification accuracy of 91.4% . in , sakar et al .
each individual was trained to say a set of 26 distinct disorder representative terms consisting of sustained vowels , words , numbers , and short sentences .
they applied summarized leave - one - out ( s - loo ) validation technique in which all the voice samples of each individual will be summarized using central tendency and dispersion metrics such as median , mean , standard deviation , trimmed mean , interquartile range , and mean absolute deviation .
tsanas et al . in   focused on monitoring the pd progression with the help of extracted features using signal processing techniques applied on a huge dataset of about 6000 voice samples from 42 patients with early - stage pd .
they have attempted to estimate the unified parkinson 's disease rating scale ( updrs ) using linear and nonlinear regression .
these three datasets are the main publicly available datasets of pd speech - based area of study .
computed 132 dysphonia new measurements using an existing dataset consisting of 263 vowels  ahh   phonations from 43 cases by applying feature selection techniques .
kursun   tried to assess the relevance and correlation between the features and pd score by applying mutual information - based selection algorithm with permutation test and feed the data with selected features ranked based on maximum - relevance - minimum - redundancy ( mrmr ) into an svm classifier .
they used leave - one - subject - out ( loso ) as the cross validation technique of their model in order to avoid bias . in loso validation scheme ,
all the voice samples of an individual which is the candidate of being the testing sample will be left out from the rest of the data .
shahbaba and neal   presented a nonlinear model based on dirichlet mixtures and obtained the classification accuracy of 87.7% .
das   conducted a comparative study of neural networks ( nn ) , dmneural , regression , and decision trees for pd diagnosis ; their study resulted in classification performance of 92.9% based on nn .
applied a combination of genetic programming and the expectation maximization ( em ) and obtained a classification accuracy of 93.1% .
luukka   proposed a method that used fuzzy entropy measures and similarity classifier and resulted in the mean accuracy of 85.03% .
introduced a fuzzy - based nonlinear transformation approach combined with svm ; their best classification accuracy was 93.47% .
ozcift and gulten   proposed classifier ensemble construction with a rotation forest approach which got classification accuracy of 87.13% .
strm and koker   achieved the classification accuracy of 91.2% by using a parallel neural network model .
polat   applied the fuzzy c - means clustering feature weighting together with the k - nearest neighbor classifier ; their best obtained classification accuracy was 97.93% .
chen et al .   proposed a model which combined pca and the fuzzy k - nearest neighbor method ; their classification approach achieved an accuracy of 96.07% .
used a diagnosis model based on particle swarm optimization ( pso ) to strengthen the fuzzy k - nearest neighbor classifier which resulted in mean classification accuracy of 97.47% . in most of the studies ,
svm was used as the base classifier to distinguish healthy subjects from pwp [ 8 , 14 , 27 ] and the success of the diagnostic system is measured with roc curves , auc , and reporting true positive and false positive rates .
the speech datasets used in the field of pd diagnosis consist of multiple speech recordings per subject .
these datasets can be grouped into two categories : ( 1 ) those that contain the repetition of one term and ( 2 ) those that consist of different vocal terms .
hence , most of the studies on pd diagnosis are conducted on these datasets [ 14 , 1626 ] ; however , none of them could obtain 100% classification accuracy .
parkinson 's data set    and  parkinson 's telemonitoring data set  , both accessible from uci machine learning repository .
the only dataset of the second category that is available in the form of processed data matrix was produced by sakar et al . .
less research has been conducted on this type of datasets ; also , corresponding classification accuracies are not promising up to this time .
the aim of this study is to show that this type of data collection can lead to high pd detection rates just by altering the classification strategy .
in this work we used parkinson speech dataset with multiple types of sound recordings , which is available on the university of california , irvine ( uci ) machine learning dataset repository website .
this dataset consists of 40 subjects , including 20 pd patients and 20 control subjects . for each subject , 26 different sound recordings have been gathered , consisting of three sustained vowels , numbers one through 10 , nine words , and four short sentences .
table 1 lists the features gathered in sakar et al . 's work and their corresponding groups ( see   for more details ) .
the aim of this paper is to propose a classification framework which focuses on the discriminating values of each vocal test . unlike the conventional loso cross validation technique and s - loo ,
the proposed methodology considers that all the recordings in the setting of the dataset are not necessarily discriminating and not every pd patient demonstrates distinguishable vocal disorders in all vocal tests .
the four steps of the proposed methodology are ( 1 ) separating the dataset based on the types of sounds recorded , ( 2 ) applying feature selection with pearson correlation coefficient , we called the two approaches we took as follows : ( a ) multiple - classifier with feature selection ( mcfs ) and ( b ) adjusted multiple - classifier with feature selection ( a - mcfs ) which will be introduced shortly , ( 3 ) applying a classifier on each subset , and finally ( 4 ) fusing the results of all classifiers to obtain the final decision by means of majority voting .
each subset of the dataset includes all the vocal tests of the same type ; for instance , all the recorded vowel sounds of type  a  go to the first subset and those of 
thus , considering the present dataset , there are 26 subsets , each containing 40 samples .
separation has been done since the mixture of all the voice samples of an individual diminishes the discriminating effect of more descriptive tests and it will affect the classification results negatively . ( 2 ) pearson correlation coefficient feature selection . for feature selection phase , a filter - based feature selection technique based on pearson correlation coefficient [ 3032 ]
a more precise definition of this feature selection is as follows : suppose that each feature consists of { x1 , x2 ,  , xn } values for samples 1 through n ( in this study n is equal to 40 ) in vector x and the corresponding class labels are { y1 , y2 ,  , yn } stored in vector y. so the pearson correlation coefficient of each feature can be calculated as(1)r = rxy=i=1nxixyiyi=1nxix2i=1nyiy2,where x-=(1/n)i=1nxi and similarly y-=(1/n)i=1nyi .
this equation gives a value between 1 and + 1 , where + 1 is maximum positive correlation , 0 is no correlation , and 1 is the strongest negative correlation .
the p values were calculated using student 's t - distribution for a transformation of the correlation . those features in the correlation coefficient matrix with p values
( 3 ) mcfs and a - mcfs . when the pearson correlation coefficient feature selection is applied
the first is the mcfs approach ; the vocal tests are used in the analysis only based on the prevalent features of other vocal tests .  
table 2 shows each vocal test and its corresponding correlated features after applying feature selection and figure 2 shows the frequency of each feature .
features 2 and 4 with frequency of six and five were , respectively , the most frequent selected features .
the third most frequent was shared by features 25 and 26 with frequency of four .
the most four frequent features were used in mcfs as selected features for unsuccessful vocal tests .
the other methodology , a - mcfs , is to simply omit unsuccessful vocal tests .
( 4 ) classification and majority voting . after doing feature selection on each subset , for each of them
leave - one - out cross validation technique was used for all of these classifiers .
since each subject has only one record in each subset , we do not have to worry about how to treat each subject for doing cross validation as it was the case in loso or previous approaches .
then , the subject whom the majority of the classifiers have voted to be a pd patient will be labeled as  1  showing the presence of pd and  0  otherwise .
the evaluation metrics used to show the effectiveness of the proposed methodology are accuracy , sensitivity , specificity , and matthew 's correlation coefficient score ( mcc ) .
the definitions of these metrics are as follows:(2)accuracy = tp+tntp+tn+fp+fn , where tp ( true positive ) is the number of pd patients who are correctly classified as parkinsonism patients by the model , tn ( true negative ) is the number of control subjects who are labeled as healthy by the model , fn ( false negative ) is the number of patients that the model falsely labeled them as healthy , and finally fp ( false positive ) is the number of healthy cases who are incorrectly labeled as having pd by the classifier .
it simply shows that the accuracy is the ratio of the correctly classified samples to the total number of instances:(3)sensitivity = tptp+fnspecificity = tntn+fp .
a well - known metric in machine learning which can be used for evaluating the quality of a binary classifier is mcc .
this metric is reliable since it takes tp , tn , fn , and fp into account and this makes it stable even if classes are of very different sizes . actually , mcc is a correlation coefficient between observed ( actual ) labels of the samples and those predicted by the binary classifier : ( 4)mcc = tptnfpfntp+fptp+fntn+fptn+fn.this equation returns a value between 1 and + 1 .
a coefficient of + 1 shows a perfect prediction , 0 represents the fact that the classifier is not better than random guessing , and finally 1 indicates a complete disagreement between the actual values and the predicted ones .
after separating the data into subsets , the z - score normalization process was applied on each subset . in other words , after transformation , mean is equal to zero and standard deviation changes to one
four classifiers including k - nn , svm , discriminant analysis , and nave bayes were applied to the preprocessed data .
distance metric used for the k - nn classifier was euclidean distance and k with values of 1 , 3 , 5 , and 7 was used .
svm classifier was applied using linear and radial basis kernels ( rbf ) with scaling factor ( sigma ) of 3 and penalty parameter ( c ) of 1 .  
table 3 includes the accuracy , sensitivity , specificity , and mcc obtained from applying mentioned classifiers under loso , s - loo , and the proposed frameworks .
the results reveal that k - nn classifier performance is almost analogous to random guessing when it is used with loso cross validation technique . besides that , s - loo could not perform much better than loso when it comes to k - nn since its best overall accuracy and mcc are 65.00% and 0.3062 , respectively .
results show that a - mcfs outperforms s - loo 's best result with overall accuracy of 77.50% , which is a 12.5% improvement and mcc of 0.5507 . when k is 1 , 3 , and 5 , mcfs results are better than s - loo at least for 5% and at most 12.5% , but its accuracy is 2.5% lower than s - loo when k is 7 .
sensitivity is another important factor , especially in biomedical sciences , which should be investigated closely in the results .
as the results show , a - mcfs also has improved the sensitivity up to 80.00% and its lowest sensitivity ( 70.00% ) is still better than that of loso and s - loo when k - nn is used .
k - nn achieved its best results when a - mcfs was applied ; besides this , loso and s - loo could not reach mcfs 's results except for k = 7 .
in addition , the best classification accuracy obtained by applying a - mcfs is 87.5% which is a 10% accuracy enhancement in comparison to the best accuracy obtained by s - loo . 

figure 3 gives a better demonstration of classification accuracies obtained by different methods . in order to examine the correctness of our approach toward finding less discriminating vocal tests ,
we have reported the classification accuracy of each vocal test prior to the majority voting phase .
the results are shown in table 4 . comparing the results shown in tables 2 and 4
reveals that the features which were excluded in a - mcfs are those that achieved a mean accuracy of below 55% .
this shows the reason of the superiority of a - mcfs over mcfs . as a result ,
finding a solution toward discriminating pd patients from the healthy people based on different vocal tests had been less accurate since all the vocal terms were treated by a single classifier .
the proposed method treated each vocal test separately and used majority voting to resolve any potential confusion .
obtained results from this research showed that more accurate pd detection based on multiple vocal tests is achievable .
another important result , achieved from this study , was that the discriminating ability of all the vocal terms is not the same , even some of those vocal terms that have been considered to be discriminating in the literature , such as vowel  a ,  failed to be successful .
as a result , our study may encourage other researchers to conduct further studies on different vocal terms from the proposed perspective .
as the future work , we plan to devise a laboratory setting to collect data from pwp and healthy subjects with several vocal tests from various languages and extend our results to other languages .
 recently , speech pattern analysis applications in building predictive telediagnosis and telemonitoring models for diagnosing parkinson 's disease ( pd ) have attracted many researchers . for this purpose , 
 several datasets of voice samples exist ; the uci dataset named  
 parkinson speech dataset with multiple types of sound recordings  has a variety of vocal tests , which include sustained vowels , words , numbers , and short sentences compiled from a set of speaking exercises for healthy and people with parkinson 's disease ( pwp ) . 
 some researchers claim that summarizing the multiple recordings of each subject with the central tendency and dispersion metrics is an efficient strategy in building a predictive model for pd . 
 however , they have overlooked the point that a pd patient may show more difficulty in pronouncing certain terms than the other terms . 
 thus , summarizing the vocal tests may lead into loss of valuable information . in order to address this issue 
 , the classification setting must take what has been said into account . as a solution 
 , we introduced a new framework that applies an independent classifier for each vocal test . 
 the final classification result would be a majority vote from all of the classifiers . 
 when our methodology comes with filter - based feature selection , it enhances classification accuracy up to 15% . 
1. Introduction
2. Related Work
3. Materials and Methods
4. Results and Discussions
5. Conclusion