55 / 2015-09-17 12:28:04

Effective prediction of three common diseases by combining SMOTE with Tomek links technique for imbalanced medical data

imbalanced medical data,SMOTE,Tomek links,diabetes,vertebral column pathologies,Parkinson's disease

Diabetes, vertebral column pathologies and Parkinson's disease are three common diseases which have high prevalence and brought great trouble and pain to billions of patients. Traditional diagnosis of these common diseases requires professional physicians who have specialized skills. Computer aided diagnosis can support decision making of physicians. However, imbalanced nature of data sets hampered the mining of medical resources, and therefore effective preprocessing method is important for the classification of imbalanced data. In this study, we proposed a powerful preprocessing method by combining Synthetic Minority Oversampling Technique (SMOTE) with Tomek links technique and then is applied to the imbalanced medical data sets of the three diseases. By using 8 classifiers, we compared the experimental results with those of using only SMOTE technique to evaluate the effectiveness of this method. The results show that the method of SMOTE combined with Tomek links technique is much superior compared with that of using only SMOTE. The performances are evidently better, with 31, 27, 30 out of a total of 32 evaluation metrics are improved for diabetes, Parkinson's disease, and vertebral column, respectively. Moreover, the algorithm of using combined SMOTE and Tomek links technique is much more stable than that of using random oversampling. The average performances are better and the standard deviations are much smaller than that of using random oversampling.