alphanumeric journal
The Journal of Operations Research, Statistics, Econometrics and Management Information Systems
A Proposal Method for Missing Value Analysis: Cluster Analysis Approach
bib
Abstract
Imputing values to missing cases is a subject that is frequently met in the fields of Machine Learning and Data Mining, and that require the researchers to study it. It is known that many computer-based analysis algorithms operate under assumption that there is no missing case. The lack of sufficient search of missing case by the researchers is able to negatively affect the performance of analysis results. In this study, it was studied with a data set consisting of 52 variables in order to measure the performance of Corporate Sustainability of district municipalities in Istanbul. Little’s MCAR was applied on 17 variables containing missing case, and it was determined that missing cases were MCAR, namely completely at random. And then Clustering Analysis was applied on 35 variables not containing missing case, and missing case imputations were made based on the clusters formed. It was observed that the cluster labels of municipalities, whose clustering analysis results obtained by data set with 35 variables that didn’t contain missing case, and whose results obtained by the data set with 52 variables following imputation were the same, didn’t change. The lack of change of cluster labels of municipalities indicates that the data set formed following imputation doesn’t draw away from the main data, namely that the data structure doesn’t get disrupted. Consequently, it can be said that clustering analysis is effective in terms of imputing more representative values in the imputation of missing case.
Keywords: Cluster Analysis, K-Nearest Neighbor İmputation Methods, Little’s MCAR Test, Missing Value Analysis
Jel Classification: C46
Suggested citation
(). A Proposal Method for Missing Value Analysis: Cluster Analysis Approach. Alphanumeric Journal, 9(2), 299-310. http://dx.doi.org/10.17093/alphanumeric.970448
References
- Acuna, E., & Rodriguez, C. (2004). The treatment of missing values and its effect on classifier accuracy. In Classification, clustering, and data mining applications (pp. 639-647). Springer, Berlin, Heidelberg.
- Aljuaid, T., & Sasi, S. (2016, August). Proper imputation techniques for missing values in data sets. In 2016 International Conference on Data Science and Engineering (ICDSE) (pp. 1-5). IEEE.
- Alpar, C. (2017). Uygulamalı çok değişkenli istatistiksel yöntemler.
- Bello, A. L. (1995). Imputation techniques in regression analysis: looking closely at their implementation. Computational statistics & data analysis, 20(1), 45-57.
- Chan, L. S., & Dunn, O. J. (1972). The treatment of missing values in discriminant analysis—I. The sampling experiment. Journal of the American Statistical Association, 67(338), 473-477.
- Dixon, J. K. (1979). Pattern recognition with partly missing data. IEEE Transactions on Systems, Man, and Cybernetics, 9(10), 617-621.
- Graham, J. W. (2009). Missing data analysis: Making it work in the real world. Annual review of psychology, 60, 549-576. https://doi.org/10.1146/annurev.psych.58.110405.085530
- Hair, J. F. (2009). Multivariate data analysis.
- Önder, E. (2020). Sağlıkta Gelişmekte Olan Teknolojiler, Yapay Zekâ & R İle Makine Öğrenimi Uygulamaları. Bursa: Dora Yayıncılık.
- Orhunbilge, N. (1999). Zaman Serisi Analizi Tahmin ve Fiyat İndeksleri. İstanbul: Tunç Matbaacılık.
- Özdemir, M. (2020). R ile Programlama ve Makine Öğrenmesi.
- Rencher, A. C., & Schimek, M. G. (1997). Methods of multivariate analysis. Computational Statistics, 12(4), 422-422.
- Rubin, D. B. (1976). Inference and missing data. Biometrika, 63(3), 581-592.
- Scheffer, J. (2002). Dealing with missing data.
- Tresp, V., Neuneier, R., & Ahmad, S. (1995). Efficient methods for dealing with missing data in supervised learning. In Advances in neural information processing systems (pp. 689-696). Morgan Kaufmann Publishers.
- Vinh, N. X., Epps, J., & Bailey, J. (2010). Information theoretic measures for clusterings comparison: Variants, properties, normalization and correction for chance. The Journal of Machine Learning Research, 11, 2837-2854.
- Zhang S., Zhang J., Zhu X., Qin Y., Zhang C. (2008) Missing Value Imputation Based on Data Clustering. In: Gavrilova M.L., Tan C.J.K. (eds) Transactions on Computational Science I. Lecture Notes in Computer Science, vol 4750. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-79299-4_7
2021.09.02.STAT.04
alphanumeric journal
Pages 299-310
Received: July 12, 2021
Accepted: Dec. 31, 2021
Published: Dec. 31, 2021
2021 Arcagök, U., Arıcıgil Çilan, Ç.
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence, which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
scan QR code to access this article from your mobile device
Contact Us
Faculty of Transportation and Logistics, Istanbul University
Beyazit Campus 34452 Fatih/Istanbul/TURKEY
Bahadır Fatih Yıldırım, Ph.D.
editor@alphanumericjournal.com
+ 90 (212) 440 00 00 - 13219
alphanumeric journal
alphanumeric journal has been publishing as "International Peer-Reviewed Journal" every six months since 2013. alphanumeric serves as a vehicle for researchers and practitioners in the field of quantitative methods, and is enabling a process of sharing in all fields related to the operations research, statistics, econometrics and management informations systems in order to enhance the quality on a globe scale.