Achmad Efendi, Zuraidah Zuraidah, Dewi S. Susanti, Naomi N. Debataraja, Ratno B.E. Wibowo, Samingun Handoyo
The Principal Component Analysis (PCA) is widely used for modeling in both statistical and machine learning domains. However, PCA’s orthogonal components may not always be independent. This research aims to compare PCA and Independent Component Analysis (ICA) using simulation and empirical data and to evaluate a Decision Tree (DT) model. Two scenarios of simulation data with linear and nonlinear relationships, along with two empirical datasets were analyzed. PCA was used to project the dataset, while ICA was applied to the 6th to 10th and the 5th to 9th principal components. Both PCA and ICA resulted in projection data with zero correlation values. Scatter plots of PCA projection on nonlinear simulation data indicated consistent underlying patterns, whereas ICA projection revealed sparse patterns on both simulation datasets. The DT model utilizing 7 independent components emerged as the optimal model, displaying superior performance across accuracy, precision, recall, F1 score, Mathew’s Correlation Coefficient, and Area Under Curve metrics. Copyright © 2025 International Academic Press
Statistics Department, Universitas Brawijaya, East Java, Malang, Indonesia; Islamic Banking Study Program, State Islamic Institute of Kediri, East Java, Kediri, Indonesia; Statistics Study Program, Lambung Mangkurat University, Banjarbaru, South Kalimantan, Indonesia; Statistics Study Program, Tanjungpura University, West Kalimantan, Pontianak, Indonesia; Mathematics Department, Universitas Brawijaya, East Java, Malang, Indonesia; EECS-IGP Department, National Yang Ming Chiao Tung University, Hsinchu, Taiwan
