Pengembangan Model Regresi dan Machine Learning untuk Meningkatkan Akurasi Prediksi pada Data Multivariat

Authors

  • Veggy Fikri UIN Fatmawati Sukarno Bengkulu Author

DOI:

https://doi.org/10.67319/kuadran.v1i1.2

Keywords:

multivariate data, regression, machine learning, model validation, predictive accuracy, regularization

Abstract

ABSTRACT

Purpose: This article develops a comparative framework for linear regression, regularized regression, and machine-learning models to improve prediction in multivariate datasets while maintaining transparent assessment of uncertainty.

Design/Methodology: A methodological and analytical literature review examines ordinary least squares, ridge, lasso, elastic net, random forests, gradient boosting, and support vector regression. A reproducible experimental protocol is proposed using preprocessing pipelines, nested cross-validation, and MAE, RMSE, and R-squared; no unperformed empirical experiment is reported.

Findings: Prediction quality depends on variable relationships, sample size, collinearity, nonlinear patterns, and validation design. Regularization can stabilize estimates when predictors are correlated, whereas nonlinear learners may capture interactions but require tuning and controls against overfitting and data leakage.

Practical Implications: Researchers can apply the framework to select appropriate baselines, evaluate models on unseen data, assess subgroup performance, and report sensitivity before deployment.

Originality/Value: The contribution is an integrated evaluation framework linking statistical interpretability, predictive accuracy, feature stability, reproducibility, and domain-aware decisions.

References

Breiman, L. (2001). Random forests. Machine Learning, 45, 5–32. https://doi.org/10.1023/A:1010933404324 DOI: https://doi.org/10.1023/A:1010933404324

Chen, T., & Guestrin, C. (2016). XGBoost: A scalable tree boosting system. Proceedings of KDD, 785–794. https://doi.org/10.1145/2939672.2939785 DOI: https://doi.org/10.1145/2939672.2939785

Chicco, D., Warrens, M. J., & Jurman, G. (2021). The coefficient of determination R-squared is more informative than SMAPE, MAE, MAPE, MSE and RMSE in regression evaluation. PeerJ Computer Science, 7, e623. https://doi.org/10.7717/peerj-cs.623 DOI: https://doi.org/10.7717/peerj-cs.623

Friedman, J. H. (2001). Greedy function approximation: A gradient boosting machine. The Annals of Statistics, 29(5), 1189–1232. https://doi.org/10.1214/aos/1013203451 DOI: https://doi.org/10.1214/aos/1013203451

Géron, A. (2022). Hands-on machine learning with Scikit-Learn, Keras, and TensorFlow (3rd ed.). O’Reilly Media.

Hastie, T., Tibshirani, R., & Friedman, J. (2009). The elements of statistical learning (2nd ed.). Springer. https://doi.org/10.1007/978-0-387-84858-7 DOI: https://doi.org/10.1007/978-0-387-84858-7

James, G., Witten, D., Hastie, T., Tibshirani, R., & Taylor, J. (2023). An introduction to statistical learning: With applications in Python. Springer. https://doi.org/10.1007/978-3-031-38747-0 DOI: https://doi.org/10.1007/978-3-031-38747-0

Kuhn, M., & Johnson, K. (2013). Applied predictive modeling. Springer. https://doi.org/10.1007/978-1-4614-6849-3 DOI: https://doi.org/10.1007/978-1-4614-6849-3

Kuhn, M., & Silge, J. (2022). Tidy modeling with R. O’Reilly Media. https://www.tmwr.org/

Lundberg, S. M., & Lee, S.-I. (2017). A unified approach to interpreting model predictions. Advances in Neural Information Processing Systems, 30.

Molnar, C. (2022). Interpretable machine learning (2nd ed.). https://christophm.github.io/interpretable-ml-book/

Pedregosa, F., et al. (2011). Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12, 2825–2830.

Probst, P., Wright, M. N., & Boulesteix, A.-L. (2019). Hyperparameters and tuning strategies for random forest. WIREs Data Mining and Knowledge Discovery, 9(3), e1301. https://doi.org/10.1002/widm.1301 DOI: https://doi.org/10.1002/widm.1301

Roberts, D. R., et al. (2017). Cross-validation strategies for data with temporal, spatial, hierarchical, or phylogenetic structure. Ecography, 40(8), 913–929. https://doi.org/10.1111/ecog.02881 DOI: https://doi.org/10.1111/ecog.02881

Scikit-learn developers. (2025). Cross-validation: Evaluating estimator performance. https://scikit-learn.org/stable/modules/cross_validation.html

Scikit-learn developers. (2025). Common pitfalls and recommended practices. https://scikit-learn.org/stable/common_pitfalls.html

Steyerberg, E. W. (2019). Clinical prediction models (2nd ed.). Springer. https://doi.org/10.1007/978-3-030-16399-0 DOI: https://doi.org/10.1007/978-3-030-16399-0

Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B, 58(1), 267–288. https://doi.org/10.1111/j.2517-6161.1996.tb02080.x DOI: https://doi.org/10.1111/j.2517-6161.1996.tb02080.x

Varoquaux, G., & Cheplygina, V. (2022). Machine learning for medical imaging: Methodological failures and recommendations for the future. NPJ Digital Medicine, 5, 48. https://doi.org/10.1038/s41746-022-00592-y DOI: https://doi.org/10.1038/s41746-022-00592-y

Zou, H., & Hastie, T. (2005). Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society: Series B, 67(2), 301–320. https://doi.org/10.1111/j.1467-9868.2005.00503.x DOI: https://doi.org/10.1111/j.1467-9868.2005.00503.x

Published

2026-10-12

Issue

Section

Articles

How to Cite

Fikri, V. (2026). Pengembangan Model Regresi dan Machine Learning untuk Meningkatkan Akurasi Prediksi pada Data Multivariat. KUADRAN: Jurnal Analitika Data Dan Ilmu Komputer, 1(1), 15-28. https://doi.org/10.67319/kuadran.v1i1.2