Bootstrap Estimation of Confidence Intervals of Multiple Regression Model Parameters in the Presence of Multicollinearity Using Principal Component Analysis

Chindy Eskana  Nababan; Elmanani  Simamora

doi:10.55927/fjas.v2i1.2851

Authors

Chindy Eskana Nababan Universitas Negeri Medan
Elmanani Simamora Universitas Negeri Medan

DOI:

https://doi.org/10.55927/fjas.v2i1.2851

Keywords:

Bootstrap Confidence Interval, Classical Confidence Interval, Multicollinearity, Principal Component Regression

Abstract

Multicollinearity in multiple regression can result in biased parameter estimators and increase the risk of accepting the null hypothesis of the regression model as an insignificant variable. This study aims to determine the use of the Principal Component Analysis method in overcoming multicollinearity problems that occur in Facebook metric data and to implement the use of the PCA (Principal Component Analysis) method with Bootstrap in overcoming multicollinearity problems that occur in Facebook metric data. One method that can be used to overcome multicollinearity is principal component regression analysis. Principal component regression will produce a point estimate. To measure the accuracy of the point estimation, the bootstrap method can be used, which generates confidence intervals by resampling the data with returns. The results of this study indicate that the problem of multicollinearity in Facebook metric data can be resolved using Principal component analysis and point estimation and classical confidence intervals in principal component regression are not significantly different from the results of estimated means and bootstrap confidence intervals.

Downloads

Download data is not yet available.

References

A.Conlin, E. Martin, A. Morris (2000)Confidence limits for contribution plots, Journal of Chemometrics,725–736.

Bawono, A. & Shina, A. (2018). Ekonometrika Terapan. Salatiga: LP2M IAIN Salatiga.

Bronman L. Do Almetrics Point to the Broader Impact of Research? An Overview of Benefits and Disadvantages of Almetrics. Journal of Infometrics, 8 (4), 2014.

DiCiccio dan Efron. (1996). Bootstrap confidence intervals. Stat.Sci. 11(3):189–212.

Efron, B., dan Tibshirani, R. J., (1993): An Introduction to the Bootstrap, Chapman and Hall, New York.

Fisher,N.I.(1995).Statistical Analysis of Circular Data. Cambridge: Cambridge University Press.

Hall, P. (1988). On Symetric Bootstrap Confidence Intervals. Journal of the Royal Statistical Society. Series B (methodological), 50 : 35– 45.

Hillier, F. S. & Lieberman, G. J. (2001). Introduction to Operations Research, Seventh Edition, The McGraw-Hill Companies, Inc., New York.

Iskandar, R., M.N.Mara dan N.Satyahadewi.(2013).Perbandingan Metode Bootstrap dan Jackknife dalam Menaksir Parameter Regresi untuk Mengatasi Multikolinearitas. Buletin Ilmiah Matematika Statistika dan Terapannya (Bimaster), 2 (2) : 137-146.

Jollife, I.T. (2002). Principal Component Analysis, Second Edition. New York : Springer.

Marzuki,dkk. (2010).Pendugaan Selang Kepercayaan Persentil Bootstrap Nonparametrik untuk Parameter Regresi ,Jurnal Statistika.10(1) :13-23.

Mega Kusuma.,F.Arief.W. (2017). Principal Component Analysis (PCA) untuk mengatasi multikolinearitas terhadap faktor angka kejadian Pneumonia balita di jawa timur. Jurnal Biometrika dan Kependudukan.6(2):89-97.

Montgomery, D.C. & E.A. Peck. 1991. Introduction to Linear Regression Analysis, Second Edition. New York: John Wiley and Sons, Inc.

Sahinler, S., dan Topuz, D., (2007): Bootstrap and Jackknife Resampling Algorithms for Estimation of Regression Parameters, JAQM, (2), 188-199.

Soemartini. (2008). Principal Component Analysis sebagai salah Satu metode mengatasi masalah multikolinearitas. Jatinangor: FMIPA Universitas Padjadjaran.

Solih,A. (2015). Estimasi Confidence Interval Bootstrap Untuk Analisis Data Sampel Terbatas.9(1).

Sudjarat,A. (2016).PCA dalam mengatasi multikolinearitas pada faktor yang mempengarui AHH Penduduk Jawa Timur.Surabaya:FKM,Universitas Airlangga.hal.34-35.

Suhaeni, C.,Made,S. & Anik,D. (2012). Bootstrap Confidence Interval Estimation of Mean Direction for Circular Data,Journal of statistics.17(2) :1-8.

Sungkono, J., (2013): Resampling Bootstrap pada R, Magistra, (84 Th XXV).

Witten. I. H, Fran, E., & Hall, M. A. 2011. Data Mining Practical Machine Learning Tools and Techniques (3rd ed). USA: Elsevier. ISBN 978-0-12-374856-0.