Bootstrapping Residuals to Estimate the Standard Error of Simple Linear Regression Coefficients

Muhammad Hasan Sidiq Kurniawan


Regression models are the statistical methods that widely used in many fields. The models allow relatively simple analysis of complicated situations. The aim of the regression models is to analyze the relationship between the predictor and response. In order to do that, we have to estimate the regression coefficient. In case of simple linear regression, the method to estimate the regression coefficient is either least square method or maximum likelihood estimation. Also, the standard error of the regression coefficient is being estimated. In this paper, we apply the bootstrap method to estimate the standard error of the regression coefficient. We compare the result of the bootstrapping method with the least square method. From this study, we know that the standard error estimation value of regression model using the bootstrap method is close to the value if we use the least square method. So we can say that the bootstrap method can be used to estimate the standard error of another regression models coefficient which does not have the closed-form formula


bootstrap; simple linear regression; least square; residuals; standard error

Full Text:



Chatterjee, S., Price, B. 1977. Regression Analysis by Example. John Wiley & Sons, Inc. New York [2]

Draper, N., Smith, H. 1992. Analisis Regresi Terapan Edisi Kedua. PT Gramedia Pustaka Utama. Jakarta

Effron, B., Tibshirani, R.J. 1993. An Introduction to the Bootstrap. Chapman & Hall. London

Kreiss, J. P., Paparoditis, E. 2015. Bootstrapping Locally Stationary Processes. Journal of The Royal Statistical Society. B, 77, 267-290

Article Metrics

Abstract view : 243 times
PDF - 155 times

Article Metrics

Metrics Loading ...

Metrics powered by PLOS ALM