Main Article Content
Abstract
Regression models are the statistical methods that widely used in many fields. The models allow relatively simple analysis of complicated situations. The aim of the regression models is to analyze the relationship between the predictor and response. In order to do that, we have to estimate the regression coefficient. In case of simple linear regression, the method to estimate the regression coefficient is either least square method or maximum likelihood estimation. Also, the standard error of the regression coefficient is being estimated. In this paper, we apply the bootstrap method to estimate the standard error of the regression coefficient. We compare the result of the bootstrapping method with the least square method. From this study, we know that the standard error estimation value of regression model using the bootstrap method is close to the value if we use the least square method. So we can say that the bootstrap method can be used to estimate the standard error of another regression models coefficient which does not have the closed-form formula
Keywords
bootstrap
simple linear regression
least square
residuals
standard error
Article Details
License
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
How to Cite
Kurniawan, M. H. S. (2016). Bootstrapping Residuals to Estimate the Standard Error of Simple Linear Regression Coefficients. EKSAKTA: Journal of Sciences and Data Analysis, 16(2), 64–69. https://doi.org/10.20885/eksakta.vol16.iss2.art1
References
- Chatterjee, S., Price, B. 1977. Regression Analysis by Example. John Wiley & Sons, Inc. New York [2]
- Draper, N., Smith, H. 1992. Analisis Regresi Terapan Edisi Kedua. PT Gramedia Pustaka Utama. Jakarta
- Effron, B., Tibshirani, R.J. 1993. An Introduction to the Bootstrap. Chapman & Hall. London
- Kreiss, J. P., Paparoditis, E. 2015. Bootstrapping Locally Stationary Processes. Journal of The Royal Statistical Society. B, 77, 267-290
References
Chatterjee, S., Price, B. 1977. Regression Analysis by Example. John Wiley & Sons, Inc. New York [2]
Draper, N., Smith, H. 1992. Analisis Regresi Terapan Edisi Kedua. PT Gramedia Pustaka Utama. Jakarta
Effron, B., Tibshirani, R.J. 1993. An Introduction to the Bootstrap. Chapman & Hall. London
Kreiss, J. P., Paparoditis, E. 2015. Bootstrapping Locally Stationary Processes. Journal of The Royal Statistical Society. B, 77, 267-290