A Bootstrap Approach to Robust Regression

Dallah, Hamadu
October 2012
International Journal of Applied Science & Technology;Oct2012, Vol. 2 Issue 8, p114
Academic Journal
We focus on the derivation of consistent estimates of the standard deviations of estimates of the parameters of a multiple regression model fitted via a robust procedure, namely, the so-called M (M for maximum likelihood) regression fitting method. M-regression is mostly actualized by way of weighted least squares (WLS). It is common knowledge that most commonly used statistical packages offering WLS assume that the weights are fixed. In this scenario M-regression yields standard errors that are inconsistent and unstable, moreso if the underlying sample is small. The alternative approach on offer in this article is the bootstrap. Using the re-sampling mechanism inherent in bootstrapping, it is demonstrated empirically that bootstrap standard errors are smaller than their M-regression counterparts.


Related Articles

  • Bootstrap-T Technique for Minimax Multivariate Control Chart. Adewara, Johnson A.; Adekeye, Kayode S. // Open Journal of Statistics;Dec2012, Vol. 2 Issue 5, p469 

    Bootstrap methods are considered in the application of statistical process control because they can deal with unknown distributions and are easy to calculate using a personal computer. In this study we propose the use of bootstrap-t multi- variate control technique on the minimax control chart....

  • AN ALTERNATIVE METHOD TO TEST THE RESIDUALS IN A REGRESSION MODEL. Holmes, Donald S.; Mergen, A. Erhan // Proceedings for the Northeast Region Decision Sciences Institute;2008, p679 

    In this paper we propose an alternative method to the Durbin-Watson (DW) test for the fitness of a regression model (see, for example, Makridakis [5, pp. 267-268; 303-304; 630-631] and Wilson & Keating [8, pp. 182-184; 234-236] for DW statistic). The proposed method tests whether the residual...

  • Testing independence and goodness-of-fit in linear models. Sen, A.; Sen, B. // Biometrika;Dec2014, Vol. 101 Issue 4, p927 

    We consider a linear regression model and propose an omnibus test to simultaneously check the assumption of independence between the error and predictor variables and the goodness-of-fit of the parametric model. Our approach is based on testing for independence between the predictor and the...

  • Performance of Nonparametric Regression Estimation with Diverse Covariates. Manzoor, Muhammad Awais; Akbar, Atif; Ullah, Muhammad Aman // Pakistan Journal of Social Sciences (PJSS);2013, Vol. 33 Issue 1, p77 

    The present study evaluates the performance of Nadaraya-Watson (NW) estimation and ordinary least square (OLS) estimation with diverse covariate structures on the basis of simulation study. The covariate structures considered here are; normal, gamma, exponential, weibull, t, laplace and uniform...

  • General formulation of HDMR component functions with independent and correlated variables. Li, Genyuan; Rabitz, Herschel // Journal of Mathematical Chemistry;Jan2012, Vol. 50 Issue 1, p99 

    The High Dimensional Model Representation (HDMR) technique decomposes an n-variate function f ( x) into a finite hierarchical expansion of component functions in terms of the input variables x = ( x, x, . . . , x). The uniqueness of the HDMR component functions is crucial for performing global...

  • Asymptotic normality and strong consistency of LS estimators in the EV regression model with NA errors. Miao, Yu; Zhao, Fangfang; Wang, Ke; Chen, Yanping // Statistical Papers;Feb2013, Vol. 54 Issue 1, p193 

    In this article, the asymptotic normality and strong consistency of the least square estimators for the unknown parameters in the simple linear errors in variables model are established under the assumptions that the errors are stationary negatively associated sequences.

  • Learning Rates of Least-Square Regularized Regression. Qiang Wu; Yiming Ying; Ding-Xuan Zhou // Foundations of Computational Mathematics;May2006, Vol. 6 Issue 2, p171 

    This paper considers the regularized learning algorithm associated with the least-square loss and reproducing kernel Hilbert spaces. The target is the error analysis for the regression problem in learning theory. A novel regularization approach is presented, which yields satisfactory learning...

  • Bootstrap Approach for Estimating Seemingly Unrelated Regressions with Varying Degrees of Autocorrelated Disturbances. Ebukuyo, O. B.; Adepoju, A. A.; Olamide, E. I. // Progress in Applied Mathematics;Apr2013, Vol. 5 Issue 2, p55 

    The Seemingly Unrelated Regressions (SUR) model proposed in 1962 by Arnold Zellner has gained a wide acceptability and its practical use is enormous. In this research, two methods of estimation techniques were examined in the presence of varying degrees of first order Autoregressive [AR(1)]...

  • DIAGNOSTIC IN POISSON REGRESSION MODELS. Algamal, Zakariya Y. // Electronic Journal of Applied Statistical Analysis;2012, Vol. 5 Issue 2, p178 

    Poisson regression model is one of the most frequently used statistical methods as a standard method of data analysis in many fields. Our focus in this paper is on the identification of outliers,we mainly discuss the deviance and Pearson Χ2 as diagnostic statistics in identification....


Read the Article


Sorry, but this item is not currently available from your library.

Try another library?
Sign out of this library

Other Topics