The Comparing of S-estimator and M-estimators in Linear Regression

Çetin, Meral; Toka, Onur
October 2011
Gazi University Journal of Science;2011, Vol. 24 Issue 4, p747
Academic Journal
In the presence of outliers, least squares estimation is inefficient and can be biased. In the 1980's several alternatives to M-estimation were proposed as attempts to overcome the lack of resistance. Least Trimmed Squares (LTS) is a viable alternative and is presently the preferred choice of Rousseeuw and Ryan (1997, 2008). Another proposed solution was S-estimation. This method finds a line that minimizes a robust estimate of the scale of the residuals. This method is highly resistant to leverage points, and is robust to outliers in the response. However, this method was also found to be inefficient. The aim of this study is to compare S-estimator with other robust estimators and the least squares estimators and also an example is given to illustrate the efficiency of S-estimator. The data used in this example are the air pollution measures. And finally a simulation study has been presented in this study.


Related Articles

  • On the Outlier Detection in Nonlinear Regression. Hossein Riazoshams, A.; Midi Habshah Jr., B.; Mohamad Bakri Adam, C. // World Academy of Science, Engineering & Technology;Dec2009, Issue 36, p264 

    The detection of outliers is very essential because of their responsibility for producing huge interpretative problem in linear as well as in nonlinear regression analysis. Much work has been accomplished on the identification of outlier in linear regression, but not in nonlinear regression. In...

  • Methods of Estimation for Autoregressive Models with Outliers. El-Fallah Abd El-Sallam, Moawad // Asian Journal of Mathematics & Statistics;2013, Vol. 6 Issue 2, p57 

    A common problem in autoregressive regression models is outliers, which produces undesirable effects on the least squares estimators. Many regression estimation techniques have been suggested to deal with this problem. The majority of such techniques are developed from the classical least...

  • On a Robust Estimator in Heteroscedastic Regression Model in the Presence of Outliers. Midi, Habshah; Rana, Sohel; Imon, A. H. M. R. // Proceedings of the World Congress on Engineering & Computer Scie;Jul2013, Vol. 1, p1 

    The ordinary least squares (OLS) procedure is inefficient when the underlying assumption of constant error variances (homoscedasticity) is not met. As an alternative, we often used weighted least squares (WLS) procedure which requires a known form of the heteroscedastic errors structures, to...

  • A Heteroscedastic Method for Comparing Regression Lines at Specified Design Points When Using a Robust Regression Estimator. Wilcox, Rand R. // Journal of Data Science;Apr2013, Vol. 11, p281 

    It is well known that the ordinary least squares (OLS) regression estimator is not robust. Many robust regression estimators have been pro- posed and inferential methods based on these estimators have been derived. However, for two independent groups, let θj(X) be some conditional mea- sure...

  • Robust fitting of [11C]-WAY-100635 PET data. Zanderigo, Francesca; Ogden, Robert Todd; Chung Chang; Choy, Stephen; Wong, Andrew; Parsey, Ramin Vaziri // Journal of Cerebral Blood Flow & Metabolism;Jul2010, Vol. 30 Issue 7, p1366 

    Fitting of a positron emission tomography (PET) time–activity curve is typically accomplished according to the least squares (LS) criterion, which is optimal for data having Gaussian distributed errors, but not robust in the presence of outliers. Conversely, quantile regression (QR)...

  • TELBS robust linear regression method. Tabatabai, M. A.; Eby, W. M.; Li, H.; Bae, S.; Singh, K. P. // Open Access Medical Statistics;2012 Part 2, Vol. 2, p65 

    Ordinary least squares estimates can behave badly when outlines are present. An alternative is to use a robust regression technique that can handle outliers and influential observations. We introduce a new robust estimation method called TELBS robust regression method. We also introduce a new...

  • THE PERFORMANCE OF ROBUST-DIAGNOSTIC F IN THE IDENTIFICATION OF MULTIPLE HIGH LEVERAGE POINTS. Midi, Habshah; Abu Bakar, Nor Mazlina // Pakistan Journal of Statistics;Sep2015, Vol. 31 Issue 5, p461 

    High leverage points have undue effects on the Least Square estimates. They are responsible for misleading conclusions in regression and multicollinearity problems. Hence, it is imperative to detect high leverage points and use robust estimators to estimate the parameters of a regression model,...

  • FUZZY LEAST SQUARE MODEL SENSITIVITY TO OUTLIERS. Onoghojobi, B.; Olewuezi, N. P. // Advances in Fuzzy Sets & Systems;2015, Vol. 20 Issue 2, p133 

    Possibilistic model has been very successful when dealing with fuzzy regression, but has limitations with respect to its sensitivity to outliers. In this paper, we use the fuzzy least squares to detect outliers and examined their influence. Using the basic idea underlying outliers' detection in...

  • The equality of OLS and GLS estimators in the linear regression model when the disturbances are spatially correlated. Gotu, Butte // Statistical Papers;2001, Vol. 42 Issue 2, p253 

    Discusses the necessary and sufficient condition for the equality of ordinary least squares (OLS) and generalized least squares estimators in the linear regression model with first-order spatial error processes. Notation of the linear regression model for spatial correlation; Equality of OLS...


Read the Article


Sorry, but this item is not currently available from your library.

Try another library?
Sign out of this library

Other Topics