A model selection method for S-estimation
AbstractCleaning data or removing some data periods in least squares (LS) regression analysis is not unusual. This practice indicates that a researcher sometimes desires to estimate the parameter value, with which the regression function fits a large fraction of individuals or events in the population (behind the original data set), possibly exhibiting poor fits to some atypical individuals or events. The S-estimators are a class of estimators that are consistent with the researcher's desire in such situations. In this paper, we propose a method of model selection suitable in the S-estimation. The proposed method chooses a model that minimizes a criterion named the penalised S-scale criterion (PSC), which is decreasing in the sample S-scale of fitted residuals and increasing in the number of parameters. We study the large sample behavior of the PSC in nonlinear regression with dependent, heterogeneous data, to establish sets of conditions sufficient for the PSC to consistently select the best-fitting, most parsimonious model. Our analysis allows for partial unidentifiability, which is an important possibility when selecting one among non-linear regression models. We conduct Monte Carlo simulations to verify that a particular PSC called the PSC-S is at least as trustworthy as the Schwarz information criterion, often used in the LS regression. Copyright Royal Economic Society 2007
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Bibliographic InfoArticle provided by Royal Economic Society in its journal Econometrics Journal.
Volume (Year): 10 (2007)
Issue (Month): 2 (07)
Contact details of provider:
Postal: Office of the Secretary-General, School of Economics and Finance, University of St. Andrews, St. Andrews, Fife, KY16 9AL, UK
Phone: +44 1334 462479
Web page: http://www.res.org.uk/
More information through EDIRC
Other versions of this item:
- C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models &bull Diffusion Processes
- C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Andrews, Donald W.K., 1992.
"Generic Uniform Convergence,"
Cambridge University Press, vol. 8(02), pages 241-257, June.
- Baci, Sidika & Zaman, Asad, 1998. "Effects of skewness and kurtosis on model selection criteria," Economics Letters, Elsevier, vol. 59(1), pages 17-22, April.
- Bierens, H.J. & Ploberger, W., 1995.
"Asymptotic theory of integrated conditional moment tests,"
1995-124, Tilburg University, Center for Economic Research.
- Herman J. Bierens & Werner Ploberger, 1997. "Asymptotic Theory of Integrated Conditional Moment Tests," Econometrica, Econometric Society, vol. 65(5), pages 1129-1152, September.
- van Dijk, D.J.C. & Franses, Ph.H.B.F. & Lucas, A., 1996.
"Testing for Smooth Transition Nonlinearity in the Presence of Outliers,"
Econometric Institute Research Papers
EI 9622-/A, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
- Van Dijk, Dick & Franses, Philip Hans & Lucas, Andre, 1999. "Testing for Smooth Transition Nonlinearity in the Presence of Outliers," Journal of Business & Economic Statistics, American Statistical Association, vol. 17(2), pages 217-35, April.
- Sin, Chor-Yiu & White, Halbert, 1996. "Information criteria for selecting possibly misspecified parametric models," Journal of Econometrics, Elsevier, vol. 71(1-2), pages 207-225.
- Balke, Nathan S & Fomby, Thomas B, 1994.
"Large Shocks, Small Shocks, and Economic Fluctuations: Outliers in Macroeconomic Time Series,"
Journal of Applied Econometrics,
John Wiley & Sons, Ltd., vol. 9(2), pages 181-200, April-Jun.
- Nathan S. Balke & Thomas B. Fomby, 1991. "Large shocks, small shocks, and economic fluctuations: outliers in macroeconomic times series," Research Paper 9101, Federal Reserve Bank of Dallas.
- Lucas, Andre, 1995. "An outlier robust unit root test with an application to the extended Nelson-Plosser data," Journal of Econometrics, Elsevier, vol. 66(1-2), pages 153-173.
- Chung-Ming Kuan, 2006. "Artificial Neural Networks," IEAS Working Paper : academic research 06-A010, Institute of Economics, Academia Sinica, Taipei, Taiwan.
- Nishii, R., 1988. "Maximum likelihood principle and model selection when the true model is unspecified," Journal of Multivariate Analysis, Elsevier, vol. 27(2), pages 392-403, November.
- Robert B. Davies, 2002. "Hypothesis testing when a nuisance parameter is present only under the alternative: Linear model case," Biometrika, Biometrika Trust, vol. 89(2), pages 484-489, June.
- Hansen, Bruce E, 1996.
"Inference When a Nuisance Parameter Is Not Identified under the Null Hypothesis,"
Econometric Society, vol. 64(2), pages 413-30, March.
- Hansen, B.E., 1991. "Inference when a Nuisance Parameter is Not Identified Under the Null Hypothesis," RCER Working Papers 296, University of Rochester - Center for Economic Research (RCER).
- Tom Doan, . "TAR: RATS procedure to estimate a threshold autoregression, tests for threshold effect," Statistical Software Components RTS00209, Boston College Department of Economics.
- Tom Doan, . "RATS programs to replicate Hansen's threshold estimation and testing results," Statistical Software Components RTZ00091, Boston College Department of Economics.
- Sibbertsen, Philipp, 1999. "S-estimation in the nonlinear regression model with long-memory error terms," Technical Reports 1999,36, Technische Universität Dortmund, Sonderforschungsbereich 475: Komplexitätsreduktion in multivariaten Datenstrukturen.
- Shinichi Sakata & Halbert White, 1998. "High Breakdown Point Conditional Dispersion Estimation with Application to S&P 500 Daily Returns Volatility," Econometrica, Econometric Society, vol. 66(3), pages 529-568, May.
- Douglas Rivers & Quang Vuong, 2002. "Model selection tests for nonlinear dynamic models," Econometrics Journal, Royal Economic Society, vol. 5(1), pages 1-39, June.
- Kapetanios, G., 1999. "Model Selection in Threshold Models," Cambridge Working Papers in Economics 9906, Faculty of Economics, University of Cambridge.
- Sakata, Shinichi & White, Halbert, 2001. "S-estimation of nonlinear regression models with dependent and heterogeneous observations," Journal of Econometrics, Elsevier, vol. 103(1-2), pages 5-72, July.
- Machado, José A.F., 1993. "Robust Model Selection and M-Estimation," Econometric Theory, Cambridge University Press, vol. 9(03), pages 478-493, June.
- Philipp Sibbertsen, 1999. "S-Estimation in the Linear Regression Model with Long-Memory Error Terms," Computing in Economics and Finance 1999 512, Society for Computational Economics.
- Stinchcombe, Maxwell B. & White, Halbert, 1998. "Consistent Specification Testing With Nuisance Parameters Present Only Under The Alternative," Econometric Theory, Cambridge University Press, vol. 14(03), pages 295-325, June.
- PREMINGER, Arie & FRANCK, Raphael, .
"Forecasting exchange rates: a robust regression approach,"
CORE Discussion Papers RP
-1917, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
- Preminger, Arie & Franck, Raphael, 2007. "Forecasting exchange rates: A robust regression approach," International Journal of Forecasting, Elsevier, vol. 23(1), pages 71-84.
- PREMINGER, Arie & FRANCK, Raphael, 2005. "Forecasting exchange rates: a robust regression approach," CORE Discussion Papers 2005025, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wiley-Blackwell Digital Licensing) or (Christopher F. Baum).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.