IDEAS home Printed from https://ideas.repec.org/a/ect/emjrnl/v10y2007i2p294-319.html
   My bibliography  Save this article

A model selection method for S-estimation

Author

Listed:
  • Arie Preminger
  • Shinichi Sakata

Abstract

Cleaning data or removing some data periods in least squares (LS) regression analysis is not unusual. This practice indicates that a researcher sometimes desires to estimate the parameter value, with which the regression function fits a large fraction of individuals or events in the population (behind the original data set), possibly exhibiting poor fits to some atypical individuals or events. The S-estimators are a class of estimators that are consistent with the researcher's desire in such situations. In this paper, we propose a method of model selection suitable in the S-estimation. The proposed method chooses a model that minimizes a criterion named the penalised S-scale criterion (PSC), which is decreasing in the sample S-scale of fitted residuals and increasing in the number of parameters. We study the large sample behavior of the PSC in nonlinear regression with dependent, heterogeneous data, to establish sets of conditions sufficient for the PSC to consistently select the best-fitting, most parsimonious model. Our analysis allows for partial unidentifiability, which is an important possibility when selecting one among non-linear regression models. We conduct Monte Carlo simulations to verify that a particular PSC called the PSC-S is at least as trustworthy as the Schwarz information criterion, often used in the LS regression. Copyright Royal Economic Society 2007

Suggested Citation

  • Arie Preminger & Shinichi Sakata, 2007. "A model selection method for S-estimation," Econometrics Journal, Royal Economic Society, vol. 10(2), pages 294-319, July.
    • Handle: RePEc:ect:emjrnl:v:10:y:2007:i:2:p:294-319
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a search for a similarly titled item that would be available.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Philipp Sibbertsen, 1999. "S-Estimation in the Linear Regression Model with Long-Memory Error Terms," Computing in Economics and Finance 1999 512, Society for Computational Economics.
    2. Hansen, Bruce E, 1996. "Inference When a Nuisance Parameter Is Not Identified under the Null Hypothesis," Econometrica, Econometric Society, vol. 64(2), pages 413-430, March.
    3. Sakata, Shinichi & White, Halbert, 2001. "S-estimation of nonlinear regression models with dependent and heterogeneous observations," Journal of Econometrics, Elsevier, vol. 103(1-2), pages 5-72, July.
    4. Nishii, R., 1988. "Maximum likelihood principle and model selection when the true model is unspecified," Journal of Multivariate Analysis, Elsevier, vol. 27(2), pages 392-403, November.
    5. Chung-Ming Kuan, 2006. "Artificial Neural Networks," IEAS Working Paper : academic research 06-A010, Institute of Economics, Academia Sinica, Taipei, Taiwan.
    6. Sin, Chor-Yiu & White, Halbert, 1996. "Information criteria for selecting possibly misspecified parametric models," Journal of Econometrics, Elsevier, vol. 71(1-2), pages 207-225.
    7. Machado, José A.F., 1993. "Robust Model Selection and M-Estimation," Econometric Theory, Cambridge University Press, vol. 9(3), pages 478-493, June.
    8. Herman J. Bierens & Werner Ploberger, 1997. "Asymptotic Theory of Integrated Conditional Moment Tests," Econometrica, Econometric Society, vol. 65(5), pages 1129-1152, September.
    9. Andrews, Donald W.K., 1992. "Generic Uniform Convergence," Econometric Theory, Cambridge University Press, vol. 8(2), pages 241-257, June.
    10. White,Halbert, 1996. "Estimation, Inference and Specification Analysis," Cambridge Books, Cambridge University Press, number 9780521574464, January.
    11. Sibbertsen, Philipp, 1999. "S-estimation in the nonlinear regression model with long-memory error terms," Technical Reports 1999,36, Technische Universität Dortmund, Sonderforschungsbereich 475: Komplexitätsreduktion in multivariaten Datenstrukturen.
    12. Balke, Nathan S & Fomby, Thomas B, 1994. "Large Shocks, Small Shocks, and Economic Fluctuations: Outliers in Macroeconomic Time Series," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 9(2), pages 181-200, April-Jun.
    13. Baci, Sidika & Zaman, Asad, 1998. "Effects of skewness and kurtosis on model selection criteria," Economics Letters, Elsevier, vol. 59(1), pages 17-22, April.
    14. Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-333, March.
    15. Andrews, Donald W K, 1987. "Consistency in Nonlinear Econometric Models: A Generic Uniform Law of Large Numbers [On Unification of the Asymptotic Theory of Nonlinear Econometric Models]," Econometrica, Econometric Society, vol. 55(6), pages 1465-1471, November.
    16. Filippo Altissimo & Valentina Corradi, 2002. "Bounds for inference with nuisance parameters present only under the alternative," Econometrics Journal, Royal Economic Society, vol. 5(2), pages 494-519, June.
    17. Robert B. Davies, 2002. "Hypothesis testing when a nuisance parameter is present only under the alternative: Linear model case," Biometrika, Biometrika Trust, vol. 89(2), pages 484-489, June.
    18. Sergio G. Koreisha & Tarmo Pukkila, 1993. "Determining The Order Of A Vector Autoregression When The Number Of Component Series Is Large," Journal of Time Series Analysis, Wiley Blackwell, vol. 14(1), pages 47-69, January.
    19. George Kapetanios, 2001. "Model Selection in Threshold Models," Journal of Time Series Analysis, Wiley Blackwell, vol. 22(6), pages 733-754, November.
    20. Stinchcombe, Maxwell B. & White, Halbert, 1998. "Consistent Specification Testing With Nuisance Parameters Present Only Under The Alternative," Econometric Theory, Cambridge University Press, vol. 14(3), pages 295-325, June.
    21. Shinichi Sakata & Halbert White, 1998. "High Breakdown Point Conditional Dispersion Estimation with Application to S&P 500 Daily Returns Volatility," Econometrica, Econometric Society, vol. 66(3), pages 529-568, May.
    22. Lucas, Andre, 1995. "An outlier robust unit root test with an application to the extended Nelson-Plosser data," Journal of Econometrics, Elsevier, vol. 66(1-2), pages 153-173.
    23. Van Dijk, Dick & Franses, Philip Hans & Lucas, Andre, 1999. "Testing for Smooth Transition Nonlinearity in the Presence of Outliers," Journal of Business & Economic Statistics, American Statistical Association, vol. 17(2), pages 217-235, April.
    24. Douglas Rivers & Quang Vuong, 2002. "Model selection tests for nonlinear dynamic models," Econometrics Journal, Royal Economic Society, vol. 5(1), pages 1-39, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Preminger, Arie & Franck, Raphael, 2007. "Forecasting exchange rates: A robust regression approach," International Journal of Forecasting, Elsevier, vol. 23(1), pages 71-84.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Preminger, Arie & Franck, Raphael, 2007. "Forecasting exchange rates: A robust regression approach," International Journal of Forecasting, Elsevier, vol. 23(1), pages 71-84.
    2. Arie Preminger & David Wettstein, 2005. "Using the Penalized Likelihood Method for Model Selection with Nuisance Parameters Present only under the Alternative: An Application to Switching Regression Models," Journal of Time Series Analysis, Wiley Blackwell, vol. 26(5), pages 715-741, September.
    3. Arie Preminger & Christian M. Hafner, 2006. "Deciding Between Garch And Stochastic Volatility Via Strong Decision Rules," Working Papers 0603, Ben-Gurion University of the Negev, Department of Economics.
    4. Jonathan B. Hill, 2004. "Consistent Model Specification Tests Against Smooth Transition Alternatives," Econometrics 0402004, University Library of Munich, Germany, revised 05 Aug 2005.
    5. Jin Seo Cho & Peter C. B. Phillips & Juwon Seo, 2019. "Parametric Inference on the Mean of Functional Data Applied to Lifetime Income Curves," Working papers 2019rwp-153, Yonsei University, Yonsei Economics Research Institute.
    6. Jin Seo Cho & Peter C. B. Phillips & Juwon Seo, 2022. "Parametric Conditional Mean Inference With Functional Data Applied To Lifetime Income Curves," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 63(1), pages 391-456, February.
    7. Jonathan B. Hill, 2004. "Consistent LM-Tests for Linearity Against Compound Smooth Transition Alternatives," Econometric Society 2004 North American Summer Meetings 42, Econometric Society.
    8. PREMINGER, Arie & HAFNER, Christian, 2006. "Deciding between GARCH and stochastic volatility via strong decision rules," LIDAM Discussion Papers CORE 2006042, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    9. Gourieroux, C. & Monfort, A., 2021. "Model risk management: Valuation and governance of pseudo-models," Econometrics and Statistics, Elsevier, vol. 17(C), pages 1-22.
    10. Donald W.K. Andrews & Werner Ploberger, 1994. "Testing for Serial Correlation Against an ARMA(1,1) Process," Cowles Foundation Discussion Papers 1077, Cowles Foundation for Research in Economics, Yale University.
    11. Pavel Cizek & Wolfgang Härdle, 2006. "Robust Econometrics," SFB 649 Discussion Papers SFB649DP2006-050, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    12. Susanne M. Schennach & Daniel Wilhelm, 2017. "A Simple Parametric Model Selection Test," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(520), pages 1663-1674, October.
    13. Komunjer, Ivana & Ragusa, Giuseppe, 2016. "Existence And Characterization Of Conditional Density Projections," Econometric Theory, Cambridge University Press, vol. 32(4), pages 947-987, August.
    14. Wasel Shadat, 2011. "On the Nonparametric Tests of Univariate GARCH Regression Models," Economics Discussion Paper Series 1115, Economics, The University of Manchester.
    15. Jonathan B. Hill, 2004. "LM-Tests for Linearity Against Smooth Transition Alternatives: A Bootstrap Simulation Study," Econometrics 0401004, University Library of Munich, Germany, revised 05 Jul 2004.
    16. Massimiliano Marcellino & Barbara Rossi, 2008. "Model Selection for Nested and Overlapping Nonlinear, Dynamic and Possibly Mis‐specified Models," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 70(s1), pages 867-893, December.
    17. Valentina Corradi & Norman R. Swanson, 2007. "Nonparametric Bootstrap Procedures For Predictive Inference Based On Recursive Estimation Schemes," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 48(1), pages 67-109, February.
    18. LeBaron, Blake, 2003. "Non-Linear Time Series Models in Empirical Finance,: Philip Hans Franses and Dick van Dijk, Cambridge University Press, Cambridge, 2000, 296 pp., Paperback, ISBN 0-521-77965-0, $33, [UK pound]22.95, [," International Journal of Forecasting, Elsevier, vol. 19(4), pages 751-752.
    19. Franses,Philip Hans & Dijk,Dick van, 2000. "Non-Linear Time Series Models in Empirical Finance," Cambridge Books, Cambridge University Press, number 9780521779654, January.
    20. Chen, Xiaohong, 2007. "Large Sample Sieve Estimation of Semi-Nonparametric Models," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 76, Elsevier.

    More about this item

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ect:emjrnl:v:10:y:2007:i:2:p:294-319. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley-Blackwell Digital Licensing or Christopher F. Baum (email available below). General contact details of provider: https://edirc.repec.org/data/resssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.