IDEAS home Printed from https://ideas.repec.org/a/bla/jecsur/v27y2013i2p269-296.html

Using Model Selection Algorithms To Obtain Reliable Coefficient Estimates

Author

Listed:
  • Jennifer L. Castle
  • Xiaochuan Qin
  • W. Robert Reed

Abstract

This review surveys a number of common Model Selection Algorithms (MSAs), discusses how they relate to each other, and identifies factors that explain their relative performances. At the heart of MSA performance is the trade-off between Type I and Type II errors. Some relevant variables will be mistakenly excluded, and some irrelevant variables will be retained by chance. A successful MSA will find the optimal trade-off between the two types of errors for a given data environment. Whether a given MSA will be successful in a given environment depends on the relative costs of these two types of errors. We use Monte Carlo experimentation to illustrate these issues. We confirm that no MSA does best in all circumstances. Even the worst MSA in terms of overall performance – the strategy of including all candidate variables – sometimes performs best (viz., when all candidate variables are relevant). We also show how (i) the ratio of relevant to total candidate variables and (ii) DGP noise affect relative MSA performance. Finally, we discuss a number of issues complicating the task of MSAs in producing reliable coefficient estimates.
(This abstract was borrowed from another version of this item.)

Suggested Citation

  • Jennifer L. Castle & Xiaochuan Qin & W. Robert Reed, 2013. "Using Model Selection Algorithms To Obtain Reliable Coefficient Estimates," Journal of Economic Surveys, Wiley Blackwell, vol. 27(2), pages 269-296, April.
    • Handle: RePEc:bla:jecsur:v:27:y:2013:i:2:p:269-296
    DOI: 10.1111/joes.2013.27.issue-2
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1111/10.1111/joes.2013.27.issue-2
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1111/joes.2013.27.issue-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or

    for a different version of it.

    Other versions of this item:

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. W. Robert Reed, 2018. "A Primer on the ‘Reproducibility Crisis’ and Ways to Fix It," Australian Economic Review, The University of Melbourne, Melbourne Institute of Applied Economic and Social Research, vol. 51(2), pages 286-300, June.
    2. Ragnar Nymoen & Kari Pedersen & Jon Ivar Sjåberg, 2019. "Estimation of Effects of Recent Macroprudential Policies in a Sample of Advanced Open Economies," IJFS, MDPI, vol. 7(2), pages 1-20, May.
    3. Hendry, David F., 2018. "Deciding between alternative approaches in macroeconomics," International Journal of Forecasting, Elsevier, vol. 34(1), pages 119-135.
    4. Durevall, Dick & Loening, Josef L. & Ayalew Birru, Yohannes, 2013. "Inflation dynamics and food prices in Ethiopia," Journal of Development Economics, Elsevier, vol. 104(C), pages 89-106.
    5. Nymoen, Ragnar & Pedersen, Kari & Sjåberg, Jon Ivar, 2018. "Estimation of effects of recent macroprudential policies in a sample of advanced open economies," Memorandum 5/2018, Oslo University, Department of Economics.
    6. Cunha, Ronan & Pereira, Pedro L. Valls, 2015. "Automatic model selection for forecasting Brazilian stock returns," Textos para discussão 398, FGV EESP - Escola de Economia de São Paulo, Fundação Getulio Vargas (Brazil).
    7. Kevin S. Nell, 2018. "Conditional Divergence in the Post-1989 Globalisation Period," CEF.UP Working Papers 1806, Universidade do Porto, Faculdade de Economia do Porto.
    8. Ericsson Neil R., 2016. "Testing for and estimating structural breaks and other nonlinearities in a dynamic monetary sector," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 20(4), pages 377-398, September.

    More about this item

    JEL classification:

    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jecsur:v:27:y:2013:i:2:p:269-296. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0950-0804 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.