IDEAS home Printed from https://ideas.repec.org/a/gam/jecnmx/v9y2021i3p26-d582011.html
   My bibliography  Save this article

Selecting a Model for Forecasting

Author

Listed:
  • Jennifer L. Castle

    (Magdalen College and Climate Econometrics, University of Oxford, High Street, Oxford OX1 4AU, UK)

  • Jurgen A. Doornik

    (Nuffield College, Climate Econometrics and Institute for New Economic Thinking at the Oxford Martin School, University of Oxford, Nuffield College, New Road, Oxford OX1 1NF, UK)

  • David F. Hendry

    (Nuffield College, Climate Econometrics and Institute for New Economic Thinking at the Oxford Martin School, University of Oxford, Nuffield College, New Road, Oxford OX1 1NF, UK)

Abstract

We investigate forecasting in models that condition on variables for which future values are unknown. We consider the role of the significance level because it guides the binary decisions whether to include or exclude variables. The analysis is extended by allowing for a structural break, either in the first forecast period or just before. Theoretical results are derived for a three-variable static model, but generalized to include dynamics and many more variables in the simulation experiment. The results show that the trade-off for selecting variables in forecasting models in a stationary world, namely that variables should be retained if their noncentralities exceed unity, still applies in settings with structural breaks. This provides support for model selection at looser than conventional settings, albeit with many additional features explaining the forecast performance, and with the caveat that retaining irrelevant variables that are subject to location shifts can worsen forecast performance.

Suggested Citation

  • Jennifer L. Castle & Jurgen A. Doornik & David F. Hendry, 2021. "Selecting a Model for Forecasting," Econometrics, MDPI, vol. 9(3), pages 1-35, June.
    • Handle: RePEc:gam:jecnmx:v:9:y:2021:i:3:p:26-:d:582011
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2225-1146/9/3/26/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2225-1146/9/3/26/
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Castle, Jennifer L. & Clements, Michael P. & Hendry, David F., 2015. "Robust approaches to forecasting," International Journal of Forecasting, Elsevier, vol. 31(1), pages 99-112.
    2. Inoue, Atsushi & Kilian, Lutz, 2008. "How Useful Is Bagging in Forecasting Economic Time Series? A Case Study of U.S. Consumer Price Inflation," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 511-522, June.
    3. Castle, Jennifer L. & Doornik, Jurgen A. & Hendry, David F., 2012. "Model selection when there are multiple breaks," Journal of Econometrics, Elsevier, vol. 169(2), pages 239-246.
    4. Jennifer L. Castle & Jurgen A. Doornik & David F. Hendry, 2021. "Forecasting Principles from Experience with Forecasting Competitions," Forecasting, MDPI, vol. 3(1), pages 1-28, February.
    5. Carlos Santos & David Hendry & Soren Johansen, 2008. "Automatic selection of indicators in a fully saturated regression," Computational Statistics, Springer, vol. 23(2), pages 317-335, April.
    6. Hendry, David F., 2006. "Robustifying forecasts from equilibrium-correction systems," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 399-426.
    7. Hendry, David F., 1995. "Dynamic Econometrics," OUP Catalogue, Oxford University Press, number 9780198283164.
    8. Julia Campos & David F. Hendry & Hans‐Martin Krolzig, 2003. "Consistent Model Selection by an Automatic Gets Approach," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 65(s1), pages 803-819, December.
    9. Clements,Michael & Hendry,David, 1998. "Forecasting Economic Time Series," Cambridge Books, Cambridge University Press, number 9780521634809, January.
    10. Chu, Chia-Shang James & Stinchcombe, Maxwell & White, Halbert, 1996. "Monitoring Structural Change," Econometrica, Econometric Society, vol. 64(5), pages 1045-1065, September.
    11. Ing, Ching-Kang & Wei, Ching-Zong, 2003. "On same-realization prediction in an infinite-order autoregressive process," Journal of Multivariate Analysis, Elsevier, vol. 85(1), pages 130-155, April.
    12. Jennifer L. Castle & Jurgen A. Doornik & David F. Hendry & Felix Pretis, 2015. "Detecting Location Shifts during Model Selection by Step-Indicator Saturation," Econometrics, MDPI, vol. 3(2), pages 1-25, April.
    13. Jennifer L. Castle & Jurgen A. Doornik & David F. Hendry, 2020. "Short-term forecasting of the Coronavirus Pandemic - 2020-04-27," Economics Papers 2020-W06, Economics Group, Nuffield College, University of Oxford.
    14. Makridakis, Spyros & Hibon, Michele, 2000. "The M3-Competition: results, conclusions and implications," International Journal of Forecasting, Elsevier, vol. 16(4), pages 451-476.
    15. Doornik, Jurgen A. & Castle, Jennifer L. & Hendry, David F., 2020. "Card forecasts for M4," International Journal of Forecasting, Elsevier, vol. 36(1), pages 129-134.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. Jia, Jian & Kang, Sang Baum, 2022. "Do the basis and other predictors of futures return also predict spot return with the same signs and magnitudes? Evidence from the LME," Journal of Commodity Markets, Elsevier, vol. 25(C).
    3. Chad Fulton & Kirstin Hubrich, 2021. "Forecasting US Inflation in Real Time," Econometrics, MDPI, vol. 9(4), pages 1-20, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. Jennifer L. Castle & Michael P. Clements & David F. Hendry, 2016. "An Overview of Forecasting Facing Breaks," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 12(1), pages 3-23, September.
    3. Neil R. Ericsson, 2021. "Dynamic Econometrics in Action: A Biography of David F. Hendry," International Finance Discussion Papers 1311, Board of Governors of the Federal Reserve System (U.S.).
    4. Ericsson, Neil R., 2017. "Economic forecasting in theory and practice: An interview with David F. Hendry," International Journal of Forecasting, Elsevier, vol. 33(2), pages 523-542.
    5. Andrew B. Martinez, 2020. "Forecast Accuracy Matters for Hurricane Damage," Econometrics, MDPI, vol. 8(2), pages 1-24, May.
    6. Ericsson, Neil R., 2017. "How biased are U.S. government forecasts of the federal debt?," International Journal of Forecasting, Elsevier, vol. 33(2), pages 543-559.
    7. Rocha, Jordano Vieira & Pereira, Pedro L. Valls, 2015. "Forecast comparison with nonlinear methods for Brazilian industrial production," Textos para discussão 397, FGV EESP - Escola de Economia de São Paulo, Fundação Getulio Vargas (Brazil).
    8. Jennifer L. Castle & Jurgen A. Doornik & David F. Hendry & Ragnar Nymoen, 2014. "Misspecification Testing: Non-Invariance of Expectations Models of Inflation," Econometric Reviews, Taylor & Francis Journals, vol. 33(5-6), pages 553-574, August.
    9. Jennifer Castle & Takamitsu Kurita, 2019. "Modelling and forecasting the dollar-pound exchange rate in the presence of structural breaks," Economics Series Working Papers 866, University of Oxford, Department of Economics.
    10. Ahumada, H. & Cornejo, M., 2016. "Forecasting food prices: The case of corn, soybeans and wheat," International Journal of Forecasting, Elsevier, vol. 32(3), pages 838-848.
    11. Ericsson Neil R., 2016. "Testing for and estimating structural breaks and other nonlinearities in a dynamic monetary sector," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 20(4), pages 377-398, September.
    12. David F. Hendry, 2020. "A Short History of Macro-econometric Modelling," Economics Papers 2020-W01, Economics Group, Nuffield College, University of Oxford.
    13. Ericsson, Neil R., 2016. "Eliciting GDP forecasts from the FOMC’s minutes around the financial crisis," International Journal of Forecasting, Elsevier, vol. 32(2), pages 571-583.
    14. Castle Jennifer L. & Doornik Jurgen A & Hendry David F., 2011. "Evaluating Automatic Model Selection," Journal of Time Series Econometrics, De Gruyter, vol. 3(1), pages 1-33, February.
    15. David F. Hendry & Grayham E. Mizon, 2016. "Improving the teaching of econometrics," Cogent Economics & Finance, Taylor & Francis Journals, vol. 4(1), pages 1170096-117, December.
    16. Hendry, David F. & Mizon, Grayham E., 2014. "Unpredictability in economic analysis, econometric modeling and forecasting," Journal of Econometrics, Elsevier, vol. 182(1), pages 186-195.
    17. Jennifer Castle & David Hendry, 2010. "Automatic Selection for Non-linear Models," Economics Series Working Papers 473, University of Oxford, Department of Economics.
    18. Jennifer Castle & David Hendry, 2007. "Forecasting UK Inflation: the Roles of Structural Breaks and Time Disaggregation," Economics Series Working Papers 309, University of Oxford, Department of Economics.
    19. Castle, Jennifer L. & Doornik, Jurgen A. & Hendry, David F., 2023. "Robust Discovery of Regression Models," Econometrics and Statistics, Elsevier, vol. 26(C), pages 31-51.
    20. Jennifer L. Castle & Jurgen A. Doornik & David F. Hendry, 2021. "Forecasting Principles from Experience with Forecasting Competitions," Forecasting, MDPI, vol. 3(1), pages 1-28, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jecnmx:v:9:y:2021:i:3:p:26-:d:582011. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.