IDEAS home Printed from https://ideas.repec.org/p/pen/papers/20-038.html
   My bibliography  Save this paper

Robust Forecasting

Author

Listed:
  • Timothy Christensen

    (New York University)

  • Hyungsik Roger Moon

    (Univ. of Southern California Schae?er Center, and Yonsei University)

  • Frank Schorfheide

    (University of Pennsylvania CEPR, NBER, and PIER)

Abstract

We use a decision-theoretic framework to study the problem of forecasting discrete outcomes when the forecaster is unable to discriminate among a set of plausible forecast distributions because of partial identi?cation or concerns about model misspeci?cation or structural breaks. We derive “robust” forecasts which minimize maximum risk or regret over the set of forecast distributions. We show that for a large class of models including semiparametric panel data models for dynamic discrete choice, the robust forecasts depend in a natural way on a small number of convex optimization problems which can be simpli?ed using duality methods. Finally, we derive “e?cient robust” forecasts to deal with the problem of ?rst having to estimate the set of forecast distributions and develop a suitable asymptotic e?ciency theory.

Suggested Citation

  • Timothy Christensen & Hyungsik Roger Moon & Frank Schorfheide, 2020. "Robust Forecasting," PIER Working Paper Archive 20-038, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
  • Handle: RePEc:pen:papers:20-038
    as

    Download full text from publisher

    File URL: https://economics.sas.upenn.edu/sites/default/files/filevault/20-038.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    • Timothy Christensen & Hyungsik Roger Moon & Frank Schorfheide, 2020. "Robust Forecasting," Papers 2011.03153, arXiv.org, revised Dec 2020.

    References listed on IDEAS

    as
    1. Kitagawa, Toru & Montiel Olea, José Luis & Payne, Jonathan & Velez, Amilcar, 2020. "Posterior distribution of nondifferentiable functions," Journal of Econometrics, Elsevier, vol. 217(1), pages 161-175.
    2. James J. Heckman & Jeffrey Smith & Nancy Clements, 1997. "Making The Most Out Of Programme Evaluations and Social Experiments: Accounting For Heterogeneity in Programme Impacts," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 487-535.
    3. Toru Kitagawa & Aleksey Tetenov, 2018. "Who Should Be Treated? Empirical Welfare Maximization Methods for Treatment Choice," Econometrica, Econometric Society, vol. 86(2), pages 591-616, March.
    4. Graham Elliott & Allan Timmermann, 2016. "Economic Forecasting," Economics Books, Princeton University Press, edition 1, number 10740.
    5. Shapiro, Alexander, 2008. "Asymptotics of minimax stochastic programs," Statistics & Probability Letters, Elsevier, vol. 78(2), pages 150-157, February.
    6. Raffaella Giacomini & Toru Kitagawa, 2021. "Robust Bayesian Inference for Set‐Identified Models," Econometrica, Econometric Society, vol. 89(4), pages 1519-1556, July.
    7. Vaart,A. W. van der, 2000. "Asymptotic Statistics," Cambridge Books, Cambridge University Press, number 9780521784504.
    8. Gary Chamberlain, 2001. "Minimax Estimation and Forecasting in a Stationary Autoregression Model," American Economic Review, American Economic Association, vol. 91(2), pages 55-59, May.
    9. Paul Milgrom & Ilya Segal, 2002. "Envelope Theorems for Arbitrary Choice Sets," Econometrica, Econometric Society, vol. 70(2), pages 583-601, March.
    10. Graham Elliott & Allan Timmermann, 2016. "Forecasting in Economics and Finance," Annual Review of Economics, Annual Reviews, vol. 8(1), pages 81-110, October.
    11. Raffaella Giacomini & Toru Kitagawa & Harald Uhlig, 2019. "Estimation Under Ambiguity," CeMMAP working papers CWP24/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    12. Federico Ciliberto & Elie Tamer, 2009. "Market Structure and Multiple Equilibria in Airline Markets," Econometrica, Econometric Society, vol. 77(6), pages 1791-1828, November.
    13. Charles F. Manski, 1996. "Learning about Treatment Effects from Experiments with Random Assignment of Treatments," Journal of Human Resources, University of Wisconsin Press, vol. 31(4), pages 709-733.
    14. Keisuke Hirano & Jack R. Porter, 2009. "Asymptotics for Statistical Treatment Rules," Econometrica, Econometric Society, vol. 77(5), pages 1683-1701, September.
    15. Hyungsik Roger Moon & Frank Schorfheide, 2012. "Bayesian and Frequentist Inference in Partially Identified Models," Econometrica, Econometric Society, vol. 80(2), pages 755-782, March.
    16. Gary Chamberlain, 2000. "Econometric applications of maxmin expected utility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(6), pages 625-644.
    17. Gilboa, Itzhak & Schmeidler, David, 1989. "Maxmin expected utility with non-unique prior," Journal of Mathematical Economics, Elsevier, vol. 18(2), pages 141-153, April.
    18. Magnac, Thierry, 2000. "Subsidised Training and Youth Employment: Distinguishing Unobserved Heterogeneity from State Dependence in Labour Market Histories," Economic Journal, Royal Economic Society, vol. 110(466), pages 805-837, October.
    19. Song, Kyungchul, 2014. "Point Decisions For Interval–Identified Parameters," Econometric Theory, Cambridge University Press, vol. 30(2), pages 334-356, April.
    20. Lars Peter Hansen & Thomas J Sargent, 2014. "Robust Control and Model Uncertainty," World Scientific Book Chapters, in: UNCERTAINTY WITHIN ECONOMIC MODELS, chapter 5, pages 145-154, World Scientific Publishing Co. Pte. Ltd..
    21. Laura Liu & Hyungsik Roger Moon & Frank Schorfheide, 2020. "Forecasting With Dynamic Panel Data Models," Econometrica, Econometric Society, vol. 88(1), pages 171-201, January.
    22. Paul L. E. Grieco, 2014. "Discrete games with flexible information structures: an application to local grocery markets," RAND Journal of Economics, RAND Corporation, vol. 45(2), pages 303-340, June.
    23. Bo E. Honoré & Elie Tamer, 2006. "Bounds on Parameters in Panel Dynamic Discrete Choice Models," Econometrica, Econometric Society, vol. 74(3), pages 611-629, May.
    24. Tetenov, Aleksey, 2012. "Statistical treatment choice based on asymmetric minimax regret criteria," Journal of Econometrics, Elsevier, vol. 166(1), pages 157-165.
    25. Elliott, Graham & Lieli, Robert P., 2013. "Predicting binary outcomes," Journal of Econometrics, Elsevier, vol. 174(1), pages 15-26.
    26. Manski, Charles F., 2000. "Identification problems and decisions under ambiguity: Empirical analysis of treatment response and normative analysis of treatment choice," Journal of Econometrics, Elsevier, vol. 95(2), pages 415-442, April.
    27. Badi H. Baltagi, 2008. "Forecasting with panel data," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 27(2), pages 153-173.
    28. Shakeeb Khan & Fu Ouyang & Elie Tamer, 2019. "Inference on Semiparametric Multinomial Response Models," Boston College Working Papers in Economics 980, Boston College Department of Economics.
    29. Charles F. Manski, 2004. "Statistical Treatment Rules for Heterogeneous Populations," Econometrica, Econometric Society, vol. 72(4), pages 1221-1246, July.
    30. Manski, Charles F., 2007. "Minimax-regret treatment choice with missing outcome data," Journal of Econometrics, Elsevier, vol. 139(1), pages 105-115, July.
    31. Dehejia, Rajeev H., 2005. "Program evaluation as a decision problem," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 141-173.
    32. Panle Jia, 2008. "What Happens When Wal-Mart Comes to Town: An Empirical Analysis of the Discount Retailing Industry," Econometrica, Econometric Society, vol. 76(6), pages 1263-1316, November.
    33. Victor Chernozhukov & Iván Fernández‐Val & Jinyong Hahn & Whitney Newey, 2013. "Average and Quantile Effects in Nonseparable Panel Models," Econometrica, Econometric Society, vol. 81(2), pages 535-580, March.
    34. Gary Chamberlain, 2010. "Binary Response Models for Panel Data: Identification and Information," Econometrica, Econometric Society, vol. 78(1), pages 159-168, January.
    35. Timothy Christensen & Benjamin Connault, 2019. "Counterfactual Sensitivity and Robustness," Papers 1904.00989, arXiv.org, revised May 2022.
    36. Bo E. Honoré & Ekaterini Kyriazidou, 2000. "Panel Data Discrete Choice Models with Lagged Dependent Variables," Econometrica, Econometric Society, vol. 68(4), pages 839-874, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Francesca Molinari, 2020. "Microeconometrics with Partial Identi?cation," CeMMAP working papers CWP15/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    2. Timothy Christensen & Hyungsik Roger Moon & Frank Schorfheide, 2022. "Optimal Decision Rules when Payoffs are Partially Identified," Papers 2204.11748, arXiv.org, revised May 2023.
    3. Francesca Molinari, 2019. "Econometrics with Partial Identification," CeMMAP working papers CWP25/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    4. Toru Kitagawa & Sokbae Lee & Chen Qiu, 2022. "Treatment Choice with Nonlinear Regret," Papers 2205.08586, arXiv.org, revised Feb 2024.
    5. Garbero, Alessandra & Sakos, Grayson & Cerulli, Giovanni, 2023. "Towards data-driven project design: Providing optimal treatment rules for development projects," Socio-Economic Planning Sciences, Elsevier, vol. 89(C).
    6. Firpo, Sergio & Galvao, Antonio F. & Kobus, Martyna & Parker, Thomas & Rosa-Dias, Pedro, 2020. "Loss Aversion and the Welfare Ranking of Policy Interventions," IZA Discussion Papers 13176, Institute of Labor Economics (IZA).
    7. Ho, Kate & Rosen, Adam M., 2015. "Partial Identification in Applied Research: Benefits and Challenges," CEPR Discussion Papers 10883, C.E.P.R. Discussion Papers.
    8. Stoye, Jörg, 2009. "Minimax regret treatment choice with finite samples," Journal of Econometrics, Elsevier, vol. 151(1), pages 70-81, July.
    9. Keisuke Hirano & Jack R. Porter, 2016. "Panel Asymptotics and Statistical Decision Theory," The Japanese Economic Review, Japanese Economic Association, vol. 67(1), pages 33-49, March.
    10. Charles F. Manski, 2021. "Econometrics for Decision Making: Building Foundations Sketched by Haavelmo and Wald," Econometrica, Econometric Society, vol. 89(6), pages 2827-2853, November.
    11. Stoye, Jörg, 2012. "Minimax regret treatment choice with covariates or with limited validity of experiments," Journal of Econometrics, Elsevier, vol. 166(1), pages 138-156.
    12. Raffaella Giacomini & Toru Kitagawa & Harald Uhlig, 2019. "Estimation Under Ambiguity," CeMMAP working papers CWP24/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    13. Daido Kido, 2023. "Locally Asymptotically Minimax Statistical Treatment Rules Under Partial Identification," Papers 2311.08958, arXiv.org.
    14. Davide Viviano & Jelena Bradic, 2020. "Fair Policy Targeting," Papers 2005.12395, arXiv.org, revised Jun 2022.
    15. Davide Viviano, 2019. "Policy Targeting under Network Interference," Papers 1906.10258, arXiv.org, revised Apr 2024.
    16. Manski, Charles F., 2023. "Probabilistic prediction for binary treatment choice: With focus on personalized medicine," Journal of Econometrics, Elsevier, vol. 234(2), pages 647-663.
    17. Eric Mbakop & Max Tabord‐Meehan, 2021. "Model Selection for Treatment Choice: Penalized Welfare Maximization," Econometrica, Econometric Society, vol. 89(2), pages 825-848, March.
    18. Anders Bredahl Kock & Martin Thyrsgaard, 2017. "Optimal sequential treatment allocation," Papers 1705.09952, arXiv.org, revised Aug 2018.
    19. Stéphane Bonhomme & Martin Weidner, 2020. "Minimizing Sensitivity to Model Misspecification," CeMMAP working papers CWP37/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    20. Undral Byambadalai, 2022. "Identification and Inference for Welfare Gains without Unconfoundedness," Papers 2207.04314, arXiv.org.

    More about this item

    Keywords

    Statistical Decision Theory; Dynamic Discrete Choice; Forecasting; Identi?cation; Minimax Loss; Minimax Regret; Panel Data Models; Robustness; Structural Breaks;
    All these keywords.

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pen:papers:20-038. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Administrator (email available below). General contact details of provider: https://edirc.repec.org/data/deupaus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.