IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v136y2015icp108-125.html
   My bibliography  Save this article

Evaluating panel data forecasts under independent realization

Author

Listed:
  • Greenaway-McGrevy, Ryan

Abstract

Independent realization is a commonly used shortcut for deriving forecast properties. It is also an unrealistic assumption in many empirical applications. In this paper we consider the effect of the assumption when deriving the properties of panel data forecasts. To do so, we derive and compare the asymptotic forecast loss of a set of vector autoregressions (VARs) under both independent and same-sample realization. We show that adopting the independent realization assumption can result in an overstatement of forecast loss when common forms of parameterized heterogeneity (such as fixed effects) are included in the VAR. Because these parameters are often used in dynamic panel forecasting applications, our results imply that the independent realization shortcut should only be used with caution when working with panel data.

Suggested Citation

  • Greenaway-McGrevy, Ryan, 2015. "Evaluating panel data forecasts under independent realization," Journal of Multivariate Analysis, Elsevier, vol. 136(C), pages 108-125.
    • Handle: RePEc:eee:jmvana:v:136:y:2015:i:c:p:108-125
    DOI: 10.1016/j.jmva.2015.01.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X15000093
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jmva.2015.01.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ing, Ching-Kang & Wei, Ching-Zong, 2003. "On same-realization prediction in an infinite-order autoregressive process," Journal of Multivariate Analysis, Elsevier, vol. 85(1), pages 130-155, April.
    2. Badi H. Baltagi, 2008. "Forecasting with panel data," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 27(2), pages 153-173.
    3. Phillips, Peter C. B., 1979. "The sampling distribution of forecasts from a first-order autoregression," Journal of Econometrics, Elsevier, vol. 9(3), pages 241-261, February.
    4. Jinyong Hahn & Guido Kuersteiner, 2002. "Asymptotically Unbiased Inference for a Dynamic Panel Model with Fixed Effects when Both "n" and "T" Are Large," Econometrica, Econometric Society, vol. 70(4), pages 1639-1657, July.
    5. Lewis, Richard & Reinsel, Gregory C., 1985. "Prediction of multivariate time series by autoregressive model fitting," Journal of Multivariate Analysis, Elsevier, vol. 16(3), pages 393-411, June.
    6. Schorfheide, Frank, 2005. "VAR forecasting under misspecification," Journal of Econometrics, Elsevier, vol. 128(1), pages 99-136, September.
    7. Ing, Ching-Kang, 2003. "Multistep Prediction In Autoregressive Processes," Econometric Theory, Cambridge University Press, vol. 19(2), pages 254-279, April.
    8. Richard A. Lewis & Gregory C. Reinsel, 1988. "Prediction Error Of Multivariate Time Series With Mis‐Specified Models," Journal of Time Series Analysis, Wiley Blackwell, vol. 9(1), pages 43-57, January.
    9. Greenaway-McGrevy, Ryan, 2013. "Multistep Prediction Of Panel Vector Autoregressive Processes," Econometric Theory, Cambridge University Press, vol. 29(4), pages 699-734, August.
    10. Findley, David F. & Wei, Ching-Zong, 2002. "AIC, Overfitting Principles, and the Boundedness of Moments of Inverse Matrices for Vector Autotregressions and Related Models," Journal of Multivariate Analysis, Elsevier, vol. 83(2), pages 415-450, November.
    11. Taku Yamamoto, 1976. "Asymptotic Mean Square Prediction Error for an Autoregressive Model with Estimated Coefficients," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 25(2), pages 123-127, June.
    12. Nickell, Stephen J, 1981. "Biases in Dynamic Models with Fixed Effects," Econometrica, Econometric Society, vol. 49(6), pages 1417-1426, November.
    13. YAMAMOTO, Taku, 1976. "Asymptotic mean square prediction error for an autoregressive model with estimated coefficients," LIDAM Reprints CORE 291, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    14. R. Bhansali, 1996. "Asymptotically efficient autoregressive model selection for multistep prediction," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 48(3), pages 577-602, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Alejandro Barragán-Ocaña & Gerardo Reyes-Ruiz & Samuel Olmos-Peña & Hortensia Gómez-Viquez, 2020. "Approach to the identification of an alternative technological innovation index," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(1), pages 23-45, January.
    2. Greenaway-McGrevy, Ryan, 2022. "Forecast combination for VARs in large N and T panels," International Journal of Forecasting, Elsevier, vol. 38(1), pages 142-164.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Greenaway-McGrevy, Ryan, 2022. "Forecast combination for VARs in large N and T panels," International Journal of Forecasting, Elsevier, vol. 38(1), pages 142-164.
    2. Schorfheide, Frank, 2005. "VAR forecasting under misspecification," Journal of Econometrics, Elsevier, vol. 128(1), pages 99-136, September.
    3. Lee, Yoon-Jin & Okui, Ryo & Shintani, Mototsugu, 2018. "Asymptotic inference for dynamic panel estimators of infinite order autoregressive processes," Journal of Econometrics, Elsevier, vol. 204(2), pages 147-158.
    4. Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2006. "A comparison of direct and iterated multistep AR methods for forecasting macroeconomic time series," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 499-526.
    5. Chevillon, Guillaume, 2016. "Multistep forecasting in the presence of location shifts," International Journal of Forecasting, Elsevier, vol. 32(1), pages 121-137.
    6. João Henrique Gonçalves Mazzeu & Esther Ruiz & Helena Veiga, 2018. "Uncertainty And Density Forecasts Of Arma Models: Comparison Of Asymptotic, Bayesian, And Bootstrap Procedures," Journal of Economic Surveys, Wiley Blackwell, vol. 32(2), pages 388-419, April.
    7. Pesaran, M.H. & Pick, A. & Timmermann, A., 2009. "Variable Selection and Inference for Multi-period Forecasting Problems," Cambridge Working Papers in Economics 0901, Faculty of Economics, University of Cambridge.
    8. Hitesh Doshi & Kris Jacobs & Rui Liu, 2021. "Information in the Term Structure: A Forecasting Perspective," Management Science, INFORMS, vol. 67(8), pages 5255-5277, August.
    9. Guillaume Chevillon, 2007. "Direct Multi‐Step Estimation And Forecasting," Journal of Economic Surveys, Wiley Blackwell, vol. 21(4), pages 746-785, September.
    10. Eliana González Molano & Luis Fernando Melo Velnadia & Anderson Grajales Olarte, 2007. "Pronósticos directos de la inflación colombiana," Borradores de Economia 4246, Banco de la Republica.
    11. Hansen, Bruce E., 2008. "Least-squares forecast averaging," Journal of Econometrics, Elsevier, vol. 146(2), pages 342-350, October.
    12. Eliana González Molano & Luis Fernando Melo Velandia & Anderson Grajales Olarte, 2007. "Pronósticos directos de la inflación colombiana," Borradores de Economia 458, Banco de la Republica de Colombia.
    13. Galvao Jr., Antonio F., 2011. "Quantile regression for dynamic panel data with fixed effects," Journal of Econometrics, Elsevier, vol. 164(1), pages 142-157, September.
    14. Daniel W. Apley & Hyun Cheol Lee, 2010. "The effects of model parameter deviations on the variance of a linearly filtered time series," Naval Research Logistics (NRL), John Wiley & Sons, vol. 57(5), pages 460-471, August.
    15. Ing, Ching-Kang & Wei, Ching-Zong, 2003. "On same-realization prediction in an infinite-order autoregressive process," Journal of Multivariate Analysis, Elsevier, vol. 85(1), pages 130-155, April.
    16. Hansen, Bruce E., 2010. "Averaging estimators for autoregressions with a near unit root," Journal of Econometrics, Elsevier, vol. 158(1), pages 142-155, September.
    17. R. Bhansali, 1996. "Asymptotically efficient autoregressive model selection for multistep prediction," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 48(3), pages 577-602, September.
    18. Gonçalves Mazzeu, Joao Henrique & Ruiz Ortega, Esther & Veiga, Helena, 2015. "Model uncertainty and the forecast accuracy of ARMA models: A survey," DES - Working Papers. Statistics and Econometrics. WS ws1508, Universidad Carlos III de Madrid. Departamento de Estadística.
    19. repec:hal:spmain:info:hdl:2441/dambferfb7dfprc9m052g20qh is not listed on IDEAS
    20. Huy Quang Doan, 2019. "Trade, Institutional Quality and Income: Empirical Evidence for Sub-Saharan Africa," Economies, MDPI, vol. 7(2), pages 1-23, May.
    21. Seung C. Ahn & Gareth M. Thomas, 2023. "Likelihood-based inference for dynamic panel data models," Empirical Economics, Springer, vol. 64(6), pages 2859-2909, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:136:y:2015:i:c:p:108-125. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.