Optimal forecasting with heterogeneous panels: A Monte Carlo study
We contrast the forecasting performance of alternative panel estimators, divided into three main groups: homogeneous, heterogeneous and shrinkage/Bayesian. Via a series of Monte Carlo simulations, the comparison is performed using different levels of heterogeneity and cross sectional dependence, alternative panel structures in terms of T and N and the specification of the dynamics of the error term. To assess the predictive performance, we use traditional measures of forecast accuracy (Theil's U statistics, RMSE and MAE), the Diebold-Mariano test, and Pesaran and Timmerman's statistic on the capability of forecasting turning points. The main finding of our analysis is that when the level of heterogeneity is high, shrinkage/Bayesian estimators are preferred, whilst when there is low or mild heterogeneity, homogeneous estimators have the best forecast accuracy.
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Diebold, Francis X & Mariano, Roberto S, 2002.
"Comparing Predictive Accuracy,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 20(1), pages 134-44, January.
- Christoffersen & Diebold, .
"Further Results on Forecasting and Model Selection Under Asymmetric Loss,"
_059, University of Pennsylvania.
- Christoffersen, Peter F & Diebold, Francis X, 1996. "Further Results on Forecasting and Model Selection under Asymmetric Loss," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(5), pages 561-71, Sept.-Oct.
- Ciaran Driver & Giovanni Urga, 2004. "Transforming Qualitative Survey Data: Performance Comparisons for the UK," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 66(1), pages 71-89, 02.
- Keane, Michael P & Runkle, David E, 1992. "On the Estimation of Panel-Data Models with Serial Correlation When Instruments Are Not Strictly Exogenous: Reply," Journal of Business & Economic Statistics, American Statistical Association, vol. 10(1), pages 26-29, January.
- Arellano, Manuel, 2003. "Panel Data Econometrics," OUP Catalogue, Oxford University Press, number 9780199245291, May.
- Pesaran, M.H. & Smith, R., 1992.
"Estimating Long-Run Relationships From Dynamic Heterogeneous Panels,"
Cambridge Working Papers in Economics
9215, Faculty of Economics, University of Cambridge.
- Pesaran, M. Hashem & Smith, Ron, 1995. "Estimating long-run relationships from dynamic heterogeneous panels," Journal of Econometrics, Elsevier, vol. 68(1), pages 79-113, July.
- Pesaran, M.H. & Timmermann, A., 1990.
"A Simple Non-Parametric Test Of Predictive Performance,"
29, California Los Angeles - Applied Econometrics.
- Pesaran, M Hashem & Timmermann, Allan, 1992. "A Simple Nonparametric Test of Predictive Performance," Journal of Business & Economic Statistics, American Statistical Association, vol. 10(4), pages 561-65, October.
- Pesaran, M.H. & Timmermann, A., 1990. "A Simple, Non-Parametric Test Of Predictive Performance," Cambridge Working Papers in Economics 9021, Faculty of Economics, University of Cambridge.
- Baltagi, Badi H. & Li, Qi, 1992. "A Note on the Estimation of Simultaneous Equations with Error Components," Econometric Theory, Cambridge University Press, vol. 8(01), pages 113-119, March.
- Badi H. Baltagi & Georges Bresson & James M. Griffin & Alain Pirotte, 2003.
"Homogeneous, heterogeneous or shrinkage estimators? Some empirical evidence from French regional gasoline consumption,"
Springer, vol. 28(4), pages 795-811, November.
- Badi H. Baltagi & Georges Bresson & James M. Griffin & Alain Pirotte, 2002. "Homogeneous, heterogeneous or shrinkage estimators? Some empirical evidence from French regional gasoline consumption," 10th International Conference on Panel Data, Berlin, July 5-6, 2002 A6-4, International Conferences on Panel Data.
- Keane, Michael P & Runkle, David E, 1992. "On the Estimation of Panel-Data Models with Serial Correlation When Instruments Are Not Strictly Exogenous," Journal of Business & Economic Statistics, American Statistical Association, vol. 10(1), pages 1-9, January.
- Sevestre, P. & Trognon, A., 1985. "A note on autoregressive error components models," Journal of Econometrics, Elsevier, vol. 28(2), pages 231-245, May.
- Brücker, Herbert & Siliverstovs, Boriss, 2005.
"On the Estimation and Forecasting of International Migration: How Relevant Is Heterogeneity Across Countries?,"
IZA Discussion Papers
1710, Institute for the Study of Labor (IZA).
- Herbert Brücker & Boriss Siliverstovs, 2006. "On the estimation and forecasting of international migration: how relevant is heterogeneity across countries?," Empirical Economics, Springer, vol. 31(3), pages 735-754, September.
- Breusch, Trevor S., 1987. "Maximum likelihood estimation of random effects models," Journal of Econometrics, Elsevier, vol. 36(3), pages 383-389, November.
- Manuel Arellano & Stephen Bond, 1991.
"Some Tests of Specification for Panel Data: Monte Carlo Evidence and an Application to Employment Equations,"
Review of Economic Studies,
Oxford University Press, vol. 58(2), pages 277-297.
- Tom Doan, . "RATS program to replicate Arellano-Bond 1991 dynamic panel," Statistical Software Components RTZ00169, Boston College Department of Economics.
- M. Hashem Pesaran, 2007.
"A simple panel unit root test in the presence of cross-section dependence,"
Journal of Applied Econometrics,
John Wiley & Sons, Ltd., vol. 22(2), pages 265-312.
- Pesaran, M.H., 2003. "A Simple Panel Unit Root Test in the Presence of Cross Section Dependence," Cambridge Working Papers in Economics 0346, Faculty of Economics, University of Cambridge.
- Badi H. Baltagi & Georges Bresson & Alain Pirotte, 2004. "Tobin q: Forecast performance for hierarchical Bayes, shrinkage, heterogeneous and homogeneous panel data estimators," Empirical Economics, Springer, vol. 29(1), pages 107-113, January.
- Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
- Francis X. Diebold & Jose A. Lopez, 1995.
"Forecast evaluation and combination,"
9525, Federal Reserve Bank of New York.
- Anderson, T. W. & Hsiao, Cheng, 1982. "Formulation and estimation of dynamic models using panel data," Journal of Econometrics, Elsevier, vol. 18(1), pages 47-82, January.
- Balestra, Pietro & Varadharajan-Krishnakumar, Jayalakshmi, 1987. "Full Information Estimations of a System of Simultaneous Equations with Error Component Structure," Econometric Theory, Cambridge University Press, vol. 3(02), pages 223-246, April.
- Swamy, P A V B, 1970.
"Efficient Inference in a Random Coefficient Regression Model,"
Econometric Society, vol. 38(2), pages 311-23, March.
- Tom Doan, . "SWAMY: RATS procedure to compute a GLS matrix weighted estimator for a panel data set," Statistical Software Components RTS00206, Boston College Department of Economics.
- Leitch, Gordon & Tanner, J Ernest, 1991. "Economic Forecast Evaluation: Profits versus the Conventional Error Measures," American Economic Review, American Economic Association, vol. 81(3), pages 580-90, June.
- Arellano, Manuel & Honore, Bo, 2001.
"Panel data models: some recent developments,"
Handbook of Econometrics,
in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 53, pages 3229-3296
- Baltagi, Badi H. & Griffin, James M., 1997. "Pooled estimators vs. their heterogeneous counterparts in the context of dynamic demand for gasoline," Journal of Econometrics, Elsevier, vol. 77(2), pages 303-327, April.
- Baltagi, Badi H. & Bresson, Georges & Pirotte, Alain, 2002. "Comparison of forecast performance for homogeneous, heterogeneous and shrinkage estimators: Some empirical evidence from US electricity and natural-gas consumption," Economics Letters, Elsevier, vol. 76(3), pages 375-382, August.
- Nickell, Stephen J, 1981. "Biases in Dynamic Models with Fixed Effects," Econometrica, Econometric Society, vol. 49(6), pages 1417-26, November.
When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:25:y:2009:i:3:p:567-586. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Zhang, Lei)
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.