Optimal forecasting with heterogeneous panels: A Monte Carlo study
We contrast the forecasting performance of alternative panel estimators, divided into three main groups: homogeneous, heterogeneous and shrinkage/Bayesian. Via a series of Monte Carlo simulations, the comparison is performed using different levels of heterogeneity and cross sectional dependence, alternative panel structures in terms of T and N and the specification of the dynamics of the error term. To assess the predictive performance, we use traditional measures of forecast accuracy (Theil's U statistics, RMSE and MAE), the Diebold-Mariano test, and Pesaran and Timmerman's statistic on the capability of forecasting turning points. The main finding of our analysis is that when the level of heterogeneity is high, shrinkage/Bayesian estimators are preferred, whilst when there is low or mild heterogeneity, homogeneous estimators have the best forecast accuracy.
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Christoffersen & Diebold, .
"Further Results on Forecasting and Model Selection Under Asymmetric Loss,"
_059, University of Pennsylvania.
- Christoffersen, Peter F & Diebold, Francis X, 1996. "Further Results on Forecasting and Model Selection under Asymmetric Loss," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(5), pages 561-71, Sept.-Oct.
- Keane, Michael P & Runkle, David E, 1992. "On the Estimation of Panel-Data Models with Serial Correlation When Instruments Are Not Strictly Exogenous," Journal of Business & Economic Statistics, American Statistical Association, vol. 10(1), pages 1-9, January.
- Keane, Michael P & Runkle, David E, 1992. "On the Estimation of Panel-Data Models with Serial Correlation When Instruments Are Not Strictly Exogenous: Reply," Journal of Business & Economic Statistics, American Statistical Association, vol. 10(1), pages 26-29, January.
- Anderson, T. W. & Hsiao, Cheng, 1982. "Formulation and estimation of dynamic models using panel data," Journal of Econometrics, Elsevier, vol. 18(1), pages 47-82, January.
- Baltagi, Badi H. & Bresson, Georges & Pirotte, Alain, 2002. "Comparison of forecast performance for homogeneous, heterogeneous and shrinkage estimators: Some empirical evidence from US electricity and natural-gas consumption," Economics Letters, Elsevier, vol. 76(3), pages 375-382, August.
- Badi H. Baltagi & Georges Bresson & James M. Griffin & Alain Pirotte, 2003.
"Homogeneous, heterogeneous or shrinkage estimators? Some empirical evidence from French regional gasoline consumption,"
Springer, vol. 28(4), pages 795-811, November.
- Badi H. Baltagi & Georges Bresson & James M. Griffin & Alain Pirotte, 2002. "Homogeneous, heterogeneous or shrinkage estimators? Some empirical evidence from French regional gasoline consumption," 10th International Conference on Panel Data, Berlin, July 5-6, 2002 A6-4, International Conferences on Panel Data.
- Pesaran, M.H. & Smith, R., 1992.
"Estimating Long-Run Relationships From Dynamic Heterogeneous Panels,"
Cambridge Working Papers in Economics
9215, Faculty of Economics, University of Cambridge.
- Pesaran, M. Hashem & Smith, Ron, 1995. "Estimating long-run relationships from dynamic heterogeneous panels," Journal of Econometrics, Elsevier, vol. 68(1), pages 79-113, July.
- Swamy, P A V B, 1970.
"Efficient Inference in a Random Coefficient Regression Model,"
Econometric Society, vol. 38(2), pages 311-23, March.
- Tom Doan, . "SWAMY: RATS procedure to compute a GLS matrix weighted estimator for a panel data set," Statistical Software Components RTS00206, Boston College Department of Economics.
- Baltagi, Badi H. & Li, Qi, 1992. "A Note on the Estimation of Simultaneous Equations with Error Components," Econometric Theory, Cambridge University Press, vol. 8(01), pages 113-119, March.
- Nickell, Stephen J, 1981. "Biases in Dynamic Models with Fixed Effects," Econometrica, Econometric Society, vol. 49(6), pages 1417-26, November.
- Diebold, Francis X & Mariano, Roberto S, 2002.
"Comparing Predictive Accuracy,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 20(1), pages 134-44, January.
- Pesaran, M.H. & Timmermann, A., 1990.
"A Simple, Non-Parametric Test Of Predictive Performance,"
Cambridge Working Papers in Economics
9021, Faculty of Economics, University of Cambridge.
- Pesaran, M Hashem & Timmermann, Allan, 1992. "A Simple Nonparametric Test of Predictive Performance," Journal of Business & Economic Statistics, American Statistical Association, vol. 10(4), pages 561-65, October.
- Pesaran, M.H. & Timmermann, A., 1990. "A Simple Non-Parametric Test Of Predictive Performance," Papers 29, California Los Angeles - Applied Econometrics.
- Francis X. Diebold & Jose A. Lopez, 1995.
"Forecast evaluation and combination,"
9525, Federal Reserve Bank of New York.
- Arellano, M. & Honore, B., 2000.
"Panel Data Models: Some Recent Developments,"
0016, Centro de Estudios Monetarios Y Financieros-.
- Breusch, Trevor S., 1987. "Maximum likelihood estimation of random effects models," Journal of Econometrics, Elsevier, vol. 36(3), pages 383-389, November.
- Manuel Arellano & Stephen Bond, 1991.
"Some Tests of Specification for Panel Data: Monte Carlo Evidence and an Application to Employment Equations,"
Review of Economic Studies,
Oxford University Press, vol. 58(2), pages 277-297.
- Tom Doan, . "RATS program to replicate Arellano-Bond 1991 dynamic panel," Statistical Software Components RTZ00169, Boston College Department of Economics.
- Arellano, Manuel, 2003. "Panel Data Econometrics," OUP Catalogue, Oxford University Press, number 9780199245291, December.
- Baltagi, Badi H. & Griffin, James M., 1997. "Pooled estimators vs. their heterogeneous counterparts in the context of dynamic demand for gasoline," Journal of Econometrics, Elsevier, vol. 77(2), pages 303-327, April.
- Pesaran, M.H., 2003.
"A Simple Panel Unit Root Test in the Presence of Cross Section Dependence,"
Cambridge Working Papers in Economics
0346, Faculty of Economics, University of Cambridge.
- M. Hashem Pesaran, 2007. "A simple panel unit root test in the presence of cross-section dependence," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(2), pages 265-312.
- Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
- Ciaran Driver & Giovanni Urga, 2004. "Transforming Qualitative Survey Data: Performance Comparisons for the UK," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 66(1), pages 71-89, 02.
- Herbert Brücker & Boriss Siliverstovs, 2006.
"On the estimation and forecasting of international migration: how relevant is heterogeneity across countries?,"
Springer, vol. 31(3), pages 735-754, September.
- Brücker, Herbert & Siliverstovs, Boriss, 2005. "On the Estimation and Forecasting of International Migration: How Relevant Is Heterogeneity Across Countries?," IZA Discussion Papers 1710, Institute for the Study of Labor (IZA).
- Balestra, Pietro & Varadharajan-Krishnakumar, Jayalakshmi, 1987. "Full Information Estimations of a System of Simultaneous Equations with Error Component Structure," Econometric Theory, Cambridge University Press, vol. 3(02), pages 223-246, April.
- Badi H. Baltagi & Georges Bresson & Alain Pirotte, 2004. "Tobin q: Forecast performance for hierarchical Bayes, shrinkage, heterogeneous and homogeneous panel data estimators," Empirical Economics, Springer, vol. 29(1), pages 107-113, January.
- Sevestre, P. & Trognon, A., 1985. "A note on autoregressive error components models," Journal of Econometrics, Elsevier, vol. 28(2), pages 231-245, May.
- Leitch, Gordon & Tanner, J Ernest, 1991. "Economic Forecast Evaluation: Profits versus the Conventional Error Measures," American Economic Review, American Economic Association, vol. 81(3), pages 580-90, June.
When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:25:y:2009:i:3:p:567-586. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Shamier, Wendy)
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.