IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2512.15592.html

Inference for Forecasting Accuracy: Pooled versus Individual Estimators in High-dimensional Panel Data

Author

Listed:
  • Tim Kutta
  • Martin Schumann
  • Holger Dette

Abstract

Panels with large time $(T)$ and cross-sectional $(N)$ dimensions are a key data structure in social sciences and other fields. A central question in panel data analysis is whether to pool data across individuals or to estimate separate models. Pooled estimators typically have lower variance but may suffer from bias, creating a fundamental trade-off for optimal estimation. We develop a new inference method to compare the forecasting performance of pooled and individual estimators. Specifically, we propose a confidence interval for the difference between their forecasting errors and establish its asymptotic validity. Our theory allows for complex temporal and cross-sectional dependence in the model errors and covers scenarios where $N$ can be much larger than $T$-including the independent case under the classical condition $N/T^2 \to 0$. The finite-sample properties of the proposed method are examined in an extensive simulation study.

Suggested Citation

  • Tim Kutta & Martin Schumann & Holger Dette, 2025. "Inference for Forecasting Accuracy: Pooled versus Individual Estimators in High-dimensional Panel Data," Papers 2512.15592, arXiv.org.
  • Handle: RePEc:arx:papers:2512.15592
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2512.15592
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Whitney Newey & Kenneth West, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    2. Murillo Campello & Antonio F. Galvao & Ted Juhl, 2019. "Testing for Slope Heterogeneity Bias in Panel Data Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(4), pages 749-760, October.
    3. Herold Dehling & Walter Philipp, 2002. "Empirical Process Techniques for Dependent Data," Springer Books, in: Herold Dehling & Thomas Mikosch & Michael Sørensen (ed.), Empirical Process Techniques for Dependent Data, pages 3-113, Springer.
    4. Pesaran, M. Hashem & Pick, Andreas & Timmermann, Allan, 2022. "Forecasting with panel data: estimation uncertainty versus parameter heterogeneity," CEPR Discussion Papers 17123, C.E.P.R. Discussion Papers.
    5. Wu Wang & Zhongyi Zhu, 2024. "Homogeneity and Sparsity Analysis for High-Dimensional Panel Data Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 42(1), pages 26-35, January.
    6. Hashem Pesaran, M. & Yamagata, Takashi, 2008. "Testing slope homogeneity in large panels," Journal of Econometrics, Elsevier, vol. 142(1), pages 50-93, January.
    7. Wuyi Wang & Peter C. B. Phillips & Liangjun Su, 2018. "Homogeneity pursuit in panel data models: Theory and application," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 33(6), pages 797-815, September.
    8. Mokkadem, Abdelkader, 1988. "Mixing properties of ARMA processes," Stochastic Processes and their Applications, Elsevier, vol. 29(2), pages 309-315, September.
    9. Ando, Tomohiro & Bai, Jushan, 2015. "A simple new test for slope homogeneity in panel data models with interactive effects," Economics Letters, Elsevier, vol. 136(C), pages 112-117.
    10. Johan Blomquist & Joakim Westerlund, 2016. "Panel bootstrap tests of slope homogeneity," Empirical Economics, Springer, vol. 50(4), pages 1359-1381, June.
    11. Peter C. B. Phillips & Donggyu Sul, 2003. "Dynamic panel estimation and homogeneity testing under cross section dependence *," Econometrics Journal, Royal Economic Society, vol. 6(1), pages 217-259, June.
    12. Kutta, Tim & Dette, Holger, 2024. "Validating approximate slope homogeneity in large panels," Journal of Econometrics, Elsevier, vol. 246(1).
    13. Liangjun Su & Zhentao Shi & Peter C. B. Phillips, 2016. "Identifying Latent Structures in Panel Data," Econometrica, Econometric Society, vol. 84, pages 2215-2264, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kutta, Tim & Dette, Holger, 2024. "Validating approximate slope homogeneity in large panels," Journal of Econometrics, Elsevier, vol. 246(1).
    2. Ando, Tomohiro & Bai, Jushan, 2021. "Large-scale generalized linear longitudinal data models with grouped patterns of unobserved heterogeneity," MPRA Paper 111431, University Library of Munich, Germany.
    3. Oguzhan Akgun & Ryo Okui, 2025. "Robust Inference Methods for Latent Group Panel Models under Possible Group Non-Separation," Papers 2511.18550, arXiv.org.
    4. Vasilis Sarafidis & Tom Wansbeek, 2020. "Celebrating 40 Years of Panel Data Analysis: Past, Present and Future," Monash Econometrics and Business Statistics Working Papers 6/20, Monash University, Department of Econometrics and Business Statistics.
    5. Wang, Yiren & Phillips, Peter C.B. & Su, Liangjun, 2024. "Panel data models with time-varying latent group structures," Journal of Econometrics, Elsevier, vol. 240(1).
    6. Nibbering, D. & Paap, R., 2019. "Panel Forecasting with Asymmetric Grouping," Econometric Institute Research Papers EI-2019-30, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    7. Yoonseok Lee & Donggyu Sul, 2022. "Trimmed Mean Group Estimation," Advances in Econometrics, in: Essays in Honor of M. Hashem Pesaran: Panel Modeling, Micro Applications, and Econometric Methodology, volume 43, pages 177-202, Emerald Group Publishing Limited.
    8. Chulan Lasantha Kukule Nawarathna, 2025. "Female Labor Force Participation and Sustainable Development: A Global Study," International Journal of Research and Innovation in Social Science, International Journal of Research and Innovation in Social Science (IJRISS), vol. 9(5), pages 2417-2438, May.
    9. Mikihito Nishi, 2025. "K-Means Panel Data Clustering in the Presence of Small Groups," Papers 2508.15408, arXiv.org.
    10. Pionati, Alessandro, 2025. "Latent grouped structures in panel data: a review," MPRA Paper 123954, University Library of Munich, Germany.
    11. Feng Xu & Zekai He, 2020. "Testing slope homogeneity in panel data models with a multifactor error structure," Statistical Papers, Springer, vol. 61(1), pages 201-224, February.
    12. Chulan Lasantha Kukule Nawarathna, 2025. "The Impact of Female Labor Force Participation on Enhancing Human Development Throughout the Stages of Global Demographic Dividends," International Journal of Research and Innovation in Social Science, International Journal of Research and Innovation in Social Science (IJRISS), vol. 9(4), pages 580-605, April.
    13. Mehrabani, Ali, 2023. "Estimation and identification of latent group structures in panel data," Journal of Econometrics, Elsevier, vol. 235(2), pages 1464-1482.
    14. Lu, Xun & Su, Liangjun, 2023. "Uniform inference in linear panel data models with two-dimensional heterogeneity," Journal of Econometrics, Elsevier, vol. 235(2), pages 694-719.
    15. Mohammed Musah & Yusheng Kong & Isaac Adjei Mensah & Stephen Kwadwo Antwi & Mary Donkor, 2021. "The connection between urbanization and carbon emissions: a panel evidence from West Africa," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 23(8), pages 11525-11552, August.
    16. Antonio Raiola & Nazarii Salish, 2025. "Detection Boundaries for Panel Slope Homogeneity Tests Under Small-Group Heterogeneity," Papers 2510.22841, arXiv.org, revised Apr 2026.
    17. Marina Khismatullina & Bernhard van der Sluis, 2025. "Multiscale Comparison of Nonparametric Trending Coefficients," Papers 2511.12600, arXiv.org.
    18. Zhu, Jia & Zhou, Pengfei & Shen, Yang, 2024. "Exploring the individual and combined effect of natural resource rents, fin-tech, and renewable energy on sustainable development: New insights from SSA countries," Resources Policy, Elsevier, vol. 91(C).
    19. Boyuan Zhang, 2022. "Incorporating Prior Knowledge of Latent Group Structure in Panel Data Models," Papers 2211.16714, arXiv.org, revised Oct 2023.
    20. Paul Haimerl & Stephan Smeekes & Ines Wilms, 2025. "Estimation of Latent Group Structures in Time-Varying Panel Data Models," Papers 2503.23165, arXiv.org, revised Nov 2025.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2512.15592. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.