IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v41y2025i2p670-688.html
   My bibliography  Save this article

Efficiency of poll-based multi-period forecasting systems for German state elections

Author

Listed:
  • Fritsch, Markus
  • Haupt, Harry
  • Schnurbus, Joachim

Abstract

Election polls are frequently employed to reflect voter sentiment with respect to a particular election (or fixed-event). Despite their widespread use as forecasts and inputs for predictive algorithms, there is substantial uncertainty regarding their efficiency. This uncertainty is amplified by judgment in the form of pollsters applying unpublished weighting schemes to ensure the representativeness of the sampled voters for the underlying population. Efficient forecasting systems incorporate past information instantly, which renders a given fixed-event unpredictable based on past information. This results in all sequential adjustments of the fixed-event forecasts across adjacent time periods (or forecast revisions) being martingale differences. This paper illustrates the theoretical conditions related to weak efficiency of fixed-event forecasting systems based on traditional least squares loss and asymmetrically weighted least absolute deviations (or quantile) loss. Weak efficiency of poll-based multi-period forecasting systems for all German federal state elections since the year 2000 is investigated. The inefficiency of almost all considered forecasting systems is documented and alternative explanations for the findings are discussed.

Suggested Citation

  • Fritsch, Markus & Haupt, Harry & Schnurbus, Joachim, 2025. "Efficiency of poll-based multi-period forecasting systems for German state elections," International Journal of Forecasting, Elsevier, vol. 41(2), pages 670-688.
  • Handle: RePEc:eee:intfor:v:41:y:2025:i:2:p:670-688
    DOI: 10.1016/j.ijforecast.2024.04.008
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207024000396
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2024.04.008?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Goodwin, Paul & Wright, George, 1993. "Improving judgmental time series forecasting: A review of the guidance provided by research," International Journal of Forecasting, Elsevier, vol. 9(2), pages 147-161, August.
    2. J. Carlos Escanciano & Ignacio N. Lobato, 2009. "Testing the Martingale Hypothesis," Palgrave Macmillan Books, in: Terence C. Mills & Kerry Patterson (ed.), Palgrave Handbook of Econometrics, chapter 20, pages 972-1003, Palgrave Macmillan.
    3. Clements, Michael P & Taylor, Nick, 2001. "Robust Evaluation of Fixed-Event Forecast Rationality," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 20(4), pages 285-295, July.
    4. Fred Joutz & Michael P. Clements & Herman O. Stekler, 2007. "An evaluation of the forecasts of the federal reserve: a pooled approach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(1), pages 121-136.
    5. Chang, Chia-Lin & de Bruijn, Bert & Franses, Philip Hans & McAleer, Michael, 2013. "Analyzing fixed-event forecast revisions," International Journal of Forecasting, Elsevier, vol. 29(4), pages 622-627.
    6. Frederic S. Mishkin, 1983. "Are Market Forecasts Rational?," NBER Chapters, in: A Rational Expectations Approach to Macroeconometrics: Testing Policy Ineffectiveness and Efficient-Markets Models, pages 59-75, National Bureau of Economic Research, Inc.
    7. Roger Koenker, 2017. "Quantile regression 40 years on," CeMMAP working papers CWP36/17, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    8. Peter C. B. Phillips & Sainan Jin, 2014. "Testing the Martingale Hypothesis," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 32(4), pages 537-554, October.
    9. Linton, O. & Whang, Yoon-Jae, 2007. "The quantilogram: With an application to evaluating directional predictability," Journal of Econometrics, Elsevier, vol. 141(1), pages 250-282, November.
    10. Makridakis, Spyros & Chatfield, Chris & Hibon, Michele & Lawrence, Michael & Mills, Terence & Ord, Keith & Simmons, LeRoy F., 1993. "The M2-competition: A real-time judgmentally based forecasting study," International Journal of Forecasting, Elsevier, vol. 9(1), pages 5-22, April.
    11. David Byers & James Davidson & David Peel, 1997. "Modelling Political Popularity: an Analysis of Long‐range Dependence in Opinion Poll Series," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 160(3), pages 471-490, September.
    12. Gneiting, Tilmann, 2011. "Quantiles as optimal point forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 197-207.
    13. Robert F. Engle & Simone Manganelli, 2004. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Journal of Business & Economic Statistics, American Statistical Association, vol. 22, pages 367-381, October.
    14. Kiviet, Jan F., 1995. "On bias, inconsistency, and efficiency of various estimators in dynamic panel data models," Journal of Econometrics, Elsevier, vol. 68(1), pages 53-78, July.
    15. Drew A. Linzer, 2013. "Dynamic Bayesian Forecasting of Presidential Elections in the States," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(501), pages 124-134, March.
    16. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2022. "M5 accuracy competition: Results, findings, and conclusions," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1346-1364.
    17. Tahk, Alexander M., 2015. "A Continuous-Time, Latent-Variable Model of Time Series Data," Political Analysis, Cambridge University Press, vol. 23(2), pages 278-298, April.
    18. repec:osf:osfxxx:29pvm_v1 is not listed on IDEAS
    19. Patton, Andrew J. & Timmermann, Allan, 2007. "Properties of optimal forecasts under asymmetric loss and nonlinearity," Journal of Econometrics, Elsevier, vol. 140(2), pages 884-918, October.
    20. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2018. "The M4 Competition: Results, findings, conclusion and way forward," International Journal of Forecasting, Elsevier, vol. 34(4), pages 802-808.
    21. G. A. Christodoulakis & E. C. Mamatzakis, 2009. "Assessing the prudence of economic forecasts in the EU," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(4), pages 583-606.
    22. de Castro, Luciano & Galvao, Antonio F. & Montes-Rojas, Gabriel, 2020. "Quantile selection in non-linear GMM quantile models," Economics Letters, Elsevier, vol. 195(C).
    23. Zarnowitz, Victor, 1985. "Rational Expectations and Macroeconomic Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 3(4), pages 293-311, October.
    24. Colm O'Muircheartaigh & Peter Lynn, 1997. "Editorial: The 1997 UK Pre‐election Polls," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 160(3), pages 381-385, September.
    25. Oberhofer, Walter & Haupt, Harry, 2005. "The asymptotic distribution of the unconditional quantile estimator under dependence," Statistics & Probability Letters, Elsevier, vol. 73(3), pages 243-250, July.
    26. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    27. Koenker, Roger & Xiao, Zhijie, 2006. "Quantile Autoregression," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 980-990, September.
    28. Gneiting, Tilmann, 2011. "Making and Evaluating Point Forecasts," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 746-762.
    29. Roger Koenker, 2017. "Quantile Regression: 40 Years On," Annual Review of Economics, Annual Reviews, vol. 9(1), pages 155-176, September.
    30. Aichholzer, Julian & Willmann, Johanna, 2014. "Forecasting Austrian national elections: The Grand Coalition model," International Journal of Forecasting, Elsevier, vol. 30(1), pages 55-64.
    31. Andrew J. Patton & Allan Timmermann, 2011. "Predictability of Output Growth and Inflation: A Multi-Horizon Survey Approach," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(3), pages 397-410, July.
    32. Pesaran, M. Hashem & Pick, Andreas & Pranovich, Mikhail, 2013. "Optimal forecasts in the presence of structural breaks," Journal of Econometrics, Elsevier, vol. 177(2), pages 134-152.
    33. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    34. Francis X. Diebold, 2015. "Comparing Predictive Accuracy, Twenty Years Later: A Personal Perspective on the Use and Abuse of Diebold-Mariano Tests," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(1), pages 1-1, January.
    35. Gneiting, Tilmann, 2011. "Quantiles as optimal point forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 197-207, April.
    36. Davies, Anthony & Lahiri, Kajal, 1995. "A new framework for analyzing survey forecasts using three-dimensional panel data," Journal of Econometrics, Elsevier, vol. 68(1), pages 205-227, July.
    37. Roger Koenker & Zhijie Xiao, 2004. "Unit Root Quantile Autoregression Inference," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 775-787, January.
    38. Petropoulos, Fotios & Goodwin, Paul & Fildes, Robert, 2017. "Using a rolling training approach to improve judgmental extrapolations elicited from forecasters with technical knowledge," International Journal of Forecasting, Elsevier, vol. 33(1), pages 314-324.
    39. Patton, Andrew J. & Timmermann, Allan, 2007. "Testing Forecast Optimality Under Unknown Loss," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1172-1184, December.
    40. Nordhaus, William D, 1987. "Forecasting Efficiency: Concepts and Applications," The Review of Economics and Statistics, MIT Press, vol. 69(4), pages 667-674, November.
    41. Laura Mayoral & Juan J. Dolado & Jesús Gonzalo, 2003. "Long-range dependence in Spanish political opinion poll series," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(2), pages 137-155.
    42. Pesaran, M. Hashem & Pick, Andreas, 2011. "Forecast Combination Across Estimation Windows," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(2), pages 307-318.
    43. Fabio Busetti & Andrew Harvey, 2010. "Tests of strict stationarity based on quantile indicators," Journal of Time Series Analysis, Wiley Blackwell, vol. 31(6), pages 435-450, November.
    44. Makridakis, Spyros & Hibon, Michele, 2000. "The M3-Competition: results, conclusions and implications," International Journal of Forecasting, Elsevier, vol. 16(4), pages 451-476.
    45. Pesaran, M. Hashem, 2015. "Time Series and Panel Data Econometrics," OUP Catalogue, Oxford University Press, number 9780198759980, Decembrie.
    46. Badi H. Baltagi, 2021. "Econometric Analysis of Panel Data," Springer Texts in Business and Economics, Springer, edition 6, number 978-3-030-53953-5, December.
    47. Isakov, Michael & Kuriwaki, Shiro, 2020. "Towards Principled Unskewing: Viewing 2020 Election Polls Through a Corrective Lens from 2016," OSF Preprints 29pvm, Center for Open Science.
    48. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    49. Matei Demetrescu & Christoph Roling & Anna Titova, 2021. "Reevaluating the prudence of economic forecasts in the EU: The role of instrument persistence," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(1), pages 151-161, January.
    50. Mishkin, Frederic S, 1982. "Are [Market] Forecasts Rational? Errata," American Economic Review, American Economic Association, vol. 72(4), pages 899-899, September.
    51. Houshmand Shirani-Mehr & David Rothschild & Sharad Goel & Andrew Gelman, 2018. "Disentangling Bias and Variance in Election Polls," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(522), pages 607-614, April.
    52. Roger Koenker, 2017. "Quantile regression 40 years on," CeMMAP working papers 36/17, Institute for Fiscal Studies.
    53. Vereda, Luciano & Savignon, João & Gouveia da Silva, Tarciso, 2021. "A new method to assess the degree of information rigidity using fixed-event forecasts," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1576-1589.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. Bruzda, Joanna, 2019. "Quantile smoothing in supply chain and logistics forecasting," International Journal of Production Economics, Elsevier, vol. 208(C), pages 122-139.
    3. Alan Dasilva & Helton Saulo & Roberto Vila & Jose A. Fiorucci & Suvra Pal, 2024. "Parametric quantile autoregressive moving average models with exogenous terms," Statistical Papers, Springer, vol. 65(3), pages 1613-1643, May.
    4. Sun, Yuying & Wang, Shouyang & Zhang, Xun, 2018. "How efficient are China's macroeconomic forecasts? Evidences from a new forecasting evaluation approach," Economic Modelling, Elsevier, vol. 68(C), pages 506-513.
    5. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    6. Andrew Patton & Allan Timmermann, 2012. "Forecast Rationality Tests Based on Multi-Horizon Bounds," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(1), pages 1-17.
    7. Timo Dimitriadis & Tobias Fissler & Johanna Ziegel, 2020. "The Efficiency Gap," Papers 2010.14146, arXiv.org, revised Sep 2022.
    8. Graham Elliott & Ivana Komunjer & Allan Timmermann, 2008. "Biases in Macroeconomic Forecasts: Irrationality or Asymmetric Loss?," Journal of the European Economic Association, MIT Press, vol. 6(1), pages 122-157, March.
    9. Makridakis, Spyros & Hyndman, Rob J. & Petropoulos, Fotios, 2020. "Forecasting in social settings: The state of the art," International Journal of Forecasting, Elsevier, vol. 36(1), pages 15-28.
    10. Martin, Gael M. & Loaiza-Maya, Rubén & Maneesoonthorn, Worapree & Frazier, David T. & Ramírez-Hassan, Andrés, 2022. "Optimal probabilistic forecasts: When do they work?," International Journal of Forecasting, Elsevier, vol. 38(1), pages 384-406.
    11. Clements, Michael P., 2021. "Do survey joiners and leavers differ from regular participants? The US SPF GDP growth and inflation forecasts," International Journal of Forecasting, Elsevier, vol. 37(2), pages 634-646.
    12. Sulkhan Chavleishvili & Simone Manganelli, 2024. "Forecasting and stress testing with quantile vector autoregression," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 39(1), pages 66-85, January.
    13. Matei Demetrescu & Sinem Hacioglu Hoke, 2018. "Predictive regressions under asymmetric loss: factor augmentation and model selection," Bank of England working papers 723, Bank of England.
    14. Gneiting, Tilmann, 2011. "Making and Evaluating Point Forecasts," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 746-762.
    15. Marc-Oliver Pohle, 2020. "The Murphy Decomposition and the Calibration-Resolution Principle: A New Perspective on Forecast Evaluation," Papers 2005.01835, arXiv.org.
    16. Tian, Jing & Goodwin, Thomas, 2018. "An unobserved component modeling approach to evaluate multi-horizon forecasts," Working Papers 2018-04, University of Tasmania, Tasmanian School of Business and Economics.
    17. Fildes, Robert & Stekler, Herman, 2002. "The state of macroeconomic forecasting," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 435-468, December.
    18. Vidal-Llana, Xenxo & Guillén, Montserrat, 2022. "Cross-sectional quantile regression for estimating conditional VaR of returns during periods of high volatility," The North American Journal of Economics and Finance, Elsevier, vol. 63(C).
    19. Knüppel, Malte & Schultefrankenfeld, Guido, 2019. "Assessing the uncertainty in central banks’ inflation outlooks," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1748-1769.
    20. Barbara Rossi, 2021. "Forecasting in the Presence of Instabilities: How We Know Whether Models Predict Well and How to Improve Them," Journal of Economic Literature, American Economic Association, vol. 59(4), pages 1135-1190, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:41:y:2025:i:2:p:670-688. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.