IDEAS home Printed from https://ideas.repec.org/a/gam/jforec/v7y2025i1p4-d1566045.html

Testing for Bias in Forecasts for Independent Multinomial Outcomes

Author

Listed:
  • Philip Hans Franses

    (Econometric Institute, Erasmus School of Economics, Burgemeester Oudlaan 50, 3062PA Rotterdam, The Netherlands)

  • Richard Paap

    (Econometric Institute, Erasmus School of Economics, Burgemeester Oudlaan 50, 3062PA Rotterdam, The Netherlands)

Abstract

This paper deals with a test on forecast bias in predicting independent multinomial outcomes where the predictions are probabilities. The new Likelihood Ratio (and Wald) test extends the familiar Mincer Zarnowitz regression to a multinomial logit model instead of a linear regression. The test is evaluated using various simulation experiments, which indicate that the size and power properties are good, even for small sample sizes, in the sense that the size is close to the used 5% level, and the power quickly reaches 1. We implement the test in an empirical setting on brand choice by individual households.

Suggested Citation

  • Philip Hans Franses & Richard Paap, 2025. "Testing for Bias in Forecasts for Independent Multinomial Outcomes," Forecasting, MDPI, vol. 7(1), pages 1-8, January.
    • Handle: RePEc:gam:jforec:v:7:y:2025:i:1:p:4-:d:1566045
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2571-9394/7/1/4/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2571-9394/7/1/4/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    2. Anonymous, 1969. "Chapter II. Forecasts for the Economy," National Institute Economic Review, National Institute of Economic and Social Research, vol. 47, pages 32-46, February.
    3. Franses,Philip Hans & Paap,Richard, 2010. "Quantitative Models in Marketing Research," Cambridge Books, Cambridge University Press, number 9780521143653, January.
    4. Philip Hans Franses, 2021. "Testing for bias in forecasts for independent binary outcomes," Applied Economics Letters, Taylor & Francis Journals, vol. 28(15), pages 1336-1338, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Risselada, Hans & Verhoef, Peter C. & Bijmolt, Tammo H.A., 2010. "Staying Power of Churn Prediction Models," Journal of Interactive Marketing, Elsevier, vol. 24(3), pages 198-208.
    2. Michis Antonis A, 2009. "Regression Analysis of Marketing Time Series: A Wavelet Approach with Some Frequency Domain Insights," Review of Marketing Science, De Gruyter, vol. 7(1), pages 1-43, July.
    3. Hendry, David F. & Clements, Michael P., 2003. "Economic forecasting: some lessons from recent research," Economic Modelling, Elsevier, vol. 20(2), pages 301-329, March.
    4. Polo, Yolanda & Sese, F. Javier & Verhoef, Peter C., 2011. "The Effect of Pricing and Advertising on Customer Retention in a Liberalizing Market," Journal of Interactive Marketing, Elsevier, vol. 25(4), pages 201-214.
    5. Christina Ziegler, 2009. "Testing Predicitive Ability of Business Cycle Indicators for the Euro Area," ifo Working Paper Series 69, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    6. repec:kap:iaecre:v:14:y:2008:i:1:p:112-124 is not listed on IDEAS
    7. Ericsson, Neil R., 2016. "Eliciting GDP forecasts from the FOMC’s minutes around the financial crisis," International Journal of Forecasting, Elsevier, vol. 32(2), pages 571-583.
    8. Pascal Bührig & Klaus Wohlrabe, 2015. "Revisionen der deutschen Industrieproduktion und die ifo Indikatoren," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 68(21), pages 27-31, November.
    9. Jozef Barunik & Lukas Vacha, 2015. "Realized wavelet-based estimation of integrated variance and jumps in the presence of noise," Quantitative Finance, Taylor & Francis Journals, vol. 15(8), pages 1347-1364, August.
    10. Busch, Thomas & Christensen, Bent Jesper & Nielsen, Morten Ørregaard, 2011. "The role of implied volatility in forecasting future realized volatility and jumps in foreign exchange, stock, and bond markets," Journal of Econometrics, Elsevier, vol. 160(1), pages 48-57, January.
    11. Vortelinos, Dimitrios I., 2017. "Forecasting realized volatility: HAR against Principal Components Combining, neural networks and GARCH," Research in International Business and Finance, Elsevier, vol. 39(PB), pages 824-839.
    12. Chang, Andrew C. & Hanson, Tyler J., 2016. "The accuracy of forecasts prepared for the Federal Open Market Committee," Journal of Economics and Business, Elsevier, vol. 83(C), pages 23-43.
    13. John W. Freebairn, 1975. "Forecasting For Australian Agriculture," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 19(3), pages 154-174, December.
    14. Pablo Pincheira B. & Nicolás Fernández, 2011. "Jaque Mate a las Proyecciones de Consenso," Working Papers Central Bank of Chile 630, Central Bank of Chile.
    15. Magnus Kvåle Helliesen & Håvard Hungnes & Terje Skjerpen, 2022. "Revisions in the Norwegian National Accounts: accuracy, unbiasedness and efficiency in preliminary figures," Empirical Economics, Springer, vol. 62(3), pages 1079-1121, March.
    16. Pao‐Lin Tien & Tara M. Sinclair & Edward N. Gamber, 2021. "Do Fed Forecast Errors Matter?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 83(3), pages 686-712, June.
    17. Tolga Cenesizoglu & Denada Ibrushi, 2020. "Predicting Systematic Risk With Macroeconomic And Financial Variables," Journal of Financial Research, Southern Finance Association;Southwestern Finance Association, vol. 43(3), pages 649-673, August.
    18. Sucarrat, Genaro, 2009. "Forecast Evaluation of Explanatory Models of Financial Variability," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 3, pages 1-33.
    19. Kashyap, Ravi, 2020. "David vs Goliath (You against the Markets), A dynamic programming approach to separate the impact and timing of trading costs," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 545(C).
    20. Massimo Guidolin & Stuart Hyde & David McMillan & Sadayuki Ono, 2014. "Does the Macroeconomy Predict UK Asset Returns in a Nonlinear Fashion? Comprehensive Out-of-Sample Evidence," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 76(4), pages 510-535, August.
    21. Haugom, Erik & Langeland, Henrik & Molnár, Peter & Westgaard, Sjur, 2014. "Forecasting volatility of the U.S. oil market," Journal of Banking & Finance, Elsevier, vol. 47(C), pages 1-14.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jforec:v:7:y:2025:i:1:p:4-:d:1566045. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.