IDEAS home Printed from https://ideas.repec.org/a/rjr/romjef/vy2012i3p22-43.html
   My bibliography  Save this article

Evaluating Individual and Mean Non-Replicable Forecasts

Author

Listed:
  • Chang, Chia Lin

    () (Department of Applied Economics, National Chung Hsing University, 250 Kuo Kuang Road, Taichung 402, Taiwan)

  • Franses, Philip Hans

    (Econometric Institute, Erasmus School of Economics, Erasmus University Rotterdam, The Netherlands.)

  • Mcaleer, Michael

    (Econometric Institute, Erasmus School of Economics, Erasmus University Rotterdam, and Tinbergen Institute, The Netherlands, and Department of Quantitative Economics, Complutense University of Madrid and Institute of Economic Research, Kyoto University.)

Abstract

Macroeconomic forecasts are often based on the interaction between econometric models and experts. A forecast that is based only on an econometric model is replicable and may be unbiased, whereas a forecast that is not based only on an econometric model, but also incorporates expert intuition, is non-replicable and is typically biased. In this paper we propose a methodology to analyze the qualities of individual and alternative means of non-replicable forecasts. One part of the methodology seeks to retrieve a replicable component from the non-replicable forecasts, and compares this component against the actual data. A second part modifies the estimation routine due to the assumption that the difference between a replicable and a non-replicable forecast involves measurement error. An empirical example to forecast economic fundamentals for Taiwan shows the relevance of the methodological approach using both individuals and alternative mean forecasts.

Suggested Citation

  • Chang, Chia Lin & Franses, Philip Hans & Mcaleer, Michael, 2012. "Evaluating Individual and Mean Non-Replicable Forecasts," Journal for Economic Forecasting, Institute for Economic Forecasting, vol. 0(3), pages 22-43, September.
  • Handle: RePEc:rjr:romjef:v::y:2012:i:3:p:22-43
    as

    Download full text from publisher

    File URL: http://www.ipe.ro/rjef/rjef3_12/rjef3_2012p22-43.pdf
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Eroglu, Cuneyt & Croxton, Keely L., 2010. "Biases in judgmental adjustments of statistical forecasts: The role of individual differences," International Journal of Forecasting, Elsevier, vol. 26(1), pages 116-133, January.
    2. Philip Hans Franses & Michael McAleer & Rianne Legerstee, 2009. "Expert opinion versus expertise in forecasting," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 63(3), pages 334-346.
    3. Philip Hans Franses & Rianne Legerstee, 2010. "Do experts' adjustments on model-based SKU-level forecasts improve forecast quality?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(3), pages 331-340.
    4. Chang, Chia-Lin & Franses, Philip Hans & McAleer, Michael, 2011. "How accurate are government forecasts of economic fundamentals? The case of Taiwan," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1066-1075, October.
    5. Franses, Philip Hans & Kranendonk, Henk C. & Lanser, Debby, 2011. "One model and various experts: Evaluating Dutch macroeconomic forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 482-495.
    6. Fildes, Robert & Goodwin, Paul & Lawrence, Michael & Nikolopoulos, Konstantinos, 2009. "Effective forecasting and judgmental adjustments: an empirical evaluation and strategies for improvement in supply-chain planning," International Journal of Forecasting, Elsevier, vol. 25(1), pages 3-23.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. repec:eee:ecmode:v:68:y:2018:i:c:p:506-513 is not listed on IDEAS

    More about this item

    Keywords

    Individual forecasts; alternative mean forecasts; efficient estimation; generated regressors; replicable forecasts; non-replicable forecasts; expert intuition;

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • E27 - Macroeconomics and Monetary Economics - - Consumption, Saving, Production, Employment, and Investment - - - Forecasting and Simulation: Models and Applications
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:rjr:romjef:v::y:2012:i:3:p:22-43. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Corina Saman). General contact details of provider: http://edirc.repec.org/data/ipacaro.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.