IDEAS home Printed from https://ideas.repec.org/a/bla/stanee/v63y2009i3p334-346.html
   My bibliography  Save this article

Expert opinion versus expertise in forecasting

Author

Listed:
  • Philip Hans Franses
  • Michael McAleer
  • Rianne Legerstee

Abstract

Expert opinion is an opinion given by an expert, and it can have significant value in forecasting key policy variables in economics and finance. Expert forecasts can either be expert opinions, or forecasts based on an econometric model. An expert forecast that is based on an econometric model is replicable, and can be defined as a replicable expert forecast (REF), whereas an expert opinion that is not based on an econometric model can be defined as a non‐replicable expert forecast (Non‐REF). Both REF and Non‐REF may be made available by an expert regarding a policy variable of interest. In this paper, we develop a model to generate REF, and compare REF with Non‐REF. A method is presented to compare REF and Non‐REF using efficient estimation methods, and a direct test of expertise on expert opinion is given. The latter serves the purpose of investigating whether expert adjustment improves the model‐based forecasts. Illustrations for forecasting pharmaceutical stock keeping unit (SKUs), where the econometric model is of (variations of) the autoregressive integrated moving average model (ARIMA) type, show the relevance of the new methodology proposed in the paper. In particular, experts possess significant expertise, and expert forecasts are significant in explaining actual sales.

Suggested Citation

  • Philip Hans Franses & Michael McAleer & Rianne Legerstee, 2009. "Expert opinion versus expertise in forecasting," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 63(3), pages 334-346, August.
  • Handle: RePEc:bla:stanee:v:63:y:2009:i:3:p:334-346
    DOI: 10.1111/j.1467-9574.2009.00426.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1467-9574.2009.00426.x
    Download Restriction: no

    File URL: https://libkey.io/10.1111/j.1467-9574.2009.00426.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Mcleer, M. & Mckenzie, C.R., 1989. "When Are Two Step Estimators Efficient?," Papers 179, Australian National University - Department of Economics.
    2. Franses, Ph.H.B.F. & Kranendonk, H.C. & Lanser, D., 2007. "On the optimality of expert-adjusted forecasts," Econometric Institute Research Papers EI 2007-38, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    3. Christina D. Romer & David H. Romer, 2008. "The FOMC versus the Staff: Where Can Monetary Policymakers Add Value?," American Economic Review, American Economic Association, vol. 98(2), pages 230-235, May.
    4. Franses, Philip Hans, 2008. "Merging models and experts," International Journal of Forecasting, Elsevier, vol. 24(1), pages 31-33.
    5. Patton, Andrew J. & Timmermann, Allan, 2007. "Properties of optimal forecasts under asymmetric loss and nonlinearity," Journal of Econometrics, Elsevier, vol. 140(2), pages 884-918, October.
    6. McAleer, Michael, 1995. "The significance of testing empirical non-nested models," Journal of Econometrics, Elsevier, vol. 67(1), pages 149-171, May.
    7. McAleer, Michael, 1992. "Efficient Estimation: The Rao-Zyskind Condition, Kruskal's Theorem and Ordinary Least Squares," The Economic Record, The Economic Society of Australia, vol. 68(200), pages 65-72, March.
    8. Patton, Andrew J. & Timmermann, Allan, 2007. "Testing Forecast Optimality Under Unknown Loss," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1172-1184, December.
    9. Goodwin, Paul, 2000. "Improving the voluntary integration of statistical forecasts and judgment," International Journal of Forecasting, Elsevier, vol. 16(1), pages 85-99.
    10. Franses, Philip Hans & Legerstee, Rianne, 2009. "Properties of expert adjustments on model-based SKU-level forecasts," International Journal of Forecasting, Elsevier, vol. 25(1), pages 35-47.
    11. Robert C. Blattberg & Stephen J. Hoch, 1990. "Database Models and Managerial Intuition: 50% Model + 50% Manager," Management Science, INFORMS, vol. 36(8), pages 887-899, August.
    12. Oxley, Les & McAleer, Michael, 1993. "Econometric Issues in Macroeconomic Models with Generated Regressors," Journal of Economic Surveys, Wiley Blackwell, vol. 7(1), pages 1-40.
    13. Pagan, Adrian, 1984. "Econometric Issues in the Analysis of Regressions with Generated Regressors," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 25(1), pages 221-247, February.
    14. Bunn, Derek W. & Salo, Ahti A., 1996. "Adjustment of forecasts with model consistent expectations," International Journal of Forecasting, Elsevier, vol. 12(1), pages 163-170, March.
    15. Fiebig, Denzil G. & McAleer, Michael & Bartels, Robert, 1992. "Properties of ordinary least squares estimators in regression models with nonspherical disturbances," Journal of Econometrics, Elsevier, vol. 54(1-3), pages 321-334.
    16. Suhejla Hoti & Michael McAleer & Daniel Slottje, 2006. "Intellectual Property Litigation Activity In The Usa," Journal of Economic Surveys, Wiley Blackwell, vol. 20(4), pages 715-729, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chang, Chia-Lin & de Bruijn, Bert & Franses, Philip Hans & McAleer, Michael, 2013. "Analyzing fixed-event forecast revisions," International Journal of Forecasting, Elsevier, vol. 29(4), pages 622-627.
    2. Chang, Chia-Lin & Franses, Philip Hans & McAleer, Michael, 2013. "Are forecast updates progressive?," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 93(C), pages 9-18.
    3. Chang, C-L. & McAleer, M.J. & Franses, Ph.H.B.F., 2010. "Combining Non-Replicable Forecasts," Econometric Institute Research Papers EI 2010-44, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    4. Chia-Lin Chang & Philip Hans Franses & Michael McAleer, 2010. "Evaluating Combined Non-Replicable Forecasts," Working Papers in Economics 10/74, University of Canterbury, Department of Economics and Finance.
    5. Chia-Lin Chang & Michael Mcaleer, 2013. "What Do Experts Know About Forecasting Journal Quality? A Comparison With Isi Research Impact In Finance," Annals of Financial Economics (AFE), World Scientific Publishing Co. Pte. Ltd., vol. 8(01), pages 1-30.
    6. Egor Griva & Irina Butorina & Anatoly Sidorov & Pavel Senchenko, 2022. "Analysis and Forecasting of Sales Funnels," Mathematics, MDPI, vol. 11(1), pages 1-22, December.
    7. Philip Hans Franses, 2011. "Averaging Model Forecasts and Expert Forecasts: Why Does It Work?," Interfaces, INFORMS, vol. 41(2), pages 177-181, April.
    8. Franses, Ph.H.B.F. & McAleer, M.J. & Legerstee, R., 2010. "Evaluating Macroeconomic Forecast: A Review of Some Recent Developments," Econometric Institute Research Papers EI 2010-19, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    9. Chang, Chia Lin & Franses, Philip Hans & Mcaleer, Michael, 2012. "Evaluating Individual and Mean Non-Replicable Forecasts," Journal for Economic Forecasting, Institute for Economic Forecasting, vol. 0(3), pages 22-43, September.
    10. Chang, Chia-Lin & Franses, Philip Hans & McAleer, Michael, 2011. "How accurate are government forecasts of economic fundamentals? The case of Taiwan," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1066-1075, October.
    11. Philip Hans Franses & Michael McAleer & Rianne Legerstee, 2014. "Evaluating Macroeconomic Forecasts: A Concise Review Of Some Recent Developments," Journal of Economic Surveys, Wiley Blackwell, vol. 28(2), pages 195-208, April.
    12. Franses, Ph.H.B.F. & McAleer, M.J. & Legerstee, R., 2008. "Does the ROMC have expertise, and can it forecast?," Econometric Institute Research Papers EI 2008-33, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    13. Franses, Ph.H.B.F., 2010. "Decomposing bias in expert forecast," Econometric Institute Research Papers EI 2010-26, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    14. Chia-Lin Chang & Michael McAleer, 2012. "What do Experts Know About Ranking Journal Quality? A Comparison with ISI Research Impact in Finance," Documentos de Trabajo del ICAE 2012-01, Universidad Complutense de Madrid, Facultad de Ciencias Económicas y Empresariales, Instituto Complutense de Análisis Económico.
    15. Franses, Ph.H.B.F., 2009. "Forecasting Sales," Econometric Institute Research Papers EI 2009-29, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    16. Franses, Philip Hans, 2013. "Improving judgmental adjustment of model-based forecasts," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 93(C), pages 1-8.
    17. Chang, C-L. & Franses, Ph.H.B.F. & McAleer, M.J., 2009. "How Accurate are Government Forecast of Economic Fundamentals?," Econometric Institute Research Papers EI 2009-09, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chang, Chia-Lin & Franses, Philip Hans & McAleer, Michael, 2011. "How accurate are government forecasts of economic fundamentals? The case of Taiwan," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1066-1075, October.
    2. Chang, C-L. & Franses, Ph.H.B.F. & McAleer, M.J., 2009. "How Accurate are Government Forecast of Economic Fundamentals?," Econometric Institute Research Papers EI 2009-09, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    3. Chia-Lin Chang & Philip Hans Franses & Michael McAleer, 2010. "Combining Non-Replicable Forecasts," Working Papers in Economics 10/35, University of Canterbury, Department of Economics and Finance.
    4. Chang, Chia-Lin & Franses, Philip Hans & McAleer, Michael, 2013. "Are forecast updates progressive?," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 93(C), pages 9-18.
    5. Franses, Ph.H.B.F. & McAleer, M.J. & Legerstee, R., 2008. "Does the ROMC have expertise, and can it forecast?," Econometric Institute Research Papers EI 2008-33, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    6. Legerstee, R. & Franses, Ph.H.B.F. & Paap, R., 2011. "Do experts incorporate statistical model forecasts and should they?," Econometric Institute Research Papers EI2011-32, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    7. Philip Hans Franses & Rianne Legerstee, 2010. "Do experts' adjustments on model-based SKU-level forecasts improve forecast quality?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(3), pages 331-340.
    8. Philip Hans Franses & Michael McAleer & Rianne Legerstee, 2014. "Evaluating Macroeconomic Forecasts: A Concise Review Of Some Recent Developments," Journal of Economic Surveys, Wiley Blackwell, vol. 28(2), pages 195-208, April.
    9. P H Franses & R Legerstee, 2011. "Experts' adjustment to model-based SKU-level forecasts: does the forecast horizon matter?," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(3), pages 537-543, March.
    10. Chia-Lin Chang & Michael McAleer, 2019. "Modeling Latent Carbon Emission Prices for Japan: Theory and Practice," Energies, MDPI, vol. 12(21), pages 1-21, November.
    11. Branston, Christopher B. & Groenewold, Nicolaas, 2004. "Investment and share prices: fundamental versus speculative components," The North American Journal of Economics and Finance, Elsevier, vol. 15(2), pages 199-226, August.
    12. De Baets, Shari & Harvey, Nigel, 2018. "Forecasting from time series subject to sporadic perturbations: Effectiveness of different types of forecasting support," International Journal of Forecasting, Elsevier, vol. 34(2), pages 163-180.
    13. Franses, Ph.H.B.F. & Legerstee, R., 2007. "What drives the relevance and quality of experts' adjustment to model-based forecasts?," Econometric Institute Research Papers EI 2007-43, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    14. Arvan, Meysam & Fahimnia, Behnam & Reisi, Mohsen & Siemsen, Enno, 2019. "Integrating human judgement into quantitative forecasting methods: A review," Omega, Elsevier, vol. 86(C), pages 237-252.
    15. Kearney, Colm, 2000. "The determination and international transmission of stock market volatility," Global Finance Journal, Elsevier, vol. 11(1-2), pages 31-52.
    16. Rianne Legerstee & Philip Hans Franses, 2014. "Do Experts’ SKU Forecasts Improve after Feedback?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 33(1), pages 69-79, January.
    17. Franses, Philip Hans & Kranendonk, Henk C. & Lanser, Debby, 2011. "One model and various experts: Evaluating Dutch macroeconomic forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 482-495.
    18. Philip Hans Franses, 2021. "Modeling Judgment in Macroeconomic Forecasts," Journal of Quantitative Economics, Springer;The Indian Econometric Society (TIES), vol. 19(1), pages 401-417, December.
    19. Franses, Ph.H.B.F. & McAleer, M.J. & Legerstee, R., 2010. "Evaluating Macroeconomic Forecast: A Review of Some Recent Developments," Econometric Institute Research Papers EI 2010-19, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    20. Chia-Lin Chang & Michael McAleer & Chien-Hsun Wang, 2017. "An Econometric Analysis of ETF and ETF Futures in Financial and Energy Markets Using Generated Regressors," IJFS, MDPI, vol. 6(1), pages 1-24, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:stanee:v:63:y:2009:i:3:p:334-346. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0039-0402 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.