IDEAS home Printed from https://ideas.repec.org/a/wly/japmet/v41y2026i1p77-87.html

An Instrumental Variables Approach to Testing Forecast Efficiency

Author

Listed:
  • Tucker S. McElroy
  • Xuguang Simon Sheng

Abstract

We study a specific form of forecast efficiency that requires forecast errors to be unpredictable from forecast revisions. One approach aggregates forecasts and estimates an aggregated efficiency regression, while another estimates the relationship by running separate regressions for each individual and then aggregating. We demonstrate that both estimators can be asymptotically biased in the presence of public noise. To address these biases, we propose instrumenting forecast revisions with past forecast errors. The Anderson–Rubin likelihood ratio test can be applied to test for forecast efficiency and remains robust even in the presence of weak instrumental variables. Applications of the test to the US Survey of Professional Forecasters clearly reveal experts' underreaction to news in their macroeconomic expectations.

Suggested Citation

  • Tucker S. McElroy & Xuguang Simon Sheng, 2026. "An Instrumental Variables Approach to Testing Forecast Efficiency," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 41(1), pages 77-87, January.
    • Handle: RePEc:wly:japmet:v:41:y:2026:i:1:p:77-87
    DOI: 10.1002/jae.70008
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/jae.70008
    Download Restriction: no
    File URL: https://libkey.io/10.1002/jae.70008?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. M. Hashem Pesaran & Qiankun Zhou, 2018. "To Pool or Not to Pool: Revisited," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 80(2), pages 185-217, April.
    2. Xuguang Sheng & Jingyun Yang, 2013. "Truncated Product Methods for Panel Unit Root Tests," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 75(4), pages 624-636, August.
    3. Bürgi, Constantin & Ortiz, Julio L., 2026. "Overreaction through anchoring," International Journal of Forecasting, Elsevier, vol. 42(2), pages 512-526.
    4. Marcelo J. Moreira, 2003. "A Conditional Likelihood Ratio Test for Structural Models," Econometrica, Econometric Society, vol. 71(4), pages 1027-1048, July.
    5. Stock, James H & Wright, Jonathan H & Yogo, Motohiro, 2002. "A Survey of Weak Instruments and Weak Identification in Generalized Method of Moments," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(4), pages 518-529, October.
    6. Olivier Coibion & Yuriy Gorodnichenko, 2015. "Information Rigidity and the Expectations Formation Process: A Simple Framework and New Facts," American Economic Review, American Economic Association, vol. 105(8), pages 2644-2678, August.
    7. Andrew C. Chang & Trace J. Levinson, 2023. "Raiders of the lost high‐frequency forecasts: New data and evidence on the efficiency of the Fed's forecasting," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(1), pages 88-104, January.
    8. Scott R. Baker & Tucker S. McElroy & Xuguang S. Sheng, 2020. "Expectation Formation Following Large, Unexpected Shocks," The Review of Economics and Statistics, MIT Press, vol. 102(2), pages 287-303, May.
    9. Lahiri, Kajal & Sheng, Xuguang, 2008. "Evolution of forecast disagreement in a Bayesian learning model," Journal of Econometrics, Elsevier, vol. 144(2), pages 325-340, June.
    10. Fama, Eugene F, 1970. "Efficient Capital Markets: A Review of Theory and Empirical Work," Journal of Finance, American Finance Association, vol. 25(2), pages 383-417, May.
    11. Jeffrey C. Fuhrer, 2018. "Intrinsic expectations persistence: evidence from professional and household survey expectations," Working Papers 18-9, Federal Reserve Bank of Boston.
    12. Badi H. Baltagi & James M. Griffin & Weiwen Xiong, 2000. "To Pool Or Not To Pool: Homogeneous Versus Hetergeneous Estimations Applied to Cigarette Demand," The Review of Economics and Statistics, MIT Press, vol. 82(1), pages 117-126, February.
    13. Binder, Carola, 2017. "Consumer forecast revisions: Is information really so sticky?," Economics Letters, Elsevier, vol. 161(C), pages 112-115.
    14. Messina, Jeffrey D. & Sinclair, Tara M. & Stekler, Herman, 2015. "What can we learn from revisions to the Greenbook forecasts?," Journal of Macroeconomics, Elsevier, vol. 45(C), pages 54-62.
    15. Nordhaus, William D, 1987. "Forecasting Efficiency: Concepts and Applications," The Review of Economics and Statistics, MIT Press, vol. 69(4), pages 667-674, November.
    16. Lena Dräger & Michael J. Lamla, 2017. "Imperfect Information and Consumer Inflation Expectations: Evidence from Microdata," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 79(6), pages 933-968, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrew C. Chang & Trace J. Levinson, 2023. "Raiders of the lost high‐frequency forecasts: New data and evidence on the efficiency of the Fed's forecasting," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(1), pages 88-104, January.
    2. Iregui, Ana María & Núñez, Héctor M. & Otero, Jesús, 2021. "Testing the efficiency of inflation and exchange rate forecast revisions in a changing economic environment," Journal of Economic Behavior & Organization, Elsevier, vol. 187(C), pages 290-314.
    3. Andrew B. Martinez, 2025. "How do Macroeconomic Expectations React to Extreme Weather Shocks?," Working Papers 2025-001, The George Washington University, The Center for Economic Research.
    4. Bürgi, Constantin & Ortiz, Julio L., 2026. "Overreaction through anchoring," International Journal of Forecasting, Elsevier, vol. 42(2), pages 512-526.
    5. Constantin Burgi, 2016. "What Do We Lose When We Average Expectations?," Working Papers 2016-013, The George Washington University, The Center for Economic Research.
    6. Zidong An & Salem Abo‐Zaid & Xuguang Simon Sheng, 2023. "Inattention and the impact of monetary policy," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(4), pages 623-643, June.
    7. Metodij Hadzi‐Vaskov & Luca Antonio Ricci & Alejandro Mariano Werner & Rene Zamarripa, 2023. "What drives economic growth forecast revisions?," Review of International Economics, Wiley Blackwell, vol. 31(3), pages 1068-1092, August.
    8. Reslow, André, 2019. "Inefficient Use of Competitors'Forecasts?," Working Paper Series 380, Sveriges Riksbank (Central Bank of Sweden).
    9. Granziera, Eleonora & Jalasjoki, Pirkka & Paloviita, Maritta, 2021. "The bias and efficiency of the ECB inflation projections: A state dependent analysis," Bank of Finland Research Discussion Papers 7/2021, Bank of Finland.
    10. An, Zidong & Liu, Dingqian & Wu, Yuzheng, 2021. "Expectation formation following pandemic events," Economics Letters, Elsevier, vol. 200(C).
    11. Conrad, Christian & Lahiri, Kajal, 2023. "Heterogeneous expectations among professional forecasters," ZEW Discussion Papers 23-062, ZEW - Leibniz Centre for European Economic Research.
    12. Deschamps, Bruno & Ioannidis, Christos & Ka, Kook, 2020. "High-frequency credit spread information and macroeconomic forecast revision," International Journal of Forecasting, Elsevier, vol. 36(2), pages 358-372.
    13. Berge, Travis J. & Chang, Andrew C. & Sinha, Nitish R., 2019. "Evaluating the conditionality of judgmental forecasts," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1627-1635.
    14. de Mendonça, Helder Ferreira & Vereda, Luciano & Araujo, Mateus de Azevedo, 2022. "What type of information calls the attention of forecasters? Evidence from survey data in an emerging market," Journal of International Money and Finance, Elsevier, vol. 129(C).
    15. Raghav Goyal & Michael K. Adjemian, 2023. "Information rigidities in USDA crop production forecasts," American Journal of Agricultural Economics, John Wiley & Sons, vol. 105(5), pages 1405-1425, October.
    16. Granziera, Eleonora & Jalasjoki, Pirkka & Paloviita, Maritta, 2021. "The bias and efficiency of the ECB inflation projections: a State dependent analysis," Research Discussion Papers 7/2021, Bank of Finland.
    17. Dovern, Jonas & Fritsche, Ulrich & Loungani, Prakash & Tamirisa, Natalia, 2015. "Information rigidities: Comparing average and individual forecasts for a large international panel," International Journal of Forecasting, Elsevier, vol. 31(1), pages 144-154.
    18. Constantin Bürgi, 2020. "Expectation Formation and the Persistence of Shocks," Working Papers 2020-005, The George Washington University, The Center for Economic Research, revised Sep 2020.
    19. Hari P. Regmi & Todd H. Kuethe, 2024. "An evaluation of Congressional Budget Office's baseline projections of USDA mandatory farm and nutrition programs," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 46(3), pages 1214-1240, September.
    20. Jonas Dovern & Mr. Ulrich Fritsche & Mr. Prakash Loungani & Ms. Natalia T. Tamirisa, 2013. "Information Rigidities in Economic Growth Forecasts: Evidence from a Large International Panel," IMF Working Papers 2013/056, International Monetary Fund.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:japmet:v:41:y:2026:i:1:p:77-87. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.interscience.wiley.com/jpages/0883-7252/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.