IDEAS home Printed from https://ideas.repec.org/a/taf/quantf/v18y2018i1p139-169.html
   My bibliography  Save this article

How good can heuristic-based forecasts be? A comparative performance of econometric and heuristic models for UK and US asset returns

Author

Listed:
  • Massimo Guidolin
  • Alexei G. Orlov
  • Manuela Pedio

Abstract

This paper systematically investigates the sources of differential out-of-sample predictive accuracy of heuristic frameworks based on internet search frequencies and a large set of econometric models. The volume of internet searches helps gauge the degree of investors’ time-varying interest in specific assets. We use a wide range of state-of-the-art models, both of linear and nonlinear type (regime-switching predictive regressions, threshold autoregressive, smooth transition autoregressive), extended to capture conditional heteroskedasticity through GARCH models. The predictor variables investigated are those typical of the literature featuring a range of macroeconomic and market leading indicators. Our out-of-sample forecasting exercises are conducted with reference to US, UK, French and German data, both stocks and bonds, and for 1- and 12-months-ahead horizons. We employ several forecast performance metrics and predictive accuracy tests. Internet-search-based models are found to perform better than the average of all of the alternative models. For several country-asset-horizon combinations, particularly for UK bond returns, our heuristic models compare favourably with sophisticated econometric methods. The heuristic models are also shown to perform well in forecasting realized volatility. The baseline results are supported by several extensions and robustness checks, such as using alternative search keywords, controlling for Fama–French and Cochrane–Piazzesi factors, and implementing heuristic-based trading strategies.

Suggested Citation

  • Massimo Guidolin & Alexei G. Orlov & Manuela Pedio, 2018. "How good can heuristic-based forecasts be? A comparative performance of econometric and heuristic models for UK and US asset returns," Quantitative Finance, Taylor & Francis Journals, vol. 18(1), pages 139-169, January.
  • Handle: RePEc:taf:quantf:v:18:y:2018:i:1:p:139-169
    DOI: 10.1080/14697688.2017.1351619
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/14697688.2017.1351619
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1080/14697688.2017.1351619?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hamid, Alain & Heiden, Moritz, 2015. "Forecasting volatility with empirical similarity and Google Trends," Journal of Economic Behavior & Organization, Elsevier, vol. 117(C), pages 62-81.
    2. Terasvirta, T & Anderson, H M, 1992. "Characterizing Nonlinearities in Business Cycles Using Smooth Transition Autoregressive Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 7(S), pages 119-136, Suppl. De.
    3. Goddard, John & Kita, Arben & Wang, Qingwei, 2015. "Investor attention and FX market volatility," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 38(C), pages 79-96.
    4. Lemieux, James & Peterson, Robert A., 2011. "Purchase deadline as a moderator of the effects of price uncertainty on search duration," Journal of Economic Psychology, Elsevier, vol. 32(1), pages 33-44, February.
    5. Frankfurter, George M. & McGoun, Elton G., 2002. "Resistance is futile: the assimilation of behavioral finance," Journal of Economic Behavior & Organization, Elsevier, vol. 48(4), pages 375-389, August.
    6. Damien Challet & Ahmed Bel Hadj Ayed, 2013. "Predicting financial markets with Google Trends and not so random keywords," Papers 1307.4643, arXiv.org, revised Mar 2014.
    7. John H. Cochrane & Monika Piazzesi, 2005. "Bond Risk Premia," American Economic Review, American Economic Association, vol. 95(1), pages 138-160, March.
    8. Vozlyublennaia, Nadia, 2014. "Investor attention, index performance, and return predictability," Journal of Banking & Finance, Elsevier, vol. 41(C), pages 17-35.
    9. Thomas Dimpfl & Stephan Jank, 2016. "Can Internet Search Queries Help to Predict Stock Market Volatility?," European Financial Management, European Financial Management Association, vol. 22(2), pages 171-192, March.
    10. Pesaran, M Hashem & Timmermann, Allan, 2000. "A Recursive Modelling Approach to Predicting UK Stock Returns," Economic Journal, Royal Economic Society, vol. 110(460), pages 159-191, January.
    11. Challet Damien & Bel Hadj Ayed Ahmed, 2013. "Predicting financial markets with Google Trends and not so random keywords," Working Papers hal-00851637, HAL.
    12. Joseph, Kissan & Babajide Wintoki, M. & Zhang, Zelin, 2011. "Forecasting abnormal stock returns and trading volume using investor sentiment: Evidence from online search," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1116-1127, October.
    13. Fama, Eugene F & French, Kenneth R, 1992. "The Cross-Section of Expected Stock Returns," Journal of Finance, American Finance Association, vol. 47(2), pages 427-465, June.
    14. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    15. Hyunyoung Choi & Hal Varian, 2012. "Predicting the Present with Google Trends," The Economic Record, The Economic Society of Australia, vol. 88(s1), pages 2-9, June.
    16. Mondria, Jordi & Wu, Thomas & Zhang, Yi, 2010. "The determinants of international investment and attention allocation: Using internet search query data," Journal of International Economics, Elsevier, vol. 82(1), pages 85-95, September.
    17. Carhart, Mark M, 1997. "On Persistence in Mutual Fund Performance," Journal of Finance, American Finance Association, vol. 52(1), pages 57-82, March.
    18. Jacob A. Mincer, 1969. "Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance," NBER Books, National Bureau of Economic Research, Inc, number minc69-1, July.
    19. James H. Stock & Mark W.Watson, 2003. "Forecasting Output and Inflation: The Role of Asset Prices," Journal of Economic Literature, American Economic Association, vol. 41(3), pages 788-829, September.
    20. Michael S. Drake & Darren T. Roulstone & Jacob R. Thornock, 2012. "Investor Information Demand: Evidence from Google Searches Around Earnings Announcements," Journal of Accounting Research, Wiley Blackwell, vol. 50(4), pages 1001-1040, September.
    21. Chen, Nai-Fu & Roll, Richard & Ross, Stephen A, 1986. "Economic Forces and the Stock Market," The Journal of Business, University of Chicago Press, vol. 59(3), pages 383-403, July.
    22. Rapach, David E. & Wohar, Mark E. & Rangvid, Jesper, 2005. "Macro variables and international stock return predictability," International Journal of Forecasting, Elsevier, vol. 21(1), pages 137-166.
    23. Haug, Espen Gaarder & Taleb, Nassim Nicholas, 2011. "Option traders use (very) sophisticated heuristics, never the Black-Scholes-Merton formula," Journal of Economic Behavior & Organization, Elsevier, vol. 77(2), pages 97-106, February.
    24. Fama, Eugene F. & French, Kenneth R., 1989. "Business conditions and expected returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 25(1), pages 23-49, November.
    25. Goecke, Henry & Luhan, Wolfgang J. & Roos, Michael W.M., 2013. "Rational inattentiveness in a forecasting experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 94(C), pages 80-89.
    26. Pesaran, M Hashem & Timmermann, Allan, 1995. "Predictability of Stock Returns: Robustness and Economic Significance," Journal of Finance, American Finance Association, vol. 50(4), pages 1201-1228, September.
    27. Vlastakis, Nikolaos & Markellos, Raphael N., 2012. "Information demand and stock market volatility," Journal of Banking & Finance, Elsevier, vol. 36(6), pages 1808-1821.
    28. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    29. Dzielinski, Michal, 2012. "Measuring economic uncertainty and its impact on the stock market," Finance Research Letters, Elsevier, vol. 9(3), pages 167-175.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Huthaifa Alqaralleh & Ahmad Al-Majali & Abeer Alsarayrh, 2021. "Analyzing the Dynamics Between Macroeconomic Variables and the Stock Indexes of Emerging Markets, Using Non-linear Methods," International Journal of Financial Research, International Journal of Financial Research, Sciedu Press, vol. 12(3), pages 193-204, May.
    2. Guidolin, Massimo & Pedio, Manuela, 2021. "Media Attention vs. Sentiment as Drivers of Conditional Volatility Predictions: An Application to Brexit," Finance Research Letters, Elsevier, vol. 42(C).
    3. Lee, Chien-Chiang & Chen, Mei-Ping, 2021. "The effects of investor attention and policy uncertainties on cross-border country exchange-traded fund returns," International Review of Economics & Finance, Elsevier, vol. 71(C), pages 830-852.
    4. Hartvig, Áron Dénes & Pap, Áron & Pálos, Péter, 2023. "EU Climate Change News Index: Forecasting EU ETS prices with online news," Finance Research Letters, Elsevier, vol. 54(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Papadamou, Stephanos & Fassas, Athanasios & Kenourgios, Dimitris & Dimitriou, Dimitrios, 2020. "Direct and Indirect Effects of COVID-19 Pandemic on Implied Stock Market Volatility: Evidence from Panel Data Analysis," MPRA Paper 100020, University Library of Munich, Germany.
    2. Tihana Škrinjarić, 2019. "Time Varying Spillovers between the Online Search Volume and Stock Returns: Case of CESEE Markets," IJFS, MDPI, vol. 7(4), pages 1-30, October.
    3. Christophe Desagre & Catherine D'Hondt, 2020. "Googlization and retail investors' trading activity," LIDAM Discussion Papers LFIN 2020004, Université catholique de Louvain, Louvain Finance (LFIN).
    4. Desagre, Christophe & D’Hondt, Catherine, 2021. "Googlization and retail trading activity," Journal of Behavioral and Experimental Finance, Elsevier, vol. 29(C).
    5. Basistha, Arabinda & Kurov, Alexander & Wolfe, Marketa Halova, 2019. "Volatility Forecasting: The Role of Internet Search Activity and Implied Volatility," MPRA Paper 111037, University Library of Munich, Germany.
    6. Guidolin, Massimo & Hyde, Stuart & McMillan, David & Ono, Sadayuki, 2009. "Non-linear predictability in stock and bond returns: When and where is it exploitable?," International Journal of Forecasting, Elsevier, vol. 25(2), pages 373-399.
    7. Guidolin, Massimo & Ono, Sadayuki, 2006. "Are the dynamic linkages between the macroeconomy and asset prices time-varying?," Journal of Economics and Business, Elsevier, vol. 58(5-6), pages 480-518.
    8. Tantaopas, Parkpoom & Padungsaksawasdi, Chaiyuth & Treepongkaruna, Sirimon, 2016. "Attention effect via internet search intensity in Asia-Pacific stock markets," Pacific-Basin Finance Journal, Elsevier, vol. 38(C), pages 107-124.
    9. Imene Ben El Hadj Said & Skander Slim, 2022. "The Dynamic Relationship between Investor Attention and Stock Market Volatility: International Evidence," JRFM, MDPI, vol. 15(2), pages 1-25, February.
    10. Chronopoulos, Dimitris K. & Papadimitriou, Fotios I. & Vlastakis, Nikolaos, 2018. "Information demand and stock return predictability," Journal of International Money and Finance, Elsevier, vol. 80(C), pages 59-74.
    11. Aharon, David Y. & Qadan, Mahmoud, 2018. "What drives the demand for information in the commodity market?," Resources Policy, Elsevier, vol. 59(C), pages 532-543.
    12. Kim, Neri & Lučivjanská, Katarína & Molnár, Peter & Villa, Roviel, 2019. "Google searches and stock market activity: Evidence from Norway," Finance Research Letters, Elsevier, vol. 28(C), pages 208-220.
    13. Qadan, Mahmoud & Zoua’bi, Maher, 2019. "Financial attention and the demand for information," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 82(C).
    14. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.
    15. Cooper, Michael J. & Gubellini, Stefano, 2011. "The critical role of conditioning information in determining if value is really riskier than growth," Journal of Empirical Finance, Elsevier, vol. 18(2), pages 289-305, March.
    16. Massimiliano Caporin & Francesco Poli, 2017. "Building News Measures from Textual Data and an Application to Volatility Forecasting," Econometrics, MDPI, vol. 5(3), pages 1-46, August.
    17. Coble, David & Pincheira, Pablo, 2017. "Nowcasting Building Permits with Google Trends," MPRA Paper 76514, University Library of Munich, Germany.
    18. Ballinari, Daniele & Audrino, Francesco & Sigrist, Fabio, 2022. "When does attention matter? The effect of investor attention on stock market volatility around news releases," International Review of Financial Analysis, Elsevier, vol. 82(C).
    19. Fantazzini, Dean & Shangina, Tamara, 2019. "The importance of being informed: forecasting market risk measures for the Russian RTS index future using online data and implied volatility over two decades," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 55, pages 5-31.
    20. Bonaparte, Yosef & Bernile, Gennaro, 2023. "A new “Wall Street Darling?” effects of regulation sentiment in cryptocurrency markets," Finance Research Letters, Elsevier, vol. 52(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:quantf:v:18:y:2018:i:1:p:139-169. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/RQUF20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.