IDEAS home Printed from https://ideas.repec.org/p/dpr/wpaper/1156.html
   My bibliography  Save this paper

Financial Forecasting in the Lab and the Field: Qualified Professionals vs. Smart Students

Author

Listed:
  • Te Bao
  • Brice Corgnet
  • Nobuyuki Hanaki
  • Katsuhiko Okada
  • Yohanes E. Riyanto
  • Jiahua Zhu

Abstract

We compare the performance of financial professionals (CFAs) with university students in four financial forecasting tasks ranging from simple lab prediction tasks to longitudinal field tasks. Although students and professionals performed similarly in the artificial forecasting tasks, their performance differed in the more realistic tasks. Yet, increasing the ‘representativeness of the situation’ in the lab tasks did not systematically benefit financial professionals as students outperformed CFAs when forecasting historical series. However, professionals outperformed students in the field task. Our results imply that the expertise of financial professionals might have been underestimated in previous works that focused on lab tasks.

Suggested Citation

  • Te Bao & Brice Corgnet & Nobuyuki Hanaki & Katsuhiko Okada & Yohanes E. Riyanto & Jiahua Zhu, 2022. "Financial Forecasting in the Lab and the Field: Qualified Professionals vs. Smart Students," ISER Discussion Paper 1156, Institute of Social and Economic Research, Osaka University.
  • Handle: RePEc:dpr:wpaper:1156
    as

    Download full text from publisher

    File URL: https://www.iser.osaka-u.ac.jp/library/dp/2022/DP1156.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Gervais, Simon & Odean, Terrance, 2001. "Learning to be Overconfident," The Review of Financial Studies, Society for Financial Studies, vol. 14(1), pages 1-27.
    2. Lindner, Florian & Kirchler, Michael & Rosenkranz, Stephanie & Weitzel, Utz, 2021. "Social Motives and Risk-Taking in Investment Decisions," Journal of Economic Dynamics and Control, Elsevier, vol. 127(C).
    3. Daniel Fernandes & John G. Lynch & Richard G. Netemeyer, 2014. "Financial Literacy, Financial Education, and Downstream Financial Behaviors," Management Science, INFORMS, vol. 60(8), pages 1861-1883, August.
    4. Brice Corgnet & Cary Deck & Mark DeSantis & David Porter, 2022. "Forecasting Skills in Experimental Markets: Illusion or Reality?," Management Science, INFORMS, vol. 68(7), pages 5216-5232, July.
    5. John Beshears & James J. Choi & Andreas Fuster & David Laibson & Brigitte C. Madrian, 2013. "What Goes Up Must Come Down? Experimental Evidence on Intuitive Forecasting," American Economic Review, American Economic Association, vol. 103(3), pages 570-574, May.
    6. Marco Cipriani & Antonio Guarino, 2005. "Herd Behavior in a Laboratory Financial Market," American Economic Review, American Economic Association, vol. 95(5), pages 1427-1443, December.
    7. Markus Glaser & Thomas Langer & Martin Weber, 2007. "On the Trend Recognition and Forecasting Ability of Professional Traders," Decision Analysis, INFORMS, vol. 4(4), pages 176-193, December.
    8. John List, 2021. "The Voltage Effect in Behavioral Economics," Artefactual Field Experiments 00733, The Field Experiments Website.
    9. Marco Cipriani & Antonio Guarino, 2009. "Herd Behavior in Financial Markets: An Experiment with Financial Market Professionals," Journal of the European Economic Association, MIT Press, vol. 7(1), pages 206-233, March.
    10. Schwaiger, Rene & Kirchler, Michael & Lindner, Florian & Weitzel, Utz, 2020. "Determinants of investor expectations and satisfaction. A study with financial professionals," Journal of Economic Dynamics and Control, Elsevier, vol. 110(C).
    11. Pierdzioch, Christian & Rülke, Jan-Christoph, 2012. "Forecasting stock prices: Do forecasters herd?," Economics Letters, Elsevier, vol. 116(3), pages 326-329.
    12. Kent Daniel & David Hirshleifer & Avanidhar Subrahmanyam, 1998. "Investor Psychology and Security Market Under- and Overreactions," Journal of Finance, American Finance Association, vol. 53(6), pages 1839-1885, December.
    13. List John A., 2007. "Field Experiments: A Bridge between Lab and Naturally Occurring Data," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 5(2), pages 1-47, April.
    14. David S. Lee, 2009. "Training, Wages, and Sample Selection: Estimating Sharp Bounds on Treatment Effects," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(3), pages 1071-1102.
    15. Cars Hommes, 2021. "Behavioral and Experimental Macroeconomics and Policy Analysis: A Complex Systems Approach," Journal of Economic Literature, American Economic Association, vol. 59(1), pages 149-219, March.
    16. Nagel, Rosemarie, 1995. "Unraveling in Guessing Games: An Experimental Study," American Economic Review, American Economic Association, vol. 85(5), pages 1313-1326, December.
    17. Felix Holzmeister & Jürgen Huber & Michael Kirchler & Florian Lindner & Utz Weitzel & Stefan Zeisberger, 2020. "What Drives Risk Perception? A Global Survey with Financial Professionals and Laypeople," Management Science, INFORMS, vol. 66(9), pages 3977-4002, September.
    18. Oechssler, Jörg & Roider, Andreas & Schmitz, Patrick W., 2009. "Cognitive abilities and behavioral biases," Journal of Economic Behavior & Organization, Elsevier, vol. 72(1), pages 147-152, October.
    19. Brice Corgnet & Mark Desantis & David Porter, 2018. "What Makes a Good Trader? On the Role of Intuition and Reflection on Trader Performance," Journal of Finance, American Finance Association, vol. 73(3), pages 1113-1137, June.
    20. Brown, Bryan W & Maital, Shlomo, 1981. "What Do Economists Know? An Empirical Study of Experts' Expectations," Econometrica, Econometric Society, vol. 49(2), pages 491-504, March.
    21. Locke, Peter R. & Mann, Steven C., 2005. "Professional trader discipline and trade disposition," Journal of Financial Economics, Elsevier, vol. 76(2), pages 401-444, May.
    22. Hanaki, Nobuyuki, 2022. "Risk misperceptions of structured financial products with worst-of payout characteristics revisited," Journal of Behavioral and Experimental Finance, Elsevier, vol. 33(C).
    23. Jonathan E. Alevy & Michael S. Haigh & John A. List, 2007. "Information Cascades: Evidence from a Field Experiment with Financial Market Professionals," Journal of Finance, American Finance Association, vol. 62(1), pages 151-180, February.
    24. Andrew W. Lo & Harry Mamaysky & Jiang Wang, 2000. "Foundations of Technical Analysis: Computational Algorithms, Statistical Inference, and Empirical Implementation," Journal of Finance, American Finance Association, vol. 55(4), pages 1705-1765, August.
    25. Joseph Engelberg & Caroline Sasseville & Jared Williams, 2012. "Market Madness? The Case of Mad Money," Management Science, INFORMS, vol. 58(2), pages 351-364, February.
    26. De Bondt, Werner P. M., 1993. "Betting on trends: Intuitive forecasts of financial risk and return," International Journal of Forecasting, Elsevier, vol. 9(3), pages 355-371, November.
    27. Scharfstein, David S & Stein, Jeremy C, 1990. "Herd Behavior and Investment," American Economic Review, American Economic Association, vol. 80(3), pages 465-479, June.
    28. John A. List, 2004. "Neoclassical Theory Versus Prospect Theory: Evidence from the Marketplace," Econometrica, Econometric Society, vol. 72(2), pages 615-625, March.
    29. David Genesove & Christopher Mayer, 2001. "Loss Aversion and Seller Behavior: Evidence from the Housing Market," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(4), pages 1233-1260.
    30. Markku Kaustia & Eeva Alho & Vesa Puttonen, 2008. "How Much Does Expertise Reduce Behavioral Biases? The Case of Anchoring Effects in Stock Return Estimates," Financial Management, Financial Management Association International, vol. 37(3), pages 391-412, September.
    31. David Laster & Paul Bennett & In Sun Geoum, 1999. "Rational Bias in Macroeconomic Forecasts," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(1), pages 293-318.
    32. John A. List, 2003. "Does Market Experience Eliminate Market Anomalies?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(1), pages 41-71.
    33. Brad M. Barber & Terrance Odean, 2001. "Boys will be Boys: Gender, Overconfidence, and Common Stock Investment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(1), pages 261-292.
    34. Brice Corgnet & Mark Desantis & David Porter, 2018. "What Makes a Good Trader? : On the Role of Reflection and Intuition on Trader Performance," Post-Print hal-02312062, HAL.
    35. Timm O. Sprenger & Andranik Tumasjan & Philipp G. Sandner & Isabell M. Welpe, 2014. "Tweets and Trades: the Information Content of Stock Microblogs," European Financial Management, European Financial Management Association, vol. 20(5), pages 926-957, November.
    36. Shane Frederick, 2005. "Cognitive Reflection and Decision Making," Journal of Economic Perspectives, American Economic Association, vol. 19(4), pages 25-42, Fall.
    37. Markus Glaser & Zwetelina Iliewa & Martin Weber, 2019. "Thinking about Prices versus Thinking about Returns in Financial Markets," Journal of Finance, American Finance Association, vol. 74(6), pages 2997-3039, December.
    38. Razen, Michael & Kirchler, Michael & Weitzel, Utz, 2020. "Domain-specific risk-taking among finance professionals," Journal of Behavioral and Experimental Finance, Elsevier, vol. 27(C).
    39. Lakonishok, Josef, 1980. "Stock Market Return Expectations: Some General Properties," Journal of Finance, American Finance Association, vol. 35(4), pages 921-931, September.
    40. Werner Antweiler & Murray Z. Frank, 2004. "Is All That Talk Just Noise? The Information Content of Internet Stock Message Boards," Journal of Finance, American Finance Association, vol. 59(3), pages 1259-1294, June.
    41. Pearce, Douglas K, 1984. "An Empirical Analysis of Expected Stock Price Movements," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 16(3), pages 317-327, August.
    42. Dokko, Yoon & Edelstein, Robert H, 1989. "How Well Do Economists Forecast Stock Market Prices? A Study of the Livingston Surveys," American Economic Review, American Economic Association, vol. 79(4), pages 865-871, September.
    43. John R. Graham, 1999. "Herding among Investment Newsletters: Theory and Evidence," Journal of Finance, American Finance Association, vol. 54(1), pages 237-268, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bao, Te & Corgnet, Brice & Hanaki, Nobuyuki & Riyanto, Yohanes E. & Zhu, Jiahua, 2023. "Predicting the unpredictable: New experimental evidence on forecasting random walks," Journal of Economic Dynamics and Control, Elsevier, vol. 146(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Schwaiger, Rene & Kirchler, Michael & Lindner, Florian & Weitzel, Utz, 2020. "Determinants of investor expectations and satisfaction. A study with financial professionals," Journal of Economic Dynamics and Control, Elsevier, vol. 110(C).
    2. Bottasso, Anna & Duchêne, Sébastien & Guerci, Eric & Hanaki, Nobuyuki & Noussair, Charles N., 2022. "Higher order risk attitudes of financial experts," Journal of Behavioral and Experimental Finance, Elsevier, vol. 34(C).
    3. Razen, Michael & Kirchler, Michael & Weitzel, Utz, 2020. "Domain-specific risk-taking among finance professionals," Journal of Behavioral and Experimental Finance, Elsevier, vol. 27(C).
    4. Christoph Huber & Christian König-Kersting, 2022. "Experimenting with Financial Professionals," Working Papers 2022-07, Faculty of Economics and Statistics, Universität Innsbruck.
    5. Corgnet, Brice & DeSantis, Mark & Porter, David, 2021. "Information aggregation and the cognitive make-up of market participants," European Economic Review, Elsevier, vol. 133(C).
    6. Lorenzo Esposito & Lorenzo Marrese, 2021. "The impact of cognitive skills on investment decisions. An empirical assessment and policy suggestions," DISCE - Quaderni del Dipartimento di Politica Economica dipe0019, Università Cattolica del Sacro Cuore, Dipartimenti e Istituti di Scienze Economiche (DISCE).
    7. Adam Farago & Martin Holmén & Felix Holzmeister & Michael Kirchler & Michael Razen, 2019. "Cognitive Skills and Economic Preferences in the Fund Industry," Working Papers 2019-16, Faculty of Economics and Statistics, Universität Innsbruck.
    8. Yoichi Tsuchiya, 2021. "Crises, market shocks, and herding behavior in stock price forecasts," Empirical Economics, Springer, vol. 61(2), pages 919-945, August.
    9. Brice Corgnet & Mark DeSantis & David Porter, 2020. "Information Aggregation and the Cognitive Make-up of Traders," Working Papers 20-18, Chapman University, Economic Science Institute.
    10. Itzhak Venezia, 2018. "Lecture Notes in Behavioral Finance," World Scientific Books, World Scientific Publishing Co. Pte. Ltd., number 10751, January.
    11. Marco Angrisani & Marco Cipriani & Antonio Guarino, 2022. "Strategic Sophistication and Trading Profits: An Experiment with Professional Traders," Staff Reports 1044, Federal Reserve Bank of New York.
    12. Menkhoff, Lukas & Schmeling, Maik & Schmidt, Ulrich, 2013. "Overconfidence, experience, and professionalism: An experimental study," Journal of Economic Behavior & Organization, Elsevier, vol. 86(C), pages 92-101.
    13. Jonathan E. Alevy & Michael K. Price, 2017. "Advice in the marketplace: a laboratory study," Experimental Economics, Springer;Economic Science Association, vol. 20(1), pages 156-180, March.
    14. Pierdzioch, Christian & Rülke, Jan-Christoph, 2012. "Forecasting stock prices: Do forecasters herd?," Economics Letters, Elsevier, vol. 116(3), pages 326-329.
    15. Michael Razen & Michael Kirchler & Utz Weitzel, 2019. "Determinants Of Prepaid Systems Of Healthcare Financing - A Worldwide Country-Level Perspective," Working Papers 2019-12, Faculty of Economics and Statistics, Universität Innsbruck.
    16. Jonathan E. Alevy & Michael K. Price, 2012. "Advice and Fictive Learning: The Pricing of Assets in the Laboratory," Working Papers 2012-07, University of Alaska Anchorage, Department of Economics.
    17. Cueva, Carlos & Iturbe-Ormaetxe, Iñigo & Ponti, Giovanni & Tomás, Josefa, 2019. "Boys will still be boys: Gender differences in trading activity are not due to differences in (over)confidence," Journal of Economic Behavior & Organization, Elsevier, vol. 160(C), pages 100-120.
    18. Rangvid, Jesper & Schmeling, Maik & Schrimpf, Andreas, 2013. "What do professional forecasters' stock market expectations tell us about herding, information extraction and beauty contests?," Journal of Empirical Finance, Elsevier, vol. 20(C), pages 109-129.
    19. Pereira Reichhardt, Joaquín & Iqbal, Tabassum, 2014. "Investment Decisions: Are we fully-Rational?," MPRA Paper 57686, University Library of Munich, Germany.
    20. Stefano DellaVigna, 2009. "Psychology and Economics: Evidence from the Field," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 315-372, June.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:dpr:wpaper:1156. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Librarian (email available below). General contact details of provider: https://edirc.repec.org/data/isosujp.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.