IDEAS home Printed from https://ideas.repec.org/a/eee/tefoso/v167y2021ics0040162521001578.html
   My bibliography  Save this article

Gamification to avoid cognitive biases: An experiment of gamifying a forecasting course

Author

Listed:
  • Legaki, Nikoletta-Zampeta
  • Karpouzis, Kostas
  • Assimakopoulos, Vassilios
  • Hamari, Juho

Abstract

In their daily lives, people are confronted with situations where they need to form a schema of possible future scenarios and the likelihood of them occurring, be it about climate change, economic up- or downturn, or even the potential success of a romantic date. Be these issues of mundane or universal importance, this judgmental forecasting poses people with a difficult pervasive cognitive challenge. Commonly, judgmental forecasting is taught in forecasting courses syllabi, and the pedagogy surrounding it is challenging. However, gamification and game-based learning have risen as promising tools to simulate different kinds of scenarios and stimulate cognitive problem solving. This study investigates the effects of a gamified application with points, levels, challenges, storytelling and leaderboard for teaching judgmental forecasting by conducting a 2×2 between-subjects experiment (treatments: i) read: yes vs no, and ii) gamification: yes vs no), with a sample of 285 students of a School of Electrical and Computer Engineering and a Business Administration Department. The findings indicate that the gamified application improved learning outcomes regarding the heuristics and biases that affect judgmental forecasting by almost 15%, supporting the use of gamification in forecasting education.

Suggested Citation

  • Legaki, Nikoletta-Zampeta & Karpouzis, Kostas & Assimakopoulos, Vassilios & Hamari, Juho, 2021. "Gamification to avoid cognitive biases: An experiment of gamifying a forecasting course," Technological Forecasting and Social Change, Elsevier, vol. 167(C).
  • Handle: RePEc:eee:tefoso:v:167:y:2021:i:c:s0040162521001578
    DOI: 10.1016/j.techfore.2021.120725
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0040162521001578
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.techfore.2021.120725?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Eroglu, Cuneyt & Croxton, Keely L., 2010. "Biases in judgmental adjustments of statistical forecasts: The role of individual differences," International Journal of Forecasting, Elsevier, vol. 26(1), pages 116-133, January.
    2. Bolger, Fergus & Wright, George, 2017. "Use of expert knowledge to anticipate the future: Issues, analysis and directions," International Journal of Forecasting, Elsevier, vol. 33(1), pages 230-243.
    3. Leitner, Johannes & Leopold-Wildburger, Ulrike, 2011. "Experiments on forecasting behavior with several sources of information - A review of the literature," European Journal of Operational Research, Elsevier, vol. 213(3), pages 459-469, September.
    4. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2018. "The M4 Competition: Results, findings, conclusion and way forward," International Journal of Forecasting, Elsevier, vol. 34(4), pages 802-808.
    5. Richard N. Landers & Elena M. Auer & Andrew B. Collmus & Michael B. Armstrong, 2018. "Gamification Science, Its History and Future: Definitions and a Research Agenda," Simulation & Gaming, , vol. 49(3), pages 315-337, June.
    6. Saurabh Bhargava & George Loewenstein, 2015. "Behavioral Economics and Public Policy 102: Beyond Nudging," American Economic Review, American Economic Association, vol. 105(5), pages 396-401, May.
    7. Te Bao & Cars Hommes & Tomasz Makarewicz, 2017. "Bubble Formation and (In)Efficient Markets in Learning‐to‐forecast and optimise Experiments," Economic Journal, Royal Economic Society, vol. 127(605), pages 581-609, October.
    8. Poncin, Ingrid & Garnier, Marion & Ben Mimoun, Mohammed Slim & Leclercq, Thomas, 2017. "Smart technologies and shopping experience: Are gamification interfaces effective? The case of the Smartstore," Technological Forecasting and Social Change, Elsevier, vol. 124(C), pages 320-331.
    9. Makridakis, Spyros, 1996. "Reply to comments on "Forecasting: its role and value for planning and strategy"," International Journal of Forecasting, Elsevier, vol. 12(4), pages 555-557, December.
    10. Heinonen, Sirkka & Minkkinen, Matti & Karjalainen, Joni & Inayatullah, Sohail, 2017. "Testing transformative energy scenarios through causal layered analysis gaming," Technological Forecasting and Social Change, Elsevier, vol. 124(C), pages 101-113.
    11. Liu, Chuang-Chun, 2016. "Understanding player behavior in online games: The role of gender," Technological Forecasting and Social Change, Elsevier, vol. 111(C), pages 265-274.
    12. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
    13. Rowe, Gene & Wright, George, 1999. "The Delphi technique as a forecasting tool: issues and analysis," International Journal of Forecasting, Elsevier, vol. 15(4), pages 353-375, October.
    14. Te Bao & Cars Hommes & Tomasz Makarewicz, 2017. "Bubble Formation and (In)Efficient Markets in Learning‐to‐forecast and optimise Experiments," Economic Journal, Royal Economic Society, vol. 127(605), pages 581-609, October.
    15. M. David Albritton & Patrick R. McMullen & Lorraine R. Gardiner, 2003. "OR/MS Content and Visibility in AACSB-Accredited US Business Programs," Interfaces, INFORMS, vol. 33(5), pages 83-89, October.
    16. Kai Huotari & Juho Hamari, 2017. "A definition for gamification: anchoring gamification in the service marketing literature," Electronic Markets, Springer;IIM University of St. Gallen, vol. 27(1), pages 21-31, February.
    17. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    18. Bradfield, Ron & Cairns, George & Wright, George, 2015. "Teaching scenario analysis—An action learning pedagogy," Technological Forecasting and Social Change, Elsevier, vol. 100(C), pages 44-52.
    19. Duccio Martelli, 2013. "Learning from experience or learning for convenience?," Qualitative Research in Financial Markets, Emerald Group Publishing, vol. 5(3), pages 244-255, November.
    20. Mendez-Carbajo, Diego, 2019. "Experiential learning in macroeconomics through FREDcast," International Review of Economics Education, Elsevier, vol. 30(C), pages 1-1.
    21. Han, Weiwei & Wang, Xun & Petropoulos, Fotios & Wang, Jing, 2019. "Brain imaging and forecasting: Insights from judgmental model selection," Omega, Elsevier, vol. 87(C), pages 1-9.
    22. Leslie Gardner, 2008. "Using a Spreadsheet for Active Learning Projects in Operations Management," INFORMS Transactions on Education, INFORMS, vol. 8(2), pages 75-88, January.
    23. Makridakis, Spyros, 1996. "Forecasting: its role and value for planning and strategy," International Journal of Forecasting, Elsevier, vol. 12(4), pages 513-537, December.
    24. Cox, James Jr. & Loomis, David G., 2006. "Improving forecasting through textbooks -- A 25 year review," International Journal of Forecasting, Elsevier, vol. 22(3), pages 617-624.
    25. Hofacker, Charles F. & de Ruyter, Ko & Lurie, Nicholas H. & Manchanda, Puneet & Donaldson, Jeff, 2016. "Gamification and Mobile Marketing Effectiveness," Journal of Interactive Marketing, Elsevier, vol. 34(C), pages 25-36.
    26. David G. Loomis & James E. Cox, 2000. "A Course in Economic Forecasting: Rationale and Content," The Journal of Economic Education, Taylor & Francis Journals, vol. 31(4), pages 349-357, December.
    27. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2020. "The M4 Competition: 100,000 time series and 61 forecasting methods," International Journal of Forecasting, Elsevier, vol. 36(1), pages 54-74.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Makridakis, Spyros & Hyndman, Rob J. & Petropoulos, Fotios, 2020. "Forecasting in social settings: The state of the art," International Journal of Forecasting, Elsevier, vol. 36(1), pages 15-28.
    2. Perera, H. Niles & Hurley, Jason & Fahimnia, Behnam & Reisi, Mohsen, 2019. "The human factor in supply chain forecasting: A systematic review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 574-600.
    3. Leclercq, Thomas & Poncin, Ingrid & Hammedi, Wafa, 2020. "Opening the black box of gameful experience: Implications for gamification process design," Journal of Retailing and Consumer Services, Elsevier, vol. 52(C).
    4. Petropoulos, Fotios & Fildes, Robert & Goodwin, Paul, 2016. "Do ‘big losses’ in judgmental adjustments to statistical forecasts affect experts’ behaviour?," European Journal of Operational Research, Elsevier, vol. 249(3), pages 842-852.
    5. Arvan, Meysam & Fahimnia, Behnam & Reisi, Mohsen & Siemsen, Enno, 2019. "Integrating human judgement into quantitative forecasting methods: A review," Omega, Elsevier, vol. 86(C), pages 237-252.
    6. Semenoglou, Artemios-Anargyros & Spiliotis, Evangelos & Makridakis, Spyros & Assimakopoulos, Vassilios, 2021. "Investigating the accuracy of cross-learning time series forecasting methods," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1072-1084.
    7. Hsieh, Sara H. & Lee, Crystal T. & Tseng, Timmy H., 2021. "Branded app atmospherics: Examining the effect of pleasure–arousal–dominance in brand relationship building," Journal of Retailing and Consumer Services, Elsevier, vol. 60(C).
    8. Högberg, Johan & Shams, Poja & Wästlund, Erik, 2019. "Gamified in-store mobile marketing: The mixed effect of gamified point-of-purchase advertising," Journal of Retailing and Consumer Services, Elsevier, vol. 50(C), pages 298-304.
    9. Baecke, Philippe & De Baets, Shari & Vanderheyden, Karlien, 2017. "Investigating the added value of integrating human judgement into statistical demand forecasting systems," International Journal of Production Economics, Elsevier, vol. 191(C), pages 85-96.
    10. Fischer, Ilan & Sullivan, Oriel, 2007. "Evolutionary modeling of time-use vectors," Journal of Economic Behavior & Organization, Elsevier, vol. 62(1), pages 120-143, January.
    11. Fatemeh Mokhtarzadeh & Luba Petersen, 2021. "Coordinating expectations through central bank projections," Experimental Economics, Springer;Economic Science Association, vol. 24(3), pages 883-918, September.
    12. Hewamalage, Hansika & Bergmeir, Christoph & Bandara, Kasun, 2021. "Recurrent Neural Networks for Time Series Forecasting: Current status and future directions," International Journal of Forecasting, Elsevier, vol. 37(1), pages 388-427.
    13. Fildes, Robert & Goodwin, Paul & Onkal, Dilek, 2015. "Information use in supply chain forecasting," MPRA Paper 66034, University Library of Munich, Germany.
    14. Cars Hommes & Anita Kopányi-Peuker & Joep Sonnemans, 2021. "Bubbles, crashes and information contagion in large-group asset market experiments," Experimental Economics, Springer;Economic Science Association, vol. 24(2), pages 414-433, June.
    15. Syntetos, Aris A. & Kholidasari, Inna & Naim, Mohamed M., 2016. "The effects of integrating management judgement into OUT levels: In or out of context?," European Journal of Operational Research, Elsevier, vol. 249(3), pages 853-863.
    16. Bojer, Casper Solheim & Meldgaard, Jens Peder, 2021. "Kaggle forecasting competitions: An overlooked learning opportunity," International Journal of Forecasting, Elsevier, vol. 37(2), pages 587-603.
    17. Huber, Jakob & Stuckenschmidt, Heiner, 2020. "Daily retail demand forecasting using machine learning with emphasis on calendric special days," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1420-1438.
    18. Fildes, Robert & Bretschneider, Stuart & Collopy, Fred & Lawrence, Michael & Stewart, Doug & Winklhofer, Heidi & Mentzer, John T. & Moon, Mark A., 2003. "Researching Sales Forecasting Practice: Commentaries and authors' response on "Conducting a Sales Forecasting Audit" by M.A. Moon, J.T. Mentzer & C.D. Smith," International Journal of Forecasting, Elsevier, vol. 19(1), pages 27-42.
    19. Syrjälä, Henna & Kauppinen-Räisänen, Hannele & Luomala, Harri T. & Joelsson, Tapani N. & Könnölä, Kaisa & Mäkilä, Tuomas, 2020. "Gamified package: Consumer insights into multidimensional brand engagement," Journal of Business Research, Elsevier, vol. 119(C), pages 423-434.
    20. Van Belle, Jente & Guns, Tias & Verbeke, Wouter, 2021. "Using shared sell-through data to forecast wholesaler demand in multi-echelon supply chains," European Journal of Operational Research, Elsevier, vol. 288(2), pages 466-479.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:tefoso:v:167:y:2021:i:c:s0040162521001578. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www.sciencedirect.com/science/journal/00401625 .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.sciencedirect.com/science/journal/00401625 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.