IDEAS home Printed from https://ideas.repec.org/a/inm/orisre/v27y2016i2p453-465.html
   My bibliography  Save this article

Research Note—Gamification of Technology-Mediated Training: Not All Competitions Are the Same

Author

Listed:
  • Radhika Santhanam

    (Division of Management Information Systems, Price College of Business, University of Oklahoma, Norman, Oklahoma 73019)

  • De Liu

    (Department of Information and Decision Sciences, Carlson School of Management, University of Minnesota, Minneapolis, Minnesota 55455)

  • Wei-Cheng Milton Shen

    (Department of Accounting, College of Business Administration, University of Alabama–Huntsville, Huntsville, Alabama 35899)

Abstract

Gamification, an application of game design elements to non-gaming contexts, is proposed as a way to add engagement in technology-mediated training programs. Yet there is hardly any information on how to adapt game design elements to improve learning outcomes and promote learner engagement. To address this issue, we focus on a popular game design element, competition, and specifically examine the effects of different competitive structures, i.e., whether a person faces a higher-skilled, lower-skilled or equally-skilled competitor, on learning and engagement. We study a gamified training design for databases, where trainees play a trivia-based mini-game with a competitor after each e-training module. Trainees who faced a lower-skilled competitor reported higher self-efficacy beliefs and better learning outcomes, supporting the effect of peer appraisal, a less examined aspect of social cognitive theory. Yet trainees who faced equally-skilled competitors reported higher levels of engagement, supporting the balance principle of flow theory. Our study findings indicate that no one competitive structure can simultaneously address learning and engagement outcomes. The choice of competitive structures depends on the priority of the outcomes in training. Our findings provide one explanation for the mixed findings on the effect of competitive gamification designs in technology mediated training.

Suggested Citation

  • Radhika Santhanam & De Liu & Wei-Cheng Milton Shen, 2016. "Research Note—Gamification of Technology-Mediated Training: Not All Competitions Are the Same," Information Systems Research, INFORMS, vol. 27(2), pages 453-465, June.
  • Handle: RePEc:inm:orisre:v:27:y:2016:i:2:p:453-465
    DOI: 10.1287/isre.2016.0630
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/isre.2016.0630
    Download Restriction: no

    File URL: https://libkey.io/10.1287/isre.2016.0630?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Radhika Santhanam & Sharath Sasidharan & Jane Webster, 2008. "Using Self-Regulatory Learning to Enhance E-Learning-Based Information Technology Training," Information Systems Research, INFORMS, vol. 19(1), pages 26-47, March.
    2. Barbara L. Marcolin & Deborah R. Compeau & Malcolm C. Munro & Sid L. Huff, 2000. "Assessing User Competence: Conceptualization and Measurement," Information Systems Research, INFORMS, vol. 11(1), pages 37-60, March.
    3. Richard D. Johnson & George M. Marakas, 2000. "Research Report: The Role of Behavioral Modeling in Computer Skills Acquisition: Toward Refinement of the Model," Information Systems Research, INFORMS, vol. 11(4), pages 402-417, December.
    4. Kyung Hwan Baik, 2004. "Two-Player Asymmetric Contests with Ratio-Form Contest Success Functions," Economic Inquiry, Western Economic Association International, vol. 42(4), pages 679-689, October.
    5. Mun Y. Yi & Fred D. Davis, 2003. "Developing and Validating an Observational Learning Model of Computer Software Training and Skill Acquisition," Information Systems Research, INFORMS, vol. 14(2), pages 146-169, June.
    6. Radhika Santhanam & Maung K. Sein, 1994. "Improving End-User Proficiency: Effects of Conceptual Training and Nature of Interaction," Information Systems Research, INFORMS, vol. 5(4), pages 378-399, December.
    7. Saurabh Gupta & Robert Bostrom, 2013. "Research Note ---An Investigation of the Appropriation of Technology-Mediated Training Methods Incorporating Enactive and Collaborative Learning," Information Systems Research, INFORMS, vol. 24(2), pages 454-469, June.
    8. Maryam Alavi & Dorothy E. Leidner, 2001. "Research Commentary: Technology-Mediated Learning—A Call for Greater Depth and Breadth of Research," Information Systems Research, INFORMS, vol. 12(1), pages 1-10, March.
    9. Ajay Kalra & Mengze Shi, 2001. "Designing Optimal Sales Contests: A Theoretical Perspective," Marketing Science, INFORMS, vol. 20(2), pages 170-193, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Muhammad Zia Hydari & Idris Adjerid & Aaron D. Striegel, 2023. "Health Wearables, Gamification, and Healthful Activity," Management Science, INFORMS, vol. 69(7), pages 3920-3938, July.
    2. Le Wang & Paul Benjamin Lowry & Xin (Robert) Luo & Han Li, 2023. "Moving Consumers from Free to Fee in Platform-Based Markets: An Empirical Study of Multiplayer Online Battle Arena Games," Information Systems Research, INFORMS, vol. 34(1), pages 275-296, March.
    3. Schöbel, Sofia & Janson, Andreas & Jahn, Katharina & Kordyaka, Bastian & Turetken, Ozgur & Djafarova, Naza & Saqr, Mohammad & Wu, Dezhi & Söllner, Matthias & Adam, Martin & Heiberg Gad, Povl & Wesselo, 2020. "A Research Agenda for the Why, What, and How of Gamification Designs Results on an ECIS 2019 Panel," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 119170, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    4. Koivisto, Jonna & Hamari, Juho, 2019. "The rise of motivational information systems: A review of gamification research," International Journal of Information Management, Elsevier, vol. 45(C), pages 191-210.
    5. Xiaolun Wang & Xinlin Yao, 2020. "Fueling Pro-Environmental Behaviors with Gamification Design: Identifying Key Elements in Ant Forest with the Kano Model," Sustainability, MDPI, vol. 12(6), pages 1-17, March.
    6. Yi-Jen (Ian) Ho & Siyuan Liu & Lei Wang, 2023. "Fun Shopping: A Randomized Field Experiment on Gamification," Information Systems Research, INFORMS, vol. 34(2), pages 766-785, June.
    7. Höllig, Christoph E. & Tumasjan, Andranik & Welpe, Isabell M., 2020. "Individualizing gamified systems: The role of trait competitiveness and leaderboard design," Journal of Business Research, Elsevier, vol. 106(C), pages 288-303.
    8. Ni Huang & Jiayin Zhang & Gordon Burtch & Xitong Li & Peiyu Chen, 2021. "Combating Procrastination on Massive Online Open Courses via Optimal Calls to Action," Information Systems Research, INFORMS, vol. 32(2), pages 301-317, June.
    9. Behnaz Bojd & Xiaolong Song & Yong Tan & Xiangbin Yan, 2022. "Gamified Challenges in Online Weight-Loss Communities," Information Systems Research, INFORMS, vol. 33(2), pages 718-736, June.
    10. Behl, Abhishek & Jayawardena, Nirma & Pereira, Vijay & Islam, Nazrul & Giudice, Manlio Del & Choudrie, Jyoti, 2022. "Gamification and e-learning for young learners: A systematic literature review, bibliometric analysis, and future research agenda," Technological Forecasting and Social Change, Elsevier, vol. 176(C).
    11. Chen, Xiaomeng & Forman, Christopher & Kummer, Michael E., 2021. "Chat more and contribute better: An empirical study of a knowledge-sharing community," ZEW Discussion Papers 21-061, ZEW - Leibniz Centre for European Economic Research.
    12. Alvin Chung Man Leung & Radhika Santhanam & Ron Chi-Wai Kwok & Wei Thoo Yue, 2023. "Could Gamification Designs Enhance Online Learning Through Personalization? Lessons from a Field Experiment," Information Systems Research, INFORMS, vol. 34(1), pages 27-49, March.
    13. Juin-Ming Tsai & Shiu-Wan Hung & Guan-Ting Lin, 2022. "Continued usage of smart wearable devices (SWDs): cross-level analysis of gamification and network externality," Electronic Markets, Springer;IIM University of St. Gallen, vol. 32(3), pages 1661-1676, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Radhika Santhanam & Sharath Sasidharan & Jane Webster, 2008. "Using Self-Regulatory Learning to Enhance E-Learning-Based Information Technology Training," Information Systems Research, INFORMS, vol. 19(1), pages 26-47, March.
    2. Mun Y. Yi & Fred D. Davis, 2003. "Developing and Validating an Observational Learning Model of Computer Software Training and Skill Acquisition," Information Systems Research, INFORMS, vol. 14(2), pages 146-169, June.
    3. Alvin Chung Man Leung & Radhika Santhanam & Ron Chi-Wai Kwok & Wei Thoo Yue, 2023. "Could Gamification Designs Enhance Online Learning Through Personalization? Lessons from a Field Experiment," Information Systems Research, INFORMS, vol. 34(1), pages 27-49, March.
    4. Saurabh Gupta & Robert Bostrom, 2013. "Research Note ---An Investigation of the Appropriation of Technology-Mediated Training Methods Incorporating Enactive and Collaborative Learning," Information Systems Research, INFORMS, vol. 24(2), pages 454-469, June.
    5. Weiling Ke & Lele Kang & Chuan-Hoo Tan & Chih-Hung Peng, 2021. "User Competence with Enterprise Systems: The Effects of Work Environment Factors," Information Systems Research, INFORMS, vol. 32(3), pages 860-875, September.
    6. Prasad, Acklesh & Heales, Jon, 2010. "On IT and business value in developing countries: A complementarities-based approach," International Journal of Accounting Information Systems, Elsevier, vol. 11(4), pages 314-335.
    7. Jyoti Choudrie & Efpraxia Zamani & Chike Obuekwe, 2022. "Bridging the Digital Divide in Ethnic Minority Older Adults: an Organisational Qualitative Study," Information Systems Frontiers, Springer, vol. 24(4), pages 1355-1375, August.
    8. Nagesh N. Murthy & Goutam N. Challagalla & Leslie H. Vincent & Tasadduq A. Shervani, 2008. "The Impact of Simulation Training on Call Center Agent Performance: A Field-Based Investigation," Management Science, INFORMS, vol. 54(2), pages 384-399, February.
    9. Robert Ridlon & Jiwoong Shin, 2013. "Favoring the Winner or Loser in Repeated Contests," Marketing Science, INFORMS, vol. 32(5), pages 768-785, September.
    10. Emmanuel Dechenaux & Dan Kovenock & Roman Sheremeta, 2015. "A survey of experimental research on contests, all-pay auctions and tournaments," Experimental Economics, Springer;Economic Science Association, vol. 18(4), pages 609-669, December.
    11. Proserpio, Luigi & Magni, Massimo, 2012. "Teaching without the teacher? Building a learning environment through computer simulations," International Journal of Information Management, Elsevier, vol. 32(2), pages 99-105.
    12. Pavel Kireyev, 2016. "Markets for Ideas: Prize Structure, Entry Limits, and the Design of Ideation Contests," Harvard Business School Working Papers 16-129, Harvard Business School.
    13. Xuan Yang & Xiao Li & Daning Hu & Harry Jiannan Wang, 2021. "Differential impacts of social influence on initial and sustained participation in open source software projects," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 72(9), pages 1133-1147, September.
    14. Robert Ridlon, 2016. "Does Manufacturer Advertising Crowd‐in or Crowd‐out Retailer Advertising? An Application of an Endogenous Prize Contest with Asymmetric Players," Southern Economic Journal, John Wiley & Sons, vol. 83(2), pages 364-379, October.
    15. Garima Malik & A. Sajeevan Rao, 2019. "Extended expectation-confirmation model to predict continued usage of ODR/ride hailing apps: role of perceived value and self-efficacy," Information Technology & Tourism, Springer, vol. 21(4), pages 461-482, December.
    16. Meents, S. & Verhagen, T. & Vlaar, P.W.L., 2011. "How sellers can stimulate purchasing in electronic marketplaces: Using information as a risk reduction signal," Serie Research Memoranda 0014, VU University Amsterdam, Faculty of Economics, Business Administration and Econometrics.
    17. Christian Terwiesch & Yi Xu, 2008. "Innovation Contests, Open Innovation, and Multiagent Problem Solving," Management Science, INFORMS, vol. 54(9), pages 1529-1543, September.
    18. Ewerhart, Christian, 2016. "An envelope approach to tournament design," Journal of Mathematical Economics, Elsevier, vol. 63(C), pages 1-9.
    19. Kyung Hwan Baik, 2007. "Equilibrium Contingent Compensation in Contests with Delegation," Southern Economic Journal, John Wiley & Sons, vol. 73(4), pages 986-1002, April.
    20. Wang Zhewei, 2010. "The Optimal Accuracy Level in Asymmetric Contests," The B.E. Journal of Theoretical Economics, De Gruyter, vol. 10(1), pages 1-18, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orisre:v:27:y:2016:i:2:p:453-465. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.