IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v249y2016i3p931-944.html
   My bibliography  Save this article

An experimental investigation into the role of simulation models in generating insights

Author

Listed:
  • Gogi, Anastasia
  • Tako, Antuela A.
  • Robinson, Stewart

Abstract

It is often claimed that discrete-event simulation (DES) models are useful for generating insights. There is, however, almost no empirical evidence to support this claim. To address this issue we perform an experimental study which investigates the role of DES, specifically the simulation animation and statistical results, in generating insight (an ‘Aha!’ moment). Undergraduate students were placed in three separate groups and given a task to solve using a model with only animation, a model with only statistical results, or using no model at all. The task was based around the UK's NHS111 telephone service for non-emergency health care. Performance was measured based on whether participants solved the task with insight, the time taken to achieve insight and the participants’ problem-solving patterns. The results show that there is some association between insight generation and the use of a simulation model, particularly the use of the statistical results generated from the model. While there is no evidence that insights were generated more frequently from statistical results than the use of animation, the participants using the statistical results generated insights more rapidly.

Suggested Citation

  • Gogi, Anastasia & Tako, Antuela A. & Robinson, Stewart, 2016. "An experimental investigation into the role of simulation models in generating insights," European Journal of Operational Research, Elsevier, vol. 249(3), pages 931-944.
  • Handle: RePEc:eee:ejores:v:249:y:2016:i:3:p:931-944
    DOI: 10.1016/j.ejor.2015.09.042
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S037722171500884X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2015.09.042?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Langley, Paul A. & Morecroft, John D. W., 2004. "Performance and learning in a simulation of oil industry dynamics," European Journal of Operational Research, Elsevier, vol. 155(3), pages 715-732, June.
    2. Sirkka L. Jarvenpaa, 1989. "The Effect of Task Demands and Graphical Format on Information Processing Strategies," Management Science, INFORMS, vol. 35(3), pages 285-303, March.
    3. Bakken, Bent & Gould, Janet & Kim, Daniel, 1992. "Experimentation in learning organizations: A management flight simulator approach," European Journal of Operational Research, Elsevier, vol. 59(1), pages 167-182, May.
    4. M Pidd, 2010. "Why modelling and model use matter," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 61(1), pages 14-24, January.
    5. Griffiths, J.D. & Williams, J.E. & Wood, R.M., 2013. "Modelling activities at a neurological rehabilitation unit," European Journal of Operational Research, Elsevier, vol. 226(2), pages 301-312.
    6. O'Keefe, Robert M. & Pitt, Ivan L., 1991. "Interaction with a visual interactive simulation, and the effect of cognitive style," European Journal of Operational Research, Elsevier, vol. 54(3), pages 339-348, October.
    7. Abeler, Johannes & Nosenzo, Daniele, 2013. "Self-Selection into Economics Experiments Is Driven by Monetary Rewards," IZA Discussion Papers 7374, Institute of Labor Economics (IZA).
    8. Cronin, Matthew A. & Gonzalez, Cleotilde & Sterman, John D., 2009. "Why don't well-educated adults understand accumulation? A challenge to researchers, educators, and citizens," Organizational Behavior and Human Decision Processes, Elsevier, vol. 108(1), pages 116-130, January.
    9. Hämäläinen, Raimo P. & Luoma, Jukka & Saarinen, Esa, 2013. "On the importance of behavioral operational research: The case of understanding and communicating about dynamic systems," European Journal of Operational Research, Elsevier, vol. 228(3), pages 623-634.
    10. S Robinson, 2001. "Soft with a hard centre: discrete-event simulation in facilitation," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 52(8), pages 905-915, August.
    11. Bonner, Sarah E. & Sprinkle, Geoffrey B., 2002. "The effects of monetary incentives on effort and task performance: theories, evidence, and a framework for research," Accounting, Organizations and Society, Elsevier, vol. 27(4-5), pages 303-345.
    12. Parker, Drew C., 1991. "Visual interactive financial models: An overview of microcomputer software offerings and discussion of potential decision support," European Journal of Operational Research, Elsevier, vol. 54(3), pages 330-338, October.
    13. S J E Taylor & T Eldabi & G Riley & R J Paul & M Pidd, 2009. "Simulation modelling is 50! Do we need a reality check?," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 60(1), pages 69-82, May.
    14. Richard Richels, 1981. "Building Good Models is Not Enough," Interfaces, INFORMS, vol. 11(4), pages 48-54, August.
    15. J B Jun & S H Jacobson & J R Swisher, 1999. "Application of discrete-event simulation in health care clinics: A survey," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 50(2), pages 109-123, February.
    16. N C Proudlove & S Black & A Fletcher, 2007. "OR and the challenge to improve the NHS: modelling for insight and improvement in in-patient flows," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(2), pages 145-158, February.
    17. Peter C. Bell & Robert M. O'Keefe, 1995. "An Experimental Investigation into the Efficacy of Visual Interactive Simulation," Management Science, INFORMS, vol. 41(6), pages 1018-1038, June.
    18. Etiënne A. J. A. Rouwette & Jac A. M. Vennix & Albert J. A. Felling, 2009. "On Evaluating the Performance of Problem Structuring Methods: An Attempt at Formulating a Conceptual Model," Group Decision and Negotiation, Springer, vol. 18(6), pages 567-587, November.
    19. S Robinson, 2005. "Discrete-event simulation: from the pioneers to the present, what next?," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 56(6), pages 619-629, June.
    20. S Robinson, 2008. "Conceptual modelling for simulation Part I: definition and requirements," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(3), pages 278-290, March.
    21. A Fletcher & D Halsall & S Huxham & D Worthington, 2007. "The DH Accident and Emergency Department model: a national generic model used locally," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(12), pages 1554-1562, December.
    22. John D. Sterman, 1989. "Modeling Managerial Behavior: Misperceptions of Feedback in a Dynamic Decision Making Experiment," Management Science, INFORMS, vol. 35(3), pages 321-339, March.
    23. Hurrion, R. D., 1986. "Visual interactive modelling," European Journal of Operational Research, Elsevier, vol. 23(3), pages 281-287, March.
    24. B Lehaney & S A Clarke & R J Paul, 1999. "A case of an intervention in an outpatients department," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 50(9), pages 877-891, September.
    25. Crookes, J. G., 1982. "Simulation in 1981," European Journal of Operational Research, Elsevier, vol. 9(1), pages 1-7, January.
    26. Jay W. Forrester, 1968. "Industrial Dynamics--After the First Decade," Management Science, INFORMS, vol. 14(7), pages 398-415, March.
    27. Sterman, John D., 1989. "Misperceptions of feedback in dynamic decision making," Organizational Behavior and Human Decision Processes, Elsevier, vol. 43(3), pages 301-335, June.
    28. Monks, Thomas & Robinson, Stewart & Kotiadis, Kathy, 2014. "Learning from discrete-event simulation: Exploring the high involvement hypothesis," European Journal of Operational Research, Elsevier, vol. 235(1), pages 195-205.
    29. M den Hengst & G-J de Vreede & R Maghnouji, 2007. "Using soft OR principles for collaborative simulation: a case study in the Dutch airline industry," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(5), pages 669-682, May.
    30. Sterman, John., 1994. "Learning in and about complex systems," Working papers 3660-94., Massachusetts Institute of Technology (MIT), Sloan School of Management.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Taylor, Simon J.E., 2019. "Distributed simulation: state-of-the-art and potential for operational research," European Journal of Operational Research, Elsevier, vol. 273(1), pages 1-19.
    2. Elsawah, Sondoss & McLucas, Alan & Mazanov, Jason, 2017. "An empirical investigation into the learning effects of management flight simulators: A mental models approach," European Journal of Operational Research, Elsevier, vol. 259(1), pages 262-272.
    3. Franco, L. Alberto & Hämäläinen, Raimo P. & Rouwette, Etiënne A.J.A. & Leppänen, Ilkka, 2021. "Taking stock of behavioural OR: A review of behavioural studies with an intervention focus," European Journal of Operational Research, Elsevier, vol. 293(2), pages 401-418.
    4. Harper, Alison & Mustafee, Navonil & Yearworth, Mike, 2021. "Facets of trust in simulation studies," European Journal of Operational Research, Elsevier, vol. 289(1), pages 197-213.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Franco, L. Alberto & Hämäläinen, Raimo P. & Rouwette, Etiënne A.J.A. & Leppänen, Ilkka, 2021. "Taking stock of behavioural OR: A review of behavioural studies with an intervention focus," European Journal of Operational Research, Elsevier, vol. 293(2), pages 401-418.
    2. Harper, Alison & Mustafee, Navonil & Yearworth, Mike, 2021. "Facets of trust in simulation studies," European Journal of Operational Research, Elsevier, vol. 289(1), pages 197-213.
    3. O'Keefe, Robert M., 2016. "Experimental behavioural research in operational research: What we know and what we might come to know," European Journal of Operational Research, Elsevier, vol. 249(3), pages 899-907.
    4. Lane, David C. & Rouwette, Etiënne A.J.A., 2023. "Towards a behavioural system dynamics: Exploring its scope and delineating its promise," European Journal of Operational Research, Elsevier, vol. 306(2), pages 777-794.
    5. Monks, Thomas & Robinson, Stewart & Kotiadis, Kathy, 2014. "Learning from discrete-event simulation: Exploring the high involvement hypothesis," European Journal of Operational Research, Elsevier, vol. 235(1), pages 195-205.
    6. Robinson, Stewart & Kotiadis, Kathy, 2016. "Can involving clients in simulation studies help them solve their future problems? A transfer of learning experimentAuthor-Name: Monks, Thomas," European Journal of Operational Research, Elsevier, vol. 249(3), pages 919-930.
    7. Strohhecker, Jürgen & Leyer, Michael, 2019. "How stock-flow failure and general cognitive ability impact performance in operational dynamic control tasks," European Journal of Operational Research, Elsevier, vol. 276(3), pages 1044-1055.
    8. Leopold-Wildburger, Ulrike & Strohhecker, Jürgen, 2017. "Strategy map concepts in a balanced scorecard cockpit improve performanceAuthor-Name: Hu, Bo," European Journal of Operational Research, Elsevier, vol. 258(2), pages 664-676.
    9. Hazhir Rahmandad & Nelson Repenning, 2016. "Capability erosion dynamics," Strategic Management Journal, Wiley Blackwell, vol. 37(4), pages 649-672, April.
    10. Federico Cosenz & Guido Noto, 2016. "Applying System Dynamics Modelling to Strategic Management: A Literature Review," Systems Research and Behavioral Science, Wiley Blackwell, vol. 33(6), pages 703-741, November.
    11. Pasaoglu, Güzay, 2011. "Using the decentralized and liberalized electricity market microworld (LEMM) as an educational tool," Energy Policy, Elsevier, vol. 39(1), pages 187-199, January.
    12. Hendrik Stouten & Andreas Größler, 2017. "Task Complexity in Individual Stock Control Tasks for Laboratory Experiments on Human Understanding of Dynamic Systems," Systems Research and Behavioral Science, Wiley Blackwell, vol. 34(1), pages 62-77, January.
    13. John Sterman, 2018. "System dynamics at sixty: the path forward," System Dynamics Review, System Dynamics Society, vol. 34(1-2), pages 5-47, January.
    14. John Sterman, 2011. "Communicating climate change risks in a skeptical world," Climatic Change, Springer, vol. 108(4), pages 811-826, October.
    15. Florian Kapmeier, 2020. "Reflections on developing a simulation model on sustainable and healthy diets for decision makers: Comment on the paper by Kopainsky," Systems Research and Behavioral Science, Wiley Blackwell, vol. 37(6), pages 928-935, November.
    16. David C. Lane & Birgit Kopainsky & David C. Lane, 2017. "‘Behavioural System Dynamics’: A Very Tentative and Slightly Sceptical Map of the Territory," Systems Research and Behavioral Science, Wiley Blackwell, vol. 34(4), pages 414-423, July.
    17. Robinson, Stewart & Radnor, Zoe J. & Burgess, Nicola & Worthington, Claire, 2012. "SimLean: Utilising simulation in the implementation of lean in healthcare," European Journal of Operational Research, Elsevier, vol. 219(1), pages 188-197.
    18. Robinson, Stewart & Worthington, Claire & Burgess, Nicola & Radnor, Zoe J., 2014. "Facilitated modelling with discrete-event simulation: Reality or myth?," European Journal of Operational Research, Elsevier, vol. 234(1), pages 231-240.
    19. Tako, Antuela A. & Kotiadis, Kathy, 2015. "PartiSim: A multi-methodology framework to support facilitated simulation modelling in healthcare," European Journal of Operational Research, Elsevier, vol. 244(2), pages 555-564.
    20. Sweeney, Linda Booth, 1963- & Sterman, John., 2003. "Bathtub dynamics : initial results of a systems thinking inventory," Working papers WP 4132-00., Massachusetts Institute of Technology (MIT), Sloan School of Management.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:249:y:2016:i:3:p:931-944. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.