IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v249y2016i3p908-918.html
   My bibliography  Save this article

Recent evidence on the effectiveness of group model building

Author

Listed:
  • Scott, Rodney J
  • Cavana, Robert Y
  • Cameron, Donald

Abstract

Group model building (GMB) is a participatory approach to using system dynamics in group decision-making and problem structuring. This paper considers the published quantitative evidence base for GMB since the earlier literature review by Rouwette et al. (2002), to consider the level of understanding on three basic questions: what does it achieve, when should it be applied, and how should it be applied or improved? There have now been at least 45 such studies since 1987, utilising controlled experiments, field experiments, pretest/posttest, and observational research designs. There is evidence of GMB achieving a range of outcomes, particularly with regard to the behaviour of participants and their learning through the process. There is some evidence that GMB is more effective at supporting communication and consensus than traditional facilitation, however GMB has not been compared to other problem structuring methods. GMB has been successfully applied in a range of contexts, but there is little evidence on which to select between different GMB tools, or to understand when certain tools may be more appropriate. There is improving evidence on how GMB works, but this has not yet been translated into changing practice. Overall the evidence base for GMB has continued to improve, supporting its use for improving communication and agreement between participants in group decision processes. This paper argues that future research in group model building would benefit from three main shifts: from single cases to multiple cases; from controlled settings to applied settings; and by augmenting survey results with more objective measures.

Suggested Citation

  • Scott, Rodney J & Cavana, Robert Y & Cameron, Donald, 2016. "Recent evidence on the effectiveness of group model building," European Journal of Operational Research, Elsevier, vol. 249(3), pages 908-918.
  • Handle: RePEc:eee:ejores:v:249:y:2016:i:3:p:908-918
    DOI: 10.1016/j.ejor.2015.06.078
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221715006323
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2015.06.078?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Langley, Paul A. & Morecroft, John D. W., 2004. "Performance and learning in a simulation of oil industry dynamics," European Journal of Operational Research, Elsevier, vol. 155(3), pages 715-732, June.
    2. Franco, L. Alberto & Rouwette, Etienne A.J.A., 2011. "Decision development in facilitated modelling workshops," European Journal of Operational Research, Elsevier, vol. 212(1), pages 164-178, July.
    3. Laura J. Black & David F. Andersen, 2012. "Using Visual Representations as Boundary Objects to Resolve Conflict in Collaborative Model‐Building Approaches," Systems Research and Behavioral Science, Wiley Blackwell, vol. 29(2), pages 194-208, March.
    4. Vennix, Jac A. M. & Andersen, David F. & Richardson, George P. & Rohrbaugh, John, 1992. "Model-building for group decision support: Issues and alternatives in knowledge elicitation," European Journal of Operational Research, Elsevier, vol. 59(1), pages 28-41, May.
    5. D F Andersen & J A M Vennix & G P Richardson & E A J A Rouwette, 2007. "Group model building: problem structuring, policy simulation and decision support," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(5), pages 691-694, May.
    6. Alberto Franco, L., 2013. "Rethinking Soft OR interventions: Models as boundary objects," European Journal of Operational Research, Elsevier, vol. 231(3), pages 720-733.
    7. Allyson M. Beall & Andrew Ford, 2010. "Reports from the Field: Assessing the Art and Science of Participatory Environmental Modeling," International Journal of Information Systems and Social Change (IJISSC), IGI Global, vol. 1(2), pages 72-89, April.
    8. Mingers, John & Rosenhead, Jonathan, 2004. "Problem structuring methods in action," European Journal of Operational Research, Elsevier, vol. 152(3), pages 530-554, February.
    9. Bryant, James W. & Darwin, John A., 2004. "Exploring inter-organisational relationships in the health service: An immersive drama approach," European Journal of Operational Research, Elsevier, vol. 152(3), pages 655-666, February.
    10. Birgit Kopainsky & Agata Sawicka, 2011. "Simulator‐supported descriptions of complex dynamic problems: experimental results on task performance and system understanding," System Dynamics Review, System Dynamics Society, vol. 27(2), pages 142-172, April.
    11. C Eden & F Ackermann, 2006. "Where next for problem structuring methods," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(7), pages 766-768, July.
    12. Andrej Škraba & Miroljub Kljajić & Mirjana Kljajić Borštnar, 2007. "The Role of Information Feedback in the Management Group Decision-Making Process Applying System Dynamics Models," Group Decision and Negotiation, Springer, vol. 16(1), pages 77-95, January.
    13. L A Franco, 2007. "Assessing the impact of problem structuring methods in multi-organizational settings: an empirical investigation," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(6), pages 760-768, June.
    14. E A J A Rouwette, 2011. "Facilitated modelling in strategy development: measuring the impact on communication, consensus and commitment," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(5), pages 879-887, May.
    15. Ragin, Charles C., 2000. "Fuzzy-Set Social Science," University of Chicago Press Economics Books, University of Chicago Press, edition 1, number 9780226702773, September.
    16. Phahlamohlaka, Jackie & Friend, John, 2004. "Community planning for rural education in South Africa," European Journal of Operational Research, Elsevier, vol. 152(3), pages 684-695, February.
    17. Lane, David C. & Oliva, Rogelio, 1998. "The greater whole: Towards a synthesis of system dynamics and soft systems methodology," European Journal of Operational Research, Elsevier, vol. 107(1), pages 214-235, May.
    18. Hämäläinen, Raimo P. & Luoma, Jukka & Saarinen, Esa, 2013. "On the importance of behavioral operational research: The case of understanding and communicating about dynamic systems," European Journal of Operational Research, Elsevier, vol. 228(3), pages 623-634.
    19. Finlay, Paul N., 1998. "On evaluating the performance of GSS: Furthering the debate," European Journal of Operational Research, Elsevier, vol. 107(1), pages 193-201, May.
    20. Etiënne A. J. A. Rouwette & Jac A. M. Vennix & Albert J. A. Felling, 2009. "On Evaluating the Performance of Problem Structuring Methods: An Attempt at Formulating a Conceptual Model," Group Decision and Negotiation, Springer, vol. 18(6), pages 567-587, November.
    21. Joldersma, Cisca & Roelofs, Ellie, 2004. "The impact of soft OR-methods on problem structuring," European Journal of Operational Research, Elsevier, vol. 152(3), pages 696-708, February.
    22. Etienne Rouwette & Ingrid Bastings & Hans Blokker, 2011. "A Comparison of Group Model Building and Strategic Options Development and Analysis," Group Decision and Negotiation, Springer, vol. 20(6), pages 781-803, November.
    23. Mingers, John & Brocklesby, John, 1997. "Multimethodology: Towards a framework for mixing methodologies," Omega, Elsevier, vol. 25(5), pages 489-509, October.
    24. Nuno Videira & Rita Lopes & Paula Antunes & Rui Santos & José Luís Casanova, 2012. "Mapping Maritime Sustainability Issues with Stakeholder Groups," Systems Research and Behavioral Science, Wiley Blackwell, vol. 29(6), pages 596-619, November.
    25. repec:ucp:bkecon:9780226702766 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Maria Tomai & Shyama V. Ramani & George Papachristos, 2024. "How Can We Design Policy Better? Frameworks and Approaches for Sustainability Transitions," Sustainability, MDPI, vol. 16(2), pages 1-22, January.
    2. Hugo Herrera & Nuno Videira & Hubert P.L.M. Korzilius & Kathya Lorena Cordova‐Pozo & Marleen H.F. McCardle‐Keurentjes, 2022. "Reflecting on factors influencing long‐lasting organisational effects of group model‐building interventions," System Dynamics Review, System Dynamics Society, vol. 38(2), pages 190-209, April.
    3. Pluchinotta, Irene & Salvia, Giuseppe & Zimmermann, Nici, 2022. "The importance of eliciting stakeholders’ system boundary perceptions for problem structuring and decision-making," European Journal of Operational Research, Elsevier, vol. 302(1), pages 280-293.
    4. Rich, Karl M. & Rich, Magda & Dizyee, Kanar, 2018. "Participatory systems approaches for urban and peri-urban agriculture planning: The role of system dynamics and spatial group model building," Agricultural Systems, Elsevier, vol. 160(C), pages 110-123.
    5. Nicholas Valcourt & Jeffrey Walters & Amy Javernick‐Will & Karl Linden, 2020. "Assessing the efficacy of group model building workshops in an applied setting through purposive text analysis," System Dynamics Review, System Dynamics Society, vol. 36(2), pages 135-157, April.
    6. Natalia Ciobanu & Ali Kerem Saysel, 2021. "Using social–ecological inventory and group model building for resilience assessment to climate change in a network governance setting: a case study from Ikel watershed in Moldova," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 23(1), pages 1065-1085, January.
    7. Johnson, Michael P. & Midgley, Gerald & Chichirau, George, 2018. "Emerging trends and new frontiers in community operational research," European Journal of Operational Research, Elsevier, vol. 268(3), pages 1178-1191.
    8. Giuseppe Salvia & Irene Pluchinotta & Ioanna Tsoulou & Gemma Moore & Nici Zimmermann, 2022. "Understanding Urban Green Space Usage through Systems Thinking: A Case Study in Thamesmead, London," Sustainability, MDPI, vol. 14(5), pages 1-24, February.
    9. Jacqueline Y. Sánchez-García & Juan E. Núñez-Ríos & Carlos López-Hernández & Alejandro Rodríguez-Magaña, 2023. "Modeling Organizational Resilience in SMEs: A System Dynamics Approach," Global Journal of Flexible Systems Management, Springer;Global Institute of Flexible Systems Management, vol. 24(1), pages 29-50, March.
    10. Lami, Isabella M. & Tavella, Elena, 2019. "On the usefulness of soft OR models in decision making: A comparison of Problem Structuring Methods supported and self-organized workshops," European Journal of Operational Research, Elsevier, vol. 275(3), pages 1020-1036.
    11. Harper, Alison & Mustafee, Navonil & Yearworth, Mike, 2021. "Facets of trust in simulation studies," European Journal of Operational Research, Elsevier, vol. 289(1), pages 197-213.
    12. Marleen McCardle-Keurentjes & Etiënne A. J. A. Rouwette, 2018. "Asking Questions: A Sine Qua Non of Facilitation in Decision Support?," Group Decision and Negotiation, Springer, vol. 27(5), pages 757-788, October.
    13. Cunico, Giovanni & Aivazidou, Eirini & Mollona, Edoardo, 2021. "Building a dynamic theory of citizens’ awareness of European Cohesion Policy interventions," European Journal of Operational Research, Elsevier, vol. 289(2), pages 758-773.
    14. Lane, David & Husemann, Elke & Holland, Darren & Khaled, Abdul, 2019. "Understanding foodborne transmission mechanisms for Norovirus: A study for the UK's Food Standards Agency," European Journal of Operational Research, Elsevier, vol. 275(2), pages 721-736.
    15. Asif, Muhammad & Inam, Azhar & Adamowski, Jan & Shoaib, Muhammad & Tariq, Hisham & Ahmad, Shakil & Alizadeh, Mohammad Reza & Nazeer, Aftab, 2023. "Development of methods for the simplification of complex group built causal loop diagrams: A case study of the Rechna doab," Ecological Modelling, Elsevier, vol. 476(C).
    16. de Gooyert, Vincent & Rouwette, Etiënne & van Kranenburg, Hans & Freeman, Edward & van Breen, Harry, 2022. "Cognitive change and consensus forming in facilitated modelling: A comparison of experienced and observed outcomes," European Journal of Operational Research, Elsevier, vol. 299(2), pages 589-599.
    17. Paulo Gonçalves & Paolo Ferrari & Luca Crivelli & Emiliano Albanese, 2023. "Model‐informed health system reorganization during emergencies," Production and Operations Management, Production and Operations Management Society, vol. 32(5), pages 1323-1344, May.
    18. Kyrah K. Brown & Michael Kenneth Lemke & Saeideh Fallah‐Fini & Ariel Hall & Mercy Obasanya, 2022. "Planning, implementing, and evaluating an online group‐model‐building workshop during the COVID‐19 pandemic: celebrating successes and learning from shortcomings," System Dynamics Review, System Dynamics Society, vol. 38(1), pages 93-112, January.
    19. Marleen H. F. McCardle‐Keurentjes & Etiënne A. J. A. Rouwette & Jac A. M. Vennix & Eric Jacobs, 2018. "Potential benefits of model use in group model building: insights from an experimental investigation," System Dynamics Review, System Dynamics Society, vol. 34(1-2), pages 354-384, January.
    20. Kathya Lorena Cordova-Pozo & Hubert P. L. M. Korzilius & Etiënne A. J. A. Rouwette & Gabriela Píriz & Rolando Herrera-Gutierrez & Graciela Cordova-Pozo & Miguel Orozco, 2021. "Using Systems Dynamics for Capturing the Multicausality of Factors Affecting Health System Capacity in Latin America while Responding to the COVID-19 Pandemic," IJERPH, MDPI, vol. 18(19), pages 1-19, September.
    21. Brooke Wilkerson & Anaely Aguiar & Christina Gkini & Igor Czermainski de Oliveira & Lars‐Kristian Lunde Trellevik & Birgit Kopainsky, 2020. "Reflections on adapting group model building scripts into online workshops," System Dynamics Review, System Dynamics Society, vol. 36(3), pages 358-372, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lami, Isabella M. & Tavella, Elena, 2019. "On the usefulness of soft OR models in decision making: A comparison of Problem Structuring Methods supported and self-organized workshops," European Journal of Operational Research, Elsevier, vol. 275(3), pages 1020-1036.
    2. Midgley, Gerald & Cavana, Robert Y. & Brocklesby, John & Foote, Jeff L. & Wood, David R.R. & Ahuriri-Driscoll, Annabel, 2013. "Towards a new framework for evaluating systemic problem structuring methods," European Journal of Operational Research, Elsevier, vol. 229(1), pages 143-154.
    3. Franco, L. Alberto & Hämäläinen, Raimo P. & Rouwette, Etiënne A.J.A. & Leppänen, Ilkka, 2021. "Taking stock of behavioural OR: A review of behavioural studies with an intervention focus," European Journal of Operational Research, Elsevier, vol. 293(2), pages 401-418.
    4. White, Leroy, 2016. "Behavioural operational research: Towards a framework for understanding behaviour in OR interventions," European Journal of Operational Research, Elsevier, vol. 249(3), pages 827-841.
    5. Rodney J. Scott & Robert Y. Cavana & Donald Cameron, 2016. "Client Perceptions of Reported Outcomes of Group Model Building in the New Zealand Public Sector," Group Decision and Negotiation, Springer, vol. 25(1), pages 77-101, January.
    6. Hugo J. Herrera & Marleen H. F. McCardle-Keurentjes & Nuno Videira, 2016. "Evaluating Facilitated Modelling Processes and Outcomes: An Experiment Comparing a Single and a Multimethod Approach in Group Model Building," Group Decision and Negotiation, Springer, vol. 25(6), pages 1277-1318, November.
    7. Rodney J. Scott & Robert Y. Cavana & Donald Cameron, 2016. "Mechanisms for Understanding Mental Model Change in Group Model Building," Systems Research and Behavioral Science, Wiley Blackwell, vol. 33(1), pages 100-118, January.
    8. Marleen McCardle-Keurentjes & Etiënne A. J. A. Rouwette, 2018. "Asking Questions: A Sine Qua Non of Facilitation in Decision Support?," Group Decision and Negotiation, Springer, vol. 27(5), pages 757-788, October.
    9. E A J A Rouwette, 2011. "Facilitated modelling in strategy development: measuring the impact on communication, consensus and commitment," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(5), pages 879-887, May.
    10. Peter S. Hovmand & David F. Andersen & Etiënne Rouwette & George P. Richardson & Krista Rux & Annaliese Calhoun, 2012. "Group Model‐Building ‘Scripts’ as a Collaborative Planning Tool," Systems Research and Behavioral Science, Wiley Blackwell, vol. 29(2), pages 179-193, March.
    11. Small, Adrian & Wainwright, David, 2018. "Privacy and security of electronic patient records – Tailoring multimethodology to explore the socio-political problems associated with Role Based Access Control systems," European Journal of Operational Research, Elsevier, vol. 265(1), pages 344-360.
    12. Federico Cosenz & Guido Noto, 2016. "Applying System Dynamics Modelling to Strategic Management: A Literature Review," Systems Research and Behavioral Science, Wiley Blackwell, vol. 33(6), pages 703-741, November.
    13. Robinson, Stewart & Kotiadis, Kathy, 2016. "Can involving clients in simulation studies help them solve their future problems? A transfer of learning experimentAuthor-Name: Monks, Thomas," European Journal of Operational Research, Elsevier, vol. 249(3), pages 919-930.
    14. Harper, Alison & Mustafee, Navonil & Yearworth, Mike, 2021. "Facets of trust in simulation studies," European Journal of Operational Research, Elsevier, vol. 289(1), pages 197-213.
    15. Brocklesby, John & Midgley, Gerald, 2016. "Boundary games: How teams of OR practitioners explore the boundaries of interventionAuthor-Name: Velez-Castiblanco, Jorge," European Journal of Operational Research, Elsevier, vol. 249(3), pages 968-982.
    16. David Lowe & Louise Martingale & Mike Yearworth, 2016. "Guiding interventions in a multi-organisational context: combining the Viable System Model and Hierarchical Process Modelling for use as a Problem Structuring Method," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 67(12), pages 1481-1495, December.
    17. Alexandre de A. Gomes Júnior & Vanessa B. Schramm, 2022. "Problem Structuring Methods: A Review of Advances Over the Last Decade," Systemic Practice and Action Research, Springer, vol. 35(1), pages 55-88, February.
    18. Yearworth, Mike & White, Leroy, 2013. "The uses of qualitative data in multimethodology: Developing causal loop diagrams during the coding process," European Journal of Operational Research, Elsevier, vol. 231(1), pages 151-161.
    19. Edoardo Fregonese & Isabella M. Lami & Elena Todella, 2020. "Aesthetic Perspectives in Group Decision and Negotiation Practice," Group Decision and Negotiation, Springer, vol. 29(6), pages 993-1019, December.
    20. Hämäläinen, Raimo P. & Luoma, Jukka & Saarinen, Esa, 2013. "On the importance of behavioral operational research: The case of understanding and communicating about dynamic systems," European Journal of Operational Research, Elsevier, vol. 228(3), pages 623-634.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:249:y:2016:i:3:p:908-918. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.