IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v299y2022i2p589-599.html
   My bibliography  Save this article

Cognitive change and consensus forming in facilitated modelling: A comparison of experienced and observed outcomes

Author

Listed:
  • de Gooyert, Vincent
  • Rouwette, Etiënne
  • van Kranenburg, Hans
  • Freeman, Edward
  • van Breen, Harry

Abstract

Facilitated modelling is an approach where operational researchers act as facilitators to model an issue collaboratively with stakeholders. The potential benefits of facilitated modelling, including cognitive change and consensus forming, have been extensively described. However, the evidence that these benefits are achieved often remains anecdotical, and mainly relies on self-reported assessments. This is problematic, as self-reported measures can prove unreliable. In this study we adopted a pre-test post-test design to analyse whether the intended outcomes of eight facilitated modelling workshops were achieved. We compared the outcomes as experienced by participants of the workshops with observed outcomes. Our results show that cognitive change and consensus forming were achieved. However, experienced and observed cognitive change were not related. For consensus forming, we did find a modest correlation between experienced and observed outcomes. We discuss implications for facilitated modelling research and practice.

Suggested Citation

  • de Gooyert, Vincent & Rouwette, Etiënne & van Kranenburg, Hans & Freeman, Edward & van Breen, Harry, 2022. "Cognitive change and consensus forming in facilitated modelling: A comparison of experienced and observed outcomes," European Journal of Operational Research, Elsevier, vol. 299(2), pages 589-599.
    • Handle: RePEc:eee:ejores:v:299:y:2022:i:2:p:589-599
    DOI: 10.1016/j.ejor.2021.09.007
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221721007669
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ejor.2021.09.007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mary Tripsas & Giovanni Gavetti, 2000. "Capabilities, cognition, and inertia: evidence from digital imaging," Strategic Management Journal, Wiley Blackwell, vol. 21(10‐11), pages 1147-1161, October.
    2. van Rooijen, Sascha N.M. & van Wees, Mark T., 2006. "Green electricity policies in the Netherlands: an analysis of policy decisions," Energy Policy, Elsevier, vol. 34(1), pages 60-71, January.
    3. Eero Vaara & Richard Whittington, 2012. "Strategy as practice : Taking Social Practices Seriously," Post-Print hal-02276672, HAL.
    4. Junginger, M. & Agterbosch, S. & Faaij, A. & Turkenburg, W., 2004. "Renewable electricity in the Netherlands," Energy Policy, Elsevier, vol. 32(9), pages 1053-1073, June.
    5. Franco, L. Alberto & Rouwette, Etienne A.J.A., 2011. "Decision development in facilitated modelling workshops," European Journal of Operational Research, Elsevier, vol. 212(1), pages 164-178, July.
    6. Franco, L. Alberto & Rouwette, Etiënne A.J.A. & Korzilius, Hubert, 2016. "Different paths to consensus? The impact of need for closure on model-supported group conflict management," European Journal of Operational Research, Elsevier, vol. 249(3), pages 878-889.
    7. White, Leroy, 2016. "Behavioural operational research: Towards a framework for understanding behaviour in OR interventions," European Journal of Operational Research, Elsevier, vol. 249(3), pages 827-841.
    8. Franco, L. Alberto & Greiffenhagen, Christian, 2018. "Making OR practice visible: Using ethnomethodology to analyse facilitated modelling workshops," European Journal of Operational Research, Elsevier, vol. 265(2), pages 673-684.
    9. Sarah Kaplan, 2008. "Framing Contests: Strategy Making Under Uncertainty," Organization Science, INFORMS, vol. 19(5), pages 729-752, October.
    10. Laura J. Black & David F. Andersen, 2012. "Using Visual Representations as Boundary Objects to Resolve Conflict in Collaborative Model‐Building Approaches," Systems Research and Behavioral Science, Wiley Blackwell, vol. 29(2), pages 194-208, March.
    11. Alberto Franco, L., 2013. "Rethinking Soft OR interventions: Models as boundary objects," European Journal of Operational Research, Elsevier, vol. 231(3), pages 720-733.
    12. James P. Walsh, 1995. "Managerial and Organizational Cognition: Notes from a Trip Down Memory Lane," Organization Science, INFORMS, vol. 6(3), pages 280-321, June.
    13. Kellermanns, Franz W. & Walter, Jorge & Floyd, Steven W. & Lechner, Christoph & Shaw, John C., 2011. "To agree or not to agree? A meta-analytical review of strategic consensus and organizational performance," Journal of Business Research, Elsevier, vol. 64(2), pages 126-133, February.
    14. Fran Ackermann & Colin Eden, 2011. "Negotiation in Strategy Making Teams: Group Support Systems and the Process of Cognitive Change," Group Decision and Negotiation, Springer, vol. 20(3), pages 293-314, May.
    15. de Gooyert, Vincent & Rouwette, Etiënne & van Kranenburg, Hans & Freeman, Edward & van Breen, Harry, 2016. "Sustainability transition dynamics: Towards overcoming policy resistance," Technological Forecasting and Social Change, Elsevier, vol. 111(C), pages 135-145.
    16. Annielli A R Cunha & Danielle C Morais, 2016. "Analysing the use of cognitive maps in an experiment on a group decision process," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 67(12), pages 1459-1468, December.
    17. Scott, Rodney J & Cavana, Robert Y & Cameron, Donald, 2016. "Recent evidence on the effectiveness of group model building," European Journal of Operational Research, Elsevier, vol. 249(3), pages 908-918.
    18. René Kemp, 2010. "The Dutch energy transition approach," International Economics and Economic Policy, Springer, vol. 7(2), pages 291-316, August.
    19. Gerard P. Hodgkinson, 1997. "Cognitive Inertia in a Turbulent Market: the Case of UK Residential Estate Agents," Journal of Management Studies, Wiley Blackwell, vol. 34(6), pages 921-945, November.
    20. Franco, L. Alberto & Montibeller, Gilberto, 2010. "Facilitated modelling in operational research," European Journal of Operational Research, Elsevier, vol. 205(3), pages 489-500, September.
    21. E A J A Rouwette, 2011. "Facilitated modelling in strategy development: measuring the impact on communication, consensus and commitment," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(5), pages 879-887, May.
    22. Sucheta Nadkarni & V. K. Narayanan, 2007. "Strategic schemas, strategic flexibility, and firm performance: the moderating role of industry clockspeed," Strategic Management Journal, Wiley Blackwell, vol. 28(3), pages 243-270, March.
    23. Kern, Florian & Smith, Adrian, 2008. "Restructuring energy systems for sustainability? Energy transition policy in the Netherlands," Energy Policy, Elsevier, vol. 36(11), pages 4093-4103, November.
    24. Marleen McCardle-Keurentjes & Etiënne A. J. A. Rouwette, 2018. "Asking Questions: A Sine Qua Non of Facilitation in Decision Support?," Group Decision and Negotiation, Springer, vol. 27(5), pages 757-788, October.
    25. Sarah Kaplan, 2011. "Research in Cognition and Strategy: Reflections on Two Decades of Progress and a Look to the Future," Journal of Management Studies, Wiley Blackwell, vol. 48(3), pages 665-695, May.
    26. Don Knight & Craig L. Pearce & Ken G. Smith & Judy D. Olian & Henry P. Sims & Ken A. Smith & Patrick Flood, 1999. "Top management team diversity, group process, and strategic consensus," Strategic Management Journal, Wiley Blackwell, vol. 20(5), pages 445-465, May.
    27. Elena Tavella & L. Alberto Franco, 2015. "Dynamics of Group Knowledge Production in Facilitated Modelling Workshops: An Exploratory Study," Group Decision and Negotiation, Springer, vol. 24(3), pages 451-475, May.
    28. Eero Vaara & Richard Whittington, 2012. "Strategy as practice : Taking Social Practices Seriously," Post-Print hal-02312709, HAL.
    29. von der Gracht, Heiko A., 2012. "Consensus measurement in Delphi studies," Technological Forecasting and Social Change, Elsevier, vol. 79(8), pages 1525-1536.
    30. Lami, Isabella M. & Tavella, Elena, 2019. "On the usefulness of soft OR models in decision making: A comparison of Problem Structuring Methods supported and self-organized workshops," European Journal of Operational Research, Elsevier, vol. 275(3), pages 1020-1036.
    31. Joldersma, Cisca & Roelofs, Ellie, 2004. "The impact of soft OR-methods on problem structuring," European Journal of Operational Research, Elsevier, vol. 152(3), pages 696-708, February.
    32. Rouwette, Etiënne & van Kranenburg, Hans & Freeman, Edward, 2017. "Reviewing the role of stakeholders in Operational Research: A stakeholder theory perspectiveAuthor-Name: de Gooyert, Vincent," European Journal of Operational Research, Elsevier, vol. 262(2), pages 402-410.
    33. Franco, L. Alberto & Hämäläinen, Raimo P. & Rouwette, Etiënne A.J.A. & Leppänen, Ilkka, 2021. "Taking stock of behavioural OR: A review of behavioural studies with an intervention focus," European Journal of Operational Research, Elsevier, vol. 293(2), pages 401-418.
    34. Henao, Felipe & Franco, L. Alberto, 2016. "Unpacking multimethodology: Impacts of a community development intervention," European Journal of Operational Research, Elsevier, vol. 253(3), pages 681-696.
    35. Rodney J. Scott & Robert Y. Cavana & Donald Cameron, 2016. "Client Perceptions of Reported Outcomes of Group Model Building in the New Zealand Public Sector," Group Decision and Negotiation, Springer, vol. 25(1), pages 77-101, January.
    36. Carolyn Hendriks, 2009. "Policy design without democracy? Making democratic sense of transition management," Policy Sciences, Springer;Society of Policy Sciences, vol. 42(4), pages 341-368, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kuller, M. & Beutler, P. & Lienert, J., 2023. "Preference change in stakeholder group-decision processes in the public sector: Extent, causes and implications," European Journal of Operational Research, Elsevier, vol. 308(3), pages 1268-1285.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alexandre de A. Gomes Júnior & Vanessa B. Schramm, 2022. "Problem Structuring Methods: A Review of Advances Over the Last Decade," Systemic Practice and Action Research, Springer, vol. 35(1), pages 55-88, February.
    2. Lami, Isabella M. & Tavella, Elena, 2019. "On the usefulness of soft OR models in decision making: A comparison of Problem Structuring Methods supported and self-organized workshops," European Journal of Operational Research, Elsevier, vol. 275(3), pages 1020-1036.
    3. Franco, L. Alberto & Hämäläinen, Raimo P. & Rouwette, Etiënne A.J.A. & Leppänen, Ilkka, 2021. "Taking stock of behavioural OR: A review of behavioural studies with an intervention focus," European Journal of Operational Research, Elsevier, vol. 293(2), pages 401-418.
    4. Edoardo Fregonese & Isabella M. Lami & Elena Todella, 2020. "Aesthetic Perspectives in Group Decision and Negotiation Practice," Group Decision and Negotiation, Springer, vol. 29(6), pages 993-1019, December.
    5. Harper, Alison & Mustafee, Navonil & Yearworth, Mike, 2021. "Facets of trust in simulation studies," European Journal of Operational Research, Elsevier, vol. 289(1), pages 197-213.
    6. Marleen McCardle-Keurentjes & Etiënne A. J. A. Rouwette, 2018. "Asking Questions: A Sine Qua Non of Facilitation in Decision Support?," Group Decision and Negotiation, Springer, vol. 27(5), pages 757-788, October.
    7. Francis Marleau Donais & Irène Abi-Zeid & E. Owen D. Waygood & Roxane Lavoie, 2021. "A Framework for Post-Project Evaluation of Multicriteria Decision Aiding Processes from the Stakeholders’ Perspective: Design and Application," Group Decision and Negotiation, Springer, vol. 30(5), pages 1161-1191, October.
    8. Scott, Rodney J & Cavana, Robert Y & Cameron, Donald, 2016. "Recent evidence on the effectiveness of group model building," European Journal of Operational Research, Elsevier, vol. 249(3), pages 908-918.
    9. White, Leroy, 2016. "Behavioural operational research: Towards a framework for understanding behaviour in OR interventions," European Journal of Operational Research, Elsevier, vol. 249(3), pages 827-841.
    10. Ormerod, Richard & Yearworth, Mike & White, Leroy, 2023. "Understanding participant actions in OR interventions using practice theories: A research agenda," European Journal of Operational Research, Elsevier, vol. 306(2), pages 810-827.
    11. Franco, L. Alberto & Greiffenhagen, Christian, 2018. "Making OR practice visible: Using ethnomethodology to analyse facilitated modelling workshops," European Journal of Operational Research, Elsevier, vol. 265(2), pages 673-684.
    12. Lane, David & Husemann, Elke & Holland, Darren & Khaled, Abdul, 2019. "Understanding foodborne transmission mechanisms for Norovirus: A study for the UK's Food Standards Agency," European Journal of Operational Research, Elsevier, vol. 275(2), pages 721-736.
    13. Hugo J. Herrera & Marleen H. F. McCardle-Keurentjes & Nuno Videira, 2016. "Evaluating Facilitated Modelling Processes and Outcomes: An Experiment Comparing a Single and a Multimethod Approach in Group Model Building," Group Decision and Negotiation, Springer, vol. 25(6), pages 1277-1318, November.
    14. Elena Tavella & L. Alberto Franco, 2015. "Dynamics of Group Knowledge Production in Facilitated Modelling Workshops: An Exploratory Study," Group Decision and Negotiation, Springer, vol. 24(3), pages 451-475, May.
    15. Alberto Franco, L., 2013. "Rethinking Soft OR interventions: Models as boundary objects," European Journal of Operational Research, Elsevier, vol. 231(3), pages 720-733.
    16. Franco, L. Alberto & Hämäläinen, Raimo P., 2016. "Behavioural operational research: Returning to the roots of the OR profession," European Journal of Operational Research, Elsevier, vol. 249(3), pages 791-795.
    17. Jorge Velez-Castiblanco & Diana Londono-Correa & Olandy Naranjo-Rivera, 2018. "The Structure of Problem Structuring Conversations: A Boundary Games Approach," Group Decision and Negotiation, Springer, vol. 27(5), pages 853-884, October.
    18. Juha-Antti Lamberg & Jukka Luoma, 2021. "Ideology in Vicarious Learning–Related Communication," Organization Science, INFORMS, vol. 32(3), pages 708-730, May.
    19. Vecchiato, Riccardo, 2020. "Analogical reasoning, cognition, and the response to technological change: Lessons from mobile communication," Research Policy, Elsevier, vol. 49(5).
    20. Hugo Herrera & Nuno Videira & Hubert P.L.M. Korzilius & Kathya Lorena Cordova‐Pozo & Marleen H.F. McCardle‐Keurentjes, 2022. "Reflecting on factors influencing long‐lasting organisational effects of group model‐building interventions," System Dynamics Review, System Dynamics Society, vol. 38(2), pages 190-209, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:299:y:2022:i:2:p:589-599. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.