IDEAS home Printed from https://ideas.repec.org/a/spr/syspar/v35y2022i3d10.1007_s11213-021-09576-7.html
   My bibliography  Save this article

Iterative Refinement of Multi-Method OR Workshop Designs through Boundary Critique: An Analytical Framework and Case Studies in Technology Utilisation

Author

Listed:
  • Ksenia Ivanova

    (Defence Science & Technology Group)

  • Sondoss Elsawah

    (University of New South Wales Canberra)

Abstract

Operations research (OR) is frequently depicted in terms of a ‘toolbox’ of pre-determined methods and techniques that should be matched to the given problem context. In practice, OR practitioners often tailor, combine and modify elements of methodologies, methods and techniques, particularly within multi-method interventions. Transparent tracking of this process of methodological evolution can generate more effective OR intervention designs and facilitate reflection on the underlying theoretical assumptions. In our study of concept development for logistic and health support operations, we apply the principles of iterative refinement to workshop designs through the use of boundary critique as the basis for analysis. In demonstrating a real-life application of such iterative refinement, we outline the evolution of a multi-method intervention design through theory–practice cycles across five creative workshops. The focus of the workshops is generation of new ideas for technology utilisation and development of comprehensive capability concepts based on these ideas. Our study results point to positive effects from reducing system boundaries associated with conventional ways of thinking, and with the introduction of boundary-expanding steps, such as individual and creative thinking techniques. We also report more successful outcomes when formulating the problem in terms of capabilities or applications, rather than in terms of specific technologies. Further application of the proposed analytical framework may open the door for creative OR workshop design across different domains through understanding and shaping of system boundaries.

Suggested Citation

  • Ksenia Ivanova & Sondoss Elsawah, 2022. "Iterative Refinement of Multi-Method OR Workshop Designs through Boundary Critique: An Analytical Framework and Case Studies in Technology Utilisation," Systemic Practice and Action Research, Springer, vol. 35(3), pages 345-374, June.
  • Handle: RePEc:spr:syspar:v:35:y:2022:i:3:d:10.1007_s11213-021-09576-7
    DOI: 10.1007/s11213-021-09576-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11213-021-09576-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11213-021-09576-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Daniel Ebakoleaneh Ufua, 2020. "Exploring the Effectiveness of Boundary Critique in an Intervention: a Case in the Niger Delta Region, Nigeria," Systemic Practice and Action Research, Springer, vol. 33(5), pages 485-499, October.
    2. Gregory, Amanda J. & Atkins, Jonathan P. & Midgley, Gerald & Hodgson, Anthony M., 2020. "Stakeholder identification and engagement in problem structuring interventions," European Journal of Operational Research, Elsevier, vol. 283(1), pages 321-340.
    3. Elspeth McFadzean, 1999. "Creativity in MS/OR: Choosing the Appropriate Technique," Interfaces, INFORMS, vol. 29(5), pages 110-122, October.
    4. Z Zhu, 2011. "After paradim: why mixing-methodology theorising fails and how to make it work again," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(4), pages 784-798, April.
    5. Howick, Susan & Ackermann, Fran, 2011. "Mixing OR methods in practice: Past, present and future directions," European Journal of Operational Research, Elsevier, vol. 215(3), pages 503-511, December.
    6. P J Dortmans & N J Curtis & N Tri, 2006. "An analytical approach for constructing and measuring concepts," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(8), pages 885-891, August.
    7. Franco, L. Alberto & Montibeller, Gilberto, 2010. "Facilitated modelling in operational research," European Journal of Operational Research, Elsevier, vol. 205(3), pages 489-500, September.
    8. Richard Ormerod, 2017. "Writing practitioner case studies to help behavioural OR researchers ground their theories: application of the mangle perspective," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(5), pages 507-520, May.
    9. Ksenia Ivanova & Sondoss Elsawah & Justin Fidock, 2020. "Technological ecosystems in capability development: A case study in emerging technologies," Systems Engineering, John Wiley & Sons, vol. 23(4), pages 423-435, July.
    10. M Yolles, 2001. "Viable boundary critique," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 52(1), pages 35-47, January.
    11. Richard J Ormerod, 2014. "The mangle of OR practice: towards more informative case studies of ‘technical’ projects," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 65(8), pages 1245-1260, August.
    12. Jorge Velez-Castiblanco & Diana Londono-Correa & Olandy Naranjo-Rivera, 2018. "The Structure of Problem Structuring Conversations: A Boundary Games Approach," Group Decision and Negotiation, Springer, vol. 27(5), pages 853-884, October.
    13. C. West Churchman, 1970. "Operations Research as a Profession," Management Science, INFORMS, vol. 17(2), pages 37-53, October.
    14. L White, 2006. "Evaluating problem-structuring methods: developing an approach to show the value and effectiveness of PSMs," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(7), pages 842-855, July.
    15. Brocklesby, John & Midgley, Gerald, 2016. "Boundary games: How teams of OR practitioners explore the boundaries of interventionAuthor-Name: Velez-Castiblanco, Jorge," European Journal of Operational Research, Elsevier, vol. 249(3), pages 968-982.
    16. Ulrich, Werner, 1987. "Critical heuristics of social systems design," European Journal of Operational Research, Elsevier, vol. 31(3), pages 276-283, September.
    17. Eden, Colin & Ackermann, Fran, 2018. "Theory into practice, practice to theory: Action research in method development," European Journal of Operational Research, Elsevier, vol. 271(3), pages 1145-1155.
    18. K Kotiadis & J Mingers, 2006. "Combining PSMs with hard OR methods: the philosophical and practical challenges," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(7), pages 856-867, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gerald Midgley & Erik Lindhult, 2021. "A systems perspective on systemic innovation," Systems Research and Behavioral Science, Wiley Blackwell, vol. 38(5), pages 635-670, October.
    2. Gregory, Amanda J. & Atkins, Jonathan P. & Midgley, Gerald & Hodgson, Anthony M., 2020. "Stakeholder identification and engagement in problem structuring interventions," European Journal of Operational Research, Elsevier, vol. 283(1), pages 321-340.
    3. Ormerod, Richard & Yearworth, Mike & White, Leroy, 2023. "Understanding participant actions in OR interventions using practice theories: A research agenda," European Journal of Operational Research, Elsevier, vol. 306(2), pages 810-827.
    4. Harper, Alison & Mustafee, Navonil & Yearworth, Mike, 2021. "Facets of trust in simulation studies," European Journal of Operational Research, Elsevier, vol. 289(1), pages 197-213.
    5. Sydelko, Pamela & Midgley, Gerald & Espinosa, Angela, 2021. "Designing interagency responses to wicked problems: Creating a common, cross-agency understanding," European Journal of Operational Research, Elsevier, vol. 294(1), pages 250-263.
    6. David Lowe & Louise Martingale & Mike Yearworth, 2016. "Guiding interventions in a multi-organisational context: combining the Viable System Model and Hierarchical Process Modelling for use as a Problem Structuring Method," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 67(12), pages 1481-1495, December.
    7. Howick, Susan & Ackermann, Fran & Walls, Lesley & Quigley, John & Houghton, Tom, 2017. "Learning from mixed OR method practice: The NINES case study," Omega, Elsevier, vol. 69(C), pages 70-81.
    8. White, Leroy, 2016. "Behavioural operational research: Towards a framework for understanding behaviour in OR interventions," European Journal of Operational Research, Elsevier, vol. 249(3), pages 827-841.
    9. Franco, L. Alberto & Hämäläinen, Raimo P. & Rouwette, Etiënne A.J.A. & Leppänen, Ilkka, 2021. "Taking stock of behavioural OR: A review of behavioural studies with an intervention focus," European Journal of Operational Research, Elsevier, vol. 293(2), pages 401-418.
    10. Lowe, David & Espinosa, Angela & Yearworth, Mike, 2020. "Constitutive rules for guiding the use of the viable system model: Reflections on practice," European Journal of Operational Research, Elsevier, vol. 287(3), pages 1014-1035.
    11. Brocklesby, John & Midgley, Gerald, 2016. "Boundary games: How teams of OR practitioners explore the boundaries of interventionAuthor-Name: Velez-Castiblanco, Jorge," European Journal of Operational Research, Elsevier, vol. 249(3), pages 968-982.
    12. Alexandre de A. Gomes Júnior & Vanessa B. Schramm, 2022. "Problem Structuring Methods: A Review of Advances Over the Last Decade," Systemic Practice and Action Research, Springer, vol. 35(1), pages 55-88, February.
    13. Yearworth, Mike & White, Leroy, 2013. "The uses of qualitative data in multimethodology: Developing causal loop diagrams during the coding process," European Journal of Operational Research, Elsevier, vol. 231(1), pages 151-161.
    14. Henao, Felipe & Franco, L. Alberto, 2016. "Unpacking multimethodology: Impacts of a community development intervention," European Journal of Operational Research, Elsevier, vol. 253(3), pages 681-696.
    15. Cronin, Karen & Midgley, Gerald & Jackson, Laurie Skuba, 2014. "Issues Mapping: A problem structuring method for addressing science and technology conflicts," European Journal of Operational Research, Elsevier, vol. 233(1), pages 145-158.
    16. Francis Marleau Donais & Irène Abi-Zeid & E. Owen D. Waygood & Roxane Lavoie, 2021. "A Framework for Post-Project Evaluation of Multicriteria Decision Aiding Processes from the Stakeholders’ Perspective: Design and Application," Group Decision and Negotiation, Springer, vol. 30(5), pages 1161-1191, October.
    17. M. Nassereddine & M. A. Ellakkis & A. Azar & M. D. Nayeri, 2021. "Developing a Multi-methodology for Conflict Resolution: Case of Yemen’s Humanitarian Crisis," Group Decision and Negotiation, Springer, vol. 30(2), pages 301-320, April.
    18. Marttunen, Mika & Haara, Arto & Hjerppe, Turo & Kurttila, Mikko & Liesiö, Juuso & Mustajoki, Jyri & Saarikoski, Heli & Tolvanen, Anne, 2023. "Parallel and comparative use of three multicriteria decision support methods in an environmental portfolio problem," European Journal of Operational Research, Elsevier, vol. 307(2), pages 842-859.
    19. Robert G. Dyson & Frances A. O’Brien & Devan B. Shah, 2021. "Soft OR and Practice: The Contribution of the Founders of Operations Research," Operations Research, INFORMS, vol. 69(3), pages 727-738, May.
    20. Johnson, Michael P. & Midgley, Gerald & Chichirau, George, 2018. "Emerging trends and new frontiers in community operational research," European Journal of Operational Research, Elsevier, vol. 268(3), pages 1178-1191.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:syspar:v:35:y:2022:i:3:d:10.1007_s11213-021-09576-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.