IDEAS home Printed from https://ideas.repec.org/a/eee/jomega/v69y2017icp70-81.html
   My bibliography  Save this article

Learning from mixed OR method practice: The NINES case study

Author

Listed:
  • Howick, Susan
  • Ackermann, Fran
  • Walls, Lesley
  • Quigley, John
  • Houghton, Tom

Abstract

Despite continued interest in the use of mixed OR/MS methods, limited attention has been paid in the literature to generic lessons that could be gained from mixing methods in practice. Many organisational problems demand the use of a mixed method approach and thus recognising and sharing lessons could prove beneficial to both practitioners and researchers. This paper reports on an in-depth evaluation of a case study involving risk identification and quantification of the Northern Isles New Energy Solutions (NINES) project which sought to trial and plan a new energy system. The intervention involved a mixed method approach and client feedback on the efficacy of the approach was sought. The evaluation reported in this paper is carried out using a set of themes taken from the literature and seeks to highlight transferable lessons. The set of lessons that emerge are presented along with their implications for both general OR modelling practice and the specific situation of mixing OR/MS methods. The paper concludes by discussing the implications of the work and directions for future work which will be of interest to both practitioners and researchers interested in mixed method OR/MS work.

Suggested Citation

  • Howick, Susan & Ackermann, Fran & Walls, Lesley & Quigley, John & Houghton, Tom, 2017. "Learning from mixed OR method practice: The NINES case study," Omega, Elsevier, vol. 69(C), pages 70-81.
  • Handle: RePEc:eee:jomega:v:69:y:2017:i:c:p:70-81
    DOI: 10.1016/j.omega.2016.08.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305048316304728
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.omega.2016.08.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Howick, Susan & Eden, Colin & Ackermann, Fran & Williams, Terry, 2008. "Building confidence in models for multiple audiences: The modelling cascade," European Journal of Operational Research, Elsevier, vol. 186(3), pages 1068-1083, May.
    2. Midgley, Gerald & Cavana, Robert Y. & Brocklesby, John & Foote, Jeff L. & Wood, David R.R. & Ahuriri-Driscoll, Annabel, 2013. "Towards a new framework for evaluating systemic problem structuring methods," European Journal of Operational Research, Elsevier, vol. 229(1), pages 143-154.
    3. J Pollack, 2009. "Multimethodology in series and parallel: strategic planning using hard and soft OR," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 60(2), pages 156-167, February.
    4. Franco, L. Alberto & Lord, Ewan, 2011. "Understanding multi-methodology: Evaluating the perceived impact of mixing methods for group budgetary decisions," Omega, Elsevier, vol. 39(3), pages 362-372, June.
    5. Ackermann, Fran & Andersen, David F. & Eden, Colin & Richardson, George P., 2011. "ScriptsMap: A tool for designing multi-method policy-making workshops," Omega, Elsevier, vol. 39(4), pages 427-434, August.
    6. Z Zhu, 2011. "After paradim: why mixing-methodology theorising fails and how to make it work again," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(4), pages 784-798, April.
    7. Wanda J. Orlikowski, 2000. "Using Technology and Constituting Structures: A Practice Lens for Studying Technology in Organizations," Organization Science, INFORMS, vol. 11(4), pages 404-428, August.
    8. Ormerod, R.J., 2014. "Critical rationalism in practice: Strategies to manage subjectivity in OR investigations," European Journal of Operational Research, Elsevier, vol. 235(3), pages 784-797.
    9. Howick, Susan & Ackermann, Fran, 2011. "Mixing OR methods in practice: Past, present and future directions," European Journal of Operational Research, Elsevier, vol. 215(3), pages 503-511, December.
    10. Eden, Colin, 1995. "On evaluating the performance of `wide-band' GDSS's," European Journal of Operational Research, Elsevier, vol. 81(2), pages 302-311, March.
    11. Small, Adrian & Wainwright, David, 2014. "SSM and technology management: Developing multimethodology through practice," European Journal of Operational Research, Elsevier, vol. 233(3), pages 660-673.
    12. Ackermann, Fran & Howick, Susan & Quigley, John & Walls, Lesley & Houghton, Tom, 2014. "Systemic risk elicitation: Using causal maps to engage stakeholders and build a comprehensive view of risks," European Journal of Operational Research, Elsevier, vol. 238(1), pages 290-299.
    13. Richard J. Ormerod, 1996. "Information Systems Strategy Development at Sainsbury's Supermarkets Using “Soft” OR," Interfaces, INFORMS, vol. 26(1), pages 102-130, February.
    14. Huxham, C & Cropper, S, 1994. "From many to one--and back. An exploration of some components of facilitation," Omega, Elsevier, vol. 22(1), pages 1-11, January.
    15. Ackermann, Fran, 2012. "Problem structuring methods ‘in the Dock’: Arguing the case for Soft OR," European Journal of Operational Research, Elsevier, vol. 219(3), pages 652-658.
    16. S Howick & C Eden, 2011. "Supporting strategic conversations: the significance of a quantitative model building process," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(5), pages 868-878, May.
    17. Mingers, John & Brocklesby, John, 1997. "Multimethodology: Towards a framework for mixing methodologies," Omega, Elsevier, vol. 25(5), pages 489-509, October.
    18. M C Jackson, 1999. "Towards coherent pluralism in management science," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 50(1), pages 12-22, January.
    19. Henao, Felipe & Franco, L. Alberto, 2016. "Unpacking multimethodology: Impacts of a community development intervention," European Journal of Operational Research, Elsevier, vol. 253(3), pages 681-696.
    20. K Kotiadis & J Mingers, 2006. "Combining PSMs with hard OR methods: the philosophical and practical challenges," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(7), pages 856-867, July.
    21. Richard J Ormerod, 2014. "The mangle of OR practice: towards more informative case studies of ‘technical’ projects," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 65(8), pages 1245-1260, August.
    22. J Mingers, 2003. "A classification of the philosophical assumptions of management science methods," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(6), pages 559-570, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. M. Nassereddine & M. A. Ellakkis & A. Azar & M. D. Nayeri, 2021. "Developing a Multi-methodology for Conflict Resolution: Case of Yemen’s Humanitarian Crisis," Group Decision and Negotiation, Springer, vol. 30(2), pages 301-320, April.
    2. Umberto Di Matteo & Sofia Agostinelli, 2022. "Big Data Analysis for Optimising the Decision-Making Process in Sustainable Energy Action Plans: A Multi-Criteria Evaluation Approach Applied to Sicilian Regional Recovery and Resilience Plans," Energies, MDPI, vol. 15(20), pages 1-22, October.
    3. Richard John Ormerod, 2023. "The logic of semiotics applied to mathematical and social interaction in operational research consulting practice: Towards a foundational view," Systems Research and Behavioral Science, Wiley Blackwell, vol. 40(1), pages 16-42, January.
    4. Lami, Isabella M. & Todella, Elena, 2023. "A multi-methodological combination of the strategic choice approach and the analytic network process: From facts to values and vice versa," European Journal of Operational Research, Elsevier, vol. 307(2), pages 802-812.
    5. Alexandre de A. Gomes Júnior & Vanessa B. Schramm, 2022. "Problem Structuring Methods: A Review of Advances Over the Last Decade," Systemic Practice and Action Research, Springer, vol. 35(1), pages 55-88, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. David Lowe & Louise Martingale & Mike Yearworth, 2016. "Guiding interventions in a multi-organisational context: combining the Viable System Model and Hierarchical Process Modelling for use as a Problem Structuring Method," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 67(12), pages 1481-1495, December.
    2. Small, Adrian & Wainwright, David, 2018. "Privacy and security of electronic patient records – Tailoring multimethodology to explore the socio-political problems associated with Role Based Access Control systems," European Journal of Operational Research, Elsevier, vol. 265(1), pages 344-360.
    3. Henao, Felipe & Franco, L. Alberto, 2016. "Unpacking multimethodology: Impacts of a community development intervention," European Journal of Operational Research, Elsevier, vol. 253(3), pages 681-696.
    4. Lowe, David & Espinosa, Angela & Yearworth, Mike, 2020. "Constitutive rules for guiding the use of the viable system model: Reflections on practice," European Journal of Operational Research, Elsevier, vol. 287(3), pages 1014-1035.
    5. White, Leroy, 2016. "Behavioural operational research: Towards a framework for understanding behaviour in OR interventions," European Journal of Operational Research, Elsevier, vol. 249(3), pages 827-841.
    6. Santos, Sérgio P. & Belton, Valerie & Howick, Susan & Pilkington, Martin, 2018. "Measuring organisational performance using a mix of OR methods," Technological Forecasting and Social Change, Elsevier, vol. 131(C), pages 18-30.
    7. Smith, Chris M. & Shaw, Duncan, 2019. "The characteristics of problem structuring methods: A literature review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 403-416.
    8. Alexandre de A. Gomes Júnior & Vanessa B. Schramm, 2022. "Problem Structuring Methods: A Review of Advances Over the Last Decade," Systemic Practice and Action Research, Springer, vol. 35(1), pages 55-88, February.
    9. Yearworth, Mike & White, Leroy, 2013. "The uses of qualitative data in multimethodology: Developing causal loop diagrams during the coding process," European Journal of Operational Research, Elsevier, vol. 231(1), pages 151-161.
    10. Durugbo, Christopher M., 2020. "Affordance-based problem structuring for workplace innovation," European Journal of Operational Research, Elsevier, vol. 284(2), pages 617-631.
    11. Small, Adrian & Wainwright, David, 2014. "SSM and technology management: Developing multimethodology through practice," European Journal of Operational Research, Elsevier, vol. 233(3), pages 660-673.
    12. S Howick & C Eden, 2011. "Supporting strategic conversations: the significance of a quantitative model building process," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(5), pages 868-878, May.
    13. Lami, Isabella M. & Tavella, Elena, 2019. "On the usefulness of soft OR models in decision making: A comparison of Problem Structuring Methods supported and self-organized workshops," European Journal of Operational Research, Elsevier, vol. 275(3), pages 1020-1036.
    14. M. Nassereddine & M. A. Ellakkis & A. Azar & M. D. Nayeri, 2021. "Developing a Multi-methodology for Conflict Resolution: Case of Yemen’s Humanitarian Crisis," Group Decision and Negotiation, Springer, vol. 30(2), pages 301-320, April.
    15. Brocklesby, John & Midgley, Gerald, 2016. "Boundary games: How teams of OR practitioners explore the boundaries of interventionAuthor-Name: Velez-Castiblanco, Jorge," European Journal of Operational Research, Elsevier, vol. 249(3), pages 968-982.
    16. Hugo J. Herrera & Marleen H. F. McCardle-Keurentjes & Nuno Videira, 2016. "Evaluating Facilitated Modelling Processes and Outcomes: An Experiment Comparing a Single and a Multimethod Approach in Group Model Building," Group Decision and Negotiation, Springer, vol. 25(6), pages 1277-1318, November.
    17. Foote, J. & Midgley, G. & Ahuriri-Driscoll, A. & Hepi, M. & Earl-Goulet, J., 2021. "Systemic evaluation of community environmental management programmes," European Journal of Operational Research, Elsevier, vol. 288(1), pages 207-224.
    18. Howick, Susan & Ackermann, Fran, 2011. "Mixing OR methods in practice: Past, present and future directions," European Journal of Operational Research, Elsevier, vol. 215(3), pages 503-511, December.
    19. Morgan, Jennifer Sian & Howick, Susan & Belton, Valerie, 2017. "A toolkit of designs for mixing Discrete Event Simulation and System Dynamics," European Journal of Operational Research, Elsevier, vol. 257(3), pages 907-918.
    20. Cronin, Karen & Midgley, Gerald & Jackson, Laurie Skuba, 2014. "Issues Mapping: A problem structuring method for addressing science and technology conflicts," European Journal of Operational Research, Elsevier, vol. 233(1), pages 145-158.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jomega:v:69:y:2017:i:c:p:70-81. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/375/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.