IDEAS home Printed from https://ideas.repec.org/a/eee/jomega/v39y2011i3p362-372.html
   My bibliography  Save this article

Understanding multi-methodology: Evaluating the perceived impact of mixing methods for group budgetary decisions

Author

Listed:
  • Franco, L. Alberto
  • Lord, Ewan

Abstract

This paper reports on the design and implementation of a multi-methodology intervention intended to support a budget prioritisation decision by a multi-organisational group tasked with tackling the problem of teenage pregnancy in an English borough. The intervention approach involved the combined use of cognitive/causal mapping and a multi-criteria decision analysis method to develop and prioritise a number of projects aimed at alleviating issues associated with teenage pregnancy. The paper describes and discusses the process of developing and applying the intervention approach, and provides an evaluation of its perceived impact by the client group. Drawing on the rich seam of data gathered over the course of our work with the multi-organisational group, we explore the varying degrees of impact that the mapping and multi-criteria evaluation methods achieved during and after the intervention. Analysis of the intervention data suggests that both methods were perceived to facilitate a different way of thinking and learning. In addition, we find that the mapping and multi-criteria evaluation methods successfully addressed participants' democratic and rational concerns. However, despite these reported positive effects, the full recommendations of the intervention were not implemented. An attempt is made to explain this outcome in terms of both the multi-organisational context within which the intervention took place and the nature of the group task. Directions for further research are then proposed.

Suggested Citation

  • Franco, L. Alberto & Lord, Ewan, 2011. "Understanding multi-methodology: Evaluating the perceived impact of mixing methods for group budgetary decisions," Omega, Elsevier, vol. 39(3), pages 362-372, June.
  • Handle: RePEc:eee:jomega:v:39:y:2011:i:3:p:362-372
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305-0483(10)00076-9
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. R J Ormerod, 2008. "The transformation competence perspective," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(11), pages 1435-1448, November.
    2. Eden, Colin, 2004. "Analyzing cognitive maps to help structure issues or problems," European Journal of Operational Research, Elsevier, vol. 159(3), pages 673-686, December.
    3. Alberto Franco, L., 2009. "Problem structuring methods as intervention tools: Reflections from their use with multi-organisational teams," Omega, Elsevier, vol. 37(1), pages 193-203, February.
    4. J Pollack, 2009. "Multimethodology in series and parallel: strategic planning using hard and soft OR," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 60(2), pages 156-167, February.
    5. Martin Weber & Franz Eisenführ & Detlof von Winterfeldt, 1988. "The Effects of Splitting Attributes on Weights in Multiattribute Utility Measurement," Management Science, INFORMS, vol. 34(4), pages 431-445, April.
    6. P Keys, 2006. "On becoming expert in the use of problem structuring methods," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(7), pages 822-829, July.
    7. Colin Eden & Fran Ackermann & Steve Cropper, 1992. "The Analysis Of Cause Maps," Journal of Management Studies, Wiley Blackwell, vol. 29(3), pages 309-324, May.
    8. L A Franco, 2006. "Forms of conversation and problem structuring methods: a conceptual development," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(7), pages 813-821, July.
    9. Keeney,Ralph L. & Raiffa,Howard, 1993. "Decisions with Multiple Objectives," Cambridge Books, Cambridge University Press, number 9780521438834.
    10. Franco, L. Alberto & Montibeller, Gilberto, 2010. "Facilitated modelling in operational research," European Journal of Operational Research, Elsevier, vol. 205(3), pages 489-500, September.
    11. L A Franco, 2007. "Assessing the impact of problem structuring methods in multi-organizational settings: an empirical investigation," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(6), pages 760-768, June.
    12. Barcus, Ana & Montibeller, Gilberto, 2008. "Supporting the allocation of software development work in distributed teams with multi-criteria decision analysis," Omega, Elsevier, vol. 36(3), pages 464-475, June.
    13. Mingers, John & Brocklesby, John, 1997. "Multimethodology: Towards a framework for mixing methodologies," Omega, Elsevier, vol. 25(5), pages 489-509, October.
    14. Keys, Paul, 2000. "Creativity, design and style in MS/OR," Omega, Elsevier, vol. 28(3), pages 303-312, June.
    15. Nils Brunsson, 1982. "The Irrationality Of Action And Action Rationality: Decisions, Ideologies And Organizational Actions," Journal of Management Studies, Wiley Blackwell, vol. 19(1), pages 29-44, January.
    16. Schoemaker, Paul J H, 1989. "Preferences for Information on Probabilities versus Prizes: The Role of Risk-Taking Attitudes," Journal of Risk and Uncertainty, Springer, vol. 2(1), pages 37-60, April.
    17. Barry A. Turner, 1983. "The Use Of Grounded Theory For The Qualitative Analysis Of Organizational Behaviour," Journal of Management Studies, Wiley Blackwell, vol. 20(3), pages 333-348, July.
    18. J Mingers, 2003. "A classification of the philosophical assumptions of management science methods," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(6), pages 559-570, June.
    19. Langley, A, 1991. "Formal analysis and strategic decision making," Omega, Elsevier, vol. 19(2-3), pages 79-99.
    20. Paucar-Caceres, Alberto, 2010. "Mapping the changes in management science: A review of 'soft' OR/MS articles published in Omega (1973-2008)," Omega, Elsevier, vol. 38(1-2), pages 46-56, February.
    21. M C Jackson, 2006. "Beyond problem structuring methods: reinventing the future of OR/MS," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(7), pages 868-878, July.
    22. N A D Connell, 2001. "Evaluating soft OR: some reflections on an apparently ‘unsuccessful’ implementation using a Soft Systems Methodology (SSM) based approach," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 52(2), pages 150-160, February.
    23. Jackson, MC, 1987. "Present positions and future prospects in management science," Omega, Elsevier, vol. 15(6), pages 455-466.
    24. Poyhonen, Mari & Vrolijk, Hans & Hamalainen, Raimo P., 2001. "Behavioral and procedural consequences of structural variation in value trees," European Journal of Operational Research, Elsevier, vol. 134(1), pages 216-227, October.
    25. L White, 2006. "Evaluating problem-structuring methods: developing an approach to show the value and effectiveness of PSMs," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(7), pages 842-855, July.
    26. Etiënne A. J. A. Rouwette & Jac A. M. Vennix & Albert J. A. Felling, 2009. "On Evaluating the Performance of Problem Structuring Methods: An Attempt at Formulating a Conceptual Model," Group Decision and Negotiation, Springer, vol. 18(6), pages 567-587, November.
    27. L. Alberto Franco, 2008. "Facilitating Collaboration with Problem Structuring Methods: A Case Study of an Inter-Organisational Construction Partnership," Group Decision and Negotiation, Springer, vol. 17(4), pages 267-286, July.
    28. K Kotiadis & J Mingers, 2006. "Combining PSMs with hard OR methods: the philosophical and practical challenges," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(7), pages 856-867, July.
    29. Lawrence Phillips & Carlos Bana e Costa, 2007. "Transparent prioritisation, budgeting and resource allocation with multi-criteria decision analysis and decision conferencing," Annals of Operations Research, Springer, vol. 154(1), pages 51-68, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ion Georgiou & Joaquim Heck, 2021. "The emergence of problem structuring methods, 1950s–1989: An atlas of the journal literature," Systems Research and Behavioral Science, Wiley Blackwell, vol. 38(6), pages 756-796, November.
    2. Lami, Isabella M. & Tavella, Elena, 2019. "On the usefulness of soft OR models in decision making: A comparison of Problem Structuring Methods supported and self-organized workshops," European Journal of Operational Research, Elsevier, vol. 275(3), pages 1020-1036.
    3. David Lowe & Louise Martingale & Mike Yearworth, 2016. "Guiding interventions in a multi-organisational context: combining the Viable System Model and Hierarchical Process Modelling for use as a Problem Structuring Method," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 67(12), pages 1481-1495, December.
    4. Alberto Franco, L., 2013. "Rethinking Soft OR interventions: Models as boundary objects," European Journal of Operational Research, Elsevier, vol. 231(3), pages 720-733.
    5. Henao, Felipe & Franco, L. Alberto, 2016. "Unpacking multimethodology: Impacts of a community development intervention," European Journal of Operational Research, Elsevier, vol. 253(3), pages 681-696.
    6. White, Leroy, 2016. "Behavioural operational research: Towards a framework for understanding behaviour in OR interventions," European Journal of Operational Research, Elsevier, vol. 249(3), pages 827-841.
    7. Smith, Chris M. & Shaw, Duncan, 2019. "The characteristics of problem structuring methods: A literature review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 403-416.
    8. Midgley, Gerald & Cavana, Robert Y. & Brocklesby, John & Foote, Jeff L. & Wood, David R.R. & Ahuriri-Driscoll, Annabel, 2013. "Towards a new framework for evaluating systemic problem structuring methods," European Journal of Operational Research, Elsevier, vol. 229(1), pages 143-154.
    9. Small, Adrian & Wainwright, David, 2018. "Privacy and security of electronic patient records – Tailoring multimethodology to explore the socio-political problems associated with Role Based Access Control systems," European Journal of Operational Research, Elsevier, vol. 265(1), pages 344-360.
    10. Franco, L. Alberto & Montibeller, Gilberto, 2010. "Facilitated modelling in operational research," European Journal of Operational Research, Elsevier, vol. 205(3), pages 489-500, September.
    11. D Champion & J M Wilson, 2010. "The impact of contingency factors on validation of problem structuring methods," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 61(9), pages 1420-1431, September.
    12. Luoma, Jukka, 2016. "Model-based organizational decision making: A behavioral lens," European Journal of Operational Research, Elsevier, vol. 249(3), pages 816-826.
    13. Lowe, David & Espinosa, Angela & Yearworth, Mike, 2020. "Constitutive rules for guiding the use of the viable system model: Reflections on practice," European Journal of Operational Research, Elsevier, vol. 287(3), pages 1014-1035.
    14. Z Zhu, 2011. "After paradim: why mixing-methodology theorising fails and how to make it work again," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(4), pages 784-798, April.
    15. Montibeller, Gilberto & Franco, L. Alberto & Lord, Ewan & Iglesias, Aline, 2009. "Structuring resource allocation decisions: A framework for building multi-criteria portfolio models with area-grouped options," European Journal of Operational Research, Elsevier, vol. 199(3), pages 846-856, December.
    16. Cronin, Karen & Midgley, Gerald & Jackson, Laurie Skuba, 2014. "Issues Mapping: A problem structuring method for addressing science and technology conflicts," European Journal of Operational Research, Elsevier, vol. 233(1), pages 145-158.
    17. Harper, Alison & Mustafee, Navonil & Yearworth, Mike, 2021. "Facets of trust in simulation studies," European Journal of Operational Research, Elsevier, vol. 289(1), pages 197-213.
    18. Tavella, Elena & Hjortso, Carsten Nico, 2012. "Enhancing the Design and Management of a Local Organic Food Supply Chain with Soft Systems Methodology," International Food and Agribusiness Management Review, International Food and Agribusiness Management Association, vol. 15(2), pages 1-22, May.
    19. Francis Marleau Donais & Irène Abi-Zeid & E. Owen D. Waygood & Roxane Lavoie, 2021. "A Framework for Post-Project Evaluation of Multicriteria Decision Aiding Processes from the Stakeholders’ Perspective: Design and Application," Group Decision and Negotiation, Springer, vol. 30(5), pages 1161-1191, October.
    20. Sondoss Elsawah & Elena Bakhanova & Raimo P. Hämäläinen & Alexey Voinov, 2023. "A Competency Framework for Participatory Modeling," Group Decision and Negotiation, Springer, vol. 32(3), pages 569-601, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jomega:v:39:y:2011:i:3:p:362-372. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/375/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.