IDEAS home Printed from https://ideas.repec.org/a/eee/jbrese/v65y2012i12p1790-1799.html
   My bibliography  Save this article

Multidimensional assessment of organizational performance: Integrating BSC and AHP

Author

Listed:
  • Bentes, Alexandre Veronese
  • Carneiro, Jorge
  • da Silva, Jorge Ferreira
  • Kimura, Herbert

Abstract

Measurement of organizational performance is a complex issue given that performance is a multifaceted phenomenon whose component elements may have distinct managerial priorities and may even be mutually inconsistent. This paper presents the case of a Brazilian telecom company to illustrate and critically analyze the integration of two methodologies, Balanced Scorecard (BSC) – a multiple perspective framework for performance assessment – and Analytic Hierarchy Process (AHP) – a decision-making tool to prioritize multiple performance perspectives and indicators and to generate a unified metric for the ranking of alternatives (in this case, performance of functional units). An iterative and interactive procedure coupled with an agreement-building approach among managers generates priority values for performance dimensions and respective indicators. The paper discusses the advantages and disadvantages of the design.

Suggested Citation

  • Bentes, Alexandre Veronese & Carneiro, Jorge & da Silva, Jorge Ferreira & Kimura, Herbert, 2012. "Multidimensional assessment of organizational performance: Integrating BSC and AHP," Journal of Business Research, Elsevier, vol. 65(12), pages 1790-1799.
  • Handle: RePEc:eee:jbrese:v:65:y:2012:i:12:p:1790-1799
    DOI: 10.1016/j.jbusres.2011.10.039
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0148296311003833
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jbusres.2011.10.039?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Brenes, Esteban R. & Haar, Jerry & Requena, Bernardo, 2009. "Latin America: Environmental and firm-level challenges," Journal of Business Research, Elsevier, vol. 62(9), pages 849-853, September.
    2. Thomas L. Saaty, 1986. "Axiomatic Foundation of the Analytic Hierarchy Process," Management Science, INFORMS, vol. 32(7), pages 841-855, July.
    3. Thomas L. Saaty, 1990. "An Exposition of the AHP in Reply to the Paper "Remarks on the Analytic Hierarchy Process"," Management Science, INFORMS, vol. 36(3), pages 259-268, March.
    4. H A Akkermans & K E van Oorschot, 2005. "Relevance assumed: a case study of balanced scorecard development using system dynamics," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 56(8), pages 931-941, August.
    5. Smith, Anne M., 1999. "Some Problems When Adopting Churchill's Paradigm for the Development of Service Quality Measurement Scales," Journal of Business Research, Elsevier, vol. 46(2), pages 109-120, October.
    6. B. Roy & Ph. Vincke, 1984. "Relational Systems of Preference with One or More Pseudo-Criteria: Some New Concepts and Results," Management Science, INFORMS, vol. 30(11), pages 1323-1335, November.
    7. Patrick T. Harker & Luis G. Vargas, 1987. "The Theory of Ratio Scale Estimation: Saaty's Analytic Hierarchy Process," Management Science, INFORMS, vol. 33(11), pages 1383-1403, November.
    8. Javalgi, Rajshekhar G. & Armacost, Robert L. & Hosseini, Jamshid C., 1989. "Using the analytic hierarchy process for bank management: Analysis of consumer bank selection decisions," Journal of Business Research, Elsevier, vol. 19(1), pages 33-49, August.
    9. James E. Smith & Detlof von Winterfeldt, 2004. "Anniversary Article: Decision Analysis in Management Science," Management Science, INFORMS, vol. 50(5), pages 561-574, May.
    10. Balaji S. Chakravarthy, 1986. "Measuring strategic performance," Strategic Management Journal, Wiley Blackwell, vol. 7(5), pages 437-458, September.
    11. James S. Dyer, 1990. "Remarks on the Analytic Hierarchy Process," Management Science, INFORMS, vol. 36(3), pages 249-258, March.
    12. Ernest H. Forman & Saul I. Gass, 2001. "The Analytic Hierarchy Process---An Exposition," Operations Research, INFORMS, vol. 49(4), pages 469-486, August.
    13. Yoram Wind & Thomas L. Saaty, 1980. "Marketing Applications of the Analytic Hierarchy Process," Management Science, INFORMS, vol. 26(7), pages 641-658, July.
    14. Chou, Yuntsai & Lee, Chiwei & Chung, Jianru, 2004. "Understanding m-commerce payment systems through the analytic hierarchy process," Journal of Business Research, Elsevier, vol. 57(12), pages 1423-1430, December.
    15. Forman, Ernest & Peniwati, Kirti, 1998. "Aggregating individual judgments and priorities with the analytic hierarchy process," European Journal of Operational Research, Elsevier, vol. 108(1), pages 165-169, July.
    16. L C Leung & K C Lam & D Cao, 2006. "Implementing the balanced scorecard using the analytic hierarchy process & the analytic network process," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(6), pages 682-691, June.
    17. James S. Dyer, 1990. "A Clarification of "Remarks on the Analytic Hierarchy Process"," Management Science, INFORMS, vol. 36(3), pages 274-275, March.
    18. Kim S. Cameron, 1986. "Effectiveness as Paradox: Consensus and Conflict in Conceptions of Organizational Effectiveness," Management Science, INFORMS, vol. 32(5), pages 539-553, May.
    19. Arash Shahin & M. Ali Mahbod, 2007. "Prioritization of key performance indicators," International Journal of Productivity and Performance Management, Emerald Group Publishing Limited, vol. 56(3), pages 226-240, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fabio De Felice & Antonella Petrillo & Claudio Autorino, 2015. "Development of a Framework for Sustainable Outsourcing: Analytic Balanced Scorecard Method (A-BSC)," Sustainability, MDPI, vol. 7(7), pages 1-21, June.
    2. Chih-Chao Chung & Li-Chung Chao & Chih-Hong Chen & Shi-Jer Lou, 2016. "A Balanced Scorecard of Sustainable Management in the Taiwanese Bicycle Industry: Development of Performance Indicators and Importance Analysis," Sustainability, MDPI, vol. 8(6), pages 1-21, May.
    3. Caporale, Diana & Sangiorgio, Valentino & Amodio, Alessandro & De Lucia, Caterina, 2020. "Multi-criteria and focus group analysis for social acceptance of wind energy," Energy Policy, Elsevier, vol. 140(C).
    4. César Álvarez Pérez & Vicente Rodríguez Montequín & Francisco Ortega Fernández & Joaquín Villanueva Balsera, 2017. "Integrating Analytic Hierarchy Process (AHP) and Balanced Scorecard (BSC) Framework for Sustainable Business in a Software Factory in the Financial Sector," Sustainability, MDPI, vol. 9(4), pages 1-16, March.
    5. Mendoza, Xavier & Carneiro, Jorge, 2012. "Introduction to the special issue of best papers Business Association of Latin American Studies 2010," Journal of Business Research, Elsevier, vol. 65(12), pages 1749-1751.
    6. Aleksander Janeš & Armand Faganel, 2020. "Complementary Methods for Effective Decision Making," MIC 2020: The 20th Management International Conference,, University of Primorska Press.
    7. Jeong, Byongug & Oguz, Elif & Wang, Haibin & Zhou, Peilin, 2018. "Multi-criteria decision-making for marine propulsion: Hybrid, diesel electric and diesel mechanical systems from cost-environment-risk perspectives," Applied Energy, Elsevier, vol. 230(C), pages 1065-1081.
    8. Abbas Keramati & Fatemeh Shapouri, 2016. "Multidimensional appraisal of customer relationship management: integrating balanced scorecard and multi criteria decision making approaches," Information Systems and e-Business Management, Springer, vol. 14(2), pages 217-251, May.
    9. Alkinoos Psarras & Theodoros Anagnostopoulos & Nikos Tsotsolas & Ioannis Salmon & Lazaros Vryzidis, 2020. "Applying the Balanced Scorecard and Predictive Analytics in the Administration of a European Funding Program," Administrative Sciences, MDPI, vol. 10(4), pages 1-15, December.
    10. Dias, Cleidson Nogueira & Hoffmann, Valmir Emil & Martínez-Fernández, María Teresa, 2021. "Condiciones de las redes interorganizativas para la innovación en áreas rurales," Economia Agraria y Recursos Naturales, Spanish Association of Agricultural Economists, vol. 21(01), June.
    11. Mehdi Salimi & Mahboubeh Khodaparast, 2019. "Providing a combined model of fuzzy AHP and numerical taxonomy analysis for sport organizational ranking and performance appraisal," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 10(5), pages 1133-1144, October.
    12. Panteha Khodakarami & Zukarnain Zakaria & Rossilah Jamil & Tan Seng Teck & Hayder Dhahir Mohammed & Mehran Najmaei, 2022. "The Effect of Business Technology Strategy on Inward Export Performance in the Malaysian Higher Education Industry," Sustainability, MDPI, vol. 14(15), pages 1-15, July.
    13. César Álvarez Pérez & Vicente Rodríguez Montequín & Francisco Ortega Fernández & Joaquín Villanueva Balsera, 2017. "Integration of Balanced Scorecard (BSC), Strategy Map, and Fuzzy Analytic Hierarchy Process (FAHP) for a Sustainability Business Framework: A Case Study of a Spanish Software Factory in the Financial ," Sustainability, MDPI, vol. 9(4), pages 1-23, March.
    14. Khaja Moiduddin & Syed Hammad Mian & Usama Umer & Hisham Alkhalefah & Abdul Sayeed, 2020. "Fuzzy Multicriteria Decision Mapping to Evaluate Implant Design for Maxillofacial Reconstruction," Mathematics, MDPI, vol. 8(12), pages 1-33, November.
    15. Quezada, Luis E. & López-Ospina, Héctor A., 2014. "A method for designing a strategy map using AHP and linear programming," International Journal of Production Economics, Elsevier, vol. 158(C), pages 244-255.
    16. Goswami Shankha Shubhra, 2020. "Outranking Methods: Promethee I and Promethee II," Foundations of Management, Sciendo, vol. 12(1), pages 93-110, January.
    17. Ibrahim Garba Muhammad & Ibrahim Garba Muhammad & Haim Hilman Abdullah, 2016. "Assessment of Organizational Performance: Linking the Motivational Antecedents of Empowerment, Compensation and Organizational Commitment," International Review of Management and Marketing, Econjournals, vol. 6(4), pages 974-983.
    18. Afrasiabi, Ahmadreza & Chalmardi, Mazyar Kaboli & Balezentis, Tomas, 2022. "A novel hybrid evaluation framework for public organizations based on employees’ performance factors," Evaluation and Program Planning, Elsevier, vol. 91(C).
    19. Dinçer, Hasan & Hacıoğlu, Ümit & Yüksel, Serhat, 2017. "Balanced scorecard based performance measurement of European airlines using a hybrid multicriteria decision making approach under the fuzzy environment," Journal of Air Transport Management, Elsevier, vol. 63(C), pages 17-33.
    20. Ibrahim Garba Muhammad & Ibrahim Garba Muhammad & Haim Hilman Abdullah, 2016. "Assessment of Organizational Performance: Linking the Motivational Antecedents of Empowerment, Compensation and Organizational Commitment," International Review of Management and Marketing, Econjournals, vol. 6(4), pages 974-983.
    21. Behrooz Noori, 2014. "Prioritizing strategic business units in the face of innovation performance: Combining fuzzy AHP and BSC," Proceedings of International Academic Conferences 0802059, International Institute of Social and Economic Sciences.
    22. Rossi, Cesare & Cricelli, Livio & Grimaldi, Michele & Greco, Marco, 2016. "The strategic assessment of intellectual capital assets: An application within Terradue Srl," Journal of Business Research, Elsevier, vol. 69(5), pages 1598-1603.
    23. S. Vijayakumar Bharathi, 2017. "Prioritizing and Ranking the Big Data Information Security Risk Spectrum," Global Journal of Flexible Systems Management, Springer;Global Institute of Flexible Systems Management, vol. 18(3), pages 183-201, September.
    24. Syed Hammad Mian & Abdulrahman Al-Ahmari, 2019. "Comparative analysis of different digitization systems and selection of best alternative," Journal of Intelligent Manufacturing, Springer, vol. 30(5), pages 2039-2067, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. A Ishizaka & D Balkenborg & T Kaplan, 2011. "Influence of aggregation and measurement scale on ranking a compromise alternative in AHP," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(4), pages 700-710, April.
    2. Saul I. Gass, 2005. "Model World: The Great Debate—MAUT Versus AHP," Interfaces, INFORMS, vol. 35(4), pages 308-312, August.
    3. Michele Bernasconi & Christine Choirat & Raffaello Seri, 2010. "The Analytic Hierarchy Process and the Theory of Measurement," Management Science, INFORMS, vol. 56(4), pages 699-711, April.
    4. M Tavana, 2006. "A priority assessment multi-criteria decision model for human spaceflight mission planning at NASA," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(10), pages 1197-1215, October.
    5. Alessio Ishizaka & Sajid Siraj, 2020. "Interactive consistency correction in the analytic hierarchy process to preserve ranks," Decisions in Economics and Finance, Springer;Associazione per la Matematica, vol. 43(2), pages 443-464, December.
    6. Bana e Costa, Carlos A. & Vansnick, Jean-Claude, 2008. "A critical analysis of the eigenvalue method used to derive priorities in AHP," European Journal of Operational Research, Elsevier, vol. 187(3), pages 1422-1428, June.
    7. Madjid Tavana & Mariya Sodenkamp & Leena Suhl, 2010. "A soft multi-criteria decision analysis model with application to the European Union enlargement," Annals of Operations Research, Springer, vol. 181(1), pages 393-421, December.
    8. Höfer, Tim & Sunak, Yasin & Siddique, Hafiz & Madlener, Reinhard, 2016. "Wind farm siting using a spatial Analytic Hierarchy Process approach: A case study of the Städteregion Aachen," Applied Energy, Elsevier, vol. 163(C), pages 222-243.
    9. Leung, Lawrence C. & Cao, Dong, 2001. "On the efficacy of modeling multi-attribute decision problems using AHP and Sinarchy," European Journal of Operational Research, Elsevier, vol. 132(1), pages 39-49, July.
    10. Ardalan Bafahm & Minghe Sun, 2019. "Some Conflicting Results in the Analytic Hierarchy Process," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 18(02), pages 465-486, March.
    11. Majumdar, Abhijit & Tiwari, Manoj Kumar & Agarwal, Aastha & Prajapat, Kanika, 2021. "A new case of rank reversal in analytic hierarchy process due to aggregation of cost and benefit criteria," Operations Research Perspectives, Elsevier, vol. 8(C).
    12. Liu, Qizhi, 2022. "Identifying and correcting the defects of the Saaty analytic hierarchy/network process: A comparative study of the Saaty analytic hierarchy/network process and the Markov chain-based analytic network ," Operations Research Perspectives, Elsevier, vol. 9(C).
    13. Benedetto Barabino & Nicola Aldo Cabras & Claudio Conversano & Alessandro Olivo, 2020. "An Integrated Approach to Select Key Quality Indicators in Transit Services," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 149(3), pages 1045-1080, June.
    14. Jain, Bharat A. & Nag, Barin N., 1996. "A decision-support model for investment decisions in new ventures," European Journal of Operational Research, Elsevier, vol. 90(3), pages 473-486, May.
    15. Dong, Yucheng & Xu, Yinfeng & Li, Hongyi & Dai, Min, 2008. "A comparative study of the numerical scales and the prioritization methods in AHP," European Journal of Operational Research, Elsevier, vol. 186(1), pages 229-242, April.
    16. L. Sun & B. S. Greenberg, 2006. "Multicriteria Group Decision Making: Optimal Priority Synthesis from Pairwise Comparisons," Journal of Optimization Theory and Applications, Springer, vol. 130(2), pages 317-339, August.
    17. Stam, Antonie & Duarte Silva, A. Pedro, 2003. "On multiplicative priority rating methods for the AHP," European Journal of Operational Research, Elsevier, vol. 145(1), pages 92-108, February.
    18. James E. Smith & Detlof von Winterfeldt, 2004. "Anniversary Article: Decision Analysis in Management Science," Management Science, INFORMS, vol. 50(5), pages 561-574, May.
    19. Hoene, Andreas & Jawale, Mandar & Neukirchen, Thomas & Bednorz, Nicole & Schulz, Holger & Hauser, Simon, 2019. "Bewertung von Technologielösungen für Automatisierung und Ergonomieunterstützung der Intralogistik," ild Schriftenreihe 64, FOM Hochschule für Oekonomie & Management, Institut für Logistik- & Dienstleistungsmanagement (ild).
    20. Kevin Kam Fung Yuen, 2022. "Decision models for information systems planning using primitive cognitive network process: comparisons with analytic hierarchy process," Operational Research, Springer, vol. 22(3), pages 1759-1785, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jbrese:v:65:y:2012:i:12:p:1790-1799. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jbusres .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.