IDEAS home Printed from
   My bibliography  Save this article

R&D project evaluation: An integrated DEA and balanced scorecard approach


  • Eilat, Harel
  • Golany, Boaz
  • Shtub, Avraham


We present and demonstrate a multi-criteria approach for evaluating R&D projects in different stages of their life cycle. Our approach integrates the balanced scorecard (BSC) and data envelopment analysis (DEA) and develops an extended DEA model. The input and output measures for the integrated DEA-BSC model are grouped in "cards" which are associated with a "BSC for R&D projects". The BSC is embedded in the DEA model through a hierarchical structure of constraints that reflect the BSC balance considerations. We illustrate the proposed approach with a case study involving an industrial research laboratory that selects and executes dozens of R&D projects every year.

Suggested Citation

  • Eilat, Harel & Golany, Boaz & Shtub, Avraham, 2008. "R&D project evaluation: An integrated DEA and balanced scorecard approach," Omega, Elsevier, vol. 36(5), pages 895-912, October.
  • Handle: RePEc:eee:jomega:v:36:y:2008:i:5:p:895-912

    Download full text from publisher

    File URL:
    Download Restriction: Full text for ScienceDirect subscribers only

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    1. Norman Baker & James Freeland, 1975. "Recent Advances in R&D Benefit Measurement and Project Selection Methods," Management Science, INFORMS, vol. 21(10), pages 1164-1175, June.
    2. Roll, Y & Golany, B., 1993. "Alternate methods of treating factor weights in DEA," Omega, Elsevier, vol. 21(1), pages 99-109, January.
    3. Barry G. Silverman, 1981. "Project Appraisal Methodology: A Multidimensional R&D Benefit/Cost Assessment Tool," Management Science, INFORMS, vol. 27(7), pages 802-821, July.
    4. Muhittin Oral & Ossama Kettani & Pascal Lang, 1991. "A Methodology for Collective Evaluation and Selection of Industrial R&D Projects," Management Science, INFORMS, vol. 37(7), pages 871-885, July.
    5. R. D. Banker & A. Charnes & W. W. Cooper, 1984. "Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis," Management Science, INFORMS, vol. 30(9), pages 1078-1092, September.
    6. Thompson, Russell G. & Langemeier, Larry N. & Lee, Chih-Tah & Lee, Euntaik & Thrall, Robert M., 1990. "The role of multiplier bounds in efficiency analysis with application to Kansas farming," Journal of Econometrics, Elsevier, vol. 46(1-2), pages 93-108.
    7. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    8. Lauro, George L. & Vepsalainen, Ari P. J., 1986. "Assessing technology portfolios for contract competition: An analytic hierarchy process approach," Socio-Economic Planning Sciences, Elsevier, vol. 20(6), pages 407-415.
    Full references (including those not matched with items on IDEAS)


    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.

    Cited by:

    1. Kao, Chiang, 2008. "A linear formulation of the two-level DEA model," Omega, Elsevier, vol. 36(6), pages 958-962, December.
    2. Ulucan, AydIn & BarIs AtIcI, KazIm, 2010. "Efficiency evaluations with context-dependent and measure-specific data envelopment approaches: An application in a World Bank supported project," Omega, Elsevier, vol. 38(1-2), pages 68-83, February.
    3. Oral, Muhittin, 2010. "E-DEA: Enhanced data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 207(2), pages 916-926, December.
    4. Liu, John S. & Lu, Wen-Min, 2010. "DEA and ranking with the network-based approach: a case of R&D performance," Omega, Elsevier, vol. 38(6), pages 453-464, December.
    5. Salimi, Negin & Rezaei, Jafar, 2018. "Evaluating firms’ R&D performance using best worst method," Evaluation and Program Planning, Elsevier, vol. 66(C), pages 147-155.
    6. Sara Fanati Rashidi, 0. "Studying productivity using a synergy between the balanced scorecard and analytic network process," OPSEARCH, Springer;Operational Research Society of India, vol. 0, pages 1-18.
    7. Sabahi, Sima & Parast, Mahour Mellat, 2020. "The impact of entrepreneurship orientation on project performance: A machine learning approach," International Journal of Production Economics, Elsevier, vol. 226(C).
    8. Samoilenko, Sergey & Osei-Bryson, Kweku-Muata, 2013. "Using Data Envelopment Analysis (DEA) for monitoring efficiency-based performance of productivity-driven organizations: Design and implementation of a decision support system," Omega, Elsevier, vol. 41(1), pages 131-142.
    9. Dorota Kuchta & Dimitris Despotis & Kazimierz Fraczkowski & Stanislaw Stanek, 2019. "Application of data envelopment analysis to evaluation of IT project success," Operations Research and Decisions, Wroclaw University of Technology, Institute of Organization and Management, vol. 3, pages 17-36.
    10. Chia-Hua Cheng & James J. H. Liou & Chui-Yu Chiu, 2017. "A Consistent Fuzzy Preference Relations Based ANP Model for R&D Project Selection," Sustainability, MDPI, Open Access Journal, vol. 9(8), pages 1-17, August.
    11. Wang, Jue & Xu, Wei & Ma, Jian & Wang, Shouyang, 2013. "A vague set based decision support approach for evaluating research funding programs," European Journal of Operational Research, Elsevier, vol. 230(3), pages 656-665.
    12. Basso, Antonella & Casarin, Francesco & Funari, Stefania, 2018. "How well is the museum performing? A joint use of DEA and BSC to measure the performance of museums," Omega, Elsevier, vol. 81(C), pages 67-84.
    13. Chun, Dongphil & Hong, Sungjun & Chung, Yanghon & Woo, Chungwon & Seo, Hangyeol, 2016. "Influencing factors on hydrogen energy R&D projects: An ex-post performance evaluation," Renewable and Sustainable Energy Reviews, Elsevier, vol. 53(C), pages 1252-1258.
    14. Ekaterina Makarova & Anna Sokolova, 2012. "Foresight Evaluation: Lessons from Project Management," HSE Working papers WP BRP 01/MAN/2012, National Research University Higher School of Economics.
    15. Mathias Scheiblich & Mihaela Maftei & Vanessa Just & Michael Studeny, 2017. "Developing a Project Scorecard to Measure the Performance of Project Management in Relation to EFQM Excellence Model," The AMFITEATRU ECONOMIC journal, Academy of Economic Studies - Bucharest, Romania, vol. 19(S11), pages 966-966.
    16. Madjid Tavana & Kaveh Khalili-Damghani & Rahman Rahmatian, 2015. "A hybrid fuzzy MCDM method for measuring the performance of publicly held pharmaceutical companies," Annals of Operations Research, Springer, vol. 226(1), pages 589-621, March.
    17. Madjid Tavana & Kaveh Khalili-Damghani & Amir-Reza Abtahi, 2013. "A fuzzy multidimensional multiple-choice knapsack model for project portfolio selection using an evolutionary algorithm," Annals of Operations Research, Springer, vol. 206(1), pages 449-483, July.
    18. Zervopoulos, Panagiotis D. & Brisimi, Theodora S. & Emrouznejad, Ali & Cheng, Gang, 2016. "Performance measurement with multiple interrelated variables and threshold target levels: Evidence from retail firms in the US," European Journal of Operational Research, Elsevier, vol. 250(1), pages 262-272.
    19. Amado, Carla A.F. & Santos, Sérgio P. & Marques, Pedro M., 2012. "Integrating the Data Envelopment Analysis and the Balanced Scorecard approaches for enhanced performance assessment," Omega, Elsevier, vol. 40(3), pages 390-403.
    20. Ekaterina Makarova & Anna Sokolova, 2012. "The Best Practices of Evaluating S&T Foresight: Basic Elements and Key Criteria," Foresight and STI Governance (Foresight-Russia till No. 3/2015), National Research University Higher School of Economics, vol. 6(3), pages 62-74.
    21. Vanhoucke, Mario, 2010. "Using activity sensitivity and network topology information to monitor project time performance," Omega, Elsevier, vol. 38(5), pages 359-370, October.
    22. Felicia Alina Dinu, 2017. "The Architecture of a Decision Support Software System for Sustainable Projects Selection," Global Economic Observer, "Nicolae Titulescu" University of Bucharest, Faculty of Economic Sciences;Institute for World Economy of the Romanian Academy, vol. 5(1), June.
    23. Lu, Wen-Min & Kweh, Qian Long & Nourani, Mohammad & Huang, Feng-Wen, 2016. "Evaluating the efficiency of dual-use technology development programs from the R&D and socio-economic perspectives," Omega, Elsevier, vol. 62(C), pages 82-92.
    24. Wu, Cheng-Ru & Lin, Chin-Tsai & Tsai, Pei-Hsuan, 2010. "Evaluating business performance of wealth management banks," European Journal of Operational Research, Elsevier, vol. 207(2), pages 971-979, December.
    25. García-Valderrama, Teresa & Mulero-Mendigorri, Eva & Revuelta-Bordoy, Daniel, 2009. "Relating the perspectives of the balanced scorecard for R&D by means of DEA," European Journal of Operational Research, Elsevier, vol. 196(3), pages 1177-1189, August.


    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jomega:v:36:y:2008:i:5:p:895-912. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Haili He). General contact details of provider: .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.