IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v42y2013i6p1239-1250.html
   My bibliography  Save this article

You can’t manage right what you can’t measure well: Technological innovation efficiency

Author

Listed:
  • Cruz-Cázares, Claudio
  • Bayona-Sáez, Cristina
  • García-Marco, Teresa

Abstract

This paper proposes a new approach to tackle the innovation–performance relationship. It addresses the, so far, mixed and inconclusive results of studies analyzing this relationship. We argue that the undifferentiated use of innovation inputs and outputs to measure firm innovativeness is not without problems, and that, from a productive perspective, they should be simultaneously analyzed. This study follows a two-stage empirical analysis using a sample of Spanish manufacturing firms for the period 1992–2005. By examining two inputs and two outputs of the innovation process in the first stage, we estimate technological innovation efficiency by means of an intertemporal data envelopment analysis (DEA) bootstrap and also observe the yearly efficiency changes based on a global Malmquist index. In the second stage we analyze the effect of technological innovation efficiency on firm performance through a generalized method of moments (GMM) system. The results support our arguments that the best measurement of outcomes of technological innovations is through the efficiency with which they are developed. In addition, we test the moderating effect of technological intensity level and firm size on the efficiency–performance relationship.

Suggested Citation

  • Cruz-Cázares, Claudio & Bayona-Sáez, Cristina & García-Marco, Teresa, 2013. "You can’t manage right what you can’t measure well: Technological innovation efficiency," Research Policy, Elsevier, vol. 42(6), pages 1239-1250.
    • Handle: RePEc:eee:respol:v:42:y:2013:i:6:p:1239-1250
    DOI: 10.1016/j.respol.2013.03.012
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0048733313000681
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.respol.2013.03.012?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Léopold Simar & Paul Wilson, 2000. "Statistical Inference in Nonparametric Frontier Models: The State of the Art," Journal of Productivity Analysis, Springer, vol. 13(1), pages 49-78, January.
    2. David J. TEECE, 2008. "Profiting from technological innovation: Implications for integration, collaboration, licensing and public policy," World Scientific Book Chapters, in: The Transfer And Licensing Of Know-How And Intellectual Property Understanding the Multinational Enterprise in the Modern World, chapter 5, pages 67-87, World Scientific Publishing Co. Pte. Ltd..
    3. repec:fth:harver:1473 is not listed on IDEAS
    4. Cohen, Wesley M. & Levin, Richard C., 1989. "Empirical studies of innovation and market structure," Handbook of Industrial Organization, in: R. Schmalensee & R. Willig (ed.), Handbook of Industrial Organization, edition 1, volume 2, chapter 18, pages 1059-1107, Elsevier.
    5. Charles Ian Mead, 2007. "R&D Depreciation Rates in the 2007 R&D Satellite Account," BEA Papers 0084, Bureau of Economic Analysis.
    6. Liao, Tung-Shan & Rice, John, 2010. "Innovation investments, market engagement and financial performance: A study among Australian manufacturing SMEs," Research Policy, Elsevier, vol. 39(1), pages 117-125, February.
    7. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    8. Cohen, Wesley M & Klepper, Steven, 1996. "Firm Size and the Nature of Innovation within Industries: The Case of Process and Product R&D," The Review of Economics and Statistics, MIT Press, vol. 78(2), pages 232-243, May.
    9. Christopher F Baum, 2006. "An Introduction to Modern Econometrics using Stata," Stata Press books, StataCorp LP, number imeus, March.
    10. Zvi Griliches, 1998. "Issues in Assessing the Contribution of Research and Development to Productivity Growth," NBER Chapters, in: R&D and Productivity: The Econometric Evidence, pages 17-45, National Bureau of Economic Research, Inc.
    11. Diaz-Balteiro, Luis & Casimiro Herruzo, A. & Martinez, Margarita & Gonzalez-Pachon, Jacinto, 2006. "An analysis of productive efficiency and innovation activity using DEA: An application to Spain's wood-based industry," Forest Policy and Economics, Elsevier, vol. 8(7), pages 762-773, October.
    12. Caves, Douglas W & Christensen, Laurits R & Diewert, W Erwin, 1982. "The Economic Theory of Index Numbers and the Measurement of Input, Output, and Productivity," Econometrica, Econometric Society, vol. 50(6), pages 1393-1414, November.
    13. Lichtenthaler, Ulrich, 2010. "Determinants of proactive and reactive technology licensing: A contingency perspective," Research Policy, Elsevier, vol. 39(1), pages 55-66, February.
    14. Coad, Alex & Rao, Rekha, 2008. "Innovation and firm growth in high-tech sectors: A quantile regression approach," Research Policy, Elsevier, vol. 37(4), pages 633-648, May.
    15. Frantz, Roger, 1992. "X-Efficiency and Allocative Efficiency: What Have We Learned?," American Economic Review, American Economic Association, vol. 82(2), pages 434-438, May.
    16. Koellinger, Philipp, 2008. "The relationship between technology, innovation, and firm performance--Empirical evidence from e-business in Europe," Research Policy, Elsevier, vol. 37(8), pages 1317-1328, September.
    17. Pablo Arocena & Ariadna García‐Prado, 2007. "Accounting for quality in the measurement of hospital performance: evidence from Costa Rica," Health Economics, John Wiley & Sons, Ltd., vol. 16(7), pages 667-685, July.
    18. Santamara, Llus & Nieto, Mara Jess & Barge-Gil, Andrs, 2009. "Beyond formal R&D: Taking advantage of other sources of innovation in low- and medium-technology industries," Research Policy, Elsevier, vol. 38(3), pages 507-517, April.
    19. George, Gerard & Zahra, Shaker A. & Wood, D. Jr., 2002. "The effects of business-university alliances on innovative output and financial performance: a study of publicly traded biotechnology companies," Journal of Business Venturing, Elsevier, vol. 17(6), pages 577-609, October.
    20. Brown, Rayna, 2006. "Mismanagement or mismeasurement? Pitfalls and protocols for DEA studies in the financial services sector," European Journal of Operational Research, Elsevier, vol. 174(2), pages 1100-1116, October.
    21. Arellano, Manuel & Bover, Olympia, 1995. "Another look at the instrumental variable estimation of error-components models," Journal of Econometrics, Elsevier, vol. 68(1), pages 29-51, July.
    22. Vittorio Chiesa & Federico Frattini, 2009. "Evaluation and Performance Measurement of Research and Development," Books, Edward Elgar Publishing, number 13173.
    23. Mario I. Kafouros, 2008. "Industrial Innovation and Firm Performance," Books, Edward Elgar Publishing, number 12687.
    24. Weerawardena, Jay & O'Cass, Aron & Julian, Craig, 2006. "Does industry matter? Examining the role of industry structure and organizational learning in innovation and brand performance," Journal of Business Research, Elsevier, vol. 59(1), pages 37-45, January.
    25. Wang, Eric C. & Huang, Weichiao, 2007. "Relative efficiency of R&D activities: A cross-country study accounting for environmental factors in the DEA approach," Research Policy, Elsevier, vol. 36(2), pages 260-273, March.
    26. Guan, Jian Cheng & Yam, Richard C.M. & Mok, Chiu Kam & Ma, Ning, 2006. "A study of the relationship between competitiveness and technological innovation capability based on DEA models," European Journal of Operational Research, Elsevier, vol. 170(3), pages 971-986, May.
    27. Zvi Griliches, 1998. "Productivity and R&D at the Firm Level," NBER Chapters, in: R&D and Productivity: The Econometric Evidence, pages 100-133, National Bureau of Economic Research, Inc.
    28. Yamin, Shahid & Mavondo, Felix & Gunasekaran, A & Sarros, James C., 1997. "A study of competitive strategy, organisational innovation and organisational performance among Australian manufacturing companies," International Journal of Production Economics, Elsevier, vol. 52(1-2), pages 161-172, October.
    29. Zvi Griliches, 1984. "R&D, Patents, and Productivity," NBER Books, National Bureau of Economic Research, Inc, number gril84-1, March.
    30. Hashimoto, Akihiro & Haneda, Shoko, 2008. "Measuring the change in R&D efficiency of the Japanese pharmaceutical industry," Research Policy, Elsevier, vol. 37(10), pages 1829-1836, December.
    31. Blundell, Richard & Bond, Stephen, 1998. "Initial conditions and moment restrictions in dynamic panel data models," Journal of Econometrics, Elsevier, vol. 87(1), pages 115-143, August.
    32. Koellinger, Ph.D., 2008. "The Relationship between Technology, Innovation, and Firm Performance: Empirical Evidence on E-Business in Europe," ERIM Report Series Research in Management ERS-2008-031-ORG, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
    33. Zvi Griliches, 1998. "Patent Statistics as Economic Indicators: A Survey," NBER Chapters, in: R&D and Productivity: The Econometric Evidence, pages 287-343, National Bureau of Economic Research, Inc.
    34. Wang, Eric C., 2007. "R&D efficiency and economic performance: A cross-country analysis using the stochastic frontier approach," Journal of Policy Modeling, Elsevier, vol. 29(2), pages 345-360.
    35. Jiann-Chyuan Wang & Kuen-Hung Tsai, 2003. "Productivity Growth and R&D Expenditure in Taiwan's Manufacturing Firms," NBER Working Papers 9724, National Bureau of Economic Research, Inc.
    36. Hall, Bronwyn H & Ziedonis, Rosemarie Ham, 2001. "The Patent Paradox Revisited: An Empirical Study of Patenting in the U.S. Semiconductor Industry, 1979-1995," RAND Journal of Economics, The RAND Corporation, vol. 32(1), pages 101-128, Spring.
    37. Zhong, Wei & Yuan, Wei & Li, Susan X. & Huang, Zhimin, 2011. "The performance evaluation of regional R&D investments in China: An application of DEA based on the first official China economic census data," Omega, Elsevier, vol. 39(4), pages 447-455, August.
    38. Haas, David A. & Murphy, Frederic H., 2003. "Compensating for non-homogeneity in decision-making units in data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 144(3), pages 530-544, February.
    39. Kortum, Samuel & Lerner, Josh, 1999. "What is behind the recent surge in patenting?1," Research Policy, Elsevier, vol. 28(1), pages 1-22, January.
    40. Chun-Hsien Wang & Jun-Yen Lee & Yi-Hua Chang, 2012. "Measuring productivity in the biotechnology industry using the global Malmquist index," Applied Economics Letters, Taylor & Francis Journals, vol. 19(9), pages 807-812, June.
    41. Lichtenberg, Frank R, 1984. "The Relationship between Federal Contract R&D and Company R&D," American Economic Review, American Economic Association, vol. 74(2), pages 73-78, May.
    42. Kamien,Morton I. & Schwartz,Nancy L., 1982. "Market Structure and Innovation," Cambridge Books, Cambridge University Press, number 9780521293853, December.
    43. Alvarez, Roberto & Crespi, Gustavo, 2003. "Determinants of Technical Efficiency in Small Firms," Small Business Economics, Springer, vol. 20(3), pages 233-244, May.
    44. Mario Kafouros, 2005. "R&D and productivity growth: Evidence from the UK," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 14(6), pages 479-497.
    45. Vikas Mittal & Eugene W. Anderson & Akin Sayrak & Pandu Tadikamalla, 2005. "Dual Emphasis and the Long-Term Financial Impact of Customer Satisfaction," Marketing Science, INFORMS, vol. 24(4), pages 544-555, August.
    46. Frans A. J. Van den Bosch & Henk W. Volberda & Michiel de Boer, 1999. "Coevolution of Firm Absorptive Capacity and Knowledge Environment: Organizational Forms and Combinative Capabilities," Organization Science, INFORMS, vol. 10(5), pages 551-568, October.
    47. Bayona-Sáez, Cristina & García-Marco, Teresa, 2010. "Assessing the effectiveness of the Eureka Program," Research Policy, Elsevier, vol. 39(10), pages 1375-1386, December.
    48. Windmeijer, Frank, 2005. "A finite sample correction for the variance of linear efficient two-step GMM estimators," Journal of Econometrics, Elsevier, vol. 126(1), pages 25-51, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yang, Lihong & Wang, Shixun, 2022. "Do fintech applications promote regional innovation efficiency? Empirical evidence from China," Socio-Economic Planning Sciences, Elsevier, vol. 83(C).
    2. Weihua Su & Zhen Wang & Chonghui Zhang & Tomas Balezentis, 2023. "Determinants of the innovation efficiency of strategic emerging enterprises: evidence from the robust frontiers," Economic Change and Restructuring, Springer, vol. 56(3), pages 1433-1465, June.
    3. Kou, Mingting & Yang, Yuanqi & Chen, Kaihua, 2020. "The impact of external R&D financing on innovation process from a supply-demand perspective," Economic Modelling, Elsevier, vol. 92(C), pages 375-387.
    4. Jing Feng & Longlong Geng & Hui Liu & Xuehua Zhang, 2022. "RETRACTED ARTICLE: Efficiency evaluation of the high-tech industry chain with a two-stage data envelopment analysis approach," Operations Management Research, Springer, vol. 15(3), pages 1071-1080, December.
    5. Zhang, Liangliang & Huang, Shoujun, 2022. "Social capital and regional innovation efficiency: The moderating effect of governance quality," Structural Change and Economic Dynamics, Elsevier, vol. 62(C), pages 343-359.
    6. Pradhan, Rudra P. & Arvin, Mak B. & Bahmani, Sahar & Bennett, Sara E., 2017. "The innovation- growth link in OECD countries: Could other macroeconomic variables matter?," Technology in Society, Elsevier, vol. 51(C), pages 113-123.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cohen, Wesley M., 2010. "Fifty Years of Empirical Studies of Innovative Activity and Performance," Handbook of the Economics of Innovation, in: Bronwyn H. Hall & Nathan Rosenberg (ed.), Handbook of the Economics of Innovation, edition 1, volume 1, chapter 0, pages 129-213, Elsevier.
    2. Montresor, Sandro & Vezzani, Antonio, 2015. "The production function of top R&D investors: Accounting for size and sector heterogeneity with quantile estimations," Research Policy, Elsevier, vol. 44(2), pages 381-393.
    3. Hall, Bronwyn H. & Mairesse, Jacques & Mohnen, Pierre, 2010. "Measuring the Returns to R&D," Handbook of the Economics of Innovation, in: Bronwyn H. Hall & Nathan Rosenberg (ed.), Handbook of the Economics of Innovation, edition 1, volume 2, chapter 0, pages 1033-1082, Elsevier.
    4. Halkos, George & Tzeremes, Nickolaos, 2011. "The effect of national culture on countries’ innovation efficiency," MPRA Paper 30100, University Library of Munich, Germany.
    5. Vassilis Kanellopoulos & Kostas Tsekouras, 2023. "Innovation efficiency and firm performance in a benchmarking context," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 44(1), pages 137-151, January.
    6. Lee, Jiyoung & Kim, Chulyeon & Choi, Gyunghyun, 2019. "Exploring data envelopment analysis for measuring collaborated innovation efficiency of small and medium-sized enterprises in Korea," European Journal of Operational Research, Elsevier, vol. 278(2), pages 533-545.
    7. Kafouros, Mario I. & Buckley, Peter J., 2008. "Under what conditions do firms benefit from the research efforts of other organizations?," Research Policy, Elsevier, vol. 37(2), pages 225-239, March.
    8. Bettina Becker, 2013. "The Determinants of R&D Investment: A Survey of the Empirical Research," Discussion Paper Series 2013_09, Department of Economics, Loughborough University, revised Sep 2013.
    9. Kafouros, Mario I., 2008. "Economic returns to industrial research," Journal of Business Research, Elsevier, vol. 61(8), pages 868-876, August.
    10. Chiang-Ping Chen & Jin-Li Hu & Chih-Hai Yang, 2013. "Produce patents or journal articles? A cross-country comparison of R&D productivity change," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(3), pages 833-849, March.
    11. Annita Nugent & Ho Fai Chan & Uwe Dulleck, 2022. "Government funding of university-industry collaboration: exploring the impact of targeted funding on university patent activity," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 29-73, January.
    12. de Rassenfosse, Gaetan & van Pottelsberghe de la Potterie, Bruno, 2009. "A policy insight into the R&D-patent relationship," Research Policy, Elsevier, vol. 38(5), pages 779-792, June.
    13. Baumann, Julian & Kritikos, Alexander S., 2016. "The link between R&D, innovation and productivity: Are micro firms different?," Research Policy, Elsevier, vol. 45(6), pages 1263-1274.
    14. Ester Martínez Ros & Vicente Salas Fumás, "undated". "The effect of innovation activity on innovating quasi-rents: an empirical application," Studies on the Spanish Economy 03, FEDEA.
    15. Michele Cincera & Reinhilde Veugelers, 2013. "Exploring Europe's R&D deficit relative to the US: Differences in the rates of return to R&D of young leading R&D firms," Working Papers TIMES² 2013 - 001, ULB -- Universite Libre de Bruxelles.
    16. Puertas, Rosa & Marti, Luisa & Guaita-Martinez, José M., 2020. "Innovation, lifestyle, policy and socioeconomic factors: An analysis of European quality of life," Technological Forecasting and Social Change, Elsevier, vol. 160(C).
    17. Chen Kaihua & Kou Mingting, 2014. "Staged efficiency and its determinants of regional innovation systems: a two-step analytical procedure," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 52(2), pages 627-657, March.
    18. Hasan, Iftekhar & Tucci, Christopher L., 2010. "The innovation-economic growth nexus: Global evidence," Research Policy, Elsevier, vol. 39(10), pages 1264-1276, December.
    19. Silverio Alarcón & Mercedes Sánchez, 2013. "External and Internal R&D, Capital Investment and Business Performance in the Spanish Agri-Food Industry," Journal of Agricultural Economics, Wiley Blackwell, vol. 64(3), pages 654-675, September.
    20. Wang, Qunwei & Hang, Ye & Sun, Licheng & Zhao, Zengyao, 2016. "Two-stage innovation efficiency of new energy enterprises in China: A non-radial DEA approach," Technological Forecasting and Social Change, Elsevier, vol. 112(C), pages 254-261.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:42:y:2013:i:6:p:1239-1250. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/respol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.