IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Log in (now much improved!) to save this article

Measurement and determinants of academic research efficiency: a systematic review of the evidence

Listed author(s):
  • Mehdi Rhaiem

    ()

    (Laval University)

Registered author(s):

    Abstract What is academic research efficiency and what determines the differences between scholars’ academic research efficiency? The literature on this topic has evolved exponentially during the last decades. However, the divergence of the approaches used, the differences in the bundles of outputs and inputs considered to estimate the efficiency frontiers, and the differences in the predictors of efficiency variability among scholars that are considered in prior studies, make it interesting to have an overview of the literature dedicated to this topic. Relying on a systematic review of empirical studies published between 1990 and 2012, this article proposes and discusses a framework which brings together a set of outputs and inputs related to academic research efficiency, and the individual, organizational, and contextual factors driving or hampering it. The ensuing results highlight several avenues which would help university administrators and policy makers to better foster academic research efficiency, and researchers to better channel their efforts in studying the phenomenon.

    If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

    File URL: http://link.springer.com/10.1007/s11192-016-2173-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.

    Article provided by Springer & Akadémiai Kiadó in its journal Scientometrics.

    Volume (Year): 110 (2017)
    Issue (Month): 2 (February)
    Pages: 581-615

    as
    in new window

    Handle: RePEc:spr:scient:v:110:y:2017:i:2:d:10.1007_s11192-016-2173-1
    DOI: 10.1007/s11192-016-2173-1
    Contact details of provider: Web page: http://www.springer.com

    Web page: http://akkrt.hu/

    Order Information: Web: http://www.springer.com/economics/journal/11192

    References listed on IDEAS
    Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

    as
    in new window


    1. J. Glass & Donal McKillop & Gary O'Rourke, 1998. "A Cost Indirect Evaluation of Productivity Change in UK Universities," Journal of Productivity Analysis, Springer, vol. 10(2), pages 153-175, October.
    2. Etzkowitz, Henry & Leydesdorff, Loet, 2000. "The dynamics of innovation: from National Systems and "Mode 2" to a Triple Helix of university-industry-government relations," Research Policy, Elsevier, vol. 29(2), pages 109-123, February.
    3. Johnes, Jill & Yu, Li, 2008. "Measuring the research performance of Chinese higher education institutions using data envelopment analysis," China Economic Review, Elsevier, vol. 19(4), pages 679-696, December.
    4. Johnes, Geraint & Johnes, Jill, 1993. "Measuring the Research Performance of UK Economics Departments: An Application of Data Envelopment Analysis," Oxford Economic Papers, Oxford University Press, vol. 45(2), pages 332-347, April.
    5. Landry, Réjean & Saïhi, Malek & Amara, Nabil & Ouimet, Mathieu, 2010. "Evidence on how academics manage their portfolio of knowledge transfer activities," Research Policy, Elsevier, vol. 39(10), pages 1387-1403, December.
    6. Philip Andrew Stevens, 2005. "A Stochastic Frontier Analysis of English and Welsh Universities," Education Economics, Taylor & Francis Journals, vol. 13(4), pages 355-374.
    7. Schubert, Torben, 2009. "Empirical observations on New Public Management to increase efficiency in public research--Boon or bane?," Research Policy, Elsevier, vol. 38(8), pages 1225-1234, October.
    8. Sueyoshi, Toshiyuki & Sekitani, Kazuyuki, 2005. "Returns to scale in dynamic DEA," European Journal of Operational Research, Elsevier, vol. 161(2), pages 536-544, March.
    9. Kocher, Martin G. & Luptacik, Mikulas & Sutter, Matthias, 2006. "Measuring productivity of research in economics: A cross-country study using DEA," Socio-Economic Planning Sciences, Elsevier, vol. 40(4), pages 314-332, December.
    10. Lutz Bornmann, 2014. "How are excellent (highly cited) papers defined in bibliometrics? A quantitative analysis of the literature," Research Evaluation, Oxford University Press, vol. 23(2), pages 166-173.
    11. Antreas Athanassopoulos & Estelle Shale, 1997. "Assessing the Comparative Efficiency of Higher Education Institutions in the UK by the Means of Data Envelopment Analysis," Education Economics, Taylor & Francis Journals, vol. 5(2), pages 117-134.
    12. Cherchye, L. & Abeele, P. Vanden, 2005. "On research efficiency: A micro-analysis of Dutch university research in Economics and Business Management," Research Policy, Elsevier, vol. 34(4), pages 495-516, May.
    13. Malcolm Abbott & Chris Doucouliagos, 2009. "Competition and efficiency: overseas students and technical efficiency in Australian and New Zealand universities," Education Economics, Taylor & Francis Journals, vol. 17(1), pages 31-57.
    14. Gerhard Kempkes & Carsten Pohl, 2010. "The efficiency of German universities-some evidence from nonparametric and parametric methods," Applied Economics, Taylor & Francis Journals, vol. 42(16), pages 2063-2079.
    15. Johnes, Geraint, 1992. "Performance Indicators in Higher Education: A Survey of Recent Work," Oxford Review of Economic Policy, Oxford University Press, vol. 8(2), pages 19-34, Summer.
    16. Izadi, Hooshang & Johnes, Geraint & Oskrochi, Reza & Crouchley, Robert, 2002. "Stochastic frontier estimation of a CES cost function: the case of higher education in Britain," Economics of Education Review, Elsevier, vol. 21(1), pages 63-71, February.
    17. Lu, Wen-Min, 2012. "Intellectual capital and university performance in Taiwan," Economic Modelling, Elsevier, vol. 29(4), pages 1081-1089.
    18. Merja Halme & Tarja Joro & Pekka Korhonen & Seppo Salo & Jyrki Wallenius, 1999. "A Value Efficiency Approach to Incorporating Preference Information in Data Envelopment Analysis," Management Science, INFORMS, vol. 45(1), pages 103-115, January.
    19. Vincent Mok & Godfrey Yeung, 2005. "Employee motivation, external orientation and the technical efficiency of foreign-financed firms in China: a stochastic frontier analysis," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 26(3), pages 175-190.
    20. Colin Glass, J. & McCallion, Gillian & McKillop, Donal G. & Rasaratnam, Syamarlah & Stringer, Karl S., 2006. "Implications of variant efficiency measures for policy evaluations in UK higher education," Socio-Economic Planning Sciences, Elsevier, vol. 40(2), pages 119-142, June.
    21. Guan, Jiancheng & Chen, Kaihua, 2012. "Modeling the relative efficiency of national innovation systems," Research Policy, Elsevier, vol. 41(1), pages 102-115.
    22. Worthington, Andrew C. & Lee, Boon L., 2008. "Efficiency, technology and productivity change in Australian universities, 1998-2003," Economics of Education Review, Elsevier, vol. 27(3), pages 285-298, June.
    23. Tommaso Agasisti & Carsten Pohl, 2012. "Comparing German and Italian Public Universities: Convergence or Divergence in the Higher Education Landscape?," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 33, pages 71-85, March.
    24. Cinzia Daraio & Léopold Simar, 2005. "Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic Approach," Journal of Productivity Analysis, Springer, vol. 24(1), pages 93-121, September.
    25. Emma Medin & Kjartan Anthun & Unto Häkkinen & Sverre Kittelsen & Miika Linna & Jon Magnussen & Kim Olsen & Clas Rehnberg, 2011. "Cost efficiency of university hospitals in the Nordic countries: a cross-country analysis," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 12(6), pages 509-519, December.
    26. Avkiran, Necmi K., 2001. "Investigating technical and scale efficiencies of Australian Universities through data envelopment analysis," Socio-Economic Planning Sciences, Elsevier, vol. 35(1), pages 57-80, March.
    27. Henry Tulkens, 1993. "On FDH efficiency analysis: Some methodological issues and applications to retail banking, courts, and urban transit," Journal of Productivity Analysis, Springer, vol. 4(1), pages 183-210, June.
    28. Yixin Dai & David Popp & Stuart Bretschneider, 2005. "Institutions and intellectual property: The influence of institutional forces on university patenting," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 24(3), pages 579-598.
    29. Hugo Horta & T Austin Lacy, 2011. "How does size matter for science? Exploring the effects of research unit size on academics' scientific productivity and information exchange behaviors," Science and Public Policy, Oxford University Press, vol. 38(6), pages 449-460, July.
    30. Niels Christian Petersen, 1990. "Data Envelopment Analysis on a Relaxed Set of Assumptions," Management Science, INFORMS, vol. 36(3), pages 305-314, March.
    31. Albert N. Link & Donald S. Siegel & Barry Bozeman, 2007. "An empirical analysis of the propensity of academics to engage in informal university technology transfer ," Industrial and Corporate Change, Oxford University Press, vol. 16(4), pages 641-655, August.
    32. repec:ebl:ecbull:v:4:y:2007:i:15:p:1-9 is not listed on IDEAS
    33. John Robst, 2000. "Do state appropriations influence cost efficiency in public higher education?," Applied Economics Letters, Taylor & Francis Journals, vol. 7(11), pages 715-719.
    34. Kao, Chiang & Hung, Hsi-Tai, 2008. "Efficiency analysis of university departments: An empirical study," Omega, Elsevier, vol. 36(4), pages 653-664, August.
    35. Johnes, Geraint & Johnes, Jill, 2009. "Higher education institutions' costs and efficiency: Taking the decomposition a further step," Economics of Education Review, Elsevier, vol. 28(1), pages 107-113, February.
    36. Tommaso Agasisti & Carlo Salerno, 2007. "Assessing the Cost Efficiency of Italian Universities," Education Economics, Taylor & Francis Journals, vol. 15(4), pages 455-471.
    37. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    38. Abel A. Moreno & Raghu Tadepalli, 2002. "Assessing academic department efficiency at a public university," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 23(7), pages 385-397.
    39. Albert Link & Donald Siegel, 2005. "Generating science-based growth: an econometric analysis of the impact of organizational incentives on university-industry technology transfer," The European Journal of Finance, Taylor & Francis Journals, vol. 11(3), pages 169-181.
    40. Coccia, Mario, 2008. "Measuring scientific performance of public research units for strategic change," Journal of Informetrics, Elsevier, vol. 2(3), pages 183-194.
    41. G. Thomas Sav, 2012. "Stochastic Cost Inefficiency Estimates and Rankings of Public and Private Research and Doctoral Granting Universities," Journal of Knowledge Management, Economics and Information Technology, ScientificPapers.org, vol. 2(3), pages 1-13, June.
    42. Littell, Julia H., 2008. "Evidence-based or biased? The quality of published reviews of evidence-based practices," Children and Youth Services Review, Elsevier, vol. 30(11), pages 1299-1317, November.
    43. Heinze, Thomas & Shapira, Philip & Rogers, Juan D. & Senker, Jacqueline M., 2009. "Organizational and institutional influences on creativity in scientific research," Research Policy, Elsevier, vol. 38(4), pages 610-623, May.
    44. Mensah, Yaw M. & Werner, Robert, 2003. "Cost efficiency and financial flexibility in institutions of higher education," Journal of Accounting and Public Policy, Elsevier, vol. 22(4), pages 293-323.
    45. Korhonen, Pekka & Tainio, Risto & Wallenius, Jyrki, 2001. "Value efficiency analysis of academic research," European Journal of Operational Research, Elsevier, vol. 130(1), pages 121-132, April.
    46. Nemoto, Jiro & Goto, Mika, 1999. "Dynamic data envelopment analysis: modeling intertemporal behavior of a firm in the presence of productive inefficiencies," Economics Letters, Elsevier, vol. 64(1), pages 51-56, July.
    47. Carayol, Nicolas & Matt, Mireille, 2006. "Individual and collective determinants of academic scientists' productivity," Information Economics and Policy, Elsevier, vol. 18(1), pages 55-72, March.
    48. Abbott, M. & Doucouliagos, C., 2003. "The efficiency of Australian universities: a data envelopment analysis," Economics of Education Review, Elsevier, vol. 22(1), pages 89-97, February.
    49. Meeusen, Wim & van den Broeck, Julien, 1977. "Efficiency Estimation from Cobb-Douglas Production Functions with Composed Error," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 18(2), pages 435-444, June.
    50. Tommaso Agasisti & Geraint Johnes, 2009. "Beyond frontiers: comparing the efficiency of higher education decision-making units across more than one country," Education Economics, Taylor & Francis Journals, vol. 17(1), pages 59-79.
    51. J. C. Glass & D. G. McKillop & G. O'Rourke, 2002. "Evaluating the productive performance of UK universities as cost-constrained revenue maximizers: an empirical analysis," Applied Economics, Taylor & Francis Journals, vol. 34(9), pages 1097-1108.
    52. Cohn, Elchanan & Rhine, Sherrie L W & Santos, Maria C, 1989. "Institutions of Higher Education as Multi-product Firms: Economies of Scale and Scope," The Review of Economics and Statistics, MIT Press, vol. 71(2), pages 284-290, May.
    53. George E. Halkos & Nickolaos G. Tzeremes & Stavros A. Kourtzidis, 2012. "Measuring Public Owned University Departments' Efficiency: A Bootstrapped DEA Approach," Journal of Economics and Econometrics, Economics and Econometrics Society, vol. 55(2), pages 1-24.
    54. Beasley, J. E., 1990. "Comparing university departments," Omega, Elsevier, vol. 18(2), pages 171-183.
    55. Johnes, Geraint, 1998. "The Costs of Multi-product Organizations and the Heuristic Evaluation of Industrial Structure," Socio-Economic Planning Sciences, Elsevier, vol. 32(3), pages 199-209, September.
    56. Kuo, Jenn-Shyong & Ho, Yi-Cheng, 2008. "The cost efficiency impact of the university operation fund on public universities in Taiwan," Economics of Education Review, Elsevier, vol. 27(5), pages 603-612, October.
    57. Korhonen, Pekka J. & Soleimani-damaneh, Majid & Wallenius, Jyrki, 2011. "Ratio-based RTS determination in weight-restricted DEA models," European Journal of Operational Research, Elsevier, vol. 215(2), pages 431-438, December.
    58. Melville L. McMillan & Debasish Datta, 1998. "The Relative Efficiencies of Canadian Universities: A DEA Perspective," Canadian Public Policy, University of Toronto Press, vol. 24(4), pages 485-511, December.
    59. Dietz, James S. & Bozeman, Barry, 2005. "Academic careers, patents, and productivity: industry experience as scientific and technical human capital," Research Policy, Elsevier, vol. 34(3), pages 349-367, April.
    60. Worthington, Andrew C. & Higgs, Helen, 2014. "Economies of scale and scope in Australian urban water utilities," Utilities Policy, Elsevier, vol. 31(C), pages 52-62.
    61. Jerry G. Thursby, 2000. "What Do We Say about Ourselves and What Does It Mean? Yet Another Look at Economics Department Research," Journal of Economic Literature, American Economic Association, vol. 38(2), pages 383-404, June.
    62. Léopold Simar & Paul W. Wilson, 1998. "Sensitivity Analysis of Efficiency Scores: How to Bootstrap in Nonparametric Frontier Models," Management Science, INFORMS, vol. 44(1), pages 49-61, January.
    63. Léopold Simar & Paul Wilson, 1999. "Of Course We Can Bootstrap DEA Scores! But Does It Mean Anything? Logic Trumps Wishful Thinking," Journal of Productivity Analysis, Springer, vol. 11(1), pages 93-97, February.
    64. Andrew Worthington, 2001. "An Empirical Survey of Frontier Efficiency Measurement Techniques in Education," Education Economics, Taylor & Francis Journals, vol. 9(3), pages 245-268.
    65. Gary Madden & Scott Savage & Steven Kemp, 1997. "Measuring Public Sector Efficiency: A Study of Economics Departments at Australian Universities," Education Economics, Taylor & Francis Journals, vol. 5(2), pages 153-168.
    66. Tommaso Agasisti & Geraint Johnes, 2010. "Heterogeneity and the evaluation of efficiency: the case of Italian universities," Applied Economics, Taylor & Francis Journals, vol. 42(11), pages 1365-1375.
    67. Maria Silva Portela & Pedro Borges & Emmanuel Thanassoulis, 2003. "Finding Closest Targets in Non-Oriented DEA Models: The Case of Convex and Non-Convex Technologies," Journal of Productivity Analysis, Springer, vol. 19(2), pages 251-269, April.
    68. Loren Tauer & Harold Fried & William Fry, 2007. "Measuring Efficiencies of Academic Departments within a College," Education Economics, Taylor & Francis Journals, vol. 15(4), pages 473-489.
    69. Geraint Johnes & Astrid Schwarzenberger, 2011. "Differences in cost structure and the evaluation of efficiency: the case of German universities," Education Economics, Taylor & Francis Journals, vol. 19(5), pages 487-499, January.
    70. Steve Bradley & Jill Johnes & Allan Little, 2010. "Measurement And Determinants Of Efficiency And Productivity In The Further Education Sector In England," Bulletin of Economic Research, Wiley Blackwell, vol. 62(1), pages 1-30, January.
    71. Pekka Korhonen & Mikko Syrjänen, 2005. "On the Interpretation of Value Efficiency," Journal of Productivity Analysis, Springer, vol. 24(2), pages 197-201, October.
    72. Johnes, Jill & Johnes, Geraint, 1995. "Research funding and performance in U.K. University Departments of Economics: A frontier analysis," Economics of Education Review, Elsevier, vol. 14(3), pages 301-314, September.
    73. Othman Joumady & Catherine Ris, 2005. "Performance in European higher education: A non-parametric production frontier approach," Education Economics, Taylor & Francis Journals, vol. 13(2), pages 189-205.
    74. Groot, Tom & Garcia-Valderrama, Teresa, 2006. "Research quality and efficiency: An analysis of assessments and management issues in Dutch economics and business research programs," Research Policy, Elsevier, vol. 35(9), pages 1362-1376, November.
    75. de Groot, Hans & McMahon, Walter W & Volkwein, J Fredericks, 1991. "The Cost Structure of American Research Universities," The Review of Economics and Statistics, MIT Press, vol. 73(3), pages 424-431, August.
    76. Wagner, Janet M. & Shimshak, Daniel G., 2007. "Stepwise selection of variables in data envelopment analysis: Procedures and managerial perspectives," European Journal of Operational Research, Elsevier, vol. 180(1), pages 57-67, July.
    77. Geraint Johnes & Manuel Salas-Velasco, 2007. "The Determinants Of Costs And Efficiencies Where Producers Are Heterogeneous: The Case Of Spanish Universities," Economics Bulletin, AccessEcon, vol. 4(15), pages 1-9.
    78. O. B. Olesen & N. C. Petersen, 1995. "Chance Constrained Efficiency Evaluation," Management Science, INFORMS, vol. 41(3), pages 442-457, March.
    79. Johnes, Jill, 2006. "Data envelopment analysis and its application to the measurement of efficiency in higher education," Economics of Education Review, Elsevier, vol. 25(3), pages 273-288, June.
    80. Abbas Valadkhani & Simon Ville, 2009. "Discipline-specific forecasting of research output in Australian universities," Applied Economics Letters, Taylor & Francis Journals, vol. 16(18), pages 1875-1880.
    81. Nikias Sarafoglou & Kingsley E. Haynes, 1996. "University productivity in Sweden: a demonstration and explanatory analysis for economics and business programs," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 30(3), pages 285-304.
    82. Tommaso Agasisti & Giuseppe Catalano & Paolo Landoni & Roberto Verganti, 2012. "Evaluating the performance of academic departments: an analysis of research-related output efficiency," Research Evaluation, Oxford University Press, vol. 21(1), pages 2-14, February.
    83. Vincent Larivière & Benoit Macaluso & Éric Archambault & Yves Gingras, 2010. "Which scientific elites? On the concentration of research funds, publications and citations," Research Evaluation, Oxford University Press, vol. 19(1), pages 45-53, March.
    84. Li, Yongjun & Chen, Yao & Liang, Liang & Xie, Jianhui, 2012. "DEA models for extended two-stage network structures," Omega, Elsevier, vol. 40(5), pages 611-618.
    85. Gerhard Kempkes, 2008. "Do Institutions Matter for University Cost Efficiency? Evidence from Germany," CESifo Economic Studies, CESifo, vol. 54(2), pages 177-203, June.
    86. A. T. Flegg & D. O. Allen & K. Field & T. W. Thurlow, 2004. "Measuring the efficiency of British universities: a multi-period data envelopment analysis," Education Economics, Taylor & Francis Journals, vol. 12(3), pages 231-249.
    87. NG, Ying Chu & LI, Sung-ko, 2009. "Efficiency and productivity growth in Chinese universities during the post-reform period," China Economic Review, Elsevier, vol. 20(2), pages 183-192, June.
    88. Abramo, Giovanni & Cicero, Tindaro & D’Angelo, Ciriaco Andrea, 2011. "A field-standardized application of DEA to national-scale research assessment of universities," Journal of Informetrics, Elsevier, vol. 5(4), pages 618-628.
    89. Melville McMillan & Wing Chan, 2006. "University Efficiency: A Comparison and Consolidation of Results from Stochastic and Non-stochastic Methods," Education Economics, Taylor & Francis Journals, vol. 14(1), pages 1-30.
    90. Bozeman, Barry & Corley, Elizabeth, 2004. "Scientists' collaboration strategies: implications for scientific and technical human capital," Research Policy, Elsevier, vol. 33(4), pages 599-616, May.
    91. Andrea Bonaccorsi & Cinzia Daraio, 2003. "A robust nonparametric approach to the analysis of scientific productivity," Research Evaluation, Oxford University Press, vol. 12(1), pages 47-69, April.
    92. Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
    93. Laure Latruffe & Sophia Davidova & Kelvin Balcombe, 2008. "Application of a double bootstrap to investigation of determinants of technical efficiency of farms in Central Europe," Journal of Productivity Analysis, Springer, vol. 29(2), pages 183-191, April.
    94. Roger Carrington & Tim Coelli & D. S. Prasada Rao, 2005. "The Performance Of Australian Universities: Conceptual Issues And Preliminary Results," Economic Papers, The Economic Society of Australia, vol. 24(2), pages 145-163, June.
    95. Battese, G E & Coelli, T J, 1995. "A Model for Technical Inefficiency Effects in a Stochastic Frontier Production Function for Panel Data," Empirical Economics, Springer, vol. 20(2), pages 325-332.
    96. Susanne Warning, 2004. "Performance Differences in German Higher Education: Empirical Analysis of Strategic Groups," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 24(4), pages 393-408, June.
    97. Aigner, Dennis & Lovell, C. A. Knox & Schmidt, Peter, 1977. "Formulation and estimation of stochastic frontier production function models," Journal of Econometrics, Elsevier, vol. 6(1), pages 21-37, July.
    98. Meng, Wei & Zhang, Daqun & Qi, Li & Liu, Wenbin, 2008. "Two-level DEA approaches in research evaluation," Omega, Elsevier, vol. 36(6), pages 950-957, December.
    99. Lucia Buzzigoli & Antonio Giusti & Alessandro Viviani, 2010. "The Evaluation of University Departments. A Case Study for Firenze," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 16(1), pages 24-38, February.
    Full references (including those not matched with items on IDEAS)

    This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

    When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:110:y:2017:i:2:d:10.1007_s11192-016-2173-1. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Sonal Shukla)

    or (Rebekah McClure)

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If references are entirely missing, you can add them using this form.

    If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.