Measuring Science: An Exploration
AbstractThis paper examines available U.S. data on academic R&D expenditures and the number of papers published and the number of citations to these papers as possible measures of `output' of this enterprise. We look at these numbers for science and engineering as a whole, for 5 selected major fields, and at the individual university-field level. The published data in Science and Engineering Indicators imply sharply diminishing returns to academic R&D using published papers as a 'output' measure. These data are problematic. Using a newer set of data on papers and citations, based on an `expanding' set changes the picture drastically, eliminating seemingly diminishing returns but raising the question of why input prices of academic R&D are rising so much faster than either the GDP deflator or the implicit R&D deflator in industry. A production function analysis of such data indicates significant diminishing returns to `own' R&D, with the R&D coefficients hovering around 0.5 for estimates with paper numbers as the dependent variable and around 0.6 if total citations are used. When we substitute scientists and engineers in place of R&D as the right hand side variables, the coefficient on papers rises from 0.5 to 0.8, and the coefficient on citations rises from 0.6 to 0.9, indicating systematic measurement problems with R&D as the sole input into the production of scientific output. But allowing for individual university-field effects drives these numbers down below unity. Since in the aggregate both paper numbers and citations are growing as fast or faster than R&D, this can be seen as leaving a major, yet unmeasured role, for the contribution of spill- overs from other fields, other universities, and other countries.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by National Bureau of Economic Research, Inc in its series NBER Working Papers with number 5478.
Date of creation: Jul 1997
Date of revision:
Contact details of provider:
Postal: National Bureau of Economic Research, 1050 Massachusetts Avenue Cambridge, MA 02138, U.S.A.
Web page: http://www.nber.org
More information through EDIRC
Other versions of this item:
- James Adams & Zvi Griliches, 1996. "Measuring Science: An Exploration," Harvard Institute of Economic Research Working Papers 1749, Harvard - Institute of Economic Research.
- O47 - Economic Development, Technological Change, and Growth - - Economic Growth and Aggregate Productivity - - - Measurement of Economic Growth; Aggregate Productivity; Cross-Country Output Convergence
- H40 - Public Economics - - Publicly Provided Goods - - - General
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Jorgenson, D.W. & Fraumeni, B.M., 1991.
"The Output Of The Education Sector,"
Harvard Institute of Economic Research Working Papers
1543, Harvard - Institute of Economic Research.
- Adams, James D, 1993.
"Science, R&D, and Invention Potential Recharge: U.S. Evidence,"
American Economic Review,
American Economic Association, vol. 83(2), pages 458-62, May.
- James D Adams, 1993. "Science, R&D, And Invention Potential Recharge: U.S. Evidence," Working Papers 93-2, Center for Economic Studies, U.S. Census Bureau.
- Richard C. Levin & Alvin K. Klevorick & Richard R. Nelson & Sidney G. Winter, 1987. "Appropriating the Returns from Industrial Research and Development," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 18(3), pages 783-832.
- Pardey, Philip G, 1989.
"The Agricultural Knowledge Production Function: An Empirical Look,"
The Review of Economics and Statistics,
MIT Press, vol. 71(3), pages 453-61, August.
- Pardey, Philip G., 1987. "The Agricultural Knowledge Production Function: An Empirical Look," Evaluating Agricultural Research and Productivity, Proceedings of a Workshop, Atlanta, Georgia, January 29-30, 1987, Miscellaneous Publication 52 50022, University of Minnesota, Agricultural Experiment Station.
- Richard C. Levin & Alvin K. Klevorick & Richard R. Nelson & Sidney G. Winter, 1988. "Appropriating the Returns from Industrial R&D," Cowles Foundation Discussion Papers 862, Cowles Foundation for Research in Economics, Yale University.
- Adams, James D, 1990. "Fundamental Stocks of Knowledge and Productivity Growth," Journal of Political Economy, University of Chicago Press, vol. 98(4), pages 673-702, August.
- Richard Nelson, 1962. "The Link Between Science and Invention: The Case of the Transistor," NBER Chapters, in: The Rate and Direction of Inventive Activity: Economic and Social Factors, pages 549-584 National Bureau of Economic Research, Inc.
- Mansfield, Edwin, 1991. "Academic research and industrial innovation," Research Policy, Elsevier, vol. 20(1), pages 1-12, February.
- Zvi Griliches, 1958. "Research Costs and Social Returns: Hybrid Corn and Related Innovations," Journal of Political Economy, University of Chicago Press, vol. 66, pages 419.
- Rosenberg, Nathan & Nelson, Richard R., 1994. "American universities and technical advance in industry," Research Policy, Elsevier, vol. 23(3), pages 323-348, May.
- Zvi Griliches, 1998.
"Productivity, R&D, and the Data Constraint,"
in: R&D and Productivity: The Econometric Evidence, pages 347-374
National Bureau of Economic Research, Inc.
- Paula E. Stephan, 1996. "The Economics of Science," Journal of Economic Literature, American Economic Association, vol. 34(3), pages 1199-1235, September.
- Weisbrod, Burton A, 1971. "Costs and Benefits of Medical Research: A Case Study of Poliomyelitis," Journal of Political Economy, University of Chicago Press, vol. 79(3), pages 527-44, May-June.
- Saul Lach & Mark Schankerman, 2008.
"Incentives and invention in universities,"
RAND Journal of Economics,
RAND Corporation, vol. 39(2), pages 403-433.
- Saul Lach & Mark Schankerman, 2004. "Incentives and Invention in Universities," STICERD - Economics of Industry Papers 33, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE.
- Lach, Saul & Schankerman, Mark, 2003. "Incentives and Invention in Universities," CEPR Discussion Papers 3916, C.E.P.R. Discussion Papers.
- Saul Lach & Mark Schankerman, 2006. "Incentives and Invention in Universities," CEP Discussion Papers dp0729, Centre for Economic Performance, LSE.
- Saul Lach & Mark Schankerman, 2003. "Incentives and Invention in Universities," NBER Working Papers 9727, National Bureau of Economic Research, Inc.
- Hinloopen, Jeroen & Smrkolj, Grega & Wagener, Florian, 2013.
"From mind to market: A global, dynamic analysis of R&D,"
Journal of Economic Dynamics and Control,
Elsevier, vol. 37(12), pages 2729-2754.
- Hinloopen, J. & Smrkolj, G. & Wagener, F.O.O., 2011. "From Mind to Market: A Global, Dynamic Analysis of R&D," CeNDEF Working Papers 11-11, Universiteit van Amsterdam, Center for Nonlinear Dynamics in Economics and Finance.
- Jeroen Hinloopen & Grega Smrkolj & Florian Wagener, 2011. "From Mind to Market: A Global, Dynamic Analysis of R&D," Tinbergen Institute Discussion Papers 11-139/1, Tinbergen Institute.
- Yann Kossi & Jean-Yves Lesueur & Mareva Sabatier, 2013.
"Publish or Teach ? The Role of the Scientific Environment on Academics' Multitasking,"
- Yann Kossi & Jean-Yves Lesueur & Mareva Sabatier, 2013. "Publish or Teach? The Role of the Scientific Environment on Academics' Multitasking," Working Papers hal-00825980, HAL.
- Yann Kossi & Jean-Yves Lesueur & Mareva Sabatier, 2013. "Publish or Teach ? The Role of the Scientific Environment on Academics’ Multitasking," Working Papers 1315, Groupe d'Analyse et de Théorie Economique (GATE), Centre national de la recherche scientifique (CNRS), Université Lyon 2, Ecole Normale Supérieure.
- Paul Heisey & Sarah Adelman, 2011. "Research expenditures, technology transfer activity, and university licensing revenue," The Journal of Technology Transfer, Springer, vol. 36(1), pages 38-60, February.
- Stefano Breschi & Francesco Lissoni & Fabio Montobbio, 2006. "University patenting and scientific productivity. A quantitative study of Italian academic inventors," KITeS Working Papers 189, KITeS, Centre for Knowledge, Internationalization and Technology Studies, Universita' Bocconi, Milano, Italy, revised Nov 2006.
- Arthur Diamond, 2004. "Zvi Griliches's contributions to the economics of technology and growth," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 13(4), pages 365-397.
- Carayol, Nicolas & Matt, Mireille, 2006. "Individual and collective determinants of academic scientists' productivity," Information Economics and Policy, Elsevier, vol. 18(1), pages 55-72, March.
- Ashish Arora & Alfonso Gambardella, 1997. "Impact of NSF support for basic research in economics," Others 9702001, EconWPA.
- Nathan Berg, 2002. "Coping with journal-price inflation: leading policy proposals and the quality-spectrum," Economics Bulletin, AccessEcon, vol. 4(14), pages 1-7.
- Maryann P. Feldman & Frank R. Lichtenberg, 1997.
"The Impact and Organization of Publicly-Funded Research and Development in the European Community,"
NBER Working Papers
6040, National Bureau of Economic Research, Inc.
- Maryann P. FELDMAN & Frank R. LICHTENBERG, 1998. "The Impact and Organization of Publicly-Funded Research and development in the European Community," Annales d'Economie et de Statistique, ENSAE, issue 49-50, pages 199-222.
- repec:ebl:ecbull:v:4:y:2002:i:14:p:1-7 is not listed on IDEAS
- Zhang, Daqun & Banker, Rajiv D. & Li, Xiaoxuan & Liu, Wenbin, 2011. "Performance impact of research policy at the Chinese Academy of Sciences," Research Policy, Elsevier, vol. 40(6), pages 875-885, July.
- Carayol, Nicolas & Matt, Mireille, 2004. "Does research organization influence academic production?: Laboratory level evidence from a large European university," Research Policy, Elsevier, vol. 33(8), pages 1081-1102, October.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ().
If references are entirely missing, you can add them using this form.