Advanced Search
MyIDEAS: Login to save this paper or follow this series

To publish or not to publish? On the aggregation and drivers of research performance

Contents:

Author Info

  • De Witte, K.
  • Rogge, N.

Abstract

This paper presents a methodology to aggregate multidimensional research output. Using a tailored version of the non-parametric Data Envelopment Analysis model, we account for the large heterogeneity in research output and the individual researcher preferences by endogenously weighting the various output dimensions. The approach offers three important advantages compared to the traditional approaches: (1) flexibility in the aggregation of different research outputs into an overall evaluation score; (2) a reduction of the impact of measurement errors and atypical observations; and (3) a correction for the influences of a wide variety of factors outside the evaluated researcher’s control. As a result, research evaluations are more effective representations of actual research performance. The methodology is illustrated on a data set of all faculty members at a large polytechnic university in Belgium. The sample includes questionnaire items on the motivation and perception of the researcher. This allows us to explore whether motivation and background characteristics (as age, gender, retention, etc.) of the researchers explain variations in measured research performance.

Download Info

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
File URL: http://www.tierweb.nl/assets/files/UM/research%20in%20scope.pdf
Download Restriction: no

Bibliographic Info

Paper provided by Top Institute for Evidence Based Education Research in its series Working Papers with number 33.

as in new window
Length:
Date of creation: 00 2010
Date of revision:
Handle: RePEc:tir:wpaper:33

Contact details of provider:
Web page: http://www.tierweb.nl

Related research

Keywords:

Other versions of this item:

Find related papers by JEL classification:

References

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
as in new window
  1. Daouia, Abdelaati & Simar, Leopold, 2007. "Nonparametric efficiency analysis: A multivariate conditional quantile approach," Journal of Econometrics, Elsevier, Elsevier, vol. 140(2), pages 375-400, October.
  2. Fox, Kevin J & Milbourne, Ross, 1999. "What Determines Research Output of Academic Economists?," The Economic Record, The Economic Society of Australia, The Economic Society of Australia, vol. 75(230), pages 256-67, September.
  3. Cinzia Daraio & Léopold Simar, 2005. "Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic Approach," Journal of Productivity Analysis, Springer, Springer, vol. 24(1), pages 93-121, 09.
  4. Cherchye, Laurens & Kuosmanen, Timo, 2004. "Benchmarking Sustainable Development: A Synthetic Meta-index Approach," Working Paper Series, World Institute for Development Economic Research (UNU-WIDER) UNU-WIDER Research Paper , World Institute for Development Economic Research (UNU-WIDER).
  5. Levin, Sharon G & Stephan, Paula E, 1991. "Research Productivity over the Life Cycle: Evidence for Academic Scientists," American Economic Review, American Economic Association, American Economic Association, vol. 81(1), pages 114-32, March.
  6. Garey C. Durden & Patricia Gaynor & Kellie Maske, 2002. "Determinants of Scholarly Productivity Among Male and Female Economists," Working Papers, Department of Economics, Appalachian State University 02-12, Department of Economics, Appalachian State University.
  7. De Witte, K. & Rogge, N., 2009. "Accounting for exogenous influences in a benevolent performance evaluation of teachers," Working Papers, Top Institute for Evidence Based Education Research 15, Top Institute for Evidence Based Education Research.
  8. Badin, Luiza & Daraio, Cinzia & Simar, Léopold, 2010. "Optimal bandwidth selection for conditional efficiency measures: A data-driven approach," European Journal of Operational Research, Elsevier, Elsevier, vol. 201(2), pages 633-640, March.
  9. William E. Becker & Peter E. Kennedy, 2005. "Does Teaching Enhance Research in Economics?," American Economic Review, American Economic Association, American Economic Association, vol. 95(2), pages 172-176, May.
  10. Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, Princeton University Press, edition 1, volume 1, number 8355.
  11. Beno�t Godin & Yves Gingras, 2000. "Impact of collaborative research on academic science," Science and Public Policy, Oxford University Press, Oxford University Press, vol. 27(1), pages 65-73, February.
  12. Zhou, P. & Ang, B.W. & Poh, K.L., 2007. "A mathematical programming approach to constructing composite indicators," Ecological Economics, Elsevier, Elsevier, vol. 62(2), pages 291-297, April.
  13. Laurens Cherchye & Willem Moesen & Nicky Rogge & Tom Puyenbroeck, 2007. "An Introduction to ‘Benefit of the Doubt’ Composite Indicators," Social Indicators Research, Springer, Springer, vol. 82(1), pages 111-145, May.
  14. G. Johnes & J. Johnes, . "Measuring the Research Performance of UK Economics Departments: An Application of Data Envelopment Analysis," Working Papers, Department of Economics, University of Lancaster ec17/90, Department of Economics, University of Lancaster.
  15. Cherchye, L. & Abeele, P. Vanden, 2005. "On research efficiency: A micro-analysis of Dutch university research in Economics and Business Management," Research Policy, Elsevier, Elsevier, vol. 34(4), pages 495-516, May.
  16. Joan R. Rodgers & Frank Neri, 2007. "Research Productivity Of Australian Academic Economists: Human-Capital And Fixed Effects ," Australian Economic Papers, Wiley Blackwell, Wiley Blackwell, vol. 46(1), pages 67-87, 03.
  17. Kristof DE WITTE & Mika KORTELAINEN, 2008. "Blaming the exogenous environment? Conditional efficiency estimation with continuous and discrete environmental variables," Center for Economic Studies - Discussion papers, Katholieke Universiteit Leuven, Centrum voor Economische Studiën ces0833, Katholieke Universiteit Leuven, Centrum voor Economische Studiën.
  18. Cinzia Daraio & Leopold Simar, 2005. "Conditional Nonparametric Frontier Models for Convex and Non Convex Technologies: a Unifying Approach," LEM Papers Series, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy 2005/12, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
  19. Timo Kuosmanen, 2002. "Modeling Blank Data Entries in Data Envelopment Analysis," Econometrics, EconWPA 0210001, EconWPA.
  20. Oliver Fabel & Miriam Hein & Robert Hofmeister, 2008. "Research Productivity in Business Economics: An Investigation of Austrian, German and Swiss Universities," German Economic Review, Verein für Socialpolitik, Verein für Socialpolitik, vol. 9, pages 506-531, November.
  21. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, Elsevier, vol. 2(6), pages 429-444, November.
  22. Knox Lovell, C. A. & Pastor, Jesus T. & Turner, Judi A., 1995. "Measuring macroeconomic performance in the OECD: A comparison of European and non-European countries," European Journal of Operational Research, Elsevier, Elsevier, vol. 87(3), pages 507-518, December.
  23. Joe Davis & John Huston & Debra Patterson, 2001. "The scholarly output of economists: A description of publishing patterns," Atlantic Economic Journal, International Atlantic Economic Society, International Atlantic Economic Society, vol. 29(3), pages 341-349, September.
  24. Sen, Amartya, 1997. "On Economic Inequality," OUP Catalogue, Oxford University Press, Oxford University Press, number 9780198292975, October.
  25. Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, Elsevier, vol. 106(1), pages 1-25, January.
  26. Jeffery Racine & Jeffrey Hart & Qi Li, 2006. "Testing the Significance of Categorical Predictor Variables in Nonparametric Regression Models," Econometric Reviews, Taylor & Francis Journals, Taylor & Francis Journals, vol. 25(4), pages 523-544.
  27. Broder, Ivy E, 1993. "Professional Achievements and Gender Differences among Academic Economists," Economic Inquiry, Western Economic Association International, Western Economic Association International, vol. 31(1), pages 116-27, January.
Full references (including those not matched with items on IDEAS)

Citations

Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
as in new window

Cited by:
  1. De Witte, Kristof & Rogge, Nicky & Cherchye, Laurens & Van Puyenbroeck, Tom, 2013. "Economies of scope in research and teaching: A non-parametric investigation," Omega, Elsevier, Elsevier, vol. 41(2), pages 305-314.
  2. Andrea Diem & Stefan C. Wolter, 2011. "The Use of Bibliometrics to Measure Research Performance in Education Sciences," Economics of Education Working Paper Series, University of Zurich, Institute for Strategy and Business Economics (ISU) 0066, University of Zurich, Institute for Strategy and Business Economics (ISU), revised May 2013.

Lists

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

Statistics

Access and download statistics

Corrections

When requesting a correction, please mention this item's handle: RePEc:tir:wpaper:33. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Jessica Segal) The email address of this maintainer does not seem to be valid anymore. Please ask Jessica Segal to update the entry or send us the correct address.

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.