To publish or not to publish? On the aggregation and drivers of research performance
This paper presents a methodology to aggregate multidimensional research output. Using a tailored version of the non-parametric Data Envelopment Analysis model, we account for the large heterogeneity in research output and the individual researcher preferences by endogenously weighting the various output dimensions. The approach offers three important advantages compared to the traditional approaches: (1) flexibility in the aggregation of different research outputs into an overall evaluation score; (2) a reduction of the impact of measurement errors and a-typical observations; and (3) a correction for the influences of a wide variety of factors outside the evaluated researchers control. As a result, research evaluations are more effective representations of actual research performance. The methodology is illustrated on a data set of all faculty members at the Hogeschool Universiteit Brussels. The sample is enriched with questionnaire items on the motivation and perception of the researcher. This allows us to explore whether motivation and background characteristics (as age, gender, retention) of the researchers explain variations in measured research performance.
|Date of creation:||Dec 2009|
|Contact details of provider:|| Web page: http://research.hubrussel.be|
More information through EDIRC
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Laurens Cherchye & Willem Moesen & Nicky Rogge & Tom Puyenbroeck, 2007. "An Introduction to ‘Benefit of the Doubt’ Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 82(1), pages 111-145, May.
- De Witte, K. & Rogge, N., 2009.
"Accounting for exogenous influences in a benevolent performance evaluation of teachers,"
15, Top Institute for Evidence Based Education Research.
- De Witte, Kristof & Rogge, Nicky, 2009. "Accounting for exogenous influences in a benevolent performance evaluation of teachers," Working Papers 2009/15, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
- Kristof DE WITTE & Nicky ROGGE, 2009. "Accounting for exogenous influences in a benevolent performance evaluation of teachers," Working Papers Department of Economics ces09.13, KU Leuven, Faculty of Economics and Business, Department of Economics.
- Kristof DE WITTE & Mika KORTELAINEN, 2008. "Blaming the exogenous environment? Conditional efficiency estimation with continuous and discrete environmental variables," Working Papers Department of Economics ces0833, KU Leuven, Faculty of Economics and Business, Department of Economics.
- Levin, Sharon G & Stephan, Paula E, 1991. "Research Productivity over the Life Cycle: Evidence for Academic Scientists," American Economic Review, American Economic Association, vol. 81(1), pages 114-132, March.
- Knox Lovell, C. A. & Pastor, Jesus T. & Turner, Judi A., 1995. "Measuring macroeconomic performance in the OECD: A comparison of European and non-European countries," European Journal of Operational Research, Elsevier, vol. 87(3), pages 507-518, December.
- Badin, Luiza & Daraio, Cinzia & Simar, Léopold, 2010.
"Optimal bandwidth selection for conditional efficiency measures: A data-driven approach,"
European Journal of Operational Research,
Elsevier, vol. 201(2), pages 633-640, March.
- Luiza Badin & Cinzia Daraio & Léopold Simar, 2008. "Optimal Bandwidth Selection for Conditional Efficiency Measures: a Data-driven Approach," LEM Papers Series 2008/22, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
- Cherchye, Laurens & Kuosmanen, Timo, 2004.
"Benchmarking Sustainable Development: A Synthetic Meta-index Approach,"
WIDER Working Papers
UNU-WIDER Research Paper , World Institute for Development Economic Research (UNU-WIDER).
- Laurens Cherchye & & Timo Kuosmanen, 2002. "Benchmarking Sustainable Development: A Synthetic Meta-index Approach," Others 0210001, EconWPA, revised 08 Oct 2002.
- Cinzia Daraio & Leopold Simar, 2005. "Conditional Nonparametric Frontier Models for Convex and Non Convex Technologies: a Unifying Approach," LEM Papers Series 2005/12, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
- Joe Davis & John Huston & Debra Patterson, 2001. "The scholarly output of economists: A description of publishing patterns," Atlantic Economic Journal, Springer;International Atlantic Economic Society, vol. 29(3), pages 341-349, September.
- Cinzia Daraio & Léopold Simar, 2005. "Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic Approach," Journal of Productivity Analysis, Springer, vol. 24(1), pages 93-121, 09.
- Joan R. Rodgers & Frank Neri, 2007. "Research Productivity Of Australian Academic Economists: Human-Capital And Fixed Effects ," Australian Economic Papers, Wiley Blackwell, vol. 46(1), pages 67-87, 03.
- Garey C. Durden & Patricia Gaynor & Kellie Maske, 2002.
"Determinants of Scholarly Productivity Among Male and Female Economists,"
02-12, Department of Economics, Appalachian State University.
- Kellie L. Maske & Garey C. Durden & Patricia E. Gaynor, 2003. "Determinants of Scholarly Productivity among Male and Female Economists," Economic Inquiry, Western Economic Association International, vol. 41(4), pages 555-564, October.
- William E. Becker & Peter E. Kennedy, 2005. "Does Teaching Enhance Research in Economics?," American Economic Review, American Economic Association, vol. 95(2), pages 172-176, May.
- Benoît Godin & Yves Gingras, 2000. "Impact of collaborative research on academic science," Science and Public Policy, Oxford University Press, vol. 27(1), pages 65-73, February.
- Cinzia Daraio & Léopold Simar, 2007. "Conditional nonparametric frontier models for convex and nonconvex technologies: a unifying approach," Journal of Productivity Analysis, Springer, vol. 28(1), pages 13-32, October.
- G. Johnes & J. Johnes, "undated".
"Measuring the Research Performance of UK Economics Departments: An Application of Data Envelopment Analysis,"
ec17/90, Department of Economics, University of Lancaster.
- Johnes, Geraint & Johnes, Jill, 1993. "Measuring the Research Performance of UK Economics Departments: An Application of Data Envelopment Analysis," Oxford Economic Papers, Oxford University Press, vol. 45(2), pages 332-347, April.
- Oliver Fabel & Miriam Hein & Robert Hofmeister, 2008. "Research Productivity in Business Economics: An Investigation of Austrian, German and Swiss Universities," German Economic Review, Verein für Socialpolitik, vol. 9, pages 506-531, November.
- Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
- Timo Kuosmanen, 2002. "Modeling Blank Data Entries in Data Envelopment Analysis," Econometrics 0210001, EconWPA.
- Fox, Kevin J & Milbourne, Ross, 1999. "What Determines Research Output of Academic Economists?," The Economic Record, The Economic Society of Australia, vol. 75(230), pages 256-267, September.
- Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
- Cherchye, L. & Abeele, P. Vanden, 2005.
"On research efficiency: A micro-analysis of Dutch university research in Economics and Business Management,"
Elsevier, vol. 34(4), pages 495-516, May.
- Laurens Cherchye & Piet Vanden Abeele, 2002. "On Research Efficiency: A Micro-Analysis of Dutch University Research in Economics and Business Management," Public Economics Working Paper Series ces0206, Katholieke Universiteit Leuven, Centrum voor Economische Studiën, Working Group Public Economics.
- Sen, Amartya, 1997. "On Economic Inequality," OUP Catalogue, Oxford University Press, number 9780198292975, December.
- Broder, Ivy E, 1993. "Professional Achievements and Gender Differences among Academic Economists," Economic Inquiry, Western Economic Association International, vol. 31(1), pages 116-127, January.
- Daouia, Abdelaati & Simar, Leopold, 2007. "Nonparametric efficiency analysis: A multivariate conditional quantile approach," Journal of Econometrics, Elsevier, vol. 140(2), pages 375-400, October.
- Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, number 8355.
- Zhou, P. & Ang, B.W. & Poh, K.L., 2007. "A mathematical programming approach to constructing composite indicators," Ecological Economics, Elsevier, vol. 62(2), pages 291-297, April.
- Jeffery Racine & Jeffrey Hart & Qi Li, 2006. "Testing the Significance of Categorical Predictor Variables in Nonparametric Regression Models," Econometric Reviews, Taylor & Francis Journals, vol. 25(4), pages 523-544.
When requesting a correction, please mention this item's handle: RePEc:hub:wpecon:200942. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Sabine Janssens)
If references are entirely missing, you can add them using this form.