IDEAS home Printed from https://ideas.repec.org/p/tir/wpaper/33.html
   My bibliography  Save this paper

To publish or not to publish? On the aggregation and drivers of research performance

Author

Listed:
  • De Witte, K.
  • Rogge, N.

Abstract

This paper presents a methodology to aggregate multidimensional research output. Using a tailored version of the non-parametric Data Envelopment Analysis model, we account for the large heterogeneity in research output and the individual researcher preferences by endogenously weighting the various output dimensions. The approach offers three important advantages compared to the traditional approaches: (1) flexibility in the aggregation of different research outputs into an overall evaluation score; (2) a reduction of the impact of measurement errors and atypical observations; and (3) a correction for the influences of a wide variety of factors outside the evaluated researcher’s control. As a result, research evaluations are more effective representations of actual research performance. The methodology is illustrated on a data set of all faculty members at a large polytechnic university in Belgium. The sample includes questionnaire items on the motivation and perception of the researcher. This allows us to explore whether motivation and background characteristics (as age, gender, retention, etc.) of the researchers explain variations in measured research performance.

Suggested Citation

  • De Witte, K. & Rogge, N., 2010. "To publish or not to publish? On the aggregation and drivers of research performance," Working Papers 33, Top Institute for Evidence Based Education Research.
  • Handle: RePEc:tir:wpaper:33
    as

    Download full text from publisher

    File URL: http://www.tierweb.nl/assets/files/UM/research%20in%20scope.pdf
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Kellie L. Maske & Garey C. Durden & Patricia E. Gaynor, 2003. "Determinants of Scholarly Productivity among Male and Female Economists," Economic Inquiry, Western Economic Association International, vol. 41(4), pages 555-564, October.
    2. Johnes, Geraint & Johnes, Jill, 1993. "Measuring the Research Performance of UK Economics Departments: An Application of Data Envelopment Analysis," Oxford Economic Papers, Oxford University Press, pages 332-347.
    3. Kristof DE WITTE & Mika KORTELAINEN, 2008. "Blaming the exogenous environment? Conditional efficiency estimation with continuous and discrete environmental variables," Working Papers Department of Economics ces0833, KU Leuven, Faculty of Economics and Business, Department of Economics.
    4. Timo Kuosmanen, 2002. "Modeling Blank Data Entries in Data Envelopment Analysis," Econometrics 0210001, EconWPA.
    5. Benoît Godin & Yves Gingras, 2000. "Impact of collaborative research on academic science," Science and Public Policy, Oxford University Press, vol. 27(1), pages 65-73, February.
    6. Oliver Fabel & Miriam Hein & Robert Hofmeister, 2008. "Research Productivity in Business Economics: An Investigation of Austrian, German and Swiss Universities," German Economic Review, Verein für Socialpolitik, vol. 9, pages 506-531, November.
    7. Levin, Sharon G & Stephan, Paula E, 1991. "Research Productivity over the Life Cycle: Evidence for Academic Scientists," American Economic Review, American Economic Association, vol. 81(1), pages 114-132, March.
    8. Laurens Cherchye & Wim Moesen & Tom Puyenbroeck, 2004. "Legitimately Diverse, yet Comparable: On Synthesizing Social Inclusion Performance in the EU," Journal of Common Market Studies, Wiley Blackwell, vol. 42(5), pages 919-955, December.
    9. William E. Becker & Peter E. Kennedy, 2005. "Does Teaching Enhance Research in Economics?," American Economic Review, American Economic Association, vol. 95(2), pages 172-176, May.
    10. Cinzia Daraio & Léopold Simar, 2005. "Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic Approach," Journal of Productivity Analysis, Springer, vol. 24(1), pages 93-121, September.
    11. Joe Davis & John Huston & Debra Patterson, 2001. "The scholarly output of economists: A description of publishing patterns," Atlantic Economic Journal, Springer;International Atlantic Economic Society, vol. 29(3), pages 341-349, September.
    12. Knox Lovell, C. A. & Pastor, Jesus T. & Turner, Judi A., 1995. "Measuring macroeconomic performance in the OECD: A comparison of European and non-European countries," European Journal of Operational Research, Elsevier, vol. 87(3), pages 507-518, December.
    13. Cherchye, L. & Abeele, P. Vanden, 2005. "On research efficiency: A micro-analysis of Dutch university research in Economics and Business Management," Research Policy, Elsevier, vol. 34(4), pages 495-516, May.
    14. Broder, Ivy E, 1993. "Professional Achievements and Gender Differences among Academic Economists," Economic Inquiry, Western Economic Association International, vol. 31(1), pages 116-127, January.
    15. Fox, Kevin J & Milbourne, Ross, 1999. "What Determines Research Output of Academic Economists?," The Economic Record, The Economic Society of Australia, vol. 75(230), pages 256-267, September.
    16. Badin, Luiza & Daraio, Cinzia & Simar, Léopold, 2010. "Optimal bandwidth selection for conditional efficiency measures: A data-driven approach," European Journal of Operational Research, Elsevier, vol. 201(2), pages 633-640, March.
    17. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    18. Laurens Cherchye & & Timo Kuosmanen, 2002. "Benchmarking Sustainable Development: A Synthetic Meta-index Approach," Others 0210001, EconWPA, revised 04 Dec 2002.
    19. Sen, Amartya, 1997. "On Economic Inequality," OUP Catalogue, Oxford University Press, number 9780198292975.
    20. De Witte, K. & Rogge, N., 2009. "Accounting for exogenous influences in a benevolent performance evaluation of teachers," Working Papers 15, Top Institute for Evidence Based Education Research.
    21. Jeffery Racine & Jeffrey Hart & Qi Li, 2006. "Testing the Significance of Categorical Predictor Variables in Nonparametric Regression Models," Econometric Reviews, Taylor & Francis Journals, vol. 25(4), pages 523-544.
    22. Cinzia Daraio & Léopold Simar, 2007. "Conditional nonparametric frontier models for convex and nonconvex technologies: a unifying approach," Journal of Productivity Analysis, Springer, vol. 28(1), pages 13-32, October.
    23. Laurens Cherchye & Willem Moesen & Nicky Rogge & Tom Puyenbroeck, 2007. "An Introduction to ‘Benefit of the Doubt’ Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 82(1), pages 111-145, May.
    24. Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, number 8355, June.
    25. Zhou, P. & Ang, B.W. & Poh, K.L., 2007. "A mathematical programming approach to constructing composite indicators," Ecological Economics, Elsevier, vol. 62(2), pages 291-297, April.
    26. Daouia, Abdelaati & Simar, Leopold, 2007. "Nonparametric efficiency analysis: A multivariate conditional quantile approach," Journal of Econometrics, Elsevier, vol. 140(2), pages 375-400, October.
    27. Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
    28. Joan R. Rodgers & Frank Neri, 2007. "Research Productivity Of Australian Academic Economists: Human-Capital And Fixed Effects ," Australian Economic Papers, Wiley Blackwell, vol. 46(1), pages 67-87, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kristof de Witte & Laura López-Torres, 2015. "Efficiency in Education. A Review of Literature and a Way Forward," Working Papers 1501, Departament Empresa, Universitat Autònoma de Barcelona, revised Apr 2015.
    2. repec:eee:ejores:v:264:y:2018:i:2:p:742-755 is not listed on IDEAS
    3. Diniz-Filho, José Alexandre F. & Fioravanti, Maria Clorinda S. & Bini, Luis Mauricio & Rangel, Thiago Fernando, 2016. "Drivers of academic performance in a Brazilian university under a government-restructuring program," Journal of Informetrics, Elsevier, vol. 10(1), pages 151-161.
    4. De Witte, Kristof & Rogge, Nicky & Cherchye, Laurens & Van Puyenbroeck, Tom, 2013. "Economies of scope in research and teaching: A non-parametric investigation," Omega, Elsevier, vol. 41(2), pages 305-314.
    5. Andrea Diem & Stefan C. Wolter, 2011. "The Use of Bibliometrics to Measure Research Performance in Education Sciences," Economics of Education Working Paper Series 0066, University of Zurich, Department of Business Administration (IBW), revised May 2013.
    6. repec:spr:scient:v:90:y:2012:i:3:d:10.1007_s11192-011-0555-y is not listed on IDEAS
    7. repec:spr:scient:v:92:y:2012:i:1:d:10.1007_s11192-012-0721-x is not listed on IDEAS
    8. repec:spr:scient:v:96:y:2013:i:1:d:10.1007_s11192-013-0971-2 is not listed on IDEAS
    9. Richard S. J. Tol, 2012. "Shapley values for assessing research production and impact of schools and scholars," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(3), pages 763-780, March.

    More about this item

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C25 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Discrete Regression and Qualitative Choice Models; Discrete Regressors; Proportions; Probabilities
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tir:wpaper:33. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Jessica Segal). General contact details of provider: http://www.tierweb.nl .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.