IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Login to save this article or follow this journal

Relative Performance Measurement of Researchers: The Impact of Data Source Selection

  • Matthias Meyer
  • Rüdiger W. Waldkirch
  • Michael A. Zaggl
Registered author(s):

    We investigate the impact of choosing between four data sources on the relative performance measurement of scholars’ research output. Our results show that rankings can differ considerably and that the observed correlations are often even lower than those reported in previous studies. We show that data source selection generally has a higher effect than does measure selection and that performance measures based on Google Scholar might provide information that complements the more traditional data sources. We find greater differences for accounting, which suggests that decision makers must pay more careful atten-tion when using rankings in this field.

    If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

    File URL: http://www.vhb.de/sbr/pdfarchive.html
    Download Restriction: no

    Article provided by LMU Munich School of Management in its journal Schmalenbach Business Review.

    Volume (Year): 64 (2012)
    Issue (Month): 4 (October)
    Pages: 308-330

    as
    in new window

    Handle: RePEc:sbr:abstra:v:64:y:2012:i:4:p:308-330
    Contact details of provider: Postal: Geschwister-Scholl-Platz 1, 80539 Muenchen
    Phone: 0049 89 2180 2166
    Fax: 0049 89 2180 6327
    Web page: http://www.sbr-online.com

    More information through EDIRC

    References listed on IDEAS
    Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

    as in new window
    1. Sönke Albers, 2009. "Misleading Rankings of Research in Business," German Economic Review, Verein für Socialpolitik, vol. 10, pages 352-363, 08.
    2. Bruno S. Frey & Margit Osterloh, 2006. "Evaluations: Hidden Costs, Questionable Benefits, and Superior Alternatives," IEW - Working Papers 302, Institute for Empirical Research in Economics - University of Zurich.
    3. Bernard Raffournier & Alain Schatt, 2009. "Is European accounting research fairly reflected in academic journals? An investigation of possible non-mainstream and language barrier biases," Working Papers CREGO 1090301, Université de Bourgogne - CREGO EA7317 Centre de recherches en gestion des organisations.
    4. Bruno S. Frey, 2007. "Evaluierungen, Evaluierungen H Evaluitis," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 8(3), pages 207-220, 08.
    5. Uschi Backes-Gellner, 2011. "Discussion of “Quantitative and Qualitative Rankings of Scholars”: Rankings upon Rankings – and no End in Sight –," Schmalenbach Business Review (sbr), LMU Munich School of Management, vol. 63(1), pages 99-108, January.
    6. Daniel B. Klein & Eric Chiang, 2004. "The Social Science Citation Index: A Black Box—with an Ideological Bias?," Econ Journal Watch, Econ Journal Watch, vol. 1(1), pages 134-165, April.
    7. Magnus Henrekson & Daniel Waldenström, 2011. "How Should Research Performance Be Measured? A Study Of Swedish Economists," Manchester School, University of Manchester, vol. 79(6), pages 1139-1156, December.
    8. Bruno S. Frey & Katja Rost, 2008. "Do Rankings Reflect Research Quality?," IEW - Working Papers 390, Institute for Empirical Research in Economics - University of Zurich.
    9. Robert Hofmeister & Heinrich W. Ursprung, 2008. "Das Handelsblatt Ökonomen-Ranking 2007: Eine kritische Beurteilung," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 9(3), pages 254-266, 08.
    10. Dilger, Alexander, 2009. "Rankings von Zeitschriften und Personen in der BWL," IÖB-Diskussionspapiere 5/09, University of Münster, Institute for Economic Education.
    11. Katja Rost & Bruno S. Frey, 2011. "Quantitative and Qualitative Rankings of Scholars," Schmalenbach Business Review (sbr), LMU Munich School of Management, vol. 63(1), pages 63-91, January.
    12. Matthias Krapf, 2010. "Research evaluation and journal quality weights: Much ado about nothing?," Working Paper Series of the Department of Economics, University of Konstanz 2010-02, Department of Economics, University of Konstanz.
    13. Soenke Albers, 2011. "Discussion of “Quantitative and Qualitative Rankings of Scholars”: Esteem Indicators: Membership in Editorial Boards or Honorary Doctorates," Schmalenbach Business Review (sbr), LMU Munich School of Management, vol. 63(1), pages 92-98, January.
    14. Werner Reinartz, 2011. "Discussion of “Quantitative and Qualitative Rankings of Scholars”: Feeling Good or Feeling Right?," Schmalenbach Business Review (sbr), LMU Munich School of Management, vol. 63(1), pages 109-114, January.
    15. Holmstrom, Bengt & Milgrom, Paul, 1991. "Multitask Principal-Agent Analyses: Incentive Contracts, Asset Ownership, and Job Design," Journal of Law, Economics and Organization, Oxford University Press, vol. 7(0), pages 24-52, Special I.
    Full references (including those not matched with items on IDEAS)

    This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

    When requesting a correction, please mention this item's handle: RePEc:sbr:abstra:v:64:y:2012:i:4:p:308-330. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (sbr)

    The email address of this maintainer does not seem to be valid anymore. Please ask sbr to update the entry or send us the correct address

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If references are entirely missing, you can add them using this form.

    If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.