IDEAS home Printed from https://ideas.repec.org/p/zbw/umiodp/122011.html
   My bibliography  Save this paper

Ein Forschungsleistungsranking auf der Grundlage von Google Scholar

Author

Listed:
  • Dilger, Alexander
  • Müller, Harry

Abstract

Bei der Evaluation von Forschungsleistungen hat das gängige Verfahren, Publikationen anhand der Zeitschriften zu bewerten, in denen sie erschienen sind, ernstzunehmende Schwächen, da es Buchveröffentlichungen unberücksichtigt lässt und vom Ansehen einer Zeitschrift auf die Qualität jedes einzelnen Artikels in ihr schließt. Als Alternative wird ein direkt auf den Zitationen der einzelnen Veröffentlichung basierendes Verfahren vorgeschlagen, bei dem der Impact jedes Forschers individuell gemessen werden kann. Als Grundlage dient die Datenbank Google Scholar, da sie insbesondere in Hinblick auf die deutschsprachige Literatur die beste Abdeckung verspricht. Allerdings hat sie qualitative Schwächen, die eine sorgfältige Nachkontrolle und -korrektur der Ergebnisse erfordern. Bei einer bibliometrischen Untersuchung der aktuellen Veröffentlichungen (2005-2009) sämtlicher Mitglieder des VHB (Stand 2007) zeigt sich, dass die Zitationen einer Pareto-Verteilung folgen, an deren Spitze wenige Forscher einen Großteil der gesamten Zitationen auf sich vereinen. Mit Blick auf die unterschiedlichen Kommissionen des VHB wird deutlich, dass sich die Publikations- und Zitationskulturen in den einzelnen Teilfächern z. T. deutlich voneinander unterscheiden. Dies ist bei der Interpretation des Gesamtrankings zu berücksichtigen.

Suggested Citation

  • Dilger, Alexander & Müller, Harry, 2011. "Ein Forschungsleistungsranking auf der Grundlage von Google Scholar," Discussion Papers of the Institute for Organisational Economics 12/2011, University of Münster, Institute for Organisational Economics.
  • Handle: RePEc:zbw:umiodp:122011
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/54740/1/681326018.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Sönke Albers, 2009. "Misleading Rankings of Research in Business," German Economic Review, Verein für Socialpolitik, vol. 10(3), pages 352-363, August.
    2. Benjamin M. Althouse & Jevin D. West & Carl T. Bergstrom & Theodore Bergstrom, 2009. "Differences in impact factor across fields and over time," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(1), pages 27-34, January.
    3. Sönke Albers, 2009. "Misleading Rankings of Research in Business," German Economic Review, Verein für Socialpolitik, vol. 10(3), pages 352-363, August.
    4. Dilger, Alexander, 2009. "Rankings von Zeitschriften und Personen in der BWL," IÖB-Diskussionspapiere 5/09, University of Münster, Institute for Economic Education.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Marcel Clermont & Alexander Dirksen & Barbara Scheidt & Dirk Tunger, 2017. "Citation metrics as an additional indicator for evaluating research performance? An analysis of their correlations and validity," Business Research, Springer;German Academic Association for Business Research, vol. 10(2), pages 249-279, October.
    2. Marcel Clermont & Julia Schaefer, 2019. "Identification of Outliers in Data Envelopment Analysis," Schmalenbach Business Review, Springer;Schmalenbach-Gesellschaft, vol. 71(4), pages 475-496, October.
    3. Alexander Dilger & Laura Lütkenhöner & Harry Müller, 2015. "Scholars’ physical appearance, research performance, and feelings of happiness," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(2), pages 555-573, August.
    4. Dilger, Alexander, 2017. "Sind gewählte Teamleiter besser als ihr Team? Analyse am Beispiel von BWL-Professoren und ihren Zitationen [Are elected team leaders better than their teams? Analysis at the example of management p," Discussion Papers of the Institute for Organisational Economics 9/2017, University of Münster, Institute for Organisational Economics.
    5. Müller, Harry & Dilger, Alexander, 2011. "Ein Ranking von Hochschulen und (Bundes-)Ländern am Beispiel der Betriebswirtschaftslehre," Discussion Papers of the Institute for Organisational Economics 8/2011, University of Münster, Institute for Organisational Economics.
    6. Alona Zharova & Andrija Mihoci & Wolfgang Karl Härdle, 2016. "Academic Ranking Scales in Economics: Prediction and Imputation," SFB 649 Discussion Papers SFB649DP2016-020, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    7. Müller, Harry & Dilger, Alexander, 2013. "Der Einfluss des Forschungsschwerpunkts auf den Zitationserfolg: Eine empirische Untersuchung anhand der Gesamtpublikationen deutschsprachiger Hochschullehrer für BWL," Discussion Papers of the Institute for Organisational Economics 1/2013, University of Münster, Institute for Organisational Economics.
    8. Dilger, Alexander, 2012. "Förderung von Wissenschaft zu nationalen und europäischen Fragen," Discussion Papers of the Institute for Organisational Economics 5/2012, University of Münster, Institute for Organisational Economics.
    9. Müller, Harry, 2013. "Zur Ethik von Rankings im Hochschulwesen: Eine Betrachtung aus ökonomischer Perspektive," CIW Discussion Papers 1/2013, University of Münster, Center for Interdisciplinary Economics (CIW).
    10. Dilger, Alexander, 2013. "Soll man das Handelsblatt-Ranking BWL boykottieren?," Discussion Papers of the Institute for Organisational Economics 3/2013, University of Münster, Institute for Organisational Economics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Müller, Harry & Dilger, Alexander, 2013. "Der Einfluss des Forschungsschwerpunkts auf den Zitationserfolg: Eine empirische Untersuchung anhand der Gesamtpublikationen deutschsprachiger Hochschullehrer für BWL," Discussion Papers of the Institute for Organisational Economics 1/2013, University of Münster, Institute for Organisational Economics.
    2. Müller, Harry, 2012. "Die Zitationshäufigkeit als Qualitätsindikator im Rahmen der Forschungsleistungsmessung," Discussion Papers of the Institute for Organisational Economics 1/2012, University of Münster, Institute for Organisational Economics.
    3. Matthias Meyer & Rüdiger W. Waldkirch & Michael A. Zaggl, 2012. "Relative Performance Measurement of Researchers: The Impact of Data Source Selection," Schmalenbach Business Review (sbr), LMU Munich School of Management, vol. 64(4), pages 308-330, October.
    4. Christian-Albrechts-Universität zu Kiel, Institut für Betriebswirtschaftslehre (Ed.), 2010. "Jahresbericht 2009," Manuskripte aus den Instituten für Betriebswirtschaftslehre der Universität Kiel 650, Christian-Albrechts-Universität zu Kiel, Institut für Betriebswirtschaftslehre.
    5. Justus Haucap & Johannes Muck, 2015. "What drives the relevance and reputation of economics journals? An update from a survey among economists," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 849-877, June.
    6. Müller, Harry & Dilger, Alexander, 2011. "Ein Ranking von Hochschulen und (Bundes-)Ländern am Beispiel der Betriebswirtschaftslehre," Discussion Papers of the Institute for Organisational Economics 8/2011, University of Münster, Institute for Organisational Economics.
    7. Müller, Harry, 2013. "Zur Ethik von Rankings im Hochschulwesen: Eine Betrachtung aus ökonomischer Perspektive," CIW Discussion Papers 1/2013, University of Münster, Center for Interdisciplinary Economics (CIW).
    8. Albers, Sönke & Bielecki, Andre, 2012. "Wovon hängt die Leistung in Forschung und Lehre ab? Eine Analyse deutscher betriebswirtschaftlicher Fachbereiche basierend auf den Daten des Centrums für Hochschulentwicklung," EconStor Preprints 57428, ZBW - Leibniz Information Centre for Economics.
    9. Margit Osterloh & Bruno S. Frey, 2010. "Academic rankings and research governance," IEW - Working Papers 482, Institute for Empirical Research in Economics - University of Zurich.
    10. Margit Osterloh & Bruno S. Frey, 2009. "Research Governance in Academia: Are there Alternatives to Academic Rankings?," CREMA Working Paper Series 2009-17, Center for Research in Economics, Management and the Arts (CREMA).
    11. Tüselmann, Heinz & Sinkovics, Rudolf R. & Pishchulov, Grigory, 2015. "Towards a consolidation of worldwide journal rankings – A classification using random forests and aggregate rating via data envelopment analysis," Omega, Elsevier, vol. 51(C), pages 11-23.
    12. Margit Osterloh & Bruno S. Frey, 2015. "Ranking Games," Evaluation Review, , vol. 39(1), pages 102-129, February.
    13. Bielecki, Andre & Albers, Sönke, 2012. "Eine Analyse der Forschungseffizienz deutscher betriebswirtschaftlicher Fachbereiche basierend auf den Daten des Centrums für Hochschulentwicklung (CHE)," EconStor Preprints 57429, ZBW - Leibniz Information Centre for Economics.
    14. Lorenzo Ductor & Sanjeev Goyal & Anja Prummer, 2018. "Gender & Collaboration," Working Papers 856, Queen Mary University of London, School of Economics and Finance.
    15. Matteo Migheli & Giovanni Battista Ramello, 2018. "The market of academic attention," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(1), pages 113-133, January.
    16. Keith Head & Yao Amber Li & Asier Minondo, 2019. "Geography, Ties, and Knowledge Flows: Evidence from Citations in Mathematics," The Review of Economics and Statistics, MIT Press, vol. 101(4), pages 713-727, October.
    17. Dunaiski, Marcel & Geldenhuys, Jaco & Visser, Willem, 2019. "On the interplay between normalisation, bias, and performance of paper impact metrics," Journal of Informetrics, Elsevier, vol. 13(1), pages 270-290.
    18. Battiston, Pietro & Sacco, Pier Luigi & Stanca, Luca, 2022. "Cover effects on citations uncovered: Evidence from Nature," Journal of Informetrics, Elsevier, vol. 16(2).
    19. Shahd Al-Janabi & Lee Wei Lim & Luca Aquili, 2021. "Development of a tool to accurately predict UK REF funding allocation," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 8049-8062, September.
    20. Jerome K. Vanclay, 2012. "Impact factor: outdated artefact or stepping-stone to journal certification?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 211-238, August.

    More about this item

    JEL classification:

    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • I20 - Health, Education, and Welfare - - Education - - - General
    • A11 - General Economics and Teaching - - General Economics - - - Role of Economics; Role of Economists
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • M00 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - General - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:umiodp:122011. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/ilmuede.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.