IDEAS home Printed from https://ideas.repec.org/a/spr/opsear/v59y2022i1d10.1007_s12597-021-00542-4.html
   My bibliography  Save this article

Understanding transitions in professors’ evaluation: the application of Markov chain

Author

Listed:
  • Martin Flegl

    (Tecnologico de Monterrey)

  • Robert Hlavatý

    (Czech University of Life Sciences)

Abstract

Professors’ evaluations are carried out differently throughout individual universities, but it is an important part of a university internal quality regardless the evaluation system. The institutions with a large number of teaching employees are forced to use quantitative means of evaluation to be able to capture differences between individual science fields. We provide the means of meta-evaluation based on the Markov chain approach that allows to further assess the subjects of evaluation on a long-term basis. The approach is demonstrated on the vast evaluation data gathered in the university in Mexico City. The methodology of using Markov chains is explained on the theoretical level and it is applied to the real data afterwards. Results indicate that the lowest-evaluated professors are more likely to remain within the lowest-evaluated ones over a longer period. This may correspond with professors’ unwillingness to make changes in their courses. Moreover, we provide ample commentary on how the results should be understood. In the end, it occurs that using the Markov chain can even provide a reflection on the evaluation system as such.

Suggested Citation

  • Martin Flegl & Robert Hlavatý, 2022. "Understanding transitions in professors’ evaluation: the application of Markov chain," OPSEARCH, Springer;Operational Research Society of India, vol. 59(1), pages 304-323, March.
  • Handle: RePEc:spr:opsear:v:59:y:2022:i:1:d:10.1007_s12597-021-00542-4
    DOI: 10.1007/s12597-021-00542-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s12597-021-00542-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s12597-021-00542-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Harris, Douglas N. & Sass, Tim R., 2011. "Teacher training, teacher quality and student achievement," Journal of Public Economics, Elsevier, vol. 95(7-8), pages 798-812, August.
    2. Braga, Michela & Paccagnella, Marco & Pellizzari, Michele, 2014. "Evaluating students’ evaluations of professors," Economics of Education Review, Elsevier, vol. 41(C), pages 71-88.
    3. Laureti, Tiziana & Secondi, Luca & Biggeri, Luigi, 2014. "Measuring the efficiency of teaching activities in Italian universities: An information theoretic approach," Economics of Education Review, Elsevier, vol. 42(C), pages 147-164.
    4. Brian A. Jacob & Lars Lefgren, 2004. "The Impact of Teacher Training on Student Achievement: Quasi-Experimental Evidence from School Reform Efforts in Chicago," Journal of Human Resources, University of Wisconsin Press, vol. 39(1).
    5. Arceo-Gomez, Eva O. & Campos-Vazquez, Raymundo M., 2019. "Gender stereotypes: The case of MisProfesores.com in Mexico," Economics of Education Review, Elsevier, vol. 72(C), pages 55-65.
    6. Sansone, Dario, 2017. "Why does teacher gender matter?," Economics of Education Review, Elsevier, vol. 61(C), pages 9-18.
    7. Oral, Muhittin & Oukil, Amar & Malouin, Jean-Louis & Kettani, Ossama, 2014. "The appreciative democratic voice of DEA: A case of faculty academic performance evaluation," Socio-Economic Planning Sciences, Elsevier, vol. 48(1), pages 20-28.
    8. Mueller, Steffen, 2013. "Teacher experience and the class size effect — Experimental evidence," Journal of Public Economics, Elsevier, vol. 98(C), pages 44-52.
    9. Wagner, N. & Rieger, M. & Voorvelt, K.J., 2016. "Gender, ethnicity and teaching evaluations : Evidence from mixed teaching teams," ISS Working Papers - General Series 617, International Institute of Social Studies of Erasmus University Rotterdam (ISS), The Hague.
    10. Oriana Bandiera & Valentino Larcinese & Imran Rasul, 2010. "Heterogeneous Class Size Effects: New Evidence from a Panel of University Students," Economic Journal, Royal Economic Society, vol. 120(549), pages 1365-1398, December.
    11. Ome, Alejandro & Menendez, Alicia & Elise Le, Huyen, 2017. "Improving teaching quality through training: Evidence from the Caucasus," Economics of Education Review, Elsevier, vol. 61(C), pages 1-8.
    12. Dan D. Goldhaber & Dominic J. Brewer, 1997. "Why Don't Schools and Teachers Seem to Matter? Assessing the Impact of Unobservables on Educational Productivity," Journal of Human Resources, University of Wisconsin Press, vol. 32(3), pages 505-523.
    13. Jonah E. Rockoff, 2004. "The Impact of Individual Teachers on Student Achievement: Evidence from Panel Data," American Economic Review, American Economic Association, vol. 94(2), pages 247-252, May.
    14. William E. Becker & William Bosshardt & Michael Watts, 2012. "How Departments of Economics Evaluate Teaching," The Journal of Economic Education, Taylor & Francis Journals, vol. 43(3), pages 325-333, July.
    15. Eric A. Hanushek & Steven G. Rivkin, 2010. "Generalizations about Using Value-Added Measures of Teacher Quality," American Economic Review, American Economic Association, vol. 100(2), pages 267-271, May.
    16. Boring, Anne, 2017. "Gender biases in student evaluations of teaching," Journal of Public Economics, Elsevier, vol. 145(C), pages 27-41.
    17. Rieger, Matthias & Voorvelt, Katherine, 2016. "Gender, ethnicity and teaching evaluations: Evidence from mixed teaching teamsAuthor-Name: Wagner, Natascha," Economics of Education Review, Elsevier, vol. 54(C), pages 79-94.
    18. Sapelli, Claudio & Illanes, Gastón, 2016. "Class size and teacher effects in higher education," Economics of Education Review, Elsevier, vol. 52(C), pages 19-28.
    19. Bruce A. Weinberg & Masanori Hashimoto & Belton M. Fleisher, 2009. "Evaluating Teaching in Higher Education," The Journal of Economic Education, Taylor & Francis Journals, vol. 40(3), pages 227-261, July.
    20. Bedard, Kelly & Kuhn, Peter, 2008. "Where class size really matters: Class size and student ratings of instructor effectiveness," Economics of Education Review, Elsevier, vol. 27(3), pages 253-265, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cannon, Edmund & Cipriani, Giam Pietro, 2021. "Gender Differences in Student Evaluations of Teaching: Identification and Consequences," IZA Discussion Papers 14387, Institute of Labor Economics (IZA).
    2. Rodríguez, Rosa & Rubio, Gonzalo, 2016. "Teaching quality and academic research," International Review of Economics Education, Elsevier, vol. 23(C), pages 10-27.
    3. Angelo Antoci & Irene Brunetti & Pierluigi Sacco & Mauro Sodini, 2021. "Student evaluation of teaching, social influence dynamics, and teachers’ choices: An evolutionary model," Journal of Evolutionary Economics, Springer, vol. 31(1), pages 325-348, January.
    4. Braga, Michela & Paccagnella, Marco & Pellizzari, Michele, 2014. "Evaluating students’ evaluations of professors," Economics of Education Review, Elsevier, vol. 41(C), pages 71-88.
    5. Matthew A. Kraft & John P. Papay & Olivia L. Chi, 2020. "Teacher Skill Development: Evidence from Performance Ratings by Principals," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(2), pages 315-347, March.
    6. Alexei Karas, 2021. "The effect of class size on grades and course evaluations: Evidence from multisection courses," Bulletin of Economic Research, Wiley Blackwell, vol. 73(4), pages 624-642, October.
    7. Marine de Talancé, 2015. "Better Teachers, Better Results? Evidence from Rural Pakistan," Working Papers DT/2015/21, DIAL (Développement, Institutions et Mondialisation).
    8. Maarten Goos & Anna Salomons, 2017. "Measuring teaching quality in higher education: assessing selection bias in course evaluations," Research in Higher Education, Springer;Association for Institutional Research, vol. 58(4), pages 341-364, June.
    9. Wedel, Katharina, 2021. "Instruction time and student achievement: The moderating role of teacher qualifications," Economics of Education Review, Elsevier, vol. 85(C).
    10. Robert L. Moore & Hanna Song & James D. Whitney, 2021. "Do Students Discriminate? Exploring Differentials by Race and Sex in Class Enrollments and Student Ratings of Instructors," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 47(1), pages 135-162, January.
    11. Marc van der Steeg & Roel van Elk, 2015. "The effect of schooling vouchers on higher education enrollment and completion of teachers: A regression discontinuity analysis," CPB Discussion Paper 305, CPB Netherlands Bureau for Economic Policy Analysis.
    12. Sapelli, Claudio & Illanes, Gastón, 2016. "Class size and teacher effects in higher education," Economics of Education Review, Elsevier, vol. 52(C), pages 19-28.
    13. Marc van der Steeg & Roel van Elk, 2015. "The effect of schooling vouchers on higher education enrollment and completion of teachers: A regression discontinuity analysis," CPB Discussion Paper 305.rdf, CPB Netherlands Bureau for Economic Policy Analysis.
    14. Murphy, Richard & Weinhardt, Felix & Wyness, Gill, 2021. "Who teaches the teachers? A RCT of peer-to-peer observation and feedback in 181 schools," Economics of Education Review, Elsevier, vol. 82(C).
    15. Beleche, Trinidad & Fairris, David & Marks, Mindy, 2012. "Do course evaluations truly reflect student learning? Evidence from an objectively graded post-test," Economics of Education Review, Elsevier, vol. 31(5), pages 709-719.
    16. Papay, John P. & Kraft, Matthew A., 2015. "Productivity returns to experience in the teacher labor market: Methodological challenges and new evidence on long-term career improvement," Journal of Public Economics, Elsevier, vol. 130(C), pages 105-119.
    17. Allison Atteberry & Susanna Loeb & James Wyckoff, 2013. "Do First Impressions Matter? Improvement in Early Career Teacher Effectiveness," NBER Working Papers 19096, National Bureau of Economic Research, Inc.
    18. Ayllón, Sara, 2022. "Online teaching and gender bias," Economics of Education Review, Elsevier, vol. 89(C).
    19. Canales, Andrea & Maldonado, Luis, 2018. "Teacher quality and student achievement in Chile: Linking teachers' contribution and observable characteristics," International Journal of Educational Development, Elsevier, vol. 60(C), pages 33-50.
    20. Boring, Anne & Philippe, Arnaud, 2021. "Reducing discrimination in the field: Evidence from an awareness raising intervention targeting gender biases in student evaluations of teaching," Journal of Public Economics, Elsevier, vol. 193(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:opsear:v:59:y:2022:i:1:d:10.1007_s12597-021-00542-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.