IDEAS home Printed from
   My bibliography  Save this article

The judge, the model of the judge, and the model of the judged as judge: Analyses of the UK 1992 research assessment exercise data for business and management studies


  • Doyle, J. R.
  • Arthurs, A. J.
  • Green, R. H.
  • McAulay, L.
  • Pitt, M. R.
  • Bottomley, P. A.
  • Evans, W.


This paper examines the judgments (part of a multi-million pound government-sponsored resource allocation exercise) made by a panel of experts about the research rating of UK business schools during 1988-1992. We use policy capture to determine, and critically evaluate, how business schools were judged. We suggest methods to improve the process of judgment-principally, using DEA as an idealized model whereby the judged institutions judge themselves, consistent with policy constraints.

Suggested Citation

  • Doyle, J. R. & Arthurs, A. J. & Green, R. H. & McAulay, L. & Pitt, M. R. & Bottomley, P. A. & Evans, W., 1996. "The judge, the model of the judge, and the model of the judged as judge: Analyses of the UK 1992 research assessment exercise data for business and management studies," Omega, Elsevier, vol. 24(1), pages 13-28, February.
  • Handle: RePEc:eee:jomega:v:24:y:1996:i:1:p:13-28

    Download full text from publisher

    File URL:
    Download Restriction: Full text for ScienceDirect subscribers only

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    1. Johnes, Geraint & Johnes, Jill, 1993. "Measuring the Research Performance of UK Economics Departments: An Application of Data Envelopment Analysis," Oxford Economic Papers, Oxford University Press, vol. 45(2), pages 332-347, April.
    2. Per Andersen & Niels Christian Petersen, 1993. "A Procedure for Ranking Efficient Units in Data Envelopment Analysis," Management Science, INFORMS, vol. 39(10), pages 1261-1264, October.
    3. Kahneman, Daniel & Tversky, Amos, 1979. "Prospect Theory: An Analysis of Decision under Risk," Econometrica, Econometric Society, vol. 47(2), pages 263-291, March.
    4. J. Johnes & J. Taylor, "undated". "The Research Performance of UK Universities: a Statistical Analysis of the Results of the 1989 Research Selectivity Exercise," Working Papers ec25/90, Department of Economics, University of Lancaster.
    5. Martin Weber & Franz Eisenf├╝hr & Detlof von Winterfeldt, 1988. "The Effects of Splitting Attributes on Weights in Multiattribute Utility Measurement," Management Science, INFORMS, vol. 34(4), pages 431-445, April.
    6. Edwards, Ward, 1992. "Discussion: Of human skills," Organizational Behavior and Human Decision Processes, Elsevier, vol. 53(2), pages 267-277, November.
    7. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    8. Robert C. Blattberg & Stephen J. Hoch, 1990. "Database Models and Managerial Intuition: 50% Model + 50% Manager," Management Science, INFORMS, vol. 36(8), pages 887-899, August.
    9. Geraint Johnes, 1995. "Scale and technical efficiency in the production of economic research," Applied Economics Letters, Taylor & Francis Journals, vol. 2(1), pages 7-11.
    10. E. H. Bowman, 1963. "Consistency and Optimality in Managerial Decision Making," Management Science, INFORMS, vol. 9(2), pages 310-321, January.
    11. Doyle, J. R. & Arthurs, A. J., 1995. "Judging the quality of research in business schools: The UK as a case study," Omega, Elsevier, vol. 23(3), pages 257-270, June.
    Full references (including those not matched with items on IDEAS)


    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.

    Cited by:

    1. repec:eee:ejores:v:264:y:2018:i:2:p:742-755 is not listed on IDEAS
    2. Doyle, John R & Arthurs, Alan J, 1998. "Grade inflation in the UK's 1996 research assessment exercise?," Omega, Elsevier, vol. 26(4), pages 461-465, August.
    3. Mitchell, George, 1996. "Judging research quality and journals: A call for debate," Omega, Elsevier, vol. 24(5), pages 613-613, October.
    4. Doyle, J. R. & Arthurs, A. J. & Mcaulay, L. & Osborne, P. G., 1996. "Citation as effortful voting: A reply to ones, Brinn and Pendlebury," Omega, Elsevier, vol. 24(5), pages 603-606, October.
    5. Donohue, Joan M. & Fox, Jeremy B., 2000. "A multi-method evaluation of journals in the decision and management sciences by US academics," Omega, Elsevier, vol. 28(1), pages 17-36, February.


    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jomega:v:24:y:1996:i:1:p:13-28. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Dana Niculescu). General contact details of provider: .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.