IDEAS home Printed from https://ideas.repec.org/a/sae/evarev/v10y1986i3p397-408.html
   My bibliography  Save this article

The Metric Properties of Rating Scales Employed in Evaluation Research

Author

Listed:
  • Graham K. Kenny

    (San Diego State University)

Abstract

This article describes a study that was designed to test the ordinal and interval properties of rating scales, the like of which are commonly employed in evaluation research. Because there is a scarcity of available techniques, testing the interval properties of the scales required a novel adaptation of Mosteller's (1951) "test for internal consistency." The analysis is based upon data generated by the use of paired comparisons and direct scales, and the conclusion reached is that rating scales such as those outlined in this article appear to possess metric properties.

Suggested Citation

  • Graham K. Kenny, 1986. "The Metric Properties of Rating Scales Employed in Evaluation Research," Evaluation Review, , vol. 10(3), pages 397-408, June.
    • Handle: RePEc:sae:evarev:v:10:y:1986:i:3:p:397-408
    DOI: 10.1177/0193841X8601000309
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0193841X8601000309
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0193841X8601000309?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Frederick Mosteller, 1951. "Remarks on the method of paired comparisons: II. The effect of an aberrant standard deviation when equal standard deviations and equal correlations are assumed," Psychometrika, Springer;The Psychometric Society, vol. 16(2), pages 203-206, June.
    2. J. Ramsay, 1973. "The effect of number of categories in rating scales on precision of estimation of scale values," Psychometrika, Springer;The Psychometric Society, vol. 38(4), pages 513-532, December.
    3. Frederick Mosteller, 1951. "Remarks on the method of paired comparisons: III. A test of significance for paired comparisons when equal standard deviations and equal correlations are assumed," Psychometrika, Springer;The Psychometric Society, vol. 16(2), pages 207-218, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Costa, F. P. & Rehman, T., 1999. "Exploring the link between farmers' objectives and the phenomenon of pasture degradation in the beef production systems of Central Brazil," Agricultural Systems, Elsevier, vol. 61(2), pages 135-146, August.
    2. Smith, Donnie & Capstick, Daniel F., 1976. "Establishing Priorities Among Multiple Management Goals," Southern Journal of Agricultural Economics, Southern Agricultural Economics Association, vol. 8(2), pages 1-7, December.
    3. Sonika Thakur & Shashi Kanta Varma & Patricia A. Goldey, 2001. "Perceptions of drudgery in agricultural and animal husbandry operations: a gender analysis from Haryana State, India," Journal of International Development, John Wiley & Sons, Ltd., vol. 13(8), pages 1165-1178.
    4. Dennie van Dolder & Vincent Buskens, 2014. "Individual Choices in Dynamic Networks: An Experiment on Social Preferences," PLOS ONE, Public Library of Science, vol. 9(4), pages 1-16, April.
    5. Vincent Buskens & Jeroen Weesie, 2000. "An Experiment On The Effects Of Embeddedness In Trust Situations," Rationality and Society, , vol. 12(2), pages 227-253, May.
    6. Gensch, Dennis H. & Ghose, Sanjoy, 1997. "Improving PRETREE's predictive capabilities," European Journal of Operational Research, Elsevier, vol. 97(3), pages 465-479, March.
    7. Kwan, Ying Keung & Ip, Wai Cheung & Kwan, Patrick, 2000. "A crime index with Thurstone's scaling of crime severity," Journal of Criminal Justice, Elsevier, vol. 28(3), pages 237-244.
    8. Duane F. Alwin, 1997. "Feeling Thermometers Versus 7-Point Scales," Sociological Methods & Research, , vol. 25(3), pages 318-340, February.
    9. Christian Genest & Johanna G. Nešlehová, 2014. "A Conversation with James O. Ramsay," International Statistical Review, International Statistical Institute, vol. 82(2), pages 161-183, August.
    10. Lendie Follett & Heath Henderson, 2022. "A hybrid approach to targeting social assistance," Papers 2201.01356, arXiv.org.
    11. James Lattin, 1990. "A minimum-cost network-flow solution to the case V thurstone scaling problem," Psychometrika, Springer;The Psychometric Society, vol. 55(2), pages 353-370, June.
    12. Centola, Damon & van de Rijt, Arnout, 2015. "Choosing your network: Social preferences in an online health community," Social Science & Medicine, Elsevier, vol. 125(C), pages 19-31.
    13. Elliott, Michael A., 2010. "Selecting numerical scales for pairwise comparisons," Reliability Engineering and System Safety, Elsevier, vol. 95(7), pages 750-763.
    14. Csató, László, 2013. "Rangsorolás páros összehasonlításokkal. Kiegészítések a felvételizői preferencia-sorrendek módszertanához [Paired comparisons ranking. A supplement to the methodology of application-based preferenc," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(12), pages 1333-1353.
    15. R. Darrell Bock, 1958. "Remarks on the test of significance for the method of paired comparisons," Psychometrika, Springer;The Psychometric Society, vol. 23(4), pages 323-334, December.
    16. J. Vera & Rodrigo Macías & Willem Heiser, 2009. "A Latent Class Multidimensional Scaling Model for Two-Way One-Mode Continuous Rating Dissimilarity Data," Psychometrika, Springer;The Psychometric Society, vol. 74(2), pages 297-315, June.
    17. Robert O'Brien & Pamela Homer, 1987. "Corrections for coarsely categorized measures: LISREL's polyserial and polychoric correlations," Quality & Quantity: International Journal of Methodology, Springer, vol. 21(4), pages 349-360, December.
    18. Jose Pina-Sánchez & John Paul Gosling, 2020. "Tackling selection bias in sentencing data analysis: a new approach based on a scale of severity," Quality & Quantity: International Journal of Methodology, Springer, vol. 54(3), pages 1047-1073, June.
    19. Julio González-Díaz & Ruud Hendrickx & Edwin Lohmann, 2014. "Paired comparisons analysis: an axiomatic approach to ranking methods," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 42(1), pages 139-169, January.
    20. Harman, Wyatte L. & Eidman, Vernon R. & Hatch, Roy E. & Claypool, P. L., 1972. "Relating Farm and Operator Characteristics to Multiple Goals," Journal of Agricultural and Applied Economics, Cambridge University Press, vol. 4(1), pages 215-220, July.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:10:y:1986:i:3:p:397-408. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.