IDEAS home Printed from https://ideas.repec.org/a/eee/jobhdp/v70y1997i1p65-72.html
   My bibliography  Save this article

Judging Relative Importance: Direct Rating and Point Allocation Are Not Equivalent

Author

Listed:
  • Doyle, John R.
  • Green, Rodney H.
  • Bottomley, Paul A.

Abstract

No abstract is available for this item.

Suggested Citation

  • Doyle, John R. & Green, Rodney H. & Bottomley, Paul A., 1997. "Judging Relative Importance: Direct Rating and Point Allocation Are Not Equivalent," Organizational Behavior and Human Decision Processes, Elsevier, vol. 70(1), pages 65-72, April.
    • Handle: RePEc:eee:jobhdp:v:70:y:1997:i:1:p:65-72
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0749-5978(97)92694-7
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Martin Weber & Franz Eisenführ & Detlof von Winterfeldt, 1988. "The Effects of Splitting Attributes on Weights in Multiattribute Utility Measurement," Management Science, INFORMS, vol. 34(4), pages 431-445, April.
    2. Zhu, Shu-Hong & Anderson, Norman H., 1991. "Self-estimation of weight parameter in multiattribute analysis," Organizational Behavior and Human Decision Processes, Elsevier, vol. 48(1), pages 36-54, February.
    3. F. Hutton Barron & Bruce E. Barrett, 1996. "Decision Quality Using Ranked Attribute Weights," Management Science, INFORMS, vol. 42(11), pages 1515-1523, November.
    4. Edwards, Ward & Barron, F. Hutton, 1994. "SMARTS and SMARTER: Improved Simple Methods for Multiattribute Utility Measurement," Organizational Behavior and Human Decision Processes, Elsevier, vol. 60(3), pages 306-325, December.
    5. Rüdiger von Nitzsch & Martin Weber, 1993. "The Effect of Attribute Ranges on Weights in Multiattribute Utility Measurements," Management Science, INFORMS, vol. 39(8), pages 937-943, August.
    6. Weber, Martin & Borcherding, Katrin, 1993. "Behavioral influences on weight judgments in multiattribute decision making," European Journal of Operational Research, Elsevier, vol. 67(1), pages 1-12, May.
    7. Srivastava, Joydeep & Connolly, Terry & Beach, Lee Roy, 1995. "Do Ranks Suffice? A Comparison of Alternative Weighting Approaches in Value Elicitation," Organizational Behavior and Human Decision Processes, Elsevier, vol. 63(1), pages 112-116, July.
    8. Goldstein, William M., 1990. "Judgments of relative importance in decision making: Global vs local interpretations of subjective weight," Organizational Behavior and Human Decision Processes, Elsevier, vol. 47(2), pages 313-336, December.
    9. Lance, Charles E. & LaPointe, Julie A. & Fisicaro, Sebastiano A., 1994. "Tests of Three Causal Models of Halo Rater Error," Organizational Behavior and Human Decision Processes, Elsevier, vol. 57(1), pages 83-96, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fábio T. F. Silva & Alexandre Szklo & Amanda Vinhoza & Ana Célia Nogueira & André F. P. Lucena & Antônio Marcos Mendonça & Camilla Marcolino & Felipe Nunes & Francielle M. Carvalho & Isabela Tagomori , 2022. "Inter-sectoral prioritization of climate technologies: insights from a Technology Needs Assessment for mitigation in Brazil," Mitigation and Adaptation Strategies for Global Change, Springer, vol. 27(7), pages 1-39, October.
    2. Lienert, Judit & Duygan, Mert & Zheng, Jun, 2016. "Preference stability over time with multiple elicitation methods to support wastewater infrastructure decision-making," European Journal of Operational Research, Elsevier, vol. 253(3), pages 746-760.
    3. Ahmad, Salman & Ouenniche, Jamal & Kolosz, Ben W. & Greening, Philip & Andresen, John M. & Maroto-Valer, M. Mercedes & Xu, Bing, 2021. "A stakeholders’ participatory approach to multi-criteria assessment of sustainable aviation fuels production pathways," International Journal of Production Economics, Elsevier, vol. 238(C).
    4. Böhm, Robert & Letmathe, Peter & Schinner, Matthias, 2023. "The monetary value of competencies: A novel method and case study in smart manufacturing," Technological Forecasting and Social Change, Elsevier, vol. 189(C).
    5. Fu, Chao & Yang, Shan-Lin, 2010. "The group consensus based evidential reasoning approach for multiple attributive group decision analysis," European Journal of Operational Research, Elsevier, vol. 206(3), pages 601-608, November.
    6. Bottomley, Paul A. & Doyle, John R., 2001. "A comparison of three weight elicitation methods: good, better, and best," Omega, Elsevier, vol. 29(6), pages 553-560, December.
    7. Suk, Kwanho & Yoon, Song-Oh, 2012. "The moderating role of decision task goals in attribute weight convergence," Organizational Behavior and Human Decision Processes, Elsevier, vol. 118(1), pages 37-45.
    8. Sean Pascoe & Toni Cannard & Natalie A. Dowling & Catherine M. Dichmont & Sian Breen & Tom Roberts & Rachel J. Pears & George M. Leigh, 2019. "Developing Harvest Strategies to Achieve Ecological, Economic and Social Sustainability in Multi-Sector Fisheries," Sustainability, MDPI, vol. 11(3), pages 1-21, January.
    9. Chang, Yu-Hern & Yeh, Chung-Hsing, 2001. "Evaluating airline competitiveness using multiattribute decision making," Omega, Elsevier, vol. 29(5), pages 405-415, October.
    10. Li, Yaxin & Ding, Yuxin & Guo, Yuliang & Cui, Haizhou & Gao, Haiyi & Zhou, Ziyu & (Aaron) Zhang, Nanbo & Zhu, Siyao & Chen, Faan, 2023. "An integrated decision model with reliability to support transport safety system analysis," Reliability Engineering and System Safety, Elsevier, vol. 239(C).
    11. Bottomley, Paul A. & Doyle, John R., 2013. "Comparing the validity of numerical judgements elicited by direct rating and point allocation: Insights from objectively verifiable perceptual tasks," European Journal of Operational Research, Elsevier, vol. 228(1), pages 148-157.
    12. Leung, Patrick W. & Trotman, Ken T., 2005. "The effects of feedback type on auditor judgment performance for configural and non-configural tasks," Accounting, Organizations and Society, Elsevier, vol. 30(6), pages 537-553, August.
    13. Marttunen, Mika & Belton, Valerie & Lienert, Judit, 2018. "Are objectives hierarchy related biases observed in practice? A meta-analysis of environmental and energy applications of Multi-Criteria Decision Analysis," European Journal of Operational Research, Elsevier, vol. 265(1), pages 178-194.
    14. Haya Al-Ajlani & Luc Ootegem & Elsy Verhofstadt, 2020. "Does Well-Being Vary with an Individual-Specific Weighting Scheme?," Applied Research in Quality of Life, Springer;International Society for Quality-of-Life Studies, vol. 15(5), pages 1285-1302, November.
    15. Van Ittersum, Koert & Pennings, Joost M.E. & Wansink, Brian & van Trijp, Hans C.M., 2007. "The validity of attribute-importance measurement: A review," Journal of Business Research, Elsevier, vol. 60(11), pages 1177-1190, November.
    16. Doyle, John R., 1999. "Evaluating OR/MS research," Omega, Elsevier, vol. 27(3), pages 403-405, June.
    17. Roger Chapman Burk & Richard M. Nehring, 2023. "An Empirical Comparison of Rank-Based Surrogate Weights in Additive Multiattribute Decision Analysis," Decision Analysis, INFORMS, vol. 20(1), pages 55-72, March.
    18. Dong, Yucheng & Liu, Yating & Liang, Haiming & Chiclana, Francisco & Herrera-Viedma, Enrique, 2018. "Strategic weight manipulation in multiple attribute decision making," Omega, Elsevier, vol. 75(C), pages 154-164.
    19. Yang, Guo-liang & Yang, Jian-Bo & Xu, Dong-Ling & Khoveyni, Mohammad, 2017. "A three-stage hybrid approach for weight assignment in MADM," Omega, Elsevier, vol. 71(C), pages 93-105.
    20. Haya Al-Ajlani & Luc Van Ootegem & Elsy Verhofstadt, 2019. "What is Important for Well-Being?," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 143(3), pages 955-972, June.
    21. Aubert, Alice H. & Esculier, Fabien & Lienert, Judit, 2020. "Recommendations for online elicitation of swing weights from citizens in environmental decision-making," Operations Research Perspectives, Elsevier, vol. 7(C).
    22. Ewa Roszkowska, 2020. "The extention rank ordering criteria weighting methods in fuzzy enviroment," Operations Research and Decisions, Wroclaw University of Science and Technology, Faculty of Management, vol. 30(2), pages 91-114.
    23. John R. Doyle, 1999. "Elicitation and Context Effects in Judgments: Fixed Sum Versus Fixed Scale Frames," Management Science, INFORMS, vol. 45(7), pages 972-979, July.
    24. Liu, Jiapeng & Liao, Xiuwu & Yang, Jian-bo, 2015. "A group decision-making approach based on evidential reasoning for multiple criteria sorting problem with uncertainty," European Journal of Operational Research, Elsevier, vol. 246(3), pages 858-873.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hämäläinen, Raimo P. & Alaja, Susanna, 2008. "The threat of weighting biases in environmental decision analysis," Ecological Economics, Elsevier, vol. 68(1-2), pages 556-569, December.
    2. Suk, Kwanho & Yoon, Song-Oh, 2012. "The moderating role of decision task goals in attribute weight convergence," Organizational Behavior and Human Decision Processes, Elsevier, vol. 118(1), pages 37-45.
    3. Ewa Roszkowska, 2020. "The extention rank ordering criteria weighting methods in fuzzy enviroment," Operations Research and Decisions, Wroclaw University of Science and Technology, Faculty of Management, vol. 30(2), pages 91-114.
    4. Poyhonen, Mari & Hamalainen, Raimo P., 2001. "On the convergence of multiattribute weighting methods," European Journal of Operational Research, Elsevier, vol. 129(3), pages 569-585, March.
    5. Sarah K. Jacobi & Benjamin F. Hobbs, 2007. "Quantifying and Mitigating the Splitting Bias and Other Value Tree-Induced Weighting Biases," Decision Analysis, INFORMS, vol. 4(4), pages 194-210, December.
    6. Janine Til & James Dolan & Anne Stiggelbout & Karin Groothuis & Maarten IJzerman, 2008. "The Use of Multi-Criteria Decision Analysis Weight Elicitation Techniques in Patients with Mild Cognitive Impairment," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 1(2), pages 127-135, April.
    7. Poyhonen, Mari & Vrolijk, Hans & Hamalainen, Raimo P., 2001. "Behavioral and procedural consequences of structural variation in value trees," European Journal of Operational Research, Elsevier, vol. 134(1), pages 216-227, October.
    8. Risto Lahdelma & Pekka Salminen, 2001. "SMAA-2: Stochastic Multicriteria Acceptability Analysis for Group Decision Making," Operations Research, INFORMS, vol. 49(3), pages 444-454, June.
    9. Jamie P. Monat, 2009. "The benefits of global scaling in multi-criteria decision analysis," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 4(6), pages 492-508, October.
    10. Roger Chapman Burk & Richard M. Nehring, 2023. "An Empirical Comparison of Rank-Based Surrogate Weights in Additive Multiattribute Decision Analysis," Decision Analysis, INFORMS, vol. 20(1), pages 55-72, March.
    11. Scholz, Michael & Dorner, Verena & Schryen, Guido & Benlian, Alexander, 2017. "A configuration-based recommender system for supporting e-commerce decisions," European Journal of Operational Research, Elsevier, vol. 259(1), pages 205-215.
    12. Richard M. Anderson & Robert Clemen, 2013. "Toward an Improved Methodology to Construct and Reconcile Decision Analytic Preference Judgments," Decision Analysis, INFORMS, vol. 10(2), pages 121-134, June.
    13. John R. Doyle, 1999. "Elicitation and Context Effects in Judgments: Fixed Sum Versus Fixed Scale Frames," Management Science, INFORMS, vol. 45(7), pages 972-979, July.
    14. Schuwirth, N. & Reichert, P. & Lienert, J., 2012. "Methodological aspects of multi-criteria decision analysis for policy support: A case study on pharmaceutical removal from hospital wastewater," European Journal of Operational Research, Elsevier, vol. 220(2), pages 472-483.
    15. Gilberto Montibeller & Detlof von Winterfeldt, 2015. "Cognitive and Motivational Biases in Decision and Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 35(7), pages 1230-1251, July.
    16. de Almeida, Jonatas Araujo & Costa, Ana Paula Cabral Seixas & de Almeida-Filho, Adiel Teixeira, 2016. "A new method for elicitation of criteria weights in additive models: Flexible and interactive tradeoffAuthor-Name: de Almeida, Adiel Teixeira," European Journal of Operational Research, Elsevier, vol. 250(1), pages 179-191.
    17. A Morton & B Fasolo, 2009. "Behavioural decision theory for multi-criteria decision analysis: a guided tour," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 60(2), pages 268-275, February.
    18. Eduarda Asfora Frej & Adiel Teixeira Almeida & Ana Paula Cabral Seixas Costa, 2019. "Using data visualization for ranking alternatives with partial information and interactive tradeoff elicitation," Operational Research, Springer, vol. 19(4), pages 909-931, December.
    19. repec:cup:judgdm:v:4:y:2009:i:6:p:492-508 is not listed on IDEAS
    20. Marttunen, Mika & Belton, Valerie & Lienert, Judit, 2018. "Are objectives hierarchy related biases observed in practice? A meta-analysis of environmental and energy applications of Multi-Criteria Decision Analysis," European Journal of Operational Research, Elsevier, vol. 265(1), pages 178-194.
    21. Aron Larsson & Mona Riabacke & Mats Danielson & Love Ekenberg, 2015. "Cardinal and Rank Ordering of Criteria — Addressing Prescription within Weight Elicitation," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 14(06), pages 1299-1330, November.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jobhdp:v:70:y:1997:i:1:p:65-72. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/obhdp .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.