Comparing methods for weighting decision criteria

Several metbods have been proposed to weight decision criteria. In this field study a decision group, like that used by public agencies, was formed to establish project priorities. The decision group used a variety of criteria weighting methods to study how these methods influence the magnitude of the weights assigned by members of the decision group. Direct criteria weighting methods (scaling, rank-weight, point assignment and odds procedures) and an indirect approach (weights derived from hypothetical projects) were considered. The study compared the methods in terms of the magnitude of the weights assigned, the variance in weights among members of the decision group, and the similarity of the decisions based on weights assigned by each method. The time to apply each method and the preferences of the decision makers were also determined. The linear rating scale that defined the meaning of scale increments, called an 'anchored ratin scale', was found to be favorably received and efficient and led to the most defensible decisions.