IDEAS home Printed from https://ideas.repec.org/a/inm/orinte/v34y2004i4p314-320.html
   My bibliography  Save this article

Aggregating Expert Ratings Using Preference-Neutral Weights: The Case of the College Football Polls

Author

Listed:
  • Ira Horowitz

    (Decision and Information Sciences, Warrington College of Business Administration, University of Florida, Gainesville, Florida 32611-7169)

Abstract

I use two principal college football polls to illustrate a preference-neutral linear programming procedure for determining optimal weights for aggregating expert ratings. I compute the weights for 84 weekly polls released during the 1999 through 2003 college football seasons. The weights vary from week to week (sometimes considerably over a year), the range of weights over which the aggregate ranking holds also tends to vary and to be quite small (with a range of zero almost half the time), and nothing is systematic about the week-to-week changes in either the weights or their ranges. The results suggest that predisposition to a particular set of weights is a bad idea, not just for the purpose of aggregating the football polls, but in any situation in which one wants to aggregate ratings provided by multiple sources of complementary expertise.

Suggested Citation

  • Ira Horowitz, 2004. "Aggregating Expert Ratings Using Preference-Neutral Weights: The Case of the College Football Polls," Interfaces, INFORMS, vol. 34(4), pages 314-320, August.
    • Handle: RePEc:inm:orinte:v:34:y:2004:i:4:p:314-320
    DOI: 10.1287/inte.1040.0086
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/inte.1040.0086
    Download Restriction: no
    File URL: https://libkey.io/10.1287/inte.1040.0086?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Daniel Kahneman, 2003. "Maps of Bounded Rationality: Psychology for Behavioral Economics," American Economic Review, American Economic Association, vol. 93(5), pages 1449-1475, December.
    2. I Horowitz, 2003. "Preference-neutral attribute weights in the journal-ranking problem," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(5), pages 452-457, May.
    3. Robert T. Clemen & Robert L. Winkler, 1999. "Combining Probability Distributions From Experts in Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 19(2), pages 187-203, April.
    4. John DiNardo & Justin L. Tobias, 2001. "Nonparametric Density and Regression Estimation," Journal of Economic Perspectives, American Economic Association, vol. 15(4), pages 11-28, Fall.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Randall Holcombe, 2009. "The behavioral foundations of Austrian economics," The Review of Austrian Economics, Springer;Society for the Development of Austrian Economics, vol. 22(4), pages 301-313, December.
    2. James K. Hammitt & Yifan Zhang, 2013. "Combining Experts’ Judgments: Comparison of Algorithmic Methods Using Synthetic Data," Risk Analysis, John Wiley & Sons, vol. 33(1), pages 109-120, January.
    3. Brette, Olivier & Buhler, Thomas & Lazaric, Nathalie & Marechal, Kevin, 2014. "Reconsidering the nature and effects of habits in urban transportation behavior," Journal of Institutional Economics, Cambridge University Press, vol. 10(3), pages 399-426, September.
    4. Winter, Peter, 2007. "Managerial Risk Accounting and Control – A German perspective," MPRA Paper 8185, University Library of Munich, Germany.
    5. Kolbe, Maura & Mansouri, Sasan & Momtaz, Paul P., 2022. "Why do video pitches matter in crowdfunding?," Journal of Economics and Business, Elsevier, vol. 122(C).
    6. J. Silvestre, & T. Araújo & M. St. Aubyn, 2016. "Economic growth and individual satisfaction in an agent-based economy," Working Papers Department of Economics 2016/19, ISEG - Lisbon School of Economics and Management, Department of Economics, Universidade de Lisboa.
    7. Xiao Lin, 2020. "Risk awareness and adverse selection in catastrophe insurance: Evidence from California’s residential earthquake insurance market," Journal of Risk and Uncertainty, Springer, vol. 61(1), pages 43-65, August.
    8. Luigi Guiso, 2015. "A Test of Narrow Framing and its Origin," Italian Economic Journal: A Continuation of Rivista Italiana degli Economisti and Giornale degli Economisti, Springer;Società Italiana degli Economisti (Italian Economic Association), vol. 1(1), pages 61-100, March.
    9. Henrik Andersson & Mikael Svensson, 2008. "Cognitive ability and scale bias in the contingent valuation method," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 39(4), pages 481-495, April.
    10. Corak, Miles & Lauzon, Darren, 2009. "Differences in the distribution of high school achievement: The role of class-size and time-in-term," Economics of Education Review, Elsevier, vol. 28(2), pages 189-198, April.
    11. Samuel Ferey & Yannick Gabuthy & Nicolas Jacquemet, 2013. "L'apport de l'économie expérimentale dans l'élaboration des politiques publiques," Revue française d'économie, Presses de Sciences-Po, vol. 0(2), pages 155-194.
    12. Kuhn, Dieter, 2011. "Delayering and Firm Performance: Evidence from Swiss firm-level Data," Working papers 2011/02, Faculty of Business and Economics - University of Basel.
    13. Naito, Hisahiro, 2004. "Endogenous human capital accumulation, comparative advantage and direct vs. indirect redistribution," Journal of Public Economics, Elsevier, vol. 88(12), pages 2685-2710, December.
    14. Bleichrodt, Han & Rohde, Kirsten I.M. & Van Ourti, Tom, 2012. "An experimental test of the concentration index," Journal of Health Economics, Elsevier, vol. 31(1), pages 86-98.
    15. Francisco Rosas & Bruce A. Babcock & Dermot J. Hayes, 2011. "A Nonlinear Offset Program to Reduce Nitrous Oxide Emissions Induced by Excessive Nitrogen Application," Center for Agricultural and Rural Development (CARD) Publications 11-wp521, Center for Agricultural and Rural Development (CARD) at Iowa State University.
    16. Kenneth Gillingham & William D. Nordhaus & David Anthoff & Geoffrey Blanford & Valentina Bosetti & Peter Christensen & Haewon McJeon & John Reilly & Paul Sztorc, 2015. "Modeling Uncertainty in Climate Change: A Multi-Model Comparison," NBER Working Papers 21637, National Bureau of Economic Research, Inc.
    17. Julia R. Falconer & Eibe Frank & Devon L. L. Polaschek & Chaitanya Joshi, 2022. "Methods for Eliciting Informative Prior Distributions: A Critical Review," Decision Analysis, INFORMS, vol. 19(3), pages 189-204, September.
    18. Jack Vromen, 2007. "Neuroeconomics as a Natural Extension of Bioeconomics: The Shifting Scope of Standard Economic Theory," Journal of Bioeconomics, Springer, vol. 9(2), pages 145-167, August.
    19. Sungho Park & Sachin Gupta, 2012. "Handling Endogenous Regressors by Joint Estimation Using Copulas," Marketing Science, INFORMS, vol. 31(4), pages 567-586, July.
    20. H. J. Van der Fels‐Klerx & Roger M. Cooke & Maarten N. Nauta & Louis H. Goossens & Arie H. Havelaar, 2005. "A Structured Expert Judgment Study for a Model of Campylobacter Transmission During Broiler‐Chicken Processing," Risk Analysis, John Wiley & Sons, vol. 25(1), pages 109-124, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orinte:v:34:y:2004:i:4:p:314-320. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.