IDEAS home Printed from https://ideas.repec.org/a/cup/jwecon/v3y2008i02p105-113_00.html
   My bibliography  Save this article

An Examination of Judge Reliability at a major U.S. Wine Competition

Author

Listed:
  • Hodgson, Robert T.

Abstract

Wine judge performance at a major wine competition has been analyzed from 2005 to 2008 using replicate samples. Each panel of four expert judges received a flight of 30 wines imbedded with triplicate samples poured from the same bottle. Between 65 and 70 judges were tested each year. About 10 percent of the judges were able to replicate their score within a single medal group. Another 10 percent, on occasion, scored the same wine Bronze to Gold. Judges tend to be more consistent in what they don't like than what they do. An analysis of variance covering every panel over the study period indicates only about half of the panels presented awards based solely on wine quality. (JEL Classification: Q13, Q19)

Suggested Citation

  • Hodgson, Robert T., 2008. "An Examination of Judge Reliability at a major U.S. Wine Competition," Journal of Wine Economics, Cambridge University Press, vol. 3(2), pages 105-113, January.
    • Handle: RePEc:cup:jwecon:v:3:y:2008:i:02:p:105-113_00
    as

    Download full text from publisher

    File URL: https://www.cambridge.org/core/product/identifier/S1931436100001152/type/journal_article
    File Function: link to article abstract page
    Download Restriction: no
    ---><---

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chen, Natalie & Juvenal, Luciana, 2018. "Quality and the Great Trade Collapse," Journal of Development Economics, Elsevier, vol. 135(C), pages 59-76.
    2. Pecchioli, Bruno & Moroz, David, 2023. "Do geographical appellations provide useful quality signals? The case of Scotch single malt whiskies," Economic Modelling, Elsevier, vol. 124(C).
    3. Clarissa Laura Maria Spiess Bru, 2023. "Does the Tasting Note Matter? Language Categories and Their Impact on Professional Ratings and Prices," Working Papers Dissertations 105, Paderborn University, Faculty of Business Administration and Economics.
    4. António Osório, 2020. "Performance Evaluation: Subjectivity, Bias and Judgment Style in Sport," Group Decision and Negotiation, Springer, vol. 29(4), pages 655-678, August.
    5. Olivier Gergaud & Victor Ginsburgh & Juan D. Moreno-Ternero, 2020. "Wine Ratings," Working Papers ECARES 2020-38, ULB -- Universite Libre de Bruxelles.
    6. Chen, Natalie & Juvenal, Luciana, 2016. "Quality, trade, and exchange rate pass-through," Journal of International Economics, Elsevier, vol. 100(C), pages 61-80.
    7. Gergaud, Olivier & Ginsburgh, Victor & Moreno-Ternero, Juan D., 2021. "Wine Ratings: Seeking a Consensus among Tasters via Normalization, Approval, and Aggregation," Journal of Wine Economics, Cambridge University Press, vol. 16(3), pages 321-342, August.
    8. Almenberg, Johan & Dreber, Anna, 2011. "When Does the Price Affect the Taste? Results from a Wine Experiment," Journal of Wine Economics, Cambridge University Press, vol. 6(1), pages 111-121, January.
    9. Julian M. Alston & Davide Gaeta, 2021. "Reflections on the Political Economy of European Wine Appellations," Italian Economic Journal: A Continuation of Rivista Italiana degli Economisti and Giornale degli Economisti, Springer;Società Italiana degli Economisti (Italian Economic Association), vol. 7(2), pages 219-258, July.
    10. Osório, António (António Miguel), 2016. "Judgement and Ranking: Living with Hidden Bias," Working Papers 2072/267264, Universitat Rovira i Virgili, Department of Economics.
    11. Victor Ginsburgh, 2016. "On Judging Art and Wine," Working Papers ECARES ECARES 2016-21, ULB -- Universite Libre de Bruxelles.
    12. Amogh Prakasha Kumar & Richard Watt & Laura Meriluoto, 2021. "New Evidence on Using Expert Ratings to Proxy for Wine Quality in Climate Change Research," Working Papers in Economics 21/10, University of Canterbury, Department of Economics and Finance.
    13. Rössel, Jörg & Beckert, Jens, 2012. "Quality classifications in competition: Price formation in the German wine market," MPIfG Discussion Paper 12/3, Max Planck Institute for the Study of Societies.
    14. António Osório, 2017. "Judgement and ranking: living with hidden bias," Annals of Operations Research, Springer, vol. 253(1), pages 501-518, June.
    15. Emmanuel Paroissien & Michael Visser, 2020. "The Causal Impact of Medals on Wine Producers' Prices and the Gains from Participating in Contests," American Journal of Agricultural Economics, John Wiley & Sons, vol. 102(4), pages 1135-1153, August.
    16. Wallentin, Erik, 2016. "Demand for cinema and diverging tastes of critics and audiences," Journal of Retailing and Consumer Services, Elsevier, vol. 33(C), pages 72-81.

    More about this item

    JEL classification:

    • Q13 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Agriculture - - - Agricultural Markets and Marketing; Cooperatives; Agribusiness
    • Q19 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Agriculture - - - Other

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cup:jwecon:v:3:y:2008:i:02:p:105-113_00. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Kirk Stebbing (email available below). General contact details of provider: https://www.cambridge.org/jwe .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.