IDEAS home Printed from https://ideas.repec.org/p/pie/dsedps/2023-297.html
   My bibliography  Save this paper

How much is too much? A methodological investigation of the literature on alcohol consumption

Author

Listed:
  • Stefano Castriota
  • Paolo Frumento
  • Francesco Suppressa

Abstract

Until a few years ago, moderate alcohol consumption was thought to have (mild) beneficial effects on health. However, some recent studies have suggested that "there is no safe level" of alcohol intake. Consequently, public health institutions have responded by advising against any level of alcohol use and suggesting governments a number of policies to reduce the overall alcohol consumption. Nonetheless, medical studies suffer from a variety of methodological issues that could undermine the reliability of the findings, especially when focusing on low-intake levels. We apply a search algorithm to extract 19,981 Confidence Intervals (CIs) from 6,763 medical abstracts, and show the existence of a clear publication bias which appears to have even increased and not decreased, in recent years. Further, we assess the quality of a sample of articles, showing the presence of several limitations such as omitted variable bias, miscalculation of alcohol intake, use of linear in place of non-linear models, and lack of validation of Mendelian Randomization (MR) assumptions. We conclude that the methodological limitations of the literature preclude us from claiming that "there is no safe level" of alcohol intake.

Suggested Citation

  • Stefano Castriota & Paolo Frumento & Francesco Suppressa, 2023. "How much is too much? A methodological investigation of the literature on alcohol consumption," Discussion Papers 2023/297, Dipartimento di Economia e Management (DEM), University of Pisa, Pisa, Italy.
    • Handle: RePEc:pie:dsedps:2023/297
    Note: ISSN 2039-1854
    as

    Download full text from publisher

    File URL: https://www.ec.unipi.it/documents/Ricerca/papers/2023-297.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Yon Ho Jee & Sun Ju Lee & Keum Ji Jung & Sun Ha Jee, 2016. "Alcohol Intake and Serum Glucose Levels from the Perspective of a Mendelian Randomization Design: The KCPS-II Biobank," PLOS ONE, Public Library of Science, vol. 11(9), pages 1-9, September.
    2. Erik W. van Zwet & Eric A. Cator, 2021. "The significance filter, the winner's curse and the need to shrink," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 75(4), pages 437-452, November.
    3. Shiu Lun Au Yeung & Chaoqiang Jiang & Kar Keung Cheng & Benjamin J Cowling & Bin Liu & Weisen Zhang & Tai Hing Lam & Gabriel M Leung & C Mary Schooling, 2013. "Moderate Alcohol Use and Cardiovascular Disease from Mendelian Randomization," PLOS ONE, Public Library of Science, vol. 8(7), pages 1-9, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stefano Castriota & Paolo Frumento & Francesco Suppressa, 2023. "How Much Is Too Much? A Methodological Investigation Of The Literature On Alcohol Consumption," CEIS Research Paper 560, Tor Vergata University, CEIS, revised 06 Jul 2023.
    2. Chung-Fen Tsai & Niall Anderson & Brenda Thomas & Cathie L M Sudlow, 2016. "Comparing Risk Factor Profiles between Intracerebral Hemorrhage and Ischemic Stroke in Chinese and White Populations: Systematic Review and Meta-Analysis," PLOS ONE, Public Library of Science, vol. 11(3), pages 1-15, March.
    3. Lin Xu & Chao Qiang Jiang & Kar Keung Cheng & Shiu Lun Ryan Au Yeung & Wei Sen Zhang & Tai Hing Lam & Catherine Mary Schooling, 2015. "Alcohol Use and Gamma-Glutamyltransferase Using a Mendelian Randomization Design in the Guangzhou Biobank Cohort Study," PLOS ONE, Public Library of Science, vol. 10(9), pages 1-10, September.
    4. Sander Greenland, 2023. "Divergence versus decision P‐values: A distinction worth making in theory and keeping in practice: Or, how divergence P‐values measure evidence even when decision P‐values do not," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 50(1), pages 54-88, March.
    5. Rabaa, Simon & Wilken, Robert & Geisendorf, Sylvie, 2024. "Does recalling energy efficiency measures reduce subsequent climate-friendly behavior? An experimental study of moral licensing rebound effects," Ecological Economics, Elsevier, vol. 217(C).
    6. Cantone, Giulio Giacomo, 2023. "The multiversal methodology as a remedy of the replication crisis," MetaArXiv kuhmz, Center for Open Science.
    7. Freuli, Francesca & Held, Leonhard & Heyard, Rachel, 2022. "Replication success under questionable research practices – a simulation study," MetaArXiv s4b65, Center for Open Science.
    8. Sinclair Carr & Dana Bryazka & Susan A. McLaughlin & Peng Zheng & Sarasvati Bahadursingh & Aleksandr Y. Aravkin & Simon I. Hay & Hilary R. Lawlor & Erin C. Mullany & Christopher J. L. Murray & Sneha I, 2024. "A burden of proof study on alcohol consumption and ischemic heart disease," Nature Communications, Nature, vol. 15(1), pages 1-16, December.

    More about this item

    Keywords

    Alcohol; health; safe level; publication bias; statistical bias;
    All these keywords.

    JEL classification:

    • I12 - Health, Education, and Welfare - - Health - - - Health Behavior
    • I18 - Health, Education, and Welfare - - Health - - - Government Policy; Regulation; Public Health

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pie:dsedps:2023/297. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/dspisit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.