IDEAS home Printed from https://ideas.repec.org/p/osf/metaar/t93cg.html
   My bibliography  Save this paper

Toward More Transparency in Statistical Practice

Author

Listed:
  • Wagenmakers, Eric-Jan

    (University of Amsterdam)

  • Sarafoglou, Alexandra

    (University of Amsterdam)

  • Aarts, Sil Dr.

    (Maastricht University)

  • Albers, Casper J

    (University of Groningen)

  • Algermissen, Johannes

    (Radboud University Nijmegen)

  • Bahník, Štěpán

    (University of Economics, Prague)

  • van Dongen, Noah N'Djaye Nikolai
  • Hoekstra, Rink
  • Moreau, David
  • van Ravenzwaaij, Don

    (University of Groningen)

Abstract

We explore the promise of statistical reform by starting from the assumption that most researchers would endorse Merton's ethos of science as reflected in the four norms of communalism, universalism, disinterestedness, and organized skepticism. Translated to data analysis, these norms imply a need for transparency, a fair acknowledgement of uncertainty, and openness to alternative interpretations. We discuss seven statistical procedures, both old and new, that we believe can positively impact statistical practice in the social and behavioral sciences.

Suggested Citation

  • Wagenmakers, Eric-Jan & Sarafoglou, Alexandra & Aarts, Sil Dr. & Albers, Casper J & Algermissen, Johannes & Bahník, Štěpán & van Dongen, Noah N'Djaye Nikolai & Hoekstra, Rink & Moreau, David & van Rav, 2021. "Toward More Transparency in Statistical Practice," MetaArXiv t93cg, Center for Open Science.
    • Handle: RePEc:osf:metaar:t93cg
    DOI: 10.31219/osf.io/t93cg
    as

    Download full text from publisher

    File URL: https://osf.io/download/603e494967386c031361e531/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/t93cg?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Gelman A. & Pasarica C. & Dodhia R., 2002. "Lets Practice What We Preach: Turning Tables into Graphs," The American Statistician, American Statistical Association, vol. 56, pages 121-130, May.
    2. Blakeley B. McShane & David Gal & Andrew Gelman & Christian Robert & Jennifer L. Tackett, 2019. "Abandon Statistical Significance," The American Statistician, Taylor & Francis Journals, vol. 73(S1), pages 235-245, March.
    3. Levine, Ross & Renelt, David, 1992. "A Sensitivity Analysis of Cross-Country Growth Regressions," American Economic Review, American Economic Association, vol. 82(4), pages 942-963, September.
    4. Tracey L Weissgerber & Natasa M Milic & Stacey J Winham & Vesna D Garovic, 2015. "Beyond Bar and Line Graphs: Time for a New Data Presentation Paradigm," PLOS Biology, Public Library of Science, vol. 13(4), pages 1-10, April.
    5. Noah N. N. van Dongen & Johnny B. van Doorn & Quentin F. Gronau & Don van Ravenzwaaij & Rink Hoekstra & Matthias N. Haucke & Daniel Lakens & Christian Hennig & Richard D. Morey & Saskia Homer & Andrew, 2019. "Multiple Perspectives on Inference for Two Simple Statistical Scenarios," The American Statistician, Taylor & Francis Journals, vol. 73(S1), pages 328-339, March.
    6. Athey, Susan & Imbens, Guido W., 2019. "Machine Learning Methods Economists Should Know About," Research Papers 3776, Stanford University, Graduate School of Business.
    7. Uri Simonsohn & Joseph P. Simmons & Leif D. Nelson, 2020. "Specification curve analysis," Nature Human Behaviour, Nature, vol. 4(11), pages 1208-1214, November.
    8. Susan Athey & Guido W. Imbens, 2019. "Machine Learning Methods That Economists Should Know About," Annual Review of Economics, Annual Reviews, vol. 11(1), pages 685-725, August.
    9. Darren B Taichman & Peush Sahni & Anja Pinborg & Larry Peiperl & Christine Laine & Astrid James & Sung-Tae Hong & Abraham Haileamlak & Laragh Gollogly & Fiona Godlee & Frank A Frizelle & Fernando Flor, 2017. "Data Sharing Statements for Clinical Trials: A Requirement of the International Committee of Medical Journal Editors," PLOS Medicine, Public Library of Science, vol. 14(6), pages 1-3, June.
    10. Leamer, Edward E, 1985. "Sensitivity Analyses Would Help," American Economic Review, American Economic Association, vol. 75(3), pages 308-313, June.
    11. Jonah Gabry & Daniel Simpson & Aki Vehtari & Michael Betancourt & Andrew Gelman, 2019. "Visualization in Bayesian workflow," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 182(2), pages 389-402, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bennett, Davara L. & Webb, Calum J.R. & Mason, Kate E. & Schlüter, Daniela K. & Fahy, Katie & Alexiou, Alexandros & Wickham, Sophie & Barr, Ben & Taylor-Robinson, David, 2021. "Funding for preventative Children’s Services and rates of children becoming looked after: A natural experiment using longitudinal area-level data in England," Children and Youth Services Review, Elsevier, vol. 131(C).
    2. Sacker, Amanda & Lacey, Rebecca E. & Maughan, Barbara & Murray, Emily T., 2022. "Out-of-home care in childhood and socio-economic functioning in adulthood: ONS Longitudinal study 1971–2011," Children and Youth Services Review, Elsevier, vol. 132(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Eric-Jan Wagenmakers & Alexandra Sarafoglou & Sil Aarts & Casper Albers & Johannes Algermissen & Štěpán Bahník & Noah Dongen & Rink Hoekstra & David Moreau & Don Ravenzwaaij & Aljaž Sluga & Franziska , 2021. "Seven steps toward more transparency in statistical practice," Nature Human Behaviour, Nature, vol. 5(11), pages 1473-1480, November.
    2. Guillaume Coqueret, 2023. "Forking paths in financial economics," Papers 2401.08606, arXiv.org.
    3. Gabriel Okasa & Kenneth A. Younge, 2022. "Sample Fit Reliability," Papers 2209.06631, arXiv.org.
    4. Ay, Jean-Sauveur & Le Gallo, Julie, 2021. "The Signaling Values of Nested Wine Names," Working Papers 321851, American Association of Wine Economists.
    5. Rok Spruk & Mitja Kovac, 2018. "Inefficient Growth," Review of Economics and Institutions, Università di Perugia, vol. 9(2).
    6. R Burger & S du Plessis, 2011. "Examining the Robustness of Competing Explanations of Slow Growth in African Countries," Studies in Economics and Econometrics, Taylor & Francis Journals, vol. 35(3), pages 21-47, December.
    7. Martin Gassebner & Jerg Gutmann & Stefan Voigt, 2016. "When to expect a coup d’état? An extreme bounds analysis of coup determinants," Public Choice, Springer, vol. 169(3), pages 293-313, December.
    8. Tsang, Andrew, 2021. "Uncovering Heterogeneous Regional Impacts of Chinese Monetary Policy," MPRA Paper 110703, University Library of Munich, Germany.
    9. Kyle Colangelo & Ying-Ying Lee, 2019. "Double debiased machine learning nonparametric inference with continuous treatments," CeMMAP working papers CWP54/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    10. Daniel Goller, 2023. "Analysing a built-in advantage in asymmetric darts contests using causal machine learning," Annals of Operations Research, Springer, vol. 325(1), pages 649-679, June.
    11. C. Alper & S. Cakici, 2009. "Financial Liberalization, Fiscal Prudence and Growth: Panel Evidence from 1980–2003," Open Economies Review, Springer, vol. 20(4), pages 509-524, September.
    12. Rodríguez-Vargas, Adolfo, 2020. "Forecasting Costa Rican inflation with machine learning methods," Latin American Journal of Central Banking (previously Monetaria), Elsevier, vol. 1(1).
    13. Jesus Fernandez-Villaverde, 2020. "Simple Rules for a Complex World with Arti?cial Intelligence," PIER Working Paper Archive 20-010, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    14. Klump, R. & Prüfer, P., 2006. "Prioritizing Policies for Pro-Poor Growth : Applying Bayesian Model Averaging to Vietnam," Other publications TiSEM dc14add6-f581-4eea-92dd-3, Tilburg University, School of Economics and Management.
    15. Blankenship, Brian & Aklin, Michaël & Urpelainen, Johannes & Nandan, Vagisha, 2022. "Jobs for a just transition: Evidence on coal job preferences from India," Energy Policy, Elsevier, vol. 165(C).
    16. Andrei Dubovik & Adam Elbourne & Bram Hendriks & Mark Kattenberg, 2022. "Forecasting World Trade Using Big Data and Machine Learning Techniques," CPB Discussion Paper 441, CPB Netherlands Bureau for Economic Policy Analysis.
    17. Joshua D. Angrist & Jörn-Steffen Pischke, 2010. "The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 3-30, Spring.
    18. Mark F. J. Steel, 2020. "Model Averaging and Its Use in Economics," Journal of Economic Literature, American Economic Association, vol. 58(3), pages 644-719, September.
    19. Mark Kattenberg & Bas Scheer & Jurre Thiel, 2023. "Causal forests with fixed effects for treatment effect heterogeneity in difference-in-differences," CPB Discussion Paper 452, CPB Netherlands Bureau for Economic Policy Analysis.
    20. Michael C Knaus, 2022. "Double machine learning-based programme evaluation under unconfoundedness [Econometric methods for program evaluation]," The Econometrics Journal, Royal Economic Society, vol. 25(3), pages 602-627.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:metaar:t93cg. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/metaarxiv .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.