IDEAS home Printed from https://ideas.repec.org/p/osf/socarx/67jh7.html

Cumulative science via Bayesian posterior passing, an introduction

Author

Listed:
  • Brand, Charlotte Olivia

    (University of Exeter)

  • Ounsley, James
  • van der Post, Daniel
  • Morgan, Tom

Abstract

This paper introduces a statistical technique known as “posterior passing” in which the results of past studies can be used to inform the analyses carried out by subsequent studies. We first describe the technique in detail and show how it can be implemented by individual researchers on an experiment by experiment basis. We then use a simulation to explore its success in identifying true parameter values compared to current statistical norms (ANOVAs and GLMMs). We find that posterior passing allows the true effect in the population to be found with greater accuracy and consistency than the other analysis types considered. Furthermore, posterior passing performs almost identically to a data analysis in which all data from all simulated studies are combined and analysed as one dataset. On this basis, we suggest that posterior passing is a viable means of implementing cumulative science. Furthermore, because it prevents the accumulation of large bodies of conflicting literature, it alleviates the need for traditional meta-analyses. Instead, posterior passing cumulatively and collaboratively provides clarity in real time as each new study is produced and is thus a strong candidate for a new, cumulative approach to scientific analyses and publishing.

Suggested Citation

  • Brand, Charlotte Olivia & Ounsley, James & van der Post, Daniel & Morgan, Tom, 2017. "Cumulative science via Bayesian posterior passing, an introduction," SocArXiv 67jh7, Center for Open Science.
  • Handle: RePEc:osf:socarx:67jh7
    DOI: 10.31219/osf.io/67jh7
    as

    Download full text from publisher

    File URL: https://osf.io/download/58dba79e9ad5a101fadc412a/
    Download Restriction: no

    File URL: https://libkey.io/10.31219/osf.io/67jh7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Marcus R. Munafò & Brian A. Nosek & Dorothy V. M. Bishop & Katherine S. Button & Christopher D. Chambers & Nathalie Percie du Sert & Uri Simonsohn & Eric-Jan Wagenmakers & Jennifer J. Ware & John P. A, 2017. "A manifesto for reproducible science," Nature Human Behaviour, Nature, vol. 1(1), pages 1-9, January.
    2. Daniel J. Benjamin & James O. Berger & Magnus Johannesson & Brian A. Nosek & E.-J. Wagenmakers & Richard Berk & Kenneth A. Bollen & Björn Brembs & Lawrence Brown & Colin Camerer & David Cesarini & Chr, 2018. "Redefine statistical significance," Nature Human Behaviour, Nature, vol. 2(1), pages 6-10, January.
      • Daniel Benjamin & James Berger & Magnus Johannesson & Brian Nosek & E. Wagenmakers & Richard Berk & Kenneth Bollen & Bjorn Brembs & Lawrence Brown & Colin Camerer & David Cesarini & Christopher Chambe, 2017. "Redefine Statistical Significance," Artefactual Field Experiments 00612, The Field Experiments Website.
    3. Mina Bissell, 2013. "Reproducibility: The risks of the replication drive," Nature, Nature, vol. 503(7476), pages 333-334, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lion Behrens & Ingo Rohlfing, 2026. "The Integration of Bayesian Regression Analysis and Bayesian Process Tracing in Mixed-Methods Research," Sociological Methods & Research, , vol. 55(1), pages 186-218, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Oliver Braganza, 2020. "A simple model suggesting economically rational sample-size choice drives irreproducibility," PLOS ONE, Public Library of Science, vol. 15(3), pages 1-19, March.
    2. Bernhard Voelkl & Lucile Vogt & Emily S Sena & Hanno Würbel, 2018. "Reproducibility of preclinical animal research improves with heterogeneity of study samples," PLOS Biology, Public Library of Science, vol. 16(2), pages 1-13, February.
    3. repec:osf:socarx:67jh7_v1 is not listed on IDEAS
    4. Jeff Miller & Rolf Ulrich, 2019. "The quest for an optimal alpha," PLOS ONE, Public Library of Science, vol. 14(1), pages 1-13, January.
    5. Sarstedt, Marko & Adler, Susanne J., 2023. "An advanced method to streamline p-hacking," Journal of Business Research, Elsevier, vol. 163(C).
    6. Logg, Jennifer M. & Dorison, Charles A., 2021. "Pre-registration: Weighing costs and benefits for researchers," Organizational Behavior and Human Decision Processes, Elsevier, vol. 167(C), pages 18-27.
    7. Mayo, Deborah, 2024. "Error statistics, Bayes-factor Tests and the Fallacy of Non-exhaustive Alternatives," OSF Preprints tmgqd, Center for Open Science.
    8. Dreber, Anna & Heikensten, Emma & Säve-Söderbergh, Jenny, 2022. "Why do women ask for less?," Labour Economics, Elsevier, vol. 78(C).
    9. Brenøe, Anne Ardila & Eyibak, Zeynep & Heursen, Lea & Ranehill, Eva & Weber, Roberto A., 2024. "Gender Identity and Economic Decision Making," IZA Discussion Papers 17564, IZA Network @ LISER.
    10. Buchanan, Erin Michelle & Scofield, John E., 2017. "Bulletproof Bias? Considering the Type of Data in Common Proportion of Variance Effect Sizes," OSF Preprints cs4vy, Center for Open Science.
    11. John A. List, 2024. "Optimally generate policy-based evidence before scaling," Nature, Nature, vol. 626(7999), pages 491-499, February.
    12. Samahita, Margaret & Holm, Håkan J., 2020. "Mining for Mood Effect in the Field," Working Papers 2020:2, Lund University, Department of Economics.
    13. Fossen, Frank M. & Neyse, Levent & Johannesson, Magnus & Dreber Almenberg, Anna, 2020. "2D:4D and Self-Employment Using SOEP Data: A Replication Study," IZA Discussion Papers 13180, IZA Network @ LISER.
    14. Jonas Vandenbruaene & Marc De Ceuster & Jan Annaert, 2022. "Efficient Spread Betting Markets: A Literature Review," Journal of Sports Economics, , vol. 23(7), pages 907-949, October.
    15. Piers Steel & Sjoerd Beugelsdijk & Herman Aguinis, 2021. "The anatomy of an award-winning meta-analysis: Recommendations for authors, reviewers, and readers of meta-analytic reviews," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 52(1), pages 23-44, February.
    16. Huber, Christoph & Huber, Jürgen & Kirchler, Michael, 2021. "Market shocks and professionals’ investment behavior – Evidence from the COVID-19 crash," Journal of Banking & Finance, Elsevier, vol. 133(C).
    17. Gonzalez-Jimenez, David & Capozza, Francesco & Dirkmaat, Thomas & van de Veer, Evelien & van Druten, Amber & Baillon, Aurélien, 2025. "Falling and failing (to learn): Evidence from a nation-wide cybersecurity field experiment with SMEs," Journal of Economic Behavior & Organization, Elsevier, vol. 230(C).
    18. Vigren, Andreas & Pyddoke, Roger, 2020. "The impact on bus ridership of passenger incentive contracts in public transport," Transportation Research Part A: Policy and Practice, Elsevier, vol. 135(C), pages 144-159.
    19. Khuram Mirza, 2023. "An analysis of early marriage in Pakhtun society: determinants, consequences, and interventions," Journal of International Relations and Social Dynamics, 50sea, vol. 2(2), pages 53-63, August.
    20. Dudek, Thomas & Brenøe, Anne Ardila & Feld, Jan & Rohrer, Julia, 2022. "No Evidence That Siblings' Gender Affects Personality across Nine Countries," IZA Discussion Papers 15137, IZA Network @ LISER.
    21. Caicedo, Juan D. & Guirado, Carlos & González, Marta C. & Walker, Joan L., 2025. "Sharing, collaborating, and benchmarking to advance travel demand research: A demonstration of short-term ridership prediction," Transport Policy, Elsevier, vol. 171(C), pages 531-541.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:socarx:67jh7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://arabixiv.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.