IDEAS home Printed from https://ideas.repec.org/p/osf/socarx/5bck9.html

Replication in Social Science

Author

Listed:
  • Freese, Jeremy
  • Peterson, David

Abstract

Across the medical and social sciences, new discussions about replication have been transforming research practices. Sociologists, however, have been largely absent from these discussions. The goals of this review are to introduce sociologists to these developments, synthesize insights from science studies about replication in general, and detail the specific issues regarding replication that occur in sociology. The first half of the article argues that a sociologically sophisticated understanding of replication must take into account both the ways that replication rules and conventions evolved within an epistemic culture and how those cultures are shaped by specific research challenges. The second half outlines the four main dimensions of replicability in quantitative sociology- verifiability, robustness, repeatability, and generalizability- and discusses the specific ambiguities of interpretation that can arise in each. We conclude by advocating some commonsense changes to promote replication while acknowledging the epistemic diversity of our field.

Suggested Citation

  • Freese, Jeremy & Peterson, David, 2017. "Replication in Social Science," SocArXiv 5bck9, Center for Open Science.
    • Handle: RePEc:osf:socarx:5bck9
    DOI: 10.31219/osf.io/5bck9
    as

    Download full text from publisher

    File URL: https://osf.io/download/592c96676c613b0265c43f6a/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/5bck9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jesse Chandler & et. al, 2016. "Response to Comment on "Estimating the Reproducibility of Psychological Science"," Mathematica Policy Research Reports cff9c2f16bb544c4bcca530c0, Mathematica Policy Research.
    2. Annette N. Brown & Drew B. Cameron & Benjamin D. K. Wood, 2014. "Quality evidence for policymaking: I'll believe it when I see the replication," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 6(3), pages 215-235, September.
    3. Michael A. Clemens, 2017. "The Meaning Of Failed Replications: A Review And Proposal," Journal of Economic Surveys, Wiley Blackwell, vol. 31(1), pages 326-342, February.
    4. Andrew Abbott, 2007. "Notes on Replication," Sociological Methods & Research, , vol. 36(2), pages 210-219, November.
    5. Cartwright,Nancy, 1999. "The Dappled World," Cambridge Books, Cambridge University Press, number 9780521643368, November.
    6. Cartwright,Nancy, 1999. "The Dappled World," Cambridge Books, Cambridge University Press, number 9780521644112, November.
    7. Lall, Ranjit, 2016. "How Multiple Imputation Makes a Difference," Political Analysis, Cambridge University Press, vol. 24(4), pages 414-433.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Donovan, Kevin P., 2018. "The rise of the randomistas: on the experimental turn in international aid," SocArXiv xygzb, Center for Open Science.
    2. Guala, Francesco, 2006. "Getting the FCC auctions straight: A reply to Nik-Khah," economic sociology. perspectives and conversations, Max Planck Institute for the Study of Societies, vol. 7(3), pages 23-28.
    3. Ricardo F. Crespo, 2012. "Models as signs" as "good economic models," Estudios Economicos, Universidad Nacional del Sur, Departamento de Economia, vol. 29(58), pages 1-12, january-j.
    4. Piotr Tarka, 2018. "An overview of structural equation modeling: its beginnings, historical development, usefulness and controversies in the social sciences," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(1), pages 313-354, January.
    5. Giandomenica Becchio, 2020. "The Two Blades of Occam's Razor in Economics: Logical and Heuristic," Economic Thought, World Economics Association, vol. 9(1), pages 1-17, July.
    6. Sean Muller, 2012. "Econometric methods and Reichenbach's principle," SALDRU Working Papers 85, Southern Africa Labour and Development Research Unit, University of Cape Town.
    7. Julian Reiss, 2001. "Natural economic quantities and their measurement," Journal of Economic Methodology, Taylor & Francis Journals, vol. 8(2), pages 287-311.
    8. Aumann, Craig A., 2007. "A methodology for developing simulation models of complex systems," Ecological Modelling, Elsevier, vol. 202(3), pages 385-396.
    9. Florian Ellsaesser & Eric W. K. Tsang & Jochen Runde, 2014. "Models of causal inference: Imperfect but applicable is better than perfect but inapplicable," Strategic Management Journal, Wiley Blackwell, vol. 35(10), pages 1541-1551, October.
    10. Brown, Annette N. & Wood, Benjamin Douglas Kuflick, 2018. "Which tests not witch hunts: A diagnostic approach for conducting replication research," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy, vol. 12, pages 1-26.
    11. Łukasz Hardt, 2018. "Prawa ceteris rectis w ekonomii," Gospodarka Narodowa. The Polish Journal of Economics, Warsaw School of Economics, issue 1, pages 9-31.
    12. Stephen Pratten, 2007. "Realism, closed systems and abstraction," Journal of Economic Methodology, Taylor & Francis Journals, vol. 14(4), pages 473-497.
    13. Kinouchi, Renato, 2018. "Philosophical issues related to risks and values," LSE Research Online Documents on Economics 90470, London School of Economics and Political Science, LSE Library.
    14. Kevin Hoover, 2004. "Milton Friedman?s Stance: The Methodology of Causal Realism," Working Papers 222, University of California, Davis, Department of Economics.
    15. Francesco Guala, 2005. "Economics in the lab: Completeness vs. testability," Journal of Economic Methodology, Taylor & Francis Journals, vol. 12(2), pages 185-196.
    16. Marcel Boumans & Mary Morgan, 2002. "Ceteris paribus conditions: materiality and the application of economic theories," Journal of Economic Methodology, Taylor & Francis Journals, vol. 8(1), pages 11-26.
    17. Peter C. B. Phillips, 2003. "Laws and Limits of Econometrics," Economic Journal, Royal Economic Society, vol. 113(486), pages 26-52, March.
    18. Midgley, Gerald, 2008. "Response to paper "Systems thinking" by D. Cabrera et al.:: The unification of systems thinking: Is there gold at the end of the rainbow?," Evaluation and Program Planning, Elsevier, vol. 31(3), pages 317-321, August.
    19. Sadri, Arash, 2022. "The Ultimate Cause of the “Reproducibility Crisis”: Reductionist Statistics," MetaArXiv yxba5, Center for Open Science.
    20. Anne Chapman, 2006. "Regulating Chemicals—From Risks to Riskiness," Risk Analysis, John Wiley & Sons, vol. 26(3), pages 603-616, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:socarx:5bck9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://arabixiv.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.