IDEAS home Printed from https://ideas.repec.org/p/osf/metaar/gn8ur_v1.html

Do Standard Error Corrections Exacerbate Publication Bias?

Author

Listed:
  • Vu, Patrick

Abstract

In a canonical model of the publication process, I show that the interaction between standard error corrections and selective publication can inadvertently increase bias in published studies. This occurs because larger standard errors raise the bar for statistical significance, exacerbating publication bias. I examine this phenomenon in difference-in-differences studies, where clustering is associated with a near doubling of effect sizes. Using an empirical model, I find that clustering led to large improvements in coverage but also sizable increases in bias. Nonetheless, clustering is welfare-improving from a decision-theoretic standpoint, as more accurate belief updating outweighs the costs of increased publication bias.

Suggested Citation

  • Vu, Patrick, 2025. "Do Standard Error Corrections Exacerbate Publication Bias?," MetaArXiv gn8ur_v1, Center for Open Science.
  • Handle: RePEc:osf:metaar:gn8ur_v1
    DOI: 10.31222/osf.io/gn8ur_v1
    as

    Download full text from publisher

    File URL: https://osf.io/download/69155f0cf669c7f22ae30020/
    Download Restriction: no

    File URL: https://libkey.io/10.31222/osf.io/gn8ur_v1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. McFadden, Daniel, 1989. "A Method of Simulated Moments for Estimation of Discrete Response Models without Numerical Integration," Econometrica, Econometric Society, vol. 57(5), pages 995-1026, September.
    2. Whitney Newey & Kenneth West, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    3. Douglas Staiger & James H. Stock, 1997. "Instrumental Variables Regression with Weak Instruments," Econometrica, Econometric Society, vol. 65(3), pages 557-586, May.
    4. Stefano DellaVigna & Elizabeth Linos, 2022. "RCTs to Scale: Comprehensive Evidence From Two Nudge Units," Econometrica, Econometric Society, vol. 90(1), pages 81-116, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:bla:ecorec:v:91:y:2015:i::p:1-24 is not listed on IDEAS
    2. Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91(S1), pages 1-24, June.
    3. Isaiah Andrews & Anna Mikusheva, 2016. "Conditional Inference With a Functional Nuisance Parameter," Econometrica, Econometric Society, vol. 84, pages 1571-1612, July.
    4. Frank Kleibergen, 2004. "Expansions of GMM statistics that indicate their properties under weak and/or many instruments and the bootstrap," Econometric Society 2004 North American Summer Meetings 408, Econometric Society.
    5. Guilhem Bascle, 2008. "Controlling for endogeneity with instrumental variables in strategic management research," Post-Print hal-00576795, HAL.
    6. Woutersen, Tiemen & Hausman, Jerry A., 2019. "Increasing the power of specification tests," Journal of Econometrics, Elsevier, vol. 211(1), pages 166-175.
    7. Oscar Jorda & Sharon Kozicki, 2007. "Estimation and Inference by the Method of Projection Minimum Distance," Working Papers 148, University of California, Davis, Department of Economics.
    8. Gergely Ganics & Atsushi Inoue & Barbara Rossi, 2021. "Confidence Intervals for Bias and Size Distortion in IV and Local Projections-IV Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 307-324, January.
    9. Faff, Robert & Gray, Philip, 2006. "On the estimation and comparison of short-rate models using the generalised method of moments," Journal of Banking & Finance, Elsevier, vol. 30(11), pages 3131-3146, November.
    10. Marcelo Moreira & Geert Ridder, 2019. "Efficiency loss of asymptotically efficient tests in an instrumental variables regression," CeMMAP working papers CWP03/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    11. Jørgensen, Peter Lihn & Lansing, Kevin J., 2025. "Anchored inflation expectations and the slope of the Phillips curve," European Economic Review, Elsevier, vol. 178(C).
    12. Bettin, Giulia & Sacchi, Agnese, 2020. "Health spending in Italy: The impact of immigrants," European Journal of Political Economy, Elsevier, vol. 65(C).
    13. Hall, George & Rust, John, 2021. "Estimation of endogenously sampled time series: The case of commodity price speculation in the steel market," Journal of Econometrics, Elsevier, vol. 222(1), pages 219-243.
    14. Brandt, Michael W. & Wang, Kevin Q., 2003. "Time-varying risk aversion and unexpected inflation," Journal of Monetary Economics, Elsevier, vol. 50(7), pages 1457-1498, October.
    15. William Duncombe & Yilin Hou, 2014. "The Savings Behavior of Special Purpose Governments: A Panel Study of New York School Districts," Public Budgeting & Finance, Wiley Blackwell, vol. 34(3), pages 1-23, September.
    16. Christopher F Baum & Mark E. Schaffer & Steven Stillman, 2007. "Enhanced routines for instrumental variables/GMM estimation and testing," Boston College Working Papers in Economics 667, Boston College Department of Economics, revised 05 Sep 2007.
    17. Leith, Campbell & Malley, Jim, 2005. "Estimated general equilibrium models for the evaluation of monetary policy in the US and Europe," European Economic Review, Elsevier, vol. 49(8), pages 2137-2159, November.
    18. Juan Manuel Martín-Álvarez & Miguel Ángel Del Arco-Osuna & Aida Galiano & Brenda Vázquez-La Hoz, 2026. "Estimating the Tobacco Kuznets relationship in Spain (1957–2023): income curvature, projected turning points, and policy implications," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 53(3), pages 1005-1028, August.
    19. Choi, Yoonseok & Kim, Sunghyun, 2016. "Testing an alternative price-setting behavior in the new Keynesian Phillips curve: Extrapolative price-setting mechanism," International Review of Economics & Finance, Elsevier, vol. 44(C), pages 253-265.
    20. Michael Funke, 2005. "Inflation in Mainland China - Modelling a Roller Coaster Ride," Working Papers 152005, Hong Kong Institute for Monetary Research.
    21. Isaiah Andrews & Timothy B. Armstrong, 2017. "Unbiased instrumental variables estimation under known first‐stage sign," Quantitative Economics, Econometric Society, vol. 8(2), pages 479-503, July.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:metaar:gn8ur_v1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/metaarxiv .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.