The Economics of Replication
Replication studies are considered a hallmark of good scientific practice. Yet they are treated among researchers as an ideal to be professed but not practiced. To provide incentives and favorable boundary conditions for replication practice, the main stakeholders need to be aware of what drives replication. Here we investigate how often replication studies are published in empirical economics and what types of journal articles are replicated. We find that from 1974 to 2014 less than 0.1% of publications in the top-50 economics journals were replications. We do not find empirical support that mandatory data disclosure policies or the availability of data or code have a significant effect on the incidence of replication. The mere provision of data repositories may be ineffective, unless accompanied by appropriate incentives. However, we find that higher-impact articles and articles by authors from leading institutions are more likely to be subject of published replication studies whereas the replication probability is lower for articles published in higher-ranked journals.
|Date of creation:||Jan 2017|
|Contact details of provider:|| Postal: IZA, P.O. Box 7240, D-53072 Bonn, Germany|
Phone: +49 228 3894 223
Fax: +49 228 3894 180
Web page: http://www.iza.org
|Order Information:|| Postal: IZA, Margard Ody, P.O. Box 7240, D-53072 Bonn, Germany|
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- David Card & Stefano DellaVigna, 2013.
"Nine Facts about Top Journals in Economics,"
Journal of Economic Literature,
American Economic Association, vol. 51(1), pages 144-161, March.
- David Card & Stefano DellaVigna, 2013. "Nine Facts about Top Journals in Economics," NBER Working Papers 18665, National Bureau of Economic Research, Inc.
- Furman, Jeffrey L. & Jensen, Kyle & Murray, Fiona, 2012. "Governing knowledge in the scientific community: Exploring the role of retractions in biomedicine," Research Policy, Elsevier, vol. 41(2), pages 276-290.
- Andreoli-Versbach, Patrick & Mueller-Langer, Frank, 2014. "Open access to data: An ideal professed but not practised," Research Policy, Elsevier, vol. 43(9), pages 1621-1633.
- Patrick Andreoli-Versbach & Frank Mueller-Langer, 2013. "Open Access to Data: An Ideal Professed but not Practised," Working Paper Series of the German Council for Social and Economic Data 215, German Council for Social and Economic Data (RatSWD).
- Nicola Lacetera & Lorenzo Zirulia, 2011. "The Economics of Scientific Misconduct," Journal of Law, Economics and Organization, Oxford University Press, vol. 27(3), pages 568-603.
- Nicola Lacetera & Lorenzo Zirulia, 2008. "The Economics of Scientific Misconduct," KITeS Working Papers 215, KITeS, Centre for Knowledge, Internationalization and Technology Studies, Universita' Bocconi, Milano, Italy, revised Apr 2008.
- Maren Duvendack & Richard W. Palmer-Jones & W. Robert Reed, 2014. "Replications in Economics: A Progress Report," Working Papers in Economics 14/26, University of Canterbury, Department of Economics and Finance.
- Daniel S. Hamermesh, 2007. "Viewpoint: Replication in economics," Canadian Journal of Economics, Canadian Economics Association, vol. 40(3), pages 715-733, August. Full references (including those not matched with items on IDEAS)
When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp10533. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Mark Fallak)
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.