IDEAS home Printed from https://ideas.repec.org/p/fip/fedlwp/2005-014.html
   My bibliography  Save this paper

The role of data & program code archives in the future of economic research

Author

Listed:
  • Richard G. Anderson
  • William H. Greene
  • Bruce D. McCullough
  • Hrishikesh D. Vinod

Abstract

This essay examines the role of data and program-code archives in making economic research \"replicable.\" Replication of published results is recognized as an essential part of the scientific method. Yet, historically, both the \"demand for\" and \"supply of\" replicable results in economics has been minimal. \"Respect for the scientific method\" is not sufficient to motivate either economists or editors of professional journals to ensure the replicability of published results. We enumerate the costs and benefits of mandatory data and code archives, and argue that the benefits far exceed the costs. Progress has been made since the gloomy assessment of Dewald, Thursby and Anderson some twenty years ago in the American Economic Review, but much remains to be done before empirical economics ceases to be a \"dismal science\" when judged by the replicability of its published results.

Suggested Citation

  • Richard G. Anderson & William H. Greene & Bruce D. McCullough & Hrishikesh D. Vinod, 2005. "The role of data & program code archives in the future of economic research," Working Papers 2005-014, Federal Reserve Bank of St. Louis.
    • Handle: RePEc:fip:fedlwp:2005-014
    as

    Download full text from publisher

    File URL: http://research.stlouisfed.org/wp/more/2005-014/
    Download Restriction: no
    File URL: http://research.stlouisfed.org/wp/2005/2005-014.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Vinod, H. D., 2001. "Care and feeding of reproducible econometrics," Journal of Econometrics, Elsevier, vol. 100(1), pages 87-88, January.
    2. Christian Kleiber & Achim Zeileis, 2005. "Validating multiple structural change models-a case study," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(5), pages 685-690.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Leonard E. Burman & W. Robert Reed & James Alm, 2011. "A Call for Replication Studies," Public Finance Review, , vol. 39(1), pages 190-190, January.
    2. Richard G. Anderson, 2006. "Replicability, real-time data, and the science of economic research: FRED, ALFRED, and VDC," Review, Federal Reserve Bank of St. Louis, vol. 88(Jan), pages 81-93.
    3. Works, Richard Floyd, 2016. "Econometric modeling of exchange rate determinants by market classification: An empirical analysis of Japan and South Korea using the sticky-price monetary theory," MPRA Paper 76382, University Library of Munich, Germany.
    4. Gary King, 2007. "An Introduction to the Dataverse Network as an Infrastructure for Data Sharing," Sociological Methods & Research, , vol. 36(2), pages 173-199, November.
    5. Cristobal Young & Charles Varner, 2015. "A Reply to “A Replication of “Millionaire Migration and State Taxation of Top Incomes," Public Finance Review, , vol. 43(2), pages 226-234, March.
    6. Sylvérie Herbert & Hautahi Kingi & Flavio Stanchi & Lars Vilhubern, 2021. "The Reproducibility of Economics Research: A Case Study," Working papers 853, Banque de France.
    7. Giovanni Baiocchi, 2007. "Reproducible research in computational economics: guidelines, integrated approaches, and open source software," Computational Economics, Springer;Society for Computational Economics, vol. 30(1), pages 19-40, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. A. Yalta & A. Yalta, 2010. "Should Economists Use Open Source Software for Doing Research?," Computational Economics, Springer;Society for Computational Economics, vol. 35(4), pages 371-394, April.
    2. Zeileis, Achim, 2004. "Econometric Computing with HC and HAC Covariance Matrix Estimators," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 11(i10).
    3. Kleiber Christian & Zeileis Achim, 2010. "The Grunfeld Data at 50," German Economic Review, De Gruyter, vol. 11(4), pages 404-417, December.
    4. DIMA, Bogdan & DIMA, Ştefana Maria & IOAN, Roxana, 2021. "Remarks on the behaviour of financial market efficiency during the COVID-19 pandemic. The case of VIX," Finance Research Letters, Elsevier, vol. 43(C).
    5. repec:jss:jstsof:11:i10 is not listed on IDEAS
    6. Aboura, Sofiane & Chevallier, Julien, 2013. "Leverage vs. feedback: Which Effect drives the oil market?," Finance Research Letters, Elsevier, vol. 10(3), pages 131-141.
    7. Kholodilin Konstantin Arkadievich & Siliverstovs Boriss, 2006. "On the Forecasting Properties of the Alternative Leading Indicators for the German GDP: Recent Evidence," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 226(3), pages 234-259, June.
    8. Yalta, A. Talha & Jenal, Olaf, 2009. "On the importance of verifying forecasting results," International Journal of Forecasting, Elsevier, vol. 25(1), pages 62-73.
    9. Fabio Clementi & Marco Gallegati & Mauro Gallegati, 2015. "Growth and Cycles of the Italian Economy Since 1861: The New Evidence," Italian Economic Journal: A Continuation of Rivista Italiana degli Economisti and Giornale degli Economisti, Springer;Società Italiana degli Economisti (Italian Economic Association), vol. 1(1), pages 25-59, March.
    10. Christian Kleiber & Achim Zeileis, 2010. "The Grunfeld Data at 50," German Economic Review, Verein für Socialpolitik, vol. 11(4), pages 404-417, November.
    11. Han Lin Shang & Jiguo Cao & Peijun Sang, 2022. "Stopping time detection of wood panel compression: A functional time‐series approach," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 71(5), pages 1205-1224, November.
    12. Greyling, Jan & Pardey, Philip G. & Senay, Senait, 2023. "Distortionary Agricultural Policies: Their Productivity, Location and Climate Variability Implications for South Africa During the 20th Century," Staff Papers 330158, University of Minnesota, Department of Applied Economics.
    13. Ross Sparks & Tim Keighley & David Muscatello, 2010. "Early warning CUSUM plans for surveillance of negative binomial daily disease counts," Journal of Applied Statistics, Taylor & Francis Journals, vol. 37(11), pages 1911-1929.
    14. Castelnuovo, Efrem, 2010. "Tracking U.S. inflation expectations with domestic and global indicators," Journal of International Money and Finance, Elsevier, vol. 29(7), pages 1340-1356, November.
    15. Lindmark, Magnus & Acar, Sevil, 2013. "Sustainability in the making? A historical estimate of Swedish sustainable and unsustainable development 1850–2000," Ecological Economics, Elsevier, vol. 86(C), pages 176-187.
    16. González Andrés & Teräsvirta Timo, 2008. "Modelling Autoregressive Processes with a Shifting Mean," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 12(1), pages 1-28, March.
    17. Yalta, A. Talha, 2007. "The Numerical Reliability of GAUSS 8.0," The American Statistician, American Statistical Association, vol. 61, pages 262-268, August.
    18. Baumöhl, Eduard & Výrost, Tomáš & Lyócsa, Štefan, 2011. "Are we able to capture the EU debt crisis? Evidence from PIIGGS countries in panel unit root framework," MPRA Paper 30334, University Library of Munich, Germany.
    19. Ignacio Díaz-Emparanza & Petr Mariel & María Victoria Esteban (ed.), 2009. "Econometrics with gretl. Proceedings of the gretl Conference 2009," UPV/EHU Books, Universidad del País Vasco - Facultad de Ciencias Económicas y Empresariales, edition 1, number 01.
    20. Lopez-de-Lacalle, Javier, 2006. "The R-computing language: Potential for Asian economists," Journal of Asian Economics, Elsevier, vol. 17(6), pages 1066-1081, December.
    21. Gawon Yoon, 2009. "Corrigendum to “Regime Changes in International Real Interest Rates: Are They a Monetary Phenomenon?”," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(5), pages 1031-1032, August.

    More about this item

    Keywords

    Econometrics; Research;

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedlwp:2005-014. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Anna Oates (email available below). General contact details of provider: https://edirc.repec.org/data/frbslus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.