IDEAS home Printed from https://ideas.repec.org/a/jae/japmet/v24y2009i5p833-847.html

On reproducible econometric research

Author

Listed:
  • Roger Koenker

    (Department of Economics, University of Illinois at Urbana-Champaign, USA)

  • Achim Zeileis

    (Department of Statistics and Mathematics, WU Wirtschaftsuniversit‰t Wien, Austria)

Abstract

Recent software developments are reviewed from the vantage point of reproducible econometric research. We argue that the emergence of new tools, particularly in the open-source community, have greatly eased the burden of documenting and archiving both empirical and simulation work in econometrics. Some of these tools are highlighted in the discussion of two small replication exercises. Copyright © 2009 John Wiley & Sons, Ltd.

Suggested Citation

  • Roger Koenker & Achim Zeileis, 2009. "On reproducible econometric research," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(5), pages 833-847.
    • Handle: RePEc:jae:japmet:v:24:y:2009:i:5:p:833-847
    DOI: 10.1002/jae.1083
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1002/jae.1083
    File Function: Link to full text; subscription required
    Download Restriction: no
    File URL: http://qed.econ.queensu.ca:80/jae/2009-v24.5/
    File Function: Supporting data files and programs
    Download Restriction: no
    File URL: https://libkey.io/10.1002/jae.1083?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. B. D. McCullough & H. D. Vinod, 2003. "Verifying the Solution from a Nonlinear Solver: A Case Study," American Economic Review, American Economic Association, vol. 93(3), pages 873-892, June.
    2. Durlauf, Steven N & Johnson, Paul A, 1995. "Multiple Regimes and Cross-Country Growth Behaviour," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 10(4), pages 365-384, Oct.-Dec..
    3. N. Gregory Mankiw & David Romer & David N. Weil, 1992. "A Contribution to the Empirics of Economic Growth," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 107(2), pages 407-437.
    4. McCullough, B. D. & McGeary, Kerry Anne & Harrison, Teresa D., 2006. "Lessons from the JMCB Archive," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(4), pages 1093-1107, June.
    5. Giovanni Baiocchi, 2007. "Reproducible research in computational economics: guidelines, integrated approaches, and open source software," Computational Economics, Springer;Society for Computational Economics, vol. 30(1), pages 19-40, August.
    6. Koenker, Roger, 1988. "Asymptotic Theory and Econometric Practice," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 3(2), pages 139-147, April.
    7. Marius Ooms & Jurgen A. Doornik, 2006. "Econometric software development: past, present and future," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 60(2), pages 206-224, May.
    8. Christian Kleiber & Achim Zeileis, 2005. "Validating multiple structural change models-a case study," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(5), pages 685-690.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Garret Christensen & Edward Miguel, 2018. "Transparency, Reproducibility, and the Credibility of Economics Research," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
    2. Rodolphe Buda, 2013. "SIMUL 3.2: An Econometric Tool for Multidimensional Modelling," Computational Economics, Springer;Society for Computational Economics, vol. 41(4), pages 517-524, April.
    3. Valérie Orozco & Christophe Bontemps & Elise Maigné & Virginie Piguet & Annie Hofstetter & Anne Lacroix & Fabrice Levert & Jean‐Marc Rousselle, 2020. "How To Make A Pie: Reproducible Research For Empirical Economics And Econometrics," Journal of Economic Surveys, Wiley Blackwell, vol. 34(5), pages 1134-1169, December.
    4. Nicolas Vallois & Dorian Jullien, 2017. "Replication in experimental economics: A historical and quantitative approach focused on public good game experiments," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-01651080, HAL.
    5. Valérie Orozco & Christophe Bontemps & Élise Maigné & Virginie Piguet & Annie Hofstetter & Anne Marie Lacroix & Fabrice Levert & Jean-Marc Rousselle, 2017. "How to make a pie? Reproducible Research for Empirical Economics & Econometrics," Post-Print hal-01939942, HAL.
    6. Joachim Wagner, 2016. "From Estimation Results to Stylized Facts: Twelve Recommendations for Empirical Research in International Activities of Heterogeneous Firms," World Scientific Book Chapters, in: Microeconometrics of International Trade, chapter 15, pages 479-514, World Scientific Publishing Co. Pte. Ltd..
    7. Peter Egger & Sergey Nigai, 2013. "Energy Reform in Switzerland," KOF Working papers 13-327, KOF Swiss Economic Institute, ETH Zurich.
    8. Mahmood Arai & Jonas Karlsson & Michael Lundholm, 2011. "On Fragile Grounds: A Replication Of “Are Muslim Immigrants Different In Terms Of Cultural Integration?”," Journal of the European Economic Association, European Economic Association, vol. 9(5), pages 1002-1011, October.
    9. Matthias Bannert, 2015. "timeseriesdb: Manage and Archive Time Series Data in Establishment Statistics with R and PostgreSQL," KOF Working papers 15-384, KOF Swiss Economic Institute, ETH Zurich.
    10. Rodrigues Bruno, 2016. "Version Control Systems to Facilitate Research Collaboration in Economics," Computational Economics, Springer;Society for Computational Economics, vol. 48(3), pages 547-553, October.
    11. Arai, Mahmood & Karlsson, Jonas & Lundholm, Michael, 2008. "On Fragile Grounds: A Replication of Are Muslim Immigrants Different in Terms of Cultural Integration? Technical Documentation," Research Papers in Economics 2009:6, Stockholm University, Department of Economics.
    12. Christophe Hurlin & Christophe Pérignon, 2020. "The Economics of Research Reproducibility," Working Papers hal-02896404, HAL.
    13. Michael S. Delgado & Christopher F. Parmeter, 2013. "Embarrassingly Easy Embarrassingly Parallel Processing in R: Implementation and Reproducibility," Working Papers 2013-06, University of Miami, Department of Economics.
    14. Nicolas Vallois & Dorian Jullien, 2017. "Replication in Experimental Economics: A Historical and Quantitative Approach Focused on Public Good Game Experiments," GREDEG Working Papers 2017-21, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.
    15. Kirchkamp, Oliver, 2019. "Importing z-Tree data into R," Journal of Behavioral and Experimental Finance, Elsevier, vol. 22(C), pages 1-2.
    16. Charles, Amélie & Darné, Olivier, 2019. "Volatility estimation for Bitcoin: Replication and robustness," International Economics, Elsevier, vol. 157(C), pages 23-32.
    17. Roseline Bilina & Steve Lawford, 2012. "Python for Unified Research in Econometrics and Statistics," Econometric Reviews, Taylor & Francis Journals, vol. 31(5), pages 558-591, September.
    18. Kleiber Christian & Zeileis Achim, 2013. "Reproducible Econometric Simulations," Journal of Econometric Methods, De Gruyter, vol. 2(1), pages 89-99, July.
    19. Matthias Bannert, 2013. "Gateveys," KOF Working papers 13-326, KOF Swiss Economic Institute, ETH Zurich.
    20. Le Zhang & Andreas Ortmann, 2012. "A reproduction and replication of Engel’s meta-study of dictator game experiments," Discussion Papers 2012-44, School of Economics, The University of New South Wales.
    21. Rodolphe Buda, 2015. "Data Checking and Econometric Software Development: A Technique of Traceability by Fictive Data Encoding," Computational Economics, Springer;Society for Computational Economics, vol. 46(2), pages 325-357, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kleiber Christian & Zeileis Achim, 2010. "The Grunfeld Data at 50," German Economic Review, De Gruyter, vol. 11(4), pages 404-417, December.
    2. repec:bla:germec:v:11:y:2010:i::p:404-417 is not listed on IDEAS
    3. Massimiliano Affinito, 2011. "Convergence clubs, the euro-area rank and the relationship between banking and real convergence," Temi di discussione (Economic working papers) 809, Bank of Italy, Economic Research and International Relations Area.
    4. Don J. Webber & Min-Hua Jen & Eoin O'Leary, 2014. "Regional productivity in a multi-speed Europe," Working Papers 20141408, Department of Accounting, Economics and Finance, Bristol Business School, University of the West of England, Bristol.
    5. Mueller-Langer, Frank & Andreoli-Versbach, Patrick, 2018. "Open access to research data: Strategic delay and the ambiguous welfare effects of mandatory data disclosure," Information Economics and Policy, Elsevier, vol. 42(C), pages 20-34.
    6. Zhang, Xiaobei & Wang, Xiaojun, 2021. "Measures of human capital and the mechanics of economic growth," China Economic Review, Elsevier, vol. 68(C).
    7. Manfred Fischer, 2011. "A spatial Mankiw–Romer–Weil model: theory and evidence," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 47(2), pages 419-436, October.
    8. Stöllinger, Roman, 2013. "International spillovers in a world of technology clubs," Structural Change and Economic Dynamics, Elsevier, vol. 27(C), pages 19-35.
    9. Shana M. Sundstrom & Craig R. Allen & David G. Angeler, 2020. "Scaling and discontinuities in the global economy," Journal of Evolutionary Economics, Springer, vol. 30(2), pages 319-345, April.
    10. Cutrini, Eleonora & Mendez, Carlos, 2023. "Convergence clubs and spatial structural change in the European Union," Structural Change and Economic Dynamics, Elsevier, vol. 67(C), pages 167-181.
    11. William Brock & M. Taylor, 2010. "The Green Solow model," Journal of Economic Growth, Springer, vol. 15(2), pages 127-153, June.
    12. Panagiotis Reppas & Efthymios Tsionas & Dimitris Christopoulos, 2001. "European common stochastic long-run trends," Journal of Economics, Springer, vol. 74(2), pages 119-130, June.
    13. Walid Abdmoulah & Riadh Ben Jelili, 2013. "Access to Finance Thresholds and the Finance-Growth Nexus," Economic Papers, The Economic Society of Australia, vol. 32(4), pages 522-534, December.
    14. Winford H. Masanjala & Chris Papageorgiou, 2004. "The Solow model with CES technology: nonlinearities and parameter heterogeneity," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 19(2), pages 171-201.
    15. Andreoli-Versbach, Patrick & Mueller-Langer, Frank, 2014. "Open access to data: An ideal professed but not practised," Research Policy, Elsevier, vol. 43(9), pages 1621-1633.
    16. Peter Howitt, 2007. "Innovation, Competition and Growth: A Schumpeterian Perspective on Canada’s Economy," C.D. Howe Institute Commentary, C.D. Howe Institute, issue 246, February.
    17. Jakob Haan, 2007. "Political institutions and economic growth reconsidered," Public Choice, Springer, vol. 131(3), pages 281-292, June.
    18. Maria Adelaide Duarte & Marta Simões, 2004. "Human capital, mechanisms of technological diffusion and the role of technological shocks in the speed of diffusion. Evidence from a panel of Mediterranean countries," Notas Económicas, Faculty of Economics, University of Coimbra, issue 20, pages 102-134, December.
    19. Sedat Alataş & Erkam Sarı, 2021. "An Empirical Investigation on Regional Disparities in Public Expenditures: Province Level Evidence from Turkey," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 158(1), pages 217-240, November.
    20. Stolzenburg, Ulrich, 2014. "Growth determinants across time and space: A semiparametric panel data approach," Economics Working Papers 2014-11, Christian-Albrechts-University of Kiel, Department of Economics.
    21. Cem Ertur & Wilfried Koch, 2006. "The Role of Human Capital and Technological Interdependence in Growth and Convergence Processes: International Evidence," DEGIT Conference Papers c011_029, DEGIT, Dynamics, Economic Growth, and International Trade.

    More about this item

    Lists

    This item is featured on the following reading lists, Wikipedia, or ReplicationWiki pages:
    1. On Reproducible Econometric Research (Journal of Applied Econometrics 2009) in ReplicationWiki

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jae:japmet:v:24:y:2009:i:5:p:833-847. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley-Blackwell Digital Licensing or Christopher F. Baum (email available below). General contact details of provider: http://www.interscience.wiley.com/jpages/0883-7252/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.