IDEAS home Printed from https://ideas.repec.org/a/zbw/ifweej/201860.html
   My bibliography  Save this article

Replication to assess statistical adequacy

Author

Listed:
  • Owen, P. Dorian

Abstract

"Statistical adequacy" is an important prerequisite for securing reliable inference in empirical modelling. This paper argues for more emphasis on replication that specifically assesses whether the results reported in empirical studies are based on statistically adequate models, i.e., models with valid underpinning statistical assumptions that pass relevant diagnostic tests for misspecification. A replication plan is briefly outlined to illustrate what this would involve in practice in the context of a specific study by Acemoglu, Gallego and Robinson (Institutions, human capital, and development, Annual Review of Economics, 2014).

Suggested Citation

  • Owen, P. Dorian, 2018. "Replication to assess statistical adequacy," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 12, pages 1-16.
    • Handle: RePEc:zbw:ifweej:201860
    DOI: 10.5018/economics-ejournal.ja.2018-60
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.5018/economics-ejournal.ja.2018-60
    Download Restriction: no
    File URL: https://www.econstor.eu/bitstream/10419/183497/1/Economics_2018-60.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.5018/economics-ejournal.ja.2018-60?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    2. Quamrul Ashraf & Oded Galor, 2011. "Dynamics and Stagnation in the Malthusian Epoch," American Economic Review, American Economic Association, vol. 101(5), pages 2003-2041, August.
    3. Enrico Spolaore & Romain Wacziarg, 2013. "How Deep Are the Roots of Economic Development?," Journal of Economic Literature, American Economic Association, vol. 51(2), pages 325-369, June.
    4. Kleibergen, Frank & Paap, Richard, 2006. "Generalized reduced rank tests using the singular value decomposition," Journal of Econometrics, Elsevier, vol. 133(1), pages 97-126, July.
    5. P. Dorian Owen, 2017. "Evaluating Ingenious Instruments for Fundamental Determinants of Long-Run Economic Growth and Development," Econometrics, MDPI, vol. 5(3), pages 1-33, September.
    6. Enrico Spolaore & Romain Wacziarg, 2009. "The Diffusion of Development," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 124(2), pages 469-529.
    7. Daniel S. Hamermesh, 2007. "Viewpoint: Replication in economics," Canadian Journal of Economics, Canadian Economics Association, vol. 40(3), pages 715-733, August.
    8. David F. Hendry & Bent Nielsen, 2007. "Preface to Econometric Modeling: A Likelihood Approach," Introductory Chapters, in: Econometric Modeling: A Likelihood Approach, Princeton University Press.
    9. Andrews,Donald W. K. & Stock,James H. (ed.), 2005. "Identification and Inference for Econometric Models," Cambridge Books, Cambridge University Press, number 9780521844413.
    10. Aris Spanos, 2015. "Revisiting Haavelmo's structural econometrics: bridging the gap between theory and data," Journal of Economic Methodology, Taylor & Francis Journals, vol. 22(2), pages 171-196, June.
    11. Michael A. Clemens, 2017. "The Meaning Of Failed Replications: A Review And Proposal," Journal of Economic Surveys, Wiley Blackwell, vol. 31(1), pages 326-342, February.
    12. Maren Duvendack & Richard Palmer-Jones & W. Robert Reed, 2017. "What Is Meant by "Replication" and Why Does It Encounter Resistance in Economics?," American Economic Review, American Economic Association, vol. 107(5), pages 46-51, May.
    13. Brown, Annette N. & Wood, Benjamin Douglas Kuflick, 2018. "Which tests not witch hunts: A diagnostic approach for conducting replication research," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 12, pages 1-26.
    14. Estelle Dumas-Mallet & Katherine Button & Thomas Boraud & Marcus Munafo & François Gonon, 2016. "Replication Validity of Initial Association Studies: A Comparison between Psychiatry, Neurology and Four Somatic Diseases," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-20, June.
    15. Easterly, William & Levine, Ross, 2003. "Tropics, germs, and crops: how endowments influence economic development," Journal of Monetary Economics, Elsevier, vol. 50(1), pages 3-39, January.
    16. C. Glenn Begley & Lee M. Ellis, 2012. "Raise standards for preclinical cancer research," Nature, Nature, vol. 483(7391), pages 531-533, March.
    17. Louis Putterman & David N. Weil, 2010. "Post-1500 Population Flows and The Long-Run Determinants of Economic Growth and Inequality," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(4), pages 1627-1682.
    18. Edward L. Glaeser & Rafael La Porta & Florencio Lopez-de-Silanes & Andrei Shleifer, 2004. "Do Institutions Cause Growth?," Journal of Economic Growth, Springer, vol. 9(3), pages 271-303, September.
    19. Anselin, Luc & Bera, Anil K. & Florax, Raymond & Yoon, Mann J., 1996. "Simple diagnostic tests for spatial dependence," Regional Science and Urban Economics, Elsevier, vol. 26(1), pages 77-104, February.
    20. Hamermesh, Daniel S., 2007. "Replication in Economics," IZA Discussion Papers 2760, Institute of Labor Economics (IZA).
    21. Woodberry, Robert D., 2012. "The Missionary Roots of Liberal Democracy," American Political Science Review, Cambridge University Press, vol. 106(2), pages 244-274, May.
    22. William Easterly & Ross Levine, 2016. "The European origins of economic development," Journal of Economic Growth, Springer, vol. 21(3), pages 225-257, September.
    23. Robert E. Hall & Charles I. Jones, 1999. "Why do Some Countries Produce So Much More Output Per Worker than Others?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(1), pages 83-116.
    24. Daron Acemoglu & Simon Johnson & James A. Robinson, 2001. "The Colonial Origins of Comparative Development: An Empirical Investigation," American Economic Review, American Economic Association, vol. 91(5), pages 1369-1401, December.
    25. David F. Hendry & Bent Nielsen, 2007. "The Bernoulli model, from Econometric Modeling: A Likelihood Approach," Introductory Chapters, in: Econometric Modeling: A Likelihood Approach, Princeton University Press.
    26. Daron Acemoglu & Francisco A. Gallego & James A. Robinson, 2014. "Institutions, Human Capital, and Development ," Annual Review of Economics, Annual Reviews, vol. 6(1), pages 875-912, August.
    27. Gilbert, Christopher L, 1986. "Professor Hendry's Econometric Methodology," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 48(3), pages 283-307, August.
    28. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-838, May.
    29. Daron Acemoglu & Simon Johnson & James A. Robinson, 2012. "The Colonial Origins of Comparative Development: An Empirical Investigation: Reply," American Economic Review, American Economic Association, vol. 102(6), pages 3077-3110, October.
    30. Cragg, John G. & Donald, Stephen G., 1993. "Testing Identifiability and Specification in Instrumental Variable Models," Econometric Theory, Cambridge University Press, vol. 9(2), pages 222-240, April.
    31. Aris Spanos, 2018. "Mis†Specification Testing In Retrospect," Journal of Economic Surveys, Wiley Blackwell, vol. 32(2), pages 541-577, April.
    32. Jurgen A. Doornik & Henrik Hansen, 2008. "An Omnibus Test for Univariate and Multivariate Normality," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 70(s1), pages 927-939, December.
    33. McAleer, Michael, 1994. "Sherlock Holmes and the Search for Truth: A Diagnostic Tale," Journal of Economic Surveys, Wiley Blackwell, vol. 8(4), pages 317-370, December.
    34. David F. Hendry, 2009. "The Methodology of Empirical Econometric Modeling: Applied Econometrics Through the Looking-Glass," Palgrave Macmillan Books, in: Terence C. Mills & Kerry Patterson (ed.), Palgrave Handbook of Econometrics, chapter 1, pages 3-67, Palgrave Macmillan.
    35. Phillips,Garry D. A. & Tzavalis,Elias (ed.), 2007. "The Refinement of Econometric Estimation and Test Procedures," Cambridge Books, Cambridge University Press, number 9780521870535.
    36. Spanos, Aris, 1990. "The simultaneous-equations model revisited : Statistical adequacy and identification," Journal of Econometrics, Elsevier, vol. 44(1-2), pages 87-105.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Trung V. Vu, 2021. "Are genetic traits associated with riots? The political legacy of prehistorically determined genetic diversity," Kyklos, Wiley Blackwell, vol. 74(4), pages 567-595, November.
    2. Reed, W. Robert, 2019. "Takeaways from the special issue on The Practice of Replication," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 13, pages 1-11.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. P. Dorian Owen, 2017. "Evaluating Ingenious Instruments for Fundamental Determinants of Long-Run Economic Growth and Development," Econometrics, MDPI, vol. 5(3), pages 1-33, September.
    2. Trung V. Vu, 2022. "Does institutional quality foster economic complexity? The fundamental drivers of productive capabilities," Empirical Economics, Springer, vol. 63(3), pages 1571-1604, September.
    3. Casey, Gregory & Klemp, Marc, 2021. "Historical instruments and contemporary endogenous regressors," Journal of Development Economics, Elsevier, vol. 149(C).
    4. Oyèkọ́lá, Ọláyínká, 2021. "Where do people live longer?," Research in Economics, Elsevier, vol. 75(1), pages 21-44.
    5. Rok Spruk & Mitja Kovac, 2019. "Transaction costs and economic growth under common legal system: State‐level evidence from Mexico," Economics and Politics, Wiley Blackwell, vol. 31(2), pages 240-292, July.
    6. Casey, Gregory & Klemp, Marc, 2016. "Instrumental Variables in the Long Run," MPRA Paper 68696, University Library of Munich, Germany.
    7. Nunn, Nathan, 2014. "Historical Development," Handbook of Economic Growth, in: Philippe Aghion & Steven Durlauf (ed.), Handbook of Economic Growth, edition 1, volume 2, chapter 7, pages 347-402, Elsevier.
    8. Faria, Hugo J. & Montesinos-Yufa, Hugo M. & Morales, Daniel R. & Navarro, Carlos E., 2016. "Unbundling the roles of human capital and institutions in economic development," European Journal of Political Economy, Elsevier, vol. 45(S), pages 108-128.
    9. Jamie Bologna Pavlik & Andrew T. Young, 2021. "The legacy of representation in medieval Europe for incomes and institutions today," Southern Economic Journal, John Wiley & Sons, vol. 88(1), pages 414-448, July.
    10. Ertan, Arhan & Fiszbein, Martin & Putterman, Louis, 2016. "Who was colonized and when? A cross-country analysis of determinants," European Economic Review, Elsevier, vol. 83(C), pages 165-184.
    11. Stephen Knowles & P. Dorian Owen, 2010. "Which Institutions are Good for Your Health? The Deep Determinants of Comparative Cross-country Health Status," Journal of Development Studies, Taylor & Francis Journals, vol. 46(4), pages 701-723.
    12. Sam Hak Kan Tang & Charles Ka Yui Leung, 2016. "The Deep Historical Roots of Macroeconomic Volatility," The Economic Record, The Economic Society of Australia, vol. 92(299), pages 568-589, December.
    13. William Easterly & Ross Levine, 2016. "The European origins of economic development," Journal of Economic Growth, Springer, vol. 21(3), pages 225-257, September.
    14. Ang, James B., 2013. "Institutions and the long-run impact of early development," Journal of Development Economics, Elsevier, vol. 105(C), pages 1-18.
    15. Pavlik, Jamie Bologna & Young, Andrew T., 2019. "Did technology transfer more rapidly East–West than North–South?," European Economic Review, Elsevier, vol. 119(C), pages 216-235.
    16. Raphael A. Auer, 2013. "Geography, institutions, and the making of comparative development," Journal of Economic Growth, Springer, vol. 18(2), pages 179-215, June.
    17. Gutmann, Jerg & Voigt, Stefan, 2018. "The rule of law: Measurement and deep roots," European Journal of Political Economy, Elsevier, vol. 54(C), pages 68-82.
    18. Fuchs-Schündeln, N. & Hassan, T.A., 2016. "Natural Experiments in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 923-1012, Elsevier.
    19. Mesbah Motamed & Raymond Florax & William Masters, 2014. "Agriculture, transportation and the timing of urbanization: Global analysis at the grid cell level," Journal of Economic Growth, Springer, vol. 19(3), pages 339-368, September.
    20. Bennett, Daniel L. & Faria, Hugo J. & Gwartney, James D. & Morales, Daniel R., 2017. "Economic Institutions and Comparative Economic Development: A Post-Colonial Perspective," World Development, Elsevier, vol. 96(C), pages 503-519.

    More about this item

    Keywords

    Replication; statistical adequacy; reliability of inference; science trustworthy-ness; misspecification testing; instrumental variables; reduced form; fundamental determinants of economic development;
    All these keywords.

    JEL classification:

    • C31 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models; Quantile Regressions; Social Interaction Models
    • C36 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Instrumental Variables (IV) Estimation
    • I25 - Health, Education, and Welfare - - Education - - - Education and Economic Development
    • P14 - Political Economy and Comparative Economic Systems - - Capitalist Economies - - - Property Rights
    • O10 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:ifweej:201860. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/iwkiede.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.