IDEAS home Printed from https://ideas.repec.org/a/aea/aecrev/v107y2017i5p56-59.html
   My bibliography  Save this article

Replication, Meta-analysis, and Research Synthesis in Economics

Author

Listed:
  • Richard G. Anderson
  • Areerat Kichkha

Abstract

Replicability is essential to assure the scientific integrity of empirical economic research. Some authors have suggested metadata analysis as a complementary tool. This suggestion must be addressed with caution. Empirical studies in most of economics are nonstochastic in the sense that they seldom are created via experiments and, with the data and computer software in-hand, should be reproducible without error.

Suggested Citation

  • Richard G. Anderson & Areerat Kichkha, 2017. "Replication, Meta-analysis, and Research Synthesis in Economics," American Economic Review, American Economic Association, vol. 107(5), pages 56-59, May.
    • Handle: RePEc:aea:aecrev:v:107:y:2017:i:5:p:56-59
    Note: DOI: 10.1257/aer.p20171033
    as

    Download full text from publisher

    File URL: https://www.aeaweb.org/articles?id=10.1257/aer.p20171033
    Download Restriction: no
    File URL: https://www.aeaweb.org/articles/attachments?retrieve=zwSDRHSZpexKC_0j5TWuvHHvgIcm11aR
    Download Restriction: Access to full text is restricted to AEA members and institutional subscribers.
    ---><---

    References listed on IDEAS

    as
    1. Colin J. Roberts, 2005. "Issues in Meta‐Regression Analysis: An Overview," Journal of Economic Surveys, Wiley Blackwell, vol. 19(3), pages 295-298, July.
    2. Congressional Budget Office, 2014. "The Effects of a Minimum-Wage Increase on Employment and Family Income," Reports 44995, Congressional Budget Office.
    3. Dewald, William G & Thursby, Jerry G & Anderson, Richard G, 1986. "Replication in Empirical Economics: The Journal of Money, Credit and Banking Project," American Economic Review, American Economic Association, vol. 76(4), pages 587-603, September.
    4. Daniel S. Hamermesh, 2007. "Viewpoint: Replication in economics," Canadian Journal of Economics, Canadian Economics Association, vol. 40(3), pages 715-733, August.
    5. Congressional Budget Office, 2014. "The Effects of a Minimum-Wage Increase on Employment and Family Income," Reports 44995, Congressional Budget Office.
    6. McCullough, B. D. & McGeary, Kerry Anne & Harrison, Teresa D., 2006. "Lessons from the JMCB Archive," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(4), pages 1093-1107, June.
    7. Congressional Budget Office, 2014. "The Effects of a Minimum-Wage Increase on Employment and Family Income," Reports 44995, Congressional Budget Office.
    8. Congressional Budget Office, 2014. "The Effects of a Minimum-Wage Increase on Employment and Family Income," Reports 44995, Congressional Budget Office.
    9. Hamermesh, Daniel S., 2007. "Replication in Economics," IZA Discussion Papers 2760, Institute of Labor Economics (IZA).
    10. T. D. Stanley, 2005. "Beyond Publication Bias," Journal of Economic Surveys, Wiley Blackwell, vol. 19(3), pages 309-345, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mueller-Langer, Frank & Fecher, Benedikt & Harhoff, Dietmar & Wagner, Gert G., 2019. "Replication studies in economics—How many and which papers are chosen for replication, and why?," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 48(1), pages 62-83.
    2. Koten, Silvester Van, 2020. "Forward premia in electricity markets: A replication study," Energy Economics, Elsevier, vol. 89(C).
    3. Kenneth Button, 2020. "Studying the empirical implications of the liberalization of airport markets," Competition and Regulation in Network Industries, , vol. 21(3), pages 223-243, September.
    4. Emilie Caldeira & Alou Adessé Dama & Ali Compaoré & Mario Mansour & Grégoire Rota-Graziosi, 2020. "Tax effort in Sub-Saharan African countries : evidence from a new dataset," Working Papers hal-02543162, HAL.
    5. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    6. Dela‐Dem Fiankor & Fabio G. Santeramo, 2023. "Revisiting the impact of per‐unit duties on agricultural export prices," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 45(3), pages 1472-1492, September.
    7. Joern Block & Christopher Hansen & Holger Steinmetz, 2023. "Are Family Firms Doing More Innovation Output With Less Innovation Input? A Replication and Extension," Entrepreneurship Theory and Practice, , vol. 47(4), pages 1496-1520, July.
    8. S Anukriti & Sonia Bhalotra & Eddy H F Tam, 2022. "On the Quantity and Quality of Girls: Fertility, Parental Investments and Mortality," The Economic Journal, Royal Economic Society, vol. 132(641), pages 1-36.
    9. Antinyan, Armenak & Asatryan, Zareh, 2019. "Nudging for tax compliance: A meta-analysis," ZEW Discussion Papers 19-055, ZEW - Leibniz Centre for European Economic Research.
    10. Josephson, Anna & Michler, Jeffrey D., 2018. "Viewpoint: Beasts of the field? Ethics in agricultural and applied economics," Food Policy, Elsevier, vol. 79(C), pages 1-11.
    11. Christopher Hansen & Holger Steinmetz & Jörn Block, 2022. "How to conduct a meta-analysis in eight steps: a practical guide," Management Review Quarterly, Springer, vol. 72(1), pages 1-19, February.
    12. Sylvérie Herbert & Hautahi Kingi & Flavio Stanchi & Lars Vilhubern, 2021. "The Reproducibility of Economics Research: A Case Study," Working papers 853, Banque de France.
    13. Ella Hugo & David A. Savage & Benno Torgler, 2021. "“Grease” or “Sand” the Wheels of Economic Development: A Meta-Analysis of Corruption," CREMA Working Paper Series 2021-19, Center for Research in Economics, Management and the Arts (CREMA).
    14. Fernando-Ignacio Sánchez-Martínez & Jorge-Eduardo Martínez-Pérez & José-María Abellán-Perpiñán & José-Luis Pinto-Prades, 2021. "The value of statistical life in the context of road safety: new evidence on the contingent valuation/standard gamble chained approach," Journal of Risk and Uncertainty, Springer, vol. 63(2), pages 203-228, October.
    15. Lucas C. Coffman & Muriel Niederle & Alistair J. Wilson, 2017. "A Proposal to Organize and Promote Replications," American Economic Review, American Economic Association, vol. 107(5), pages 41-45, May.
    16. Geyer-Klingeberg, Jerome & Hang, Markus & Rathgeber, Andreas, 2020. "Meta-analysis in finance research: Opportunities, challenges, and contemporary applications," International Review of Financial Analysis, Elsevier, vol. 71(C).
    17. Asatryan, Zareh & Havlik, Annika & Heinemann, Friedrich & Nover, Justus, 2020. "Biases in fiscal multiplier estimates," European Journal of Political Economy, Elsevier, vol. 63(C).
    18. Cook, Steven & Fosten, Jack, 2019. "Replicating rockets and feathers," Energy Economics, Elsevier, vol. 82(C), pages 139-151.
    19. Nelson, Jon Paul, 2020. "Fixed-effect versus random-effects meta-analysis in economics: A study of pass-through rates for alcohol beverage excise taxes," Economics Discussion Papers 2020-1, Kiel Institute for the World Economy (IfW Kiel).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Peter Harasztosi & Attila Lindner, 2019. "Who Pays for the Minimum Wage?," American Economic Review, American Economic Association, vol. 109(8), pages 2693-2727, August.
    2. Mark J. McCabe & Frank Mueller-Langer, 2019. "Does Data Disclosure Increase Citations? Empirical Evidence from a Natural Experiment in Leading Economics Journals," JRC Working Papers on Digital Economy 2019-02, Joint Research Centre.
    3. Nazila Alinaghi & John Creedy & Norman Gemmell, 2020. "The Redistributive Effects of a Minimum Wage Increase in New Zealand: A Microsimulation Analysis," Australian Economic Review, The University of Melbourne, Melbourne Institute of Applied Economic and Social Research, vol. 53(4), pages 517-538, December.
    4. Holzer, Harry J., 2019. "The US Labor Market in 2050: Supply, Demand and Policies to Improve Outcomes," IZA Policy Papers 148, Institute of Labor Economics (IZA).
    5. Claus Thustrup Kreiner & Daniel Reck & Peer Ebbesen Skov, 2020. "Do Lower Minimum Wages for Young Workers Raise Their Employment? Evidence from a Danish Discontinuity," The Review of Economics and Statistics, MIT Press, vol. 102(2), pages 339-354, May.
    6. Nicolas Vallois & Dorian Jullien, 2017. "Replication in experimental economics: A historical and quantitative approach focused on public good game experiments," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-01651080, HAL.
    7. Kiri, Bralind & Lacetera, Nicola & Zirulia, Lorenzo, 2018. "Above a swamp: A theory of high-quality scientific production," Research Policy, Elsevier, vol. 47(5), pages 827-839.
    8. Mueller-Langer, Frank & Fecher, Benedikt & Harhoff, Dietmar & Wagner, Gert G., 2019. "Replication studies in economics—How many and which papers are chosen for replication, and why?," Research Policy, Elsevier, vol. 48(1), pages 62-83.
    9. Duvendack, Maren & Palmer-Jones, Richard, 2011. "The microfinance of reproduction and the reproduction of microfinance: understanding the connections between microfinance, empowerment, contraception and fertility in Bangladesh in the 1990s," MPRA Paper 32384, University Library of Munich, Germany.
    10. Burkhauser, Richard V., 2014. "Why Minimum Wage Increases Are a Poor Way to Help the Working Poor," IZA Policy Papers 86, Institute of Labor Economics (IZA).
    11. Meer, Jonathan, 2018. "Recent Research on the Minimum Wage: Implications for Missouri," MPRA Paper 93926, University Library of Munich, Germany.
    12. David H. Autor & Alan Manning & Christopher L. Smith, 2016. "The Contribution of the Minimum Wage to US Wage Inequality over Three Decades: A Reassessment," American Economic Journal: Applied Economics, American Economic Association, vol. 8(1), pages 58-99, January.
    13. Horton, Joanne & Krishna Kumar, Dhanya & Wood, Anthony, 2020. "Detecting academic fraud using Benford law: The case of Professor James Hunton," Research Policy, Elsevier, vol. 49(8).
    14. Fišar, Miloš & Greiner, Ben & Huber, Christoph & Katok, Elena & Ozkes, Ali & Management Science Reproducibility Collaboration, 2023. "Reproducibility in Management Science," Department for Strategy and Innovation Working Paper Series 03/2023, WU Vienna University of Economics and Business.
    15. International Monetary Fund, 2016. "Cross-Country Report on Minimum Wages: Selected Issues," IMF Staff Country Reports 2016/151, International Monetary Fund.
    16. Oren M. Levin-Waldman, 2015. "Why the Minimum Wage Orthodoxy Reigns Supreme," Challenge, Taylor & Francis Journals, vol. 58(1), pages 29-50, January.
    17. Garret Christensen & Edward Miguel, 2018. "Transparency, Reproducibility, and the Credibility of Economics Research," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
    18. Maren Duvendack & Richard Palmer-Jones, 2013. "Replication of quantitative work in development studies: Experiences and suggestions," Progress in Development Studies, , vol. 13(4), pages 307-322, October.
    19. Vlaeminck, Sven, 2013. "Data Management in Scholarly Journals and Possible Roles for Libraries - Some Insights from EDaWaX," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 23(1), pages 49-79.
    20. Hensel, Przemysław G., 2021. "Reproducibility and replicability crisis: How management compares to psychology and economics – A systematic review of literature," European Management Journal, Elsevier, vol. 39(5), pages 577-594.

    More about this item

    JEL classification:

    • A14 - General Economics and Teaching - - General Economics - - - Sociology of Economics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aea:aecrev:v:107:y:2017:i:5:p:56-59. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Michael P. Albert (email available below). General contact details of provider: https://edirc.repec.org/data/aeaaaea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.