IDEAS home Printed from https://ideas.repec.org/a/iza/izawol/journly2016n320.html
   My bibliography  Save this article

Meta-regression analysis: Producing credible estimates from diverse evidence

Author

Listed:
  • Chris Doucouliagos

    (Deakin University, Australia)

Abstract

Good policy requires reliable scientific knowledge, but there are many obstacles. Most econometric estimates lack adequate statistical power; some estimates cannot be replicated; publication selection bias (the selective reporting of results) is common; and there is wide variation in the evidence base on most policy issues. Meta-regression analysis offers a way to increase statistical power, correct the evidence base for a range of biases, and make sense of the unceasing flow of contradictory econometric estimates. It enables policymakers to develop evidence-based policies even when the initial evidence base lacks credibility.

Suggested Citation

  • Chris Doucouliagos, 2016. "Meta-regression analysis: Producing credible estimates from diverse evidence," IZA World of Labor, Institute of Labor Economics (IZA), pages 320-320, November.
    • Handle: RePEc:iza:izawol:journl:y:2016:n:320
    as

    Download full text from publisher

    File URL: http://wol.iza.org/articles/meta-regression-analysis-producing-credible-estimates-from-diverse-evidence-1.pdf
    Download Restriction: no
    File URL: http://wol.iza.org/articles/meta-regression-analysis-producing-credible-estimates-from-diverse-evidence
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. David Card & Jochen Kluve & Andrea Weber, 2010. "Active Labour Market Policy Evaluations: A Meta-Analysis," Economic Journal, Royal Economic Society, vol. 120(548), pages 452-477, November.
    2. Hristos Doucouliagos & Janto Haman & T.D. Stanley, 2012. "Pay for Performance and Corporate Governance Reform," Industrial Relations: A Journal of Economy and Society, Wiley Blackwell, vol. 51(3), pages 670-703, July.
    3. Bellavance, Franois & Dionne, Georges & Lebeau, Martin, 2009. "The value of a statistical life: A meta-analysis with a mixed effects regression model," Journal of Health Economics, Elsevier, vol. 28(2), pages 444-464, March.
    4. Megan Linde Leonard & T. D. Stanley & Hristos Doucouliagos, 2014. "Does the UK Minimum Wage Reduce Employment? A Meta-Regression Analysis," British Journal of Industrial Relations, London School of Economics, vol. 52(3), pages 499-520, September.
    5. Hristos Doucouliagos & T. D. Stanley, 2009. "Publication Selection Bias in Minimum‐Wage Research? A Meta‐Regression Analysis," British Journal of Industrial Relations, London School of Economics, vol. 47(2), pages 406-428, June.
    6. W. Kip Viscusi, 2015. "The Role of Publication Selection Bias in Estimates of the Value of a Statistical Life," American Journal of Health Economics, University of Chicago Press, vol. 1(1), pages 27-52, Winter.
    7. Shanthi Nataraj & Francisco Perez-Arce & Krishna B. Kumar & Sinduja V. Srinivasan, 2014. "The Impact Of Labor Market Regulation On Employment In Low-Income Countries: A Meta-Analysis," Journal of Economic Surveys, Wiley Blackwell, vol. 28(3), pages 551-572, July.
    8. Dale Belman & Paul J. Wolfson, 2014. "What Does the Minimum Wage Do?," Books from Upjohn Press, W.E. Upjohn Institute for Employment Research, number wdmwd, November.
    9. S. Longhi & P. Nijkamp & J. Poot, 2010. "Joint impacts of immigration on wages and employment: review and meta-analysis," Journal of Geographical Systems, Springer, vol. 12(4), pages 355-387, December.
    10. Doucouliagos, Chris & Stanley, T.D. & Giles, Margaret, 2012. "Are estimates of the value of a statistical life exaggerated?," Journal of Health Economics, Elsevier, vol. 31(1), pages 197-206.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nauro F. Campos & Jarko Fidrmuc & Iikka Korhonen, 2017. "Business Cycle Synchronisation in a Currency Union: Taking Stock of the Evidence," GRU Working Paper Series GRU_2017_017, City University of Hong Kong, Department of Economics and Finance, Global Research Unit.
    2. Fidrmuc, Jarko & Lind, Ronja, 2020. "Macroeconomic impact of Basel III: Evidence from a meta-analysis," Journal of Banking & Finance, Elsevier, vol. 112(C).
    3. Campos, Nauro F. & Fidrmuc, Jarko & Korhonen, Iikka, 2019. "Business cycle synchronisation and currency unions: A review of the econometric evidence using meta-analysis," International Review of Financial Analysis, Elsevier, vol. 61(C), pages 274-283.
    4. Yin‐Wong Cheung & Shi He, 2022. "RMB misalignment: What does a meta‐analysis tell us?," Review of International Economics, Wiley Blackwell, vol. 30(4), pages 1038-1086, September.
    5. Yin-Wong Cheung & Shi He, 2019. "Truths and Myths About RMB Misalignment: A Meta-analysis," Comparative Economic Studies, Palgrave Macmillan;Association for Comparative Economic Studies, vol. 61(3), pages 464-492, September.
    6. repec:zbw:bofrdp:2017_028 is not listed on IDEAS
    7. Quang T. T. Nguyen & Son T. B. Nguyen & Quang V. Nguyen, 2019. "Can Higher Capital Discipline Bank Risk: Evidence from a Meta-Analysis," JRFM, MDPI, vol. 12(3), pages 1-21, August.
    8. Campos, Nauro F. & Jarko, Fidrmuc & Iikka, Korhonen, 2017. "Business cycle synchronisation in a currency union: Taking stock of the evidence," Bank of Finland Research Discussion Papers 28/2017, Bank of Finland.
    9. Jarko Fidrmuc & Katarína Danišková, 2020. "Meta-Analysis of the New Keynesian Phillips Curve in Developed and Emerging Economies," Emerging Markets Finance and Trade, Taylor & Francis Journals, vol. 56(1), pages 10-31, January.
    10. Thi Mai Lan Nguyen, 2020. "Output Effects of Monetary Policy in Emerging and Developing Countries: Evidence from a Meta-Analysis," Emerging Markets Finance and Trade, Taylor & Francis Journals, vol. 56(1), pages 68-85, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:wly:econjl:v::y:2017:i:605:p:f236-f265 is not listed on IDEAS
    2. John P. A. Ioannidis & T. D. Stanley & Hristos Doucouliagos, 2017. "The Power of Bias in Economics Research," Economic Journal, Royal Economic Society, vol. 127(605), pages 236-265, October.
    3. Tomas Kucera, 2020. "Are Employment Effects of Minimum Wage the Same Across the EU? A Meta-Regression Analysis," Working Papers IES 2020/2, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Jan 2020.
    4. Stanley, T. D. & Doucouliagos, Chris, 2019. "Practical Significance, Meta-Analysis and the Credibility of Economics," IZA Discussion Papers 12458, Institute of Labor Economics (IZA).
    5. Kluve, Jochen & Puerto, Susanna & Robalino, David & Romero, José Manuel & Rother, Friederike & Stöterau, Jonathan & Weidenkaff, Felix & Witte, Marc, 2016. "Do Youth Employment Programs Improve Labor Market Outcomes? A Systematic Review," Ruhr Economic Papers 648, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    6. Nazila Alinaghi & W. Robert Reed, 2016. "Meta-Analysis and Publication Bias: How Well Does the FAT-PET-PEESE Procedure Work?," Working Papers in Economics 16/26, University of Canterbury, Department of Economics and Finance.
    7. Reed, W. Robert, 2015. "A Monte Carlo analysis of alternative meta-analysis estimators in the presence of publication bias," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 9, pages 1-40.
    8. Garret Christensen & Edward Miguel, 2018. "Transparency, Reproducibility, and the Credibility of Economics Research," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
    9. Giotis, Georgios & Chletsos, Michael, 2015. "Is there publication selection bias in minimum wage research during the five-year period from 2010 to 2014?," Economics Discussion Papers 2015-58, Kiel Institute for the World Economy (IfW Kiel).
    10. Alexandros Karakitsios & Manos Matsaganis, 2018. "Minimum Wage Effects on Poverty and Inequality," DEOS Working Papers 1801, Athens University of Economics and Business.
    11. Chletsos, Michael & Giotis, Georgios P., 2015. "The employment effect of minimum wage using 77 international studies since 1992: A meta-analysis," MPRA Paper 61321, University Library of Munich, Germany.
    12. Nazila Alinaghi & W. Robert Reed, 2021. "Taxes and Economic Growth in OECD Countries: A Meta-analysis," Public Finance Review, , vol. 49(1), pages 3-40, January.
    13. Florin Vadean & Stephen Allan, 2021. "The Effects of Minimum Wage Policy on the Long‐Term Care Sector in England," British Journal of Industrial Relations, London School of Economics, vol. 59(2), pages 307-334, June.
    14. Arango, Luis E. & Rivera, Sergio A., 2022. "Moderate wage increases and flexible labour contracts to protect employment in Colombian manufacturing," Journal of Policy Modeling, Elsevier, vol. 44(3), pages 578-598.
    15. Oliver Bruttel, 2019. "The effects of the new statutory minimum wage in Germany: a first assessment of the evidence," Journal for Labour Market Research, Springer;Institute for Employment Research/ Institut für Arbeitsmarkt- und Berufsforschung (IAB), vol. 53(1), pages 1-13, December.
    16. Geyer-Klingeberg, Jerome & Hang, Markus & Rathgeber, Andreas W., 2019. "What drives financial hedging? A meta-regression analysis of corporate hedging determinants," International Review of Financial Analysis, Elsevier, vol. 61(C), pages 203-221.
    17. Stanley, T. D. & Doucouliagos, Hristos, 2013. "Better than random: weighted least squares meta-regression analysis," Working Papers eco_2013_2, Deakin University, Department of Economics.
    18. Luis E. Arango & Luz A. Flórez & Laura D. Guerrero, 2020. "Minimum wage effects on informality across demographic groups in Colombia," Borradores de Economia 1104, Banco de la Republica de Colombia.
    19. Bernhard Schütz, 2018. "Employment and the minimum wage: A pluralist approach," Economics working papers 2018-07, Department of Economics, Johannes Kepler University Linz, Austria.
    20. Jerome Geyer-Klingeberg & Markus Hang & Matthias Walter & Andreas Rathgeber, 2018. "Do stock markets react to soccer games? A meta-regression analysis," Applied Economics, Taylor & Francis Journals, vol. 50(19), pages 2171-2189, April.
    21. Jaithri Ananthapavan & Marj Moodie & Andrew J. Milat & Rob Carter, 2021. "Systematic Review to Update ‘Value of a Statistical Life’ Estimates for Australia," IJERPH, MDPI, vol. 18(11), pages 1-17, June.

    More about this item

    Keywords

    bias; credibility; research synthesis; meta-regression;
    All these keywords.

    JEL classification:

    • C01 - Mathematical and Quantitative Methods - - General - - - Econometrics
    • C50 - Mathematical and Quantitative Methods - - Econometric Modeling - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izawol:journl:y:2016:n:320. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Institute of Labor Economics (IZA) (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.