IDEAS home Printed from https://ideas.repec.org/p/ems/euriss/135342.html
   My bibliography  Save this paper

Does research on economic sanctions suffer from publication bias?

Author

Listed:
  • Demena, B.A.
  • Benalcazar Jativa, G.
  • Reta, A.S.
  • Kimararungu, P.B.
  • van Bergeijk, P.A.G.

Abstract

We meta-analyse 36 primary studies on determinants of the effectiveness of economic sanctions published over the years 1985-2018, using the Protocol of the Meta-Analysis in Economics Research-network. We investigate the impact of trade linkage, sanction duration and prior relations on sanction success. While the descriptive analysis and weighted averages suggest that the impact of the three variables of interest is significant and conforms to a priori theoretical expectations, our econometric analysis uncovers significant publication bias in the results. Bias is significant and large for the three variables of interest and the genuine impact of these variables on success and failure of sanctions after correction for publication bias is insignificant. Moreover, we find that bias in this literature increases over time.

Suggested Citation

  • Demena, B.A. & Benalcazar Jativa, G. & Reta, A.S. & Kimararungu, P.B. & van Bergeijk, P.A.G., 2021. "Does research on economic sanctions suffer from publication bias?," ISS Working Papers - General Series 674, International Institute of Social Studies of Erasmus University Rotterdam (ISS), The Hague.
    • Handle: RePEc:ems:euriss:135342
    as

    Download full text from publisher

    File URL: https://repub.eur.nl/pub/135342/wp674.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Dursun Peksen, 2019. "When Do Imposed Economic Sanctions Work? A Critical Review of the Sanctions Effectiveness Literature," Defence and Peace Economics, Taylor & Francis Journals, vol. 30(6), pages 635-647, September.
    2. Felbermayr, Gabriel & Syropoulos, Constantinos & Yalcin, Erdal & Yotov, Yoto V., 2019. "On the effects of sanctions on trade and welfare: New evidence based on structural gravity and a new database," Kiel Working Papers 2131, Kiel Institute for the World Economy (IfW Kiel).
    3. Binyam Afewerk Demena, 2015. "Publication bias in FDI spillovers in developing countries: a meta-regression analysis," Applied Economics Letters, Taylor & Francis Journals, vol. 22(14), pages 1170-1174, September.
    4. Bapat, Navin A. & Kwon, Bo Ram, 2015. "When Are Sanctions Effective? A Bargaining and Enforcement Framework," International Organization, Cambridge University Press, vol. 69(1), pages 131-162, January.
    5. Garret Christensen & Edward Miguel, 2018. "Transparency, Reproducibility, and the Credibility of Economics Research," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
    6. Donna Driscoll & Dennis Halcoussis & Anton D. Lowenberg, 2011. "Economic Sanctions And Culture," Defence and Peace Economics, Taylor & Francis Journals, vol. 22(4), pages 423-448, August.
    7. Stephen B. Jarrell & T. D. Stanley, 2004. "Declining Bias and Gender Wage Discrimination? A Meta-Regression Analysis," Journal of Human Resources, University of Wisconsin Press, vol. 39(3).
    8. Sajjad Faraji Dizaji & Peter A G van Bergeijk, 2013. "Potential early phase success and ultimate failure of economic sanctions," Journal of Peace Research, Peace Research Institute Oslo, vol. 50(6), pages 721-736, November.
    9. Peter A. G. van Bergeijk & Sara Lazzaroni, 2015. "Macroeconomics of Natural Disasters: Strengths and Weaknesses of Meta‐Analysis Versus Review of Literature," Risk Analysis, John Wiley & Sons, vol. 35(6), pages 1050-1072, June.
    10. Navin A. Bapat & Tobias Heinrich & Yoshiharu Kobayashi & T. Clifton Morgan, 2013. "Determinants of Sanctions Effectiveness: Sensitivity Analysis Using New Data," International Interactions, Taylor & Francis Journals, vol. 39(1), pages 79-98, January.
    11. Lam, San Ling, 1990. "Economic sanctions and the success of foreign policy goals : A critical evaluation," Japan and the World Economy, Elsevier, vol. 2(3), pages 239-248, September.
    12. Drezner, Daniel W., 2000. "Bargaining, Enforcement, and Multilateral Sanctions: When Is Cooperation Counterproductive?," International Organization, Cambridge University Press, vol. 54(1), pages 73-102, January.
    13. Peter A. G. van Bergeijk, 2020. "Can the Sanction Debate Be Resolved?," CESifo Forum, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 20(04), pages 3-8, January.
    14. Robert Goldfarb, 1995. "The economist-as-audience needs a methodology of plausible inference," Journal of Economic Methodology, Taylor & Francis Journals, vol. 2(2), pages 201-222.
    15. Demena, Binyam Afewerk & Afesorgbor, Sylvanus Kwaku, 2020. "The effect of FDI on environmental emissions: Evidence from a meta-analysis," Energy Policy, Elsevier, vol. 138(C).
    16. Gary Clyde Hufbauer & Jeffrey J. Schott & Kimberly Ann Elliott, 2007. "Economic Sanctions Reconsidered, 3rd edition (hardcover)," Peterson Institute Press: All Books, Peterson Institute for International Economics, number 4075, January.
    17. Solomon Major, 2012. "Timing Is Everything: Economic Sanctions, Regime Type, and Domestic Instability," International Interactions, Taylor & Francis Journals, vol. 38(1), pages 79-110, January.
    18. Peter A. G. VAN Bergeijk, 1989. "Success and Failure of Economic Sanctions," Kyklos, Wiley Blackwell, vol. 42(3), pages 385-404, August.
    19. Floridi, Andrea & Demena, Binyam Afewerk & Wagner, Natascha, 2020. "Shedding light on the shadows of informality: A meta-analysis of formalization interventions targeted at informal firms," Labour Economics, Elsevier, vol. 67(C).
    20. Medoff, Marshall H., 2003. "Collaboration and the quality of economics research," Labour Economics, Elsevier, vol. 10(5), pages 597-608, October.
    21. Peter A.G. van Bergeijk, 2009. "Economic Diplomacy and the Geography of International Trade," Books, Edward Elgar Publishing, number 13518.
    22. Gerber, Alan S. & Green, Donald P. & Nickerson, David, 2001. "Testing for Publication Bias in Political Science," Political Analysis, Cambridge University Press, vol. 9(4), pages 385-392, January.
    23. Selwyn J. V. Moons & Peter A. G. Bergeijk, 2017. "Does Economic Diplomacy Work? A Meta-analysis of Its Impact on Trade and Investment," The World Economy, Wiley Blackwell, vol. 40(2), pages 336-368, February.
    24. van Bergeijk, Peter A. G. & van Marrewijk, Charles, 1995. "Why do sanctions need time to work? Adjustment, learning and anticipation," Economic Modelling, Elsevier, vol. 12(2), pages 75-86, April.
    25. Peter A.G. van Bergeijk (ed.), 2021. "Research Handbook on Economic Sanctions," Books, Edward Elgar Publishing, number 19551.
    26. Peter A.G. van Bergeijk, 1994. "Economic Diplomacy, Trade And Commercial Policy," Books, Edward Elgar Publishing, number 447.
    27. Taehee Whang & Elena V. McLean & Douglas W. Kuberski, 2013. "Coercion, Information, and the Success of Sanction Threats," American Journal of Political Science, John Wiley & Sons, vol. 57(1), pages 65-81, January.
    28. Afesorgbor, Sylvanus Kwaku, 2019. "The impact of economic sanctions on international trade: How do threatened sanctions compare with imposed sanctions?," European Journal of Political Economy, Elsevier, vol. 56(C), pages 11-26.
    29. Binyam A. Demena & Peter A. G. van Bergeijk, 2017. "A Meta-Analysis Of Fdi And Productivity Spillovers In Developing Countries," Journal of Economic Surveys, Wiley Blackwell, vol. 31(2), pages 546-571, April.
    30. Gary Clyde Hufbauer & Jeffrey J. Schott & Kimberly Ann Elliott, 2009. "Economic Sanctions Reconsidered, 3rd Edition (paper)," Peterson Institute Press: All Books, Peterson Institute for International Economics, number 4129, October.
    31. Bergeijk Peter A.G. van & Demena Binyam A. & Reta Alemayehu & Jativa Gabriela Benalcazar & Kimararungu Patrick, 2019. "Could the literature on the economic determinants of sanctions be biased?," Peace Economics, Peace Science, and Public Policy, De Gruyter, vol. 25(4), pages 1-4, December.
    32. Chao Jing & William H. Kaempfer & Anton D. Lowenberg, 2003. "Instrument Choice and the Effectiveness of International Sanctions: A Simultaneous Equations Approach," Journal of Peace Research, Peace Research Institute Oslo, vol. 40(5), pages 519-535, September.
    33. Peter A. G. Van Bergeijk & Muhammad S. H. Siddiquee, 2017. "Biased Sanctions? Methodological Change in Economic Sanctions Reconsidered and Its Implications," International Interactions, Taylor & Francis Journals, vol. 43(5), pages 879-893, September.
    34. Shane Bonetti, 1998. "Distinguishing characteristics of degrees of success and failure in economic sanctions episodes," Applied Economics, Taylor & Francis Journals, vol. 30(6), pages 805-813.
    35. Chris Doucouliagos & T.D. Stanley, 2013. "Are All Economic Facts Greatly Exaggerated? Theory Competition And Selectivity," Journal of Economic Surveys, Wiley Blackwell, vol. 27(2), pages 316-339, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. William Seitz & Alberto Zazzaro, 2020. "Sanctions and public opinion: The case of the Russia-Ukraine gas disputes," The Review of International Organizations, Springer, vol. 15(4), pages 817-843, October.
    2. Demena, B.A., 2021. "Effectiveness of export promotion programmes," ISS Working Papers - General Series 688, International Institute of Social Studies of Erasmus University Rotterdam (ISS), The Hague.
    3. Peter A. G. van Bergeijk, 2020. "Can the Sanction Debate Be Resolved?," CESifo Forum, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 20(04), pages 3-8, January.
    4. Dizaji, S.F. & Lis, P. & Murshed, S.M. & Zweiri, M., 2020. "What the political economy literature tells us about blockades and sanctions," ISS Working Papers - General Series 130655, International Institute of Social Studies of Erasmus University Rotterdam (ISS), The Hague.
    5. (ed.), 0. "Research Handbook on Economic Diplomacy," Books, Edward Elgar Publishing, number 16053.
    6. Raul Caruso, 2021. "Economic Statecraft: from Negative Sanctions to Positive Sanctions," Working Papers 1010, European Centre of Peace Science, Integration and Cooperation (CESPIC), Catholic University 'Our Lady of Good Counsel'.
    7. Morgan, T. Clifton & Kobayashi, Yoshiharu, 2021. "Talking to the hand: Bargaining, strategic interaction, and economic sanctions," European Economic Review, Elsevier, vol. 134(C).
    8. Caruso Raul, 2003. "The Impact of International Economic Sanctions on Trade: An Empirical Analysis," Peace Economics, Peace Science, and Public Policy, De Gruyter, vol. 9(2), pages 1-36, April.
    9. Toke S. Aidt & Facundo Albornoz & Esther Hauk, 2019. "Foreign in influence and domestic policy: A survey," Cambridge Working Papers in Economics 1928, Faculty of Economics, University of Cambridge.
    10. van Bergeijk, Peter A. G. & Hossain Siddiquee, Muhammad Shahadat, 2015. "Bias and methodological change in economic sanction reconsidered," Economics Discussion Papers 2015-33, Kiel Institute for the World Economy (IfW Kiel).
    11. Valentin L. Krustev & T. Clifton Morgan, 2011. "Ending Economic Coercion: Domestic Politics and International Bargaining," Conflict Management and Peace Science, Peace Science Society (International), vol. 28(4), pages 351-376, September.
    12. Mikhail A Alexseev & Henry E Hale, 2020. "Crimea come what may: Do economic sanctions backfire politically?," Journal of Peace Research, Peace Research Institute Oslo, vol. 57(2), pages 344-359, March.
    13. Menevis Cilizoglu & Navin A Bapat, 2020. "Economic coercion and the problem of sanctions-proofing," Conflict Management and Peace Science, Peace Science Society (International), vol. 37(4), pages 385-408, July.
    14. Toke S. Aidt & Facundo Albornoz & Esther Hauk, 2021. "Foreign Influence and Domestic Policy," Journal of Economic Literature, American Economic Association, vol. 59(2), pages 426-487, June.
    15. William H. Kaempfer & Anton D. Lowenberg & William Mertens, 2004. "International Economic Sanctions Against a Dictator," Economics and Politics, Wiley Blackwell, vol. 16(1), pages 29-51, March.
    16. Weber, Patrick M. & Schneider, Gerald, 2020. "How many hands to make sanctions work? Comparing EU and US sanctioning efforts," European Economic Review, Elsevier, vol. 130(C).
    17. Afesorgbor, Sylvanus Kwaku, 2019. "The impact of economic sanctions on international trade: How do threatened sanctions compare with imposed sanctions?," European Journal of Political Economy, Elsevier, vol. 56(C), pages 11-26.
    18. Peter A.G. van Bergeijk, 2009. "Economic Diplomacy and the Geography of International Trade," Books, Edward Elgar Publishing, number 13518.
    19. Sajjad Faraji Dizaji & Peter A G van Bergeijk, 2013. "Potential early phase success and ultimate failure of economic sanctions," Journal of Peace Research, Peace Research Institute Oslo, vol. 50(6), pages 721-736, November.
    20. Fuchs, Andreas, 2016. "China’s Economic Diplomacy and the Politics-Trade Nexus," Working Papers 0609, University of Heidelberg, Department of Economics.

    More about this item

    Keywords

    economic sanctions; success; failure; meta-analysis; trade linkage; sanction duration; prior relations; heterogeneity;
    All these keywords.

    JEL classification:

    • F14 - International Economics - - Trade - - - Empirical Studies of Trade

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ems:euriss:135342. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: RePub (email available below). General contact details of provider: https://edirc.repec.org/data/issssnl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.