IDEAS home Printed from https://ideas.repec.org/p/cpr/ceprdp/8428.html
   My bibliography  Save this paper

Impact Evaluation of Trade Interventions: Paving the Way

Author

Listed:
  • Mattoo, Aaditya
  • Cadot, Olivier
  • Gourdon, Julien
  • Fernandes, Ana Margarida

Abstract

The focus of trade policy has shifted in recent years from economy-wide reductions in tariffs and trade restrictions towards targeted interventions to facilitate trade and promote exports. Most of these latter interventions are based on the new mantra of 'aid-for-trade' rather than on hard evidence on what works and what doesn?t. On the one hand, rigorous impact-evaluation is needed to justify these interventions and to improve their design. On the other hand, rigorous evaluation is feasible because unlike traditional trade policy, these interventions tend to be targeted and so it is possible to construct treatment and control groups. When interventions are not naturally targeted, such as in the case of customs reforms, some techniques, such as randomized control trials, may not be feasible but meaningful evaluation may still be possible. We discuss examples of impact evaluations using a range of methods (experimental, quasi-experimental, or 'natural experiments') highlighting the particular issues and caveats arising in a trade context, and the valuable lessons that are already being learnt. We argue that systematically building impact evaluation into trade projects could lead to better policy design and a more credible case for 'aid-for-trade.'

Suggested Citation

  • Mattoo, Aaditya & Cadot, Olivier & Gourdon, Julien & Fernandes, Ana Margarida, 2011. "Impact Evaluation of Trade Interventions: Paving the Way," CEPR Discussion Papers 8428, C.E.P.R. Discussion Papers.
  • Handle: RePEc:cpr:ceprdp:8428
    as

    Download full text from publisher

    File URL: https://cepr.org/publications/DP8428
    Download Restriction: CEPR Discussion Papers are free to download for our researchers, subscribers and members. If you fall into one of these categories but have trouble downloading our papers, please contact us at subscribers@cepr.org
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. David McKenzie, 2010. "Impact Assessments in Finance and Private Sector Development: What Have We Learned and What Should We Learn?," The World Bank Research Observer, World Bank, vol. 25(2), pages 209-233, August.
    2. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-620, September.
    3. Abhijit Vinayak Banerjee & Alice H. Amsden & Robert H. Bates & Jagdish Bhagwati & Angus Deaton & Nicholas Stern, 2007. "Making Aid Work," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262026155, April.
    4. Xavier Giné & Inessa Love, 2010. "Do Reorganization Costs Matter for Efficiency? Evidence from a Bankruptcy Reform in Colombia," Journal of Law and Economics, University of Chicago Press, vol. 53(4), pages 833-864.
    5. Ravallion Martin, 2015. "On the Implications of Essential Heterogeneity for Estimating Causal Impacts Using Social Experiments," Journal of Econometric Methods, De Gruyter, vol. 4(1), pages 145-151, January.
    6. Miriam Bruhn, 2011. "License to Sell: The Effect of Business Registration Reform on Entrepreneurial Activity in Mexico," The Review of Economics and Statistics, MIT Press, vol. 93(1), pages 382-386, February.
    7. Balat, Jorge & Brambilla, Irene & Porto, Guido, 2009. "Realizing the gains from trade: Export crops, marketing costs, and poverty," Journal of International Economics, Elsevier, vol. 78(1), pages 21-31, June.
    8. Lopez-Acevedo , Gladys & Tinajero, Monica, 2010. "Mexico : impact evaluation of sme programs using panel firm data," Policy Research Working Paper Series 5186, The World Bank.
    9. Francois, Joseph & Manchin, Miriam, 2013. "Institutions, Infrastructure, and Trade," World Development, Elsevier, vol. 46(C), pages 165-175.
    10. Richard Blundell & Monica Costa Dias, 2009. "Alternative Approaches to Evaluation in Empirical Microeconomics," Journal of Human Resources, University of Wisconsin Press, vol. 44(3).
    11. Harrison, Ann E. & Rodriguez-Clare, Andres, 2009. "Trade, Foreign Investment, and Industrial Policy," MPRA Paper 15561, University Library of Munich, Germany.
    12. Matthias Helble & Catherine Mann & John Wilson, 2012. "Aid-for-trade facilitation," Review of World Economics (Weltwirtschaftliches Archiv), Springer;Institut für Weltwirtschaft (Kiel Institute for the World Economy), vol. 148(2), pages 357-376, June.
    13. Jaud, Melise & Cadot, Olivier, 2012. "A second look at the pesticides initiative program: evidence from Senegal," World Trade Review, Cambridge University Press, vol. 11(3), pages 490-506, July.
    14. Gamberoni, Elisa & Newfarmer, Richard, 2009. "Aid for trade : matching potential demand and supply," Policy Research Working Paper Series 4991, The World Bank.
    15. Hoekman, Bernard & Nicita, Alessandro, 2011. "Trade Policy, Trade Costs, and Developing Country Trade," World Development, Elsevier, vol. 39(12), pages 2069-2079.
    16. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    17. Ravallion, Martin, 2008. "Evaluating Anti-Poverty Programs," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 59, pages 3787-3846, Elsevier.
    18. Wagner, Don, 2003. "Aid and trade--an empirical study," Journal of the Japanese and International Economies, Elsevier, vol. 17(2), pages 153-173, June.
    19. Freund, Caroline & Rocha, Nadia, 2010. "What constrains Africa's exports?," WTO Staff Working Papers ERSD-2010-07, World Trade Organization (WTO), Economic Research and Statistics Division.
    20. Simeon Djankov & Caroline Freund & Cong S. Pham, 2010. "Trading on Time," The Review of Economics and Statistics, MIT Press, vol. 92(1), pages 166-173, February.
    21. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962, Elsevier.
    22. Simone Juhasz Silva & Douglas Nelson, 2012. "Does Aid Cause Trade? Evidence from an Asymmetric Gravity Model," The World Economy, Wiley Blackwell, vol. 35(5), pages 545-577, May.
    23. Djebbari, Habiba & Smith, Jeffrey, 2008. "Heterogeneous impacts in PROGRESA," Journal of Econometrics, Elsevier, vol. 145(1-2), pages 64-80, July.
    24. Hong Tan, 2009. "Evaluating SME support Programs in Chile using panel firm data," Policy Research Working Paper Series 5082, The World Bank.
    25. James J. Heckman & Sergio Urzua & Edward Vytlacil, 2006. "Understanding Instrumental Variables in Models with Essential Heterogeneity," The Review of Economics and Statistics, MIT Press, vol. 88(3), pages 389-432, August.
    26. Christopher B. Barrett & Michael R. Carter, 2010. "The Power and Pitfalls of Experiments in Development Economics: Some Non-random Reflections," Applied Economic Perspectives and Policy, Agricultural and Applied Economics Association, vol. 32(4), pages 515-548.
    27. repec:pri:rpdevs:morduch_microfinance_poor is not listed on IDEAS
    28. Raghuram G. Rajan & Arvind Subramanian, 2008. "Aid and Growth: What Does the Cross-Country Evidence Really Show?," The Review of Economics and Statistics, MIT Press, vol. 90(4), pages 643-665, November.
    29. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    30. Fan, Yanqin & Park, Sang Soo, 2010. "Sharp Bounds On The Distribution Of Treatment Effects And Their Statistical Inference," Econometric Theory, Cambridge University Press, vol. 26(3), pages 931-951, June.
    31. Abhijit V. Banerjee & Esther Duflo, 2009. "The Experimental Approach to Development Economics," Annual Review of Economics, Annual Reviews, vol. 1(1), pages 151-178, May.
    32. Caroline Freund & Martha Denisse Pierola, 2015. "Export Superstars," The Review of Economics and Statistics, MIT Press, vol. 97(5), pages 1023-1032, December.
    33. repec:idb:brikps:publication-detail,7101.html?id=21146 is not listed on IDEAS
    34. Rodrik, Dani, 2008. "The New Development Economics: We Shall Experiment, but How Shall We Learn?," Working Paper Series rwp08-055, Harvard University, John F. Kennedy School of Government.
    35. Portugal-Perez, Alberto & Wilson, John S., 2012. "Export Performance and Trade Facilitation Reform: Hard and Soft Infrastructure," World Development, Elsevier, vol. 40(7), pages 1295-1307.
    36. Abbring, Jaap H. & Heckman, James J., 2007. "Econometric Evaluation of Social Programs, Part III: Distributional Treatment Effects, Dynamic Treatment Effects, Dynamic Discrete Choice, and General Equilibrium Policy Evaluation," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 72, Elsevier.
    37. Steven Glazerman & Dan M. Levy & David Myers, "undated". "Nonexperimental Replications of Social Experiments: A Systematic Review," Mathematica Policy Research Reports 9e8a2edf60ef4fa89ad9a5acf, Mathematica Policy Research.
    38. Paul Brenton & Erik von Uexkull, 2014. "Product specific technical assistance for exports – has it been effective?," World Scientific Book Chapters, in: INTERNATIONAL TRADE, DISTRIBUTION AND DEVELOPMENT Empirical Studies of Trade Policies, chapter 18, pages 373-392, World Scientific Publishing Co. Pte. Ltd..
    39. Todd, Petra E., 2008. "Evaluating Social Programs with Endogenous Program Placement and Selection of the Treated," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 60, pages 3847-3894, Elsevier.
    40. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, January.
    41. David McKenzie, 2011. "How Can We Learn Whether Firm Policies Are Working in Africa? Challenges (and Solutions?) For Experiments and Structural Models -super-†," Journal of African Economies, Centre for the Study of African Economies, vol. 20(4), pages 600-625, August.
    42. Calì, Massimiliano & te Velde, Dirk Willem, 2011. "Does Aid for Trade Really Improve Trade Performance?," World Development, Elsevier, vol. 39(5), pages 725-740, May.
    43. McKenzie, David, 2012. "Beyond baseline and follow-up: The case for more T in experiments," Journal of Development Economics, Elsevier, vol. 99(2), pages 210-221.
    44. Volpe Martincus, Christian & Carballo, Jerónimo, 2010. "Beyond the average effects: The distributional impacts of export promotion programs in developing countries," Journal of Development Economics, Elsevier, vol. 92(2), pages 201-214, July.
    45. Lederman, Daniel & Olarreaga, Marcelo & Payton, Lucy, 2010. "Export promotion agencies: Do they work?," Journal of Development Economics, Elsevier, vol. 91(2), pages 257-265, March.
    46. Charles F. Manski, 1997. "The Mixing Problem in Programme Evaluation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 537-553.
    47. Jonathan Morduch, 1998. "Does Microfinance Really Help the Poor? New Evidence from Flagship Programs in Bangladesh," Working Papers 198, Princeton University, Woodrow Wilson School of Public and International Affairs, Research Program in Development Studies..
    48. Klapper, Leora & Love, Inessa, 2010. "The impact of business environment reforms on new firm registration," Policy Research Working Paper Series 5493, The World Bank.
    49. Freund, Caroline & Pierola, Martha Denisse, 2010. "Export entrepreneurs : evidence from Peru," Policy Research Working Paper Series 5407, The World Bank.
    50. Volpe Martincus, Christian & Carballo, Jerónimo, 2010. "Beyond the average effects: The distributional impacts of export promotion programs in developing countries," Journal of Development Economics, Elsevier, vol. 92(2), pages 201-214, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Frederick Mayer & William Milberg, 2013. "Aid for Trade in a world of global value chains: chain power, the distribution of rents and implications for the form of aid," Global Development Institute Working Paper Series ctg-2013-34, GDI, The University of Manchester.
    2. Luca Salvatici & Silvia Nenci, 2017. "New features, forgotten costs and counterfactual gains of the international trading system," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 44(4), pages 592-633.
    3. Independent Evaluation Group, 2013. "Evaluation of the International Finance Corporation's Global Trade Finance Program, 2006-12," World Bank Publications - Books, The World Bank Group, number 15769.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guido W. Imbens, 2010. "Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009)," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 399-423, June.
    2. Léopold BIARDEAU & Anne BORING, 2017. "L’impact de l’aide au développement sur les flux commerciaux entre pays donateurs et pays récipiendaires," Working Paper 464d860e-562e-4ae7-98f5-1, Agence française de développement.
    3. Christian Volpe Martincus, 2010. "Odyssey in International Markets: An Assessment of the Effectiveness of Export Promotion in Latin America and the Caribbean," IDB Publications (Books), Inter-American Development Bank, number 16458, February.
    4. Jones A.M & Rice N, 2009. "Econometric Evaluation of Health Policies," Health, Econometrics and Data Group (HEDG) Working Papers 09/09, HEDG, c/o Department of Economics, University of York.
    5. Mariana Vijil & Laurent Wagner, 2012. "Does Aid for Trade Enhance Export Performance? Investigating the Infrastructure Channel," The World Economy, Wiley Blackwell, vol. 35(7), pages 838-868, July.
    6. Angus Deaton, 2009. "Instruments of development: Randomization in the tropics, and the search for the elusive keys to economic development," Working Papers 1128, Princeton University, Woodrow Wilson School of Public and International Affairs, Center for Health and Wellbeing..
    7. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    8. Christian Volpe Martincus & Jerónimo Carballo & Pablo M. Garcia, 2012. "Public programmes to promote firms’ exports in developing countries: are there heterogeneous effects by size categories?," Applied Economics, Taylor & Francis Journals, vol. 44(4), pages 471-491, February.
    9. Matthias Busse & Ruth Hoekstra & Jens Königer, 2012. "The Impact of Aid for Trade Facilitation on the Costs of Trading," Kyklos, Wiley Blackwell, vol. 65(2), pages 143-163, May.
    10. Jaud, Melise & Cadot, Olivier, 2012. "A second look at the pesticides initiative program: evidence from Senegal," World Trade Review, Cambridge University Press, vol. 11(3), pages 490-506, July.
    11. Sokbae Lee & Yoon-Jae Whang, 2009. "Nonparametric Tests of Conditional Treatment Effects," Cowles Foundation Discussion Papers 1740, Cowles Foundation for Research in Economics, Yale University.
    12. Felicitas Nowak-Lehmann & Inmaculada Martínez-Zarzoso & Dierk Herzer & Stephan Klasen & Adriana Cardozo, 2013. "Does foreign aid promote recipient exports to donor countries?," Review of World Economics (Weltwirtschaftliches Archiv), Springer;Institut für Weltwirtschaft (Kiel Institute for the World Economy), vol. 149(3), pages 505-535, September.
    13. (ed.), 0. "Research Handbook on Economic Diplomacy," Books, Edward Elgar Publishing, number 16053.
    14. Thomas, Ranjeeta & Jones, Andrew M & Squire, Lyn, 2010. "Methods for Evaluating Innovative Health Programs (EIHP): A Multi-Country Study," MPRA Paper 29402, University Library of Munich, Germany.
    15. Cadot, Olivier & Fernandes, Ana M. & Gourdon, Julien & Mattoo, Aaditya, 2015. "Are the benefits of export support durable? Evidence from Tunisia," Journal of International Economics, Elsevier, vol. 97(2), pages 310-324.
    16. Bernard Hoekman & Anirudh Shingal, 2020. "Aid for trade and international transactions in goods and services," Review of International Economics, Wiley Blackwell, vol. 28(2), pages 320-340, May.
    17. Philipp H�hne & Birgit Meyer & Peter Nunnenkamp, 2014. "Who Benefits from Aid for Trade? Comparing the Effects on Recipient versus Donor Exports," Journal of Development Studies, Taylor & Francis Journals, vol. 50(9), pages 1275-1288, September.
    18. Temple, Jonathan R.W., 2010. "Aid and Conditionality," Handbook of Development Economics, in: Dani Rodrik & Mark Rosenzweig (ed.), Handbook of Development Economics, edition 1, volume 5, chapter 0, pages 4415-4523, Elsevier.
    19. Olivier Cadot & Ana Fernandes & Julien Gourdon & Aaditya Mattoo & Jaime Melo, 2014. "Evaluating Aid for Trade: A Survey of Recent Studies," The World Economy, Wiley Blackwell, vol. 37(4), pages 516-529, April.
    20. Jeffrey Smith & Arthur Sweetman, 2016. "Viewpoint: Estimating the causal effects of policies and programs," Canadian Journal of Economics, Canadian Economics Association, vol. 49(3), pages 871-905, August.

    More about this item

    Keywords

    Export promotion; Firms; Export margins; Tunisia; Impact evaluation; Propensity-score matching;
    All these keywords.

    JEL classification:

    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models
    • F13 - International Economics - - Trade - - - Trade Policy; International Trade Organizations
    • F14 - International Economics - - Trade - - - Empirical Studies of Trade
    • L15 - Industrial Organization - - Market Structure, Firm Strategy, and Market Performance - - - Information and Product Quality
    • L25 - Industrial Organization - - Firm Objectives, Organization, and Behavior - - - Firm Performance
    • O17 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Formal and Informal Sectors; Shadow Economy; Institutional Arrangements
    • O24 - Economic Development, Innovation, Technological Change, and Growth - - Development Planning and Policy - - - Trade Policy; Factor Movement; Foreign Exchange Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cpr:ceprdp:8428. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://www.cepr.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.