IDEAS home Printed from https://ideas.repec.org/p/wiw/wiwrsa/ersa13p340.html
   My bibliography  Save this paper

Beyond the SUTVA: how industrial policy evaluations change when we allow for interaction among firms

Author

Listed:
  • Augusto Cerqua
  • Guido Pellegrini

Abstract

Developed countries have used several place-based policies to address the socioeconomic underdevelopment of their lagging regions ranging from tax exemptions to soft loans. Among these place-based policies, investment subsidies to private firms are one of the most popular in the EU. However, the empirical evidence to date is mixed and there is no general consensus on the effectiveness of such policy. Most evaluation studies have focused on the policy impact on subsidized firms, whereas the possible spillovers on other firms have been mostly overlooked. This is due to the dependence of these analyses on the Stable Unit Treatment Value Assumption (SUTVA), i.e. they assume away any possible interaction among firms. There are several situations in which this assumption is not plausible; however, there are severe empirical difficulties in disentangling the spillover effects from more relevant confounding factors. In this paper we propose evaluation strategies capable of detecting potential positive and negative spillovers. In presence of spillovers, the use of eligible but unsubsidized firms as control group will yield biased ATT estimates. We propose to build a counterfactual scenario drawing firms from the pool of firms located in non-assisted areas as similar as possible to the eligible areas. In addition to the ATT, our approach allows to estimate spillover parameters that contrast the positive agglomeration effect with the negative cross-sectional substitution and the crowding-out effect. Econometrically we adopt a Matching difference-in-differences (DID) using the recent coarsened exact matching (CEM) that dominates commonly used existing matching methods in its ability to reduce imbalance, model dependence, and bias. Our application concerns the Italian Law 488 (L488) and contrasting positive and negative spillover effects we find positive spillovers in terms of investments and negative spillovers in terms of employment, but these estimates are not statistically significant. This demonstrates that the positive effects of the subsidies on the subsidized firms' growth in terms of investments and turnover are not engendered to the detriment of the unsubsidized firms. The main methodological contribution to the literature is our novel evaluation strategy that can be adopted in other contexts to evaluate the micro spillovers of other policy instruments.

Suggested Citation

  • Augusto Cerqua & Guido Pellegrini, 2013. "Beyond the SUTVA: how industrial policy evaluations change when we allow for interaction among firms," ERSA conference papers ersa13p340, European Regional Science Association.
  • Handle: RePEc:wiw:wiwrsa:ersa13p340
    as

    Download full text from publisher

    File URL: https://www-sre.wu.ac.at/ersa/ersaconfs/ersa13/ERSA2013_paper_00340.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Mayer, Thierry & Mayneris, Florian & Py, Loriane, 2012. "The Impact of Urban Enterprise Zones on Establishments' Location Decisions: Evidence from French ZFUs," CEPR Discussion Papers 9074, C.E.P.R. Discussion Papers.
    2. Criscuolo, Chiara & Martin, Ralf & Overman, Henry & Van Reenen, John, 2012. "The Causal Effects of an Industrial Policy," IZA Discussion Papers 6323, Institute of Labor Economics (IZA).
    3. Richard Blundell & Monica Costa Dias, 2009. "Alternative Approaches to Evaluation in Empirical Microeconomics," Journal of Human Resources, University of Wisconsin Press, vol. 44(3).
    4. Thierry Mayer & Florian Mayneris & Loriane Py, 2017. "The impact of Urban Enterprise Zones on establishment location decisions and labor market outcomes: evidence from France," Journal of Economic Geography, Oxford University Press, vol. 17(4), pages 709-752.
    5. Thomas Farole & Andrés Rodríguez‐Pose & Michael Storper, 2011. "Cohesion Policy in the European Union: Growth, Geography, Institutions," Journal of Common Market Studies, Wiley Blackwell, vol. 49(5), pages 1089-1111, September.
    6. Givord, Pauline & Quantin, Simon & Trevien, Corentin, 2018. "A long-term evaluation of the first generation of French urban enterprise zones," Journal of Urban Economics, Elsevier, vol. 105(C), pages 149-161.
    7. Devereux, Michael P. & Griffith, Rachel & Simpson, Helen, 2007. "Firm location decisions, regional grants and agglomeration externalities," Journal of Public Economics, Elsevier, vol. 91(3-4), pages 413-435, April.
    8. Timothy J. Bartik, 1991. "Who Benefits from State and Local Economic Development Policies?," Books from Upjohn Press, W.E. Upjohn Institute for Employment Research, number wbsle, November.
    9. Iacus, Stefano M. & King, Gary & Porro, Giuseppe, 2011. "Multivariate Matching Methods That Are Monotonic Imbalance Bounding," Journal of the American Statistical Association, American Statistical Association, vol. 106(493), pages 345-361.
    10. Guido Pellegrini & Augusto Cerqua, 2011. "Are the subsidies to private capital useful? A Multiple Regression Discontinuity Design Approach1," ERSA conference papers ersa11p1323, European Regional Science Association.
    11. Guido Pellegrini & Flavia Terribile & Ornella Tarola & Teo Muccigrosso & Federica Busillo, 2013. "Measuring the effects of European Regional Policy on economic growth: A regression discontinuity approach," Papers in Regional Science, Wiley Blackwell, vol. 92(1), pages 217-233, March.
    12. Accetturo, Antonio & de Blasio, Guido, 2012. "Policies for local development: An evaluation of Italy's “Patti Territoriali”," Regional Science and Urban Economics, Elsevier, vol. 42(1-2), pages 15-26.
    13. Matthew Blackwell & Stefano Iacus & Gary King & Giuseppe Porro, 2009. "cem: Coarsened exact matching in Stata," Stata Journal, StataCorp LP, vol. 9(4), pages 524-546, December.
    14. Faini, Riccardo, 1999. "Trade unions and regional development," European Economic Review, Elsevier, vol. 43(2), pages 457-474, February.
    15. Marusca de Castris & Guido Pellegrini, 2012. "Evaluation of Spatial Effects of Capital Subsidies in the South of Italy," Regional Studies, Taylor & Francis Journals, vol. 46(4), pages 525-538, June.
    16. Bronzini, Raffaello & de Blasio, Guido, 2006. "Evaluating the impact of investment incentives: The case of Italy's Law 488/1992," Journal of Urban Economics, Elsevier, vol. 60(2), pages 327-349, September.
    17. Ham, John C. & Swenson, Charles & İmrohoroğlu, Ayşe & Song, Heonjae, 2011. "Government programs can improve local labor markets: Evidence from State Enterprise Zones, Federal Empowerment Zones and Federal Enterprise Community," Journal of Public Economics, Elsevier, vol. 95(7), pages 779-797.
    18. Bernini, Cristina & Pellegrini, Guido, 2011. "How are growth and productivity in private firms affected by public subsidy? Evidence from a regional policy," Regional Science and Urban Economics, Elsevier, vol. 41(3), pages 253-265, May.
    19. Alf Erko Lublinski, 2003. "Does Geographic Proximity Matter? Evidence from Clustered and Non-clustered Aeronautic Firms in Germany," Regional Studies, Taylor & Francis Journals, vol. 37(5), pages 453-467.
    20. Bondonio, Daniele, 2009. "Impact identification strategies for evaluating business incentive programs," POLIS Working Papers 129, Institute of Public Policy and Public Choice - POLIS.
    21. Melo, Patricia C. & Graham, Daniel J. & Noland, Robert B., 2009. "A meta-analysis of estimates of urban agglomeration economies," Regional Science and Urban Economics, Elsevier, vol. 39(3), pages 332-342, May.
    22. Gerhard Untiedt & Hans Joachim Schalk, 2000. "Regional investment incentives in Germany: Impacts on factor demand and growth," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 34(2), pages 173-195.
    23. Karl Aiginger, 2007. "Industrial Policy: A Dying Breed or A Re-emerging Phoenix," Journal of Industry, Competition and Trade, Springer, vol. 7(3), pages 297-323, December.
    24. Augusto Cerqua & Guido Pellegrini, 2011. "Are the subsidies to private capital useful? A Multiple Regression Discontinuity Design Approach," Working Papers 12, Doctoral School of Economics, Sapienza University of Rome, revised 2011.
    25. Iacus, Stefano M. & King, Gary & Porro, Giuseppe, 2012. "Causal Inference without Balance Checking: Coarsened Exact Matching," Political Analysis, Cambridge University Press, vol. 20(1), pages 1-24, January.
    26. Austan Goolsbee, 1998. "Investment Tax Incentives, Prices, and the Supply of Capital Goods," The Quarterly Journal of Economics, Oxford University Press, vol. 113(1), pages 121-148.
    27. Ho, Daniel E. & Imai, Kosuke & King, Gary & Stuart, Elizabeth A., 2007. "Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference," Political Analysis, Cambridge University Press, vol. 15(3), pages 199-236, July.
    28. Richard Harris & Mary Trainor, 2007. "Impact of Government Intervention on Employment Change and Plant Closure in Northern Ireland, 1983-97," Regional Studies, Taylor & Francis Journals, vol. 41(1), pages 51-63.
    29. Johansson, Börje, 2004. "Parsing the Menagerie of Agglomeration and Network Externalities," Working Paper Series in Economics and Institutions of Innovation 2, Royal Institute of Technology, CESIS - Centre of Excellence for Science and Innovation Studies.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Marusca De Castris & Guido Pellegrini, 2015. "Neighborhood Effects On The Propensity Score Matching," Working Papers 0515, CREI Università degli Studi Roma Tre, revised 2015.
    2. Cerqua, Augusto & Pellegrini, Guido, 2014. "Do subsidies to private capital boost firms' growth? A multiple regression discontinuity design approach," Journal of Public Economics, Elsevier, vol. 109(C), pages 114-126.
    3. Carlianne Patrick, 2014. "Does Increasing Available Non-Tax Economic Development Incentives Result in More Jobs?," National Tax Journal, National Tax Association;National Tax Journal, vol. 67(2), pages 351-386, June.
    4. Marusca De Castris & Guido Pellegrini, 2015. "Italian Public Guarantees To Sme: The Impact On Regional Growth," Working Papers 0615, CREI Università degli Studi Roma Tre, revised 2015.
    5. Roberto Gabriele & Enrico Tundis, 2015. "the effect of longitudinal multiple subsidies on firm performance in the presence of neighbour interactions," ERSA conference papers ersa15p1368, European Regional Science Association.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Augusto Cerqua & Guido Pellegrini, 2014. "Beyond the SUTVA: how policy evaluations change when we allow for interactions among firms," Working Papers 2/14, Sapienza University of Rome, DISS.
    2. Augusto Cerqua & Guido Pellegrini, 2017. "Industrial policy evaluation in the presence of spillovers," Small Business Economics, Springer, vol. 49(3), pages 671-686, October.
    3. Neumark, David & Simpson, Helen, 2015. "Place-Based Policies," Handbook of Regional and Urban Economics, in: Gilles Duranton & J. V. Henderson & William C. Strange (ed.), Handbook of Regional and Urban Economics, edition 1, volume 5, chapter 0, pages 1197-1287, Elsevier.
    4. Ramboer, Sander & Reynaerts, Jo, 2020. "Indecent proposals: Estimating the impact of regional state aid through EU guideline compliance," Regional Science and Urban Economics, Elsevier, vol. 82(C).
    5. Cerqua, Augusto & Pellegrini, Guido, 2014. "Do subsidies to private capital boost firms' growth? A multiple regression discontinuity design approach," Journal of Public Economics, Elsevier, vol. 109(C), pages 114-126.
    6. Dettmann, Eva & Giebler, Alexander & Weyh, Antje, 2019. "flexpaneldid: A Stata command for causal analysis with varying treatment time and duration," IWH Discussion Papers 5/2019, Halle Institute for Economic Research (IWH).
    7. Stefaan Decramer & Stijn Vanormelingen, 2016. "The effectiveness of investment subsidies: evidence from a regression discontinuity design," Small Business Economics, Springer, vol. 47(4), pages 1007-1032, December.
    8. Dettmann, Eva & Weyh, Antje & Titze, Mirko, 2018. "Heterogeneous effects of investment grants - Evidence from a new measurement approach," IAB-Discussion Paper 201815, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    9. Dettmann, Eva & Weyh, Antje & Titze, Mirko, 2017. "Who benefits from GRW? Heterogeneous effects of investment subsidies in Saxony Anhalt," VfS Annual Conference 2017 (Vienna): Alternative Structures for Money and Banking 168158, Verein für Socialpolitik / German Economic Association.
    10. Dettmann, Eva & Giebler, Alexander & Weyh, Antje, 2020. "Flexpaneldid: A Stata toolbox for causal analysis with varying treatment time and duration," IWH Discussion Papers 3/2020, Halle Institute for Economic Research (IWH).
    11. Federico Biagi & Daniele Bondonio & Alberto Martini, 2015. "Counterfactual Impact Evaluation of Enterprise Support Programmes. Evidence from a Decade of Subsidies to Italian Firm," ERSA conference papers ersa15p1619, European Regional Science Association.
    12. Alessandro Cusimano & Fabio Mazzola, 2013. "Ex-post evaluation of Territorial Integrated Projects in Italy: an empirical analysis at firm level," ERSA conference papers ersa13p1331, European Regional Science Association.
    13. Florian MAYNERIS & Loriane PY, 2013. "The Efficiency Of Enterprise Zone Programs Some Conflicting Results?," Region et Developpement, Region et Developpement, LEAD, Universite du Sud - Toulon Var, vol. 38, pages 209-224.
    14. Eva Dettmann & Matthias Brachert & Mirko Titze, 2016. "Identifying the Effects of Place-Based Policies - Causal Evidence from Germany," CESifo Working Paper Series 5901, CESifo.
    15. Guido Pellegrini & Augusto Cerqua, 2011. "Are the subsidies to private capital useful? A Multiple Regression Discontinuity Design Approach1," ERSA conference papers ersa11p1323, European Regional Science Association.
    16. Chaurey, Ritam & Le, Duong Trung, 2018. "Infrastructure Grants and the Performance of Microenterprises," IZA Discussion Papers 11749, Institute of Labor Economics (IZA).
    17. Binkai Chen & Ming Lu & Christopher Timmins & Kuanhu Xiang, 2019. "Spatial Misallocation: Evaluating Place-Based Policies Using a Natural Experiment in China," NBER Working Papers 26148, National Bureau of Economic Research, Inc.
    18. Peter Mayerhofer & Michael Klien, 2016. "Unternehmensinvestitionen in den österreichischen Bundesländern. Entwicklung – Struktur – Funktion regionaler Förderung," WIFO Studies, WIFO, number 61950, Juni.
    19. Bernini, Cristina & Pellegrini, Guido, 2013. "Is subsidising tourism firms an effective use of public funds?," Tourism Management, Elsevier, vol. 35(C), pages 156-167.
    20. Jofre-Monseny, Jordi, 2014. "The effects of unemployment protection on migration in lagging regions," Journal of Urban Economics, Elsevier, vol. 83(C), pages 73-86.

    More about this item

    Keywords

    SUTVA; spillovers; policy evaluation; public subsidies; business support policy;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • H71 - Public Economics - - State and Local Government; Intergovernmental Relations - - - State and Local Taxation, Subsidies, and Revenue
    • R38 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - Real Estate Markets, Spatial Production Analysis, and Firm Location - - - Government Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wiw:wiwrsa:ersa13p340. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Gunther Maier (email available below). General contact details of provider: http://www.ersa.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.