IDEAS home Printed from https://ideas.repec.org/a/sae/evarev/v46y2022i5p598-625.html

Does the Running Variable Matter? A Second Look at Discontinuity Designs for Evaluating Regional Economic Development and Business Incentive Policies

Author

Listed:
  • Daniele Bondonio

Abstract

In recent years, a growing number of studies have applied regression discontinuity designs (RDDs) to the analysis of prominent regional economic development and business incentive policies. As a result, impact evaluations of these policy interventions are being increasingly commissioned under the assumption that local linear regressions have superior impact identification properties in the cases in which an eligibility boundary, geographical border or application cutoff is identifiable as a source of treatment assignment. This paper shows that in a number of frequently encountered cases, however, economic development and business incentive programs pose peculiar impact identification conditions in terms of violations of main assumptions for the validity of RDDs and of running variables that have little or no influence of the outcome variable. Under these circumstances, that bear generalizable relevance also for the analysis of other public programs at large, no adequate testing to support the internal validity of the applied discontinuity design is often performed in the literature and the use of local linear/polynomial regressions, or cross-border comparisons, becomes an inadequate choice. When these conditions apply, adopting instead other quasi-experimental methods to achieve an actual adequate treatment-control balance of the relevant baseline characteristic will often be a better approach. JEL classification; O1; R5; C23

Suggested Citation

  • Daniele Bondonio, 2022. "Does the Running Variable Matter? A Second Look at Discontinuity Designs for Evaluating Regional Economic Development and Business Incentive Policies," Evaluation Review, , vol. 46(5), pages 598-625, October.
  • Handle: RePEc:sae:evarev:v:46:y:2022:i:5:p:598-625
    DOI: 10.1177/0193841X221077558
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0193841X221077558
    Download Restriction: no

    File URL: https://libkey.io/10.1177/0193841X221077558?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Gobillon, Laurent & Magnac, Thierry & Selod, Harris, 2012. "Do unemployed workers benefit from enterprise zones? The French experience," Journal of Public Economics, Elsevier, vol. 96(9-10), pages 881-892.
    2. Green, Donald P. & Leong, Terence Y. & Kern, Holger L. & Gerber, Alan S. & Larimer, Christopher W., 2009. "Testing the Accuracy of Regression Discontinuity Analysis Using Experimental Benchmarks," Political Analysis, Cambridge University Press, vol. 17(4), pages 400-417.
    3. Lemieux, Thomas & Milligan, Kevin, 2008. "Incentive effects of social assistance: A regression discontinuity approach," Journal of Econometrics, Elsevier, vol. 142(2), pages 807-828, February.
    4. repec:hal:pseose:hal-00812979 is not listed on IDEAS
    5. Alan B. Krueger & David Card, 2000. "Minimum Wages and Employment: A Case Study of the Fast-Food Industry in New Jersey and Pennsylvania: Reply," American Economic Review, American Economic Association, vol. 90(5), pages 1397-1420, December.
    6. Becker, Sascha O. & Egger, Peter H. & von Ehrlich, Maximilian, 2010. "Going NUTS: The effect of EU Structural Funds on regional performance," Journal of Public Economics, Elsevier, vol. 94(9-10), pages 578-590, October.
    7. Thomas J. Holmes, 1998. "The Effect of State Policies on the Location of Manufacturing: Evidence from State Borders," Journal of Political Economy, University of Chicago Press, vol. 106(4), pages 667-705, August.
    8. Jinyong Hahn & Petra Todd & Wilbert Van der Klaauw, 1999. "Evaluating the Effect of an Antidiscrimination Law Using a Regression-Discontinuity Design," NBER Working Papers 7131, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. N/A, 2022. "Publication Notice," Evaluation Review, , vol. 46(5), pages 678-679, October.
    2. Bondonio, Daniele & Chirico, Paolo & Piacenza, Massimiliano & Robbiano, Simone, 2025. "Urban NO2-pollution and health outcomes: Evidence from a natural experiment in Italy on the simulated benefits of the EU zero-emission-vehicles resolution," Health Policy, Elsevier, vol. 159(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Daniele Bondonio, 2019. "Does the Running Variable Matter? A Second Look at Discontinuity Designs for Evaluating Regional Economic Development and Business Incentive Policies," Economics Working Paper from Condorcet Center for political Economy at CREM-CNRS 2019-02-ccr, Condorcet Center for political Economy.
    2. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    3. Chiara Criscuolo & Ralf Martin & Henry G. Overman & John Van Reenen, 2019. "Some Causal Effects of an Industrial Policy," American Economic Review, American Economic Association, vol. 109(1), pages 48-85, January.
    4. Riccardo Crescenzi & Mara Giua, 2018. "One or Many Cohesion Policies of the European Union? On the Diverging Impacts of Cohesion Policy across Member States," SERC Discussion Papers 0230, Centre for Economic Performance, LSE.
    5. Criscuolo, Chiara & Martin, Ralf & Overman, Henry & Van Reenen, John, 2012. "The Causal Effects of an Industrial Policy," IZA Discussion Papers 6323, IZA Network @ LISER.
    6. Neumark, David & Simpson, Helen, 2015. "Place-Based Policies," Handbook of Regional and Urban Economics, in: Gilles Duranton & J. V. Henderson & William C. Strange (ed.), Handbook of Regional and Urban Economics, edition 1, volume 5, chapter 0, pages 1197-1287, Elsevier.
    7. David S. Lee & Thomas Lemieux, 2009. "Regression Discontinuity Designs In Economics," Working Papers 1118, Princeton University, Department of Economics, Industrial Relations Section..
    8. Perez-Reyna, David & Villamizar-Villegas, Mauricio, 2019. "Exchange rate effects of financial regulations," Journal of International Money and Finance, Elsevier, vol. 96(C), pages 228-245.
    9. Daniel Kuehn, 2016. "Spillover Bias in Cross-Border Minimum Wage Studies: Evidence from a Gravity Model," Journal of Labor Research, Springer, vol. 37(4), pages 441-459, December.
    10. Maximilian v. Ehrlich & Henry G. Overman, 2020. "Place-Based Policies and Spatial Disparities across European Cities," Journal of Economic Perspectives, American Economic Association, vol. 34(3), pages 128-149, Summer.
    11. Nadiia Matsiuk, 2022. "Thrive, survive, or perish: The impact of regional autonomy on the demographic dynamics of Italian Alpine territories," Journal of Regional Science, Wiley Blackwell, vol. 62(5), pages 1512-1558, November.
    12. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    13. Ari Hyytinen & Jaakko Meriläinen & Tuukka Saarimaa & Otto Toivanen & Janne Tukiainen, 2018. "When does regression discontinuity design work? Evidence from random election outcomes," Quantitative Economics, Econometric Society, vol. 9(2), pages 1019-1051, July.
    14. Giuseppe Albanese & Guglielmo Barone & Guido de Blasio, 2023. "The impact of place‐based policies on interpersonal income inequality," Economica, London School of Economics and Political Science, vol. 90(358), pages 508-530, April.
    15. Eric James Stokan, 2019. "An Estimate of the Local Economic Impact of State-Level Earned Income Tax Credits," Economic Development Quarterly, , vol. 33(3), pages 170-186, August.
    16. Jofre-Monseny, Jordi, 2014. "The effects of unemployment protection on migration in lagging regions," Journal of Urban Economics, Elsevier, vol. 83(C), pages 73-86.
    17. Cingano, Federico & Palomba, Filippo & Pinotti, Paolo & Rettore, Enrico, 2022. "Making Subsidies Work: Rules vs. Discretion," IZA Discussion Papers 15172, IZA Network @ LISER.
    18. Hervé Cardot & Antonio Musolesi, 2020. "Modeling temporal treatment effects with zero inflated semi-parametric regression models: The case of local development policies in France," Post-Print hal-02394810, HAL.
    19. Li, Xiaoying & Shi, Dongbo & Zhou, Sifan, 2023. "The minimum wage and the locations of new business entries in China: Estimates based on a refined border approach," Regional Science and Urban Economics, Elsevier, vol. 99(C).
    20. Andrew Hanson, 2021. "Taxes and Economic Development: An Update on the State of the Economics Literature," Economic Development Quarterly, , vol. 35(3), pages 232-253, August.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    JEL classification:

    • O1 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development
    • R5 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - Regional Government Analysis
    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:46:y:2022:i:5:p:598-625. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.