IDEAS home Printed from https://ideas.repec.org/a/sae/evarev/v46y2022i5p598-625.html

Does the Running Variable Matter? A Second Look at Discontinuity Designs for Evaluating Regional Economic Development and Business Incentive Policies

Author

Listed:
  • Daniele Bondonio

Abstract

In recent years, a growing number of studies have applied regression discontinuity designs (RDDs) to the analysis of prominent regional economic development and business incentive policies. As a result, impact evaluations of these policy interventions are being increasingly commissioned under the assumption that local linear regressions have superior impact identification properties in the cases in which an eligibility boundary, geographical border or application cutoff is identifiable as a source of treatment assignment. This paper shows that in a number of frequently encountered cases, however, economic development and business incentive programs pose peculiar impact identification conditions in terms of violations of main assumptions for the validity of RDDs and of running variables that have little or no influence of the outcome variable. Under these circumstances, that bear generalizable relevance also for the analysis of other public programs at large, no adequate testing to support the internal validity of the applied discontinuity design is often performed in the literature and the use of local linear/polynomial regressions, or cross-border comparisons, becomes an inadequate choice. When these conditions apply, adopting instead other quasi-experimental methods to achieve an actual adequate treatment-control balance of the relevant baseline characteristic will often be a better approach. JEL classification; O1; R5; C23

Suggested Citation

  • Daniele Bondonio, 2022. "Does the Running Variable Matter? A Second Look at Discontinuity Designs for Evaluating Regional Economic Development and Business Incentive Policies," Evaluation Review, , vol. 46(5), pages 598-625, October.
  • Handle: RePEc:sae:evarev:v:46:y:2022:i:5:p:598-625
    DOI: 10.1177/0193841X221077558
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0193841X221077558
    Download Restriction: no

    File URL: https://libkey.io/10.1177/0193841X221077558?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Alan B. Krueger & David Card, 2000. "Minimum Wages and Employment: A Case Study of the Fast-Food Industry in New Jersey and Pennsylvania: Reply," American Economic Review, American Economic Association, vol. 90(5), pages 1397-1420, December.
    2. Becker, Sascha O. & Egger, Peter H. & von Ehrlich, Maximilian, 2010. "Going NUTS: The effect of EU Structural Funds on regional performance," Journal of Public Economics, Elsevier, vol. 94(9-10), pages 578-590, October.
    3. Thomas J. Holmes, 1998. "The Effect of State Policies on the Location of Manufacturing: Evidence from State Borders," Journal of Political Economy, University of Chicago Press, vol. 106(4), pages 667-705, August.
    4. Lemieux, Thomas & Milligan, Kevin, 2008. "Incentive effects of social assistance: A regression discontinuity approach," Journal of Econometrics, Elsevier, vol. 142(2), pages 807-828, February.
    5. Gobillon, Laurent & Magnac, Thierry & Selod, Harris, 2012. "Do unemployed workers benefit from enterprise zones? The French experience," Journal of Public Economics, Elsevier, vol. 96(9-10), pages 881-892.
    6. Jinyong Hahn & Petra Todd & Wilbert Van der Klaauw, 1999. "Evaluating the Effect of an Antidiscrimination Law Using a Regression-Discontinuity Design," NBER Working Papers 7131, National Bureau of Economic Research, Inc.
    7. repec:hal:pseose:hal-00812979 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bondonio, Daniele & Chirico, Paolo & Piacenza, Massimiliano & Robbiano, Simone, 2025. "Urban NO2-pollution and health outcomes: Evidence from a natural experiment in Italy on the simulated benefits of the EU zero-emission-vehicles resolution," Health Policy, Elsevier, vol. 159(C).
    2. N/A, 2022. "Publication Notice," Evaluation Review, , vol. 46(5), pages 678-679, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Daniele Bondonio, 2019. "Does the Running Variable Matter? A Second Look at Discontinuity Designs for Evaluating Regional Economic Development and Business Incentive Policies," Economics Working Paper from Condorcet Center for political Economy at CREM-CNRS 2019-02-ccr, Condorcet Center for political Economy.
    2. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    3. Chiara Criscuolo & Ralf Martin & Henry G. Overman & John Van Reenen, 2019. "Some Causal Effects of an Industrial Policy," American Economic Review, American Economic Association, vol. 109(1), pages 48-85, January.
    4. Riccardo Crescenzi & Mara Giua, 2018. "One or Many Cohesion Policies of the European Union? On the Diverging Impacts of Cohesion Policy across Member States," SERC Discussion Papers 0230, Centre for Economic Performance, LSE.
    5. Imbens, Guido W. & Lemieux, Thomas, 2008. "Regression discontinuity designs: A guide to practice," Journal of Econometrics, Elsevier, vol. 142(2), pages 615-635, February.
    6. Neumark, David & Simpson, Helen, 2015. "Place-Based Policies," Handbook of Regional and Urban Economics, in: Gilles Duranton & J. V. Henderson & William C. Strange (ed.), Handbook of Regional and Urban Economics, edition 1, volume 5, chapter 0, pages 1197-1287, Elsevier.
    7. Maximilian v. Ehrlich & Tobias Seidel, 2018. "The Persistent Effects of Place-Based Policy: Evidence from the West-German Zonenrandgebiet," American Economic Journal: Economic Policy, American Economic Association, vol. 10(4), pages 344-374, November.
    8. Mitman, Kurt & Hagedorn, Marcus & Manovskii, Iourii, 2016. "Interpreting Recent Quasi-Experimental Evidence on the Effects of Unemployment Benefit Extensions," CEPR Discussion Papers 11290, C.E.P.R. Discussion Papers.
    9. Hervé Cardot & Antonio Musolesi, 2019. "Modeling temporal treatment effects with zero inflated semi-parametric regression models: the case of local development policies in France," SEEDS Working Papers 0219, SEEDS, Sustainability Environmental Economics and Dynamics Studies, revised Jan 2019.
    10. Fe, Eduardo & Hollingsworth, Bruce, 2012. "Estimating the eect of retirement on mental health via panel discontinuity designs," MPRA Paper 38162, University Library of Munich, Germany.
    11. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    12. Kong, Dongmin & Qin, Ni & Xiang, Junyi, 2021. "Minimum wage and entrepreneurship: Evidence from China," Journal of Economic Behavior & Organization, Elsevier, vol. 189(C), pages 320-336.
    13. Criscuolo, Chiara & Martin, Ralf & Overman, Henry & Van Reenen, John, 2012. "The Causal Effects of an Industrial Policy," IZA Discussion Papers 6323, IZA Network @ LISER.
    14. Perez-Reyna, David & Villamizar-Villegas, Mauricio, 2019. "Exchange rate effects of financial regulations," Journal of International Money and Finance, Elsevier, vol. 96(C), pages 228-245.
    15. Eric James Stokan, 2019. "An Estimate of the Local Economic Impact of State-Level Earned Income Tax Credits," Economic Development Quarterly, , vol. 33(3), pages 170-186, August.
    16. Li, Xiaoying & Shi, Dongbo & Zhou, Sifan, 2023. "The minimum wage and the locations of new business entries in China: Estimates based on a refined border approach," Regional Science and Urban Economics, Elsevier, vol. 99(C).
    17. Andrew Hanson, 2021. "Taxes and Economic Development: An Update on the State of the Economics Literature," Economic Development Quarterly, , vol. 35(3), pages 232-253, August.
    18. Antonio Musolesi & Hervé Cardot, 2017. "Modeling temporal treatment effects with zero inflated semi-parametric regression models: the case of local development policies in France," Working Papers 2017036, University of Ferrara, Department of Economics.
    19. Cingano, Federico & Palomba, Filippo & Pinotti, Paolo & Rettore, Enrico, 2022. "Making Subsidies Work: Rules vs. Discretion," IZA Discussion Papers 15172, IZA Network @ LISER.
    20. Maximilian v. Ehrlich & Henry G. Overman, 2020. "Place-Based Policies and Spatial Disparities across European Cities," Journal of Economic Perspectives, American Economic Association, vol. 34(3), pages 128-149, Summer.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    JEL classification:

    • O1 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development
    • R5 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - Regional Government Analysis
    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:46:y:2022:i:5:p:598-625. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.