IDEAS home Printed from https://ideas.repec.org/a/bla/jorssa/v165y2002i1p39-57.html
   My bibliography  Save this article

Testing for programme effects in a regression discontinuity design with imperfect compliance

Author

Listed:
  • Erich Battistin
  • Enrico Rettore

Abstract

Summary. The administrators of an office automation training programme in Italy enrolled applicants on the basis of their score in an attitudinal test, with low scoring subjects mandated out of the programme. Some of the applicants who were mandated out resorted to an alternative programme. To identify the effect of the programme by comparing participants with non‐participants we need to account properly for both the selection by the score and the contamination of the comparison group by a number of non‐complying subjects. The estimand resulting from using the mandated status as an instrumental variable for the actual status identifies the effect of the programme on complying subjects exhibiting a score in the attitudinal test in the neighbourhood of the threshold for selection. Simple nonparametric instrumental variable estimators based on the work of Robinson and Hahn and co‐workers reveal that the programme had no effect on the probability of being in work several months after its completion. Simulation results show that in spite of the small sample size the test for the no‐impact hypothesis has non‐negligible power even at small departures from the null hypothesis. As a side‐result Robinson's test turns out to be appreciably more powerful than the other test.

Suggested Citation

  • Erich Battistin & Enrico Rettore, 2002. "Testing for programme effects in a regression discontinuity design with imperfect compliance," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 165(1), pages 39-57, February.
    • Handle: RePEc:bla:jorssa:v:165:y:2002:i:1:p:39-57
    DOI: 10.1111/1467-985X.0asp6
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/1467-985X.0asp6
    Download Restriction: no
    File URL: https://libkey.io/10.1111/1467-985X.0asp6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Angrist, J.D. & Imbens, G.W., 1991. "Sources of Identifying Information in Evaluation Models," Harvard Institute of Economic Research Working Papers 1568, Harvard - Institute of Economic Research.
    2. Joshua D. Angrist & Victor Lavy, 1999. "Using Maimonides' Rule to Estimate the Effect of Class Size on Scholastic Achievement," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 533-575.
    3. Jinyong Hahn & Petra Todd & Wilbert Van der Klaauw, 1999. "Evaluating the Effect of an Antidiscrimination Law Using a Regression-Discontinuity Design," NBER Working Papers 7131, National Bureau of Economic Research, Inc.
    4. Hahn, Jinyong & Todd, Petra & Van der Klaauw, Wilbert, 2001. "Identification and Estimation of Treatment Effects with a Regression-Discontinuity Design," Econometrica, Econometric Society, vol. 69(1), pages 201-209, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. David S. Lee & Thomas Lemieux, 2009. "Regression Discontinuity Designs In Economics," Working Papers 1118, Princeton University, Department of Economics, Industrial Relations Section..
    2. Erich Battistin & Enrico Rettore, 2003. "Another look at the regression discontinuity design," CeMMAP working papers 01/03, Institute for Fiscal Studies.
    3. Jens Hainmueller & Holger Lutz Kern, 2005. "Incumbency Effects in German and British Elections: A Quasi- Experimental Approach," Public Economics 0505009, University Library of Munich, Germany.
    4. Frölich, Markus, 2007. "Regression Discontinuity Design with Covariates," IZA Discussion Papers 3024, Institute of Labor Economics (IZA).
    5. Battistin, Erich & Rettore, Enrico, 2008. "Ineligibles and eligible non-participants as a double comparison group in regression-discontinuity designs," Journal of Econometrics, Elsevier, vol. 142(2), pages 715-730, February.
    6. Mourifié, Ismael, 2015. "Sharp bounds on treatment effects in a binary triangular system," Journal of Econometrics, Elsevier, vol. 187(1), pages 74-81.
    7. Ravallion, Martin, 2008. "Evaluating Anti-Poverty Programs," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 59, pages 3787-3846, Elsevier.
    8. Elena Ragazzi & Lisa Sella, 2013. "The effectiveness of vocational training policies: methods for an impact evaluation," CERIS Working Paper 201314, CNR-IRCrES Research Institute on Sustainable Economic Growth - Torino (TO) ITALY - former Institute for Economic Research on Firms and Growth - Moncalieri (TO) ITALY.
    9. Elisa BARBIERI & Lauretta RUBINI & Alessandra MICOZZI, 2013. "Evaluating policies for innovation and university-firm relations. An investigation on the attitude of Italian academic entrepreneurs towards collaborations with firms," Economia Marche / Journal of Applied Economics, Universita' Politecnica delle Marche (I) / Fondazione Aristide Merloni (I), vol. 0(2), pages 17-45, December.
    10. Elena Ragazzi & Lisa Sella, 2013. "Migration and work: the cohesive role of vocational training policies," CERIS Working Paper 201316, CNR-IRCrES Research Institute on Sustainable Economic Growth - Torino (TO) ITALY - former Institute for Economic Research on Firms and Growth - Moncalieri (TO) ITALY.
    11. Juan Carlos Calcagno & Bridget Terry Long, 2008. "The Impact of Postsecondary Remediation Using a Regression Discontinuity Approach: Addressing Endogenous Sorting and Noncompliance," NBER Working Papers 14194, National Bureau of Economic Research, Inc.
    12. Yixiao Sun, 2005. "Adaptive Estimation of the Regression Discontinuity Model," Econometrics 0506003, University Library of Munich, Germany.
    13. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    14. Daniel Höhmann, 2017. "The effect of legislature size on public spending: evidence from a regression discontinuity design," Public Choice, Springer, vol. 173(3), pages 345-367, December.
    15. Jin-young Choi & Myoung-jae Lee, 2017. "Regression discontinuity: review with extensions," Statistical Papers, Springer, vol. 58(4), pages 1217-1246, December.
    16. Vincent J. Shea & Kevin E. Dow & Alain Yee-Loong Chong & Eric W. T. Ngai, 0. "An examination of the long-term business value of investments in information technology," Information Systems Frontiers, Springer, vol. 0, pages 1-15.
    17. Greta Falavigna & Elena Ragazzi & Lisa Sella, 2014. "Gender inequalities and labour integration. An integrated approach to vocational training in Piedmont," CERIS Working Paper 201407, CNR-IRCrES Research Institute on Sustainable Economic Growth - Torino (TO) ITALY - former Institute for Economic Research on Firms and Growth - Moncalieri (TO) ITALY.
    18. Vincent J. Shea & Kevin E. Dow & Alain Yee-Loong Chong & Eric W. T. Ngai, 2019. "An examination of the long-term business value of investments in information technology," Information Systems Frontiers, Springer, vol. 21(1), pages 213-227, February.
    19. Elena Ragazzi & Lisa Sella, 2013. "Una valutazione di impatto delle politiche formative regionali: il caso piemontese," CERIS Working Paper 201315, CNR-IRCrES Research Institute on Sustainable Economic Growth - Torino (TO) ITALY - former Institute for Economic Research on Firms and Growth - Moncalieri (TO) ITALY.
    20. Falavigna Falavigna & Elena Ragazzi & Lisa Sella, "undated". "Vocational training and labour market: inclusion or segregation paths? An integrated approach on immigrant trainees in Piedmont," CERIS Working Paper 201425, CNR-IRCrES Research Institute on Sustainable Economic Growth - Torino (TO) ITALY - former Institute for Economic Research on Firms and Growth - Moncalieri (TO) ITALY.
    21. Deborah A. Cobb‐Clark & Thomas Crossley, 2003. "Econometrics for Evaluations: An Introduction to Recent Developments," The Economic Record, The Economic Society of Australia, vol. 79(247), pages 491-511, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Frandsen, Brigham R. & Frölich, Markus & Melly, Blaise, 2012. "Quantile treatment effects in the regression discontinuity design," Journal of Econometrics, Elsevier, vol. 168(2), pages 382-395.
    2. Santarossa, Gino, 2008. "Note d'introduction sur l'évaluation d'impact d'un programme public par la méthode de régression par discontinuité [The Evaluation of Public Program Effect Using Regression Discontinuity Method : A," MPRA Paper 11268, University Library of Munich, Germany.
    3. Perez-Reyna, David & Villamizar-Villegas, Mauricio, 2019. "Exchange rate effects of financial regulations," Journal of International Money and Finance, Elsevier, vol. 96(C), pages 228-245.
    4. Markus Frölich, 2004. "Programme Evaluation with Multiple Treatments," Journal of Economic Surveys, Wiley Blackwell, vol. 18(2), pages 181-224, April.
    5. Bauer, Thomas K. & Bender, Stefan & Paloyo, Alfredo R. & Schmidt, Christoph M., 2012. "Evaluating the labor-market effects of compulsory military service," European Economic Review, Elsevier, vol. 56(4), pages 814-829.
    6. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    7. Imbens, Guido W. & Lemieux, Thomas, 2008. "Regression discontinuity designs: A guide to practice," Journal of Econometrics, Elsevier, vol. 142(2), pages 615-635, February.
    8. Eduardo Fé, 2010. "An application of local linear regression with asymmetric kernels to regression discontinuity designs," Economics Discussion Paper Series 1016, Economics, The University of Manchester.
    9. Ponce, Juan & Bedi, Arjun S., 2010. "The impact of a cash transfer program on cognitive achievement: The Bono de Desarrollo Humano of Ecuador," Economics of Education Review, Elsevier, vol. 29(1), pages 116-125, February.
    10. Bizopoulou, Aspasia & Megalokonomou, Rigissa & Simion, Stefania, 2022. "Do Second Chances Pay Off? Evidence from a Natural Experiment with Low-Achieving Students," IZA Discussion Papers 15139, Institute of Labor Economics (IZA).
    11. Yoichi Arai & Yu‐Chin Hsu & Toru Kitagawa & Ismael Mourifié & Yuanyuan Wan, 2022. "Testing identifying assumptions in fuzzy regression discontinuity designs," Quantitative Economics, Econometric Society, vol. 13(1), pages 1-28, January.
    12. Guido Blasio & Samuele Poy, 2017. "THE IMPACT OF LOCAL WAGE REGULATION ON EMPLOYMENT: A BORDER ANALYSIS FROM ITALY IN THE 1950s," Journal of Regional Science, Wiley Blackwell, vol. 57(1), pages 48-74, January.
    13. Matz Dahlberg & Eva Mörk & Jørn Rattsø & Hanna Ågren, 2006. "Using a Discontinuous Grant to Identify the Effect of Grants on Local Taxes and Spending," CESifo Working Paper Series 1857, CESifo.
    14. Chakrabarti Rajashri, 2013. "Impact of Voucher Design on Public School Performance: Evidence from Florida and Milwaukee Voucher Programs," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 13(1), pages 349-394, July.
    15. Argaw, Bethlehem A. & Puhani, Patrick A., 2018. "Does class size matter for school tracking outcomes after elementary school? Quasi-experimental evidence using administrative panel data from Germany," Economics of Education Review, Elsevier, vol. 65(C), pages 48-57.
    16. Murat G. Kırdar & Meltem Dayıoğlu & İsmet Koç, 2018. "The Effects of Compulsory-Schooling Laws on Teenage Marriage and Births in Turkey," Journal of Human Capital, University of Chicago Press, vol. 12(4), pages 640-668.
    17. Dahlberg, Matz & Mörk, Eva & Rattsø, Jørn & Ågren, Hanna, 2008. "Using a discontinuous grant rule to identify the effect of grants on local taxes and spending," Journal of Public Economics, Elsevier, vol. 92(12), pages 2320-2335, December.
    18. Ferraz, Claudio & Finan, Frederico S., 2008. "Motivating Politicians: The Impacts of Monetary Incentives on Quality and Performance," IZA Discussion Papers 3411, Institute of Labor Economics (IZA).
    19. Klinger, Bailey & Schündeln, Matthias, 2011. "Can Entrepreneurial Activity be Taught? Quasi-Experimental Evidence from Central America," World Development, Elsevier, vol. 39(9), pages 1592-1610, September.
    20. Pettersson Lidbom, Per, 2003. "Does the Size of the Legislature Affect the Size of Government? Evidence from a Natural Experiment," Research Papers in Economics 2003:18, Stockholm University, Department of Economics.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssa:v:165:y:2002:i:1:p:39-57. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.