IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp270.html
   My bibliography  Save this paper

The Evaluation of Community-Based Interventions: A Monte Carlo Study

Author

Listed:
  • Augurzky, Boris

    (RWI)

  • Schmidt, Christoph M.

    (RWI)

Abstract

The evaluation of interventions such as active labor market policies or medical programs by means of a randomized controlled trial is often considered the gold standard. However, randomized experiments might face severe shortcomings especially if performed at the group level. One such problem is caused by small sample size which might prevent the experiment from developing its fundamental virtue in balancing all relevant covariates. This paper investigates the potential and limits of experimental and non-experimental approaches to the evaluation problem, in particular the use of instrumental variables, in a numerical simulation study, against the particular background of community-based interventions. In our simulations, we emphasize the trade-off between bias and precision by imposing a smaller number of communities whenever we model a randomized experiment, and by allowing for a correspondingly larger number of communities in all cases where selection into the program is not controlled completely by the analyst.

Suggested Citation

  • Augurzky, Boris & Schmidt, Christoph M., 2001. "The Evaluation of Community-Based Interventions: A Monte Carlo Study," IZA Discussion Papers 270, Institute of Labor Economics (IZA).
    • Handle: RePEc:iza:izadps:dp270
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp270.pdf
    Download Restriction: no
    ---><---

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Angrist, Josh & Lavy, Victor, 2002. "The Effect of High School Matriculation Awards: Evidence from Randomized Trials," CEPR Discussion Papers 3827, C.E.P.R. Discussion Papers.
    2. Christoph M. Schmidt, 2000. "Arbeitsmarktpolitische Massnahmen und ihre Evaluierung: eine Bestandsaufnahme," Vierteljahrshefte zur Wirtschaftsforschung / Quarterly Journal of Economic Research, DIW Berlin, German Institute for Economic Research, vol. 69(3), pages 425-437.
    3. Peters, Jörg, 2009. "Evaluating Rural Electrification Projects - Methodological Approaches," Ruhr Economic Papers 136, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    4. Alesina, Alberto & Di Tella, Rafael & MacCulloch, Robert, 2004. "Inequality and happiness: are Europeans and Americans different?," Journal of Public Economics, Elsevier, vol. 88(9-10), pages 2009-2042, August.
    5. Kohns, Stephan, 2001. "Testing for Asymmetry in British, German and US Unemployment Data," IZA Discussion Papers 341, Institute of Labor Economics (IZA).
    6. repec:zbw:rwirep:0136 is not listed on IDEAS
    7. Jörg Peters, 2009. "Evaluating Rural Electrification Projects - Methodological Approaches," Ruhr Economic Papers 0136, Rheinisch-Westfälisches Institut für Wirtschaftsforschung, Ruhr-Universität Bochum, Universität Dortmund, Universität Duisburg-Essen.
    8. Joshua Angrist & Victor Lavy, 2003. "Achievement awards for high school matriculation: Evidence from randomized trials," Natural Field Experiments 00202, The Field Experiments Website.

    More about this item

    Keywords

    Grouped data; observational study; randomized experiment; simulation study;
    All these keywords.

    JEL classification:

    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • H43 - Public Economics - - Publicly Provided Goods - - - Project Evaluation; Social Discount Rate

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp270. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.