IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2305.01435.html
   My bibliography  Save this paper

Transfer Estimates for Causal Effects across Heterogeneous Sites

Author

Listed:
  • Konrad Menzel

Abstract

We consider the problem of extrapolating treatment effects across heterogeneous populations (``sites"/``contexts"). We consider an idealized scenario in which the researcher observes cross-sectional data for a large number of units across several ``experimental" sites in which an intervention has already been implemented to a new ``target" site for which a baseline survey of unit-specific, pre-treatment outcomes and relevant attributes is available. Our approach treats the baseline as functional data, and this choice is motivated by the observation that unobserved site-specific confounders manifest themselves not only in average levels of outcomes, but also how these interact with observed unit-specific attributes. We consider the problem of determining the optimal finite-dimensional feature space in which to solve that prediction problem. Our approach is design-based in the sense that the performance of the predictor is evaluated given the specific, finite selection of experimental and target sites. Our approach is nonparametric, and our formal results concern the construction of an optimal basis of predictors as well as convergence rates for the estimated conditional average treatment effect relative to the constrained-optimal population predictor for the target site. We illustrate our approach using a combined data set of five multi-site randomized controlled trials (RCTs) to evaluate the effect of conditional cash transfers on school attendance.

Suggested Citation

  • Konrad Menzel, 2023. "Transfer Estimates for Causal Effects across Heterogeneous Sites," Papers 2305.01435, arXiv.org, revised Feb 2024.
  • Handle: RePEc:arx:papers:2305.01435
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2305.01435
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Eric V. Edmonds & Norbert Schady, 2012. "Poverty Alleviation and Child Labor," American Economic Journal: Economic Policy, American Economic Association, vol. 4(4), pages 100-124, November.
    2. Alberto Abadie & Javier Gardeazabal, 2003. "The Economic Costs of Conflict: A Case Study of the Basque Country," American Economic Review, American Economic Association, vol. 93(1), pages 113-132, March.
    3. Rajeev Dehejia & Cristian Pop-Eleches & Cyrus Samii, 2021. "From Local to Global: External Validity in a Fertility Natural Experiment," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 217-243, January.
    4. Hansen, Bruce E., 2008. "Uniform Convergence Rates For Kernel Estimation With Dependent Data," Econometric Theory, Cambridge University Press, vol. 24(3), pages 726-748, June.
    5. Bryan S. Graham & Fengshi Niu & James L. Powell, 2020. "Minimax Risk and Uniform Convergence Rates for Nonparametric Dyadic Regression," Papers 2012.08444, arXiv.org, revised Mar 2021.
    6. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
    7. Paul Schultz, T., 2004. "School subsidies for the poor: evaluating the Mexican Progresa poverty program," Journal of Development Economics, Elsevier, vol. 74(1), pages 199-250, June.
    8. Rachael Meager, 2022. "Aggregating Distributional Treatment Effects: A Bayesian Hierarchical Analysis of the Microcredit Literature," American Economic Review, American Economic Association, vol. 112(6), pages 1818-1847, June.
    9. Nur Cahyadi & Rema Hanna & Benjamin A. Olken & Rizal Adi Prima & Elan Satriawan & Ekki Syamsulhakim, 2020. "Cumulative Impacts of Conditional Cash Transfer Programs: Experimental Evidence from Indonesia," American Economic Journal: Economic Policy, American Economic Association, vol. 12(4), pages 88-110, November.
    10. Hunt Allcott, 2015. "Site Selection Bias in Program Evaluation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 130(3), pages 1117-1165.
    11. Liebl, Dominik, 2019. "Inference for sparse and dense functional data with covariate adjustments," Journal of Multivariate Analysis, Elsevier, vol. 170(C), pages 315-335.
    12. Kenneth I. Wolpin & Petra E. Todd, 2006. "Assessing the Impact of a School Subsidy Program in Mexico: Using a Social Experiment to Validate a Dynamic Behavioral Model of Child Schooling and Fertility," American Economic Review, American Economic Association, vol. 96(5), pages 1384-1417, December.
    13. Carrasco, Marine & Florens, Jean-Pierre & Renault, Eric, 2007. "Linear Inverse Problems in Structural Econometrics Estimation Based on Spectral Decomposition and Regularization," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 77, Elsevier.
    14. Felipe Barrera-Osorio & Marianne Bertrand & Leigh L. Linden & Francisco Perez-Calle, 2011. "Improving the Design of Conditional Transfer Programs: Evidence from a Randomized Education Experiment in Colombia," American Economic Journal: Applied Economics, American Economic Association, vol. 3(2), pages 167-195, April.
    15. Joseph Hotz, V. & Imbens, Guido W. & Mortimer, Julie H., 2005. "Predicting the efficacy of future training programs using past experiences at other locations," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 241-270.
    16. David Kraus, 2015. "Components and completion of partially observed functional data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 77(4), pages 777-801, September.
    17. Cupidon, J. & Eubank, R. & Gilliam, D. & Ruymgaart, F., 2008. "Some properties of canonical correlations and variates in infinite dimensions," Journal of Multivariate Analysis, Elsevier, vol. 99(6), pages 1083-1104, July.
    18. Abhijit V. Banerjee & Rema Hanna & Gabriel E. Kreindler & Benjamin A. Olken, 2017. "Debunking the Stereotype of the Lazy Welfare Recipient: Evidence from Cash Transfer Programs," The World Bank Research Observer, World Bank, vol. 32(2), pages 155-184.
    19. Clara Happ & Sonja Greven, 2018. "Multivariate Functional Principal Component Analysis for Data Observed on Different (Dimensional) Domains," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(522), pages 649-659, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Denis Fougère & Nicolas Jacquemet, 2020. "Policy Evaluation Using Causal Inference Methods," SciencePo Working papers Main hal-03455978, HAL.
    2. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    3. Susan Athey & Guido W. Imbens, 2017. "The State of Applied Econometrics: Causality and Policy Evaluation," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 3-32, Spring.
    4. Jacobus de Hoop & Furio C. Rosati, 2014. "Cash Transfers and Child Labor," The World Bank Research Observer, World Bank, vol. 29(2), pages 202-234.
    5. Tyler Morin & Mark Partridge, 2021. "The Impact of Small Regional Economic Development Commissions: Is There Any Bang After Just a Few Bucks?," Economic Development Quarterly, , vol. 35(1), pages 22-39, February.
    6. Cornelius Christian & Lukas Hensel & Christopher Roth, 2019. "Income Shocks and Suicides: Causal Evidence From Indonesia," The Review of Economics and Statistics, MIT Press, vol. 101(5), pages 905-920, December.
    7. Del Rey, Elena & Estevan, Fernanda, 2013. "Conditional cash transfers and education quality in the presence of credit constraints," Economics of Education Review, Elsevier, vol. 34(C), pages 76-84.
    8. Rahul Singh & Liyuan Xu & Arthur Gretton, 2020. "Kernel Methods for Causal Functions: Dose, Heterogeneous, and Incremental Response Curves," Papers 2010.04855, arXiv.org, revised Oct 2022.
    9. Richard Akresh & Damien de Walque & Harounan Kazianga, 2013. "Cash Transfers and Child Schooling: Evidence from a Randomized Evaluation of the Role of Conditionality," Economics Working Paper Series 1301, Oklahoma State University, Department of Economics and Legal Studies in Business.
    10. Rokhaya Dieye & Habiba Djebbari & Felipe Barrera-Osorio, 2014. "Accounting for Peer Effects in Treatment Response," Working Papers halshs-01025680, HAL.
    11. Karthik Muralidharan & Paul Niehaus, 2017. "Experimentation at Scale," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 103-124, Fall.
    12. Zhou, Lei & Jiang, Bo & Wang, Jingxi, 2020. "Do cash transfers have impacts on student Academic, cognitive, and enrollment outcomes? Evidence from rural China," Children and Youth Services Review, Elsevier, vol. 116(C).
    13. Kitaura, Koji & Miyazawa, Kazutoshi, 2021. "Inequality and conditionality in cash transfers: Demographic transition and economic development," Economic Modelling, Elsevier, vol. 94(C), pages 276-287.
    14. Clair Null & Clemencia Cosentino & Swetha Sridharan & Laura Meyer, "undated". "Policies and Programs to Improve Secondary Education in Developing Countries: A Review of the Evidence," Mathematica Policy Research Reports 516e420e637c4851b15e6a3f6, Mathematica Policy Research.
    15. Goodman-Bacon, Andrew, 2021. "Difference-in-differences with variation in treatment timing," Journal of Econometrics, Elsevier, vol. 225(2), pages 254-277.
    16. Hönig, Tillman, 2017. "The Impact of Peace: Evidence from Nigeria," MPRA Paper 83302, University Library of Munich, Germany.
    17. Benjamin A. Olken, 2020. "Banerjee, Duflo, Kremer, and the Rise of Modern Development Economics," Scandinavian Journal of Economics, Wiley Blackwell, vol. 122(3), pages 853-878, July.
    18. Estevan, Fernanda, 2013. "The impact of conditional cash transfers on public education expenditures: A political economy approach," European Journal of Political Economy, Elsevier, vol. 32(C), pages 268-284.
    19. Andor, Mark A. & Gerster, Andreas & Peters, Jörg & Schmidt, Christoph M., 2020. "Social Norms and Energy Conservation Beyond the US," Journal of Environmental Economics and Management, Elsevier, vol. 103(C).
    20. Andrews, Isaiah & Oster, Emily, 2019. "A simple approximation for evaluating external validity bias," Economics Letters, Elsevier, vol. 178(C), pages 58-62.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2305.01435. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.