How Much Should We Trust Observational Estimates? Accumulating Evidence Using Randomized Controlled Trials with Imperfect Compliance
Author
Abstract
Suggested Citation
Download full text from publisher
Other versions of this item:
- David Rhys Bernard & Gharad Bryan & Sylvain Chabé-Ferret & Jonathan de Quidt & Jasmin Claire Fliegner & Roland Rathelot, 2023. "How Much Should We Trust Observational Estimates? Accumulating Evidence Using Randomized Controlled Trials with Imperfect Compliance," Working Papers 976, Queen Mary University of London, School of Economics and Finance.
References listed on IDEAS
- Anderson, Michael L, 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series qt15n8j26f, Department of Agricultural & Resource Economics, UC Berkeley.
- Abhijit V. Banerjee & Shawn Cole & Esther Duflo & Leigh Linden, 2007.
"Remedying Education: Evidence from Two Randomized Experiments in India,"
The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(3), pages 1235-1264.
- Abhijit Banerjee & Shawn Cole & Esther Duflo & Leigh Linden, 2005. "Remedying education: Evidence from two randomized experiments in india," Framed Field Experiments 00122, The Field Experiments Website.
- Banerjee, Abhijit & Duflo, Esther & Cole, Shawn & Linden, Leigh, 2006. "Remedying Education: Evidence from Two Randomized Experiments in India," CEPR Discussion Papers 5446, C.E.P.R. Discussion Papers.
- Abhijit Banerjee, 2006. "Remedying Education: Evidence from Two Randomised Experiments in India," Working Papers id:360, eSocialSciences.
- Abhijit Banerjee & Shawn Cole & Esther Duflo & Leigh Linden, 2005. "Remedying Education: Evidence from Two Randomized Experiments in India," NBER Working Papers 11904, National Bureau of Economic Research, Inc.
- Nava Ashraf & Xavier Giné & Dean Karlan, 2009.
"Finding Missing Markets (and a Disturbing Epilogue): Evidence from an Export Crop Adoption and Marketing Intervention in Kenya,"
American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 91(4), pages 973-990.
- Ashraf, Nava & Gine, Xavier & Karlan, Dean, 2008. "Finding missing markets (and a disturbing epilogue) : evidence from an export crop adoption and marketing intervention in Kenya," Policy Research Working Paper Series 4477, The World Bank.
- Nava Ashraf & Xavier Giné & Dean Karlan, 2008. "Finding Missing Markets (and a disturbing epilogue): Evidence from an Export Crop Adoption and Marketing Intervention in Kenya," Working Papers 967, Economic Growth Center, Yale University.
- Ashraf, Nava & Gine, Xavier & Karlan, Dean, 2008. "Finding Missing Markets (and a Disturbing Epilogue): Evidence from an Export Crop Adoption and Marketing Intervention in Kenya," Working Papers 56, Yale University, Department of Economics.
- Ashraf, Nava & Gine, Xavier & Karlan, Dean S., 2008. "Finding Missing Markets (and a disturbing epilogue): Evidence from an Export Crop Adoption and Marketing Intervention in Kenya," Center Discussion Papers 46516, Yale University, Economic Growth Center.
- Gine, Xavier & Karlan, Dean & Ashraf, Nava, 2009. "Finding Missing Markets (and a disturbing epilogue): Evidence from an Export Crop Adoption and Marketing Intervention in Kenya," CEPR Discussion Papers 7133, C.E.P.R. Discussion Papers.
- Karlan, Dean & Osman, Adam & Zinman, Jonathan, 2016. "Follow the money not the cash: Comparing methods for identifying consumption and investment responses to a liquidity shock," Journal of Development Economics, Elsevier, vol. 121(C), pages 11-23.
- Miriam Bruhn & Dean Karlan & Antoinette Schoar, 2018.
"The Impact of Consulting Services on Small and Medium Enterprises: Evidence from a Randomized Trial in Mexico,"
Journal of Political Economy, University of Chicago Press, vol. 126(2), pages 635-687.
- Bruhn, Miriam & Karlan, Dean S. & Schoar, Antoinette, 2012. "The Impact of Consulting Services on Small and Medium Enterprises: Evidence from a Randomized Trial in Mexico," Center Discussion Papers 121675, Yale University, Economic Growth Center.
- Mariam Bruhn & Dean Karlan & Antoinette Schoar, 2012. "The Impact of Consulting Services on Small and Medium Enterprises: Evidence from a Randomized Trial in Mexico," Working Papers 1010, Economic Growth Center, Yale University.
- Bruhn, Miriam & Karlan, Dean & Schoar, Antoinette, 2012. "The Impact of Consulting Services on Small and Medium Enterprises: Evidence from a Randomized Trial in Mexico," Working Papers 100, Yale University, Department of Economics.
- Schoar, Antoinette & Karlan, Dean & Bruhn, Miriam, 2012. "The Impact of Consulting Services on Small and Medium Enterprises: Evidence from a Randomized Trial in Mexico," CEPR Discussion Papers 8887, C.E.P.R. Discussion Papers.
- Bruhn, Miriam & Karlan, Dean & Schoar, Antoinette, 2013. "The impact of consulting services on small and medium enterprises: evidence from a randomized trial in Mexico," Policy Research Working Paper Series 6508, The World Bank.
- Brett R. Gordon & Florian Zettelmeyer & Neha Bhargava & Dan Chapsky, 2019. "A Comparison of Approaches to Advertising Measurement: Evidence from Big Field Experiments at Facebook," Marketing Science, INFORMS, vol. 38(2), pages 193-225, March.
- Andrew S. Griffen & Petra E. Todd, 2017. "Assessing the Performance of Nonexperimental Estimators for Evaluating Head Start," Journal of Labor Economics, University of Chicago Press, vol. 35(S1), pages 7-63.
- Xavier Giné & Dean Karlan & Jonathan Zinman, 2010.
"Put Your Money Where Your Butt Is: A Commitment Contract for Smoking Cessation,"
American Economic Journal: Applied Economics, American Economic Association, vol. 2(4), pages 213-235, October.
- Gine, Xavier & Karlan, Dean & Zinman, Jonathan, 2009. "Put your money where your butt is : a commitment contract for smoking cessation," Policy Research Working Paper Series 4985, The World Bank.
- Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769.
- Kate Ambler & Diego Aycinena & Dean Yang, 2015.
"Channeling Remittances to Education: A Field Experiment among Migrants from El Salvador,"
American Economic Journal: Applied Economics, American Economic Association, vol. 7(2), pages 207-232, April.
- Kate Ambler & Diego Aycinena & Dean Yang, 2014. "Channeling Remittances to Education: A Field Experiment Among Migrants from El Salvador," NBER Working Papers 20262, National Bureau of Economic Research, Inc.
- Alan S. Gerber & Dean Karlan & Daniel Bergan, 2009.
"Does the Media Matter? A Field Experiment Measuring the Effect of Newspapers on Voting Behavior and Political Opinions,"
American Economic Journal: Applied Economics, American Economic Association, vol. 1(2), pages 35-52, April.
- Gerber, Alan & Karlan, Dean & Bergan, Daniel, 2006. "Does The Media Matter? A Field Experiment Measuring the Effect of Newspapers on Voting Behavior and Political Opinions," Working Papers 12, Yale University, Department of Economics.
- Daniel Bergan & Alan Gerber & Dean Karlan, 2009. "Does the media matter? A field experiment measuring the effect of newspapers on voting behavior and political opinions," Natural Field Experiments 00252, The Field Experiments Website.
- Luc Behaghel & Clément de Chaisemartin & Marc Gurgand, 2017.
"Ready for Boarding? The Effects of a Boarding School for Disadvantaged Students,"
American Economic Journal: Applied Economics, American Economic Association, vol. 9(1), pages 140-164, January.
- Behaghel, Luc & de Chaisemartin, Clement & Gurgand, Marc, 2015. "Ready for boarding? The effects of a boarding school for disadvantaged students," Economic Research Papers 270224, University of Warwick - Department of Economics.
- Luc Behaghel & Clément de Chaisemartin & Marc Gurgand, 2017. "Ready for Boarding? The Effects of a Boarding School for Disadvantaged Students," PSE-Ecole d'économie de Paris (Postprint) hal-01590806, HAL.
- Luc Behaghel & Clément de Chaisemartin & Marc Gurgand, 2017. "Ready for Boarding? The Effects of a Boarding School for Disadvantaged Students," Post-Print hal-01590806, HAL.
- Behaghel, Luc & de Chaisemartin, Clement & Gurgand, Marc, 2015. "Ready for boarding? The effects of a boarding school for disadvantaged students," The Warwick Economics Research Paper Series (TWERPS) 1059, University of Warwick, Department of Economics.
- Pascaline Dupas, 2011.
"Do Teenagers Respond to HIV Risk Information? Evidence from a Field Experiment in Kenya,"
American Economic Journal: Applied Economics, American Economic Association, vol. 3(1), pages 1-34, January.
- Pascaline Dupas, 2009. "Do Teenagers Respond to HIV Risk Information? Evidence from a Field Experiment in Kenya," NBER Working Papers 14707, National Bureau of Economic Research, Inc.
- Anderson, Michael L., 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1481-1495.
- Rukmini Banerji & James Berry & Marc Shotland, 2017. "The Impact of Maternal Literacy and Participation Programs: Evidence from a Randomized Evaluation in India," American Economic Journal: Applied Economics, American Economic Association, vol. 9(4), pages 303-337, October.
- Blattman, Christopher & Annan, Jeannie, 2016. "Can Employment Reduce Lawlessness and Rebellion? A Field Experiment with High-Risk Men in a Fragile State," American Political Science Review, Cambridge University Press, vol. 110(1), pages 1-17, February.
- Ashraf, Nava & Giné, Xavier & Karlan, Dean S., 2009. "AJAE appendix for “Finding Missing Markets (and a Disturbing Epilogue): Evidence from an Export Crop Adoption and Marketing Intervention in Kenya”," American Journal of Agricultural Economics APPENDICES, Agricultural and Applied Economics Association, vol. 91(4), pages 1-9, February.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Magnan, Nicholas & Hoffmann, Vivian & Opoku, Nelson & Gajate Garrido, Gissele & Kanyam, Daniel Akwasi, 2021.
"Information, technology, and market rewards: Incentivizing aflatoxin control in Ghana,"
Journal of Development Economics, Elsevier, vol. 151(C).
- Hoffmann, Vivian & Magnan, Nicholas & Garrido, Gissele Gajate & Kanyam, Daniel Akwasi & Opoku, Nelson, 2017. "Information, Technology, and Market Rewards: Incentivizing Aflatoxin Control in Ghana," 2018 Allied Social Sciences Association (ASSA) Annual Meeting, January 5-7, 2018, Philadelphia, Pennsylvania 266297, Agricultural and Applied Economics Association.
- Magnan, Nicholas & Hoffmann, Vivian & Garrido, Gissele & Kanyam, Faniel Akwasi & Opoku, Nelson, 2019. "Information, technology, and market rewards: Incentivizing aflatoxin control in Ghana:," IFPRI discussion papers 1878, International Food Policy Research Institute (IFPRI).
- Bjorn Van Campenhout & David J. Spielman & Els Lecoutere, 2021. "Information and Communication Technologies to Provide Agricultural Advice to Smallholder Farmers: Experimental Evidence from Uganda," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(1), pages 317-337, January.
- Derksen, Laura & Leclerc, Catherine Michaud & Souza, Pedro CL, 2019. "Searching for Answers : The Impact of Student Access to Wikipedia," The Warwick Economics Research Paper Series (TWERPS) 1236, University of Warwick, Department of Economics.
- Kyle Emerick & Alain de Janvry & Elisabeth Sadoulet & Manzoor H. Dar, 2016. "Technological Innovations, Downside Risk, and the Modernization of Agriculture," American Economic Review, American Economic Association, vol. 106(6), pages 1537-1561, June.
- Arouna, Aminou & Michler, Jeffrey D. & Lokossou, Jourdain C., 2021.
"Contract farming and rural transformation: Evidence from a field experiment in Benin,"
Journal of Development Economics, Elsevier, vol. 151(C).
- Aminou Arouna & Jeffrey D. Michler & Jourdain C. Lokossou, 2019. "Contract Farming and Rural Transformation: Evidence from a Field Experiment in Benin," NBER Working Papers 25665, National Bureau of Economic Research, Inc.
- Arouna, Aminou & Michler, Jeffrey D. & Lokossou, Jourdain C., 2019. "Contract Farming and Rural Transformation: Evidence from a Field Experiment in Benin," 2019 Sixth International Conference, September 23-26, 2019, Abuja, Nigeria 295717, African Association of Agricultural Economists (AAAE).
- Aggarwal, Shilpa, 2021. "The long road to health: Healthcare utilization impacts of a road pavement policy in rural India," Journal of Development Economics, Elsevier, vol. 151(C).
- Brown, Annette N. & Wood, Benjamin Douglas Kuflick, 2018.
"Which tests not witch hunts: A diagnostic approach for conducting replication research,"
Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 12, pages 1-26.
- Brown, Annette N. & Wood, Benjamin Douglas Kuflick, 2017. "Which tests not witch hunts: a diagnostic approach for conducting replication research," Economics Discussion Papers 2017-77, Kiel Institute for the World Economy (IfW Kiel).
- Derksen, Laura & Leclerc, Catherine Michaud & Souza, Pedro CL, 2019. "Searching for Answers: The Impact of Student Access to Wikipedia," CAGE Online Working Paper Series 450, Competitive Advantage in the Global Economy (CAGE).
- Bandiera, Oriana. & Buehren, Niklas. & Burgess, Robin & Goldstein, Markus P., & Gulesci, Selim. & Rasul, Imran. & Sulaiman, Munshi., 2015. "Women’s economic empowerment in action : evidence from a randomized control trial in Africa," ILO Working Papers 994874053402676, International Labour Organization.
- Derksen, Laura & Michaud-Leclerc, Catherine & Souza, Pedro C.L., 2022. "Restricted access: How the internet can be used to promote reading and learning," Journal of Development Economics, Elsevier, vol. 155(C).
- Pascaline Dupas & Edward Miguel, 2016. "Impacts and Determinants of Health Levels in Low-Income Countries," NBER Working Papers 22235, National Bureau of Economic Research, Inc.
- Sant’Anna, Pedro H.C. & Zhao, Jun, 2020.
"Doubly robust difference-in-differences estimators,"
Journal of Econometrics, Elsevier, vol. 219(1), pages 101-122.
- Pedro H. C. Sant'Anna & Jun B. Zhao, 2018. "Doubly Robust Difference-in-Differences Estimators," Papers 1812.01723, arXiv.org, revised May 2020.
- Emilio Depetris-Chauvin & Ömer Özak, 2020.
"The origins of the division of labor in pre-industrial times,"
Journal of Economic Growth, Springer, vol. 25(3), pages 297-340, September.
- Depetris-Chauvin, Emilio & Özak, Ömer, 2018. "The Origins of the Division of Labor in Pre-Industrial Times," SocArXiv z3ngq, Center for Open Science.
- Özak, Ömer & Depetris-Chauvin, Emilio, 2020. "The Origins of the Division of Labor in Pre-Industrial Times," SocArXiv k59wg, Center for Open Science.
- Sonia Bhalotra & Martin Karlsson & Therese Nilsson & Nina Schwarz, 2022.
"Infant Health, Cognitive Performance, and Earnings: Evidence from Inception of the Welfare State in Sweden,"
The Review of Economics and Statistics, MIT Press, vol. 104(6), pages 1138-1156, November.
- Bhalotra, Sonia R. & Karlsson, Martin & Nilsson, Therese & Schwarz, Nina, 2016. "Infant Health, Cognitive Performance and Earnings: Evidence from Inception of the Welfare State in Sweden," IZA Discussion Papers 10339, Institute of Labor Economics (IZA).
- Bhalotra, S.; & Karlsson, M.; & Nilsson, T.; & Schwarz, N.;, 2018. "Infant Health, Cognitive Performance and Earnings: Evidence from Inception of the Welfare State in Sweden," Health, Econometrics and Data Group (HEDG) Working Papers 18/06, HEDG, c/o Department of Economics, University of York.
- Bhalotra, Sonia & , & Nilsson, Therese & Schwarz, Nina, 2022. "Infant health, cognitive performance and earnings: Evidence from inception of the welfare state in Sweden," CEPR Discussion Papers 17257, C.E.P.R. Discussion Papers.
- Bhalotra, Sonia & Karlsson, Martin & Nilsson, Therese & Schwarz, Nina, 2019. "Infant health, cognitive performance and earnings: evidence from inception of the welfare state in Sweden," ISER Working Paper Series 2019-05, Institute for Social and Economic Research.
- Bhalotra, Sonia & Martin Karlsson & Therese Nilsson & Schwarz, Nina, 2021. "Infant Health, Cognitive Performance and Earnings : Evidence from Inception of the Welfare State in Sweden," The Warwick Economics Research Paper Series (TWERPS) 1345, University of Warwick, Department of Economics.
- Bhalotra, Sonia & Karlsson, Martin & Nilsson, Therese & Schwarz, Nina, 2017. "Infant Health, Cognitive Performance and Earnings: Evidence from Inception of the Welfare State in Sweden," Working Paper Series 1177, Research Institute of Industrial Economics.
- Karlsson, Martin & Schwarz, Nina & Bhalotra, Sonia & Nilsson, Therese, 2018. "Infant Health, Cognitive Performance and Earnings: Evidence from Inception of the Welfare State in Sweden," VfS Annual Conference 2018 (Freiburg, Breisgau): Digital Economy 181577, Verein für Socialpolitik / German Economic Association.
- Joshua D. Angrist & Sarah R. Cohodes & Susan M. Dynarski & Parag A. Pathak & Christopher R. Walters, 2016.
"Stand and Deliver: Effects of Boston's Charter High Schools on College Preparation, Entry, and Choice,"
Journal of Labor Economics, University of Chicago Press, vol. 34(2), pages 275-318.
- Joshua D. Angrist & Sarah R. Cohodes & Susan M. Dynarski & Parag A. Pathak & Christopher R. Walters, 2013. "Stand and Deliver: Effects of Boston's Charter High School on College Preparation, Entry, and Choice," CESifo Working Paper Series 4396, CESifo.
- Joshua D. Angrist & Sarah R. Cohodes & Susan M. Dynarski & Parag A. Pathak & Christopher R. Walters, 2013. "Stand and Deliver: Effects of Boston's Charter High Schools on College Preparation, Entry, and Choice," NBER Working Papers 19275, National Bureau of Economic Research, Inc.
- Derksen, Laura & Kerwin, Jason Theodore & Reynoso, Natalia Ordaz & Sterck, Olivier, 2021.
"Appointments: A More Effective Commitment Device for Health Behaviors,"
SocArXiv
y8gh7, Center for Open Science.
- Laura Derksen & Jason Kerwin & Natalia Ordaz Reynoso & Olivier Sterck, 2021. "Appointments: A More Effective Commitment Device for Health Behaviors," Papers 2110.06876, arXiv.org.
- Laura Derksen & Jason. T Kerwin & Natalia Ordaz Reynoso & Olivier Sterck, 2021. "Appointments: A More Effective Commitment Device for Health Behaviors," CSAE Working Paper Series 2021-13, Centre for the Study of African Economies, University of Oxford.
- Agostinelli, Francesco & Avitabile, Ciro & Bobba, Matteo, 2021.
"Enhancing Human Capital in Children: A Case Study on Scaling,"
TSE Working Papers
21-1196, Toulouse School of Economics (TSE), revised Oct 2023.
- Francesco Agostinelli & Ciro Avitabile & Matteo Bobba, 2023. "Enhancing Human Capital in Children: A Case Study on Scaling," NBER Working Papers 31407, National Bureau of Economic Research, Inc.
- Francesco Agostinelli & Ciro Avitable & Matteo Bobba, 2021. "Enhancing Human Capital in Children: A Case Study on Scaling," Working Papers 2021-012, Human Capital and Economic Opportunity Working Group.
- Agostinelli,Francesco & Avitabile,Ciro & Bobba,Matteo, 2021. "Enhancing Human Capital in Children : A Case Study on Scaling," Policy Research Working Paper Series 9647, The World Bank.
- Christopher Blattman & Julian C. Jamison & Margaret Sheridan, 2017. "Reducing Crime and Violence: Experimental Evidence from Cognitive Behavioral Therapy in Liberia," American Economic Review, American Economic Association, vol. 107(4), pages 1165-1206, April.
- Simone Schaner, 2018.
"The Persistent Power of Behavioral Change: Long-Run Impacts of Temporary Savings Subsidies for the Poor,"
American Economic Journal: Applied Economics, American Economic Association, vol. 10(3), pages 67-100, July.
- Simone Schaner, 2016. "The Persistent Power of Behavioral Change: Long-Run Impacts of Temporary Savings Subsidies for the Poor," NBER Working Papers 22534, National Bureau of Economic Research, Inc.
- Mesnard, Alice & Vera-Hernández, Marcos & Fitzsimons, Emla & Malde, Bansi, 2012.
"Household Responses to Information on Child Nutrition: Experimental Evidence from Malawi,"
CEPR Discussion Papers
8915, C.E.P.R. Discussion Papers.
- Emla Fitzsimons & Bansi Malde & Alice Mesnard & Marcos Vera-Hernandez, 2012. "Household responses to information on child nutrition: experimental evidence from Malawi," IFS Working Papers W12/07, Institute for Fiscal Studies.
More about this item
NEP fields
This paper has been announced in the following NEP Reports:- NEP-ECM-2024-02-19 (Econometrics)
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tse:wpaper:128965. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/tsetofr.html .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.