Generalizing Treatment Effect Estimates From Sample to Population: A Case Study in the Difficulties of Finding Sufficient Data
Author
Abstract
Suggested Citation
DOI: 10.1177/0193841X16660663
Download full text from publisher
References listed on IDEAS
- Robert B. Olsen & Larry L. Orr & Stephen H. Bell & Elizabeth A. Stuart, 2013. "External Validity in Policy Evaluations That Choose Sites Purposively," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 32(1), pages 107-121, January.
- Thomas D. Cook, 2014. "Generalizing Causal Knowledge In The Policy Sciences: External Validity As A Task Of Both Multiattribute Representation And Multiattribute Extrapolation," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 33(2), pages 527-536, March.
- Keisuke Hirano & Guido W. Imbens & Geert Ridder, 2003.
"Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score,"
Econometrica, Econometric Society, vol. 71(4), pages 1161-1189, July.
- Keisuke Hirano & Guido W. Imbens & Geert Ridder, 2000. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," NBER Technical Working Papers 0251, National Bureau of Economic Research, Inc.
- Guido Imbens, 2000. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," Econometric Society World Congress 2000 Contributed Papers 1166, Econometric Society.
- Anonymous, 2013. "Introduction to the Issue," Journal of Wine Economics, Cambridge University Press, vol. 8(2), pages 129-130, November.
- Elizabeth A. Stuart & Stephen R. Cole & Catherine P. Bradshaw & Philip J. Leaf, 2011. "The use of propensity scores to assess the generalizability of results from randomized trials," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(2), pages 369-386, April.
- Colm O'Muircheartaigh & Larry V. Hedges, 2014. "Generalizing from unrepresentative experiments: a stratified propensity score approach," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 63(2), pages 195-210, February.
- Anonymous, 2013. "Introduction to the Issue," Journal of Wine Economics, Cambridge University Press, vol. 8(3), pages 243-243, December.
- repec:mpr:mprres:8128 is not listed on IDEAS
- Kosuke Imai & Gary King & Elizabeth A. Stuart, 2008. "Misunderstandings between experimentalists and observationalists about causal inference," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 171(2), pages 481-502, April.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- John M. Brooks & Cole G. Chapman & Mary C. Schroeder, 2018. "Understanding Treatment Effect Estimates When Treatment Effects Are Heterogeneous for More Than One Outcome," Applied Health Economics and Health Policy, Springer, vol. 16(3), pages 381-393, June.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- repec:mpr:mprres:8128 is not listed on IDEAS
- Wendy Chan, 2018. "Applications of Small Area Estimation to Generalization With Subclassification by Propensity Scores," Journal of Educational and Behavioral Statistics, , vol. 43(2), pages 182-224, April.
- Elizabeth Tipton & Kelly Hallberg & Larry V. Hedges & Wendy Chan, 2017. "Implications of Small Samples for Generalization: Adjustments and Rules of Thumb," Evaluation Review, , vol. 41(5), pages 472-505, October.
- Elizabeth Tipton & Laura R. Peck, 2017. "A Design-Based Approach to Improve External Validity in Welfare Policy Evaluations," Evaluation Review, , vol. 41(4), pages 326-356, August.
- Esterling, Kevin M. & Brady, David & Schwitzgebel, Eric, 2023. "The Necessity of Construct and External Validity for Generalized Causal Claims," I4R Discussion Paper Series 18, The Institute for Replication (I4R).
- Jacob Alex Klerman, 2017. "Editor in Chief’s Comment: External Validity in Systematic Reviews," Evaluation Review, , vol. 41(5), pages 391-402, October.
- Esterling, Kevin & Brady, David & Schwitzgebel, Eric, 2021. "The Necessity of Construct and External Validity for Generalized Causal Claims," OSF Preprints 2s8w5, Center for Open Science.
- Ranjana Raghunathan, 2022. "Everyday Intimacies and Inter-Ethnic Relationships: Tracing Entanglements of Gender and Race in Multicultural Singapore," Sociological Research Online, , vol. 27(1), pages 77-94, March.
- Songsore, Emmanuel & Buzzelli, Michael, 2014. "Social responses to wind energy development in Ontario: The influence of health risk perceptions and associated concerns," Energy Policy, Elsevier, vol. 69(C), pages 285-296.
- Tapsuwan, Sorada & Polyakov, Maksym & Bark, Rosalind & Nolan, Martin, 2015. "Valuing the Barmah–Millewa Forest and in stream river flows: A spatial heteroskedasticity and autocorrelation consistent (SHAC) approach," Ecological Economics, Elsevier, vol. 110(C), pages 98-105.
- Bertschek, Irene & Kesler, Reinhold, 2022.
"Let the user speak: Is feedback on Facebook a source of firms’ innovation?,"
Information Economics and Policy, Elsevier, vol. 60(C).
- Bertschek, Irene & Kesler, Reinhold, 2018. "Let the user speak: Is feedback on Facebook a source of firms' innovation?," ZEW Discussion Papers 17-015, ZEW - Leibniz Centre for European Economic Research, revised 2018.
- Gigi Foster, 2020. "The behavioural economics of government responses to COVID-19," Journal of Behavioral Economics for Policy, Society for the Advancement of Behavioral Economics (SABE), vol. 4(S3), pages 11-43, December.
- Balint, T. & Lamperti, F. & Mandel, A. & Napoletano, M. & Roventini, A. & Sapio, A., 2017.
"Complexity and the Economics of Climate Change: A Survey and a Look Forward,"
Ecological Economics, Elsevier, vol. 138(C), pages 252-265.
- T. BALINT & F. LAMPERTI & A. Mandel & A. Roventini Author-Workplace-Name : OFCE-Sciences Pp and SKEMA Businees School & A. Sapio Author-Workplace-Name : Parathenope Universtiy of Naples, 2016. "Complexity and the Economics of Climate Change : a survey and look forward," Documents de Travail de l'OFCE 2016-23, Observatoire Francais des Conjonctures Economiques (OFCE).
- T. Balint & F. Lamperti & Antoine Mandel & Mauro Napoletano & A. Roventini & A. Sapio, 2017. "Complexity and the Economics of Climate Change: A Survey and a Look Forward," SciencePo Working papers Main halshs-01906003, HAL.
- Tomas Balint & Francesco Lamperti & Antoine Mandel & Mauro Napoletano & Andrea Roventini & Alessandro Sapio, 2016. "Complexity and the Economics of Climate Change: a Survey and a Look Forward," Documents de travail du Centre d'Economie de la Sorbonne 16058, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
- Tomas Balint & Francesco Lamperti & Antoine Mandel & Mauro Napoletano & Andrea Roventini & Alessandro Sapio, 2016. "Complexity and the Economics of Climate Change: a Survey and a Look Forward," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-01390694, HAL.
- Tomas Balint & Francesco Lamperti & Mauro Napoletano & Antoine Mandel & Andrea Roventini & Alessandro Sapio, 2016. "Complexity and the Economics of Climate Change: a Survey and a Look Forward," Working Papers hal-03459291, HAL.
- Tomas Balint & Francesco Lamperti & Mauro Napoletano & Antoine Mandel & Andrea Roventini & Alessandro Sapio, 2016. "Complexity and the Economics of Climate Change: a Survey and a Look Forward," SciencePo Working papers Main hal-03459291, HAL.
- T. Balint & F. Lamperti & Antoine Mandel & Mauro Napoletano & A. Roventini & A. Sapio, 2017. "Complexity and the Economics of Climate Change: A Survey and a Look Forward," PSE-Ecole d'économie de Paris (Postprint) halshs-01906003, HAL.
- Tomas Balint & Francesco Lamperti & Mauro Napoletano & Antoine Mandel & Andrea Roventini & Alessandro Sapio, 2016. "Complexity and the Economics of Climate Change: a Survey and a Look Forward," Sciences Po publications 2016-23, Sciences Po.
- T. Balint & F. Lamperti & Antoine Mandel & Mauro Napoletano & A. Roventini & A. Sapio, 2017. "Complexity and the Economics of Climate Change: A Survey and a Look Forward," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-01906003, HAL.
- Tomas Balint & Francesco Lamperti & Antoine Mandel & Mauro Napoletano & Andrea Roventini & Alessandro Sapio, 2017. "Complexity and the Economics of Climate Change: A Survey and a Look Forward," Sciences Po publications info:hdl:2441/1nlv566svi8, Sciences Po.
- Tomas Balint & Francesco Lamperti & Antoine Mandel & Mauro Napoletano & Andrea Roventini & Alessandro Sapio, 2016. "Complexity and the Economics of Climate Change: a Survey and a Look Forward," Post-Print halshs-01390694, HAL.
- Tomas Balint & Francesco Lamperti & Antoine Mandel & Mauro Napoletano & Andrea Roventini & Alessandro Sapio, 2016. "Complexity and the Economics of Climate Change: a Survey and a Look Forward," LEM Papers Series 2016/29, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
- Tomas Balint & Francesco Lamperti & Antoine Mandel & Mauro Napoletano & Andrea Roventini & Alessandro Sapio, 2016. "Complexity and the Economics of Climate Change: a Survey and a Look Forward," SciencePo Working papers Main halshs-01390694, HAL.
- T. Balint & F. Lamperti & Antoine Mandel & Mauro Napoletano & A. Roventini & A. Sapio, 2017. "Complexity and the Economics of Climate Change: A Survey and a Look Forward," Post-Print halshs-01906003, HAL.
- Audoly, Richard & Vogt-Schilb, Adrien & Guivarch, Céline & Pfeiffer, Alexander, 2018.
"Pathways toward zero-carbon electricity required for climate stabilization,"
Applied Energy, Elsevier, vol. 225(C), pages 884-901.
- Richard Audoly & Adrien Vogt-Schilb & Céline Guivarch, 2014. "Pathways toward Zero-Carbon Electricity Required for Climate Stabilization," Working Papers hal-01079837, HAL.
- Audoly, Richard & Vogt-Schilb, Adrien & Guivarch, Celine, 2014. "Pathways toward zero-carbon electricity required for climate stabilization," Policy Research Working Paper Series 7075, The World Bank.
- Audoly, Richard & Vogt-Schilb, Adrien & Guivarch, Céline & Pfeiffer, Alexander, 2017. "Pathways toward Zero-Carbon Electricity Required for Climate Stabilization," IDB Publications (Working Papers) 8498, Inter-American Development Bank.
- Richard Audoly & Adrien Vogt-Schilb & Céline Guivarch & Alexander Pfeiffer, 2018. "Pathways toward zero-carbon electricity required for climate stabilization," Post-Print halshs-01804564, HAL.
- Richard Audoly & Adrien Vogt-Schilb & Céline Guivarch, 2014. "Pathways toward Zero-Carbon Electricity Required for Climate Stabilization," CIRED Working Papers hal-01079837, HAL.
- Gerards, Ruud & Welters, Ricardo, 2016.
"Impact of financial pressure on unemployed job search, job find success and job quality,"
ROA Research Memorandum
008, Maastricht University, Research Centre for Education and the Labour Market (ROA).
- Gerards, Ruud & Welters, Ricardo, 2016. "Impact of financial pressure on unemployed job search, job find success and job quality," Research Memorandum 022, Maastricht University, Graduate School of Business and Economics (GSBE).
- Vasile-Daniel Păvăloaia & Elena-Mădălina Teodor & Doina Fotache & Magdalena Danileţ, 2019. "Opinion Mining on Social Media Data: Sentiment Analysis of User Preferences," Sustainability, MDPI, vol. 11(16), pages 1-21, August.
- Cailong Xu & Ruidong Li & Wenwen Song & Tingting Wu & Shi Sun & Shuixiu Hu & Tianfu Han & Cunxiang Wu, 2021. "Responses of Branch Number and Yield Component of Soybean Cultivars Tested in Different Planting Densities," Agriculture, MDPI, vol. 11(1), pages 1-12, January.
- Caitlin Robinson & Stefan Bouzarovski & Sarah Lindley, 2018. "Underrepresenting neighbourhood vulnerabilities? The measurement of fuel poverty in England," Environment and Planning A, , vol. 50(5), pages 1109-1127, August.
- Michaela Haase & Emmanuel Raufflet, 2017. "Ideologies in Markets, Organizations, and Business Ethics: Drafting a Map: Introduction to the Special Issue," Journal of Business Ethics, Springer, vol. 142(4), pages 629-639, June.
- Rafael Alcadipani & Cíntia Rodrigues Oliveira Medeiros, 2020. "When Corporations Cause Harm: A Critical View of Corporate Social Irresponsibility and Corporate Crimes," Journal of Business Ethics, Springer, vol. 167(2), pages 285-297, November.
- Mansoora Ahmed & Sun Zehou & Syed Ali Raza & Muhammad Asif Qureshi & Sara Qamar Yousufi, 2020. "Impact of CSR and environmental triggers on employee green behavior: The mediating effect of employee well‐being," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 27(5), pages 2225-2239, September.
More about this item
Keywords
causal inference; generalizability; Head Start Impact Study; REDI evaluation; transportability;All these keywords.
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:41:y:2017:i:4:p:357-388. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.