Matching on Noise: Finite Sample Bias in the Synthetic Control Estimator
Author
Abstract
Suggested Citation
DOI: 10.1515/jem-2021-0019
Download full text from publisher
As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.
Other versions of this item:
- Joseph Cummins & Brock Smith & Douglas L. Miller & David Eliot Simon, 2023. "Matching on Noise: Finite Sample Bias in the Synthetic Control Estimator," Working papers 2023-07, University of Connecticut, Department of Economics.
References listed on IDEAS
- Acemoglu, Daron & Johnson, Simon & Kermani, Amir & Kwak, James & Mitton, Todd, 2016.
"The value of connections in turbulent times: Evidence from the United States,"
Journal of Financial Economics, Elsevier, vol. 121(2), pages 368-391.
- Daron Acemoglu & Simon Johnson & Amir Kermani & James Kwak & Todd Mitton, 2013. "The Value of Connections in Turbulent Times: Evidence from the United States," NBER Working Papers 19701, National Bureau of Economic Research, Inc.
- Eli Ben-Michael & Avi Feller & Jesse Rothstein, 2021.
"The Augmented Synthetic Control Method,"
Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1789-1803, October.
- Eli Ben-Michael & Avi Feller & Jesse Rothstein, 2018. "The Augmented Synthetic Control Method," Papers 1811.04170, arXiv.org, revised Jul 2020.
- Eli Ben-Michael & Avi Feller & Jesse Rothstein, 2021. "The Augmented Synthetic Control Method," NBER Working Papers 28885, National Bureau of Economic Research, Inc.
- Smith, Brock, 2015.
"The resource curse exorcised: Evidence from a panel of countries,"
Journal of Development Economics, Elsevier, vol. 116(C), pages 57-73.
- Brock Smith, 2013. "The Resource Curse Exorcised: Evidence from a Panel of Countries," Working Papers 63, University of California, Davis, Department of Economics.
- Brock Smith, 2015. "The Resource Curse Exorcised: Evidence from a Panel of Countries," OxCarre Working Papers 165, Oxford Centre for the Analysis of Resource Rich Economies, University of Oxford.
- Dmitry Arkhangelsky & Susan Athey & David A. Hirshberg & Guido W. Imbens & Stefan Wager, 2021.
"Synthetic Difference-in-Differences,"
American Economic Review, American Economic Association, vol. 111(12), pages 4088-4118, December.
- Dmitry Arkhangelsky & Susan Athey & David A. Hirshberg & Guido W. Imbens & Stefan Wager, 2019. "Synthetic Difference in Differences," Working Papers wp2019_1907, CEMFI.
- Dmitry Arkhangelsky & Susan Athey & David A. Hirshberg & Guido W. Imbens & Stefan Wager, 2019. "Synthetic Difference In Differences," NBER Working Papers 25532, National Bureau of Economic Research, Inc.
- Tommaso Nannicini & Roberto Ricciuti, 2010. "Autocratic Transitions and Growth," CESifo Working Paper Series 2967, CESifo.
- Fitzpatrick Maria D, 2008. "Starting School at Four: The Effect of Universal Pre-Kindergarten on Children's Academic Achievement," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 8(1), pages 1-40, November.
- Kiesel, Kristin & Villas-Boas, Sofia B., 2013.
"Can information costs affect consumer choice? Nutritional labels in a supermarket experiment,"
International Journal of Industrial Organization, Elsevier, vol. 31(2), pages 153-163.
- Kiesel, Kristin & Villas-Boas, Sofia Berto, 2010. "Can Information Costs Affect Consumer Choice?—Nutritional Labels in a Supermarket Experiment—," 115th Joint EAAE/AAEA Seminar, September 15-17, 2010, Freising-Weihenstephan, Germany 116433, European Association of Agricultural Economists.
- Ashok Kaul & Stefan Klößner & Gregor Pfeifer & Manuel Schieler, 2022. "Standard Synthetic Control Methods: The Case of Using All Preintervention Outcomes Together With Covariates," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(3), pages 1362-1376, June.
- Markus Frlich, 2004. "Finite-Sample Properties of Propensity-Score Matching and Weighting Estimators," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 77-90, February.
- Matias Busso & John DiNardo & Justin McCrary, 2014. "New Evidence on the Finite Sample Properties of Propensity Score Reweighting and Matching Estimators," The Review of Economics and Statistics, MIT Press, vol. 96(5), pages 885-897, December.
- Eduardo Cavallo & Sebastian Galiani & Ilan Noy & Juan Pantano, 2013.
"Catastrophic Natural Disasters and Economic Growth,"
The Review of Economics and Statistics, MIT Press, vol. 95(5), pages 1549-1561, December.
- Cavallo, Eduardo A. & Noy, Ilan & Pantano, Juan & Galiani, Sebastián, 2010. "Catastrophic Natural Disasters and Economic Growth," IDB Publications (Working Papers) 1903, Inter-American Development Bank.
- Eduardo Cavallo & Sebastian Galiani & Ilan Noy & Juan Pantano, 2010. "Catastrophic Natural Disasters and Economic Growth," Research Department Publications 4671, Inter-American Development Bank, Research Department.
- Eduardo Cavallo & Sebastian Galiani & Ilan Noy & Juan Pantano, 2010. "Catastrophic Natural Disasters and Economic Growth," Working Papers 201006, University of Hawaii at Manoa, Department of Economics.
- Giovanni Peri & Vasil Yasenov, 2019.
"The Labor Market Effects of a Refugee Wave: Synthetic Control Method Meets the Mariel Boatlift,"
Journal of Human Resources, University of Wisconsin Press, vol. 54(2), pages 267-309.
- Peri, Giovanni & Yasenov, Vasil, 2017. "The Labor Market Effects of a Refugee Wave: Synthetic Control Method Meets the Mariel Boatlift," IZA Discussion Papers 10605, Institute of Labor Economics (IZA).
- Oded Gurantz, 2020. "What Does Free Community College Buy? Early Impacts from the Oregon Promise," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(1), pages 11-35, January.
- John J. Donohue & Abhay Aneja & Kyle D. Weber, 2019.
"Right‐to‐Carry Laws and Violent Crime: A Comprehensive Assessment Using Panel Data and a State‐Level Synthetic Control Analysis,"
Journal of Empirical Legal Studies, John Wiley & Sons, vol. 16(2), pages 198-247, June.
- John J. Donohue & Abhay Aneja & Kyle D. Weber, 2017. "Right-to-Carry Laws and Violent Crime: A Comprehensive Assessment Using Panel Data and a State-Level Synthetic Control Analysis," NBER Working Papers 23510, National Bureau of Economic Research, Inc.
- Bruno Ferman & Cristine Pinto & Vitor Possebom, 2020.
"Cherry Picking with Synthetic Controls,"
Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(2), pages 510-532, March.
- Ferman, Bruno & Pinto, Cristine Campos de Xavier & Possebom, Vítor Augusto, 2016. "Cherry picking with synthetic controls," Textos para discussão 420, FGV EESP - Escola de Economia de São Paulo, Fundação Getulio Vargas (Brazil).
- Ferman, Bruno & Pinto, Cristine & Possebom, Vitor, 2017. "Cherry Picking with Synthetic Controls," MPRA Paper 78213, University Library of Munich, Germany.
- Sarah Bohn & Magnus Lofstrom & Steven Raphael, 2014.
"Did the 2007 Legal Arizona Workers Act Reduce the State's Unauthorized Immigrant Population?,"
The Review of Economics and Statistics, MIT Press, vol. 96(2), pages 258-269, May.
- Bohn, Sarah & Lofstrom, Magnus & Raphael, Steven, 2011. "Did the 2007 Legal Arizona Workers Act Reduce the State's Unauthorized Immigrant Population?," IZA Discussion Papers 5682, Institute of Labor Economics (IZA).
- Arun Advani & Toru Kitagawa & Tymon Słoczyński, 2019.
"Mostly harmless simulations? Using Monte Carlo studies for estimator selection,"
Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(6), pages 893-910, September.
- Arun Advani & Toru Kitagawa & Tymon S{l}oczy'nski, 2018. "Mostly Harmless Simulations? Using Monte Carlo Studies for Estimator Selection," Papers 1809.09527, arXiv.org, revised Apr 2019.
- Advani, Arun & Kitagawa, Toru & Słoczyński, Tymon, 2019. "Mostly Harmless Simulations? Using Monte Carlo Studies for Estimator Selection," The Warwick Economics Research Paper Series (TWERPS) 1192, University of Warwick, Department of Economics.
- Advani, Arun & Kitagawa, Toru & Sloczynski, Tymon, 2019. "Mostly Harmless Simulations? Using Monte Carlo Studies for Estimator Selection," CAGE Online Working Paper Series 411, Competitive Advantage in the Global Economy (CAGE).
- Alberto Abadie & Alexis Diamond & Jens Hainmueller, 2015. "Comparative Politics and the Synthetic Control Method," American Journal of Political Science, John Wiley & Sons, vol. 59(2), pages 495-510, February.
- Alberto Abadie & Javier Gardeazabal, 2003. "The Economic Costs of Conflict: A Case Study of the Basque Country," American Economic Review, American Economic Association, vol. 93(1), pages 113-132, March.
- Hinrichs, Peter, 2014. "Affirmative action bans and college graduation rates," Economics of Education Review, Elsevier, vol. 42(C), pages 43-52.
- Bruno Ferman & Cristine Pinto, 2021.
"Synthetic controls with imperfect pretreatment fit,"
Quantitative Economics, Econometric Society, vol. 12(4), pages 1197-1221, November.
- Bruno Ferman & Cristine Pinto, 2019. "Synthetic Controls with Imperfect Pre-Treatment Fit," Papers 1911.08521, arXiv.org, revised Jan 2021.
- Charles J. Courtemanche & Daniela Zapata, 2014.
"Does Universal Coverage Improve Health? The Massachusetts Experience,"
Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 33(1), pages 36-69, January.
- Charles J. Courtemanche & Daniela Zapata, 2012. "Does Universal Coverage Improve Health? The Massachusetts Experience," NBER Working Papers 17893, National Bureau of Economic Research, Inc.
- Andreas Billmeier & Tommaso Nannicini, 2013. "Assessing Economic Liberalization Episodes: A Synthetic Control Approach," The Review of Economics and Statistics, MIT Press, vol. 95(3), pages 983-1001, July.
- Alice J. Chen & Amy J. Graves & Matthew J. Resnick & Michael R. Richards, 2018. "Does Spending More Get More? Health Care Delivery and Fiscal Implications From a Medicare Fee Bump," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 37(4), pages 706-731, September.
- Ferman, Bruno & Pinto, Cristine Campos de Xavier, 2016.
"Revisiting the synthetic control estimator,"
Textos para discussão
421, FGV EESP - Escola de Economia de São Paulo, Fundação Getulio Vargas (Brazil).
- Ferman, Bruno & Pinto, Cristine, 2016. "Revisiting the Synthetic Control Estimator," MPRA Paper 73982, University Library of Munich, Germany.
- Noémi Kreif & Richard Grieve & Dominik Hangartner & Alex James Turner & Silviya Nikolova & Matt Sutton, 2016.
"Examination of the Synthetic Control Method for Evaluating Health Policies with Multiple Treated Units,"
Health Economics, John Wiley & Sons, Ltd., vol. 25(12), pages 1514-1528, December.
- Kreif, Noémi & Grieve, Richard & Hangartner, Dominik & Turner, Alex James & Nikolova, Silviya & Sutton, Matt, 2016. "Examination of the synthetic control method for evaluating health policies with multiple treated units," LSE Research Online Documents on Economics 65074, London School of Economics and Political Science, LSE Library.
- Ferman, Bruno & Pinto, Cristine, 2017. "Placebo Tests for Synthetic Controls," MPRA Paper 78079, University Library of Munich, Germany.
- Gautier, Pieter A. & Siegmann, Arjen & Van Vuuren, Aico, 2009. "Terrorism and attitudes towards minorities: The effect of the Theo van Gogh murder on house prices in Amsterdam," Journal of Urban Economics, Elsevier, vol. 65(2), pages 113-126, March.
- Huber, Martin & Lechner, Michael & Wunsch, Conny, 2013. "The performance of estimators based on the propensity score," Journal of Econometrics, Elsevier, vol. 175(1), pages 1-21.
- Jushan Bai, 2009. "Panel Data Models With Interactive Fixed Effects," Econometrica, Econometric Society, vol. 77(4), pages 1229-1279, July.
- Hu, Luojia & Kaestner, Robert & Mazumder, Bhashkar & Miller, Sarah & Wong, Ashley, 2018. "The effect of the affordable care act Medicaid expansions on financial wellbeing," Journal of Public Economics, Elsevier, vol. 163(C), pages 99-112.
- Paolo Pinotti, 2015. "The Economic Costs of Organised Crime: Evidence from Southern Italy," Economic Journal, Royal Economic Society, vol. 125(586), pages 203-232, August.
- Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- David Gilchrist & Thomas Emery & Nuno Garoupa & Rok Spruk, 2023. "Synthetic Control Method: A tool for comparative case studies in economic history," Journal of Economic Surveys, Wiley Blackwell, vol. 37(2), pages 409-445, April.
- Bruno Ferman & Cristine Pinto & Vitor Possebom, 2020.
"Cherry Picking with Synthetic Controls,"
Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(2), pages 510-532, March.
- Ferman, Bruno & Pinto, Cristine Campos de Xavier & Possebom, Vítor Augusto, 2016. "Cherry picking with synthetic controls," Textos para discussão 420, FGV EESP - Escola de Economia de São Paulo, Fundação Getulio Vargas (Brazil).
- Ferman, Bruno & Pinto, Cristine & Possebom, Vitor, 2017. "Cherry Picking with Synthetic Controls," MPRA Paper 78213, University Library of Munich, Germany.
- Emery, Thomas & Mélon, Lela & Spruk, Rok, 2023. "Does e-procurement matter for economic growth? Subnational evidence from Australia," The Quarterly Review of Economics and Finance, Elsevier, vol. 89(C), pages 318-334.
- Samuel Verevis & Murat Üngör, 2021. "What has New Zealand gained from The FTA with China?: Two counterfactual analyses†," Scottish Journal of Political Economy, Scottish Economic Society, vol. 68(1), pages 20-50, February.
- Kaul, Ashok & Klößner, Stefan & Pfeifer, Gregor & Schieler, Manuel, 2015. "Synthetic Control Methods: Never Use All Pre-Intervention Outcomes Together With Covariates," MPRA Paper 83790, University Library of Munich, Germany.
- Pier Basaglia & Sophie M. Behr & Moritz A. Drupp, 2023. "De-Fueling Externalities: How Tax Salience and Fuel Substitution Mediate Climate and Health Benefits," Discussion Papers of DIW Berlin 2041, DIW Berlin, German Institute for Economic Research.
- Pier Basaglia & Sophie M. Behr & Moritz A. Drupp, 2023. "De-Fueling Externalities: Causal Effects of Fuel Taxation and Mediating Mechanisms for Reducing Climate and Pollution Costs," CESifo Working Paper Series 10508, CESifo.
- Nuno Garoupa & Rok Spruk, 2024. "Populist Constitutional Backsliding and Judicial Independence: Evidence from Turkiye," Papers 2410.02439, arXiv.org.
- Tomasz Serwach, 2023. "The European Union and within‐country income inequalities. The case of the new member states," The World Economy, Wiley Blackwell, vol. 46(7), pages 1890-1939, July.
- Tomasz Serwach, 2022. "The European Union and within-country income inequalities. The case of the New Member States," Working Papers hal-03548416, HAL.
- Giulio Grossi & Marco Mariani & Alessandra Mattei & Patrizia Lattarulo & Ozge Oner, 2020. "Direct and spillover effects of a new tramway line on the commercial vitality of peripheral streets. A synthetic-control approach," Papers 2004.05027, arXiv.org, revised Nov 2023.
- Daniel Albalate & Germà Bel & Ferran A. Mazaira-Font, 2021. "Decoupling synthetic control methods to ensure stability, accuracy and meaningfulness," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 12(4), pages 549-584, December.
- Guillaume Allaire Pouliot & Zhen Xie, 2022. "Degrees of Freedom and Information Criteria for the Synthetic Control Method," Papers 2207.02943, arXiv.org.
- Ferman, Bruno & Pinto, Cristine, 2016.
"Revisiting the Synthetic Control Estimator,"
MPRA Paper
73982, University Library of Munich, Germany.
- Ferman, Bruno & Pinto, Cristine Campos de Xavier, 2016. "Revisiting the synthetic control estimator," Textos para discussão 421, FGV EESP - Escola de Economia de São Paulo, Fundação Getulio Vargas (Brazil).
- Maximiliano Marzetti & Rok Spruk, 2023. "Long-Term Economic Effects of Populist Legal Reforms: Evidence from Argentina," Comparative Economic Studies, Palgrave Macmillan;Association for Comparative Economic Studies, vol. 65(1), pages 60-95, March.
- Irene Botosaru & Bruno Ferman, 2019.
"On the role of covariates in the synthetic control method,"
The Econometrics Journal, Royal Economic Society, vol. 22(2), pages 117-130.
- Botosaru, Irene & Ferman, Bruno, 2017. "On the Role of Covariates in the Synthetic Control Method," MPRA Paper 80796, University Library of Munich, Germany.
- Pekka Malo & Juha Eskelinen & Xun Zhou & Timo Kuosmanen, 2024.
"Computing Synthetic Controls Using Bilevel Optimization,"
Computational Economics, Springer;Society for Computational Economics, vol. 64(2), pages 1113-1136, August.
- Malo, Pekka & Eskelinen, Juha & Zhou, Xun & Kuosmanen, Timo, 2020. "Computing Synthetic Controls Using Bilevel Optimization," MPRA Paper 104085, University Library of Munich, Germany.
- Bibek Adhikari, 2022. "A Guide to Using the Synthetic Control Method to Quantify the Effects of Shocks, Policies, and Shocking Policies," The American Economist, Sage Publications, vol. 67(1), pages 46-63, March.
- Klößner, Stefan & Pfeifer, Gregor, 2015.
"Synthesizing Cash for Clunkers: Stabilizing the Car Market, Hurting the Environment,"
VfS Annual Conference 2015 (Muenster): Economic Development - Theory and Policy
113207, Verein für Socialpolitik / German Economic Association.
- Klößner, Stefan & Pfeifer, Gregor, 2018. "Synthesizing Cash for Clunkers: Stabilizing the Car Market, Hurting the Environment?," MPRA Paper 88175, University Library of Munich, Germany.
- Juan S. Mora‐Sanguinetti & Rok Spruk, 2023. "Economic effects of recent experiences of federalism: Analysis of the regionalization process in Spain," Journal of Regional Science, Wiley Blackwell, vol. 63(1), pages 30-63, January.
More about this item
Keywords
synthetic control; over-fitting; program evaluation;All these keywords.
JEL classification:
- C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models
- C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bpj:jecome:v:13:y:2024:i:1:p:67-95:n:2. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.degruyter.com .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.