IDEAS home Printed from https://ideas.repec.org/a/sae/inrsre/v43y2020i1-2p128-153.html
   My bibliography  Save this article

A Spatial Perspective on the Econometrics of Program Evaluation

Author

Listed:
  • Marynia Kolak
  • Luc Anselin

Abstract

Empirical work in regional science has seen a growing interest in causal inference, leveraging insights from econometrics, statistics, and related fields. This has resulted in several conceptual as well as empirical papers. However, the role of spatial effects, such as spatial dependence (SD) and spatial heterogeneity (SH), is less well understood in this context. Such spatial effects violate the so-called stable unit treatment value assumption advanced by Rubin as part of the foundational framework for empirical treatment effect analysis. In this article, we consider the role of spatial effects more closely. We provide a brief overview of a number of attempts to extend existing econometric treatment effect evaluation methods with an accounting for spatial aspects and outline and illustrate an alternative approach. Specifically, we propose a spatially explicit counterfactual framework that leverages spatial panel econometrics to account for both SD and SH in treatment choice, treatment variation, and treatment effects. We illustrate this framework with a replication of a well-known treatment effect analysis, that is, the evaluation effect of minimum legal drinking age laws on mortality for US states during the period 1970–1984, a classic textbook example of applied causal inference. We replicate the results available in the literature and compare these to a range of alternative specifications that incorporate spatial effects.

Suggested Citation

  • Marynia Kolak & Luc Anselin, 2020. "A Spatial Perspective on the Econometrics of Program Evaluation," International Regional Science Review, , vol. 43(1-2), pages 128-153, January.
  • Handle: RePEc:sae:inrsre:v:43:y:2020:i:1-2:p:128-153
    DOI: 10.1177/0160017619869781
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0160017619869781
    Download Restriction: no

    File URL: https://libkey.io/10.1177/0160017619869781?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Joshua D. Angrist & Jörn-Steffen Pischke, 2010. "The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 3-30, Spring.
    2. Peter H. Egger & Andrea Lassmann, 2015. "The Causal Impact of Common Native Language on International Trade: Evidence from a Spatial Regression Discontinuity Design," Economic Journal, Royal Economic Society, vol. 0(584), pages 699-745, May.
    3. Sandra E. Black, 1999. "Do Better Schools Matter? Parental Valuation of Elementary Education," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 577-599.
    4. Jalil, Andrew J., 2014. "Monetary Intervention Really Did Mitigate Banking Panics During the Great Depression: Evidence Along the Atlanta Federal Reserve District Border," The Journal of Economic History, Cambridge University Press, vol. 74(1), pages 259-273, March.
    5. James J. Heckman, 2010. "Building Bridges between Structural and Program Evaluation Approaches to Evaluating Policy," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 356-398, June.
    6. Luc Anselin & Nancy Lozano-Gracia, 2009. "Errors in variables and spatial effects in hedonic house price models of ambient air quality," Studies in Empirical Economics, in: Giuseppe Arbia & Badi H. Baltagi (ed.), Spatial Econometrics, pages 5-34, Springer.
    7. Abbring, Jaap H. & Heckman, James J., 2007. "Econometric Evaluation of Social Programs, Part III: Distributional Treatment Effects, Dynamic Treatment Effects, Dynamic Discrete Choice, and General Equilibrium Policy Evaluation," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 72, Elsevier.
    8. Sobel, Michael E., 2006. "What Do Randomized Studies of Housing Mobility Demonstrate?: Causal Inference in the Face of Interference," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1398-1407, December.
    9. Timothy G. Conley & Christopher R. Taber, 2011. "Inference with "Difference in Differences" with a Small Number of Policy Changes," The Review of Economics and Statistics, MIT Press, vol. 93(1), pages 113-125, February.
    10. Aliaga, Javier & Herrera, Marcos & Leguía, Daniel & Mur, Jesús & Ruiz, Manuel & Villegas, Horacio, 2011. "Spatial Causality. An application to the Deforestation Process in Bolivia," INVESTIGACIONES REGIONALES - Journal of REGIONAL RESEARCH, Asociación Española de Ciencia Regional, issue 21, pages 183-198.
    11. Delgado, Michael S. & Florax, Raymond J.G.M., 2015. "Difference-in-differences techniques for spatial data: Local autocorrelation and spatial interaction," Economics Letters, Elsevier, vol. 137(C), pages 123-126.
    12. Koschinsky, Julia, 2013. "The case for spatial analysis in evaluation to reduce health inequities," Evaluation and Program Planning, Elsevier, vol. 36(1), pages 172-176.
    13. Luisa Corrado & Bernard Fingleton, 2012. "Where Is The Economics In Spatial Econometrics?," Journal of Regional Science, Wiley Blackwell, vol. 52(2), pages 210-239, May.
    14. André Luis Squarize Chagas & Rudinei Toneto & Carlos Roberto Azzoni, 2012. "A Spatial Propensity Score Matching Evaluation of the Social Impacts of Sugarcane Growing on Municipalities in Brazil," International Regional Science Review, , vol. 35(1), pages 48-69, January.
    15. Irani Arraiz & David M. Drukker & Harry H. Kelejian & Ingmar R. Prucha, 2010. "A Spatial Cliff‐Ord‐Type Model With Heteroskedastic Innovations: Small And Large Sample Results," Journal of Regional Science, Wiley Blackwell, vol. 50(2), pages 592-614, May.
    16. repec:fth:prinin:334 is not listed on IDEAS
    17. MacKinnon, James G. & White, Halbert, 1985. "Some heteroskedasticity-consistent covariance matrix estimators with improved finite sample properties," Journal of Econometrics, Elsevier, vol. 29(3), pages 305-325, September.
    18. Raymond J. G. M. Florax & Arno J. Van der Vlist, 2003. "Spatial Econometric Data Analysis: Moving Beyond Traditional Models," International Regional Science Review, , vol. 26(3), pages 223-243, July.
    19. Baum-Snow, Nathaniel & Ferreira, Fernando, 2015. "Causal Inference in Urban and Regional Economics," Handbook of Regional and Urban Economics, in: Gilles Duranton & J. V. Henderson & William C. Strange (ed.), Handbook of Regional and Urban Economics, edition 1, volume 5, chapter 0, pages 3-68, Elsevier.
    20. Marcos Herrera & Manuel Ruiz & Jesús Mur, 2013. "Detecting Dependence Between Spatial Processes," Spatial Economic Analysis, Taylor & Francis Journals, vol. 8(4), pages 469-497, February.
    21. Herbert L. Smith, 2003. "Some Thoughts on Causation as It Relates to Demography and Population Studies," Population and Development Review, The Population Council, Inc., vol. 29(3), pages 459-469, September.
    22. Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2004. "How Much Should We Trust Differences-In-Differences Estimates?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(1), pages 249-275.
    23. Athias, Laure & Wicht, Pascal, 2014. "Cultural Biases in Public Service Delivery: Evidence from a Regression Discontinuity Approach," MPRA Paper 60639, University Library of Munich, Germany.
    24. James J. Heckman & Vytlacil, Edward J., 2007. "Econometric Evaluation of Social Programs, Part I: Causal Models, Structural Models and Econometric Policy Evaluation," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 70, Elsevier.
    25. Christopher Carpenter & Carlos Dobkin, 2009. "The Effect of Alcohol Consumption on Mortality: Regression Discontinuity Evidence from the Minimum Drinking Age," American Economic Journal: Applied Economics, American Economic Association, vol. 1(1), pages 164-182, January.
    26. David Card & Alan Krueger, 1994. "The Economic Return to School Quality: A Partial Survey," Working Papers 713, Princeton University, Department of Economics, Industrial Relations Section..
    27. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881.
    28. Gilles Duranton & J. V. Henderson & William C. Strange (ed.), 2015. "Handbook of Regional and Urban Economics," Handbook of Regional and Urban Economics, Elsevier, edition 1, volume 5, number 5.
    29. Baylis, Kathy & Ham, Andres, 2015. "How important is spatial correlation in randomized controlled trials?," 2015 AAEA & WAEA Joint Annual Meeting, July 26-28, San Francisco, California 205586, Agricultural and Applied Economics Association.
    30. Joshua D. Angrist & Jörn-Steffen Pischke, 2015. "The path from cause to effect: mastering 'metrics," CentrePiece - The magazine for economic performance 442, Centre for Economic Performance, LSE.
    31. Lee, Lung-fei & Yu, Jihai, 2010. "Some recent developments in spatial panel data models," Regional Science and Urban Economics, Elsevier, vol. 40(5), pages 255-271, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rolf Bergs & Rüdiger Budde, 2022. "The potential of small-scale spatial data in regional science," Review of Regional Research: Jahrbuch für Regionalwissenschaft, Springer;Gesellschaft für Regionalforschung (GfR), vol. 42(2), pages 97-110, August.
    2. Gary Cornwall & Beau Sauley, 2021. "Indirect effects and causal inference: reconsidering regression discontinuity," Journal of Spatial Econometrics, Springer, vol. 2(1), pages 1-28, December.
    3. Monturano, Gianluca & Resce, Giuliano & Ventura, Marco, 2022. "Place-Based Policies and the location of economic activity: evidence from the Italian Strategy for Inner areas," Economics & Statistics Discussion Papers esdp22087, University of Molise, Department of Economics.
    4. Man Jiao & Hengzhou Xu, 2022. "Does Rural Construction Land Marketization Inhibit State-Owned Industrial Land Transactions? Evidence from Huzhou City, China," Land, MDPI, vol. 11(9), pages 1-17, September.
    5. Min-Xing Wang & Lufei Huang & Zhen-Ming Chen, 2023. "The Impact of Green Financial Policy on the Regional Economic Development Level and AQI—Evidence from Zhejiang Province, China," Sustainability, MDPI, vol. 15(5), pages 1-23, February.
    6. Edoardo Baldoni & Roberto Esposti, 2023. "Estimating The Impact Of Policies Under Spatial Interference. The Case Of Cap Support To Organic Farming," Working Papers 475, Universita' Politecnica delle Marche (I), Dipartimento di Scienze Economiche e Sociali.
    7. Reinhold Kosfeld & Timo Mitze & Johannes Rode & Klaus Wälde, 2021. "The Covid‐19 containment effects of public health measures: A spatial difference‐in‐differences approach," Journal of Regional Science, Wiley Blackwell, vol. 61(4), pages 799-825, September.
    8. Ferreira, Susana, 2024. "Extreme Weather Events and Climate Change: Economic Impacts and Adaptation Policies," IZA Discussion Papers 16715, Institute of Labor Economics (IZA).
    9. Roberto Esposti, 2022. "The Coevolution of Policy Support and Farmers' Behaviour. An investigation on Italian agriculture over the 2008-2019 period," Working Papers 464, Universita' Politecnica delle Marche (I), Dipartimento di Scienze Economiche e Sociali.
    10. Demidova, Olga, 2021. "Methods of spatial econometrics and evaluation of government programs effectiveness," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 64, pages 107-134.
    11. Nie, Liang & Zhang, ZhongXiang, 2023. "Is high-speed rail heading towards a low-carbon industry? Evidence from a quasi-natural experiment in China," Resource and Energy Economics, Elsevier, vol. 72(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Demidova, Olga, 2021. "Methods of spatial econometrics and evaluation of government programs effectiveness," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 64, pages 107-134.
    2. MacKinnon, James G. & Nielsen, Morten Ørregaard & Webb, Matthew D., 2023. "Cluster-robust inference: A guide to empirical practice," Journal of Econometrics, Elsevier, vol. 232(2), pages 272-299.
    3. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    4. Athey, Susan & Imbens, Guido W., 2022. "Design-based analysis in Difference-In-Differences settings with staggered adoption," Journal of Econometrics, Elsevier, vol. 226(1), pages 62-79.
    5. Jeffrey Smith & Arthur Sweetman, 2016. "Viewpoint: Estimating the causal effects of policies and programs," Canadian Journal of Economics, Canadian Economics Association, vol. 49(3), pages 871-905, August.
    6. Heckman, James J. & Humphries, John Eric & Veramendi, Gregory, 2016. "Dynamic treatment effects," Journal of Econometrics, Elsevier, vol. 191(2), pages 276-292.
    7. Jiaming Mao & Jingzhi Xu, 2020. "Ensemble Learning with Statistical and Structural Models," Papers 2006.05308, arXiv.org.
    8. Jeffrey D. Michler & Anna Josephson, 2022. "Recent developments in inference: practicalities for applied economics," Chapters, in: A Modern Guide to Food Economics, chapter 11, pages 235-268, Edward Elgar Publishing.
    9. Tobias Rüttenauer, 2022. "Spatial Regression Models: A Systematic Comparison of Different Model Specifications Using Monte Carlo Experiments," Sociological Methods & Research, , vol. 51(2), pages 728-759, May.
    10. Dionissi Aliprantis, 2017. "Assessing the evidence on neighborhood effects from Moving to Opportunity," Empirical Economics, Springer, vol. 52(3), pages 925-954, May.
    11. James G. MacKinnon & Matthew D. Webb, 2020. "When and How to Deal with Clustered Errors in Regression Models," Working Paper 1421, Economics Department, Queen's University.
    12. Öberg, Stefan, 2018. "Instrumental variables based on twin births are by definition not valid (v.3.0)," SocArXiv zux9s, Center for Open Science.
    13. Kyle Butts, 2021. "Difference-in-Differences Estimation with Spatial Spillovers," Papers 2105.03737, arXiv.org, revised Jun 2023.
    14. Timo Mitze & Alfredo R. Paloyo & Björn Alecke, 2015. "Is There a Purchase Limit on Regional Growth? A Quasi-experimental Evaluation of Investment Grants Using Matching Techniques," International Regional Science Review, , vol. 38(4), pages 388-412, October.
    15. James G. MacKinnon, 2019. "How cluster‐robust inference is changing applied econometrics," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 52(3), pages 851-881, August.
    16. Sviták, Jan & Tichem, Jan & Haasbeek, Stefan, 2021. "Price effects of search advertising restrictions," International Journal of Industrial Organization, Elsevier, vol. 77(C).
    17. Denis Fougère & Nicolas Jacquemet, 2020. "Policy Evaluation Using Causal Inference Methods," SciencePo Working papers Main hal-03455978, HAL.
    18. A. Colin Cameron & Douglas L. Miller, 2010. "Robust Inference with Clustered Data," Working Papers 106, University of California, Davis, Department of Economics.
    19. Peter H Egger & Marko Koethenbuerger & Gabriel Loumeau, 2022. "Local border reforms and economic activity," Journal of Economic Geography, Oxford University Press, vol. 22(1), pages 81-102.
    20. Marianna Schaubert, 2023. "Do Alimony Regulations Matter Inside Marriage? Evidence from the 2008 Reform of the German Maintenance Law," Journal of Labor Research, Springer, vol. 44(1), pages 145-178, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:inrsre:v:43:y:2020:i:1-2:p:128-153. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.