IDEAS home Printed from https://ideas.repec.org/a/sae/inrsre/v36y2013i1p44-68.html
   My bibliography  Save this article

Isserman’s Impact

Author

Listed:
  • Edward Feser

Abstract

Applications using quasi-experimental comparison group designs in regional science and geography have increased substantially over the last three decades, inspired by the work of Andrew Isserman and colleagues in the 1980s and 1990s, robust literatures on quasi-experimental design in fields like education and psychology, a vast program evaluation literature, observational studies methodology in statistics, and the growing interest in experimental and nonexperimental (natural) designs in empirical economics. This article discusses the state of quasi-experimental comparison group research today, with a primary focus on studies in which regions—census tracts, counties, cities, metropolitan areas, provinces, or states—are the units of analysis. There is still progress to be made in improving matching methods, making more extensive use of time-series designs, undertaking more systematic sensitivity testing and checks for the robustness of findings, focusing greater attention on effect heterogeneity and research designs that aid policy and program improvement, and improving the practice of regional quasi-experimental research generally.

Suggested Citation

  • Edward Feser, 2013. "Isserman’s Impact," International Regional Science Review, , vol. 36(1), pages 44-68, January.
  • Handle: RePEc:sae:inrsre:v:36:y:2013:i:1:p:44-68
    DOI: 10.1177/0160017612464051
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0160017612464051
    Download Restriction: no

    File URL: https://libkey.io/10.1177/0160017612464051?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. repec:rre:publsh:v:38:y:2008:i:2:p:121-43 is not listed on IDEAS
    2. Keane, Michael P., 2010. "Structural vs. atheoretic approaches to econometrics," Journal of Econometrics, Elsevier, vol. 156(1), pages 3-20, May.
    3. Joshua D. Angrist & Jörn-Steffen Pischke, 2010. "The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 3-30, Spring.
    4. Stephen Gibbons & Henry G. Overman, 2012. "Mostly Pointless Spatial Econometrics?," Journal of Regional Science, Wiley Blackwell, vol. 52(2), pages 172-191, May.
    5. Daniel P. McMillen, 2010. "Issues In Spatial Data Analysis," Journal of Regional Science, Wiley Blackwell, vol. 50(1), pages 119-141, February.
    6. Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2008. "Nonparametric Tests for Treatment Effect Heterogeneity," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 389-405, August.
    7. Sandra E. Black, 1999. "Do Better Schools Matter? Parental Valuation of Elementary Education," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 577-599.
    8. repec:rre:publsh:v:35:y:2005:i:1:p:1-7 is not listed on IDEAS
    9. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    10. Greenberg, Michael & Isserman, Andrew & Frisch, Michael & Krueckeberg, Donald & Lowrie, Karen & Mayer, Henry & Simon, Darien & Sorenson, David, 1999. "Questioning conventional wisdom: the regional economic impacts of Major US nuclear weapons sites, 1970-1994," Socio-Economic Planning Sciences, Elsevier, vol. 33(3), pages 183-204, September.
    11. Yu Xiao, 2011. "Local Economic Impacts Of Natural Disasters," Journal of Regional Science, Wiley Blackwell, vol. 51(4), pages 804-820, October.
    12. Douglas J. Besharov, 2009. "Presidential address: From the Great Society to continuous improvement government: Shifting from “does it work?” to “what would make it better?”," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 28(2), pages 199-220.
    13. Bender, Bruce & Shwiff, Steven, 1982. "The Appropriation of Rents by Boomtown Governments," Economic Inquiry, Western Economic Association International, vol. 20(1), pages 84-103, January.
    14. Sylvie Charlot & Sonia Paty & Michel Visalli, 2013. "Assessing the impact of local taxation on property prices: a spatial matching contribution," Applied Economics, Taylor & Francis Journals, vol. 45(9), pages 1151-1166, March.
    15. Robert T. Greenbaum & John B. Engberg, 2004. "The impact of state enterprise zones on urban manufacturing establishments," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 23(2), pages 315-339.
    16. Christopher R. Cunningham, 2007. "Growth Controls, Real Options, and Land Development," The Review of Economics and Statistics, MIT Press, vol. 89(2), pages 343-358, May.
    17. Angrist, Joshua D, 1990. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records," American Economic Review, American Economic Association, vol. 80(3), pages 313-336, June.
    18. Luisa Corrado & Bernard Fingleton, 2012. "Where Is The Economics In Spatial Econometrics?," Journal of Regional Science, Wiley Blackwell, vol. 52(2), pages 210-239, May.
    19. Terance J. Rephann & Margaret Dalton & Anthony Stair & Andrew Isserman, 1997. "Casino Gambling as an Economic Development Strategy," Tourism Economics, , vol. 3(2), pages 161-183, June.
    20. Tiebout, Charles M, 1969. "An Empirical Regional Input-Output Projection Model: The State of Washington 1980," The Review of Economics and Statistics, MIT Press, vol. 51(3), pages 334-340, August.
    21. Stephen Billings, 2009. "Do Enterprise Zones Work?," Public Finance Review, , vol. 37(1), pages 68-93, January.
    22. Ona, Lucia Y. & Hudoyo, Agus & Freshwater, David, 2007. "Economic Impact of Hospital Closure on Rural Communities in Three Southern States: A Quasi-Experimental Approach," Journal of Regional Analysis and Policy, Mid-Continent Regional Science Association, vol. 37(2), pages 1-10.
    23. Campbell Jr., Harrison S., 2000. "Education, Training, and Regional Development: A Policy Relevant Agenda for Regional Science," The Review of Regional Studies, Southern Regional Science Association, vol. 30(1), pages 85-91, Summer.
    24. Caporale, Tony & Grier, Kevin, 2005. "How Smart Is my Dummy? Time Series Tests for the Influence of Politics," Political Analysis, Cambridge University Press, vol. 13(1), pages 77-94, January.
    25. Jushan Bai & Pierre Perron, 1998. "Estimating and Testing Linear Models with Multiple Structural Changes," Econometrica, Econometric Society, vol. 66(1), pages 47-78, January.
    26. Paul R. Rosenbaum, 2010. "Evidence factors in observational studies," Biometrika, Biometrika Trust, vol. 97(2), pages 333-345.
    27. Sullivan, Patrick & Hellerstein, Daniel & Hansen, LeRoy T. & Johansson, Robert C. & Koenig, Steven R. & Lubowski, Ruben N. & McBride, William D. & McGranahan, David A. & Roberts, Michael J. & Vogel, S, 2004. "The Conservation Reserve Program: Economic Implications for Rural America," Agricultural Economic Reports 33987, United States Department of Agriculture, Economic Research Service.
    28. Randall G. Holcombe & Donald J. Lacombe, 2004. "Using Matched Border Counties for Policy Analysis: The Effects of Entitlement Programs on Female-Headed Households and Female Labor-Force Participation," Eastern Economic Journal, Eastern Economic Association, vol. 30(3), pages 411-425, Summer.
    29. Rosenbaum, Paul R., 2010. "Design Sensitivity and Efficiency in Observational Studies," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 692-702.
    30. Randall Jackson, 2011. "Knowns, Unknowns, and Impacts," Working Papers Research Paper 2011-11, Regional Research Institute, West Virginia University.
    31. Thomas J. Holmes, 2010. "Structural, Experimentalist, And Descriptive Approaches To Empirical Work In Regional Economics," Journal of Regional Science, Wiley Blackwell, vol. 50(1), pages 5-22, February.
    32. Thomas J. Holmes, 1998. "The Effect of State Policies on the Location of Manufacturing: Evidence from State Borders," Journal of Political Economy, University of Chicago Press, vol. 106(4), pages 667-705, August.
    33. Reed, W. Robert & Rogers, Cynthia L., 2003. "A study of quasi-experimental control group methods for estimating policy impacts," Regional Science and Urban Economics, Elsevier, vol. 33(1), pages 3-25, January.
    34. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    35. Robert A. Baade & Robert Baumann & Victor Matheson, 2007. "Estimating the Economic Impact of Natural and Social Disasters, with an Application to Hurricane Katrina," Urban Studies, Urban Studies Journal Limited, vol. 44(11), pages 2061-2076, October.
    36. Michael Wenz, 2008. "Matching estimation, casino gambling and the quality of life," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 42(1), pages 235-249, March.
    37. Alberto Abadie & Guido W. Imbens, 2008. "On the Failure of the Bootstrap for Matching Estimators," Econometrica, Econometric Society, vol. 76(6), pages 1537-1557, November.
    38. Meyer, Bruce D, 1995. "Natural and Quasi-experiments in Economics," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(2), pages 151-161, April.
    39. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
    40. Huang, Rocco R., 2008. "Evaluating the real effect of bank branching deregulation: Comparing contiguous counties across US state borders," Journal of Financial Economics, Elsevier, vol. 87(3), pages 678-705, March.
    41. Ann Markusen, 2003. "Fuzzy Concepts, Scanty Evidence, Policy Distance: The Case for Rigour and Policy Relevance in Critical Regional Studies," Regional Studies, Taylor & Francis Journals, vol. 37(6-7), pages 701-717.
    42. Rephann, Terance & Isserman, Andrew, 1994. "New highways as economic development tools: An evaluation using quasi-experimental matching methods," Regional Science and Urban Economics, Elsevier, vol. 24(6), pages 723-751, December.
    43. Angrist, Joshua D, 1990. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records: Errata," American Economic Review, American Economic Association, vol. 80(5), pages 1284-1286, December.
    44. Stenberg, Peter L. & Morehart, Mitchell J. & Vogel, Stephen J. & Cromartie, John & Breneman, Vincent E. & Brown, Dennis M., 2009. "Broadband Internet's Value for Rural America," Economic Research Report 55944, United States Department of Agriculture, Economic Research Service.
    45. Brent C. Smith, 2009. "If You Promise to Build It, Will They Come? The Interaction between Local Economic Development Policy and the Real Estate Market: Evidence from Tax Increment Finance Districts," Real Estate Economics, American Real Estate and Urban Economics Association, vol. 37(2), pages 209-234, June.
    46. Daniel P. McMillen & John F. McDonald, 2002. "Land Values In A Newly Zoned City," The Review of Economics and Statistics, MIT Press, vol. 84(1), pages 62-72, February.
    47. Rohlin, Shawn M., 2011. "State minimum wages and business location: Evidence from a refined border approach," Journal of Urban Economics, Elsevier, vol. 69(1), pages 103-117, January.
    48. Stephen Billings & Thomas Thibodeau, 2011. "Intrametropolitan Decentralization: Is Government Structure Capitalized in Residential Property Values?," The Journal of Real Estate Finance and Economics, Springer, vol. 42(4), pages 416-450, May.
    49. Pender, John & Reeder, Richard, 2011. "Impacts of Regional Approaches to Rural Development: Initial Evidence on the Delta Regional Authority," Economic Research Report 262240, United States Department of Agriculture, Economic Research Service.
    50. Jushan Bai & Pierre Perron, 2003. "Computation and analysis of multiple structural change models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(1), pages 1-22.
    51. Daniel P. McMillen, 2012. "Perspectives On Spatial Econometrics: Linear Smoothing With Structured Models," Journal of Regional Science, Wiley Blackwell, vol. 52(2), pages 192-209, May.
    52. Jian Zhou & Daniel P. McMillen & John F. McDonald, 2008. "Land Values and the 1957 Comprehensive Amendment to the Chicago Zoning Ordinance," Urban Studies, Urban Studies Journal Limited, vol. 45(8), pages 1647-1661, July.
    53. Zhong Zhao, 2004. "Using Matching to Estimate Treatment Effects: Data Requirements, Matching Metrics, and Monte Carlo Evidence," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 91-107, February.
    54. Mark D. Partridge & Marlon Boarnet & Steven Brakman & Gianmarco Ottaviano, 2012. "Introduction: Whither Spatial Econometrics?," Journal of Regional Science, Wiley Blackwell, vol. 52(2), pages 167-171, May.
    55. Alberto Abadie & Guido W. Imbens, 2006. "Large Sample Properties of Matching Estimators for Average Treatment Effects," Econometrica, Econometric Society, vol. 74(1), pages 235-267, January.
    56. Isserman, Andrew M. & Beaumont, Paul M., 1989. "New directions in quasi-experimental control group methods for project evaluation," Socio-Economic Planning Sciences, Elsevier, vol. 23(1-2), pages 39-53.
    57. Arindrajit Dube & T. William Lester & Michael Reich, 2010. "Minimum Wage Effects Across State Borders: Estimates Using Contiguous Counties," The Review of Economics and Statistics, MIT Press, vol. 92(4), pages 945-964, November.
    58. Bronars, Stephen G & Lott, John R, Jr, 1998. "Criminal Deterrence, Geographic Spillovers, and the Right to Carry Concealed Handguns," American Economic Review, American Economic Association, vol. 88(2), pages 475-479, May.
    59. Paul Ferraro & Merlin Hanauer, 2011. "Protecting Ecosystems and Alleviating Poverty with Parks and Reserves: ‘Win-Win’ or Tradeoffs?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 48(2), pages 269-286, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    2. Abbott, Joshua K. & Klaiber, H. Allen, 2011. "The Value Of Water As An Urban Club Good: A Matching Approach To Hoa-Provided Lakes," 2011 Annual Meeting, July 24-26, 2011, Pittsburgh, Pennsylvania 103781, Agricultural and Applied Economics Association.
    3. Guido W. Imbens, 2020. "Potential Outcome and Directed Acyclic Graph Approaches to Causality: Relevance for Empirical Practice in Economics," Journal of Economic Literature, American Economic Association, vol. 58(4), pages 1129-1179, December.
    4. Pender, John & Reeder, Richard, 2011. "Impacts of Regional Approaches to Rural Development: Initial Evidence on the Delta Regional Authority," Economic Research Report 262240, United States Department of Agriculture, Economic Research Service.
    5. Abbott, Joshua K. & Allen Klaiber, H., 2013. "The value of water as an urban club good: A matching approach to community-provided lakes," Journal of Environmental Economics and Management, Elsevier, vol. 65(2), pages 208-224.
    6. Stephen Gibbons & Henry G. Overman, 2012. "Mostly Pointless Spatial Econometrics?," Journal of Regional Science, Wiley Blackwell, vol. 52(2), pages 172-191, May.
    7. James R. Meldrum, 2016. "Floodplain Price Impacts by Property Type in Boulder County, Colorado: Condominiums Versus Standalone Properties," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 64(4), pages 725-750, August.
    8. Huber, Martin & Lechner, Michael & Wunsch, Conny, 2013. "The performance of estimators based on the propensity score," Journal of Econometrics, Elsevier, vol. 175(1), pages 1-21.
    9. Demidova, Olga, 2021. "Methods of spatial econometrics and evaluation of government programs effectiveness," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 64, pages 107-134.
    10. Stephen Billings, 2009. "Do Enterprise Zones Work?," Public Finance Review, , vol. 37(1), pages 68-93, January.
    11. Heinrich, Carolyn J. & Mueser, Peter R. & Troske, Kenneth & Jeon, Kyung-Seong & Kahvecioglu, Daver C., 2009. "New Estimates of Public Employment and Training Program Net Impacts: A Nonexperimental Evaluation of the Workforce Investment Act Program," IZA Discussion Papers 4569, Institute of Labor Economics (IZA).
    12. Peter R. Mueser & Kenneth R. Troske & Alexey Gorislavsky, 2007. "Using State Administrative Data to Measure Program Performance," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 761-783, November.
    13. Christian Volpe Martincus, 2010. "Odyssey in International Markets: An Assessment of the Effectiveness of Export Promotion in Latin America and the Caribbean," IDB Publications (Books), Inter-American Development Bank, number 16458, February.
    14. Lechner, Michael & Wunsch, Conny, 2013. "Sensitivity of matching-based program evaluations to the availability of control variables," Labour Economics, Elsevier, vol. 21(C), pages 111-121.
    15. Jones A.M & Rice N, 2009. "Econometric Evaluation of Health Policies," Health, Econometrics and Data Group (HEDG) Working Papers 09/09, HEDG, c/o Department of Economics, University of York.
    16. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    17. Sokbae Lee & Yoon-Jae Whang, 2009. "Nonparametric Tests of Conditional Treatment Effects," Cowles Foundation Discussion Papers 1740, Cowles Foundation for Research in Economics, Yale University.
    18. Kong, Dongmin & Qin, Ni & Xiang, Junyi, 2021. "Minimum wage and entrepreneurship: Evidence from China," Journal of Economic Behavior & Organization, Elsevier, vol. 189(C), pages 320-336.
    19. Ferman, Bruno, 2021. "Matching estimators with few treated and many control observations," Journal of Econometrics, Elsevier, vol. 225(2), pages 295-307.
    20. Breinlich, Holger & Ottaviano, Gianmarco I.P. & Temple, Jonathan R.W., 2014. "Regional Growth and Regional Decline," Handbook of Economic Growth, in: Philippe Aghion & Steven Durlauf (ed.), Handbook of Economic Growth, edition 1, volume 2, chapter 4, pages 683-779, Elsevier.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:inrsre:v:36:y:2013:i:1:p:44-68. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.