IDEAS home Printed from https://ideas.repec.org/p/nbr/nberte/0170.html
   My bibliography  Save this paper

Natural and Quasi- Experiments in Economics

Author

Listed:
  • Bruce D. Meyer

Abstract

Using research designs patterned after randomized experiments, many recent economic studies examine outcome measures for treatment groups and comparison groups that are not randomly assigned. By using variation in explanatory variables generated by changes in state laws, government draft mechanisms, or other means, these studies obtain variation that is readily examined and is plausibly exogenous. This paper describes the advantages of these studies and suggests how they can be improved. It also provides aids in judging the validity of inferences they draw. Design complications such as multiple treatment and comparison groups and multiple pre- or post-intervention observations are advocated.

Suggested Citation

  • Bruce D. Meyer, 1994. "Natural and Quasi- Experiments in Economics," NBER Technical Working Papers 0170, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberte:0170
    Note: LS
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/t0170.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Meyer, Bruce D & Viscusi, W Kip & Durbin, David L, 1995. "Workers' Compensation and Injury Duration: Evidence from a Natural Experiment," American Economic Review, American Economic Association, vol. 85(3), pages 322-340, June.
    2. Meyer, Bruce D, 1990. "Unemployment Insurance and Unemployment Spells," Econometrica, Econometric Society, vol. 58(4), pages 757-782, July.
    3. Lawrence F. Katz & Alan B. Krueger, 1992. "The Effect of the Minimum Wage on the Fast-Food Industry," ILR Review, Cornell University, ILR School, vol. 46(1), pages 6-21, October.
    4. Pakes, Ariel & Ericson, Richard, 1998. "Empirical Implications of Alternative Models of Firm Dynamics," Journal of Economic Theory, Elsevier, vol. 79(1), pages 1-45, March.
    5. Card, David & Krueger, Alan B, 1994. "Minimum Wages and Employment: A Case Study of the Fast-Food Industry in New Jersey and Pennsylvania," American Economic Review, American Economic Association, vol. 84(4), pages 772-793, September.
    6. Imbens, Guido & van der Klaauw, Wilbert, 1995. "Evaluating the Cost of Conscription in The Netherlands," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(2), pages 207-215, April.
    7. David Card, 1990. "The Impact of the Mariel Boatlift on the Miami Labor Market," ILR Review, Cornell University, ILR School, vol. 43(2), pages 245-257, January.
    8. Alan B. Krueger, 1990. "Workers' Compensation Insurance and the Duration of Workplace Injuries," NBER Working Papers 3253, National Bureau of Economic Research, Inc.
    9. Angrist, Joshua & Krueger, Alan B, 1994. "Why Do World War II Veterans Earn More Than Nonveterans?," Journal of Labor Economics, University of Chicago Press, vol. 12(1), pages 74-97, January.
    10. Gruber, Jonathan, 1994. "The Incidence of Mandated Maternity Benefits," American Economic Review, American Economic Association, vol. 84(3), pages 622-641, June.
    11. Ashenfelter, Orley C, 1978. "Estimating the Effect of Training Programs on Earnings," The Review of Economics and Statistics, MIT Press, vol. 60(1), pages 47-57, February.
    12. Besley, Timothy & Case, Anne, 2000. "Unnatural Experiments? Estimating the Incidence of Endogenous Policies," Economic Journal, Royal Economic Society, vol. 110(467), pages 672-694, November.
    13. Manski, C.F., 1990. "The Selection Problem," Working papers 90-12, Wisconsin Madison - Social Systems.
    14. Jason G. Cummins & Kevin A. Hassett & R. Glenn Hubbard, 1994. "A Reconsideration of Investment Behavior Using Tax Reforms as Natural Experiments," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 25(2), pages 1-74.
    15. Angrist, Joshua D, 1990. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records," American Economic Review, American Economic Association, vol. 80(3), pages 313-336, June.
    16. Solon, Gary R, 1985. "Work Incentive Effects of Taxing Unemployment Benefits," Econometrica, Econometric Society, vol. 53(2), pages 295-306, March.
    17. Stephen A. Woodbury, 2009. "Unemployment," Chapters, in: Kenneth G. Dau-Schmidt & Seth D. Harris & Orly Lobel (ed.), Labor and Employment Law and Economics, chapter 17, Edward Elgar Publishing.
    18. Janet Currie & Jonathan Gruber, 1994. "Saving Babies: The Efficacy and Cost of Recent Expansions of Medicaid Eligibility for Pregnant Women," NBER Working Papers 4644, National Bureau of Economic Research, Inc.
    19. Joshua D. Angrist & Alan B. Keueger, 1991. "Does Compulsory School Attendance Affect Schooling and Earnings?," The Quarterly Journal of Economics, Oxford University Press, vol. 106(4), pages 979-1014.
    20. David Card, 1992. "Using Regional Variation in Wages to Measure the Effects of the Federal Minimum Wage," ILR Review, Cornell University, ILR School, vol. 46(1), pages 22-37, October.
    21. Ashenfelter, Orley & Card, David, 1985. "Using the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs," The Review of Economics and Statistics, MIT Press, vol. 67(4), pages 648-660, November.
    22. Patricia M. Anderson & Bruce D. Meyer, 1994. "Unemployment Insurance Benefits and Takeup Rates," NBER Working Papers 4787, National Bureau of Economic Research, Inc.
    23. Bruce D. Meyer, 1989. "A Quasi-Experimental Approach to the Effects of Unemployment Insurance," NBER Working Papers 3159, National Bureau of Economic Research, Inc.
    24. Aaron S. Yelowitz, 1995. "The Medicaid Notch, Labor Supply, and Welfare Participation: Evidence from Eligibility Expansions," The Quarterly Journal of Economics, Oxford University Press, vol. 110(4), pages 909-939.
    25. repec:fth:prinin:300 is not listed on IDEAS
    26. Green, David A & Riddell, W Craig, 1993. "The Economic Effects of Unemployment Insurance in Canada: An Empirical Analysis of UI Disentitlement," Journal of Labor Economics, University of Chicago Press, vol. 11(1), pages 96-147, January.
    27. C. F. Manski, "undated". "Learning about social programs from experiments with random assignment of treatments," Institute for Research on Poverty Discussion Papers 1061-95, University of Wisconsin Institute for Research on Poverty.
    28. repec:fth:prinin:261 is not listed on IDEAS
    29. Rosenzweig, Mark R & Wolpin, Kenneth I, 1980. "Testing the Quantity-Quality Fertility Model: The Use of Twins as a Natural Experiment," Econometrica, Econometric Society, vol. 48(1), pages 227-240, January.
    30. repec:fth:prinin:298 is not listed on IDEAS
    31. William P. Curington, 1994. "Compensation for Permanent Impairment and the Duration of Work Absence: Evidence from Four Natural Experiments," Journal of Human Resources, University of Wisconsin Press, vol. 29(3), pages 888-910.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cockx, Bart & Ridder, Geert, 2001. "Social Employment of Welfare Recipients in Belgium: An Evaluation," Economic Journal, Royal Economic Society, vol. 111(470), pages 322-352, April.
    2. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    3. Krueger, Alan B. & Meyer, Bruce D., 2002. "Labor supply effects of social insurance," Handbook of Public Economics, in: A. J. Auerbach & M. Feldstein (ed.), Handbook of Public Economics, edition 1, volume 4, chapter 33, pages 2327-2392, Elsevier.
    4. Rösner, Anja & Haucap, Justus & Heimeshoff, Ulrich, 2020. "The impact of consumer protection in the digital age: Evidence from the European Union," International Journal of Industrial Organization, Elsevier, vol. 73(C).
    5. Peter Skogman Thoursie, 2004. "Reporting sick: are sporting events contagious?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 19(6), pages 809-823.
    6. Jeff Borland & Yi-Ping Tseng & Roger Wilkins, 2005. "Experimental and Quasi-Experimental Methods of Microeconomic Program and Policy Evaluation," Melbourne Institute Working Paper Series wp2005n08, Melbourne Institute of Applied Economic and Social Research, The University of Melbourne.
    7. van der Klaauw, Bas, 2014. "From micro data to causality: Forty years of empirical labor economics," Labour Economics, Elsevier, vol. 30(C), pages 88-97.
    8. Jonathan Gruber, 1998. "Health Insurance and the Labor Market," NBER Working Papers 6762, National Bureau of Economic Research, Inc.
    9. Lewbel, Arthur & Yang, Thomas Tao, 2016. "Identifying the average treatment effect in ordered treatment models without unconfoundedness," Journal of Econometrics, Elsevier, vol. 195(1), pages 1-22.
    10. Bardaka, Eleni & Delgado, Michael S. & Florax, Raymond J.G.M., 2019. "A spatial multiple treatment/multiple outcome difference-in-differences model with an application to urban rail infrastructure and gentrification," Transportation Research Part A: Policy and Practice, Elsevier, vol. 121(C), pages 325-345.
    11. Piza, Caio & Souza, André Portela Fernandes de, 2016. "Short and long-term effects of a child-labor ban," Textos para discussão 428, FGV EESP - Escola de Economia de São Paulo, Fundação Getulio Vargas (Brazil).
    12. Torun, Huzeyfe & Tumen, Semih, 2016. "The effects of compulsory military service exemption on education and labor market outcomes: Evidence from a natural experiment," Economics of Education Review, Elsevier, vol. 54(C), pages 16-35.
    13. Nicolas R. Ziebarth & Martin Karlsson, 2014. "The Effects Of Expanding The Generosity Of The Statutory Sickness Insurance System," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(2), pages 208-230, March.
    14. Fortin, B. & Lanoie, P., 1998. "Effects of Workers' Compensation : A Survey," Papers 9816, Laval - Recherche en Politique Economique.
    15. Jonathan Gruber, 1994. "The Consumption Smoothing Benefits of Unemployment Insurance," NBER Working Papers 4750, National Bureau of Economic Research, Inc.
    16. Greenstone, Michael & Gayer, Ted, 2009. "Quasi-experimental and experimental approaches to environmental economics," Journal of Environmental Economics and Management, Elsevier, vol. 57(1), pages 21-44, January.
    17. Susan Athey & Guido W. Imbens, 2006. "Identification and Inference in Nonlinear Difference-in-Differences Models," Econometrica, Econometric Society, vol. 74(2), pages 431-497, March.
    18. Sampaio, Breno, 2010. "On the identification of the effect of prohibiting hand-held cell phone use while driving: Comment," Transportation Research Part A: Policy and Practice, Elsevier, vol. 44(9), pages 766-770, November.
    19. Marco D. Huesch & Truls Østbye & Michael K. Ong, 2012. "Measuring The Effect Of Policy Interventions At The Population Level: Some Methodological Concerns," Health Economics, John Wiley & Sons, Ltd., vol. 21(10), pages 1234-1249, October.
    20. Nikolay Doudchenko & Guido W. Imbens, 2016. "Balancing, Regression, Difference-In-Differences and Synthetic Control Methods: A Synthesis," NBER Working Papers 22791, National Bureau of Economic Research, Inc.

    More about this item

    JEL classification:

    • C1 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General
    • C9 - Mathematical and Quantitative Methods - - Design of Experiments

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberte:0170. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.