IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp6682.html
   My bibliography  Save this paper

Sharpening the Effectiveness of Natural Experiments as an Analytical Tool

Author

Listed:
  • Duleep, Harriet

    (College of William and Mary)

Abstract

The importance of using natural experiments in economic research has long been recognized. Yet, it is only in recent years that natural experiments have become an integral part of the economist's analytical toolbox, thanks to the efforts of Meyer, Card, Peters, Krueger, Gruber, and others. This use promises to shed new light on a variety of public policy issues and has already caused a major challenge to some tightly held beliefs in economics, most vividly illustrated by the finding of a positive effect of a minimum wage increase on the employment of low-wage workers. Although currently in vogue in economic research, the analysis of natural experiments could be substantially strengthened. This paper discusses several methodological approaches that would increase the precision and reliability of the results stemming from the analysis of natural experiments. A theme underlying all of these proposals is how best to measure the effect of a treatment on a variable, as opposed to explaining a level or change in a variable.

Suggested Citation

  • Duleep, Harriet, 2012. "Sharpening the Effectiveness of Natural Experiments as an Analytical Tool," IZA Discussion Papers 6682, Institute of Labor Economics (IZA).
    • Handle: RePEc:iza:izadps:dp6682
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp6682.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. David Card, 1990. "The Impact of the Mariel Boatlift on the Miami Labor Market," ILR Review, Cornell University, ILR School, vol. 43(2), pages 245-257, January.
    2. Jennifer Hunt, 1992. "The Impact of the 1962 Repatriates from Algeria on the French Labor Market," ILR Review, Cornell University, ILR School, vol. 45(3), pages 556-572, April.
    3. Angrist, Joshua D, 1990. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records," American Economic Review, American Economic Association, vol. 80(3), pages 313-336, June.
    4. Meyer, Bruce D, 1995. "Natural and Quasi-experiments in Economics," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(2), pages 151-161, April.
    5. Herbert L. Lyon & Julian L. Simon, 1968. "Price Elasticity of the Demand for Cigarettes in the United States," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 50(4), pages 888-895.
    6. Angrist, Joshua D, 1990. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records: Errata," American Economic Review, American Economic Association, vol. 80(5), pages 1284-1286, December.
    7. Nakamura, Alice Orcutt & Nakamura, Masao & Duleep, Harriet Orcutt, 1990. "Alternative approaches to model choice," Journal of Economic Behavior & Organization, Elsevier, vol. 14(1), pages 97-125, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Harriet Orcutt Duleep, 2013. "U.S. Immigration Policy at a Crossroads," Working Papers 130, Department of Economics, College of William and Mary.
    2. Duleep, Harriet, 2013. "U.S. Immigration Policy at a Crossroads," IZA Discussion Papers 7136, Institute of Labor Economics (IZA).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Duleep, Harriet & Liu, Xingfei, 2016. "Estimating More Precise Treatment Effects in Natural and Actual Experiments," IZA Discussion Papers 10055, Institute of Labor Economics (IZA).
    2. Idrisov, Georgiy (Идрисов, Георгий) & Taganov, B.V. (Таганов, Б.), 2016. "Research of the Effect of Growth of Openness of the Russian Economy on Income Inequality in Russia [Исследование Влияния Роста Открытости Российской Экономики На Неравенство Доходов Населения В Рос," Working Papers 3136, Russian Presidential Academy of National Economy and Public Administration.
    3. Boris Salazar-Trujillo & Daniel Otero Robles, 2019. "La revolución empírica en economía," Apuntes del Cenes, Universidad Pedagógica y Tecnológica de Colombia, vol. 38(68), pages 15-48, July.
    4. Tito Boeri & Jan van Ours, 2013. "The Economics of Imperfect Labor Markets: Second Edition," Economics Books, Princeton University Press, edition 1, number 10142.
    5. Committee, Nobel Prize, 2021. "Answering causal questions using observational data," Nobel Prize in Economics documents 2021-2, Nobel Prize Committee.
    6. Dautović, Ernest & Gambacorta, Leonardo & Reghezza, Alessio, 2023. "Supervisory policy stimulus: evidence from the euro area dividend recommendation," Working Paper Series 2796, European Central Bank.
    7. Joshua D. Angrist & Jörn-Steffen Pischke, 2010. "The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 3-30, Spring.
    8. Peter Hull & Michal Kolesár & Christopher Walters, 2022. "Labor by design: contributions of David Card, Joshua Angrist, and Guido Imbens," Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(3), pages 603-645, July.
    9. Guido W. Imbens, 2020. "Potential Outcome and Directed Acyclic Graph Approaches to Causality: Relevance for Empirical Practice in Economics," Journal of Economic Literature, American Economic Association, vol. 58(4), pages 1129-1179, December.
    10. Aydemir, Abdurrahman B. & Kırdar, Murat G., 2017. "Quasi-experimental impact estimates of immigrant labor supply shocks: The role of treatment and comparison group matching and relative skill composition," European Economic Review, Elsevier, vol. 98(C), pages 282-315.
    11. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    12. Jeff Borland & Yi-Ping Tseng & Roger Wilkins, 2005. "Experimental and Quasi-Experimental Methods of Microeconomic Program and Policy Evaluation," Melbourne Institute Working Paper Series wp2005n08, Melbourne Institute of Applied Economic and Social Research, The University of Melbourne.
    13. Jens Ludwig & Jeffrey R. Kling & Sendhil Mullainathan, 2011. "Mechanism Experiments and Policy Evaluations," Journal of Economic Perspectives, American Economic Association, vol. 25(3), pages 17-38, Summer.
    14. Mazzutti, Caio Cícero Toledo Piza da Costa, 2016. "Three essays on the causal impacts of child labour laws in Brazil," Economics PhD Theses 0616, Department of Economics, University of Sussex Business School.
    15. Meyer, Bruce D, 1995. "Natural and Quasi-experiments in Economics," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(2), pages 151-161, April.
    16. Aishwarya Deep Shukla & Guodong (Gordon) Gao & Ritu Agarwal, 2021. "How Digital Word-of-Mouth Affects Consumer Decision Making: Evidence from Doctor Appointment Booking," Management Science, INFORMS, vol. 67(3), pages 1546-1568, March.
    17. Akihiko Kawaura & Sumner La Croix, 2010. "The Designated Hitter Rule in Baseball as a Natural Experiment," Working Papers 201005, University of Hawaii at Manoa, Department of Economics.
    18. Guido W. Imbens, 2010. "Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009)," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 399-423, June.
    19. van der Klaauw, Bas, 2014. "From micro data to causality: Forty years of empirical labor economics," Labour Economics, Elsevier, vol. 30(C), pages 88-97.
    20. Edward Feser, 2013. "Isserman’s Impact," International Regional Science Review, , vol. 36(1), pages 44-68, January.

    More about this item

    Keywords

    natural experiments; regression format; treatment effect; precision; extraneous group-specific effects; minimum wage; divorce laws; military service; Julian Simon;
    All these keywords.

    JEL classification:

    • J08 - Labor and Demographic Economics - - General - - - Labor Economics Policies
    • J18 - Labor and Demographic Economics - - Demographic Economics - - - Public Policy
    • J38 - Labor and Demographic Economics - - Wages, Compensation, and Labor Costs - - - Public Policy
    • J48 - Labor and Demographic Economics - - Particular Labor Markets - - - Particular Labor Markets; Public Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp6682. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.