IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp6803.html
   My bibliography  Save this paper

Comparing Quasi-Experimental Designs and Structural Models for Policy Evaluation: The Case of a Reform of Lone Parental Welfare

Author

Listed:
  • Pronzato, Chiara D.

    (University of Turin)

Abstract

This paper compares two different ways of doing policy evaluation: on the one hand, quasi-experimental methods (or "ex-post" evaluations) which exploit the introduction of a reform and identify its effect by comparing treated and untreated individuals; on the other hand, structural models (or "ex-ante" evaluations) which are based on economic theory and predict the effect of potential reforms by using the estimates of behavioural parameters. The comparison is carried out using an empirical case. In 1998, in Norway, a major welfare reform changed the rules of the most generous benefit for lone parents: it increased the amount of the benefit and introduced working requirements. Using a quasi-experimental evaluation approach, it is found a positive effect of the reform on lone mothers' employment. In this paper, I estimate a static structural model of work and welfare participation decisions and compare the results using the two different approaches. Despite the differences in the assumptions I make for the two models, results are fairly comparable.

Suggested Citation

  • Pronzato, Chiara D., 2012. "Comparing Quasi-Experimental Designs and Structural Models for Policy Evaluation: The Case of a Reform of Lone Parental Welfare," IZA Discussion Papers 6803, Institute of Labor Economics (IZA).
    • Handle: RePEc:iza:izadps:dp6803
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp6803.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Keane, Michael P., 2010. "Structural vs. atheoretic approaches to econometrics," Journal of Econometrics, Elsevier, vol. 156(1), pages 3-20, May.
    2. Blundell, Richard, 2006. "Earned income tax credit policies: Impact and optimality: The Adam Smith Lecture, 2005," Labour Economics, Elsevier, vol. 13(4), pages 423-443, August.
    3. Magne Mogstad & Chiara Pronzato, 2008. "Are lone mothers responsive to policy changes? The effects of a Norwegian workfare reform on earnings, education and poverty," Working Papers 008, "Carlo F. Dondena" Centre for Research on Social Dynamics (DONDENA), Università Commerciale Luigi Bocconi.
    4. Ilmakunnas, Seija & Pudney, Stephen, 1990. "A model of female labour supply in the presence of hours restrictions," Journal of Public Economics, Elsevier, vol. 41(2), pages 183-210, March.
    5. Moffitt, Robert, 1983. "An Economic Model of Welfare Stigma," American Economic Review, American Economic Association, vol. 73(5), pages 1023-1035, December.
    6. Bargain, Olivier B. & Orsini, Kristian & Peichl, Andreas, 2011. "Labor Supply Elasticities in Europe and the US," IZA Discussion Papers 5820, Institute of Labor Economics (IZA).
    7. Jorgen Hansen & Xingfei Liu, 2015. "Estimating labour supply responses and welfare participation: Using a natural experiment to validate a structural labour supply model," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 48(5), pages 1831-1854, December.
    8. Lemieux, Thomas & Milligan, Kevin, 2008. "Incentive effects of social assistance: A regression discontinuity approach," Journal of Econometrics, Elsevier, vol. 142(2), pages 807-828, February.
    9. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521766555.
    10. R. Aaberge & U. Colombino & T. Wennemo, 2009. "Evaluating Alternative Representations Of The Choice Sets In Models Of Labor Supply," Journal of Economic Surveys, Wiley Blackwell, vol. 23(3), pages 586-612, July.
    11. Thomas MaCurdy & David Green & Harry Paarsch, 1990. "Assessing Empirical Approaches for Analyzing Taxes and Labor Supply," Journal of Human Resources, University of Wisconsin Press, vol. 25(3), pages 415-490.
    12. Olivier Bargain & Kristian Orsini & Andreas Peichl, 2014. "Comparing Labor Supply Elasticities in Europe and the United States: New Results," Journal of Human Resources, University of Wisconsin Press, vol. 49(3), pages 723-838.
    13. Michael P. Keane & Kenneth I. Wolpin, 2007. "Exploring The Usefulness Of A Nonrandom Holdout Sample For Model Validation: Welfare Effects On Female Behavior," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 48(4), pages 1351-1378, November.
    14. Michael P. Keane, 2011. "Labor Supply and Taxes: A Survey," Journal of Economic Literature, American Economic Association, vol. 49(4), pages 961-1075, December.
    15. Kenneth I. Wolpin & Petra E. Todd, 2006. "Assessing the Impact of a School Subsidy Program in Mexico: Using a Social Experiment to Validate a Dynamic Behavioral Model of Child Schooling and Fertility," American Economic Review, American Economic Association, vol. 96(5), pages 1384-1417, December.
    16. John Creedy & Guyonne Kalb, 2005. "Discrete Hours Labour Supply Modelling: Specification, Estimation and Simulation," Journal of Economic Surveys, Wiley Blackwell, vol. 19(5), pages 697-734, December.
    17. Paul Gregg & Susan Harkness & Sarah Smith, 2009. "Welfare Reform and Lone Parents in the UK," Economic Journal, Royal Economic Society, vol. 119(535), pages 38-65, February.
    18. repec:hoo:wpaper:e-90-11 is not listed on IDEAS
    19. Magne Mogstad & Chiara Pronzato, 2012. "Are Lone Mothers Responsive to Policy Changes? Evidence from a Workfare Reform in a Generous Welfare State," Scandinavian Journal of Economics, Wiley Blackwell, vol. 114(4), pages 1129-1159, December.
    20. Hoynes, Hilary Williamson, 1996. "Welfare Transfers in Two-Parent Families: Labor Supply and Welfare Participation under AFDC-UP," Econometrica, Econometric Society, vol. 64(2), pages 295-332, March.
    21. Bernal, Raquel & Keane, Michael P., 2010. "Quasi-structural estimation of a model of childcare choices and child cognitive ability production," Journal of Econometrics, Elsevier, vol. 156(1), pages 164-189, May.
    22. Brewer, Mike & Duncan, Alan & Shephard, Andrew & Suarez, Maria Jose, 2006. "Did working families' tax credit work? The impact of in-work support on labour supply in Great Britain," Labour Economics, Elsevier, vol. 13(6), pages 699-720, December.
    23. Francesconi, Marco & van der Klaauw, Wilbert, 2004. "The consequences of ‘in-work’ benefit reform in Britain: new evidence from panel data," ISER Working Paper Series 2004-13, Institute for Social and Economic Research.
    24. Olivier Bargain & Kristian Orsini & Andreas Peichl, 2012. "Comparing Labor Supply Elasticities in Europe and the US: New Results," SOEPpapers on Multidisciplinary Panel Data Research 525, DIW Berlin, The German Socio-Economic Panel (SOEP).
    25. Aaberge, Rolf & Colombino, Ugo & Strom, Steinar, 1999. "Labour Supply in Italy: An Empirical Analysis of Joint Household Decisions, with Taxes and Quantity Constraints," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(4), pages 403-422, July-Aug..
    26. Richard Blundell, 2012. "Tax Policy Reform: The Role Of Empirical Evidence," Journal of the European Economic Association, European Economic Association, vol. 10(1), pages 43-77, February.
    27. Richard Blundell & Alan Duncan & Julian McCrae & Costas Meghir, 2000. "Evaluating In-Work Benefit Reform: The Working Families Tax Credit in the U.K," JCPR Working Papers 160, Northwestern University/University of Chicago Joint Center for Poverty Research.
    28. Arthur van Soest, 1995. "Structural Models of Family Labor Supply: A Discrete Choice Approach," Journal of Human Resources, University of Wisconsin Press, vol. 30(1), pages 63-88.
    29. Andrew Leigh, 2005. "Optimal Design of Earned Income Tax Credits: Evidence from a British Natural Experiment," CEPR Discussion Papers 488, Centre for Economic Policy Research, Research School of Economics, Australian National University.
    30. John Creedy & Guyonne Kalb & Rosanna Scutella, 2006. "Income distribution in discrete hours behavioural microsimulation models: An illustration," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 4(1), pages 57-76, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Olivier Bargain & Karina Doorley, 2016. "The Effect of Social Benefits on Youth Employment: Combining RD and a Behavioral Model," Post-Print hal-03894917, HAL.
    2. Peter Ericson & Lennart Flood & Nizamul Islam, 2015. "Taxes, wages and working hours," Empirical Economics, Springer, vol. 49(2), pages 503-535, September.
    3. Chiara Daniela Pronzato, 2015. "Fighting Lone Mothers’ Poverty Through In-Work Benefits: Methodological Issues and Policy Suggestions," CESifo Economic Studies, CESifo Group, vol. 61(1), pages 95-122.
    4. Johannes Geyer & Peter Haan & Katharina Wrohlich, 2014. "The Effects of Family Policy on Mothers' Labor Supply: Combining Evidence from a Structural Model and a Natural Experiment," Discussion Papers of DIW Berlin 1366, DIW Berlin, German Institute for Economic Research.
    5. Thor O. Thoresen & Trine E. Vattø, 2013. "Validation of structural labor supply model by the elasticity of taxable income," Discussion Papers 738, Statistics Norway, Research Department.
    6. Chiara Daniela Pronzato, 2014. "Fighting Lone Mothers’ Poverty through In-Work Benefits. Methodological Issues and Policy Suggestions," CHILD Working Papers Series 23, Centre for Household, Income, Labour and Demographic Economics (CHILD) - CCA.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chiara Daniela Pronzato, 2015. "Fighting Lone Mothers’ Poverty Through In-Work Benefits: Methodological Issues and Policy Suggestions," CESifo Economic Studies, CESifo Group, vol. 61(1), pages 95-122.
    2. Chiara Daniela Pronzato, 2014. "Fighting Lone Mothers’ Poverty through In-Work Benefits. Methodological Issues and Policy Suggestions," CHILD Working Papers Series 23, Centre for Household, Income, Labour and Demographic Economics (CHILD) - CCA.
    3. Löffler, Max & Peichl, Andreas & Siegloch, Sebastian, 2013. "Validating Structural Labor Supply Models," VfS Annual Conference 2013 (Duesseldorf): Competition Policy and Regulation in a Global Economic Order 79819, Verein für Socialpolitik / German Economic Association.
    4. Rolf Aaberge & Ugo Colombino, 2014. "Labour Supply Models," Contributions to Economic Analysis, in: Handbook of Microsimulation Modelling, volume 127, pages 167-221, Emerald Group Publishing Limited.
    5. Thoresen, Thor O. & Vattø, Trine E., 2015. "Validation of the discrete choice labor supply model by methods of the new tax responsiveness literature," Labour Economics, Elsevier, vol. 37(C), pages 38-53.
    6. Mauro Mastrogiacomo & Nicole M. Bosch & Miriam D. A. C. Gielen & Egbert L. W. Jongen, 2017. "Heterogeneity in Labour Supply Responses: Evidence from a Major Tax Reform," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 79(5), pages 769-796, October.
    7. Henk-Wim Boer & Egbert L. W. Jongen, 2023. "Analysing tax-benefit reforms in the Netherlands using structural models and natural experiments," Journal of Population Economics, Springer;European Society for Population Economics, vol. 36(1), pages 179-209, January.
    8. Kabátek, Jan, 2015. "Essays on public policy and household decision making," Other publications TiSEM 8cdb178e-ad98-42e5-a7e1-b, Tilburg University, School of Economics and Management.
    9. Jorgen Hansen & Xingfei Liu, 2015. "Estimating labour supply responses and welfare participation: Using a natural experiment to validate a structural labour supply model," Canadian Journal of Economics, Canadian Economics Association, vol. 48(5), pages 1831-1854, December.
    10. Buhlmann, Florian & Hebsaker, Michael & Kreuz, Tobias & Schmidhäuser, Jakob & Siegloch, Sebastian & Stichnoth, Holger, 2022. "ZEW-EviSTA: A microsimulation model of the German tax and transfer system," ZEW Discussion Papers 22-026, ZEW - Leibniz Centre for European Economic Research.
    11. de Boer, Henk-Wim & Jongen, Egbert L. W., 2020. "Analysing Tax-Benefit Reforms in the Netherlands: Using Structural Models and Natural Experiments," IZA Discussion Papers 12892, Institute of Labor Economics (IZA).
    12. Löffler, Max & Peichl, Andreas & Pestel, Nico & Siegloch, Sebastian & Sommer, Eric, 2014. "Documentation IZA?MOD v3.0: The IZA Policy Simulation Model," IZA Discussion Papers 8553, Institute of Labor Economics (IZA).
    13. Rolf Aaberge & Ugo Colombino, 2018. "Structural Labour Supply Models and Microsimulation," International Journal of Microsimulation, International Microsimulation Association, vol. 11(1), pages 162-197.
    14. Shun-ichiro Bessho & Masayoshi Hayashi, 2015. "Should the Japanese tax system be more progressive? An evaluation using the simulated SMCFs based on the discrete choice model of labor supply," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 22(1), pages 144-175, February.
    15. Bessho, Shun-ichiro & Hayashi, Masayoshi, 2014. "Intensive margins, extensive margins, and spousal allowances in the Japanese system of personal income taxes: A discrete choice analysis," Journal of the Japanese and International Economies, Elsevier, vol. 34(C), pages 162-178.
    16. Thor O. Thoresen & Trine E. Vattø, 2013. "Validation of structural labor supply model by the elasticity of taxable income," Discussion Papers 738, Statistics Norway, Research Department.
    17. John K. Dagsvik & Zhiyang Jia & Tom Kornstad & Thor O. Thoresen, 2014. "Theoretical And Practical Arguments For Modeling Labor Supply As A Choice Among Latent Jobs," Journal of Economic Surveys, Wiley Blackwell, vol. 28(1), pages 134-151, February.
    18. Kurowska, Anna & Myck, Michal & Wrohlich, Katharina, 2012. "Family and Labor Market Choices: Requirements to Guide Effective Evidence-Based Policy," IZA Discussion Papers 6846, Institute of Labor Economics (IZA).
    19. Nicole Bosch & Miriam Gielen & Egbert Jongen & Mauro Mastrogiacomo (DNB & voorheen CPB), 2013. "A structural analysis of labour supply elasticities in the Netherlands," CPB Discussion Paper 235, CPB Netherlands Bureau for Economic Policy Analysis.
    20. de Boer, Henk-Wim & Jongen, Egbert L.W. & Kabatek, Jan, 2022. "The effectiveness of fiscal stimuli for working parents," Labour Economics, Elsevier, vol. 76(C).

    More about this item

    Keywords

    discrete choice modelling; quasi-experimental evaluation designs; in-work benefits; lone mothers; ex-ante and ex-post evaluation;
    All these keywords.

    JEL classification:

    • I38 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - Government Programs; Provision and Effects of Welfare Programs
    • J22 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Time Allocation and Labor Supply
    • C25 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Discrete Regression and Qualitative Choice Models; Discrete Regressors; Proportions; Probabilities

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp6803. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.