IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp11052.html
   My bibliography  Save this paper

Comparing Retrospective and Panel Data Collection Methods to Assess Labor Market Dynamics

Author

Listed:
  • Assaad, Ragui

    (University of Minnesota)

  • Krafft, Caroline

    (St. Catherine University)

  • Yassin, Shaimaa

    (University of Paris 1 Panthéon-Sorbonne)

Abstract

There is potential for measurement problems in both retrospective and panel microdata. In this paper we compare results on basic indicators related to labor markets and their dynamics from retrospective and panel survey data in Egypt, in order to determine the conditions under which results are similar or different. Specifically, we (1) assess the consistency of reporting of time-invariant characteristics in different waves of the panel, (2) compare the retrospective and panel data results on past labor market statuses, (3) assess the consistency of estimates of labor market transition rates across two specific dates by comparing panel and retrospective data, (4) assess the consistency of estimates of the level and trends of annual labor market transition rates across retrospective data from different waves of the survey, and (5) assess whether retrospective data can provide accurate trends of labor market aggregates, such as unemployment rates. We find that it is possible to garner useful information on labor market dynamics from retrospective data, but one must be cautious about which information to trust and at what level of detail. We conclude with a discussion of implications for future research as well as future survey design.

Suggested Citation

  • Assaad, Ragui & Krafft, Caroline & Yassin, Shaimaa, 2017. "Comparing Retrospective and Panel Data Collection Methods to Assess Labor Market Dynamics," IZA Discussion Papers 11052, Institute of Labor Economics (IZA).
  • Handle: RePEc:iza:izadps:dp11052
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp11052.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. John Gibson & Bonggeun Kim, 2010. "Non‐Classical Measurement Error in Long‐Term Retrospective Recall Surveys," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 72(5), pages 687-695, October.
    2. Shuaizhang Feng & Yingyao Hu, 2013. "Misclassification Errors and the Underestimation of the US Unemployment Rate," American Economic Review, American Economic Association, vol. 103(2), pages 1054-1070, April.
    3. Beegle, Kathleen & Carletto, Calogero & Himelein, Kristen, 2012. "Reliability of recall in agricultural data," Journal of Development Economics, Elsevier, vol. 98(1), pages 34-41.
    4. Stefan Dercon & Joseph S. Shapiro, 2007. "Moving On, Staying Behind, Getting Lost: Lessons on poverty mobility from longitudinal data," Economics Series Working Papers GPRG-WPS-075, University of Oxford, Department of Economics.
    5. de Nicola, Francesca & Giné, Xavier, 2014. "How accurate are recall data? Evidence from coastal India," Journal of Development Economics, Elsevier, vol. 106(C), pages 52-65.
    6. Ragui Assaad & Caroline Krafft, 2013. "The Egypt labor market panel survey: introducing the 2012 round," IZA Journal of Labor & Development, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 2(1), pages 1-30, December.
    7. Shaimaa Yassin, 2016. "Constructing Labor Market Transitions Recall Weights in Retrospective Data: An Application to Egypt and Jordan," Working Papers 1061, Economic Research Forum, revised 11 Jan 2016.
    8. Margaret Grosh & Paul Glewwe, 2000. "Designing Household Survey Questionnaires for Developing Countries," World Bank Publications - Books, The World Bank Group, number 25338.
    9. Thierry Magnac & Michael Visser, 1999. "Transition Models With Measurement Errors," The Review of Economics and Statistics, MIT Press, vol. 81(3), pages 466-474, August.
    10. Margaret Grosh & Paul Glewwe, 2000. "Designing Household Survey Questionnaires for Developing Countries : Lessons from 15 Years of the Living Standards Measurement Study, Volume 2," World Bank Publications - Books, The World Bank Group, number 15194.
    11. Ray Langsten & Rania Salen, 2008. "Two Approaches to Measuring Women's Work in Developing Countries: A Comparison of Survey Data from Egypt," Population and Development Review, The Population Council, Inc., vol. 34(2), pages 283-305, June.
    12. Rania Salem, 2015. "Changes in the Institution of Marriage in Egypt from 1998 to 2012," Working Papers 911, Economic Research Forum, revised May 2015.
    13. Ragui Assaad & Caroline Krafft, 2014. "The Economics of Marriage in North Africa," WIDER Working Paper Series wp-2014-067, World Institute for Development Economic Research (UNU-WIDER).
    14. John Roberts & Devon Brewer, 2001. "Measures and tests of heaping in discrete quantitative distributions," Journal of Applied Statistics, Taylor & Francis Journals, vol. 28(7), pages 887-896.
    15. Megan Beckett & Julie Da Vanzo & Narayan Sastry & Constantijn Panis & Christine Peterson, 2001. "The Quality of Retrospective Data: An Examination of Long-Term Recall in a Developing Country," Journal of Human Resources, University of Wisconsin Press, vol. 36(3), pages 593-625.
    16. Beegle, Kathleen & De Weerdt, Joachim & Friedman, Jed & Gibson, John, 2012. "Methods of household consumption measurement through surveys: Experimental results from Tanzania," Journal of Development Economics, Elsevier, vol. 98(1), pages 3-18.
    17. Mathiowetz, Nancy A & Duncan, Greg J, 1988. "Out of Work, Out of Mind: Response Errors in Retrospective Reports of Unemployment," Journal of Business & Economic Statistics, American Statistical Association, vol. 6(2), pages 221-229, April.
    18. François Langot & Shaimaa Yassin, 2015. "Reforming Employment Protection in Egypt: An Evaluation Based on Transition Models with Measurement Errors," Working Papers 918, Economic Research Forum, revised Jun 2015.
    19. Ragui Assaad & Caroline Krafft & Shaimaa Yassin, 2018. "Comparing retrospective and panel data collection methods to assess labor market dynamics," IZA Journal of Migration and Development, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 8(1), pages 1-34, December.
    20. Bound, John & Brown, Charles & Mathiowetz, Nancy, 2001. "Measurement error in survey data," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 59, pages 3705-3843, Elsevier.
    21. Margaret Grosh & Paul Glewwe, 2000. "Designing Household Survey Questionnaires for Developing Countries : Lessons from 15 Years of the Living Standards Measurement Study, Volume 3," World Bank Publications - Books, The World Bank Group, number 15195.
    22. Samer Kherfi, 2015. "Determinants of Unemployment Duration," Working Papers 909, Economic Research Forum, revised May 2015.
    23. Assaad, Ragui & Krafft, Caroline (ed.), 2015. "The Egyptian Labor Market in an Era of Revolution," OUP Catalogue, Oxford University Press, number 9780198737254.
    24. NAKATA Hiroyuki & SAWADA Yasuyuki & TANAKA Mari, 2010. "Asking Retrospective Questions in Household Surveys: Evidence from Vietnam," Discussion papers 10008, Research Institute of Economy, Trade and Industry (RIETI).
    25. Shaimaa Yassin & Francois Langot, 2017. "Correcting Measurement Errors in Transition Models Based on Retrospective Panel Data," IRENE Working Papers 17-04, IRENE Institute of Economic Research.
    26. George Judge & Laura Schechter, 2009. "Detecting Problems in Survey Data Using Benford’s Law," Journal of Human Resources, University of Wisconsin Press, vol. 44(1).
    27. Bell, Una Louise & Artola, Concha, 2001. "Identifying labour market dynamics using labour force survey data," ZEW Discussion Papers 01-44, ZEW - Leibniz Centre for European Economic Research.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:lic:licosd:41819 is not listed on IDEAS
    2. de Nicola, Francesca & Giné, Xavier, 2014. "How accurate are recall data? Evidence from coastal India," Journal of Development Economics, Elsevier, vol. 106(C), pages 52-65.
    3. Irene Selwaness & Caroline Krafft, 2021. "The Dynamics of Family Formation and Women’s Work: What Facilitates and Hinders Female Employment in the Middle East and North Africa?," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 40(3), pages 533-587, June.
    4. De Magalhães, Leandro & Santaeulàlia-Llopis, Raül, 2018. "The consumption, income, and wealth of the poorest: An empirical analysis of economic inequality in rural and urban Sub-Saharan Africa for macroeconomists," Journal of Development Economics, Elsevier, vol. 134(C), pages 350-371.
    5. Leandro De Magalhães & Dongya Koh & Raül Santaeulàlia-Llopis, 2016. "Consumption and Expenditure in Sub-Saharan Africa," Bristol Economics Discussion Papers 16/677, School of Economics, University of Bristol, UK, revised 07 Oct 2016.
    6. Leandro DE MAGALHÃES & Dongya KOH & Räul SANTAEULILA-LLOPIS, 2019. "The Cost of Consumption Smoothing: Less Schooling and less Nutrition," JODE - Journal of Demographic Economics, Cambridge University Press, vol. 85(3), pages 181-208, September.
    7. Wollburg, Philip & Tiberti, Marco & Zezza, Alberto, 2021. "Recall length and measurement error in agricultural surveys," Food Policy, Elsevier, vol. 100(C).
    8. Caroline Krafft & Ragui Assaad, 2020. "Employment’s Role in Enabling and Constraining Marriage in the Middle East and North Africa," Demography, Springer;Population Association of America (PAA), vol. 57(6), pages 2297-2325, December.
    9. Shaimaa Yassin, 2016. "Constructing Labor Market Transitions Recall Weights in Retrospective Data: An Application to Egypt and Jordan," IRENE Working Papers 16-07, IRENE Institute of Economic Research.
    10. Raül Santaeulàlia-Llopis & Yu Zheng, 2017. "Why Is Food Consumption Inequality Underestimated? A Story of Vices and Children," Working Papers 969, Barcelona School of Economics.
    11. Arthi, Vellore & Beegle, Kathleen & De Weerdt, Joachim & Palacios-López, Amparo, 2018. "Not your average job: Measuring farm labor in Tanzania," Journal of Development Economics, Elsevier, vol. 130(C), pages 160-172.
    12. Heath,Rachel & Mansuri,Ghazala & Rijkers,Bob & Seitz,William Hutchins & Sharma,Dhiraj, 2020. "Measuring Employment : Experimental Evidence from Urban Ghana," Policy Research Working Paper Series 9263, The World Bank.
    13. Ragui Assaad & Caroline Krafft, 2023. "Labour market dynamics and youth unemployment in the Middle East and North Africa: Evidence from Egypt, Jordan, and Tunisia," LABOUR, CEIS, vol. 37(4), pages 519-553, December.
    14. Ambler, Kate & Herskowitz, Sylvan & Maredia, Mywish K., 2021. "Are we done yet? Response fatigue and rural livelihoods," Journal of Development Economics, Elsevier, vol. 153(C).
    15. Shaimaa Yassin & Francois Langot, 2017. "Correcting Measurement Errors in Transition Models Based on Retrospective Panel Data," IRENE Working Papers 17-04, IRENE Institute of Economic Research.
    16. Godlonton, Susan & Hernandez, Manuel A. & Paz, Cynthia, 2021. "Can survey design reduce anchoring bias in recall data? Evidence from Malawi," IFPRI discussion papers 2055, International Food Policy Research Institute (IFPRI).
    17. Virginie Comblon & Anne-Sophie Robilliard, 2015. "Are female employment statistics more sensitive than male ones to questionnaire design? Evidence from Cameroon, Mali and Senegal," Working Papers DT/2015/22, DIAL (Développement, Institutions et Mondialisation).
    18. Barik, Debasis & Desai, Sonalde & Vanneman, Reeve, 2018. "Economic Status and Adult Mortality in India: Is the Relationship Sensitive to Choice of Indicators?," World Development, Elsevier, vol. 103(C), pages 176-187.
    19. Van Landeghem, Bert & Vandeplas, Anneleen, 2018. "The relationship between status and happiness: Evidence from the caste system in rural India," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 77(C), pages 62-71.
    20. Caroline Krafft, 2020. "Why is fertility on the rise in Egypt? The role of women’s employment opportunities," Journal of Population Economics, Springer;European Society for Population Economics, vol. 33(4), pages 1173-1218, October.
    21. Xiaowei Yang & Jianmin Gao & Zhongliang Zhou & Jue Yan & Sha Lai & Yongjian Xu & Gang Chen, 2016. "Assessing the Effects of the New Cooperative Medical Scheme on Alleviating the Health Payment-Induced Poverty in Shaanxi Province, China," PLOS ONE, Public Library of Science, vol. 11(7), pages 1-12, July.

    More about this item

    Keywords

    panel data; retrospective data; survey data; measurement error; labor markets; Egypt;
    All these keywords.

    JEL classification:

    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • J01 - Labor and Demographic Economics - - General - - - Labor Economics: General
    • J62 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Job, Occupational and Intergenerational Mobility; Promotion
    • J64 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Unemployment: Models, Duration, Incidence, and Job Search

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp11052. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.