IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp11052.html
   My bibliography  Save this paper

Comparing Retrospective and Panel Data Collection Methods to Assess Labor Market Dynamics

Author

Listed:
  • Assaad, Ragui

    (University of Minnesota)

  • Krafft, Caroline

    (St. Catherine University)

  • Yassin, Shaimaa

    (University of Paris 1 Panthéon-Sorbonne)

Abstract

There is potential for measurement problems in both retrospective and panel microdata. In this paper we compare results on basic indicators related to labor markets and their dynamics from retrospective and panel survey data in Egypt, in order to determine the conditions under which results are similar or different. Specifically, we (1) assess the consistency of reporting of time-invariant characteristics in different waves of the panel, (2) compare the retrospective and panel data results on past labor market statuses, (3) assess the consistency of estimates of labor market transition rates across two specific dates by comparing panel and retrospective data, (4) assess the consistency of estimates of the level and trends of annual labor market transition rates across retrospective data from different waves of the survey, and (5) assess whether retrospective data can provide accurate trends of labor market aggregates, such as unemployment rates. We find that it is possible to garner useful information on labor market dynamics from retrospective data, but one must be cautious about which information to trust and at what level of detail. We conclude with a discussion of implications for future research as well as future survey design.

Suggested Citation

  • Assaad, Ragui & Krafft, Caroline & Yassin, Shaimaa, 2017. "Comparing Retrospective and Panel Data Collection Methods to Assess Labor Market Dynamics," IZA Discussion Papers 11052, Institute of Labor Economics (IZA).
    • Handle: RePEc:iza:izadps:dp11052
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp11052.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Megan Beckett & Julie Da Vanzo & Narayan Sastry & Constantijn Panis & Christine Peterson, 2001. "The Quality of Retrospective Data: An Examination of Long-Term Recall in a Developing Country," Journal of Human Resources, University of Wisconsin Press, vol. 36(3), pages 593-625.
    2. Shuaizhang Feng & Yingyao Hu, 2013. "Misclassification Errors and the Underestimation of the US Unemployment Rate," American Economic Review, American Economic Association, vol. 103(2), pages 1054-1070, April.
    3. Beegle, Kathleen & De Weerdt, Joachim & Friedman, Jed & Gibson, John, 2012. "Methods of household consumption measurement through surveys: Experimental results from Tanzania," Journal of Development Economics, Elsevier, vol. 98(1), pages 3-18.
    4. John Gibson & Bonggeun Kim, 2010. "Non‐Classical Measurement Error in Long‐Term Retrospective Recall Surveys," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 72(5), pages 687-695, October.
    5. Mathiowetz, Nancy A & Duncan, Greg J, 1988. "Out of Work, Out of Mind: Response Errors in Retrospective Reports of Unemployment," Journal of Business & Economic Statistics, American Statistical Association, vol. 6(2), pages 221-229, April.
    6. François Langot & Shaimaa Yassin, 2015. "Reforming Employment Protection in Egypt: An Evaluation Based on Transition Models with Measurement Errors," Working Papers 918, Economic Research Forum, revised Jun 2015.
    7. Ragui Assaad & Caroline Krafft & Shaimaa Yassin, 2018. "Comparing retrospective and panel data collection methods to assess labor market dynamics," IZA Journal of Migration and Development, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 8(1), pages 1-34, December.
    8. Bound, John & Brown, Charles & Mathiowetz, Nancy, 2001. "Measurement error in survey data," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 59, pages 3705-3843, Elsevier.
    9. de Nicola, Francesca & Giné, Xavier, 2014. "How accurate are recall data? Evidence from coastal India," Journal of Development Economics, Elsevier, vol. 106(C), pages 52-65.
    10. Margaret Grosh & Paul Glewwe, 2000. "Designing Household Survey Questionnaires for Developing Countries : Lessons from 15 Years of the Living Standards Measurement Study, Volume 3," World Bank Publications - Books, The World Bank Group, number 15195, December.
    11. Thierry Magnac & Michael Visser, 1999. "Transition Models With Measurement Errors," The Review of Economics and Statistics, MIT Press, vol. 81(3), pages 466-474, August.
    12. Beegle, Kathleen & Carletto, Calogero & Himelein, Kristen, 2012. "Reliability of recall in agricultural data," Journal of Development Economics, Elsevier, vol. 98(1), pages 34-41.
    13. Samer Kherfi, 2015. "Determinants of Unemployment Duration," Working Papers 909, Economic Research Forum, revised May 2015.
    14. Stefan Dercon & Joseph S. Shapiro, 2007. "Moving On, Staying Behind, Getting Lost: Lessons on poverty mobility from longitudinal data," Economics Series Working Papers GPRG-WPS-075, University of Oxford, Department of Economics.
    15. Ragui Assaad & Caroline Krafft, 2013. "The Egypt labor market panel survey: introducing the 2012 round," IZA Journal of Labor & Development, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 2(1), pages 1-30, December.
    16. Shaimaa Yassin, 2016. "Constructing Labor Market Transitions Recall Weights in Retrospective Data: An Application to Egypt and Jordan," Working Papers 1061, Economic Research Forum, revised 11 Jan 2016.
    17. Assaad, Ragui & Krafft, Caroline (ed.), 2015. "The Egyptian Labor Market in an Era of Revolution," OUP Catalogue, Oxford University Press, number 9780198737254.
    18. Margaret Grosh & Paul Glewwe, 2000. "Designing Household Survey Questionnaires for Developing Countries," World Bank Publications - Books, The World Bank Group, number 25338, December.
    19. NAKATA Hiroyuki & SAWADA Yasuyuki & TANAKA Mari, 2010. "Asking Retrospective Questions in Household Surveys: Evidence from Vietnam," Discussion papers 10008, Research Institute of Economy, Trade and Industry (RIETI).
    20. Shaimaa Yassin & Francois Langot, 2017. "Correcting Measurement Errors in Transition Models Based on Retrospective Panel Data," IRENE Working Papers 17-04, IRENE Institute of Economic Research.
    21. George Judge & Laura Schechter, 2009. "Detecting Problems in Survey Data Using Benford’s Law," Journal of Human Resources, University of Wisconsin Press, vol. 44(1).
    22. Margaret Grosh & Paul Glewwe, 2000. "Designing Household Survey Questionnaires for Developing Countries : Lessons from 15 Years of the Living Standards Measurement Study, Volume 2," World Bank Publications - Books, The World Bank Group, number 15194, December.
    23. Ray Langsten & Rania Salen, 2008. "Two Approaches to Measuring Women's Work in Developing Countries: A Comparison of Survey Data from Egypt," Population and Development Review, The Population Council, Inc., vol. 34(2), pages 283-305, June.
    24. Rania Salem, 2015. "Changes in the Institution of Marriage in Egypt from 1998 to 2012," Working Papers 911, Economic Research Forum, revised May 2015.
    25. Ragui Assaad & Caroline Krafft, 2014. "The Economics of Marriage in North Africa," WIDER Working Paper Series wp-2014-067, World Institute for Development Economic Research (UNU-WIDER).
    26. Bell, Una Louise & Artola, Concha, 2001. "Identifying labour market dynamics using labour force survey data," ZEW Discussion Papers 01-44, ZEW - Leibniz Centre for European Economic Research.
    27. John Roberts & Devon Brewer, 2001. "Measures and tests of heaping in discrete quantitative distributions," Journal of Applied Statistics, Taylor & Francis Journals, vol. 28(7), pages 887-896.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Struffolino, Emanuela, 2019. "Navigating the early career: The social stratification of young workers’ employment trajectories in Italy," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 63, pages 1-17.
    2. Ragui Assaad & Caroline Krafft, 2023. "Labour market dynamics and youth unemployment in the Middle East and North Africa: Evidence from Egypt, Jordan, and Tunisia," LABOUR, CEIS, vol. 37(4), pages 519-553, December.
    3. Yassin, Shaimaa & Langot, François, 2018. "Informality, public employment and employment protection in developing countries," Journal of Comparative Economics, Elsevier, vol. 46(1), pages 326-348.
    4. Behr Andreas & Giese Marco & Teguim K Herve D. & Theune Katja, 2020. "Early Prediction of University Dropouts – A Random Forest Approach," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 240(6), pages 743-789, December.
    5. Caroline Krafft & Ragui Assaad, 2020. "Employment’s Role in Enabling and Constraining Marriage in the Middle East and North Africa," Demography, Springer;Population Association of America (PAA), vol. 57(6), pages 2297-2325, December.
    6. Fallah, Belal & Krafft, Caroline & Wahba, Jackline, 2019. "The impact of refugees on employment and wages in Jordan," Journal of Development Economics, Elsevier, vol. 139(C), pages 203-216.
    7. Ragui Assaad & Rana Hendy & Moundir Lassassi & Shaimaa Yassin, 2020. "Explaining the MENA paradox: Rising educational attainment yet stagnant female labor force participation," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 43(28), pages 817-850.
    8. Krafft Caroline & Assaad Ragui & Rahman Khandker Wahedur, 2021. "Introducing the Egypt Labor Market Panel Survey 2018," IZA Journal of Development and Migration, Sciendo & Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 12(1), pages 1-40, January.
    9. Rania Salem & Sarah Shah, 2016. "Correlates of Kin Marriage in Egypt, Jordan, and Tunisia," Working Papers 1067, Economic Research Forum, revised 12 Jan 2016.
    10. Ragui Assaad & Caroline Krafft & Colette Salemi, 2023. "Socioeconomic Status and the Changing Nature of School-to-Work Transitions in Egypt, Jordan, and Tunisia," ILR Review, Cornell University, ILR School, vol. 76(4), pages 697-723, August.
    11. Caroline Krafft, 2020. "Why is fertility on the rise in Egypt? The role of women’s employment opportunities," Journal of Population Economics, Springer;European Society for Population Economics, vol. 33(4), pages 1173-1218, October.
    12. Shaimaa Yassin, 2016. "Constructing Labor Market Transitions Recall Weights in Retrospective Data: An Application to Egypt and Jordan," Working Papers 1061, Economic Research Forum, revised 11 Jan 2016.
    13. Irene Selwaness & Caroline Krafft, 2021. "The Dynamics of Family Formation and Women’s Work: What Facilitates and Hinders Female Employment in the Middle East and North Africa?," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 40(3), pages 533-587, June.
    14. Alistair Munro, 2020. "Using experimental manipulation of questionnaire design and a Kenyan panel to test for the reliability of reported perceptions of climate change and adaptation," Climatic Change, Springer, vol. 162(3), pages 1081-1105, October.
    15. Ragui Assaad & Samir Ghazouani & Caroline Krafft & Dominique J. Rolando, 2016. "Introducing the Tunisia Labor Market Panel Survey 2014," IZA Journal of Labor & Development, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 5(1), pages 1-21, December.
    16. Ragui Assaad & Caroline Krafft & Shaimaa Yassin, 2018. "Comparing retrospective and panel data collection methods to assess labor market dynamics," IZA Journal of Migration and Development, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 8(1), pages 1-34, December.
    17. Krafft Caroline & Assaad Ragui, 2021. "Introducing the Jordan Labor Market Panel Survey 2016," IZA Journal of Development and Migration, Sciendo & Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 12(1), pages 1-42, January.
    18. Tyrowicz, Joanna & van der Velde, Lucas, 2018. "Labor reallocation and demographics," Journal of Comparative Economics, Elsevier, vol. 46(1), pages 381-412.
    19. Maia Sieverding & Caroline Krafft & Nasma Berri & Caitlyn Keo, 2019. "Persistence and Change in Marriage Practices Among Syrian Refugees in Jordan," Working Papers 1281, Economic Research Forum, revised 2019.
    20. Amare, Dagninet & Darr, Dietrich, 2023. "Can a sequential analysis provide a more robust understanding of farmers' adoption decisions? An example from an agroforestry adoption study in Ethiopia," Forest Policy and Economics, Elsevier, vol. 153(C).
    21. Shaimaa Yassin & Francois Langot, 2017. "Correcting Measurement Errors in Transition Models Based on Retrospective Panel Data," IRENE Working Papers 17-04, IRENE Institute of Economic Research.
    22. Ragui Assaad & Colette Salemi, 2018. "The Structure of Employment and Job Creation in Jordan: 2010-2016," Working Papers 1259, Economic Research Forum, revised 19 Nov 2018.
    23. Struffolino, Emanuela & Raitano, Michele, 2018. "Il divario generazionale nell’accesso al mercato del lavoro: differenziazione e destandardizzazione delle traiettorie d’ingresso," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, issue 3, pages 63-83.
    24. Temitayo A. Adeyemo & Victor O. Okoruwa, 2018. "Value Addition and Productivity Differentials in the Nigerian Cassava System," Sustainability, MDPI, vol. 10(12), pages 1-22, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Joachim De Weerdt & John Gibson & Kathleen Beegle, 2020. "What Can We Learn from Experimenting with Survey Methods?," Annual Review of Resource Economics, Annual Reviews, vol. 12(1), pages 431-447, October.
    2. de Nicola, Francesca & Giné, Xavier, 2014. "How accurate are recall data? Evidence from coastal India," Journal of Development Economics, Elsevier, vol. 106(C), pages 52-65.
    3. Friedman,Jed & Beegle,Kathleen G. & De Weerdt,Joachim & Gibson,John, 2016. "Decomposing response errors in food consumption measurement : implications for survey design from a survey experiment in Tanzania," Policy Research Working Paper Series 7646, The World Bank.
    4. Irene Selwaness & Caroline Krafft, 2021. "The Dynamics of Family Formation and Women’s Work: What Facilitates and Hinders Female Employment in the Middle East and North Africa?," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 40(3), pages 533-587, June.
    5. De Magalhães, Leandro & Santaeulàlia-Llopis, Raül, 2018. "The consumption, income, and wealth of the poorest: An empirical analysis of economic inequality in rural and urban Sub-Saharan Africa for macroeconomists," Journal of Development Economics, Elsevier, vol. 134(C), pages 350-371.
    6. Leandro De Magalhães & Dongya Koh & Raül Santaeulàlia-Llopis, 2016. "Consumption and Expenditure in Sub-Saharan Africa," Bristol Economics Discussion Papers 16/677, School of Economics, University of Bristol, UK, revised 07 Oct 2016.
    7. Leandro DE MAGALHÃES & Dongya KOH & Räul SANTAEULILA-LLOPIS, 2019. "The Cost of Consumption Smoothing: Less Schooling and less Nutrition," JODE - Journal of Demographic Economics, Cambridge University Press, vol. 85(3), pages 181-208, September.
    8. Wollburg, Philip & Tiberti, Marco & Zezza, Alberto, 2021. "Recall length and measurement error in agricultural surveys," Food Policy, Elsevier, vol. 100(C).
    9. Caroline Krafft & Ragui Assaad, 2020. "Employment’s Role in Enabling and Constraining Marriage in the Middle East and North Africa," Demography, Springer;Population Association of America (PAA), vol. 57(6), pages 2297-2325, December.
    10. Shaimaa Yassin, 2016. "Constructing Labor Market Transitions Recall Weights in Retrospective Data: An Application to Egypt and Jordan," IRENE Working Papers 16-07, IRENE Institute of Economic Research.
    11. Raül Santaeulàlia-Llopis & Yu Zheng, 2017. "Why Is Food Consumption Inequality Underestimated? A Story of Vices and Children," Working Papers 969, Barcelona School of Economics.
    12. Arthi, Vellore & Beegle, Kathleen & De Weerdt, Joachim & Palacios-López, Amparo, 2018. "Not your average job: Measuring farm labor in Tanzania," Journal of Development Economics, Elsevier, vol. 130(C), pages 160-172.
    13. Heath,Rachel & Mansuri,Ghazala & Rijkers,Bob & Seitz,William Hutchins & Sharma,Dhiraj, 2020. "Measuring Employment : Experimental Evidence from Urban Ghana," Policy Research Working Paper Series 9263, The World Bank.
    14. Ragui Assaad & Caroline Krafft, 2023. "Labour market dynamics and youth unemployment in the Middle East and North Africa: Evidence from Egypt, Jordan, and Tunisia," LABOUR, CEIS, vol. 37(4), pages 519-553, December.
    15. Ambler, Kate & Herskowitz, Sylvan & Maredia, Mywish K., 2021. "Are we done yet? Response fatigue and rural livelihoods," Journal of Development Economics, Elsevier, vol. 153(C).
    16. Shaimaa Yassin & Francois Langot, 2017. "Correcting Measurement Errors in Transition Models Based on Retrospective Panel Data," IRENE Working Papers 17-04, IRENE Institute of Economic Research.
    17. Godlonton, Susan & Hernandez, Manuel A. & Paz, Cynthia, 2021. "Can survey design reduce anchoring bias in recall data? Evidence from Malawi," IFPRI discussion papers 2055, International Food Policy Research Institute (IFPRI).
    18. Virginie Comblon & Anne-Sophie Robilliard, 2015. "Are female employment statistics more sensitive than male ones to questionnaire design? Evidence from Cameroon, Mali and Senegal," Working Papers DT/2015/22, DIAL (Développement, Institutions et Mondialisation).
    19. Barik, Debasis & Desai, Sonalde & Vanneman, Reeve, 2018. "Economic Status and Adult Mortality in India: Is the Relationship Sensitive to Choice of Indicators?," World Development, Elsevier, vol. 103(C), pages 176-187.
    20. Van Landeghem, Bert & Vandeplas, Anneleen, 2018. "The relationship between status and happiness: Evidence from the caste system in rural India," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 77(C), pages 62-71.

    More about this item

    Keywords

    panel data; retrospective data; survey data; measurement error; labor markets; Egypt;
    All these keywords.

    JEL classification:

    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • J01 - Labor and Demographic Economics - - General - - - Labor Economics: General
    • J62 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Job, Occupational and Intergenerational Mobility; Promotion
    • J64 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Unemployment: Models, Duration, Incidence, and Job Search

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp11052. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.