IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp4733.html
   My bibliography  Save this paper

Do Labor Statistics Depend on How and to Whom the Questions Are Asked? Results from a Survey Experiment in Tanzania

Author

Listed:
  • Bardasi, Elena

    (World Bank)

  • Beegle, Kathleen

    (World Bank)

  • Dillon, Andrew

    (Michigan State University)

  • Serneels, Pieter

    (University of East Anglia)

Abstract

Labor market statistics are critical for assessing and understanding economic development. In practice, widespread variation exists in how labor statistics are measured in household surveys in low-income countries. Little is known whether these differences have an effect on the labor statistics they produce. This paper analyzes these effects by implementing a survey experiment in Tanzania that varied two key dimensions: the level of detail of the questions and the type of respondent. Significant differences are observed across survey designs with respect to different labor statistics. Labor force participation rates, for example, vary by as much as 10 percentage points across the four survey assignments. Using a short labor module without screening questions on employment generates lower female labor force participation and lower rates of wage employment for both men and women. Response by proxy rather than self-report yields lower male labor force participation, lower female working hours, and lower employment in agriculture for men. The differences between proxy and self reporting seem to come from information imperfections within the household, especially with the distance in age between respondent and subject playing an important role, while gender and educational differences seem less important.

Suggested Citation

  • Bardasi, Elena & Beegle, Kathleen & Dillon, Andrew & Serneels, Pieter, 2010. "Do Labor Statistics Depend on How and to Whom the Questions Are Asked? Results from a Survey Experiment in Tanzania," IZA Discussion Papers 4733, Institute of Labor Economics (IZA).
  • Handle: RePEc:iza:izadps:dp4733
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp4733.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. de Mel, Suresh & McKenzie, David & Woodruff, Christopher, 2007. "Measuring microenterprise profits : don't ask how the sausage is made," Policy Research Working Paper Series 4229, The World Bank.
    2. Hyslop, Dean R & Imbens, Guido W, 2001. "Bias from Classical and Other Forms of Measurement Error," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 475-481, October.
    3. Margaret Grosh & Paul Glewwe, 2000. "Designing Household Survey Questionnaires for Developing Countries," World Bank Publications - Books, The World Bank Group, number 25338, December.
    4. Hausman, J. A. & Abrevaya, Jason & Scott-Morton, F. M., 1998. "Misclassification of the dependent variable in a discrete-response setting," Journal of Econometrics, Elsevier, vol. 87(2), pages 239-269, September.
    5. Jerry Hausman, 2001. "Mismeasured Variables in Econometric Analysis: Problems from the Right and Problems from the Left," Journal of Economic Perspectives, American Economic Association, vol. 15(4), pages 57-67, Fall.
    6. Bound, John & Brown, Charles & Mathiowetz, Nancy, 2001. "Measurement error in survey data," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 59, pages 3705-3843, Elsevier.
    7. Ucw, 2011. "Understanding the Brazilian success in reducing child labour: empirical evidence and policy lessons. Drawing policy lessons from the Brazilian experience," UCW Working Paper 55, Understanding Children's Work (UCW Programme).
    8. George Judge & Laura Schechter, 2009. "Detecting Problems in Survey Data Using Benford’s Law," Journal of Human Resources, University of Wisconsin Press, vol. 44(1).
    9. Abowd, John M & Zellner, Arnold, 1985. "Estimating Gross Labor-Force Flows," Journal of Business & Economic Statistics, American Statistical Association, vol. 3(3), pages 254-283, June.
    10. Mathiowetz, N.A. & Groves, R.M., 1985. "The effects of respondent rules on health survey reports," American Journal of Public Health, American Public Health Association, vol. 75(6), pages 639-644.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Olivia Bertelli, 2020. "Investing in Agriculture when it is worth it. Empirical evidence from rural Uganda," Working Papers hal-02446820, HAL.
    2. Oya, Carlos., 2010. "Rural inequality, wage employment and labour market formation in Africa : historical and micro-level evidence," ILO Working Papers 994582213402676, International Labour Organization.
    3. Bryceson, Deborah Fahy, 2019. "Gender and generational patterns of African deagrarianization: Evolving labour and land allocation in smallholder peasant household farming, 1980–2015," World Development, Elsevier, vol. 113(C), pages 60-72.
    4. Arthi, Vellore & Beegle, Kathleen & De Weerdt, Joachim & Palacios-López, Amparo, 2018. "Not your average job: Measuring farm labor in Tanzania," Journal of Development Economics, Elsevier, vol. 130(C), pages 160-172.
    5. Matteo Rizzo & Blandina Kilama & Marc Wuyts, 2015. "The Invisibility of Wage Employment in Statistics on the Informal Economy in Africa: Causes and Consequences," Journal of Development Studies, Taylor & Francis Journals, vol. 51(2), pages 149-161, February.
    6. Ugo Pica-Ciamarra & Derek Baker & Nancy Morgan & Alberto Zezza & Carlo Azzarri & Cheikh Ly & Longin Nsiima & Simplice Nouala & Patrick Okello & Joseph Sserugga, 2014. "Investing in the Livestock Sector : Why Good Numbers Matter, A Sourcebook for Decision Makers on How to Improve Livestock Data," World Bank Publications - Reports 17830, The World Bank Group.
    7. Dervisevic, Ervin & Goldstein, Markus, 2021. "He Said, She Said: The Impact of Gender and Marriage Perceptions on Self and Proxy Reporting of Labor," 2021 Conference, August 17-31, 2021, Virtual 315396, International Association of Agricultural Economists.
    8. Olivia Bertelli, 2019. "Investing in agriculture when it is worth it. Evidence from rural Uganda," Working Papers DT/2019/05, DIAL (Développement, Institutions et Mondialisation).
    9. Dammert, Ana C. & Galdo, Jose, 2013. "Child Labor Variation by Type of Respondent: Evidence from a Large-Scale Study," World Development, Elsevier, vol. 51(C), pages 207-220.
    10. Palacios-Lopez, Amparo & Christiaensen, Luc & Kilic, Talip, 2017. "How much of the labor in African agriculture is provided by women?," Food Policy, Elsevier, vol. 67(C), pages 52-63.
    11. Cheryl Doss, 2015. "Women and Agricultural Productivity: What Does the Evidence Tell Us?," Working Papers 1051, Economic Growth Center, Yale University.
    12. repec:ilo:ilowps:458221 is not listed on IDEAS
    13. Alwang, Jeffrey & Larochelle, Catherine & Barrera, Victor, 2017. "Farm Decision Making and Gender: Results from a Randomized Experiment in Ecuador," World Development, Elsevier, vol. 92(C), pages 117-129.
    14. Joachim Vandercasteelen & Mekdim Dereje & Bart Minten & Alemayehu Seyoum Taffesse, 2018. "Labour, profitability and gender impacts of adopting row planting in Ethiopia," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 45(4), pages 471-503.
    15. Vandercasteelen, Joachim & Dereje, Mekdim & Minten, Bart & Taffesse, Alemayehu Seyoum, 2016. "Row planting teff in Ethiopia: Impact on farm-level profitability and labor allocation," ESSP working papers 92, International Food Policy Research Institute (IFPRI).
    16. Burrone, Sara & Giannelli, Gianna Claudia, 2019. "Does Child Labor Lead to Vulnerable Employment in Adulthood? Evidence for Tanzania," IZA Discussion Papers 12162, Institute of Labor Economics (IZA).
    17. Virginie Comblon & Anne-Sophie Robilliard, 2015. "Are female employment statistics more sensitive than male ones to questionnaire design? Evidence from Cameroon, Mali and Senegal," Working Papers DT/2015/22, DIAL (Développement, Institutions et Mondialisation).
    18. Dillon, Andrew & Bardasi, Elena & Beegle, Kathleen & Serneels, Pieter, 2012. "Explaining variation in child labor statistics," Journal of Development Economics, Elsevier, vol. 98(1), pages 136-147.
    19. repec:mpr:mprres:7138 is not listed on IDEAS
    20. Duncan Chaplin & Arif Mamun & Thomas Fraker & Kathy Buek & Minki Chatterji & Denzel Hankinson, 2011. "Evaluation of Tanzania Energy Sector Project: Updated Design Report," Mathematica Policy Research Reports d946b658c7774742aeeec5d65, Mathematica Policy Research.
    21. Joachim Frick & Kristina Krell, 2011. "Einkommensmessungen in Haushaltspanelstudien für Deutschland: Ein Vergleich von EU-SILC und SOEP," AStA Wirtschafts- und Sozialstatistisches Archiv, Springer;Deutsche Statistische Gesellschaft - German Statistical Society, vol. 5(3), pages 221-248, December.
    22. Beegle, Kathleen & De Weerdt, Joachim & Friedman, Jed & Gibson, John, 2012. "Methods of household consumption measurement through surveys: Experimental results from Tanzania," Journal of Development Economics, Elsevier, vol. 98(1), pages 3-18.
    23. Fox, Louise & Pimhidzai, Obert, 2013. "Different dreams, same bed : collecting, using, and interpreting employment statistics in Sub-Saharan Africa -- the case of Uganda," Policy Research Working Paper Series 6436, The World Bank.
    24. Sabina Alkire & Emma Samman, 2014. "Mobilising the Household Data Required to Progress toward the SDGs," OPHI Working Papers 72, Queen Elizabeth House, University of Oxford.
    25. World Bank, 2012. "Uganda - Promoting Inclusive Growth : Transforming Farms, Human Capital, and Economic Geography, Synthesis Report," World Bank Publications - Reports 12655, The World Bank Group.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Serneels, Pieter & Beegle, Kathleen & Dillon, Andrew, 2017. "Do returns to education depend on how and whom you ask?," Economics of Education Review, Elsevier, vol. 60(C), pages 5-19.
    2. Adele Bergin, 2013. "Job Changes and Wage Changes: Estimation with Measurement Error in a Binary Variable," Economics Department Working Paper Series n240-13.pdf, Department of Economics, National University of Ireland - Maynooth.
    3. Dammert, Ana C. & Galdo, Jose, 2013. "Child Labor Variation by Type of Respondent: Evidence from a Large-Scale Study," World Development, Elsevier, vol. 51(C), pages 207-220.
    4. Ragui Assaad & Caroline Krafft & Shaimaa Yassin, 2018. "Comparing retrospective and panel data collection methods to assess labor market dynamics," IZA Journal of Migration and Development, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 8(1), pages 1-34, December.
    5. Susanne M. Schennach, 2012. "Measurement error in nonlinear models - a review," CeMMAP working papers 41/12, Institute for Fiscal Studies.
    6. Hoderlein, Stefan & Winter, Joachim, 2010. "Structural measurement errors in nonseparable models," Journal of Econometrics, Elsevier, vol. 157(2), pages 432-440, August.
    7. Andrea Bastianin & Paolo Castelnovo & Massimo Florio, 2017. "The Empirics of Regulatory Reforms Proxied by Categorical Variables: Recent Findings and Methodological Issues," Working Papers 2017.22, Fondazione Eni Enrico Mattei.
    8. Beegle, Kathleen & Carletto, Calogero & Himelein, Kristen, 2012. "Reliability of recall in agricultural data," Journal of Development Economics, Elsevier, vol. 98(1), pages 34-41.
    9. Kibrom A. Abay & Leah E. M. Bevis & Christopher B. Barrett, 2021. "Measurement Error Mechanisms Matter: Agricultural Intensification with Farmer Misperceptions and Misreporting," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(2), pages 498-522, March.
    10. Yingyao Hu & Zhongjian Lin, 2018. "Misclassification and the hidden silent rivalry," CeMMAP working papers CWP12/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    11. Bastianin, Andrea & Castelnovo, Paolo & Florio, Massimo, 2018. "Evaluating regulatory reform of network industries: a survey of empirical models based on categorical proxies," Utilities Policy, Elsevier, vol. 55(C), pages 115-128.
    12. Carletto,Calogero & Dillon,Andrew S. & Zezza,Alberto, 2021. "Agricultural Data Collection to Minimize Measurement Error and Maximize Coverage," Policy Research Working Paper Series 9745, The World Bank.
    13. Jerry Hausman & Haoyang Liu & Ye Luo & Christopher Palmer, 2021. "Errors in the Dependent Variable of Quantile Regression Models," Econometrica, Econometric Society, vol. 89(2), pages 849-873, March.
    14. Adele Bergin, 2015. "Employer Changes and Wage Changes: Estimation with Measurement Error in a Binary Variable," LABOUR, CEIS, vol. 29(2), pages 194-223, June.
    15. Yokoo, Hide-Fumi & Arimura, Toshi H. & Chattopadhyay, Mriduchhanda & Katayama, Hajime, 2023. "Subjective risk belief function in the field: Evidence from cooking fuel choices and health in India," Journal of Development Economics, Elsevier, vol. 161(C).
    16. Philip Jung & Moritz Kuhn, 2019. "Earnings Losses and Labor Mobility Over the Life Cycle," Journal of the European Economic Association, European Economic Association, vol. 17(3), pages 678-724.
    17. Blattman, Christopher & Jamison, Julian & Koroknay-Palicz, Tricia & Rodrigues, Katherine & Sheridan, Margaret, 2016. "Measuring the measurement error: A method to qualitatively validate survey data," Journal of Development Economics, Elsevier, vol. 120(C), pages 99-112.
    18. Giovanni Compiani & Yuichi Kitamura, 2016. "Using mixtures in econometric models: a brief review and some new results," Econometrics Journal, Royal Economic Society, vol. 19(3), pages 95-127, October.
    19. Bellemare, Charles, 2007. "A life-cycle model of outmigration and economic assimilation of immigrants in Germany," European Economic Review, Elsevier, vol. 51(3), pages 553-576, April.
    20. Sun, Jiandong & Feng, Shuaizhang & Hu, Yingyao, 2021. "Misclassification errors in labor force statuses and the early identification of economic recessions," Journal of Asian Economics, Elsevier, vol. 75(C).

    More about this item

    Keywords

    Tanzania; survey design; labor statistics; field experiment;
    All these keywords.

    JEL classification:

    • J21 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Labor Force and Employment, Size, and Structure
    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp4733. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.