IDEAS home Printed from https://ideas.repec.org/a/eee/wdevel/v161y2023ics0305750x22002662.html
   My bibliography  Save this article

Using machine learning and qualitative interviews to design a five-question survey module for women’s agency

Author

Listed:
  • Jayachandran, Seema
  • Biradavolu, Monica
  • Cooper, Jan

Abstract

Open-ended interview questions elicit rich information about people’s lives, but in large-scale surveys, social scientists often need to measure complex concepts using only a few close-ended questions. We propose a new method to design a short survey measure for such cases by combining mixed-methods data collection and machine learning. We identify the best survey questions based on how well they predict a benchmark measure of the concept derived from qualitative interviews. We apply the method to create a survey module and index for women’s agency. We measure agency for 209 married women in Haryana, India, first, through a semi-structured interview and, second, through a large set of close-ended questions. We use qualitative coding methods to score each woman’s agency based on the interview, which we use as a benchmark measure of agency. To determine the close-ended questions most predictive of the benchmark, we apply statistical algorithms that build on LASSO and random forest but constrain how many variables are selected for the model (five in our case). The resulting five-question index is as strongly correlated with the coded qualitative interview as is an index that uses all of the candidate questions. This approach of selecting survey questions based on their statistical correspondence to coded qualitative interviews could be used to design short survey modules for many other latent constructs.

Suggested Citation

  • Jayachandran, Seema & Biradavolu, Monica & Cooper, Jan, 2023. "Using machine learning and qualitative interviews to design a five-question survey module for women’s agency," World Development, Elsevier, vol. 161(C).
  • Handle: RePEc:eee:wdevel:v:161:y:2023:i:c:s0305750x22002662
    DOI: 10.1016/j.worlddev.2022.106076
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305750X22002662
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.worlddev.2022.106076?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Shaffer, Paul, 2013. "Ten Years of “Q-Squared”: Implications for Understanding and Explaining Poverty," World Development, Elsevier, vol. 45(C), pages 269-285.
    2. Malapit, Hazel & Quisumbing, Agnes & Meinzen-Dick, Ruth & Seymour, Greg & Martinez, Elena M. & Heckert, Jessica & Rubin, Deborah & Vaz, Ana & Yount, Kathryn M., 2019. "Development of the project-level Women’s Empowerment in Agriculture Index (pro-WEAI)," World Development, Elsevier, vol. 122(C), pages 675-692.
    3. Martha NUSSBAUM, 1999. "Women and equality: The capabilities approach," International Labour Review, International Labour Organization, vol. 138(3), pages 227-245, September.
    4. Deborah Naybor & Jessie P. H. Poon & Irene Casas, 2016. "Mobility Disadvantage and Livelihood Opportunities of Marginalized Widowed Women in Rural Uganda," Annals of the American Association of Geographers, Taylor & Francis Journals, vol. 106(2), pages 404-412, March.
    5. Rossalina Latcheva, 2011. "Cognitive interviewing and factor-analytic techniques: a mixed method approach to validity of survey items measuring national identity," Quality & Quantity: International Journal of Methodology, Springer, vol. 45(6), pages 1175-1199, October.
    6. Chambers, Robert, 1994. "Participatory rural appraisal (PRA): Analysis of experience," World Development, Elsevier, vol. 22(9), pages 1253-1268, September.
    7. Linden McBride & Austin Nichols, 2018. "Retooling Poverty Targeting Using Out-of-Sample Validation and Machine Learning," The World Bank Economic Review, World Bank, vol. 32(3), pages 531-550.
    8. Nicolai Meinshausen & Peter Bühlmann, 2010. "Stability selection," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(4), pages 417-473, September.
    9. Seema Jayachandran, 2015. "The Roots of Gender Inequality in Developing Countries," Annual Review of Economics, Annual Reviews, vol. 7(1), pages 63-88, August.
    10. Laura Camfield & Gina Crivello & Martin Woodhead, 2009. "Wellbeing Research in Developing Countries: Reviewing the Role of Qualitative Methods," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 90(1), pages 5-31, January.
    11. Chambers, Robert, 1994. "Participatory rural appraisal (PRA): Challenges, potentials and paradigm," World Development, Elsevier, vol. 22(10), pages 1437-1454, October.
    12. Ana Vaz & Pierre Pratley & Sabina Alkire, 2016. "Measuring Women's Autonomy in Chad Using the Relative Autonomy Index," Feminist Economics, Taylor & Francis Journals, vol. 22(1), pages 264-294, January.
    13. Abigail Barr & Marlene Dekker & Floyd Mwansa & Tia Linda Zuze, 2020. "Financial decision-making, gender and social norms in Zambia: Preliminary report on the quantitative data generation, analysis and results," Discussion Papers 2020-06, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    14. Lupin Rahman & Vijayendra Rao, 2004. "The Determinants of Gender Equity in India: Examining Dyson and Moore's Thesis with New Data," Population and Development Review, The Population Council, Inc., vol. 30(2), pages 239-268, June.
    15. Maiorano, Diego & Shrimankar, Dishil & Thapar-Björkert, Suruchi & Blomkvist, Hans, 2021. "Measuring empowerment: Choices, values and norms," World Development, Elsevier, vol. 138(C).
    16. Naila Kabeer, 1999. "Resources, Agency, Achievements: Reflections on the Measurement of Women's Empowerment," Development and Change, International Institute of Social Studies, vol. 30(3), pages 435-464, July.
    17. Almås, Ingvild & Berge, Lars Ivar & Bjorvatn, Kjetil & Somville, Vincent & Tungodden, Bertil, 2020. "Adverse selection into competition: Evidence from a large-scale field experiment in Tanzania," Discussion Paper Series in Economics 19/2020, Norwegian School of Economics, Department of Economics.
    18. Robin Richardson & Norbert Schmitz & Sam Harper & Arijit Nandi, 2019. "Development of a Tool to Measure Women’s Agency in India," Journal of Human Development and Capabilities, Taylor & Francis Journals, vol. 20(1), pages 26-53, January.
    19. Peterman, Amber & Schwab, Benjamin & Roy, Shalini & Hidrobo, Melissa & Gilligan, Daniel O., 2021. "Measuring women’s decisionmaking: Indicator choice and survey design experiments from cash and food transfer evaluations in Ecuador, Uganda and Yemen," World Development, Elsevier, vol. 141(C).
    20. Malapit, Hazel J. & Quisumbing, Agnes R. & Meinzen-Dick, Ruth Suseela & Seymour, Gregory & Martinez, Elena M. & Heckert, Jessica & Rubin, Deborah & Vaz, Ana & Yount, Kathryn M., 2019. "Development of the project-level Women’s Empowerment in Agriculture Index (pro-WEAI)," IFPRI discussion papers 1796, International Food Policy Research Institute (IFPRI).
    21. Chambers, Robert, 1994. "The origins and practice of participatory rural appraisal," World Development, Elsevier, vol. 22(7), pages 953-969, July.
    22. Alasdair Cohen & Michaela Saisana, 2014. "Quantifying the Qualitative: Eliciting Expert Input to Develop the Multidimensional Poverty Assessment Tool," Journal of Development Studies, Taylor & Francis Journals, vol. 50(1), pages 35-50, January.
    23. Knippenberg, Erwin & Jensen, Nathaniel & Constas, Mark, 2019. "Quantifying household resilience with high frequency data: Temporal dynamics and methodological options," World Development, Elsevier, vol. 121(C), pages 1-15.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Maria Perrotta Berlin & Evelina Bonnier & Anders Olofsgård, 2024. "Foreign Aid and Female Empowerment," Journal of Development Studies, Taylor & Francis Journals, vol. 60(5), pages 662-684, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jayachandran, Seema & Biradavolu, Monica & Cooper, Jan, 2021. "Using Machine Learning and Qualitative Interviews to Design a Five-Question Women's Agency Index," IZA Discussion Papers 14221, Institute of Labor Economics (IZA).
    2. Alastair Orr & Takuji Tsusaka & Sabine Homann Kee‐Tui & Harry Msere, 2016. "What Do We Mean by ‘Women's Crops'? Commercialisation, Gender and the Power to Name," Journal of International Development, John Wiley & Sons, Ltd., vol. 28(6), pages 919-937, August.
    3. Jinnat Ara & Dipanwita Sarkar, 2021. "Customized Credit Transfer and Women Empowerment: Evidence from Randomized Controlled Trials in Bangladesh," QuBE Working Papers 062, QUT Business School.
    4. Laszlo, Sonia & Grantham, Kate & Oskay, Ecem & Zhang, Tingting, 2020. "Grappling with the challenges of measuring women's economic empowerment in intrahousehold settings," World Development, Elsevier, vol. 132(C).
    5. Ross, Heather M. & Pine, Kathleen H. & Curran, Sarah & Augusta, Dawn, 2022. "Pathway mapping as a tool to address police use of force in behavioral health crisis," Social Science & Medicine, Elsevier, vol. 306(C).
    6. Chilombo, Andrew & Van Der Horst, Dan, 2021. "Livelihoods and coping strategies of local communities on previous customary land in limbo of commercial agricultural development: Lessons from the farm block program in Zambia," Land Use Policy, Elsevier, vol. 104(C).
    7. Thompson, John, 1995. "Participatory approaches in government bureaucracies: Facilitating the process of institutional change," World Development, Elsevier, vol. 23(9), pages 1521-1554, September.
    8. Shane Cronin & Mike Petterson & Paul Taylor & Randall Biliki, 2004. "Maximising Multi-Stakeholder Participation in Government and Community Volcanic Hazard Management Programs; A Case Study from Savo, Solomon Islands," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 33(1), pages 105-136, September.
    9. Glyn Williams & Manoj Srivastava & Stuart Corbridge & René Véron, 2003. "Enhancing pro-poor governance in Eastern India: participation, politics and action research," Progress in Development Studies, , vol. 3(2), pages 159-178, April.
    10. Palash Kamruzzaman, 2020. "Exploring the Nexus Between Participation and Empowerment," Journal of Development Policy and Practice, , vol. 5(1), pages 32-53, January.
    11. Michael J.G. Parnwell, 2003. "Consulting the poor in Thailand: enlightenment or delusion?," Progress in Development Studies, , vol. 3(2), pages 99-112, April.
    12. Jinnat Ara & Dipanwita Sarkar & Jayanta Sarkar, 2021. "Like mother like daughter? Occupational mobility among children under asset transfer program in Bangladesh," QuBE Working Papers 061, QUT Business School.
    13. Namatama, Nathan, 2020. "An assessment of stakeholders’ participation in land use planning process of Luapula Province Planning Authority," Land Use Policy, Elsevier, vol. 97(C).
    14. Saha, Shree & Narayanan, Sudha, 2022. "A simplified measure of nutritional empowerment: Using machine learning to abbreviate the Women’s Empowerment in Nutrition Index (WENI)," World Development, Elsevier, vol. 154(C).
    15. Thomas, David H. L. & Adams, William M., 1999. "Adapting to Dams: Agrarian Change Downstream of the Tiga Dam, Northern Nigeria," World Development, Elsevier, vol. 27(6), pages 919-935, June.
    16. Bond, Richard & Hulme, David, 1999. "Process Approaches to Development: Theory and Sri Lankan Practice," World Development, Elsevier, vol. 27(8), pages 1339-1358, August.
    17. Jennifer Sowerwine & Megan Mucioki & Daniel Sarna-Wojcicki & Lisa Hillman, 2019. "Reframing food security by and for Native American communities: a case study among tribes in the Klamath River basin of Oregon and California," Food Security: The Science, Sociology and Economics of Food Production and Access to Food, Springer;The International Society for Plant Pathology, vol. 11(3), pages 579-607, June.
    18. Barrett, T. & Feola, G. & Krylova, V. & Khusnitdinova, M., 2017. "The application of Rapid Appraisal of Agricultural Innovation Systems (RAAIS) to agricultural adaptation to climate change in Kazakhstan: A critical evaluation," Agricultural Systems, Elsevier, vol. 151(C), pages 106-113.
    19. García-Ponce, E. & Gómez-Macpherson, H. & Diallo, O. & Djibril, M. & Baba, C. & Porcel, O. & Mathieu, B. & Comas, J. & Mateos, L. & Connor, D.J., 2013. "Contribution of sorghum to productivity of small-holder irrigation schemes: On-farm research in the Senegal River Valley, Mauritania," Agricultural Systems, Elsevier, vol. 115(C), pages 72-82.
    20. Dipanwita De & Chandan Surabhi Das, 2021. "Measuring Livelihood Sustainability by PCA in Indian Sundarban," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 23(12), pages 18424-18442, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:wdevel:v:161:y:2023:i:c:s0305750x22002662. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/worlddev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.