IDEAS home Printed from https://ideas.repec.org/a/bla/rdevec/v28y2024i4p1947-1970.html

The case for mixed methods research: Embracing qualitative research to understand the (informal) economy

Author

Listed:
  • Edward Cartwright
  • Eghosa Igudia

Abstract

Economics has long shunned qualitative research methods, such as interviews, focus groups and observational studies, in preference for quantitative methods, such as empirical analysis of secondary data and field experiments. Moreover, recent years, with advances in econometric theory, have seen a notable increase in the size and quality of data sets that are needed to publish quantitative research in leading journals. This has the effect of significantly increasing the ‘entry costs’ for researchers interested in studying economic development. Crucially, it also limits the topics that can be studied. In particular, it focuses attention on issues and countries where large data sets exist or can be collected. In this paper, we argue that by putting too much weight on internal validity, economics has adopted a too narrow definition of ‘rigour’ and would benefit from embracing qualitative and mixed methods research. To illustrate our point, we pay particular attention to the informal economy. The informal economy is understudied by economists because of the lack of available quantitative data. We show that this fundamentally impacts our understanding of the wider economy. Qualitative research can enrich our understanding by providing a more complete and nuanced view of the economy.

Suggested Citation

  • Edward Cartwright & Eghosa Igudia, 2024. "The case for mixed methods research: Embracing qualitative research to understand the (informal) economy," Review of Development Economics, Wiley Blackwell, vol. 28(4), pages 1947-1970, November.
  • Handle: RePEc:bla:rdevec:v:28:y:2024:i:4:p:1947-1970
    DOI: 10.1111/rode.13069
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/rode.13069
    Download Restriction: no

    File URL: https://libkey.io/10.1111/rode.13069?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Zizzamia, Rocco, 2020. "Is employment a panacea for poverty? A mixed-methods investigation of employment decisions in South Africa," World Development, Elsevier, vol. 130(C).
    2. repec:oup:qjecon:v:129:y:2014:i:2:p:697-752. is not listed on IDEAS
    3. Norman V. Loayza, 2016. "Informality in the Process of Development and Growth," The World Economy, Wiley Blackwell, vol. 39(12), pages 1856-1916, December.
    4. Muhammad Shehryar Shahid & Peter Rodgers & Colin C. Williams, 2017. "Evaluating the participation of an ethnic minority group in informal employment: a product of exit or exclusion?," Review of Social Economy, Taylor & Francis Journals, vol. 75(4), pages 468-488, October.
    5. Baird, Sarah & Özler, Berk, 2012. "Examining the reliability of self-reported data on school participation," Journal of Development Economics, Elsevier, vol. 98(1), pages 89-93.
    6. Peters, Jörg & Langbein, Jörg & Roberts, Gareth, 2016. "Policy evaluation, randomized controlled trials, and external validity—A systematic review," Economics Letters, Elsevier, vol. 147(C), pages 51-54.
    7. Deaton, Angus & Cartwright, Nancy, 2018. "Understanding and misunderstanding randomized controlled trials," Social Science & Medicine, Elsevier, vol. 210(C), pages 2-21.
    8. Shidratul Moontaha Suha & Dorottya Sik, 2021. "Social Disorganization and Lack of Recognition Increase Stress Among the Street Children of Dhaka," Asian Social Science, Canadian Center of Science and Education, vol. 17(7), pages 1-39, July.
    9. Mr. Friedrich Schneider & Dominik Enste, 2002. "Hiding in the Shadows: The Growth of the Underground Economy," IMF Economic Issues 2002/001, International Monetary Fund.
    10. Jennifer Olmsted, 1997. "Telling Palestinian Women's Economic Stories," Feminist Economics, Taylor & Francis Journals, vol. 3(2), pages 141-151.
    11. Alexander Lenger, 2019. "The Rejection of Qualitative Research Methods in Economics," Journal of Economic Issues, Taylor & Francis Journals, vol. 53(4), pages 946-965, October.
    12. Marchionatti, Roberto, 2012. "The economists and the primitive societies," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 41(5), pages 529-540.
    13. Michal Bauer & Julie Chytilová, 2013. "Women, Children and Patience: Experimental Evidence from Indian Villages," Review of Development Economics, Wiley Blackwell, vol. 17(4), pages 662-675, November.
    14. Ceren Ozgen, 2021. "The economics of diversity: Innovation, productivity and the labour market," Journal of Economic Surveys, Wiley Blackwell, vol. 35(4), pages 1168-1216, September.
    15. Rao, Vijayendra, 1997. "Wife-beating in rural South India: A qualitative and econometric analysis," Social Science & Medicine, Elsevier, vol. 44(8), pages 1169-1180, April.
    16. Glenn W. Harrison, 2013. "Field experiments and methodological intolerance," Journal of Economic Methodology, Taylor & Francis Journals, vol. 20(2), pages 103-117, June.
    17. Christopher Blattman & Nathan Fiala & Sebastian Martinez, 2014. "Generating Skilled Self-Employment in Developing Countries: Experimental Evidence from Uganda," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(2), pages 697-752.
    18. Rao, Vijayendra & Ananthpur, Kripa & Malik, Kabir, 2017. "The Anatomy of Failure: An Ethnography of a Randomized Trial to Deepen Democracy in Rural India," World Development, Elsevier, vol. 99(C), pages 481-497.
    19. Eghosa Igudia & Rob Ackrill & Simeon Coleman & Carlyn Dobson, 2016. "Determinants of the informal economy of an emerging economy: a multiple indicator, multiple causes approach," International Journal of Entrepreneurship and Small Business, Inderscience Enterprises Ltd, vol. 28(2/3), pages 154-177.
    20. Christopher Blattman & Nathan Fiala & Sebastian Martinez, 2020. "The Long-Term Impacts of Grants on Poverty: Nine-Year Evidence from Uganda's Youth Opportunities Program," American Economic Review: Insights, American Economic Association, vol. 2(3), pages 287-304, September.
    21. Roberto Dell'Anno & Ferda Halicioglu, 2010. "An ARDL model of unrecorded and recorded economies in Turkey," Journal of Economic Studies, Emerald Group Publishing Limited, vol. 37(6), pages 627-646, November.
    22. Morvant-Roux, Solène & Guérin, Isabelle & Roesch, Marc & Moisseron, Jean-Yves, 2014. "Adding Value to Randomization with Qualitative Analysis: The Case of Microcredit in Rural Morocco," World Development, Elsevier, vol. 56(C), pages 302-312.
    23. Roberto Dell'Anno & Ferda Halicioglu, 2010. "An ARDL model of unrecorded and recorded economies in Turkey," Journal of Economic Studies, Emerald Group Publishing Limited, vol. 37(6), pages 627-646, November.
    24. Ligia MUNTEAN JEMNA, 2016. "Qualitative And Mixed Research Methods In Economics: The Added Value When Using Qualitative Research Methods," Journal of Public Administration, Finance and Law, Alexandru Ioan Cuza University, Faculty of Economics and Business Administration, vol. 9(9), pages 154-167, June.
    25. Lionel Page & Charles N. Noussair & Robert Slonim, 2021. "The replication crisis, the rise of new research practices and what it means for experimental economics," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 7(2), pages 210-225, December.
    26. Dominik Enste & Friedrich Schneider, 2002. "Hiding in the Shadows; The Growth of the Underground Economy," IMF Economic Issues 30, International Monetary Fund.
    27. Christine Valente, 2011. "Household Returns to Land Transfers in South Africa: A Q-squared Analysis," Journal of Development Studies, Taylor & Francis Journals, vol. 47(2), pages 354-376.
    28. Michael Bamberger, 2000. "Integrating Quantitative and Qualitative Research in Development Projects," World Bank Publications - Books, The World Bank Group, number 15253, October.
    29. Roberto Dell'Anno & Omobola Adu, 2020. "The size of the informal economy in Nigeria: a structural equation approach," International Journal of Social Economics, Emerald Group Publishing Limited, vol. 47(8), pages 1063-1078, July.
    30. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    31. Peter Davis & Bob Baulch, 2011. "Parallel Realities: Exploring Poverty Dynamics Using Mixed Methods in Rural Bangladesh," Journal of Development Studies, Taylor & Francis Journals, vol. 47(1), pages 118-142.
    32. Jishnu Das & Jeffrey Hammer & Kenneth Leonard, 2008. "The Quality of Medical Advice in Low-Income Countries," Journal of Economic Perspectives, American Economic Association, vol. 22(2), pages 93-114, Spring.
    33. Das, Jishnu & Hammer, Jeffrey, 2005. "Which doctor? Combining vignettes and item response to measure clinical competence," Journal of Development Economics, Elsevier, vol. 78(2), pages 348-383, December.
    34. Jindrich Matousek & Tomas Havranek & Zuzana Irsova, 2022. "Individual discount rates: a meta-analysis of experimental evidence," Experimental Economics, Springer;Economic Science Association, vol. 25(1), pages 318-358, February.
    35. Gisele Ferreira-Tiryaki, 2008. "The Informal Economy and Business Cycles," Journal of Applied Economics, Taylor & Francis Journals, vol. 11(1), pages 91-117, May.
    36. Michelle Adato & Michael Carter & Julian May, 2006. "Exploring poverty traps and social exclusion in South Africa using qualitative and quantitative data," Journal of Development Studies, Taylor & Francis Journals, vol. 42(2), pages 226-247.
    37. Markoff, John & Montecinos, Verónica, 1993. "The Ubiquitous Rise of Economists," Journal of Public Policy, Cambridge University Press, vol. 13(1), pages 37-68, January.
    38. Brian E. Roe & David R. Just, 2009. "Internal and External Validity in Economics Research: Tradeoffs between Experiments, Field Experiments, Natural Experiments, and Field Data," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 91(5), pages 1266-1271.
    39. David Brownstone & Robert Valletta, 2001. "The Bootstrap and Multiple Imputations: Harnessing Increased Computing Power for Improved Statistical Tests," Journal of Economic Perspectives, American Economic Association, vol. 15(4), pages 129-141, Fall.
    40. Nicole Paganini & Kustiwa Adinata & Nomonde Buthelezi & David Harris & Stefanie Lemke & Alberto Luis & Jennifer Koppelin & Abdulrazak Karriem & Fezile Ncube & Enzo Nervi Aguirre & Tandu Ramba & Inês R, 2020. "Growing and Eating Food during the COVID-19 Pandemic: Farmers’ Perspectives on Local Food System Resilience to Shocks in Southern Africa and Indonesia," Sustainability, MDPI, vol. 12(20), pages 1-26, October.
    41. Leandro Medina & Mr. Friedrich Schneider, 2018. "Shadow Economies Around the World: What Did We Learn Over the Last 20 Years?," IMF Working Papers 2018/017, International Monetary Fund.
    42. Sandra Sookram & Patrick Kent Watson, 2008. "Small-Business Participation in the Informal Sector of an Emerging Economy," Journal of Development Studies, Taylor & Francis Journals, vol. 44(10), pages 1531-1553.
    43. Eghosa O Igudia, 2020. "Exploring the theories, determinants and policy options of street vending: A demand-side approach," Urban Studies, Urban Studies Journal Limited, vol. 57(1), pages 56-74, January.
    44. Luigino Bruni & Robert Sugden, 2007. "The road not taken: how psychology was removed from economics, and how it might be brought back," Economic Journal, Royal Economic Society, vol. 117(516), pages 146-173, January.
    45. Kate Bird & Kate Higgins & Andy McKay, 2010. "Conflict, education and the intergenerational transmission of poverty in Northern Uganda," Journal of International Development, John Wiley & Sons, Ltd., vol. 22(8), pages 1183-1196, November.
    46. Abel Brodeur & Nikolai Cook & Anthony Heyes, 2020. "Methods Matter: p-Hacking and Publication Bias in Causal Analysis in Economics," American Economic Review, American Economic Association, vol. 110(11), pages 3634-3660, November.
    47. Alberto Abadie, 2020. "Statistical Nonsignificance in Empirical Economics," American Economic Review: Insights, American Economic Association, vol. 2(2), pages 193-208, June.
    48. Colin C. Williams & Jan Windebank, 2002. "The Uneven Geographies of Informal Economic Activities: a Case Study of Two British Cities," Work, Employment & Society, British Sociological Association, vol. 16(2), pages 231-250, June.
    49. Robert Jensen, 2007. "The Digital Provide: Information (Technology), Market Performance, and Welfare in the South Indian Fisheries Sector," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(3), pages 879-924.
    50. repec:osf:osfxxx:8abyu_v1 is not listed on IDEAS
    51. Bewley, Truman F, 1995. "A Depressed Labor Market as Explained by Participants," American Economic Review, American Economic Association, vol. 85(2), pages 250-254, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jörg Peters & Jörg Langbein & Gareth Roberts, 2018. "Generalization in the Tropics – Development Policy, Randomized Controlled Trials, and External Validity," The World Bank Research Observer, World Bank, vol. 33(1), pages 34-64.
    2. Colin C. Williams, 2023. "A Modern Guide to the Informal Economy," Books, Edward Elgar Publishing, number 18668.
    3. Massomeh Hajilee & Farhang Niroomand & Linda A. Hayes, 2023. "The relationship between interest rate volatility and the shadow economy in OECD countries: An asymmetric analysis," Australian Economic Papers, Wiley Blackwell, vol. 62(3), pages 539-566, September.
    4. Alexander L. Brown & Taisuke Imai & Ferdinand M. Vieider & Colin F. Camerer, 2024. "Meta-analysis of Empirical Estimates of Loss Aversion," Journal of Economic Literature, American Economic Association, vol. 62(2), pages 485-516, June.
    5. Monica Violeta Achim & Sorin Nicolae Borlea & Lucian Vasile Găban & Alin Adrian Mihăilă, 2019. "The Shadow Economy and Culture: Evidence in European Countries," Eastern European Economics, Taylor & Francis Journals, vol. 57(5), pages 352-374, September.
    6. Pasovic Edin & Efendic Adnan S., 2018. "Informal Economy in Bosnia and Herzegovina – An Empirical Investigation," South East European Journal of Economics and Business, Paradigm, vol. 13(2), pages 112-125, December.
    7. Martha A. Starr, 2014. "Qualitative And Mixed-Methods Research In Economics: Surprising Growth, Promising Future," Journal of Economic Surveys, Wiley Blackwell, vol. 28(2), pages 238-264, April.
    8. Gaetano Lisi, 2021. "Can the AD-AS Model Explain the Presence and Persistence of the Underground Economy? Evidence from Italy," Economies, MDPI, vol. 9(4), pages 1-11, November.
    9. Jakhongir Kakhkharov & Nicholas Rohde, 2023. "Remittance flows and informal economies in post‐Soviet transition countries," The World Economy, Wiley Blackwell, vol. 46(10), pages 3057-3080, October.
    10. Sintayehu Tulu Wondimu & Mathewos Woldemariam Birru, 2020. "Determinants Of Informal Economy Estimation In Ethiopia: Multiple-Indicators, Multiple-Causes (Mimic) Approach," Copernican Journal of Finance & Accounting, Uniwersytet Mikolaja Kopernika, vol. 9(2), pages 65-86.
    11. Erumban, Abdul A., 2024. "Informality and aggregate labor productivity growth: Does ICT moderate the relationship?," Telecommunications Policy, Elsevier, vol. 48(1).
    12. Shaffer, Paul, 2013. "Ten Years of “Q-Squared”: Implications for Understanding and Explaining Poverty," World Development, Elsevier, vol. 45(C), pages 269-285.
    13. Shamaila Butt & Faisal FAISAL & Muhammad Ali Chohan & Adnan Ali & Suresh Ramakrishnan, 2024. "Do Shadow Economy and Institutions Lessen the Environmental Pollution? Evidence from Panel of ASEAN-9 Economies," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 15(1), pages 4800-4828, March.
    14. Tran, My Thi Ha, 2021. "Public Sector Management And Corruption In Asean Plus Six," OSF Preprints stxw4, Center for Open Science.
    15. Ajide, Kazeem Bello & Ridwan, Lanre Ibrahim, 2023. "Does natural resource wealth hinder or promote activity of the shadow markets in africa?," Resources Policy, Elsevier, vol. 85(PA).
    16. repec:osf:osfxxx:stxw4_v1 is not listed on IDEAS
    17. Luca Baldo & Elisa Bonifacio & Marco Brandi & Michelina Lo Russo & Gianluca Maddaloni & Andrea Nobili & Giorgia Rocco & Gabriele Sene & Massimo Valentini, 2021. "Inside the black box: tools for understanding cash circulation," Mercati, infrastrutture, sistemi di pagamento (Markets, Infrastructures, Payment Systems) 7, Bank of Italy, Directorate General for Markets and Payment System.
    18. Francesco GUALA, 2017. "Preferences: Neither Behavioural nor Mental," Departmental Working Papers 2017-05, Department of Economics, Management and Quantitative Methods at Università degli Studi di Milano.
    19. Ndoya, Hermann & Okere, Donald & Belomo, Marie laure & Atangana, Melissa, 2023. "Does ICTs decrease the spread of informal economy in Africa?," Telecommunications Policy, Elsevier, vol. 47(2).
    20. Ligita Gasparėnienė & Rita Remeikienė & Colin C. Williams, 2022. "Unemployment and the Informal Economy," SpringerBriefs in Economics, Springer, number 978-3-030-96687-4, February.
    21. Quentin Stoeffler & Michael Carter & Catherine Guirkinger & Wouter Gelade, 2022. "The Spillover Impact of Index Insurance on Agricultural Investment by Cotton Farmers in Burkina Faso," The World Bank Economic Review, World Bank, vol. 36(1), pages 114-140.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:rdevec:v:28:y:2024:i:4:p:1947-1970. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=1363-6669 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.