IDEAS home Printed from https://ideas.repec.org/p/wbk/wbrwps/10046.html
   My bibliography  Save this paper

A Method to Scale-Up Interpretative Qualitative Analysis, with an Application toAspirations in Cox’s Bazaar, Bangladesh

Author

Listed:
  • Ashwin,Julian
  • Rao,Vijayendra
  • Biradavolu,Monica Rao
  • Chhabra,Aditya
  • Haque,Arshia
  • Khan,Afsana Iffat
  • Krishnan,Nandini

Abstract

The qualitative analysis of open-ended interviews has vast potential in economics buthas found limited use. This is partly because the interpretative, nuanced human reading of text and codingthat it requires is labor intensive and very time consuming. This paper presents a method to simplify and shorten thecoding process by extending a small set of interpretative human-codes to a larger, representative, sample usingnatural language processing and thus analyze qualitative data at scale. It applies it to analyze 2,200 open-endedinterviews on parent’s aspirations for children with Rohingya refugees and their Bangladeshi hosts. It shows thatstudying aspirations with open-ended interviews extends the economics focus on material goals to ideas from philosophyand anthropology that emphasize aspirations for moral and religious values, and the navigational capacity to achievethese aspirations. The paper shows how to assess the robustness and reliability of this approach and finds thatextending the sample of interviews, rather than the human-coded training set, is likely to be optimal.

Suggested Citation

  • Ashwin,Julian & Rao,Vijayendra & Biradavolu,Monica Rao & Chhabra,Aditya & Haque,Arshia & Khan,Afsana Iffat & Krishnan,Nandini, 2022. "A Method to Scale-Up Interpretative Qualitative Analysis, with an Application toAspirations in Cox’s Bazaar, Bangladesh," Policy Research Working Paper Series 10046, The World Bank.
  • Handle: RePEc:wbk:wbrwps:10046
    as

    Download full text from publisher

    File URL: http://documents.worldbank.org/curated/en/099759305162210822/pdf/IDU0a357362e00b6004c580966006b1c2f2e3996.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Nyman, Rickard & Kapadia, Sujit & Tuckett, David, 2021. "News and narratives in financial systems: Exploiting big data for systemic risk assessment," Journal of Economic Dynamics and Control, Elsevier, vol. 127(C).
    2. Larsen, Vegard H. & Thorsrud, Leif Anders & Zhulanova, Julia, 2021. "News-driven inflation expectations and information rigidities," Journal of Monetary Economics, Elsevier, vol. 117(C), pages 507-520.
    3. Stephen Hansen & Michael McMahon & Andrea Prat, 2018. "Transparency and Deliberation Within the FOMC: A Computational Linguistics Approach," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(2), pages 801-870.
    4. Scott R. Baker & Nicholas Bloom & Steven J. Davis, 2016. "Measuring Economic Policy Uncertainty," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1593-1636.
    5. repec:cup:apsrev:v:113:y:2019:i:03:p:623-640_00 is not listed on IDEAS
    6. Margaret E. Roberts & Brandon M. Stewart & Edoardo M. Airoldi, 2016. "A Model of Text for Experimentation in the Social Sciences," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(515), pages 988-1003, July.
    7. Jayachandran, Seema & Biradavolu, Monica & Cooper, Jan, 2021. "Using machine learning and qualitative interviews to design a five-question women's agency index," CEPR Discussion Papers 15961, C.E.P.R. Discussion Papers.
    8. Garance Genicot & Debraj Ray, 2017. "Aspirations and Inequality," Econometrica, Econometric Society, vol. 85, pages 489-519, March.
    9. Christina D. Romer & David H. Romer, 2004. "A New Measure of Monetary Shocks: Derivation and Implications," American Economic Review, American Economic Association, vol. 94(4), pages 1055-1084, September.
    10. Garance Genicot & Debraj Ray, 2020. "Aspirations and Economic Behavior," Annual Review of Economics, Annual Reviews, vol. 12(1), pages 715-746, August.
    11. Saiz, Lorena & Ashwin, Julian & Kalamara, Eleni, 2021. "Nowcasting euro area GDP with news sentiment: a tale of two crises," Working Paper Series 2616, European Central Bank.
    12. Shapiro, Adam Hale & Sudhof, Moritz & Wilson, Daniel J., 2022. "Measuring news sentiment," Journal of Econometrics, Elsevier, vol. 228(2), pages 221-243.
    13. Fruttero,Anna & Muller,Noel & Calvo-Gonzalez,Oscar, 2021. "The Power and Roots of Aspirations : A Survey of the Empirical Evidence," Policy Research Working Paper Series 9729, The World Bank.
    14. Chris Elbers & Jean O. Lanjouw & Peter Lanjouw, 2003. "Micro--Level Estimation of Poverty and Inequality," Econometrica, Econometric Society, vol. 71(1), pages 355-364, January.
    15. Nimark, Kristoffer P. & Pitschner, Stefan, 2019. "News media and delegated information choice," Journal of Economic Theory, Elsevier, vol. 181(C), pages 160-196.
    16. Deon Filmer & Lant Pritchett, 2001. "Estimating Wealth Effects Without Expenditure Data—Or Tears: An Application To Educational Enrollments In States Of India," Demography, Springer;Population Association of America (PAA), vol. 38(1), pages 115-132, February.
    17. Apel, Mikael & Blix Grimaldi, Marianna, 2012. "The Information Content of Central Bank Minutes," Working Paper Series 261, Sveriges Riksbank (Central Bank of Sweden).
    18. J. Trent Alexander & Robert Andersen & Peter W. Cookson Jr. & Kathryn Edin & Jonathan Fisher & David B. Grusky & Marybeth Mattingly & Charles Varner, 2017. "A Qualitative Census of Rural and Urban Poverty," The ANNALS of the American Academy of Political and Social Science, , vol. 672(1), pages 143-161, July.
    19. Paul C. Tetlock, 2007. "Giving Content to Investor Sentiment: The Role of Media in the Stock Market," Journal of Finance, American Finance Association, vol. 62(3), pages 1139-1168, June.
    20. Tim Loughran & Bill Mcdonald, 2011. "When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10‐Ks," Journal of Finance, American Finance Association, vol. 66(1), pages 35-65, February.
    21. Parthasarathy, Ramya & Rao, Vijayendra & Palaniswamy, Nethra, 2019. "Deliberative Democracy in an Unequal World: A Text-As-Data Study of South India’s Village Assemblies," American Political Science Review, Cambridge University Press, vol. 113(3), pages 623-640, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yuting Chen & Don Bredin & Valerio Potì & Roman Matkovskyy, 2022. "COVID risk narratives: a computational linguistic approach to the econometric identification of narrative risk during a pandemic," Digital Finance, Springer, vol. 4(1), pages 17-61, March.
    2. Vegard H. Larsen & Leif Anders Thorsrud, 2018. "Business cycle narratives," Working Paper 2018/3, Norges Bank.
    3. Ardia, David & Bluteau, Keven & Boudt, Kris, 2022. "Media abnormal tone, earnings announcements, and the stock market," Journal of Financial Markets, Elsevier, vol. 61(C).
    4. Nyman, Rickard & Kapadia, Sujit & Tuckett, David, 2021. "News and narratives in financial systems: Exploiting big data for systemic risk assessment," Journal of Economic Dynamics and Control, Elsevier, vol. 127(C).
    5. Andres Algaba & David Ardia & Keven Bluteau & Samuel Borms & Kris Boudt, 2020. "Econometrics Meets Sentiment: An Overview Of Methodology And Applications," Journal of Economic Surveys, Wiley Blackwell, vol. 34(3), pages 512-547, July.
    6. Aprigliano, Valentina & Emiliozzi, Simone & Guaitoli, Gabriele & Luciani, Andrea & Marcucci, Juri & Monteforte, Libero, 2023. "The power of text-based indicators in forecasting Italian economic activity," International Journal of Forecasting, Elsevier, vol. 39(2), pages 791-808.
    7. Picault, Matthieu & Renault, Thomas, 2017. "Words are not all created equal: A new measure of ECB communication," Journal of International Money and Finance, Elsevier, vol. 79(C), pages 136-156.
    8. Hubert, Paul & Labondance, Fabien, 2021. "The signaling effects of central bank tone," European Economic Review, Elsevier, vol. 133(C).
    9. Saiz, Lorena & Ashwin, Julian & Kalamara, Eleni, 2021. "Nowcasting euro area GDP with news sentiment: a tale of two crises," Working Paper Series 2616, European Central Bank.
    10. Istrefi, Klodiana & Hanifi, Rayane & Penalver, Adrian, 2022. "Central Bank Communication of Uncertainty," CEPR Discussion Papers 17728, C.E.P.R. Discussion Papers.
    11. Shen, Shulin & Xia, Le & Shuai, Yulin & Gao, Da, 2022. "Measuring news media sentiment using big data for Chinese stock markets," Pacific-Basin Finance Journal, Elsevier, vol. 74(C).
    12. Paul Hubert & Fabien Labondance, 2016. "Central Bank Sentiment and Policy Expectations," SciencePo Working papers Main hal-03459227, HAL.
    13. Youngjoon Lee & Soohyon Kim & Ki Young Park, 2018. "Deciphering Monetary Policy Committee Minutes with Text Mining Approach: A Case of South Korea," Working papers 2018rwp-132, Yonsei University, Yonsei Economics Research Institute.
    14. Hansen, Stephen & McMahon, Michael & Tong, Matthew, 2019. "The long-run information effect of central bank communication," Journal of Monetary Economics, Elsevier, vol. 108(C), pages 185-202.
    15. Hanjo Odendaal & Monique Reid & Johann F. Kirsten, 2020. "Media‐Based Sentiment Indices as an Alternative Measure of Consumer Confidence," South African Journal of Economics, Economic Society of South Africa, vol. 88(4), pages 409-434, December.
    16. Istrefi, Klodiana & Odendahl, Florens & Sestieri, Giulia, 2023. "Fed communication on financial stability concerns and monetary policy decisions: Revelations from speeches," Journal of Banking & Finance, Elsevier, vol. 151(C).
    17. Jon Ellingsen & Vegard H. Larsen & Leif Anders Thorsrud, 2020. "News Media vs. FRED-MD for Macroeconomic Forecasting," CESifo Working Paper Series 8639, CESifo.
    18. Vegard Høghaug Larsen & Leif Anders Thorsrud, 2022. "Asset returns, news topics, and media effects," Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(3), pages 838-868, July.
    19. Paul Hubert & Fabien Labondance, 2019. "Central bank tone and the dispersion of views within monetary policy committees," Sciences Po publications 2019 – 08, Sciences Po.
    20. repec:hal:spmain:info:hdl:2441/7v8fvu0bf08jcoi4epn8cutjm8 is not listed on IDEAS
    21. Nicolò Fraccaroli & Alessandro Giovannini & Jean-François Jamet & Eric Persson, 2023. "Central Banks in Parliaments: A Text Analysis of the Parliamentary Hearings of the Bank of England, the European Central Bank, and the Federal Reserve," International Journal of Central Banking, International Journal of Central Banking, vol. 19(2), pages 543-600, June.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wbk:wbrwps:10046. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Roula I. Yazigi (email available below). General contact details of provider: https://edirc.repec.org/data/dvewbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.