IDEAS home Printed from https://ideas.repec.org/a/sae/somere/v53y2024i2p729-759.html

Iteration in Mixed-Methods Research Designs Combining Experiments and Fieldwork 1, 2

Author

Listed:
  • Verónica Pérez Bentancur
  • Lucía Tiscornia

Abstract

Experimental designs in the social sciences have received increasing attention due to their power to produce causal inferences. Nevertheless, experimental research faces limitations, including limited external validity and unrealistic treatments. We propose combining qualitative fieldwork and experimental design iteratively—moving back-and-forth between elements of a research design—to overcome these limitations. To properly evaluate the strength of experiments researchers need information about the context, data, and previous knowledge used to design the treatment. To support our argument, we analyze 338 pre-analysis plans submitted to the Evidence in Governance and Politics repository in 2019 and the design of a study on public opinion support for punitive policing practices in Montevideo, Uruguay. The paper provides insights about using qualitative fieldwork to enhance the external validity, transparency and replicability of experimental research, and a practical guide for researchers who want to incorporate iteration to their research designs.

Suggested Citation

  • Verónica Pérez Bentancur & Lucía Tiscornia, 2024. "Iteration in Mixed-Methods Research Designs Combining Experiments and Fieldwork 1, 2," Sociological Methods & Research, , vol. 53(2), pages 729-759, May.
    • Handle: RePEc:sae:somere:v:53:y:2024:i:2:p:729-759
    DOI: 10.1177/00491241221082595
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/00491241221082595
    Download Restriction: no
    File URL: https://libkey.io/10.1177/00491241221082595?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Rao, Vijayendra & Ananthpur, Kripa & Malik, Kabir, 2017. "The Anatomy of Failure: An Ethnography of a Randomized Trial to Deepen Democracy in Rural India," World Development, Elsevier, vol. 99(C), pages 481-497.
    2. Hainmueller, Jens & Hopkins, Daniel J. & Yamamoto, Teppei, 2014. "Causal Inference in Conjoint Analysis: Understanding Multidimensional Choices via Stated Preference Experiments," Political Analysis, Cambridge University Press, vol. 22(1), pages 1-30, January.
    3. Jennifer Cyr, 2019. "An integrative approach to measurement: focus groups as a survey pretest," Quality & Quantity: International Journal of Methodology, Springer, vol. 53(2), pages 897-913, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Röllicke, Lena, 2025. "Affective polarization and qualitative methods," EconStor Open Access Book Chapters, in: Handbook of Affective Polarization, pages 88-102, ZBW - Leibniz Information Centre for Economics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lisanne de Blok & Max Heermann & Julian Schuessler & Dirk Leuffen & Catherine E. de Vries, 2024. "All on board? The role of institutional design for public support for differentiated integration," European Union Politics, , vol. 25(3), pages 593-604, September.
    2. Chaikaew, Pasicha & Hodges, Alan W. & Grunwald, Sabine, 2017. "Estimating the value of ecosystem services in a mixed-use watershed: A choice experiment approach," Ecosystem Services, Elsevier, vol. 23(C), pages 228-237.
    3. Jiawei Fu & Xiaojun Li, 2024. "A Formal Theory of Survey Experiment Generalizability: Attention and Salience," Papers 2405.06779, arXiv.org, revised Apr 2026.
    4. Henrik Serup Christensen & Lauri Rapeli, 2021. "Immediate rewards or delayed gratification? A conjoint survey experiment of the public’s policy preferences," Policy Sciences, Springer;Society of Policy Sciences, vol. 54(1), pages 63-94, March.
    5. George,Siddharth & Rao,Vijayendra & Sharan,M. R., 2024. "Two Hundred and Fifty-Thousand Democracies : A Review of Village Government in India," Policy Research Working Paper Series 10793, The World Bank.
    6. Okada, Isamu, 2024. "What procedures matter to social acceptance of mining? A conjoint experiment in Peru," World Development, Elsevier, vol. 183(C).
    7. Wietzke, Frank-Borge, 2024. "Perceptions of social class in Africa. Results from a conjoint experiment," World Development, Elsevier, vol. 178(C).
    8. Robert Kubinec, 2018. "Patrons or Clients? Measuring and Experimentally Evaluating Political Connections of Firms in Morocco and Jordan," Working Papers 1280, Economic Research Forum, revised 26 Dec 2018.
    9. Heap, Shaun P. Hargreaves & Koop, Christel & Matakos, Konstantinos & Unan, Asli & Weber, Nina Sophie, 2021. "We Cannot Disagree Forever! Reality Polarization and Citizens’ Post-Pandemic Fiscal Adjustment Preferences," SocArXiv 69tup, Center for Open Science.
    10. E. Keith Smith & Dennis Kolcava & Thomas Bernauer, 2024. "Stringent sustainability regulations for global supply chains are supported across middle-income democracies," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    11. Vrânceanu, Alina & Dinas, Elias & Heidland, Tobias & Ruhs, Martin, 2023. "The European refugee crisis and public support for the externalisation of migration management," Open Access Publications from Kiel Institute for the World Economy 279441, Kiel Institute for the World Economy.
    12. Beber, Bernd & Ebert, Cara & Sievert, Maximiliane, 2024. "Is intent to migrate irregularly responsive to recent German asylum policy adjustments?," Ruhr Economic Papers 1071, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    13. Lichtin, Florian & Smith, E. Keith & Axhausen, Kay W. & Bernauer, Thomas, 2024. "“How much should public transport services be expanded, and who should pay? Experimental evidence from Switzerland”," Transport Policy, Elsevier, vol. 158(C), pages 64-74.
    14. Saparova, Gulkaiyr & Khan, Ghulam Dastgir & Joshi, Niraj Prakash, 2024. "Linking farmers to markets: Assessing small-scale farmers' preferences for an official phytosanitary regime in the Kyrgyz Republic," Economic Analysis and Policy, Elsevier, vol. 81(C), pages 696-708.
    15. Arntz, Melanie & Brüll, Eduard & Lipowski, Cäcilia, 2021. "Do preferences for urban amenities really differ by skill?," ZEW Discussion Papers 21-045, ZEW - Leibniz Centre for European Economic Research.
    16. Joshua Alley, 2023. "Elite Cues and Public Attitudes Towards Military Alliances," Journal of Conflict Resolution, Peace Science Society (International), vol. 67(7-8), pages 1537-1563, August.
    17. Tukiainen, Janne & Blesse, Sebastian & Bohne, Albrecht & Giuffrida, Leonardo M. & Jääskeläinen, Jan & Luukinen, Ari & Sieppi, Antti, 2024. "What are the priorities of bureaucrats? Evidence from conjoint experiments with procurement officials," Journal of Economic Behavior & Organization, Elsevier, vol. 227(C).
    18. Fumiya Uchikoshi & Hirofumi Miwa & Yoshikuni Ono, 2025. "Gendered Expectations for College Applications: Experimental Evidence from a Gender Inegalitarian Education Context," Research in Higher Education, Springer;Association for Institutional Research, vol. 66(5), pages 1-27, August.
    19. Tulsi Ram Aryal & Masaru Ichihashi & Shinji Kaneko, 2022. "How strong is demand for public transport service in Nepal? A case study of Kathmandu using a choice-based conjoint experiment," Journal of Economic Structures, Springer;Pan-Pacific Association of Input-Output Studies (PAPAIOS), vol. 11(1), pages 1-14, December.
    20. Poulissen, Davey & de Grip, Andries & Fouarge, Didier & Künn, Annemarie, 2021. "Employers’ willingness to invest in the training of temporary workers: a discrete choice experiment," Research Memorandum 010, Maastricht University, Graduate School of Business and Economics (GSBE).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:somere:v:53:y:2024:i:2:p:729-759. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.