IDEAS home Printed from https://ideas.repec.org/p/ags/aaea24/345097.html

Using Multiple Methods to Improve Validity

Author

Listed:
  • Just, David R.
  • Jiao, Jie

Abstract

Behavioral research faces unique challenges in balancing internal and external validity, especially for policy-oriented studies. This paper examines the limitations of combining experimental and field data to address the “behavioral policy challenge,” highlighting the need for rigorous theoretical assumptions and practical considerations. Drawing on empirical examples, we demonstrate how combining laboratory and field data can sometimes fail to ensure both causality and relevance. We propose criteria for effectively integrating multiple methods to enhance validity, offering insights for researchers aiming to establish robust evidence for behavioral phenomena in policy-making contexts.
(This abstract was borrowed from another version of this item.)

Suggested Citation

  • Just, David R. & Jiao, Jie, 2024. "Using Multiple Methods to Improve Validity," 2024 Annual Meeting, July 28-30, New Orleans, LA 345097, Agricultural and Applied Economics Association.
    • Handle: RePEc:ags:aaea24:345097
    DOI: 10.22004/ag.econ.345097
    as

    Download full text from publisher

    File URL: https://ageconsearch.umn.edu/record/345097/files/David%20R.%20Just.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.22004/ag.econ.345097?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Dante A. Urbina & Alberto Ruiz‐Villaverde, 2019. "A Critical Review of Homo Economicus from Five Approaches," American Journal of Economics and Sociology, Wiley Blackwell, vol. 78(1), pages 63-93, January.
    2. Hummel, Dennis & Maedche, Alexander, 2019. "How effective is nudging? A quantitative review on the effect sizes and limits of empirical nudging studies," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 80(C), pages 47-58.
    3. Richard H. Thaler, 2000. "From Homo Economicus to Homo Sapiens," Journal of Economic Perspectives, American Economic Association, vol. 14(1), pages 133-141, Winter.
    4. Steven D. Levitt & John A. List, 2007. "What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 153-174, Spring.
    5. Lo, Hui-Yi & Harvey, Nigel, 2011. "Shopping without pain: Compulsive buying and the effects of credit card availability in Europe and the Far East," Journal of Economic Psychology, Elsevier, vol. 32(1), pages 79-92, February.
    6. Daniel Kahneman & Jack L. Knetsch & Richard H. Thaler, 1991. "Anomalies: The Endowment Effect, Loss Aversion, and Status Quo Bias," Journal of Economic Perspectives, American Economic Association, vol. 5(1), pages 193-206, Winter.
    7. Leamer, Edward E, 1983. "Let's Take the Con Out of Econometrics," American Economic Review, American Economic Association, vol. 73(1), pages 31-43, March.
    8. Just, David R. & Gabrielyan, Gnel, 2018. "Influencing the food choices of SNAP consumers: Lessons from economics, psychology and marketing," Food Policy, Elsevier, vol. 79(C), pages 309-317.
    9. Richard H. Thaler, 2016. "Behavioral Economics: Past, Present, and Future," American Economic Review, American Economic Association, vol. 106(7), pages 1577-1600, July.
    10. Montes-Rojas, Gabriel & Galvao, Antonio F., 2014. "Bayesian endogeneity bias modeling," Economics Letters, Elsevier, vol. 122(1), pages 36-39.
    11. John A. List & Anya Samek, 2017. "A Field Experiment on the Impact of Incentives on Milk Choice in the Lunchroom," Public Finance Review, , vol. 45(1), pages 44-67, January.
    12. David R Just & Anne T Byrne, 2020. "Evidence-based policy and food consumer behaviour: how empirical challenges shape the evidence [The effects of a fat tax on French households’ purchases: a nutritional approach]," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 47(1), pages 348-370.
    13. Hallsworth, Michael & List, John A. & Metcalfe, Robert D. & Vlaev, Ivo, 2017. "The behavioralist as tax collector: Using natural field experiments to enhance tax compliance," Journal of Public Economics, Elsevier, vol. 148(C), pages 14-31.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:ags:aaea22:345097 is not listed on IDEAS
    2. Andrew Pendleton & Ben Lupton & Andrew Rowe & Richard Whittle, 2019. "Back to the Shop Floor: Behavioural Insights from Workplace Sociology," Work, Employment & Society, British Sociological Association, vol. 33(6), pages 1039-1057, December.
    3. Eugen Dimant & Tobias Gesche, 2021. "Nudging Enforcers: How Norm Perceptions and Motives for Lying Shape Sanctions," CESifo Working Paper Series 9385, CESifo.
    4. Lorko, Matej & Miklánek, Tomáš & Servátka, Maroš, 2025. "Why do some nudges work and others not?," Journal of Economic Behavior & Organization, Elsevier, vol. 235(C).
    5. Bogliacino, Francesco & Codagnone, Cristiano, 2021. "Microfoundations, behaviour, and evolution: Evidence from experiments," Structural Change and Economic Dynamics, Elsevier, vol. 56(C), pages 372-385.
    6. Riehm, Tobias & Fugger, Nicolas & Gillen, Philippe & Gretschko, Vitali & Werner, Peter, 2022. "Social norms, sanctions, and conditional entry in markets with externalities: Evidence from an artefactual field experiment," Journal of Public Economics, Elsevier, vol. 212(C).
    7. Mußhoff, O. & Hirschauer, N., . "Planspiele als experimentelle Methode der Politikfolgenabschätzung: Das Beispiel der Stickstoffextensivierung," Proceedings “Schriften der Gesellschaft für Wirtschafts- und Sozialwissenschaften des Landbaues e.V.”, German Association of Agricultural Economists (GEWISOLA), vol. 48.
    8. Ole Bonnichsen & Jacob Ladenburg, 2010. "Reducing Status Quo Bias in Choice Experiments – An Application of a Protest Reduction Entreaty," IFRO Working Paper 2010/7, University of Copenhagen, Department of Food and Resource Economics.
    9. Hermstrüwer, Yoan & Dickert, Stephan, 2017. "Sharing is daring: An experiment on consent, chilling effects and a salient privacy nudge," International Review of Law and Economics, Elsevier, vol. 51(C), pages 38-49.
    10. Migchelbrink, Koen & Raymaekers, Pieter, 2023. "Nudging people to pay their parking fines on time. Evidence from a cluster-randomized field experiment," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 105(C).
    11. Eduard Marinov, 2017. "The 2017 Nobel Prize in Economics," Economic Thought journal, Bulgarian Academy of Sciences - Economic Research Institute, issue 6, pages 117-159.
    12. Sanjit Dhami, 2017. "Human Ethics and Virtues: Rethinking the Homo-Economicus Model," CESifo Working Paper Series 6836, CESifo.
    13. Nobel Prize Committee, 2017. "Richard H. Thaler: Integrating Economics with Psychology," Nobel Prize in Economics documents 2017-1, Nobel Prize Committee.
    14. Antinyan, Armenak & Asatryan, Zareh, 2019. "Nudging for tax compliance: A meta-analysis," ZEW Discussion Papers 19-055, ZEW - Leibniz Centre for European Economic Research.
    15. Raineau, Yann & Giraud-Héraud, Éric & Lecocq, Sébastien, 2025. "Social comparison nudges: What actually happens when we are told what others do?," Ecological Economics, Elsevier, vol. 228(C).
    16. Stefano DellaVigna & Elizabeth Linos, 2022. "RCTs to Scale: Comprehensive Evidence From Two Nudge Units," Econometrica, Econometric Society, vol. 90(1), pages 81-116, January.
    17. repec:osf:socarx:a9436_v1 is not listed on IDEAS
    18. Rotem Dvir, 2024. "Nudging citizens co-production: Assessing multiple behavioral strategies," Policy Sciences, Springer;Society of Policy Sciences, vol. 57(4), pages 719-743, December.
    19. Casal, Sandro & Mittone, Luigi, 2016. "Social esteem versus social stigma: The role of anonymity in an income reporting game," Journal of Economic Behavior & Organization, Elsevier, vol. 124(C), pages 55-66.
    20. Carina Cavalcanti & Andreas Leibbrandt, 2017. "A glance into the willingness to reduce overfishing: Field evidence from a fishnet exchange program," Monash Economics Working Papers 09-17, Monash University, Department of Economics.
    21. Sanders, Michael & Smith, Sarah, 2016. "Can simple prompts increase bequest giving? Field evidence from a legal call centre," Journal of Economic Behavior & Organization, Elsevier, vol. 125(C), pages 179-191.
    22. Yoan Hermstrüwer & Stephan Dickert, 2013. "Tearing the Veil of Privacy Law: An Experiment on Chilling Effects and the Right to Be Forgotten," Discussion Paper Series of the Max Planck Institute for Behavioral Economics 2013_15, Max Planck Institute for Behavioral Economics.

    More about this item

    Keywords

    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:aaea24:345097. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AgEcon Search (email available below). General contact details of provider: https://edirc.repec.org/data/aaeaaea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.