IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Log in (now much improved!) to save this article

Experimental methods: When and why contextual instructions are important

Listed author(s):
  • Alekseev, Aleksandr
  • Charness, Gary
  • Gneezy, Uri

An important methodological issue in experimental research is the extent to which one should use context-rich or abstract language in the instructions for an experiment. The traditional use of abstract context in experimental economics is commonly viewed as a way to achieve experimental control. However, there are some advantages to using context-framed instructions, such as “employer and worker” instead of “player 1 and player 2.” Meaningful context can enhance understanding of an environment and reduce confusion among participants, particularly when a task requires sophisticated reasoning, and hence may yield responses of better quality. In emotionally-charged research questions, such as pollution or bribes, contextual instructions may affect behavior in the experiment, but this effect may be appropriate as it relates to the research question. Our review of the evidence from the literature indicates that in the great majority of cases meaningful language is either useful or produces no change in behavior. Nevertheless, a few important considerations are worth keeping in mind when using rich context. Finally, we see the choice of context as being an expansion of the experimenter’s toolkit and a factor to consider in experimental design.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.sciencedirect.com/science/article/pii/S0167268116302876
Download Restriction: Full text for ScienceDirect subscribers only

As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.

Article provided by Elsevier in its journal Journal of Economic Behavior & Organization.

Volume (Year): 134 (2017)
Issue (Month): C ()
Pages: 48-59

as
in new window

Handle: RePEc:eee:jeborg:v:134:y:2017:i:c:p:48-59
DOI: 10.1016/j.jebo.2016.12.005
Contact details of provider: Web page: http://www.elsevier.com/locate/jebo

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as
in new window


  1. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde, 2009. "Homo Reciprocans: Survey Evidence on Behavioural Outcomes," Economic Journal, Royal Economic Society, vol. 119(536), pages 592-612, 03.
  2. Burnham, Terence & McCabe, Kevin & Smith, Vernon L., 2000. "Friend-or-foe intentionality priming in an extensive form trust game," Journal of Economic Behavior & Organization, Elsevier, vol. 43(1), pages 57-73, September.
  3. Berninghaus, Siegfried K. & Haller, Sven & Krüger, Tyll & Neumann, Thomas & Schosser, Stephan & Vogt, Bodo, 2013. "Risk attitude, beliefs, and information in a Corruption Game – An experimental analysis," Journal of Economic Psychology, Elsevier, vol. 34(C), pages 46-60.
  4. Dufwenberg, Martin & Gächter, Simon & Hennig-Schmidt, Heike, 2011. "The framing of games and the psychology of play," Games and Economic Behavior, Elsevier, vol. 73(2), pages 459-478.
  5. Heike Hennig-Schmidt & Bettina Rockenbach & Abdolkarim Sadrieh, 2010. "In Search Of Workers' Real Effort Reciprocity-A Field and a Laboratory Experiment," Journal of the European Economic Association, MIT Press, vol. 8(4), pages 817-837, 06.
  6. Itzhak Gilboa & David Schmeidler, 1995. "Case-Based Decision Theory," The Quarterly Journal of Economics, Oxford University Press, vol. 110(3), pages 605-639.
  7. David J. Cooper, 1999. "Gaming against Managers in Incentive Systems: Experimental Results with Chinese Students and Chinese Managers," American Economic Review, American Economic Association, vol. 89(4), pages 781-804, September.
  8. Daniele Nosenzo, 2013. "Pay Secrecy And Effort Provision," Economic Inquiry, Western Economic Association International, vol. 51(3), pages 1779-1794, 07.
  9. Glenn W. Harrison & John A. List, 2004. "Field Experiments," Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
  10. David Cooper & John Kagel & Qing Liang Gu & Wei Lo, 1999. "Gaming against managers in incentive systems: Experimental results with chinese students and chinese managers," Artefactual Field Experiments 00038, The Field Experiments Website.
  11. Klaus Abbink & Heike Hennig-Schmidt, 2006. "Neutral versus loaded instructions in a bribery experiment," Experimental Economics, Springer;Economic Science Association, vol. 9(2), pages 103-121, June.
  12. Abigail Barr & Danila Serra, 2009. "The effects of externalities and framing on bribery in a petty corruption experiment," Experimental Economics, Springer;Economic Science Association, vol. 12(4), pages 488-503, December.
  13. Jehiel, Philippe, 2005. "Analogy-based expectation equilibrium," Journal of Economic Theory, Elsevier, vol. 123(2), pages 81-104, August.
  14. Avrahami, Judith & Kareev, Yaakov & Todd, Peter M. & Silverman, Boaz, 2014. "Allocation of resources in asymmetric competitions: How do the weak maintain a chance of winning?," Journal of Economic Psychology, Elsevier, vol. 42(C), pages 161-174.
  15. Ritwik Banerjee, 2016. "On the interpretation of bribery in a laboratory corruption game: moral frames and social norms," Experimental Economics, Springer;Economic Science Association, vol. 19(1), pages 240-267, March.
  16. Abbink, Klaus & Dasgupta, Utteeyo & Gangadharan, Lata & Jain, Tarun, 2014. "Letting the briber go free: An experiment on mitigating harassment bribes," Journal of Public Economics, Elsevier, vol. 111(C), pages 17-28.
  17. M. Fernanda Rivas, 2013. "An Experiment On Corruption And Gender," Bulletin of Economic Research, Wiley Blackwell, vol. 65(1), pages 10-42, 01.
  18. Glenn W. Harrison & Morten I. Lau & E. Elisabet Rutström, 2007. "Estimating Risk Attitudes in Denmark: A Field Experiment," Scandinavian Journal of Economics, Wiley Blackwell, vol. 109(2), pages 341-368, 06.
  19. Engel, Christoph & Rand, David G., 2014. "What does “clean” really mean? The implicit framing of decontextualized experiments," Economics Letters, Elsevier, vol. 122(3), pages 386-389.
  20. Cox, James C & Oaxaca, Ronald L, 1989. "Laboratory Experiments with a Finite-Horizon Job-Search Model," Journal of Risk and Uncertainty, Springer, vol. 2(3), pages 301-329, September.
  21. Ellingsen, Tore & Johannesson, Magnus & Mollerstrom, Johanna & Munkhammar, Sara, 2012. "Social framing effects: Preferences or beliefs?," Games and Economic Behavior, Elsevier, vol. 76(1), pages 117-130.
  22. Rajna Gibson & Carmen Tanner & Alexander F. Wagner, 2013. "Preferences for Truthfulness: Heterogeneity among and within Individuals," American Economic Review, American Economic Association, vol. 103(1), pages 532-548, February.
  23. Pevnitskaya, Svetlana & Ryvkin, Dmitry, 2013. "Environmental context and termination uncertainty in games with a dynamic public bad," Environment and Development Economics, Cambridge University Press, vol. 18(01), pages 27-49, February.
  24. Alm, James & McClelland, Gary H. & Schulze, William D., 1992. "Why do people pay taxes?," Journal of Public Economics, Elsevier, vol. 48(1), pages 21-38, June.
  25. David J. Cooper & John H. Kagel, 2009. "The Role of Context and Team Play in Cross-Game Learning," Journal of the European Economic Association, MIT Press, vol. 7(5), pages 1101-1139, 09.
  26. Andrei Bremzen & Elena Khokhlova & Anton Suvorov & Jeroen van de Ven, 2015. "Bad News: An Experimental Study on the Informational Effects Of Rewards," The Review of Economics and Statistics, MIT Press, vol. 97(1), pages 55-70, March.
  27. Elliott, Catherine S. & Hayward, Donald M. & Canon, Sebastian, 1998. "Institutional framing: Some experimental evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 35(4), pages 455-464, May.
  28. Landeo, Claudia M. & Nikitin, Maxim & Babcock, Linda, 2007. "Split-awards and disputes: An experimental study of a strategic model of litigation," Journal of Economic Behavior & Organization, Elsevier, vol. 63(3), pages 553-572, July.
  29. Jana Krajcova & Andreas Ortmann, 2008. "Testing Leniency Programs Experimentally: The Impact of “Natural” Framing," CERGE-EI Working Papers wp372, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
  30. Christine Harbring & Bernd Irlenbusch, 2011. "Sabotage in Tournaments: Evidence from a Laboratory Experiment," Management Science, INFORMS, vol. 57(4), pages 611-627, April.
  31. Jordi Brandts & David Cooper, 2006. "Observability and overcoming coordination failure in organizations: An experimental study," Experimental Economics, Springer;Economic Science Association, vol. 9(4), pages 407-423, December.
  32. Li, Danyang & Hawley, Zackary & Schnier, Kurt, 2013. "Increasing organ donation via changes in the default choice or allocation rule," Journal of Health Economics, Elsevier, vol. 32(6), pages 1117-1129.
  33. Jana Krajcova, 2008. "Testing Leniency Programs Experimentally: The Impact of Change in Parameterization," CERGE-EI Working Papers wp370, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
  34. Eileen Chou & Margaret McConnell & Rosemarie Nagel & Charles Plott, 2009. "The control of game form recognition in experiments: understanding dominant strategy failures in a simple two person “guessing” game," Experimental Economics, Springer;Economic Science Association, vol. 12(2), pages 159-179, June.
  35. Michael Kirchler & Jurgen Huber & Thomas Stockl, 2012. "Thar She Bursts: Reducing Confusion Reduces Bubbles," American Economic Review, American Economic Association, vol. 102(2), pages 865-883, April.
  36. Vivi Alatas & Lisa Cameron & Ananish Chaudhuri & Nisvan Erkal & Lata Gangadharan, 2009. "Gender, Culture, and Corruption: Insights from an Experimental Analysis," Southern Economic Journal, Southern Economic Association, vol. 75(3), pages 663-680, January.
  37. Rachel Croson & Uri Gneezy, 2009. "Gender Differences in Preferences," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 448-474, June.
  38. Cooper, David J. & Kagel, John H., 2003. "The impact of meaningful context on strategic play in signaling games," Journal of Economic Behavior & Organization, Elsevier, vol. 50(3), pages 311-337, March.
  39. Samuelson, Charles D. & Allison, Scott T., 1994. "Cognitive Factors Affecting the Use of Social Decision Heuristics in Resource-Sharing Tasks," Organizational Behavior and Human Decision Processes, Elsevier, vol. 58(1), pages 1-27, April.
  40. Lambsdorff, Johann Graf & Frank, Björn, 2011. "Corrupt reciprocity - Experimental evidence on a men's game," International Review of Law and Economics, Elsevier, vol. 31(2), pages 116-125, June.
  41. Danyang Li & Zackary Hawley & Kurt Schnier, 2013. "Increasing Organ Donation via Changes in the Default Choice or Allocation Rule," Working Papers 201302, Texas Christian University, Department of Economics.
  42. Smith, Vernon L, 1976. "Experimental Economics: Induced Value Theory," American Economic Review, American Economic Association, vol. 66(2), pages 274-279, May.
  43. Smith, Vernon L & Suchanek, Gerry L & Williams, Arlington W, 1988. "Bubbles, Crashes, and Endogenous Expectations in Experimental Spot Asset Markets," Econometrica, Econometric Society, vol. 56(5), pages 1119-1151, September.
  44. Kimmo Eriksson & Pontus Strimling, 2014. "Spontaneous associations and label framing have similar effects in the public goods game," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 9(5), pages 360-372, September.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:eee:jeborg:v:134:y:2017:i:c:p:48-59. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Dana Niculescu)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.