IDEAS home Printed from https://ideas.repec.org/a/spr/jesaex/v4y2018i2d10.1007_s40881-018-0059-0.html
   My bibliography  Save this article

Instructions

Author

Listed:
  • David J. Freeman

    (Simon Fraser University)

  • Erik O. Kimbrough

    (Chapman University)

  • Garrett M. Petersen

    (Simon Fraser University)

  • Hanh T. Tong

    (Simon Fraser University)

Abstract

A survey of instruction delivery and reinforcement methods in recent laboratory experiments reveals a wide and inconsistently reported variety of practices and limited research evaluating their effectiveness. Thus, we experimentally compare how methods of delivering and reinforcing experiment instructions impact subjects’ comprehension and retention of payoff-relevant information. We report a one-shot individual decision task in which non-money-maximizing behavior can be unambiguously identified and find that such behavior is prevalent in our baseline treatment which uses plain, but relatively standard experimental instructions. We find combinations of reinforcement methods that can eliminate half of non-money-maximizing behavior, and we find that we can induce a similar reduction via enhancements to the content of instructions. Residual non-money-maximizing behavior suggests that this may be an important source of noise in experimental studies.

Suggested Citation

  • David J. Freeman & Erik O. Kimbrough & Garrett M. Petersen & Hanh T. Tong, 2018. "Instructions," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 4(2), pages 165-179, December.
    • Handle: RePEc:spr:jesaex:v:4:y:2018:i:2:d:10.1007_s40881-018-0059-0
    DOI: 10.1007/s40881-018-0059-0
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s40881-018-0059-0
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s40881-018-0059-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    • David J. Freeman & Erik O. Kimbrough & Garrett M. Petersen & Hanh T. Tong, 2017. "Instructions," Discussion Papers dp17-12, Department of Economics, Simon Fraser University.

    References listed on IDEAS

    as
    1. Philip Brookins & Dmitry Ryvkin, 2014. "An experimental study of bidding in contests of incomplete information," Experimental Economics, Springer;Economic Science Association, vol. 17(2), pages 245-261, June.
    2. Davis, Douglas D. & Holt, Charles a., 1993. "Experimental economics: Methods, problems and promise," Estudios Económicos, El Colegio de México, Centro de Estudios Económicos, vol. 8(2), pages 179-212.
    3. Smith, Vernon L, 1982. "Microeconomic Systems as an Experimental Science," American Economic Review, American Economic Association, vol. 72(5), pages 923-955, December.
    4. Alekseev, Aleksandr & Charness, Gary & Gneezy, Uri, 2017. "Experimental methods: When and why contextual instructions are important," Journal of Economic Behavior & Organization, Elsevier, vol. 134(C), pages 48-59.
    5. Diego Aycinena & Rimvydas Baltaduonis & Lucas Rentschler, 2014. "Valuation structure in first-price and least-revenue auctions: an experimental investigation," Experimental Economics, Springer;Economic Science Association, vol. 17(1), pages 100-128, March.
    6. David Gill & Victoria Prowse, 2012. "A Structural Analysis of Disappointment Aversion in a Real Effort Competition," American Economic Review, American Economic Association, vol. 102(1), pages 469-503, February.
    7. Susana Cabrera & Enrique Fatás & Juan Lacomba & Tibor Neugebauer, 2013. "Splitting leagues: promotion and demotion in contribution-based regrouping experiments," Experimental Economics, Springer;Economic Science Association, vol. 16(3), pages 426-441, September.
    8. Bigoni, M. & Dragone, D., 2012. "Effective and efficient experimental instructions," Economics Letters, Elsevier, vol. 117(2), pages 460-463.
    9. Steffen Altmann & Armin Falk & Andreas Grunewald & David Huffman, 2014. "Contractual Incompleteness, Unemployment, and Labour Market Segmentation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(1), pages 30-56.
    10. Alvin Etang & David Fielding & Stephen Knowles, 2011. "Does trust extend beyond the village? Experimental trust and social distance in Cameroon," Experimental Economics, Springer;Economic Science Association, vol. 14(1), pages 15-35, March.
    11. Luigi Mittone & Matteo Ploner, 2011. "Peer pressure, social spillovers, and reciprocity: an experimental analysis," Experimental Economics, Springer;Economic Science Association, vol. 14(2), pages 203-222, May.
    12. Keith M. Marzilli Ericson & Andreas Fuster, 2011. "Expectations as Endowments: Evidence on Reference-Dependent Preferences from Exchange and Valuation Experiments," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1879-1907.
    13. James C. Cox & Duncan James, 2012. "Clocks and Trees: Isomorphic Dutch Auctions and Centipede Games," Econometrica, Econometric Society, vol. 80(2), pages 883-903, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Daniel W. M. Chan & Matteo Cristofaro & Hala Nassereddine & Nicole S. N. Yiu & Hadi Sarvari, 2021. "Perceptions of Safety Climate in Construction Projects between Workers and Managers/Supervisors in the Developing Country of Iran," Sustainability, MDPI, vol. 13(18), pages 1-18, September.
    2. Merav Badash & Efrat Harel & Rivi Carmel & Tina Waldman, 2020. "Beliefs versus Declared Practices of English as a Foreign Language (EFL) Teachers Regarding Teaching Grammar," World Journal of English Language, Sciedu Press, vol. 10(1), pages 1-49, March.
    3. Taylor Jaworski & Bart J. Wilson, 2013. "Go West Young Man: Self‐Selection and Endogenous Property Rights," Southern Economic Journal, John Wiley & Sons, vol. 79(4), pages 886-904, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Emmanuel Dechenaux & Dan Kovenock & Roman Sheremeta, 2015. "A survey of experimental research on contests, all-pay auctions and tournaments," Experimental Economics, Springer;Economic Science Association, vol. 18(4), pages 609-669, December.
    2. Jean-Michel Benkert, 2015. "Bilateral trade with loss-averse agents," ECON - Working Papers 188, Department of Economics - University of Zurich, revised Jul 2022.
    3. Karle, Heiko & Schumacher, Heiner & Vølund, Rune, 2023. "Consumer loss aversion and scale-dependent psychological switching costs," Games and Economic Behavior, Elsevier, vol. 138(C), pages 214-237.
    4. Simon Gächter & Lingbo Huang & Martin Sefton, 2016. "Combining “real effort” with induced effort costs: the ball-catching task," Experimental Economics, Springer;Economic Science Association, vol. 19(4), pages 687-712, December.
    5. James C. Cox & Vjollca Sadiraj, 2018. "Incentives," Experimental Economics Center Working Paper Series 2018-01, Experimental Economics Center, Andrew Young School of Policy Studies, Georgia State University.
    6. Yoichi Hizen & Kengo Kurosaka, 2021. "Monetary Costs Versus Opportunity Costs in a Voting Experiment," Working Papers SDES-2021-1, Kochi University of Technology, School of Economics and Management, revised Feb 2021.
    7. Takeuchi, Ai & Veszteg, Róbert F. & Kamijo, Yoshio & Funaki, Yukihiko, 2022. "Bargaining over a jointly produced pie: The effect of the production function on bargaining outcomes," Games and Economic Behavior, Elsevier, vol. 134(C), pages 169-198.
    8. Trabelsi, Emna & Hichri, Walid, 2021. "Central Bank Transparency with (semi-)public Information: Laboratory Experiments," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 90(C).
    9. Miles S. Kimball & Collin B. Raymond & Jiannan Zhou & Junya Zhou & Fumio Ohtake & Yoshiro Tsutsui, 2024. "Happiness Dynamics, Reference Dependence, and Motivated Beliefs in U.S. Presidential Elections," NBER Working Papers 32078, National Bureau of Economic Research, Inc.
    10. Jong-Hee Hahn & Jinwoo Kim & Sang-Hyun Kim & Jihong Lee, 2018. "Price discrimination with loss averse consumers," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 65(3), pages 681-728, May.
    11. Brice Corgnet & Brian Gunia & Roberto Hernán González, 2021. "Harnessing the power of social incentives to curb shirking in teams," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 30(1), pages 139-167, February.
    12. Gesche, Tobias, 2018. "Reference Price Shifts and Customer Antagonism: Evidence from Reviews for Online Auctions," VfS Annual Conference 2018 (Freiburg, Breisgau): Digital Economy 181650, Verein für Socialpolitik / German Economic Association.
    13. Björn Bartling & Leif Brandes & Daniel Schunk, 2012. "Expectations as reference points: field evidence from experienced subjects in a competitive, high-stakes environment," ECON - Working Papers 073, Department of Economics - University of Zurich.
    14. Aleksandr Alekseev, 2022. "Give me a challenge or give me a raise," Experimental Economics, Springer;Economic Science Association, vol. 25(1), pages 170-202, February.
    15. Heiko Karle & Heiner Schumacher & Rune Vølund, 2020. "Consumer search and the uncertainty effect," Working Papers of Department of Economics, Leuven 657766, KU Leuven, Faculty of Economics and Business (FEB), Department of Economics, Leuven.
    16. Shikuku, Kelvin Mashisia & Bulte, Erwin & Lagerkvist, Carl Johan & Tran, Nhuong, 2021. "The Formation of Reference Points in Consumer Choice Behavior: Experimental Evidence from a Fish Market in Nigeria," 2021 Conference, August 17-31, 2021, Virtual 314964, International Association of Agricultural Economists.
    17. Brandts, Jordi & Riedl, Arno, 2020. "Market interaction and efficient cooperation," European Economic Review, Elsevier, vol. 121(C).
    18. Dreyfuss, Bnaya & Heffetz, Ori & Hoffman, Guy & Ishai, Guy & Kshirsagar, Alap, 2024. "Additive vs. subtractive earning in shared human-robot work environments," Journal of Economic Behavior & Organization, Elsevier, vol. 217(C), pages 692-704.
    19. Gagnon-Bartsch, Tristan & Bushong, Benjamin, 2022. "Learning with misattribution of reference dependence," Journal of Economic Theory, Elsevier, vol. 203(C).
    20. Wayne Edwards & Lee Huskey, 2014. "The search goes on: Parameter effects on the return migration decision," Migration Letters, Migration Letters, vol. 11(1), pages 79-89, January.

    More about this item

    Keywords

    Attention; Comprehension; Instructions;
    All these keywords.

    JEL classification:

    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jesaex:v:4:y:2018:i:2:d:10.1007_s40881-018-0059-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.