IDEAS home Printed from https://ideas.repec.org/p/huj/dispap/dp701.html
   My bibliography  Save this paper

Heterogeneous Suppression of Sequential Effects in Random Sequence Generation, but not in Operant Learning

Author

Listed:
  • Hanan Shteingart
  • Yonatan Loewenstein

Abstract

There is a long history of experiments, in which participantsare instructed to generate a long sequence of binary random numbers.The scope of this line of research has shifted over the years from identifying the basic psychological principles and/or the heuristics that lead to deviations from randomness, to one of predicting future choices. In this paper,we usedgeneralized linear regression and the framework of Reinforcement Learning in order to address both points. In particular, weused logistic regression analysis in order to characterize the temporal sequence of participants’ choices. Surprisingly, a population analysis indicated that the contribution of the most recent trial has only a weak effect on behavior, compared to more preceding trials, a result that seem irreconcilable with standard sequential effects that decay monotonously with the delay. However, when considering each participant separately, we found that the magnitudes of the sequential effect area monotonousdecreasing function of the delay, yet these individual sequential effectsare largely averaged outin a population analysis because of heterogeneity.The substantial behavioral heterogeneity in this task is further demonstrated quantitatively by considering the predictive power of the model. We show that a heterogeneous model of sequential dependencies captures the structure available in random sequence generation.Finally, we show that the results of the logistic regression analysis can be interpreted in the framework of reinforcement learning, allowing us to compare the sequential effects in the random sequence generation task to those in an operant learning task. We show that in contrast to the random sequence generation task, sequential effects in operant learning are far more homogenous across the population. These results suggest that in therandom sequence generation task, different participants adoptdifferent cognitive strategiesto suppress sequential dependencies when generating the “random” sequences.

Suggested Citation

  • Hanan Shteingart & Yonatan Loewenstein, 2016. "Heterogeneous Suppression of Sequential Effects in Random Sequence Generation, but not in Operant Learning," Discussion Paper Series dp701, The Federmann Center for the Study of Rationality, the Hebrew University, Jerusalem.
  • Handle: RePEc:huj:dispap:dp701
    as

    Download full text from publisher

    File URL: http://ratio.huji.ac.il/sites/default/files/publications/dp701.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Barron, Greg & Ursino, Giovanni, 2013. "Underweighting rare events in experience based decisions: Beyond sample error," Journal of Economic Psychology, Elsevier, vol. 39(C), pages 278-286.
    2. Hanan Shteingart & Yonatan Loewenstein, 2014. "Reinforcement Learning and Human Behavior," Discussion Paper Series dp656, The Federmann Center for the Study of Rationality, the Hebrew University, Jerusalem.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Maya Bar-Hillel & Cass R. Sunstein, 2019. "Baffling bathrooms: On navigability and choice architecture," Discussion Paper Series dp726, The Federmann Center for the Study of Rationality, the Hebrew University, Jerusalem.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Emmanuel Kemel & Muriel Travers, 2016. "Comparing attitudes toward time and toward money in experience-based decisions," Theory and Decision, Springer, vol. 80(1), pages 71-100, January.
    2. Robin Cubitt & Orestis Kopsacheilis & Chris Starmer, 2022. "An inquiry into the nature and causes of the Description - Experience gap," Journal of Risk and Uncertainty, Springer, vol. 65(2), pages 105-137, October.
    3. Tal Neiman & Yonatan Loewenstein, 2014. "Spatial Generalization in Operant Learning: Lessons from Professional Basketball," PLOS Computational Biology, Public Library of Science, vol. 10(5), pages 1-8, May.
    4. Ayton, Peter & Bernile, Gennaro & Bucciol, Alessandro & Zarri, Luca, 2020. "The impact of life experiences on risk taking," Journal of Economic Psychology, Elsevier, vol. 79(C).
    5. Aloys Prinz, 2019. "Learning (Not) to Evade Taxes," Games, MDPI, vol. 10(4), pages 1-18, September.
    6. Karthik Kannan & Vandith Pamuru & Yaroslav Rosokha, 2023. "Analyzing Frictions in Generalized Second-Price Auction Markets," Information Systems Research, INFORMS, vol. 34(4), pages 1437-1454, December.
    7. Tal Neiman & Yonatan Loewenstein, 2014. "Spatial Generalization in Operant Learning: Lessons from Professional Basketball," Discussion Paper Series dp665, The Federmann Center for the Study of Rationality, the Hebrew University, Jerusalem.
    8. Di Guida, Sibilla & Erev, Ido & Marchiori, Davide, 2015. "Cross cultural differences in decisions from experience: Evidence from Denmark, Israel, and Taiwan," Journal of Economic Psychology, Elsevier, vol. 49(C), pages 47-58.
    9. Gianluigi Mongillo & Hanan Shteingart & Yonatan Loewenstein, 2014. "The Misbehavior of Reinforcement Learning," Discussion Paper Series dp661, The Federmann Center for the Study of Rationality, the Hebrew University, Jerusalem.
    10. Ilke Aydogan & Yu Gao, 2020. "Experience and rationality under risk: re-examining the impact of sampling experience," Experimental Economics, Springer;Economic Science Association, vol. 23(4), pages 1100-1128, December.
    11. Caballero, Adrián & López-Pérez, Raúl, 2022. "Heterogeneous primacy and recency effects in frequency estimation," Journal of Economic Behavior & Organization, Elsevier, vol. 200(C), pages 182-203.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:huj:dispap:dp701. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Michael Simkin (email available below). General contact details of provider: https://edirc.repec.org/data/crihuil.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.