IDEAS home Printed from https://ideas.repec.org/a/nea/journl/y2013i20p33-50.html
   My bibliography  Save this article

The Optimality of Choice by Markov Random Walk

Author

Listed:
  • Zutler, I.

    (National Research University Higher School of Economics, Moscow, Russia)

Abstract

In the rational choice problem Zutler (2011) proposed a model of choice by continuous Markov random walk on a set of alternatives to find the best. In this paper we investigate the optimal properties of obtained solutions. It is shown that the result of this choice is the maximal element on a set of lotteries with respect to relation p > q iff F(p, q) > F(q, p) for special function F(., .) that has a natural interpretation as flow of probability from one to another lottery. It is shown the relationship between the problems of choosing the best alternative and non-cooperative games solution. It is proved that Nash equilibrium is a stationary point of a dynamical system of the continuous random walk of players on the set of available strategies. The intensity transition of the player from one strategy to another is equal to his assessment of increase of payoff in the alleged current rival's strategies.

Suggested Citation

  • Zutler, I., 2013. "The Optimality of Choice by Markov Random Walk," Journal of the New Economic Association, New Economic Association, vol. 20(4), pages 33-50.
    • Handle: RePEc:nea:journl:y:2013:i:20:p:33-50
    as

    Download full text from publisher

    File URL: http://www.econorus.org/repec/journl/2013-20-33-50r.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Fishburn, Peter C, 1978. "A Probabilistic Expected Utility Theory of Risky Binary Choices," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 19(3), pages 633-646, October.
    2. Pavlo Blavatskyy, 2012. "Probabilistic choice and stochastic dominance," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 50(1), pages 59-83, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. A. Tatarkin I. & А. Татаркин И., 2014. "Социальный Вектор Смешанной Модели Экономического Развития России // The Social Vector Of A Mixed Model Of The Russian Economic Development," Финансы: теория и практика/Finance: Theory and Practice // Finance: Theory and Practice, ФГОБУВО Финансовый университет при Правительстве Российской Федерации // Financial University under The Government of Russian Federation, issue 6, pages 10-21.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dagsvik, John K., 2015. "Stochastic models for risky choices: A comparison of different axiomatizations," Journal of Mathematical Economics, Elsevier, vol. 60(C), pages 81-88.
    2. Blavatskyy, Pavlo, 2016. "Probability weighting and L-moments," European Journal of Operational Research, Elsevier, vol. 255(1), pages 103-109.
    3. Pavlo Blavatskyy, 2021. "Probabilistic independence axiom," The Geneva Risk and Insurance Review, Palgrave Macmillan;International Association for the Study of Insurance Economics (The Geneva Association), vol. 46(1), pages 21-34, March.
    4. Pavlo Blavatskyy, 2018. "A Refinement of Logit Quantal Response Equilibrium," International Game Theory Review (IGTR), World Scientific Publishing Co. Pte. Ltd., vol. 20(02), pages 1-14, June.
    5. Machina, Mark J, 1982. ""Expected Utility" Analysis without the Independence Axiom," Econometrica, Econometric Society, vol. 50(2), pages 277-323, March.
    6. Pavlo Blavatskyy, 2009. "Preference reversals and probabilistic decisions," Journal of Risk and Uncertainty, Springer, vol. 39(3), pages 237-250, December.
    7. Pavlo Blavatskyy, 2012. "Probabilistic choice and stochastic dominance," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 50(1), pages 59-83, May.
    8. Dino Borie, 2016. "Expected Multi-Utility Representations by "Simplex" with Applications," GREDEG Working Papers 2016-10, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.
    9. Matthew Ryan, 2021. "Stochastic expected utility for binary choice: a ‘modular’ axiomatic foundation," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 72(2), pages 641-669, September.
    10. Blavatskyy, Pavlo, 2013. "Which decision theory?," Economics Letters, Elsevier, vol. 120(1), pages 40-44.
    11. Nathaniel T. Wilcox, 2015. "Error and Generalization in Discrete Choice Under Risk," Working Papers 15-11, Chapman University, Economic Science Institute.
    12. Pavlo R. Blavatskyy, 2020. "Dual choice axiom and probabilistic choice," Journal of Risk and Uncertainty, Springer, vol. 61(1), pages 25-41, August.
    13. Blavatskyy, Pavlo R., 2012. "Probabilistic subjective expected utility," Journal of Mathematical Economics, Elsevier, vol. 48(1), pages 47-50.
    14. Dagsvik, John K., 2008. "Axiomatization of stochastic models for choice under uncertainty," Mathematical Social Sciences, Elsevier, vol. 55(3), pages 341-370, May.
    15. Blavatskyy, Pavlo R., 2008. "Stochastic utility theorem," Journal of Mathematical Economics, Elsevier, vol. 44(11), pages 1049-1056, December.
    16. Michael H. Birnbaum & Ulrich Schmidt & Miriam D. Schneider, 2017. "Testing independence conditions in the presence of errors and splitting effects," Journal of Risk and Uncertainty, Springer, vol. 54(1), pages 61-85, February.
    17. Pavlo R. Blavatskyy, 2011. "A Model of Probabilistic Choice Satisfying First-Order Stochastic Dominance," Management Science, INFORMS, vol. 57(3), pages 542-548, March.
    18. Blavatskyy, Pavlo, 2019. "Future plans and errors," Mathematical Social Sciences, Elsevier, vol. 102(C), pages 85-92.
    19. Blavatskyy, Pavlo, 2015. "Behavior in the centipede game: A decision-theoretical perspective," Economics Letters, Elsevier, vol. 133(C), pages 117-122.
    20. John K. Dagsvik, 2005. "Choice under Uncertainty and Bounded Rationality," Discussion Papers 409, Statistics Norway, Research Department.

    More about this item

    Keywords

    decision theory; continuous Markov process; Nash equilibrium;
    All these keywords.

    JEL classification:

    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty
    • C72 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Noncooperative Games
    • C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games
    • C44 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Operations Research; Statistical Decision Theory

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nea:journl:y:2013:i:20:p:33-50. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Alexey Tcharykov (email available below). General contact details of provider: https://edirc.repec.org/data/nearuea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.