IDEAS home Printed from https://ideas.repec.org/p/hal/journl/hal-01300681.html
   My bibliography  Save this paper

Optimal Dynamic Resource Allocation to Prevent Defaults

Author

Listed:
  • Urtzi Ayesta

    (LAAS-SARA - Équipe Services et Architectures pour Réseaux Avancés - LAAS - Laboratoire d'analyse et d'architecture des systèmes - UT Capitole - Université Toulouse Capitole - UT - Université de Toulouse - INSA Toulouse - Institut National des Sciences Appliquées - Toulouse - INSA - Institut National des Sciences Appliquées - UT - Université de Toulouse - UT2J - Université Toulouse - Jean Jaurès - UT - Université de Toulouse - UT3 - Université Toulouse III - Paul Sabatier - UT - Université de Toulouse - CNRS - Centre National de la Recherche Scientifique - Toulouse INP - Institut National Polytechnique (Toulouse) - UT - Université de Toulouse)

  • M Erausquin
  • E Ferreira
  • P Jacko

    (Lancaster University)

Abstract

We consider a resource allocation problem, where a rational agent has to decide how to share a limited amount of resources among different companies that might be facing financial difficulties. The objective is to minimize the total long term cost incurred by the economy due to default events. Using the framework of multi-armed restless bandits and, assuming a two-state evolution of the default risk, the optimal dynamic resource sharing policy is determined. This policy assigns an index value to each company, which orders its priority to be funded. We obtain an analytical expression for this index, which generalizes the return-on-investment (ROI) index under the static setting, and we analyse the influence of the future events on the optimal dynamic policy. A discussion about the structure of the optimal dynamic policy is provided, as well as some extensions of the model.

Suggested Citation

  • Urtzi Ayesta & M Erausquin & E Ferreira & P Jacko, 2016. "Optimal Dynamic Resource Allocation to Prevent Defaults," Post-Print hal-01300681, HAL.
    • Handle: RePEc:hal:journl:hal-01300681
    Note: View the original document on HAL open archive server: https://hal.science/hal-01300681
    as

    Download full text from publisher

    File URL: https://hal.science/hal-01300681/document
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Roberts, Kevin & Weitzman, Martin L, 1981. "Funding Criteria for Research, Development, and Exploration Projects," Econometrica, Econometric Society, vol. 49(5), pages 1261-1288, September.
    2. Viral V. Acharya & Tanju Yorulmazer, 2008. "Cash-in-the-Market Pricing and Optimal Resolution of Bank Failures," The Review of Financial Studies, Society for Financial Studies, vol. 21(6), pages 2705-2742, November.
    3. Rothschild, Michael, 1974. "A two-armed bandit theory of market pricing," Journal of Economic Theory, Elsevier, vol. 9(2), pages 185-202, October.
    4. Robert A. Jarrow & David Lando & Stuart M. Turnbull, 2008. "A Markov Model for the Term Structure of Credit Risk Spreads," World Scientific Book Chapters, in: Financial Derivatives Pricing Selected Works of Robert Jarrow, chapter 18, pages 411-453, World Scientific Publishing Co. Pte. Ltd..
    5. Rustichini, Aldo & Wolinsky, Asher, 1995. "Learning about variable demand in the long run," Journal of Economic Dynamics and Control, Elsevier, vol. 19(5-7), pages 1283-1292.
    6. Godfrey Keller & Sven Rady & Martin Cripps, 2005. "Strategic Experimentation with Exponential Bandits," Econometrica, Econometric Society, vol. 73(1), pages 39-68, January.
    7. Dinesh Kumar, U. & Saranga, Haritha, 2010. "Optimal selection of obsolescence mitigation strategies using a restless bandit model," European Journal of Operational Research, Elsevier, vol. 200(1), pages 170-180, January.
    8. McLennan, Andrew, 1984. "Price dispersion and incomplete learning in the long run," Journal of Economic Dynamics and Control, Elsevier, vol. 7(3), pages 331-347, September.
    9. Glazebrook, K. D. & Mitchell, H. M. & Ansell, P. S., 2005. "Index policies for the maintenance of a collection of machines by a set of repairmen," European Journal of Operational Research, Elsevier, vol. 165(1), pages 267-284, August.
    10. Li, Dong & Glazebrook, Kevin D., 2011. "A Bayesian approach to the triage problem with imperfect classification," European Journal of Operational Research, Elsevier, vol. 215(1), pages 169-180, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Shivam Gupta & Sachin Modgil & Samadrita Bhattacharyya & Indranil Bose, 2022. "Artificial intelligence for decision support systems in the field of operations research: review and future scope of research," Annals of Operations Research, Springer, vol. 308(1), pages 215-274, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Urtzi Ayesta & M Erausquin & E Ferreira & P Jacko, 2016. "Optimal Dynamic Resource Allocation to Prevent Defaults," Working Papers hal-01300681, HAL.
    2. Agbo, Maxime, 2015. "A perpetual search for talents across overlapping generations: A learning process," Mathematical Social Sciences, Elsevier, vol. 76(C), pages 131-145.
    3. Mason, Robin & Välimäki, Juuso, 2011. "Learning about the arrival of sales," Journal of Economic Theory, Elsevier, vol. 146(4), pages 1699-1711, July.
    4. Keller, Godfrey & Novák, Vladimír & Willems, Tim, 2019. "A note on optimal experimentation under risk aversion," Journal of Economic Theory, Elsevier, vol. 179(C), pages 476-487.
    5. Asaf Cohen & Eilon Solan, 2013. "Bandit Problems with Lévy Processes," Mathematics of Operations Research, INFORMS, vol. 38(1), pages 92-107, February.
    6. Klimenko, Mikhail M., 2004. "Industrial targeting, experimentation and long-run specialization," Journal of Development Economics, Elsevier, vol. 73(1), pages 75-105, February.
    7. Wieland, Volker, 2000. "Learning by doing and the value of optimal experimentation," Journal of Economic Dynamics and Control, Elsevier, vol. 24(4), pages 501-534, April.
    8. Gomes, Renato & Gottlieb, Daniel & Maestri, Lucas, 2016. "Experimentation and project selection: Screening and learning," Games and Economic Behavior, Elsevier, vol. 96(C), pages 145-169.
    9. , & ,, 2010. "Strategic experimentation with Poisson bandits," Theoretical Economics, Econometric Society, vol. 5(2), May.
    10. Nicolas Klein & Tymofiy Mylovanov, 2011. "Should the Flatterers be Avoided?," 2011 Meeting Papers 1273, Society for Economic Dynamics.
    11. Besanko, David & Tong, Jian & Wu, Jianjun, 2016. "Subsidizing research programs with "if" and "when" uncertainty in the face of severe informational constraints," Discussion Paper Series In Economics And Econometrics 1605, Economics Division, School of Social Sciences, University of Southampton.
    12. Heidhues, Paul & Rady, Sven & Strack, Philipp, 2015. "Strategic experimentation with private payoffs," Journal of Economic Theory, Elsevier, vol. 159(PA), pages 531-551.
    13. Maloney,William F. & Zambrano,Andrés, 2021. "Learning to Learn : Experimentation, Entrepreneurial Capital, and Development," Policy Research Working Paper Series 9890, The World Bank.
    14. Roland G. Fryer, Jr. & Philipp Harms, 2013. "Two-Armed Restless Bandits with Imperfect Information: Stochastic Control and Indexability," NBER Working Papers 19043, National Bureau of Economic Research, Inc.
    15. Arthur Charpentier & Romuald Élie & Carl Remlinger, 2023. "Reinforcement Learning in Economics and Finance," Computational Economics, Springer;Society for Computational Economics, vol. 62(1), pages 425-462, June.
    16. Bergemann, Dirk & Valimaki, Juuso, 1996. "Learning and Strategic Pricing," Econometrica, Econometric Society, vol. 64(5), pages 1125-1149, September.
    17. Deimen, Inga & Wirtz, Julia, 2022. "Control, cost, and confidence: Perseverance and procrastination in the face of failure," Games and Economic Behavior, Elsevier, vol. 134(C), pages 52-74.
    18. Sorensen, Morten, 2007. "Learning by Investing: Evidence from Venture Capital," SIFR Research Report Series 53, Institute for Financial Research.
    19. Batlome Janjgava & Sergey Slobodyan, 2011. "Duopoly Competition, Escape Dynamics and Non-cooperative Collusion," CERGE-EI Working Papers wp445, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    20. Ilan Kremer & Yishay Mansour & Motty Perry, 2014. "Implementing the "Wisdom of the Crowd"," Journal of Political Economy, University of Chicago Press, vol. 122(5), pages 988-1012.

    More about this item

    Keywords

    Multi-Armed Bandit Problem; Default Risk Management; Dynamic Resource Allocation Policies; Markov Decision Processes;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:journl:hal-01300681. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.