IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2605.02681.html

The Design and Composition of Structural Causal Decision Processes

Author

Listed:
  • Sebastian Benthall
  • Alan Lujan

Abstract

We present two new classes of causal models of decision-making agents. Our approach is motivated by the needs of modeling the economics of computing systems. These systems are composed of subsystems and can exhibit endogenous limits on cognitive resources and value discounting. Structural Causal Decision Models (SCDMs) expand on Structural Causal Influence Models. Like SCIMs, they explicitly represent the causal relationships between model variables and the payoffs of agent decisions. Additionally, agent decisions can be constrained by their causal antecedents, and SCDMs can have open root variables for which no probability distribution or structural equation is given. We show that SCDMs have a well-defined and computationally useful property of composability. Building on SCDMs, we then define a Structural Causal Decision Process (SCDP) as a recurring SCDM with a discount variable. SCDPs benefit from the useful composition properties of SCDMs. Moreover, SCDPs are strictly more expressive than POMDPs because they do not assume rational belief formation. Indeed, an SCDP can endogenously model the memory-formation process, and is thus useful for modeling resource rational agents in dynamic settings. SCDPs are also capable of modeling variable discounting, a tool used widely in social scientific modeling. We pose that SCDPs are a useful framework for policy simulation for the digital economy, mechanism design for information systems, and digital twin modeling of cyberinfrastructure.

Suggested Citation

  • Sebastian Benthall & Alan Lujan, 2026. "The Design and Composition of Structural Causal Decision Processes," Papers 2605.02681, arXiv.org.
  • Handle: RePEc:arx:papers:2605.02681
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2605.02681
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Axelrod, Robert, 2006. "Agent-based Modeling as a Bridge Between Disciplines," Handbook of Computational Economics, in: Leigh Tesfatsion & Kenneth L. Judd (ed.), Handbook of Computational Economics, edition 1, volume 2, chapter 33, pages 1565-1584, Elsevier.
    2. Koller, Daphne & Milch, Brian, 2003. "Multi-agent influence diagrams for representing and solving games," Games and Economic Behavior, Elsevier, vol. 45(1), pages 181-221, October.
    3. András Borsos & Adrian Carro & Aldo Glielmo & Marc Hinterschweiger & Jagoda Kaszowska-Mojsa & Arzu Uluc, 2025. "Agent-based modeling at central banks: recent developments and new challenges," Bank of England working papers 1122, Bank of England.
    4. Per Krusell & Anthony A. Smith & Jr., 1998. "Income and Wealth Heterogeneity in the Macroeconomy," Journal of Political Economy, University of Chicago Press, vol. 106(5), pages 867-896, October.
    5. Harris, Christopher & Laibson, David, 2001. "Dynamic Choices of Hyperbolic Consumers," Econometrica, Econometric Society, vol. 69(4), pages 935-957, July.
    6. David Laibson, 1997. "Golden Eggs and Hyperbolic Discounting," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 112(2), pages 443-478.
    7. Krusell, Per & Kuruscu, Burhanettin & Smith, Anthony Jr., 2002. "Equilibrium Welfare and Government Policy with Quasi-geometric Discounting," Journal of Economic Theory, Elsevier, vol. 105(1), pages 42-72, July.
    8. Stachurski, John & Zhang, Junnan, 2021. "Dynamic programming with state-dependent discounting," Journal of Economic Theory, Elsevier, vol. 192(C).
    9. Cao, Dan, 2020. "Recursive equilibrium in Krusell and Smith (1998)," Journal of Economic Theory, Elsevier, vol. 186(C).
    10. repec:bde:opaper:2503 is not listed on IDEAS
    11. Maliar, Lilia & Maliar, Serguei & Winant, Pablo, 2021. "Deep learning for solving dynamic economic models," Journal of Monetary Economics, Elsevier, vol. 122(C), pages 76-101.
    12. Ross D. Shachter, 1986. "Evaluating Influence Diagrams," Operations Research, INFORMS, vol. 34(6), pages 871-882, December.
    13. Joshua M. Epstein & Robert L. Axtell, 1996. "Growing Artificial Societies: Social Science from the Bottom Up," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262550253, December.
    14. O Balci & J D Arthur & W F Ormsby, 2011. "Achieving reusability and composability with a simulation conceptual model," Journal of Simulation, Taylor & Francis Journals, vol. 5(3), pages 157-165, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Maliar, Lilia & Maliar, Serguei, 2006. "The Neoclassical Growth Model with Heterogeneous Quasi-Geometric Consumers," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(3), pages 635-654, April.
    2. Lilia Maliar & Serguei Maliar, 2003. "Heterogeneity In The Degree Of Quasi-Geometric Discounting: The Distributional Implications," Working Papers. Serie AD 2003-28, Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie).
    3. Thomas J. Sargent & John Stachurski, 2024. "Dynamic Programming: Finite States," Papers 2401.10473, arXiv.org.
    4. Bernd Huber & Marco Runkel, 2008. "Hyperbolic Discounting, Public Debt And Balanced Budget Rules," Scottish Journal of Political Economy, Scottish Economic Society, vol. 55(5), pages 543-560, November.
    5. Lilia Maliar & Serguei Maliar, 2004. "Quasi‐geometric discounting: A closed‐form solution under the exponential utility function," Bulletin of Economic Research, Wiley Blackwell, vol. 56(2), pages 201-206, April.
    6. A. S. Nowak, 2010. "On a Noncooperative Stochastic Game Played by Internally Cooperating Generations," Journal of Optimization Theory and Applications, Springer, vol. 144(1), pages 88-106, January.
    7. Lilia Maliar & Serguei Maliar, 2003. "Solving The Neoclassical Growth Model With Quasi-Geometric Discounting: Non-Linear Euler-Equation Models," Working Papers. Serie AD 2003-23, Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie).
    8. Kirill Borissov & Mikhail Pakhnin & Ronald Wendner, 2020. "Naive Agents with Quasi-hyperbolic Discounting and Perfect Foresight," EUSP Department of Economics Working Paper Series 2020/03, European University at St. Petersburg, Department of Economics.
    9. Agah R. Turan, 2019. "Intentional time inconsistency," Theory and Decision, Springer, vol. 86(1), pages 41-64, February.
    10. Christos Kotsogiannis & Robert Schwager, 2022. "Present bias and externalities: Can government intervention raise welfare?," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 55(3), pages 1480-1506, August.
    11. Luttmer, Erzo G.J. & Mariotti, Thomas, 2007. "Efficiency and equilibrium when preferences are time-inconsistent," Journal of Economic Theory, Elsevier, vol. 132(1), pages 493-506, January.
    12. Maliar, Lilia & Maliar, Serguei, 2006. "Indeterminacy in a log-linearized neoclassical growth model with quasi-geometric discounting," Economic Modelling, Elsevier, vol. 23(3), pages 492-505, May.
    13. Love, David A., 2017. "Countercyclical retirement accounts," European Economic Review, Elsevier, vol. 98(C), pages 32-48.
    14. Alexis Akira Toda, 2021. "Perov's Contraction Principle and Dynamic Programming with Stochastic Discounting," Papers 2103.14173, arXiv.org, revised Sep 2021.
    15. Lilia Maliar & Serguei Maliar, 2005. "Solving the Neoclassical Growth Model with Quasi-Geometric Discounting: A Grid-Based Euler-Equation Method," Computational Economics, Springer;Society for Computational Economics, vol. 26(2), pages 163-172, October.
    16. Anna Jaśkiewicz & Andrzej S. Nowak, 2021. "Markov decision processes with quasi-hyperbolic discounting," Finance and Stochastics, Springer, vol. 25(2), pages 189-229, April.
    17. Takeshi Ojima, 2018. "General Equilibrium Dynamics with Naïve and Sophisticated Hyperbolic Consumers in an Overlapping Generations Economy," Economica, London School of Economics and Political Science, vol. 85(338), pages 281-304, April.
    18. Koichi Futagami & Yuta Nakabo, 2021. "Capital accumulation game with quasi-geometric discounting and consumption externalities," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 71(1), pages 251-281, February.
    19. Azzimonti, Marina & de Francisco, Eva & Krusell, Per, 2008. "Production subsidies and redistribution," Journal of Economic Theory, Elsevier, vol. 142(1), pages 73-99, September.
    20. Hanming Fang & Dan Silverman, 2009. "Time-Inconsistency And Welfare Program Participation: Evidence From The Nlsy," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 50(4), pages 1043-1077, November.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2605.02681. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.