A Stochastic Lake Game
AbstractIn this paper we solve a stochastic dynamic programming problem for the solution to a dynamic game in which the players select a mean level of control. The state transition dynamics are a function of the current state of the system and a multiplicative noise factor on the control variables of the players. The particular application is to lake water usage. (A deterministic version of the model was analyzed by Brock and Dechert, "The Lakegame.") The control variables are the levels of phosphorus discharged (typically by farmers) into the water shed of the lake, and the random shock is the level of rainfall that washes the phosphorus in to the lake. The state of the system is the accumulated level of phosphorus in the lake. The system dynamics are sufficiently non-linear so that there can be two Nash equilibria, and hence a Skiba point can be present in the optimal control solution. In the paper we analyze (numerically) how the dynamics and the Skiba point change as the variance of the noise (the rain) increases. The numerical analysis uses a result of Dechert (JET 1978) that allows us to construct a potential function for the dynamic game. This greatly reduces the computational burden in finding Nash equilibrium solutions for the dynamic game.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Society for Computational Economics in its series Computing in Economics and Finance 2004 with number 104.
Date of creation: 11 Aug 2004
Date of revision:
stochastic dynamic programming; dynamic game; potential function;
Find related papers by JEL classification:
- C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
- C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
- C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games
This paper has been announced in the following NEP Reports:
You can help add them by filling out this form.
reading list or among the top items on IDEAS.Access and download statisticsgeneral information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Christopher F. Baum).
If references are entirely missing, you can add them using this form.