IDEAS home Printed from https://ideas.repec.org/p/wpa/wuwpco/9403001.html
   My bibliography  Save this paper

Using Randomization to Break the Curse of Dimensionality

Author

Listed:
  • John Rust
  • Department of Economics
  • University of Wisconsin

Abstract

This paper introduces random versions of successive approximations and multigrid algorithms for computing approximate solutions to a class of finite and infinite horizon Markovian decision problems (MDPs). We prove that these algorithms succeed in breaking the curse of dimensionality for a subclass of MDPs known as discrete decision processes (DDPs).

Suggested Citation

  • John Rust & Department of Economics & University of Wisconsin, 1994. "Using Randomization to Break the Curse of Dimensionality," Computational Economics 9403001, University Library of Munich, Germany, revised 19 Nov 1996.
    • Handle: RePEc:wpa:wuwpco:9403001
    Note: TeX file, Postscript version submitted
    as

    Download full text from publisher

    File URL: https://econwpa.ub.uni-muenchen.de/econ-wp/comp/papers/9403/9403001.pdf
    Download Restriction: no
    File URL: https://econwpa.ub.uni-muenchen.de/econ-wp/comp/papers/9403/9403001.ps.gz
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Rust, John, 1987. "Optimal Replacement of GMC Bus Engines: An Empirical Model of Harold Zurcher," Econometrica, Econometric Society, vol. 55(5), pages 999-1033, September.
    2. Tauchen, George & Hussey, Robert, 1991. "Quadrature-Based Methods for Obtaining Approximate Solutions to Nonlinear Asset Pricing Models," Econometrica, Econometric Society, vol. 59(2), pages 371-396, March.
    3. Anderson, Evan W. & McGrattan, Ellen R. & Hansen, Lars Peter & Sargent, Thomas J., 1996. "Mechanics of forming and estimating dynamic linear economies," Handbook of Computational Economics, in: H. M. Amman & D. A. Kendrick & J. Rust (ed.), Handbook of Computational Economics, edition 1, volume 1, chapter 4, pages 171-252, Elsevier.
    4. Keane, Michael P & Wolpin, Kenneth I, 1994. "The Solution and Estimation of Discrete Choice Dynamic Programming Models by Simulation and Interpolation: Monte Carlo Evidence," The Review of Economics and Statistics, MIT Press, vol. 76(4), pages 648-672, November.
    5. Ariel Pakes & Paul McGuire, 1997. "Stochastic Algorithms for Dynamic Models: Markov Perfect Equilibrium, and the 'Curse' of Dimensionality," Cowles Foundation Discussion Papers 1144, Cowles Foundation for Research in Economics, Yale University.
    6. Judd, Kenneth L., 1996. "Approximation, perturbation, and projection methods in economic analysis," Handbook of Computational Economics, in: H. M. Amman & D. A. Kendrick & J. Rust (ed.), Handbook of Computational Economics, edition 1, volume 1, chapter 12, pages 509-585, Elsevier.
    7. Hans M. Amman & David A. Kendrick, . "Computational Economics," Online economics textbooks, SUNY-Oswego, Department of Economics, number comp1.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. John Rust, 1997. "A Comparison of Policy Iteration Methods for Solving Continuous-State, Infinite-Horizon Markovian Decision Problems Using Random, Quasi-random, and Deterministic Discretizations," Computational Economics 9704001, University Library of Munich, Germany.
    2. Willi Semmler & Lars Grüne, 2004. "Asset Pricing with Delayed Consumption Decisions," Computing in Economics and Finance 2004 59, Society for Computational Economics.
    3. Aguirregabiria, Victor & Mira, Pedro, 2010. "Dynamic discrete choice structural models: A survey," Journal of Econometrics, Elsevier, vol. 156(1), pages 38-67, May.
    4. Bound, John & Stinebrickner, Todd & Waidmann, Timothy, 2010. "Health, economic resources and the work decisions of older men," Journal of Econometrics, Elsevier, vol. 156(1), pages 106-129, May.
    5. Gamba, Andrea & Tesser, Matteo, 2009. "Structural estimation of real options models," Journal of Economic Dynamics and Control, Elsevier, vol. 33(4), pages 798-816, April.
    6. Kristensen, Dennis & Salanié, Bernard, 2017. "Higher-order properties of approximate estimators," Journal of Econometrics, Elsevier, vol. 198(2), pages 189-208.
    7. Harikesh Nair, 2007. "Intertemporal price discrimination with forward-looking consumers: Application to the US market for console video-games," Quantitative Marketing and Economics (QME), Springer, vol. 5(3), pages 239-292, September.
    8. Todd R. Stinebrickner, 2000. "Serially correlated variables in dynamic, discrete choice models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(6), pages 595-624.
    9. Grune, Lars & Semmler, Willi, 2004. "Using dynamic programming with adaptive grid scheme for optimal control problems in economics," Journal of Economic Dynamics and Control, Elsevier, vol. 28(12), pages 2427-2456, December.
    10. Anderson, Evan W. & Hansen, Lars Peter & Sargent, Thomas J., 2012. "Small noise methods for risk-sensitive/robust economies," Journal of Economic Dynamics and Control, Elsevier, vol. 36(4), pages 468-500.
    11. John Bound & Todd Stinebrickner & Timothy Waidman, 2004. "Using a Structural Retirement Model to Simulate the Effect of Changes to the OASDI and Medicare Programs," Working Papers wp091, University of Michigan, Michigan Retirement Research Center.
    12. Victor Aguirregabiria & Pedro Mira, 2000. "Structural Models Involving Highly Dimensional Fixed Point Problems: An Asymptotically Efficient Two-Stage Estimator," Econometric Society World Congress 2000 Contributed Papers 1702, Econometric Society.
    13. Yamaguchi, Shintaro, 2010. "The effect of match quality and specific experience on career decisions and wage growth," Labour Economics, Elsevier, vol. 17(2), pages 407-423, April.
    14. Maria Casanova-Rivas, 2008. "Dynamic Complementarities: A Computational and Empirical Analysis of Couples' Retirement Decisions," 2008 Meeting Papers 1073, Society for Economic Dynamics.
    15. Jesús Fernández-Villaverde & Juan F. Rubio-Ramirez, 2001. "Comparing dynamic equilibrium economies to data," FRB Atlanta Working Paper 2001-23, Federal Reserve Bank of Atlanta.
    16. Hu Yingyao & Shum Matthew & Tan Wei & Xiao Ruli, 2017. "A Simple Estimator for Dynamic Models with Serially Correlated Unobservables," Journal of Econometric Methods, De Gruyter, vol. 6(1), pages 1-16, January.
    17. Mingliang Li, 2006. "High school completion and future youth unemployment: new evidence from High School and Beyond," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(1), pages 23-53.
    18. Linnea Polgreen & Pedro Silos, 2008. "Capital-Skill Complementarity and Inequality: A Sensitivity Analysis," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 11(2), pages 302-313, April.
    19. Patrick Bajari & C. Lanier Benkard & Jonathan Levin, 2007. "Estimating Dynamic Models of Imperfect Competition," Econometrica, Econometric Society, vol. 75(5), pages 1331-1370, September.
    20. Kristensen, Dennis & Mogensen, Patrick K. & Moon, Jong Myun & Schjerning, Bertel, 2021. "Solving dynamic discrete choice models using smoothing and sieve methods," Journal of Econometrics, Elsevier, vol. 223(2), pages 328-360.

    More about this item

    JEL classification:

    • C8 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wpa:wuwpco:9403001. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: EconWPA (email available below). General contact details of provider: https://econwpa.ub.uni-muenchen.de .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.