IDEAS home Printed from https://ideas.repec.org/p/fip/fedcwp/1210.html
   My bibliography  Save this paper

Approximating high-dimensional dynamic models: sieve value function iteration

Author

Listed:
  • Peter Arcidiacono
  • Patrick Bayer
  • Federico A. Bugni
  • Jonathan James

Abstract

Many dynamic problems in economics are characterized by large state spaces, which make both computing and estimating the model infeasible. We introduce a method for approximating the value function of high-dimensional dynamic models based on sieves and establish results for the: (a) consistency, (b) rates of convergence, and (c) bounds on the error of approximation. We embed this method for approximating the solution to the dynamic problem within an estimation routine and prove that it provides consistent estimates of the model's parameters. We provide Monte Carlo evidence that our method can successfully be used to approximate models that would otherwise be infeasible to compute, suggesting that these techniques may substantially broaden the class of models that can be solved and estimated.

Suggested Citation

  • Peter Arcidiacono & Patrick Bayer & Federico A. Bugni & Jonathan James, 2012. "Approximating high-dimensional dynamic models: sieve value function iteration," Working Papers (Old Series) 1210, Federal Reserve Bank of Cleveland.
  • Handle: RePEc:fip:fedcwp:1210
    DOI: 10.26509/frbc-wp-201210
    as

    Download full text from publisher

    File URL: https://doi.org/10.26509/frbc-wp-201210r
    File Function: Full Text
    Download Restriction: no

    File URL: https://www.clevelandfed.org/-/media/project/clevelandfedtenant/clevelandfedsite/publications/working-papers/2012/wp-1210r-approximating-high-dimensional-dynamic-models-sieve-value-function-iteration-pdf.pdf
    File Function: Full text
    Download Restriction: no

    File URL: https://libkey.io/10.26509/frbc-wp-201210?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Rust, John, 1987. "Optimal Replacement of GMC Bus Engines: An Empirical Model of Harold Zurcher," Econometrica, Econometric Society, vol. 55(5), pages 999-1033, September.
    2. Igal Hendel & Aviv Nevo, 2006. "Sales and consumer inventory," RAND Journal of Economics, RAND Corporation, vol. 37(3), pages 543-561, September.
    3. Victor Aguirregabiria & Pedro Mira, 2002. "Swapping the Nested Fixed Point Algorithm: A Class of Estimators for Discrete Markov Decision Models," Econometrica, Econometric Society, vol. 70(4), pages 1519-1543, July.
    4. Hugo Benitez-Silva & John Rust & Gunter Hitsch & Giorgio Pauletto & George Hall, 2000. "A Comparison Of Discrete And Parametric Methods For Continuous-State Dynamic Programming Problems," Computing in Economics and Finance 2000 24, Society for Computational Economics.
    5. Gregory S. Crawford & Matthew Shum, 2005. "Uncertainty and Learning in Pharmaceutical Demand," Econometrica, Econometric Society, vol. 73(4), pages 1137-1173, July.
    6. Keane, Michael P & Wolpin, Kenneth I, 1994. "The Solution and Estimation of Discrete Choice Dynamic Programming Models by Simulation and Interpolation: Monte Carlo Evidence," The Review of Economics and Statistics, MIT Press, vol. 76(4), pages 648-672, November.
    7. Chen, Xiaohong, 2007. "Large Sample Sieve Estimation of Semi-Nonparametric Models," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 76, Elsevier.
    8. Igal Hendel & Aviv Nevo, 2006. "Measuring the Implications of Sales and Consumer Inventory Behavior," Econometrica, Econometric Society, vol. 74(6), pages 1637-1673, November.
    9. Igal Hendel & Aviv Nevo, 2006. "Sales and Consumer Inventory," RAND Journal of Economics, The RAND Corporation, vol. 37(3), pages 543-561, Autumn.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Shintaro Yamaguchi, 2016. "Effects of Parental Leave Policies on Female Career and Fertility Choices," Department of Economics Working Papers 2016-10, McMaster University.
    2. Meredith Fowlie & Mar Reguant & Stephen P. Ryan, 2016. "Market-Based Emissions Regulation and Industry Dynamics," Journal of Political Economy, University of Chicago Press, vol. 124(1), pages 249-302.
    3. Panle Jia Barwick & Parag A. Pathak, 2015. "The costs of free entry: an empirical study of real estate agents in Greater Boston," RAND Journal of Economics, RAND Corporation, vol. 46(1), pages 103-145, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrew Ching & Susumu Imai & Masakazu Ishihara & Neelam Jain, 2012. "A practitioner’s guide to Bayesian estimation of discrete choice dynamic programming models," Quantitative Marketing and Economics (QME), Springer, vol. 10(2), pages 151-196, June.
    2. Aguirregabiria, Victor & Mira, Pedro, 2010. "Dynamic discrete choice structural models: A survey," Journal of Econometrics, Elsevier, vol. 156(1), pages 38-67, May.
    3. Daniel Ackerberg, 2009. "A new use of importance sampling to reduce computational burden in simulation estimation," Quantitative Marketing and Economics (QME), Springer, vol. 7(4), pages 343-376, December.
    4. Mantian (Mandy) Hu & Chu (Ivy) Dang & Pradeep K. Chintagunta, 2019. "Search and Learning at a Daily Deals Website," Marketing Science, INFORMS, vol. 38(4), pages 609-642, July.
    5. Kalouptsidi, Myrto & Scott, Paul & Souza-Rodrigues, Edouardo, 2015. "Identification of Counterfactuals and Payoffs in Dynamic Discrete Choice with an Application to Land Use," TSE Working Papers 15-596, Toulouse School of Economics (TSE).
    6. Chen, Chia-Wen, 2014. "Estimating the foreclosure effect of exclusive dealing: Evidence from the entry of specialty beer producers," International Journal of Industrial Organization, Elsevier, vol. 37(C), pages 47-64.
    7. Myrto Kalouptsidi & Paul T. Scott & Eduardo Souza‐Rodrigues, 2021. "Identification of counterfactuals in dynamic discrete choice models," Quantitative Economics, Econometric Society, vol. 12(2), pages 351-403, May.
    8. Kalouptsidi, Myrto & Souza-Rodrigues, Eduardo & Scott, Paul, 2017. "Identification of Counterfactuals in Dynamic Discrete Choice Models," CEPR Discussion Papers 12470, C.E.P.R. Discussion Papers.
    9. Victor Aguirregabiria & Margaret Slade, 2017. "Empirical models of firms and industries," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 50(5), pages 1445-1488, December.
    10. Blevins, Jason R. & Kim, Minhae, 2024. "Nested Pseudo likelihood estimation of continuous-time dynamic discrete games," Journal of Econometrics, Elsevier, vol. 238(2).
    11. Andrew T. Ching & Tülin Erdem & Michael P. Keane, 2013. "Invited Paper ---Learning Models: An Assessment of Progress, Challenges, and New Developments," Marketing Science, INFORMS, vol. 32(6), pages 913-938, November.
    12. Myrto Kalouptsidi & Paul T. Scott & Eduardo Souza-Rodrigues, 2018. "Linear IV Regression Estimators for Structural Dynamic Discrete Choice Models," NBER Working Papers 25134, National Bureau of Economic Research, Inc.
    13. Huang, Yufeng, 2015. "Empirical analysis of consumer behavior," Other publications TiSEM 9cc96a79-43d7-436d-87d3-3, Tilburg University, School of Economics and Management.
    14. Masakazu Ishihara & Andrew T. Ching, 2019. "Dynamic Demand for New and Used Durable Goods Without Physical Depreciation: The Case of Japanese Video Games," Marketing Science, INFORMS, vol. 38(3), pages 392-416, May.
    15. Andrew T. Ching & Tülin Erdem & Michael P. Keane, 2013. "Learning Models: An Assessment of Progress, Challenges and New Developments," Economics Papers 2013-W07, Economics Group, Nuffield College, University of Oxford.
    16. Kalouptsidi, Myrto & Scott, Paul T. & Souza-Rodrigues, Eduardo, 2021. "Linear IV regression estimators for structural dynamic discrete choice models," Journal of Econometrics, Elsevier, vol. 222(1), pages 778-804.
    17. Myrto Kalouptsidi & Paul T. Scott & Eduardo Souza-Rodrigues, 2015. "Identification of Counterfactuals in Dynamic Discrete Choice Models," NBER Working Papers 21527, National Bureau of Economic Research, Inc.
    18. Scott, Paul, 2014. "Dynamic Discrete Choice Estimation of Agricultural Land Use," TSE Working Papers 14-526, Toulouse School of Economics (TSE).
    19. Yufeng Huang, 2019. "Learning by Doing and the Demand for Advanced Products," Marketing Science, INFORMS, vol. 38(1), pages 107-128, January.
    20. Patrick Bajari & Victor Chernozhukov & Han Hong & Denis Nekipelov, 2015. "Identification and Efficient Semiparametric Estimation of a Dynamic Discrete Game," NBER Working Papers 21125, National Bureau of Economic Research, Inc.

    More about this item

    Keywords

    Estimation theory; Quantitative policy modeling; Simulation modeling;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C54 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Quantitative Policy Modeling
    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
    • C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedcwp:1210. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: 4D Library (email available below). General contact details of provider: https://edirc.repec.org/data/frbclus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.