Advanced Search
MyIDEAS: Login to save this article or follow this journal

Pseudo-likelihood estimation and bootstrap inference for structural discrete Markov decision models

Contents:

Author Info

  • Kasahara, Hiroyuki
  • Shimotsu, Katsumi

Abstract

This paper analyzes the higher-order properties of the estimators based on the nested pseudo-likelihood (NPL) algorithm and the practical implementation of such estimators for parametric discrete Markov decision models. We derive the rate at which the NPL algorithm converges to the MLE and provide a theoretical explanation for the simulation results in Aguirregabiria and Mira [Aguirregabiria, V., Mira, P., 2002. Swapping the nested fixed point algorithm: A class of estimators for discrete Markov decision models. Econometrica 70, 1519-1543], in which iterating the NPL algorithm improves the accuracy of the estimator. We then propose a new NPL algorithm that can achieve quadratic convergence without fully solving the fixed point problem in every iteration and apply our estimation procedure to a finite mixture model. We also develop one-step NPL bootstrap procedures for discrete Markov decision models. The Monte Carlo simulation evidence based on a machine replacement model of Rust [Rust, J., 1987. Optimal replacement of GMC bus engines: An empirical model of Harold Zurcher. Econometrica 55, 999-1033] shows that the proposed one-step bootstrap test statistics and confidence intervals improve upon the first order asymptotics even with a relatively small number of iterations.

Download Info

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
File URL: http://www.sciencedirect.com/science/article/B6VC0-4T5JJ1W-1/2/98456d4680bbe25fa17d9c6bd7d29e11
Download Restriction: Full text for ScienceDirect subscribers only

As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.

Bibliographic Info

Article provided by Elsevier in its journal Journal of Econometrics.

Volume (Year): 146 (2008)
Issue (Month): 1 (September)
Pages: 92-106

as in new window
Handle: RePEc:eee:econom:v:146:y:2008:i:1:p:92-106

Contact details of provider:
Web page: http://www.elsevier.com/locate/jeconom

Related research

Keywords: Edgeworth expansion Finite mixture k-step bootstrap Maximum pseudo-likelihood estimators Nested fixed point algorithm Newton-Raphson method Policy iteration;

References

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
as in new window
  1. Hidehiko Ichimura & Sokbae Lee, 2006. "Characterization of the Asymptotic Distribution of Semiparametric M-Estimators," CIRJE F-Series CIRJE-F-426, CIRJE, Faculty of Economics, University of Tokyo.
  2. Patrick Bajari & C. Lanier Benkard & Jonathan Levin, 2007. "Estimating Dynamic Models of Imperfect Competition," Econometrica, Econometric Society, Econometric Society, vol. 75(5), pages 1331-1370, 09.
  3. Martin Pesendorfer & Philipp Schmidt-Dengler, 2008. "Asymptotic Least Squares Estimators for Dynamic Games -super-1," Review of Economic Studies, Oxford University Press, vol. 75(3), pages 901-928.
  4. Davidson, Russell & MacKinnon, James G., 1999. "The Size Distortion Of Bootstrap Tests," Econometric Theory, Cambridge University Press, vol. 15(03), pages 361-376, June.
  5. Hiroyuki Kasahara & Beverly Lapham, 2008. "Productivity and the Decision to Import and Export: Theory and Evidence," CESifo Working Paper Series 2240, CESifo Group Munich.
  6. Ariel Pakes & Michael Ostrovsky & Steve Berry, 2004. "Simple Estimators for the Parameters of Discrete Dynamic Games (with Entry/Exit Examples)," Harvard Institute of Economic Research Working Papers 2036, Harvard - Institute of Economic Research.
  7. Donald W.K. Andrews, 1999. "Higher-Order Improvements of a Computationally Attractive-Step Bootstrap for Extremum Estimators," Cowles Foundation Discussion Papers 1230, Cowles Foundation for Research in Economics, Yale University.
  8. Kennan,J. & Walker,J.R., 2003. "The effect of expected income on individual migration decisions," Working papers, Wisconsin Madison - Social Systems 7, Wisconsin Madison - Social Systems.
  9. John Rust & Christopher Phelan, 1997. "How Social Security and Medicare Affect Retirement Behavior in a World of Incomplete Markets," Econometrica, Econometric Society, Econometric Society, vol. 65(4), pages 781-832, July.
  10. Hiroyuki Kasahara & Katsumi Shimotsu, 2006. "Nonparametric Identification and Estimation of Finite Mixture Models of Dynamic Discrete Choices," Working Papers, Queen's University, Department of Economics 1092, Queen's University, Department of Economics.
  11. Davidson, R. & Mackinnon, J.G., 1997. "Bootstrap Testing in Nonlinear Models," G.R.E.Q.A.M., Universite Aix-Marseille III 97a39, Universite Aix-Marseille III.
  12. Arcidiacono, Peter, 2002. "Ability Sorting and the Returns to College Major," Working Papers, Duke University, Department of Economics 02-26, Duke University, Department of Economics.
  13. Pakes, Ariel S, 1986. "Patents as Options: Some Estimates of the Value of Holding European Patent Stocks," Econometrica, Econometric Society, Econometric Society, vol. 54(4), pages 755-84, July.
  14. Miller, Robert A, 1984. "Job Matching and Occupational Choice," Journal of Political Economy, University of Chicago Press, University of Chicago Press, vol. 92(6), pages 1086-120, December.
  15. Donna B. Gilleskie, 1998. "A Dynamic Stochastic Model of Medical Care Use and Work Absence," Econometrica, Econometric Society, Econometric Society, vol. 66(1), pages 1-46, January.
  16. Patrick Bajari & Han Hong, 2006. "Semiparametric Estimation of a Dynamic Game of Incomplete Information," NBER Technical Working Papers 0320, National Bureau of Economic Research, Inc.
  17. Victor Aguirregabiria & Pedro Mira, 2007. "Sequential Estimation of Dynamic Discrete Games," Econometrica, Econometric Society, Econometric Society, vol. 75(1), pages 1-53, 01.
  18. Robinson, Peter M, 1988. "The Stochastic Difference between Econometric Statistics," Econometrica, Econometric Society, Econometric Society, vol. 56(3), pages 531-48, May.
  19. Hotz, V.J. & Miller, R.A., 1991. "Conditional Choice Probabilities and the Estimation of Dynamic Models," GSIA Working Papers, Carnegie Mellon University, Tepper School of Business 1992-12, Carnegie Mellon University, Tepper School of Business.
  20. Keane, Michael P & Wolpin, Kenneth I, 1997. "The Career Decisions of Young Men," Journal of Political Economy, University of Chicago Press, University of Chicago Press, vol. 105(3), pages 473-522, June.
  21. Peter Arcidiacono, 2005. "Affirmative Action in Higher Education: How Do Admission and Financial Aid Rules Affect Future Earnings?," Econometrica, Econometric Society, Econometric Society, vol. 73(5), pages 1477-1524, 09.
  22. Arjan Heyma, 2004. "A structural dynamic analysis of retirement behaviour in the Netherlands," Journal of Applied Econometrics, John Wiley & Sons, Ltd., John Wiley & Sons, Ltd., vol. 19(6), pages 739-759.
  23. Susumu Imai & Michael P. Keane, 2004. "Intertemporal Labor Supply and Human Capital Accumulation," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 45(2), pages 601-641, 05.
  24. Susumu Imai & Neelam Jain, 2005. "Bayesian Estimation of Dynamic Discrete Choice Models," 2005 Meeting Papers 432, Society for Economic Dynamics.
  25. Russell Cooper & John Haltiwanger & Laura Power, 1995. "Machine Replacement and the Business Cycle: Lumps and Bumps," NBER Working Papers 5260, National Bureau of Economic Research, Inc.
  26. John Rust & Geoffrey Rothwell, 1995. "On the Optimal Lifetime of Nuclear Power Plants," Industrial Organization, EconWPA 9512002, EconWPA, revised 15 Dec 1995.
  27. Kennet, D Mark, 1994. "A Structural Model of Aircraft Engine Maintenance," Journal of Applied Econometrics, John Wiley & Sons, Ltd., John Wiley & Sons, Ltd., vol. 9(4), pages 351-68, Oct.-Dec..
  28. Ahn, Namkee, 1995. "Measuring the Value of Children by Sex and Age Using a Dynamic Programming Model," Review of Economic Studies, Wiley Blackwell, Wiley Blackwell, vol. 62(3), pages 361-79, July.
  29. Aguirregabiria, Victor, 1999. "The Dynamics of Markups and Inventories in Retailing Firms," Review of Economic Studies, Wiley Blackwell, Wiley Blackwell, vol. 66(2), pages 275-308, April.
  30. Wolpin, Kenneth I, 1984. "An Estimable Dynamic Stochastic Model of Fertility and Child Mortality," Journal of Political Economy, University of Chicago Press, University of Chicago Press, vol. 92(5), pages 852-74, October.
  31. Slade, Margaret E, 1998. "Optimal Pricing with Costly Adjustment: Evidence from Retail-Grocery Prices," Review of Economic Studies, Wiley Blackwell, Wiley Blackwell, vol. 65(1), pages 87-107, January.
  32. Miller, Robert A. & Sanders, Seth G., 1997. "Human capital development and welfare participation," Carnegie-Rochester Conference Series on Public Policy, Elsevier, Elsevier, vol. 46(1), pages 1-43, June.
  33. Paola Rota, 2004. "Estimating Labor Demand with Fixed Costs," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 45(1), pages 25-48, 02.
  34. Gotz, Glenn A. & McCall, John J., 1980. "Estimation in sequential decisionmaking models : A methodological note," Economics Letters, Elsevier, vol. 6(2), pages 131-136.
  35. Donald W.K. Andrews, 2000. "Equivalence of the Higher-order Asymptotic Efficiency of k-step and Extremum Statistics," Cowles Foundation Discussion Papers 1269, Cowles Foundation for Research in Economics, Yale University.
  36. Altug, Sumru & Miller, Robert A, 1998. "The Effect of Work Experience on Female Wages and Labour Supply," Review of Economic Studies, Wiley Blackwell, Wiley Blackwell, vol. 65(1), pages 45-85, January.
  37. Victor Aguirregabiria & Pedro Mira, 2002. "Swapping the Nested Fixed Point Algorithm: A Class of Estimators for Discrete Markov Decision Models," Econometrica, Econometric Society, Econometric Society, vol. 70(4), pages 1519-1543, July.
  38. Gonul, Fusun F., 1998. "Estimating price expectations in the OTC medicine market: An application of dynamic stochastic discrete choice models to scanner panel data," Journal of Econometrics, Elsevier, Elsevier, vol. 89(1-2), pages 41-56, November.
  39. Rust, John, 1987. "Optimal Replacement of GMC Bus Engines: An Empirical Model of Harold Zurcher," Econometrica, Econometric Society, Econometric Society, vol. 55(5), pages 999-1033, September.
  40. Zvi Eckstein & Kenneth I. Wolpin, 1999. "Why Youths Drop Out of High School: The Impact of Preferences, Opportunities, and Abilities," Econometrica, Econometric Society, Econometric Society, vol. 67(6), pages 1295-1340, November.
Full references (including those not matched with items on IDEAS)

Citations

Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
as in new window

Cited by:
  1. Aguirregabiria, Victor & Ho, Chun-Yu, 2012. "A dynamic oligopoly game of the US airline industry: Estimation and policy experiments," Journal of Econometrics, Elsevier, Elsevier, vol. 168(1), pages 156-173.
  2. Victor Aguirregabiria & Arvind Magesan, 2013. "Euler Equations for the Estimation of Dynamic Discrete Choice Structural Models," Working Papers tecipa-489, University of Toronto, Department of Economics.
  3. Kasahara, Hiroyuki & Shimotsu, Katsumi, 2009. "Sequential Estimation of Structural Models with a Fixed Point Constraint," Discussion Papers 2009-18, Graduate School of Economics, Hitotsubashi University.
  4. Vadim Marmer & Taisuke Otsu, 2009. "Optimal Comparison of Misspecified Moment Restriction Models under a Chosen Measure of Fit," Cowles Foundation Discussion Papers 1724, Cowles Foundation for Research in Economics, Yale University, revised Jul 2011.
  5. Victor Aguirregabiria & Victor Aguirregabiria & Aviv Nevo & Aviv Nevo, 2010. "Recent Developments in Empirical IO: Dynamic Demand and Dynamic Games," Working Papers tecipa-419, University of Toronto, Department of Economics.
  6. Aguirregabiria, Victor & Magesan, Arvind, 2013. "Euler Equations for the Estimation of Dynamic Discrete Choice Structural," MPRA Paper 46056, University Library of Munich, Germany.
  7. Aguirregabiria, Victor, 2009. "Estimation of Dynamic Discrete Games Using the Nested Pseudo Likelihood Algorithm: Code and Application," MPRA Paper 17329, University Library of Munich, Germany.
  8. Yu Zheng & Juan Pantano, 2012. "Using Subjective Expectations Data to Allow for Unobserved Heterogeneity in Hotz-Miller Estimation Strategies," 2012 Meeting Papers, Society for Economic Dynamics 940, Society for Economic Dynamics.
  9. Srisuma, Sorawoot & Linton, Oliver, 2012. "Semiparametric estimation of Markov decision processes with continuous state space," Journal of Econometrics, Elsevier, Elsevier, vol. 166(2), pages 320-341.

Lists

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

Statistics

Access and download statistics

Corrections

When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:146:y:2008:i:1:p:92-106. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Zhang, Lei).

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.