IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v167y2012i1p76-94.html
   My bibliography  Save this article

Estimation of dynamic models with nonparametric simulated maximum likelihood

Author

Listed:
  • Kristensen, Dennis
  • Shin, Yongseok

Abstract

We propose an easy-to-implement simulated maximum likelihood estimator for dynamic models where no closed-form representation of the likelihood function is available. Our method can handle any simulable model without latent dynamics. Using simulated observations, we nonparametrically estimate the unknown density by kernel methods, and then construct a likelihood function that can be maximized. We prove that this nonparametric simulated maximum likelihood (NPSML) estimator is consistent and asymptotically efficient. The higher-order impact of simulations and kernel smoothing on the resulting estimator is also analyzed; in particular, it is shown that the NPSML does not suffer from the usual curse of dimensionality associated with kernel estimators. A simulation study shows good performance of the method when employed in the estimation of jump–diffusion models.

Suggested Citation

  • Kristensen, Dennis & Shin, Yongseok, 2012. "Estimation of dynamic models with nonparametric simulated maximum likelihood," Journal of Econometrics, Elsevier, vol. 167(1), pages 76-94.
  • Handle: RePEc:eee:econom:v:167:y:2012:i:1:p:76-94
    DOI: 10.1016/j.jeconom.2011.09.042
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304407611002363
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jeconom.2011.09.042?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Kristensen, Dennis & Rahbek, Anders, 2010. "Likelihood-based inference for cointegration with nonlinear error-correction," Journal of Econometrics, Elsevier, vol. 158(1), pages 78-94, September.
    2. Lee, Bong-Soo & Ingram, Beth Fisher, 1991. "Simulation estimation of time-series models," Journal of Econometrics, Elsevier, vol. 47(2-3), pages 197-205, February.
    3. Lo, Andrew W., 1988. "Maximum Likelihood Estimation of Generalized Itô Processes with Discretely Sampled Data," Econometric Theory, Cambridge University Press, vol. 4(2), pages 231-247, August.
    4. Lee, Lung-Fei, 1992. "On Efficiency of Methods of Simulated Moments and Maximum Simulated Likelihood Estimation of Discrete Response Models," Econometric Theory, Cambridge University Press, vol. 8(4), pages 518-552, December.
    5. Duffie, Darrell & Singleton, Kenneth J, 1993. "Simulated Moments Estimation of Markov Models of Asset Prices," Econometrica, Econometric Society, vol. 61(4), pages 929-952, July.
    6. Sundaresan, S.M., 2000. "Continuous-Time Methods in Finance: A Review and an Assessment," Papers 00-03, Columbia - Graduate School of Business.
    7. Phillips, Peter C B, 1983. "ERAs: A New Approach to Small Sample Theory," Econometrica, Econometric Society, vol. 51(5), pages 1505-1525, September.
    8. Fermanian, Jean-David & Salanié, Bernard, 2004. "A Nonparametric Simulated Maximum Likelihood Estimation Method," Econometric Theory, Cambridge University Press, vol. 20(4), pages 701-734, August.
    9. Detemple, Jerome & Garcia, Rene & Rindisbacher, Marcel, 2006. "Asymptotic properties of Monte Carlo estimators of diffusion processes," Journal of Econometrics, Elsevier, vol. 134(1), pages 1-68, September.
    10. Kristensen, Dennis, 2009. "Uniform Convergence Rates Of Kernel Estimators With Heterogeneous Dependent Data," Econometric Theory, Cambridge University Press, vol. 25(5), pages 1433-1445, October.
    11. Michael Creel, 2008. "Estimation of Dynamic Latent Variable Models Using Simulated Nonparametric Moments," UFAE and IAE Working Papers 725.08, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC), revised 02 Jun 2008.
    12. Sims,Christopher A. (ed.), 1994. "Advances in Econometrics," Cambridge Books, Cambridge University Press, number 9780521444606.
    13. Torben G. Andersen & Luca Benzoni & Jesper Lund, 2002. "An Empirical Investigation of Continuous‐Time Equity Return Models," Journal of Finance, American Finance Association, vol. 57(3), pages 1239-1284, June.
    14. Brandt, Michael W. & Santa-Clara, Pedro, 2002. "Simulated likelihood estimation of diffusions with an application to exchange rate dynamics in incomplete markets," Journal of Financial Economics, Elsevier, vol. 63(2), pages 161-210, February.
    15. White,Halbert, 1996. "Estimation, Inference and Specification Analysis," Cambridge Books, Cambridge University Press, number 9780521574464, January.
    16. Kreps,David M. & Wallis,Kenneth F. (ed.), 1997. "Advances in Economics and Econometrics: Theory and Applications," Cambridge Books, Cambridge University Press, number 9780521589819.
    17. Jean-David Fermanian & Bernard Salanié, 2001. "A Nonparametric Simulated Maximum Likelihood Estimation Method," Working Papers 2001-13, Center for Research in Economics and Statistics.
    18. Gallant, A. Ronald & Tauchen, George, 1996. "Which Moments to Match?," Econometric Theory, Cambridge University Press, vol. 12(4), pages 657-681, October.
    19. John C. Cox & Jonathan E. Ingersoll Jr. & Stephen A. Ross, 2005. "A Theory Of The Term Structure Of Interest Rates," World Scientific Book Chapters, in: Sudipto Bhattacharya & George M Constantinides (ed.), Theory Of Valuation, chapter 5, pages 129-164, World Scientific Publishing Co. Pte. Ltd..
    20. Kristensen, Dennis, 2004. "Estimation in two classes of semiparametric diffusion models," LSE Research Online Documents on Economics 24739, London School of Economics and Political Science, LSE Library.
    21. Lee, Sang-Won & Hansen, Bruce E., 1994. "Asymptotic Theory for the Garch(1,1) Quasi-Maximum Likelihood Estimator," Econometric Theory, Cambridge University Press, vol. 10(1), pages 29-52, March.
    22. Federico M. Bandi & Peter C. B. Phillips, 2003. "Fully Nonparametric Estimation of Scalar Diffusion Models," Econometrica, Econometric Society, vol. 71(1), pages 241-283, January.
    23. Michael Creel & Dennis Kristensen, 2013. "Indirect Likelihood Inference (revised)," UFAE and IAE Working Papers 931.13, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC).
    24. Pakes, Ariel & Pollard, David, 1989. "Simulation and the Asymptotics of Optimization Estimators," Econometrica, Econometric Society, vol. 57(5), pages 1027-1057, September.
    25. Andrews, Donald W.K., 1995. "Nonparametric Kernel Estimation for Semiparametric Models," Econometric Theory, Cambridge University Press, vol. 11(3), pages 560-586, June.
    26. Kristensen, Dennis, 2010. "Pseudo-maximum likelihood estimation in two classes of semiparametric diffusion models," Journal of Econometrics, Elsevier, vol. 156(2), pages 239-259, June.
    27. Michael Creel & Dennis Kristensen, 2012. "Estimation of dynamic latent variable models using simulated non‐parametric moments," Econometrics Journal, Royal Economic Society, vol. 15(3), pages 490-515, October.
    28. Richard Ericson & Ariel Pakes, 1995. "Markov-Perfect Industry Dynamics: A Framework for Empirical Work," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 62(1), pages 53-82.
    29. Tauchen, George, 1985. "Diagnostic testing and evaluation of maximum likelihood models," Journal of Econometrics, Elsevier, vol. 30(1-2), pages 415-443.
    30. Durham, Garland B & Gallant, A Ronald, 2002. "Numerical Techniques for Maximum Likelihood Estimation of Continuous-Time Diffusion Processes: Reply," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(3), pages 335-338, July.
    31. Lee, Lung-fei, 1999. "Statistical Inference With Simulated Likelihood Functions," Econometric Theory, Cambridge University Press, vol. 15(3), pages 337-360, June.
    32. Gallant, A Ronald & Nychka, Douglas W, 1987. "Semi-nonparametric Maximum Likelihood Estimation," Econometrica, Econometric Society, vol. 55(2), pages 363-390, March.
    33. Lee, Lung-Fei, 1995. "Asymptotic Bias in Simulated Maximum Likelihood Estimation of Discrete Choice Models," Econometric Theory, Cambridge University Press, vol. 11(3), pages 437-483, June.
    34. Zongwu Cai & Qiwei Yao & Wenyang Zhang, 2001. "Smoothing for discrete‐valued time series," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(2), pages 357-375.
    35. Michael Creel & Dennis Kristensen, "undated". "Indirect Likelihood Inference," Working Papers 558, Barcelona School of Economics.
    36. Carrasco, Marine & Chernov, Mikhail & Florens, Jean-Pierre & Ghysels, Eric, 2007. "Efficient estimation of general dynamic models with a continuum of moment conditions," Journal of Econometrics, Elsevier, vol. 140(2), pages 529-573, October.
    37. Park, Joon Y & Phillips, Peter C B, 2001. "Nonlinear Regressions with Integrated Time Series," Econometrica, Econometric Society, vol. 69(1), pages 117-161, January.
    38. Kristensen, Dennis & Rahbek, Anders, 2005. "ASYMPTOTICS OF THE QMLE FOR A CLASS OF ARCH(q) MODELS," Econometric Theory, Cambridge University Press, vol. 21(5), pages 946-961, October.
    39. A. S. Hurn & K. A. Lindsay & V. L. Martin, 2003. "On the efficacy of simulated maximum likelihood for estimating the parameters of stochastic differential Equations," Journal of Time Series Analysis, Wiley Blackwell, vol. 24(1), pages 45-63, January.
    40. Vassilis A. Hajivassiliou & Daniel L. McFadden, 1998. "The Method of Simulated Scores for the Estimation of LDV Models," Econometrica, Econometric Society, vol. 66(4), pages 863-896, July.
    41. Sims,Christopher A. (ed.), 1994. "Advances in Econometrics," Cambridge Books, Cambridge University Press, number 9780521444590.
    42. Ichimura, Hidehiko & Todd, Petra E., 2007. "Implementing Nonparametric and Semiparametric Estimators," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 74, Elsevier.
    43. Elerain, Ola & Chib, Siddhartha & Shephard, Neil, 2001. "Likelihood Inference for Discretely Observed Nonlinear Diffusions," Econometrica, Econometric Society, vol. 69(4), pages 959-993, July.
    44. Joon Y. Park & Peter C. B. Phillips, 2000. "Nonstationary Binary Choice," Econometrica, Econometric Society, vol. 68(5), pages 1249-1280, September.
    45. Smith, A A, Jr, 1993. "Estimating Nonlinear Time-Series Models Using Simulated Vector Autoregressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 63-84, Suppl. De.
    46. Nicola Bruti-Liberati & Eckhard Platen, 2007. "Approximation of jump diffusions in finance and economics," Computational Economics, Springer;Society for Computational Economics, vol. 29(3), pages 283-312, May.
    47. Kreps,David M. & Wallis,Kenneth F. (ed.), 1997. "Advances in Economics and Econometrics: Theory and Applications," Cambridge Books, Cambridge University Press, number 9780521589833.
    48. Dennis Kristensen & Bernard Salanié, 2010. "Higher Order Improvements for Approximate Estimators," CAM Working Papers 2010-04, University of Copenhagen. Department of Economics. Centre for Applied Microeconometrics.
    49. Gourieroux, C & Monfort, A & Renault, E, 1993. "Indirect Inference," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 85-118, Suppl. De.
    50. Yu, Jialin, 2007. "Closed-form likelihood approximation and estimation of jump-diffusions with an application to the realignment risk of the Chinese Yuan," Journal of Econometrics, Elsevier, vol. 141(2), pages 1245-1280, December.
    51. Fenton, Victor M & Gallant, A Ronald, 1996. "Convergence Rates of SNP Density Estimators," Econometrica, Econometric Society, vol. 64(3), pages 719-727, May.
    52. Durham, Garland B & Gallant, A Ronald, 2002. "Numerical Techniques for Maximum Likelihood Estimation of Continuous-Time Diffusion Processes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(3), pages 297-316, July.
    53. Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, volume 1, number 8355.
    54. Nze, Patrick Ango & Doukhan, Paul, 2004. "Weak Dependence: Models And Applications To Econometrics," Econometric Theory, Cambridge University Press, vol. 20(6), pages 995-1045, December.
    55. Filippo Altissimo & Antonio Mele, 2009. "Simulated Non-Parametric Estimation of Dynamic Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(2), pages 413-450.
    56. Jeganathan, P., 1995. "Some Aspects of Asymptotic Theory with Applications to Time Series Models," Econometric Theory, Cambridge University Press, vol. 11(5), pages 818-887, October.
    57. Ai[diaeresis]t-Sahalia, Yacine & Kimmel, Robert, 2007. "Maximum likelihood estimation of stochastic volatility models," Journal of Financial Economics, Elsevier, vol. 83(2), pages 413-452, February.
    58. Sandmann, Gleb & Koopman, Siem Jan, 1998. "Estimation of stochastic volatility models via Monte Carlo maximum likelihood," Journal of Econometrics, Elsevier, vol. 87(2), pages 271-301, September.
    59. Kreps,David M. & Wallis,Kenneth F. (ed.), 1997. "Advances in Economics and Econometrics: Theory and Applications," Cambridge Books, Cambridge University Press, number 9780521589826.
    60. Aurora Manrique & Neil Shephard, 1998. "Simulation-based likelihood inference for limited dependent processes," Econometrics Journal, Royal Economic Society, vol. 1(Conferenc), pages 174-202.
    61. Saikkonen, Pentti, 1995. "Problems with the Asymptotic Theory of Maximum Likelihood Estimation in Integrated and Cointegrated Systems," Econometric Theory, Cambridge University Press, vol. 11(5), pages 888-911, October.
    62. Yacine Ait-Sahalia, 2002. "Maximum Likelihood Estimation of Discretely Sampled Diffusions: A Closed-form Approximation Approach," Econometrica, Econometric Society, vol. 70(1), pages 223-262, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zongwu Cai & Yongmiao Hong, 2013. "Some Recent Developments in Nonparametric Finance," Working Papers 2013-10-14, Wang Yanan Institute for Studies in Economics (WISE), Xiamen University.
    2. Stan Hurn & J.Jeisman & K.A. Lindsay, 2006. "Seeing the Wood for the Trees: A Critical Evaluation of Methods to Estimate the Parameters of Stochastic Differential Equations. Working paper #2," NCER Working Paper Series 2, National Centre for Econometric Research.
    3. A. S. Hurn & J. I. Jeisman & K. A. Lindsay, 0. "Seeing the Wood for the Trees: A Critical Evaluation of Methods to Estimate the Parameters of Stochastic Differential Equations," Journal of Financial Econometrics, Oxford University Press, vol. 5(3), pages 390-455.
    4. Kristensen, Dennis & Salanié, Bernard, 2017. "Higher-order properties of approximate estimators," Journal of Econometrics, Elsevier, vol. 198(2), pages 189-208.
    5. Tauchen, George E., 1995. "New Minimum Chi-Square Methods in Empirical Finance," Working Papers 95-42, Duke University, Department of Economics.
    6. Dennis Kristensen & Bernard Salanié, 2010. "Higher Order Improvements for Approximate Estimators," CAM Working Papers 2010-04, University of Copenhagen. Department of Economics. Centre for Applied Microeconometrics.
    7. repec:wyi:journl:002108 is not listed on IDEAS
    8. Carrasco, Marine & Chernov, Mikhaël & Florens, Jean-Pierre & Ghysels, Eric, 2000. "Efficient Estimation of Jump Diffusions and General Dynamic Models with a Continuum of Moment Conditions," IDEI Working Papers 116, Institut d'Économie Industrielle (IDEI), Toulouse, revised 2002.
    9. Kristensen, Dennis, 2008. "Estimation of partial differential equations with applications in finance," Journal of Econometrics, Elsevier, vol. 144(2), pages 392-408, June.
    10. Cai, Zongwu & Hong, Yongmiao, 2003. "Nonparametric Methods in Continuous-Time Finance: A Selective Review," SFB 373 Discussion Papers 2003,15, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    11. Stan Hurn & J.Jeisman & K.A. Lindsay, 2006. "Teaching an old dog new tricks: Improved estimation of the parameters of SDEs by numerical solution of the Fokker-Planck equation," Stan Hurn Discussion Papers 2006-01, School of Economics and Finance, Queensland University of Technology.
    12. Michael Creel & Dennis Kristensen, 2013. "Indirect Likelihood Inference (revised)," UFAE and IAE Working Papers 931.13, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC).
    13. Bandi, Federico M. & Phillips, Peter C.B., 2007. "A simple approach to the parametric estimation of potentially nonstationary diffusions," Journal of Econometrics, Elsevier, vol. 137(2), pages 354-395, April.
    14. Gallant, A. Ronald & Tauchen, George, 2002. "Simulated Score Methods and Indirect Inference for Continuous-time Models," Working Papers 02-09, Duke University, Department of Economics.
    15. Pastorello, S. & Rossi, E., 2010. "Efficient importance sampling maximum likelihood estimation of stochastic differential equations," Computational Statistics & Data Analysis, Elsevier, vol. 54(11), pages 2753-2762, November.
    16. Michael Creel & Dennis Kristensen, "undated". "Indirect Likelihood Inference," Working Papers 558, Barcelona School of Economics.
    17. Kristensen, Dennis, 2004. "Estimation in two classes of semiparametric diffusion models," LSE Research Online Documents on Economics 24739, London School of Economics and Political Science, LSE Library.
    18. Detemple, Jerome & Garcia, Rene & Rindisbacher, Marcel, 2006. "Asymptotic properties of Monte Carlo estimators of diffusion processes," Journal of Econometrics, Elsevier, vol. 134(1), pages 1-68, September.
    19. Yu, Jialin, 2007. "Closed-form likelihood approximation and estimation of jump-diffusions with an application to the realignment risk of the Chinese Yuan," Journal of Econometrics, Elsevier, vol. 141(2), pages 1245-1280, December.
    20. Jun Yu & Peter C. B. Phillips, 2001. "A Gaussian approach for continuous time models of the short-term interest rate," Econometrics Journal, Royal Economic Society, vol. 4(2), pages 1-3.
    21. Siddhartha Chib & Michael K Pitt & Neil Shephard, 2004. "Likelihood based inference for diffusion driven models," OFRC Working Papers Series 2004fe17, Oxford Financial Research Centre.

    More about this item

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C35 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Discrete Regression and Qualitative Choice Models; Discrete Regressors; Proportions

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:167:y:2012:i:1:p:76-94. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.