IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v167y2012i1p76-94.html
   My bibliography  Save this article

Estimation of dynamic models with nonparametric simulated maximum likelihood

Author

Listed:
  • Kristensen, Dennis
  • Shin, Yongseok

Abstract

We propose an easy-to-implement simulated maximum likelihood estimator for dynamic models where no closed-form representation of the likelihood function is available. Our method can handle any simulable model without latent dynamics. Using simulated observations, we nonparametrically estimate the unknown density by kernel methods, and then construct a likelihood function that can be maximized. We prove that this nonparametric simulated maximum likelihood (NPSML) estimator is consistent and asymptotically efficient. The higher-order impact of simulations and kernel smoothing on the resulting estimator is also analyzed; in particular, it is shown that the NPSML does not suffer from the usual curse of dimensionality associated with kernel estimators. A simulation study shows good performance of the method when employed in the estimation of jump–diffusion models.

Suggested Citation

  • Kristensen, Dennis & Shin, Yongseok, 2012. "Estimation of dynamic models with nonparametric simulated maximum likelihood," Journal of Econometrics, Elsevier, vol. 167(1), pages 76-94.
  • Handle: RePEc:eee:econom:v:167:y:2012:i:1:p:76-94 DOI: 10.1016/j.jeconom.2011.09.042
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304407611002363
    Download Restriction: Full text for ScienceDirect subscribers only

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Kristensen, Dennis & Rahbek, Anders, 2010. "Likelihood-based inference for cointegration with nonlinear error-correction," Journal of Econometrics, Elsevier, vol. 158(1), pages 78-94, September.
    2. Smith, A A, Jr, 1993. "Estimating Nonlinear Time-Series Models Using Simulated Vector Autoregressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 63-84, Suppl. De.
    3. Nicola Bruti-Liberati & Eckhard Platen, 2007. "Approximation of jump diffusions in finance and economics," Computational Economics, Springer;Society for Computational Economics, vol. 29(3), pages 283-312, May.
    4. Lee, Bong-Soo & Ingram, Beth Fisher, 1991. "Simulation estimation of time-series models," Journal of Econometrics, Elsevier, vol. 47(2-3), pages 197-205, February.
    5. Lo, Andrew W., 1988. "Maximum Likelihood Estimation of Generalized Itô Processes with Discretely Sampled Data," Econometric Theory, Cambridge University Press, vol. 4(02), pages 231-247, August.
    6. Dennis Kristensen & Bernard Salanié, 2010. "Higher Order Improvements for Approximate Estimators," CAM Working Papers 2010-04, University of Copenhagen. Department of Economics. Centre for Applied Microeconometrics.
    7. Lee, Lung-Fei, 1992. "On Efficiency of Methods of Simulated Moments and Maximum Simulated Likelihood Estimation of Discrete Response Models," Econometric Theory, Cambridge University Press, pages 518-552.
    8. Kristensen, Dennis, 2009. "Uniform Convergence Rates Of Kernel Estimators With Heterogeneous Dependent Data," Econometric Theory, Cambridge University Press, vol. 25(05), pages 1433-1445, October.
    9. Duffie, Darrell & Singleton, Kenneth J, 1993. "Simulated Moments Estimation of Markov Models of Asset Prices," Econometrica, Econometric Society, vol. 61(4), pages 929-952, July.
    10. Gourieroux, C & Monfort, A & Renault, E, 1993. "Indirect Inference," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 85-118, Suppl. De.
    11. Michael Creel & Dennis Kristensen, "undated". "Indirect Likelihood Inference," Working Papers 558, Barcelona Graduate School of Economics.
    12. Sundaresan, S.M., 2000. "Continuous-Time Methods in Finance: A Review and an Assessment," Papers 00-03, Columbia - Graduate School of Business.
    13. Phillips, Peter C B, 1983. "ERAs: A New Approach to Small Sample Theory," Econometrica, Econometric Society, pages 1505-1525.
    14. Fermanian, Jean-David & Salani , Bernard, 2004. "A Nonparametric Simulated Maximum Likelihood Estimation Method," Econometric Theory, Cambridge University Press, vol. 20(04), pages 701-734, August.
    15. Detemple, Jerome & Garcia, Rene & Rindisbacher, Marcel, 2006. "Asymptotic properties of Monte Carlo estimators of diffusion processes," Journal of Econometrics, Elsevier, pages 1-68.
    16. Michael Creel, 2008. "Estimation of Dynamic Latent Variable Models Using Simulated Nonparametric Moments," UFAE and IAE Working Papers 725.08, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC), revised 02 Jun 2008.
    17. Yu, Jialin, 2007. "Closed-form likelihood approximation and estimation of jump-diffusions with an application to the realignment risk of the Chinese Yuan," Journal of Econometrics, Elsevier, vol. 141(2), pages 1245-1280, December.
    18. Torben G. Andersen & Luca Benzoni & Jesper Lund, 2002. "An Empirical Investigation of Continuous-Time Equity Return Models," Journal of Finance, American Finance Association, vol. 57(3), pages 1239-1284, June.
    19. White,Halbert, 1996. "Estimation, Inference and Specification Analysis," Cambridge Books, Cambridge University Press, number 9780521574464, November.
    20. Jean-David Fermanian & Bernard Salanié, 2001. "A Nonparametric Simulated Maximum Likelihood Estimation Method," Working Papers 2001-13, Center for Research in Economics and Statistics.
    21. Zongwu Cai & Qiwei Yao & Wenyang Zhang, 2001. "Smoothing for discrete-valued time series," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(2), pages 357-375.
    22. Gallant, A. Ronald & Tauchen, George, 1996. "Which Moments to Match?," Econometric Theory, Cambridge University Press, vol. 12(04), pages 657-681, October.
    23. John C. Cox & Jonathan E. Ingersoll Jr. & Stephen A. Ross, 2005. "A Theory Of The Term Structure Of Interest Rates," World Scientific Book Chapters,in: Theory Of Valuation, chapter 5, pages 129-164 World Scientific Publishing Co. Pte. Ltd..
    24. Kristensen, Dennis, 2004. "Estimation in two classes of semiparametric diffusion models," LSE Research Online Documents on Economics 24739, London School of Economics and Political Science, LSE Library.
    25. Vassilis A. Hajivassiliou & Daniel L. McFadden, 1998. "The Method of Simulated Scores for the Estimation of LDV Models," Econometrica, Econometric Society, vol. 66(4), pages 863-896, July.
    26. Lee, Sang-Won & Hansen, Bruce E., 1994. "Asymptotic Theory for the Garch(1,1) Quasi-Maximum Likelihood Estimator," Econometric Theory, Cambridge University Press, vol. 10(01), pages 29-52, March.
    27. Federico M. Bandi & Peter C. B. Phillips, 2003. "Fully Nonparametric Estimation of Scalar Diffusion Models," Econometrica, Econometric Society, pages 241-283.
    28. Michael Creel & Dennis Kristensen, 2013. "Indirect Likelihood Inference (revised)," UFAE and IAE Working Papers 931.13, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC).
    29. Pakes, Ariel & Pollard, David, 1989. "Simulation and the Asymptotics of Optimization Estimators," Econometrica, Econometric Society, vol. 57(5), pages 1027-1057, September.
    30. Andrews, Donald W.K., 1995. "Nonparametric Kernel Estimation for Semiparametric Models," Econometric Theory, Cambridge University Press, vol. 11(03), pages 560-586, June.
    31. Kristensen, Dennis, 2010. "Pseudo-maximum likelihood estimation in two classes of semiparametric diffusion models," Journal of Econometrics, Elsevier, vol. 156(2), pages 239-259, June.
    32. Michael Creel & Dennis Kristensen, 2012. "Estimation of dynamic latent variable models using simulated non‐parametric moments," Econometrics Journal, Royal Economic Society, vol. 15(3), pages 490-515, October.
    33. Durham, Garland B & Gallant, A Ronald, 2002. "Numerical Techniques for Maximum Likelihood Estimation of Continuous-Time Diffusion Processes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(3), pages 297-316, July.
    34. Richard Ericson & Ariel Pakes, 1995. "Markov-Perfect Industry Dynamics: A Framework for Empirical Work," Review of Economic Studies, Oxford University Press, vol. 62(1), pages 53-82.
    35. Tauchen, George, 1985. "Diagnostic testing and evaluation of maximum likelihood models," Journal of Econometrics, Elsevier, vol. 30(1-2), pages 415-443.
    36. Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, number 8355, June.
    37. Lee, Lung-fei, 1999. "Statistical Inference With Simulated Likelihood Functions," Econometric Theory, Cambridge University Press, vol. 15(03), pages 337-360, June.
    38. Nze, Patrick Ango & Doukhan, Paul, 2004. "Weak Dependence: Models And Applications To Econometrics," Econometric Theory, Cambridge University Press, vol. 20(06), pages 995-1045, December.
    39. Filippo Altissimo & Antonio Mele, 2009. "Simulated Non-Parametric Estimation of Dynamic Models," Review of Economic Studies, Oxford University Press, vol. 76(2), pages 413-450.
    40. Gallant, A Ronald & Nychka, Douglas W, 1987. "Semi-nonparametric Maximum Likelihood Estimation," Econometrica, Econometric Society, vol. 55(2), pages 363-390, March.
    41. Lee, Lung-Fei, 1995. "Asymptotic Bias in Simulated Maximum Likelihood Estimation of Discrete Choice Models," Econometric Theory, Cambridge University Press, vol. 11(03), pages 437-483, June.
    42. Jeganathan, P., 1995. "Some Aspects of Asymptotic Theory with Applications to Time Series Models," Econometric Theory, Cambridge University Press, vol. 11(05), pages 818-887, October.
    43. Ai[diaeresis]t-Sahalia, Yacine & Kimmel, Robert, 2007. "Maximum likelihood estimation of stochastic volatility models," Journal of Financial Economics, Elsevier, vol. 83(2), pages 413-452, February.
    44. Park, Joon Y & Phillips, Peter C B, 2001. "Nonlinear Regressions with Integrated Time Series," Econometrica, Econometric Society, vol. 69(1), pages 117-161, January.
    45. Carrasco, Marine & Chernov, Mikhail & Florens, Jean-Pierre & Ghysels, Eric, 2007. "Efficient estimation of general dynamic models with a continuum of moment conditions," Journal of Econometrics, Elsevier, vol. 140(2), pages 529-573, October.
    46. Kristensen, Dennis & Rahbek, Anders, 2005. "ASYMPTOTICS OF THE QMLE FOR A CLASS OF ARCH(q) MODELS," Econometric Theory, Cambridge University Press, vol. 21(05), pages 946-961, October.
    47. Sandmann, Gleb & Koopman, Siem Jan, 1998. "Estimation of stochastic volatility models via Monte Carlo maximum likelihood," Journal of Econometrics, Elsevier, vol. 87(2), pages 271-301, September.
    48. Elerain, Ola & Chib, Siddhartha & Shephard, Neil, 2001. "Likelihood Inference for Discretely Observed Nonlinear Diffusions," Econometrica, Econometric Society, pages 959-993.
    49. A. S. Hurn & K. A. Lindsay & V. L. Martin, 2003. "On the efficacy of simulated maximum likelihood for estimating the parameters of stochastic differential Equations," Journal of Time Series Analysis, Wiley Blackwell, vol. 24(1), pages 45-63, January.
    50. Aurora Manrique & Neil Shephard, 1998. "Simulation-based likelihood inference for limited dependent processes," Econometrics Journal, Royal Economic Society, vol. 1(Conferenc), pages 174-202.
    51. Saikkonen, Pentti, 1995. "Problems with the Asymptotic Theory of Maximum Likelihood Estimation in Integrated and Cointegrated Systems," Econometric Theory, Cambridge University Press, vol. 11(05), pages 888-911, October.
    52. Yacine Ait-Sahalia, 2002. "Maximum Likelihood Estimation of Discretely Sampled Diffusions: A Closed-form Approximation Approach," Econometrica, Econometric Society, vol. 70(1), pages 223-262, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Michael Creel & Dennis Kristensen, "undated". "Indirect Likelihood Inference," Working Papers 558, Barcelona Graduate School of Economics.
    2. Corradi, Valentina & Swanson, Norman R., 2011. "Predictive density construction and accuracy testing with multiple possibly misspecified diffusion models," Journal of Econometrics, Elsevier, vol. 161(2), pages 304-324, April.
    3. Heejoon Han & Dennis Kristensen, 2014. "Asymptotic Theory for the QMLE in GARCH-X Models With Stationary and Nonstationary Covariates," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 32(3), pages 416-429, July.
    4. Dennis Kristensen, 2007. "Nonparametric Estimation and Misspecification Testing of Diffusion Models," CREATES Research Papers 2007-01, Department of Economics and Business Economics, Aarhus University.
    5. Kristensen, Dennis, 2010. "Pseudo-maximum likelihood estimation in two classes of semiparametric diffusion models," Journal of Econometrics, Elsevier, vol. 156(2), pages 239-259, June.
    6. Kristensen, Dennis, 2011. "Semi-nonparametric estimation and misspecification testing of diffusion models," Journal of Econometrics, Elsevier, vol. 164(2), pages 382-403, October.
    7. Kristensen, Dennis, 2009. "Uniform Convergence Rates Of Kernel Estimators With Heterogeneous Dependent Data," Econometric Theory, Cambridge University Press, vol. 25(05), pages 1433-1445, October.
    8. Lee, Donghoon & Song, Kyungchul, 2015. "Simulated maximum likelihood estimation for discrete choices using transformed simulated frequencies," Journal of Econometrics, Elsevier, vol. 187(1), pages 131-153.
    9. Diep Duong & Norman Swanson, 2013. "Density and Conditional Distribution Based Specification Analysis," Departmental Working Papers 201312, Rutgers University, Department of Economics.
    10. repec:hal:journl:peer-00796745 is not listed on IDEAS
    11. Jiti Gao & Han Hong, 2014. "A Computational Implementation of GMM," Monash Econometrics and Business Statistics Working Papers 24/14, Monash University, Department of Econometrics and Business Statistics.
    12. Grazzini, Jakob & Richiardi, Matteo, 2015. "Estimation of ergodic agent-based models by simulated minimum distance," Journal of Economic Dynamics and Control, Elsevier, vol. 51(C), pages 148-165.
    13. Kristensen, Dennis, 2008. "Estimation of partial differential equations with applications in finance," Journal of Econometrics, Elsevier, vol. 144(2), pages 392-408, June.
    14. Anthony A. Smith, Jr. & Michael Keane, 2004. "Generalized Indirect Inference for Discrete Choice Models," Econometric Society 2004 North American Winter Meetings 512, Econometric Society.
    15. repec:eee:econom:v:198:y:2017:i:2:p:189-208 is not listed on IDEAS
    16. Dennis Kristensen & Bernard Salanié, 2010. "Higher Order Improvements for Approximate Estimators," CAM Working Papers 2010-04, University of Copenhagen. Department of Economics. Centre for Applied Microeconometrics.
    17. Judge, George, 2012. "The Information Theoretic Foundations of a Probabilistic and Predictive Micro and Macro Economics," Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series qt5d98g7wg, Department of Agricultural & Resource Economics, UC Berkeley.
    18. Michael Creel & Dennis Kristensen, 2013. "Indirect Likelihood Inference (revised)," UFAE and IAE Working Papers 931.13, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC).
    19. repec:eee:dyncon:v:85:y:2017:i:c:p:21-45 is not listed on IDEAS
    20. Kukacka, Jiri & Barunik, Jozef, 2017. "Estimation of financial agent-based models with simulated maximum likelihood," Journal of Economic Dynamics and Control, Elsevier, vol. 85(C), pages 21-45.
    21. Jakob Grazzini & Matteo G. Richiardi, 2013. "Consistent Estimation of Agent-Based Models by Simulated Minimum Distance," LABORatorio R. Revelli Working Papers Series 130, LABORatorio R. Revelli, Centre for Employment Studies.
    22. Kristensen, Dennis & Salanié, Bernard, 2017. "Higher-order properties of approximate estimators," Journal of Econometrics, Elsevier, vol. 198(2), pages 189-208.
    23. Mathias Barkhagen & Jörgen Blomvall & Eckhard Platen, 2015. "Recovering the Real-World Density and Liquidity Premia From Option Data," Research Paper Series 363, Quantitative Finance Research Centre, University of Technology, Sydney.

    More about this item

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C35 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Discrete Regression and Qualitative Choice Models; Discrete Regressors; Proportions

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:167:y:2012:i:1:p:76-94. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Dana Niculescu). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.