IDEAS home Printed from https://ideas.repec.org/p/aah/create/2008-58.html
   My bibliography  Save this paper

Estimation of Dynamic Models with Nonparametric Simulated Maximum Likelihood

Author

Listed:
  • Dennis Kristensen
  • Yongseok Shin

    (School of Economics and Management, University of Aarhus, Denmark and CREATES)

Abstract

We propose a simulated maximum likelihood estimator for dynamic models based on non-parametric kernel methods. Our method is designed for models without latent dynamics from which one can simulate observations but cannot obtain a closed-form representation of the likelihood function. Using the simulated observations, we nonparametrically estimate the density - which is unknown in closed form - by kernel methods, and then construct a likelihood function that can be maximized. We prove for dynamic models that this nonparametric simulated maximum likelihood (NPSML) estimator is consistent and asymptotically efficient. NPSML is applicable to general classes of models and is easy to implement in practice.

Suggested Citation

  • Dennis Kristensen & Yongseok Shin, 2008. "Estimation of Dynamic Models with Nonparametric Simulated Maximum Likelihood," CREATES Research Papers 2008-58, Department of Economics and Business Economics, Aarhus University.
  • Handle: RePEc:aah:create:2008-58
    as

    Download full text from publisher

    File URL: https://repec.econ.au.dk/repec/creates/rp/08/rp08_58.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Durham, Garland B & Gallant, A Ronald, 2002. "Numerical Techniques for Maximum Likelihood Estimation of Continuous-Time Diffusion Processes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(3), pages 297-316, July.
    2. Michael Creel & Dennis Kristensen, 2012. "Estimation of dynamic latent variable models using simulated non‐parametric moments," Econometrics Journal, Royal Economic Society, vol. 15(3), pages 490-515, October.
    3. Richard Ericson & Ariel Pakes, 1995. "Markov-Perfect Industry Dynamics: A Framework for Empirical Work," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 62(1), pages 53-82.
    4. Joon Y. Park & Peter C. B. Phillips, 2000. "Nonstationary Binary Choice," Econometrica, Econometric Society, vol. 68(5), pages 1249-1280, September.
    5. Detemple, Jerome & Garcia, Rene & Rindisbacher, Marcel, 2006. "Asymptotic properties of Monte Carlo estimators of diffusion processes," Journal of Econometrics, Elsevier, vol. 134(1), pages 1-68, September.
    6. Tauchen, George, 1985. "Diagnostic testing and evaluation of maximum likelihood models," Journal of Econometrics, Elsevier, vol. 30(1-2), pages 415-443.
    7. Durham, Garland B & Gallant, A Ronald, 2002. "Numerical Techniques for Maximum Likelihood Estimation of Continuous-Time Diffusion Processes: Reply," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(3), pages 335-338, July.
    8. Kristensen, Dennis & Rahbek, Anders, 2010. "Likelihood-based inference for cointegration with nonlinear error-correction," Journal of Econometrics, Elsevier, vol. 158(1), pages 78-94, September.
    9. Gourieroux, C & Monfort, A & Renault, E, 1993. "Indirect Inference," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 85-118, Suppl. De.
    10. Smith, A A, Jr, 1993. "Estimating Nonlinear Time-Series Models Using Simulated Vector Autoregressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 63-84, Suppl. De.
    11. Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, volume 1, number 8355.
    12. Nicola Bruti-Liberati & Eckhard Platen, 2007. "Approximation of jump diffusions in finance and economics," Computational Economics, Springer;Society for Computational Economics, vol. 29(3), pages 283-312, May.
    13. Lee, Lung-fei, 1999. "Statistical Inference With Simulated Likelihood Functions," Econometric Theory, Cambridge University Press, vol. 15(3), pages 337-360, June.
    14. Lee, Bong-Soo & Ingram, Beth Fisher, 1991. "Simulation estimation of time-series models," Journal of Econometrics, Elsevier, vol. 47(2-3), pages 197-205, February.
    15. Kreps,David M. & Wallis,Kenneth F. (ed.), 1997. "Advances in Economics and Econometrics: Theory and Applications," Cambridge Books, Cambridge University Press, number 9780521589833.
    16. Lo, Andrew W., 1988. "Maximum Likelihood Estimation of Generalized Itô Processes with Discretely Sampled Data," Econometric Theory, Cambridge University Press, vol. 4(2), pages 231-247, August.
    17. Nze, Patrick Ango & Doukhan, Paul, 2004. "Weak Dependence: Models And Applications To Econometrics," Econometric Theory, Cambridge University Press, vol. 20(6), pages 995-1045, December.
    18. Dennis Kristensen & Bernard Salanié, 2010. "Higher Order Improvements for Approximate Estimators," CAM Working Papers 2010-04, University of Copenhagen. Department of Economics. Centre for Applied Microeconometrics.
    19. Filippo Altissimo & Antonio Mele, 2009. "Simulated Non-Parametric Estimation of Dynamic Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(2), pages 413-450.
    20. Kristensen, Dennis, 2009. "Uniform Convergence Rates Of Kernel Estimators With Heterogeneous Dependent Data," Econometric Theory, Cambridge University Press, vol. 25(5), pages 1433-1445, October.
    21. Lee, Lung-Fei, 1992. "On Efficiency of Methods of Simulated Moments and Maximum Simulated Likelihood Estimation of Discrete Response Models," Econometric Theory, Cambridge University Press, vol. 8(4), pages 518-552, December.
    22. Duffie, Darrell & Singleton, Kenneth J, 1993. "Simulated Moments Estimation of Markov Models of Asset Prices," Econometrica, Econometric Society, vol. 61(4), pages 929-952, July.
    23. Gallant, A Ronald & Nychka, Douglas W, 1987. "Semi-nonparametric Maximum Likelihood Estimation," Econometrica, Econometric Society, vol. 55(2), pages 363-390, March.
    24. Michael Creel & Dennis Kristensen, "undated". "Indirect Likelihood Inference," Working Papers 558, Barcelona School of Economics.
    25. Dennis Kristensen, 2004. "Estimation in Two Classes of Semiparametric Diffusion Models," FMG Discussion Papers dp500, Financial Markets Group.
    26. Sundaresan, S.M., 2000. "Continuous-Time Methods in Finance: A Review and an Assessment," Papers 00-03, Columbia - Graduate School of Business.
    27. Kristensen, Dennis, 2010. "Pseudo-maximum likelihood estimation in two classes of semiparametric diffusion models," Journal of Econometrics, Elsevier, vol. 156(2), pages 239-259, June.
    28. Phillips, Peter C B, 1983. "ERAs: A New Approach to Small Sample Theory," Econometrica, Econometric Society, vol. 51(5), pages 1505-1525, September.
    29. Lee, Lung-Fei, 1995. "Asymptotic Bias in Simulated Maximum Likelihood Estimation of Discrete Choice Models," Econometric Theory, Cambridge University Press, vol. 11(3), pages 437-483, June.
    30. Fermanian, Jean-David & Salanié, Bernard, 2004. "A Nonparametric Simulated Maximum Likelihood Estimation Method," Econometric Theory, Cambridge University Press, vol. 20(4), pages 701-734, August.
    31. Jeganathan, P., 1995. "Some Aspects of Asymptotic Theory with Applications to Time Series Models," Econometric Theory, Cambridge University Press, vol. 11(5), pages 818-887, October.
    32. Ai[diaeresis]t-Sahalia, Yacine & Kimmel, Robert, 2007. "Maximum likelihood estimation of stochastic volatility models," Journal of Financial Economics, Elsevier, vol. 83(2), pages 413-452, February.
    33. Michael Creel, 2008. "Estimation of Dynamic Latent Variable Models Using Simulated Nonparametric Moments," UFAE and IAE Working Papers 725.08, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC), revised 02 Jun 2008.
    34. Yu, Jialin, 2007. "Closed-form likelihood approximation and estimation of jump-diffusions with an application to the realignment risk of the Chinese Yuan," Journal of Econometrics, Elsevier, vol. 141(2), pages 1245-1280, December.
    35. Sims,Christopher A. (ed.), 1994. "Advances in Econometrics," Cambridge Books, Cambridge University Press, number 9780521444606.
    36. Zongwu Cai & Qiwei Yao & Wenyang Zhang, 2001. "Smoothing for discrete‐valued time series," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(2), pages 357-375.
    37. Gallant, A. Ronald & Tauchen, George, 1996. "Which Moments to Match?," Econometric Theory, Cambridge University Press, vol. 12(4), pages 657-681, October.
    38. Torben G. Andersen & Luca Benzoni & Jesper Lund, 2002. "An Empirical Investigation of Continuous‐Time Equity Return Models," Journal of Finance, American Finance Association, vol. 57(3), pages 1239-1284, June.
    39. Brandt, Michael W. & Santa-Clara, Pedro, 2002. "Simulated likelihood estimation of diffusions with an application to exchange rate dynamics in incomplete markets," Journal of Financial Economics, Elsevier, vol. 63(2), pages 161-210, February.
    40. Carrasco, Marine & Chernov, Mikhail & Florens, Jean-Pierre & Ghysels, Eric, 2007. "Efficient estimation of general dynamic models with a continuum of moment conditions," Journal of Econometrics, Elsevier, vol. 140(2), pages 529-573, October.
    41. Park, Joon Y & Phillips, Peter C B, 2001. "Nonlinear Regressions with Integrated Time Series," Econometrica, Econometric Society, vol. 69(1), pages 117-161, January.
    42. Kristensen, Dennis & Rahbek, Anders, 2005. "ASYMPTOTICS OF THE QMLE FOR A CLASS OF ARCH(q) MODELS," Econometric Theory, Cambridge University Press, vol. 21(5), pages 946-961, October.
    43. Fenton, Victor M & Gallant, A Ronald, 1996. "Convergence Rates of SNP Density Estimators," Econometrica, Econometric Society, vol. 64(3), pages 719-727, May.
    44. White,Halbert, 1996. "Estimation, Inference and Specification Analysis," Cambridge Books, Cambridge University Press, number 9780521574464.
    45. Sandmann, Gleb & Koopman, Siem Jan, 1998. "Estimation of stochastic volatility models via Monte Carlo maximum likelihood," Journal of Econometrics, Elsevier, vol. 87(2), pages 271-301, September.
    46. Kreps,David M. & Wallis,Kenneth F. (ed.), 1997. "Advances in Economics and Econometrics: Theory and Applications," Cambridge Books, Cambridge University Press, number 9780521589819.
    47. Kreps,David M. & Wallis,Kenneth F. (ed.), 1997. "Advances in Economics and Econometrics: Theory and Applications," Cambridge Books, Cambridge University Press, number 9780521589826.
    48. Elerain, Ola & Chib, Siddhartha & Shephard, Neil, 2001. "Likelihood Inference for Discretely Observed Nonlinear Diffusions," Econometrica, Econometric Society, vol. 69(4), pages 959-993, July.
    49. Jean-David Fermanian & Bernard Salanié, 2001. "A Nonparametric Simulated Maximum Likelihood Estimation Method," Working Papers 2001-13, Center for Research in Economics and Statistics.
    50. A. S. Hurn & K. A. Lindsay & V. L. Martin, 2003. "On the efficacy of simulated maximum likelihood for estimating the parameters of stochastic differential Equations," Journal of Time Series Analysis, Wiley Blackwell, vol. 24(1), pages 45-63, January.
    51. Vassilis A. Hajivassiliou & Daniel L. McFadden, 1998. "The Method of Simulated Scores for the Estimation of LDV Models," Econometrica, Econometric Society, vol. 66(4), pages 863-896, July.
    52. John C. Cox & Jonathan E. Ingersoll Jr. & Stephen A. Ross, 2005. "A Theory Of The Term Structure Of Interest Rates," World Scientific Book Chapters, in: Sudipto Bhattacharya & George M Constantinides (ed.), Theory Of Valuation, chapter 5, pages 129-164, World Scientific Publishing Co. Pte. Ltd..
    53. Federico M. Bandi & Peter C. B. Phillips, 2003. "Fully Nonparametric Estimation of Scalar Diffusion Models," Econometrica, Econometric Society, vol. 71(1), pages 241-283, January.
    54. Aurora Manrique & Neil Shephard, 1998. "Simulation-based likelihood inference for limited dependent processes," Econometrics Journal, Royal Economic Society, vol. 1(Conferenc), pages 174-202.
    55. Ichimura, Hidehiko & Todd, Petra E., 2007. "Implementing Nonparametric and Semiparametric Estimators," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 74, Elsevier.
    56. Saikkonen, Pentti, 1995. "Problems with the Asymptotic Theory of Maximum Likelihood Estimation in Integrated and Cointegrated Systems," Econometric Theory, Cambridge University Press, vol. 11(5), pages 888-911, October.
    57. Sims,Christopher A. (ed.), 1994. "Advances in Econometrics," Cambridge Books, Cambridge University Press, number 9780521444590.
    58. Lee, Sang-Won & Hansen, Bruce E., 1994. "Asymptotic Theory for the Garch(1,1) Quasi-Maximum Likelihood Estimator," Econometric Theory, Cambridge University Press, vol. 10(1), pages 29-52, March.
    59. Michael Creel & Dennis Kristensen, 2013. "Indirect Likelihood Inference (revised)," UFAE and IAE Working Papers 931.13, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC).
    60. Pakes, Ariel & Pollard, David, 1989. "Simulation and the Asymptotics of Optimization Estimators," Econometrica, Econometric Society, vol. 57(5), pages 1027-1057, September.
    61. Andrews, Donald W.K., 1995. "Nonparametric Kernel Estimation for Semiparametric Models," Econometric Theory, Cambridge University Press, vol. 11(3), pages 560-586, June.
    62. Yacine Ait-Sahalia, 2002. "Maximum Likelihood Estimation of Discretely Sampled Diffusions: A Closed-form Approximation Approach," Econometrica, Econometric Society, vol. 70(1), pages 223-262, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stan Hurn & J.Jeisman & K.A. Lindsay, 2006. "Seeing the Wood for the Trees: A Critical Evaluation of Methods to Estimate the Parameters of Stochastic Differential Equations. Working paper #2," NCER Working Paper Series 2, National Centre for Econometric Research.
    2. Zongwu Cai & Yongmiao Hong, 2013. "Some Recent Developments in Nonparametric Finance," Working Papers 2013-10-14, Wang Yanan Institute for Studies in Economics (WISE), Xiamen University.
    3. A. S. Hurn & J. I. Jeisman & K. A. Lindsay, 0. "Seeing the Wood for the Trees: A Critical Evaluation of Methods to Estimate the Parameters of Stochastic Differential Equations," Journal of Financial Econometrics, Oxford University Press, vol. 5(3), pages 390-455.
    4. Kristensen, Dennis & Salanié, Bernard, 2017. "Higher-order properties of approximate estimators," Journal of Econometrics, Elsevier, vol. 198(2), pages 189-208.
    5. Dennis Kristensen & Bernard Salanié, 2010. "Higher Order Improvements for Approximate Estimators," CAM Working Papers 2010-04, University of Copenhagen. Department of Economics. Centre for Applied Microeconometrics.
    6. Tauchen, George E., 1995. "New Minimum Chi-Square Methods in Empirical Finance," Working Papers 95-42, Duke University, Department of Economics.
    7. repec:wyi:journl:002108 is not listed on IDEAS
    8. Carrasco, Marine & Chernov, Mikhaël & Florens, Jean-Pierre & Ghysels, Eric, 2000. "Efficient Estimation of Jump Diffusions and General Dynamic Models with a Continuum of Moment Conditions," IDEI Working Papers 116, Institut d'Économie Industrielle (IDEI), Toulouse, revised 2002.
    9. Stan Hurn & J.Jeisman & K.A. Lindsay, 2006. "Teaching an old dog new tricks: Improved estimation of the parameters of SDEs by numerical solution of the Fokker-Planck equation," Stan Hurn Discussion Papers 2006-01, School of Economics and Finance, Queensland University of Technology.
    10. Kristensen, Dennis, 2008. "Estimation of partial differential equations with applications in finance," Journal of Econometrics, Elsevier, vol. 144(2), pages 392-408, June.
    11. Michael Creel & Dennis Kristensen, 2013. "Indirect Likelihood Inference (revised)," UFAE and IAE Working Papers 931.13, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC).
    12. Gallant, A. Ronald & Tauchen, George, 2002. "Simulated Score Methods and Indirect Inference for Continuous-time Models," Working Papers 02-09, Duke University, Department of Economics.
    13. Bandi, Federico M. & Phillips, Peter C.B., 2007. "A simple approach to the parametric estimation of potentially nonstationary diffusions," Journal of Econometrics, Elsevier, vol. 137(2), pages 354-395, April.
    14. Cai, Zongwu & Hong, Yongmiao, 2003. "Nonparametric Methods in Continuous-Time Finance: A Selective Review," SFB 373 Discussion Papers 2003,15, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    15. Michael Creel & Dennis Kristensen, "undated". "Indirect Likelihood Inference," Working Papers 558, Barcelona School of Economics.
    16. Kristensen, Dennis, 2004. "Estimation in two classes of semiparametric diffusion models," LSE Research Online Documents on Economics 24739, London School of Economics and Political Science, LSE Library.
    17. Siddhartha Chib & Michael K Pitt & Neil Shephard, 2004. "Likelihood based inference for diffusion driven models," OFRC Working Papers Series 2004fe17, Oxford Financial Research Centre.
    18. Detemple, Jerome & Garcia, Rene & Rindisbacher, Marcel, 2006. "Asymptotic properties of Monte Carlo estimators of diffusion processes," Journal of Econometrics, Elsevier, vol. 134(1), pages 1-68, September.
    19. Yu, Jialin, 2007. "Closed-form likelihood approximation and estimation of jump-diffusions with an application to the realignment risk of the Chinese Yuan," Journal of Econometrics, Elsevier, vol. 141(2), pages 1245-1280, December.
    20. J. Jimenez & R. Biscay & T. Ozaki, 2005. "Inference Methods for Discretely Observed Continuous-Time Stochastic Volatility Models: A Commented Overview," Asia-Pacific Financial Markets, Springer;Japanese Association of Financial Economics and Engineering, vol. 12(2), pages 109-141, June.
    21. Jun Yu & Peter C. B. Phillips, 2001. "A Gaussian approach for continuous time models of the short-term interest rate," Econometrics Journal, Royal Economic Society, vol. 4(2), pages 1-3.

    More about this item

    Keywords

    dynamic models; estimation; kernel density estimation; maximum-likelihood; simulation;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C35 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Discrete Regression and Qualitative Choice Models; Discrete Regressors; Proportions

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aah:create:2008-58. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: http://www.econ.au.dk/afn/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.