IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v84y2015icp54-67.html
   My bibliography  Save this article

A penalized simulated maximum likelihood approach in parameter estimation for stochastic differential equations

Author

Listed:
  • Sun, Libo
  • Lee, Chihoon
  • Hoeting, Jennifer A.

Abstract

We consider the problem of estimating parameters of stochastic differential equations (SDEs) with discrete-time observations that are either completely or partially observed. The transition density between two observations is generally unknown. We propose an importance sampling approach with an auxiliary parameter when the transition density is unknown. We embed the auxiliary importance sampler in a penalized maximum likelihood framework which produces more accurate and computationally efficient parameter estimates. Simulation studies in three different models illustrate promising improvements of the new penalized simulated maximum likelihood method. The new procedure is designed for the challenging case when some state variables are unobserved and moreover, observed states are sparse over time, which commonly arises in ecological studies. We apply this new approach to two epidemics of chronic wasting disease in mule deer.

Suggested Citation

  • Sun, Libo & Lee, Chihoon & Hoeting, Jennifer A., 2015. "A penalized simulated maximum likelihood approach in parameter estimation for stochastic differential equations," Computational Statistics & Data Analysis, Elsevier, vol. 84(C), pages 54-67.
    • Handle: RePEc:eee:csdana:v:84:y:2015:i:c:p:54-67
    DOI: 10.1016/j.csda.2014.11.007
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S016794731400320X
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2014.11.007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. C. C. Drovandi & A. N. Pettitt, 2011. "Estimation of Parameters for Macroparasite Population Evolution Using Approximate Bayesian Computation," Biometrics, The International Biometric Society, vol. 67(1), pages 225-233, March.
    2. repec:dau:papers:123456789/1124 is not listed on IDEAS
    3. Geweke, John, 1989. "Bayesian Inference in Econometric Models Using Monte Carlo Integration," Econometrica, Econometric Society, vol. 57(6), pages 1317-1339, November.
    4. Nathanial Burch & Jennifer Hoeting & Donald Estep, 2012. "Optimal design and directional leverage with applications in differential equation models," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 75(7), pages 895-911, October.
    5. J. Jimenez & R. Biscay & T. Ozaki, 2005. "Inference Methods for Discretely Observed Continuous-Time Stochastic Volatility Models: A Commented Overview," Asia-Pacific Financial Markets, Springer;Japanese Association of Financial Economics and Engineering, vol. 12(2), pages 109-141, June.
    6. repec:dau:papers:123456789/4642 is not listed on IDEAS
    7. Durham, Garland B & Gallant, A Ronald, 2002. "Numerical Techniques for Maximum Likelihood Estimation of Continuous-Time Diffusion Processes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(3), pages 297-316, July.
    8. Osnat Stramer & Jun Yan, 2007. "Asymptotics of an Efficient Monte Carlo Estimation for the Transition Density of Diffusion Processes," Methodology and Computing in Applied Probability, Springer, vol. 9(4), pages 483-496, December.
    9. Pastorello, S. & Rossi, E., 2010. "Efficient importance sampling maximum likelihood estimation of stochastic differential equations," Computational Statistics & Data Analysis, Elsevier, vol. 54(11), pages 2753-2762, November.
    10. Bhadra, Anindya & Ionides, Edward L. & Laneri, Karina & Pascual, Mercedes & Bouma, Menno & Dhiman, Ramesh C., 2011. "Malaria in Northwest India: Data Analysis via Partially Observed Stochastic Differential Equation Models Driven by Lévy Noise," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 440-451.
    11. A. Golightly & D. J. Wilkinson, 2005. "Bayesian Inference for Stochastic Kinetic Models Using a Diffusion Approximation," Biometrics, The International Biometric Society, vol. 61(3), pages 781-788, September.
    12. Durham, Garland B & Gallant, A Ronald, 2002. "Numerical Techniques for Maximum Likelihood Estimation of Continuous-Time Diffusion Processes: Reply," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(3), pages 335-338, July.
    13. Christophe Andrieu & Arnaud Doucet & Roman Holenstein, 2010. "Particle Markov chain Monte Carlo methods," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(3), pages 269-342, June.
    14. Santa-Clara, Pedro, 1997. "Simulated Likeliehood Estimation of Diffusions With an Application to the Short Tem Interest Rate," University of California at Los Angeles, Anderson Graduate School of Management qt8zz2d0q8, Anderson Graduate School of Management, UCLA.
    15. Jean-Francois Richard, 2007. "Efficient High-Dimensional Importance Sampling," Working Paper 321, Department of Economics, University of Pittsburgh, revised Jan 2007.
    16. Sophie Donnet & Jean-Louis Foulley & Adeline Samson, 2010. "Bayesian Analysis of Growth Curves Using Mixed Models Defined by Stochastic Differential Equations," Biometrics, The International Biometric Society, vol. 66(3), pages 733-741, September.
    17. Eraker, Bjorn, 2001. "MCMC Analysis of Diffusion Models with Application to Finance," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(2), pages 177-191, April.
    18. Richard, Jean-Francois & Zhang, Wei, 2007. "Efficient high-dimensional importance sampling," Journal of Econometrics, Elsevier, vol. 141(2), pages 1385-1411, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kleppe, Tore Selland & Yu, Jun & Skaug, Hans J., 2014. "Maximum likelihood estimation of partially observed diffusion models," Journal of Econometrics, Elsevier, vol. 180(1), pages 73-80.
    2. Mengheng Li & Siem Jan (S.J.) Koopman, 2018. "Unobserved Components with Stochastic Volatility in U.S. Inflation: Estimation and Signal Extraction," Tinbergen Institute Discussion Papers 18-027/III, Tinbergen Institute.
    3. Golightly Andrew & Wilkinson Darren J., 2015. "Bayesian inference for Markov jump processes with informative observations," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 14(2), pages 169-188, April.
    4. Siem Jan Koopman & Rutger Lit & Thuy Minh Nguyen, 2012. "Fast Efficient Importance Sampling by State Space Methods," Tinbergen Institute Discussion Papers 12-008/4, Tinbergen Institute, revised 16 Oct 2014.
    5. Golightly, A. & Wilkinson, D.J., 2008. "Bayesian inference for nonlinear multivariate diffusion models observed with error," Computational Statistics & Data Analysis, Elsevier, vol. 52(3), pages 1674-1693, January.
    6. Libo Sun & Chihoon Lee & Jennifer A. Hoeting, 2019. "A penalized simulated maximum likelihood method to estimate parameters for SDEs with measurement error," Computational Statistics, Springer, vol. 34(2), pages 847-863, June.
    7. Pastorello, S. & Rossi, E., 2010. "Efficient importance sampling maximum likelihood estimation of stochastic differential equations," Computational Statistics & Data Analysis, Elsevier, vol. 54(11), pages 2753-2762, November.
    8. Koopman, Siem Jan & Shephard, Neil & Creal, Drew, 2009. "Testing the assumptions behind importance sampling," Journal of Econometrics, Elsevier, vol. 149(1), pages 2-11, April.
    9. Siddhartha Chib & Michael K Pitt & Neil Shephard, 2004. "Likelihood based inference for diffusion driven models," OFRC Working Papers Series 2004fe17, Oxford Financial Research Centre.
    10. Niu Wei-Fang, 2013. "Maximum likelihood estimation of continuous time stochastic volatility models with partially observed GARCH," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 17(4), pages 421-438, September.
    11. Bretó, Carles, 2014. "On idiosyncratic stochasticity of financial leverage effects," Statistics & Probability Letters, Elsevier, vol. 91(C), pages 20-26.
    12. Scharth, Marcel & Kohn, Robert, 2016. "Particle efficient importance sampling," Journal of Econometrics, Elsevier, vol. 190(1), pages 133-147.
    13. Kleppe, Tore Selland & Skaug, Hans Julius, 2012. "Fitting general stochastic volatility models using Laplace accelerated sequential importance sampling," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3105-3119.
    14. Mogens Bladt & Samuel Finch & Michael Sørensen, 2016. "Simulation of multivariate diffusion bridges," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(2), pages 343-369, March.
    15. Kleppe, Tore Selland & Oglend, Atle, 2017. "Estimating the competitive storage model: A simulated likelihood approach," Econometrics and Statistics, Elsevier, vol. 4(C), pages 39-56.
    16. Beskos, Alexandros & Kalogeropoulos, Konstantinos & Pazos, Erik, 2013. "Advanced MCMC methods for sampling on diffusion pathspace," Stochastic Processes and their Applications, Elsevier, vol. 123(4), pages 1415-1453.
    17. Pitt, Michael K. & Silva, Ralph dos Santos & Giordani, Paolo & Kohn, Robert, 2012. "On some properties of Markov chain Monte Carlo simulation methods based on the particle filter," Journal of Econometrics, Elsevier, vol. 171(2), pages 134-151.
    18. Theodore Simos & Mike Tsionas, 2018. "Bayesian inference of the fractional Ornstein–Uhlenbeck process under a flow sampling scheme," Computational Statistics, Springer, vol. 33(4), pages 1687-1713, December.
    19. Falk Bräuning & Siem Jan Koopman, 2016. "The dynamic factor network model with an application to global credit risk," Working Papers 16-13, Federal Reserve Bank of Boston.
    20. Mesters, G. & Koopman, S.J., 2014. "Generalized dynamic panel data models with random effects for cross-section and time," Journal of Econometrics, Elsevier, vol. 180(2), pages 127-140.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:84:y:2015:i:c:p:54-67. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.