IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v41y1995i3p524-554.html
   My bibliography  Save this article

Asymptotics of Likelihood Ratio Derivative Estimators in Simulations of Highly Reliable Markovian Systems

Author

Listed:
  • Marvin K. Nakayama

    (Computer and Information Science Department, New Jersey Institute of Technology, University Heights, Newark, New Jersey 07102)

Abstract

We discuss the estimation of derivatives of a performance measure using the likelihood ratio method in simulations of highly reliable Markovian systems. We compare the difficulties of estimating the performance measure and of estimating its partial derivatives with respect to component failure rates as the component failure rates tend to 0 and the component repair rates remain fixed. We first consider the case when the quantities are estimated using naive simulation; i.e., when no variance reduction technique is used. In particular, we prove that in the limit, some of the partial derivatives can be estimated as accurately as the performance measure itself. This result is of particular interest in light of the somewhat pessimistic empirical results others have obtained when applying the likelihood ratio method to other types of systems. However, the result only holds for certain partial derivatives of the performance measure when using naive simulation. More specifically, we can estimate a certain partial derivative with the same relative accuracy as the performance measure if the partial derivative is associated with a component either having one of the largest failure rates or whose failure can trigger a failure transition on one of the "most likely paths to failure." Also, we develop a simple criterion to determine which partial derivatives will satisfy either of these properties. In particular, we can identify these derivatives using a sensitivity measure which can be calculated for each type of component. We also examine the limiting behavior of the estimates of the performance measure and its derivatives which are obtained when an importance sampling scheme known as balanced failure biasing is used. In particular, we show that the estimates of all derivatives can be improved. In contrast to the situation that arose when using naive simulation, we prove that in the limit, all derivatives can be estimated as accurately as the performance measure when balanced failure biasing is employed. Finally, we formalize the notion of a "most likely path to failure" in the setting of highly reliable Markovian systems. We accomplish this by proving a conditional limit theorem for the distribution of the sample paths leading to a system failure, given that a system failure occurs before the system returns to the state with all components operational. We use this result to establish our other results.

Suggested Citation

  • Marvin K. Nakayama, 1995. "Asymptotics of Likelihood Ratio Derivative Estimators in Simulations of Highly Reliable Markovian Systems," Management Science, INFORMS, vol. 41(3), pages 524-554, March.
  • Handle: RePEc:inm:ormnsc:v:41:y:1995:i:3:p:524-554
    DOI: 10.1287/mnsc.41.3.524
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.41.3.524
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.41.3.524?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Li, Jinghui & Mosleh, Ali & Kang, Rui, 2011. "Likelihood ratio gradient estimation for dynamic reliability applications," Reliability Engineering and System Safety, Elsevier, vol. 96(12), pages 1667-1679.
    2. Marvin K. Nakayama, 1998. "On Derivative Estimation of the Mean Time to Failure in Simulations of Highly Reliable Markovian Systems," Operations Research, INFORMS, vol. 46(2), pages 285-290, April.
    3. Marvin K. Nakayama & Perwez Shahabuddin, 1998. "Likelihood Ratio Derivative Estimation for Finite-Time Performance Measures in Generalized Semi-Markov Processes," Management Science, INFORMS, vol. 44(10), pages 1426-1441, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:41:y:1995:i:3:p:524-554. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.