IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v42y1996i4p475-498.html
   My bibliography  Save this article

A Scaled Stochastic Approximation Algorithm

Author

Listed:
  • Sigrún Andradöttir

    (Department of Industrial Engineering, University of Wisconsin---Madison, 1513 University Avenue, Madison, Wisconsin 53706)

Abstract

Consider a stochastic system of such complexity that its performance can only be evaluated by using simulation or direct experimentation. To optimize the expected performance of such systems as a function of several continuous input parameters (decision variables), we present a "scaled" stochastic approximation algorithm for finding the zero (root) of the gradient of the response function. In each iteration of the scaled algorithm, two independent gradient estimates are sampled at the current estimate of the optimal input-parameter vector to compute a scale-free estimate of the next search direction. We establish sufficient conditions to ensure strong consistency and asymptotic normality of the resulting estimator of the optimal input-parameter vector. Strong consistency is also established for a variant of the scaled algorithm with Kesten's acceleration. An experimental performance comparison of the scaled algorithm and the classical Robbins-Monro algorithm in two simple queueing systems reveals some of the practical advantages of the scaled algorithm.

Suggested Citation

  • Sigrún Andradöttir, 1996. "A Scaled Stochastic Approximation Algorithm," Management Science, INFORMS, vol. 42(4), pages 475-498, April.
    • Handle: RePEc:inm:ormnsc:v:42:y:1996:i:4:p:475-498
    DOI: 10.1287/mnsc.42.4.475
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.42.4.475
    Download Restriction: no
    File URL: https://libkey.io/10.1287/mnsc.42.4.475?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nataša Krejić & Nataša Krklec Jerinkić, 2019. "Spectral projected gradient method for stochastic optimization," Journal of Global Optimization, Springer, vol. 73(1), pages 59-81, January.
    2. Kao, Chiang & Chen, Shih-Pin, 2006. "A stochastic quasi-Newton method for simulation response optimization," European Journal of Operational Research, Elsevier, vol. 173(1), pages 30-46, August.
    3. Nicolai, R.P. & Koning, A.J., 2006. "A general framework for statistical inference on discrete event systems," Econometric Institute Research Papers EI 2006-45, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    4. Chen, Shih-Pin, 2007. "Solving fuzzy queueing decision problems via a parametric mixed integer nonlinear programming method," European Journal of Operational Research, Elsevier, vol. 177(1), pages 445-457, February.
    5. Arsham H., 1998. "Techniques for Monte Carlo Optimizing," Monte Carlo Methods and Applications, De Gruyter, vol. 4(3), pages 181-230, December.
    6. K. Lakshmanan & Shalabh Bhatnagar, 2017. "Quasi-Newton smoothed functional algorithms for unconstrained and constrained simulation optimization," Computational Optimization and Applications, Springer, vol. 66(3), pages 533-556, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:42:y:1996:i:4:p:475-498. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.