IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v222y2012i2p328-340.html
   My bibliography  Save this article

Approximate dynamic programming algorithms for optimal dosage decisions in controlled ovarian hyperstimulation

Author

Listed:
  • He, Miao
  • Zhao, Lei
  • Powell, Warren B.

Abstract

In the controlled ovarian hyperstimulation (COH) treatment, clinicians monitor the patients’ physiological responses to gonadotropin administration to tradeoff between pregnancy probability and ovarian hyperstimulation syndrome (OHSS). We formulate the dosage control problem in the COH treatment as a stochastic dynamic program and design approximate dynamic programming (ADP) algorithms to overcome the well-known curses of dimensionality in Markov decision processes (MDP). Our numerical experiments indicate that the piecewise linear (PWL) approximation ADP algorithms can obtain policies that are very close to the one obtained by the MDP benchmark with significantly less solution time.

Suggested Citation

  • He, Miao & Zhao, Lei & Powell, Warren B., 2012. "Approximate dynamic programming algorithms for optimal dosage decisions in controlled ovarian hyperstimulation," European Journal of Operational Research, Elsevier, vol. 222(2), pages 328-340.
    • Handle: RePEc:eee:ejores:v:222:y:2012:i:2:p:328-340
    DOI: 10.1016/j.ejor.2012.03.049
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221712002755
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ejor.2012.03.049?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bahar Biller & Barry L. Nelson, 2005. "Fitting Time-Series Input Processes for Simulation," Operations Research, INFORMS, vol. 53(3), pages 549-559, June.
    2. Miao He & Lei Zhao & Warren Powell, 2010. "Optimal control of dosage decisions in controlled ovarian hyperstimulation," Annals of Operations Research, Springer, vol. 178(1), pages 223-245, July.
    3. Marne C. Cario & Barry L. Nelson, 1998. "Numerical Methods for Fitting and Simulating Autoregressive-to-Anything Processes," INFORMS Journal on Computing, INFORMS, vol. 10(1), pages 72-81, February.
    4. Schmid, Verena, 2012. "Solving the dynamic ambulance relocation and dispatching problem using approximate dynamic programming," European Journal of Operational Research, Elsevier, vol. 219(3), pages 611-621.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ilya O. Ryzhov & Martijn R. K. Mes & Warren B. Powell & Gerald van den Berg, 2019. "Bayesian Exploration for Approximate Dynamic Programming," Operations Research, INFORMS, vol. 67(1), pages 198-214, January.
    2. Chen, Xi & Hewitt, Mike & Thomas, Barrett W., 2018. "An approximate dynamic programming method for the multi-period technician scheduling problem with experience-based service times and stochastic customers," International Journal of Production Economics, Elsevier, vol. 196(C), pages 122-134.
    3. Arruda, Edilson F. & Ourique, Fabrício O. & LaCombe, Jason & Almudevar, Anthony, 2013. "Accelerating the convergence of value iteration by using partial transition functions," European Journal of Operational Research, Elsevier, vol. 229(1), pages 190-198.
    4. Ulmer, Marlin W. & Thomas, Barrett W., 2020. "Meso-parametric value function approximation for dynamic customer acceptances in delivery routing," European Journal of Operational Research, Elsevier, vol. 285(1), pages 183-195.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Miao He & Lei Zhao & Warren Powell, 2010. "Optimal control of dosage decisions in controlled ovarian hyperstimulation," Annals of Operations Research, Springer, vol. 178(1), pages 223-245, July.
    2. Bahar Biller, 2009. "Copula-Based Multivariate Input Models for Stochastic Simulation," Operations Research, INFORMS, vol. 57(4), pages 878-892, August.
    3. Bahar Biller & Barry L. Nelson, 2008. "Evaluation of the ARTAFIT Method for Fitting Time-Series Input Processes for Simulation," INFORMS Journal on Computing, INFORMS, vol. 20(3), pages 485-498, August.
    4. Peter J. H. Hulshof & Martijn R. K. Mes & Richard J. Boucherie & Erwin W. Hans, 2016. "Patient admission planning using Approximate Dynamic Programming," Flexible Services and Manufacturing Journal, Springer, vol. 28(1), pages 30-61, June.
    5. Deng, Qichen & Santos, Bruno F., 2022. "Lookahead approximate dynamic programming for stochastic aircraft maintenance check scheduling optimization," European Journal of Operational Research, Elsevier, vol. 299(3), pages 814-833.
    6. Hejn Nielsen, Erland, 2007. "Autocorrelation in queuing network-type production systems--Revisited," International Journal of Production Economics, Elsevier, vol. 110(1-2), pages 138-146, October.
    7. Max Auerswald & Morten Moshagen, 2015. "Generating Correlated, Non-normally Distributed Data Using a Non-linear Structural Model," Psychometrika, Springer;The Psychometric Society, vol. 80(4), pages 920-937, December.
    8. Amir Rastpour & Armann Ingolfsson & Bora Kolfal, 2020. "Modeling Yellow and Red Alert Durations for Ambulance Systems," Production and Operations Management, Production and Operations Management Society, vol. 29(8), pages 1972-1991, August.
    9. Su, Qiang & Luo, Qinyi & Huang, Samuel H., 2015. "Cost-effective analyses for emergency medical services deployment: A case study in Shanghai," International Journal of Production Economics, Elsevier, vol. 163(C), pages 112-123.
    10. Aristidis K. Nikoloulopoulos & Peter G. Moffatt, 2019. "Coupling Couples With Copulas: Analysis Of Assortative Matching On Risk Attitude," Economic Inquiry, Western Economic Association International, vol. 57(1), pages 654-666, January.
    11. Almehdawe, Eman & Jewkes, Beth & He, Qi-Ming, 2013. "A Markovian queueing model for ambulance offload delays," European Journal of Operational Research, Elsevier, vol. 226(3), pages 602-614.
    12. van Barneveld, T.C. & Bhulai, S. & van der Mei, R.D., 2016. "The effect of ambulance relocations on the performance of ambulance service providers," European Journal of Operational Research, Elsevier, vol. 252(1), pages 257-269.
    13. Mohamed A. Ayadi & Hatem Ben-Ameur & Nabil Channouf & Quang Khoi Tran, 2019. "NORTA for portfolio credit risk," Annals of Operations Research, Springer, vol. 281(1), pages 99-119, October.
    14. Westgate, Bradford S. & Woodard, Dawn B. & Matteson, David S. & Henderson, Shane G., 2016. "Large-network travel time distribution estimation for ambulances," European Journal of Operational Research, Elsevier, vol. 252(1), pages 322-333.
    15. Lee, Yu-Ching & Chen, Yu-Shih & Chen, Albert Y., 2022. "Lagrangian dual decomposition for the ambulance relocation and routing considering stochastic demand with the truncated Poisson," Transportation Research Part B: Methodological, Elsevier, vol. 157(C), pages 1-23.
    16. Zolfagharinia, Hossein & Haughton, Michael, 2016. "Effective truckload dispatch decision methods with incomplete advance load information," European Journal of Operational Research, Elsevier, vol. 252(1), pages 103-121.
    17. Hua, Lei & Joe, Harry, 2014. "Strength of tail dependence based on conditional tail expectation," Journal of Multivariate Analysis, Elsevier, vol. 123(C), pages 143-159.
    18. Bahar Biller & Barry L. Nelson, 2005. "Fitting Time-Series Input Processes for Simulation," Operations Research, INFORMS, vol. 53(3), pages 549-559, June.
    19. Heejung Park, 2022. "A Unit Commitment Model Considering Feasibility of Operating Reserves under Stochastic Optimization Framework," Energies, MDPI, vol. 15(17), pages 1-22, August.
    20. Boyacı, Burak & Geroliminis, Nikolas, 2015. "Approximation methods for large-scale spatial queueing systems," Transportation Research Part B: Methodological, Elsevier, vol. 74(C), pages 151-181.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:222:y:2012:i:2:p:328-340. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.