IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v222y2012i2p328-340.html
   My bibliography  Save this article

Approximate dynamic programming algorithms for optimal dosage decisions in controlled ovarian hyperstimulation

Author

Listed:
  • He, Miao
  • Zhao, Lei
  • Powell, Warren B.

Abstract

In the controlled ovarian hyperstimulation (COH) treatment, clinicians monitor the patients’ physiological responses to gonadotropin administration to tradeoff between pregnancy probability and ovarian hyperstimulation syndrome (OHSS). We formulate the dosage control problem in the COH treatment as a stochastic dynamic program and design approximate dynamic programming (ADP) algorithms to overcome the well-known curses of dimensionality in Markov decision processes (MDP). Our numerical experiments indicate that the piecewise linear (PWL) approximation ADP algorithms can obtain policies that are very close to the one obtained by the MDP benchmark with significantly less solution time.

Suggested Citation

  • He, Miao & Zhao, Lei & Powell, Warren B., 2012. "Approximate dynamic programming algorithms for optimal dosage decisions in controlled ovarian hyperstimulation," European Journal of Operational Research, Elsevier, vol. 222(2), pages 328-340.
    • Handle: RePEc:eee:ejores:v:222:y:2012:i:2:p:328-340
    DOI: 10.1016/j.ejor.2012.03.049
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221712002755
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ejor.2012.03.049?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bahar Biller & Barry L. Nelson, 2005. "Fitting Time-Series Input Processes for Simulation," Operations Research, INFORMS, vol. 53(3), pages 549-559, June.
    2. Miao He & Lei Zhao & Warren Powell, 2010. "Optimal control of dosage decisions in controlled ovarian hyperstimulation," Annals of Operations Research, Springer, vol. 178(1), pages 223-245, July.
    3. Marne C. Cario & Barry L. Nelson, 1998. "Numerical Methods for Fitting and Simulating Autoregressive-to-Anything Processes," INFORMS Journal on Computing, INFORMS, vol. 10(1), pages 72-81, February.
    4. Schmid, Verena, 2012. "Solving the dynamic ambulance relocation and dispatching problem using approximate dynamic programming," European Journal of Operational Research, Elsevier, vol. 219(3), pages 611-621.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ilya O. Ryzhov & Martijn R. K. Mes & Warren B. Powell & Gerald van den Berg, 2019. "Bayesian Exploration for Approximate Dynamic Programming," Operations Research, INFORMS, vol. 67(1), pages 198-214, January.
    2. Chen, Xi & Hewitt, Mike & Thomas, Barrett W., 2018. "An approximate dynamic programming method for the multi-period technician scheduling problem with experience-based service times and stochastic customers," International Journal of Production Economics, Elsevier, vol. 196(C), pages 122-134.
    3. Arruda, Edilson F. & Ourique, Fabrício O. & LaCombe, Jason & Almudevar, Anthony, 2013. "Accelerating the convergence of value iteration by using partial transition functions," European Journal of Operational Research, Elsevier, vol. 229(1), pages 190-198.
    4. Ulmer, Marlin W. & Thomas, Barrett W., 2020. "Meso-parametric value function approximation for dynamic customer acceptances in delivery routing," European Journal of Operational Research, Elsevier, vol. 285(1), pages 183-195.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Miao He & Lei Zhao & Warren Powell, 2010. "Optimal control of dosage decisions in controlled ovarian hyperstimulation," Annals of Operations Research, Springer, vol. 178(1), pages 223-245, July.
    2. Bahar Biller & Barry L. Nelson, 2008. "Evaluation of the ARTAFIT Method for Fitting Time-Series Input Processes for Simulation," INFORMS Journal on Computing, INFORMS, vol. 20(3), pages 485-498, August.
    3. Bahar Biller, 2009. "Copula-Based Multivariate Input Models for Stochastic Simulation," Operations Research, INFORMS, vol. 57(4), pages 878-892, August.
    4. Peter J. H. Hulshof & Martijn R. K. Mes & Richard J. Boucherie & Erwin W. Hans, 2016. "Patient admission planning using Approximate Dynamic Programming," Flexible Services and Manufacturing Journal, Springer, vol. 28(1), pages 30-61, June.
    5. Chen, Huifen & Cheng, Yuyen, 2009. "Designing charts for known autocorrelations and unknown marginal distribution," European Journal of Operational Research, Elsevier, vol. 198(2), pages 520-529, October.
    6. Deng, Qichen & Santos, Bruno F., 2022. "Lookahead approximate dynamic programming for stochastic aircraft maintenance check scheduling optimization," European Journal of Operational Research, Elsevier, vol. 299(3), pages 814-833.
    7. Amir Ali Nasrollahzadeh & Amin Khademi & Maria E. Mayorga, 2018. "Real-Time Ambulance Dispatching and Relocation," Manufacturing & Service Operations Management, INFORMS, vol. 20(3), pages 467-480, July.
    8. Kalema, George & Molenberghs, Geert, 2016. "Generating Correlated and/or Overdispersed Count Data: A SAS Implementation," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 70(c01).
    9. Xuefei Lu & Alessandro Rudi & Emanuele Borgonovo & Lorenzo Rosasco, 2020. "Faster Kriging: Facing High-Dimensional Simulators," Operations Research, INFORMS, vol. 68(1), pages 233-249, January.
    10. Acuna, Jorge A. & Zayas-Castro, José L. & Charkhgard, Hadi, 2020. "Ambulance allocation optimization model for the overcrowding problem in US emergency departments: A case study in Florida," Socio-Economic Planning Sciences, Elsevier, vol. 71(C).
    11. Hejn Nielsen, Erland, 2007. "Autocorrelation in queuing network-type production systems--Revisited," International Journal of Production Economics, Elsevier, vol. 110(1-2), pages 138-146, October.
    12. Max Auerswald & Morten Moshagen, 2015. "Generating Correlated, Non-normally Distributed Data Using a Non-linear Structural Model," Psychometrika, Springer;The Psychometric Society, vol. 80(4), pages 920-937, December.
    13. Martin van Buuren & Caroline Jagtenberg & Thije van Barneveld & Rob van der Mei & Sandjai Bhulai, 2018. "Ambulance Dispatch Center Pilots Proactive Relocation Policies to Enhance Effectiveness," Interfaces, INFORMS, vol. 48(3), pages 235-246, June.
    14. Amir Rastpour & Armann Ingolfsson & Bora Kolfal, 2020. "Modeling Yellow and Red Alert Durations for Ambulance Systems," Production and Operations Management, Production and Operations Management Society, vol. 29(8), pages 1972-1991, August.
    15. Jagtenberg, C.J. & van den Berg, P.L. & van der Mei, R.D., 2017. "Benchmarking online dispatch algorithms for Emergency Medical Services," European Journal of Operational Research, Elsevier, vol. 258(2), pages 715-725.
    16. Ranon Jientrakul & Chumpol Yuangyai & Klongkwan Boonkul & Pakinai Chaicharoenwut & Suriyaphong Nilsang & Sittiporn Pimsakul, 2022. "Integrating Spatial Risk Factors with Social Media Data Analysis for an Ambulance Allocation Strategy: A Case Study in Bangkok," Sustainability, MDPI, vol. 14(16), pages 1-15, August.
    17. Su, Qiang & Luo, Qinyi & Huang, Samuel H., 2015. "Cost-effective analyses for emergency medical services deployment: A case study in Shanghai," International Journal of Production Economics, Elsevier, vol. 163(C), pages 112-123.
    18. Aristidis K. Nikoloulopoulos & Peter G. Moffatt, 2019. "Coupling Couples With Copulas: Analysis Of Assortative Matching On Risk Attitude," Economic Inquiry, Western Economic Association International, vol. 57(1), pages 654-666, January.
    19. Sondes Hammami & Aida Jebali, 2021. "Designing modular capacitated emergency medical service using information on ambulance trip," Operational Research, Springer, vol. 21(3), pages 1723-1742, September.
    20. Almehdawe, Eman & Jewkes, Beth & He, Qi-Ming, 2013. "A Markovian queueing model for ambulance offload delays," European Journal of Operational Research, Elsevier, vol. 226(3), pages 602-614.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:222:y:2012:i:2:p:328-340. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.