IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v199y2012i1p215-22410.1007-s10479-011-0992-2.html
   My bibliography  Save this article

Modelling of hydrological persistence for hidden state Markov decision processes

Author

Listed:
  • Aiden Fisher
  • David Green
  • Andrew Metcalfe

Abstract

A reservoir in south east Queensland can supply irrigators, industry or domestic users. Stochastic inflow is modelled by a hidden state Markov chain, with three hidden states corresponding to prevailing climatic conditions. A stochastic dynamic program that relies on estimation of the hidden state is implemented. The optimal decisions are compared with those obtained if the hidden state Markov chain model is replaced with a model that relies on the Southern Oscillation Index to define prevailing climatic conditions. Copyright Springer Science+Business Media, LLC 2012

Suggested Citation

  • Aiden Fisher & David Green & Andrew Metcalfe, 2012. "Modelling of hydrological persistence for hidden state Markov decision processes," Annals of Operations Research, Springer, vol. 199(1), pages 215-224, October.
    • Handle: RePEc:spr:annopr:v:199:y:2012:i:1:p:215-224:10.1007/s10479-011-0992-2
    DOI: 10.1007/s10479-011-0992-2
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s10479-011-0992-2
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s10479-011-0992-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. I. David & L. Friedman & Z. Sinuany‐Stern, 1999. "A simple suboptimal algorithm for system maintenanceunder partial observability," Annals of Operations Research, Springer, vol. 91(0), pages 25-40, January.
    2. Erhan Bayraktar & Michael Ludkovski, 2010. "Inventory management with partially observed nonstationary demand," Annals of Operations Research, Springer, vol. 176(1), pages 7-39, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Roberto Rossi & S. Tarim & Brahim Hnich & Steven Prestwich, 2012. "Constraint programming for stochastic inventory systems under shortage cost," Annals of Operations Research, Springer, vol. 195(1), pages 49-71, May.
    2. Pavel V. Gapeev, 2016. "Bayesian Switching Multiple Disorder Problems," Mathematics of Operations Research, INFORMS, vol. 41(3), pages 1108-1124, August.
    3. Mike Ludkovski, 2022. "Regression Monte Carlo for Impulse Control," Papers 2203.06539, arXiv.org.
    4. Ricardo Montoya & Carlos Gonzalez, 2019. "A Hidden Markov Model to Detect On-Shelf Out-of-Stocks Using Point-of-Sale Data," Manufacturing & Service Operations Management, INFORMS, vol. 21(4), pages 932-948, October.
    5. Moawia Alghalith, 2012. "A New Stopping Time Model: A Solution to a Free-Boundary Problem," Journal of Optimization Theory and Applications, Springer, vol. 152(1), pages 265-270, January.
    6. Park, Hyungjun & Choi, Dong Gu & Min, Daiki, 2023. "Adaptive inventory replenishment using structured reinforcement learning by exploiting a policy structure," International Journal of Production Economics, Elsevier, vol. 266(C).
    7. Manafzadeh Dizbin, Nima & Tan, Barış, 2020. "Optimal control of production-inventory systems with correlated demand inter-arrival and processing times," International Journal of Production Economics, Elsevier, vol. 228(C).
    8. Satya S. Malladi & Alan L. Erera & Chelsea C. White, 2023. "Inventory control with modulated demand and a partially observed modulation process," Annals of Operations Research, Springer, vol. 321(1), pages 343-369, February.
    9. Stößlein, Martin & Kanet, John Jack & Gorman, Mike & Minner, Stefan, 2014. "Time-phased safety stocks planning and its financial impacts: Empirical evidence based on European econometric data," International Journal of Production Economics, Elsevier, vol. 149(C), pages 47-55.
    10. Khayyati, Siamak & Tan, Barış, 2020. "Data-driven control of a production system by using marking-dependent threshold policy," International Journal of Production Economics, Elsevier, vol. 226(C).
    11. Harun Avci & Kagan Gokbayrak & Emre Nadar, 2020. "Structural Results for Average‐Cost Inventory Models with Markov‐Modulated Demand and Partial Information," Production and Operations Management, Production and Operations Management Society, vol. 29(1), pages 156-173, January.
    12. Alghalith, Moawia, 2013. "The interaction among production, hedging and investment decisions," Economic Modelling, Elsevier, vol. 30(C), pages 193-195.
    13. Sinuany-Stern, Zilla, 2023. "Foundations of operations research: From linear programming to data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 306(3), pages 1069-1080.
    14. Jianqiang Hu & Cheng Zhang & Chenbo Zhu, 2016. "( s , S ) Inventory Systems with Correlated Demands," INFORMS Journal on Computing, INFORMS, vol. 28(4), pages 603-611, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:199:y:2012:i:1:p:215-224:10.1007/s10479-011-0992-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.