IDEAS home Printed from https://ideas.repec.org/a/wly/jnljam/v2014y2014i1n238357.html

Intelligent Inventory Control via Ruminative Reinforcement Learning

Author

Listed:
  • Tatpong Katanyukul
  • Edwin K. P. Chong

Abstract

Inventory management is a sequential decision problem that can be solved with reinforcement learning (RL). Although RL in its conventional form does not require domain knowledge, exploiting such knowledge of problem structure, usually available in inventory management, can be beneficial to improving the learning quality and speed of RL. Ruminative reinforcement learning (RRL) has been introduced recently based on this approach. RRL is motivated by how humans contemplate the consequences of their actions in trying to learn how to make a better decision. This study further investigates the issues of RRL and proposes new RRL methods applied to inventory management. Our investigation provides insight into different RRL characteristics, and our experimental results show the viability of the new methods.

Suggested Citation

  • Tatpong Katanyukul & Edwin K. P. Chong, 2014. "Intelligent Inventory Control via Ruminative Reinforcement Learning," Journal of Applied Mathematics, John Wiley & Sons, vol. 2014(1).
  • Handle: RePEc:wly:jnljam:v:2014:y:2014:i:1:n:238357
    DOI: 10.1155/2014/238357
    as

    Download full text from publisher

    File URL: https://doi.org/10.1155/2014/238357
    Download Restriction: no

    File URL: https://libkey.io/10.1155/2014/238357?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Dimitris Bertsimas & Aurélie Thiele, 2006. "A Robust Optimization Approach to Inventory Theory," Operations Research, INFORMS, vol. 54(1), pages 150-168, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bergsma, Ritsaart & de Ruijt, Corné & Bhulai, Sandjai, 2025. "A systematic review of machine learning approaches in inventory control optimization," Operations Research Perspectives, Elsevier, vol. 15(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Minjiao Zhang & Simge Küçükyavuz & Saumya Goel, 2014. "A Branch-and-Cut Method for Dynamic Decision Making Under Joint Chance Constraints," Management Science, INFORMS, vol. 60(5), pages 1317-1333, May.
    2. Sarhadi, Hassan & Naoum-Sawaya, Joe & Verma, Manish, 2020. "A robust optimization approach to locating and stockpiling marine oil-spill response facilities," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 141(C).
    3. Axsäter, Sven, 2011. "Batch quantities when forecasts are improving," International Journal of Production Economics, Elsevier, vol. 133(1), pages 212-215, September.
    4. Serrano, Breno & Minner, Stefan & Schiffer, Maximilian & Vidal, Thibaut, 2024. "Bilevel optimization for feature selection in the data-driven newsvendor problem," European Journal of Operational Research, Elsevier, vol. 315(2), pages 703-714.
    5. Chen, Xiaoming & He, Ruichun & Li, Haijun & Li, Yinzhen & Xiong, Yi & Ju, Yuxiang & Li, Zhuo, 2026. "Designing a cross-regional emergency response network considering spatiotemporal evolution: A smart predict-then-optimise method," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 206(C).
    6. Dario Bauso & Rosario Maggistro & Raffaele Pesenti, 2020. "Robust Sub-optimality of Linear-Saturated Control via Quadratic Zero-Sum Differential Games," Journal of Optimization Theory and Applications, Springer, vol. 184(3), pages 1109-1125, March.
    7. Marc Goerigk & Mohammad Khosravi, 2025. "Robust combinatorial optimization problems under budgeted interdiction uncertainty," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 47(1), pages 255-285, March.
    8. Nir Halman & Giacomo Nannicini, 2025. "Fully Polynomial Time Approximation Schemes for Robust Multistage Decision Making," INFORMS Journal on Computing, INFORMS, vol. 37(5), pages 1306-1327, September.
    9. Qiu, Ruozhen & Sun, Minghe & Lim, Yun Fong, 2017. "Optimizing (s, S) policies for multi-period inventory models with demand distribution uncertainty: Robust dynamic programing approaches," European Journal of Operational Research, Elsevier, vol. 261(3), pages 880-892.
    10. Malin Song & Sai Yuan & Hongguang Bo & Jinbo Song & Xiongfeng Pan & Kairui Jin, 2024. "Robust optimization model of anti-epidemic supply chain under technological innovation: learning from COVID-19," Annals of Operations Research, Springer, vol. 335(3), pages 1331-1361, April.
    11. Zhang, Jie & Xie, Weijun & Sarin, Subhash C., 2021. "Robust multi-product newsvendor model with uncertain demand and substitution," European Journal of Operational Research, Elsevier, vol. 293(1), pages 190-202.
    12. Rui Peng Liu & Konstantina Mellou & Evelyn Xiao-Yue Gong & Beibin Li & Thomas Coffee & Jeevan Pathuri & David Simchi-Levi & Ishai Menache, 2025. "Efficient Cloud Server Deployment Under Demand Uncertainty," Manufacturing & Service Operations Management, INFORMS, vol. 27(2), pages 425-440, March.
    13. Wang, Zujian & Qi, Mingyao, 2019. "Service network design considering multiple types of services," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 126(C), pages 1-14.
    14. Hamed Mamani & Shima Nassiri & Michael R. Wagner, 2017. "Closed-Form Solutions for Robust Inventory Management," Management Science, INFORMS, vol. 63(5), pages 1625-1643, May.
    15. Mehdi Ansari & Juan S. Borrero & Leonardo Lozano, 2023. "Robust Minimum-Cost Flow Problems Under Multiple Ripple Effect Disruptions," INFORMS Journal on Computing, INFORMS, vol. 35(1), pages 83-103, January.
    16. Jiang, Sheng-Long & Wang, Meihong & Bogle, I. David L., 2023. "Plant-wide byproduct gas distribution under uncertainty in iron and steel industry via quantile forecasting and robust optimization," Applied Energy, Elsevier, vol. 350(C).
    17. Man Yiu Tsang & Tony Sit & Hoi Ying Wong, 2022. "Adaptive Robust Online Portfolio Selection," Papers 2206.01064, arXiv.org.
    18. Boute, Robert N. & Gijsbrechts, Joren & van Jaarsveld, Willem & Vanvuchelen, Nathalie, 2022. "Deep reinforcement learning for inventory control: A roadmap," European Journal of Operational Research, Elsevier, vol. 298(2), pages 401-412.
    19. Metzker Soares, Paula & Thevenin, Simon & Adulyasak, Yossiri & Dolgui, Alexandre, 2024. "Adaptive robust optimization for lot-sizing under yield uncertainty," European Journal of Operational Research, Elsevier, vol. 313(2), pages 513-526.
    20. Qing-chun Meng & Xiao-le Wan & Xiao-xia Rong, 2015. "A Robust Ordering Strategy for Retailers Facing a Free Shipping Option," PLOS ONE, Public Library of Science, vol. 10(5), pages 1-14, May.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:jnljam:v:2014:y:2014:i:1:n:238357. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://onlinelibrary.wiley.com/journal/4185 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.