IDEAS home Printed from https://ideas.repec.org/a/inm/ortrsc/v38y2004i1p42-70.html
   My bibliography  Save this article

Dynamic Programming Approximations for a Stochastic Inventory Routing Problem

Author

Listed:
  • Anton J. Kleywegt

    (School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, Georgia 30332-0205)

  • Vijay S. Nori

    (School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, Georgia 30332-0205)

  • Martin W. P. Savelsbergh

    (School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, Georgia 30332-0205)

Abstract

This work is motivated by the need to solve the inventory routing problem when implementing a business practice called vendor managed inventory replenishment (VMI). With VMI, vendors monitor their customers′ inventories and decide when and how much inventory should be replenished at each customer. The inventory routing problem attempts to coordinate inventory replenishment and transportation in such a way that the cost is minimized over the long run. We formulate a Markov decision process model of the stochastic inventory routing problem and propose approximation methods to find good solutions with reasonable computational effort. We indicate how the proposed approach can be used for other Markov decision processes involving the control of multiple resources.

Suggested Citation

  • Anton J. Kleywegt & Vijay S. Nori & Martin W. P. Savelsbergh, 2004. "Dynamic Programming Approximations for a Stochastic Inventory Routing Problem," Transportation Science, INFORMS, vol. 38(1), pages 42-70, February.
    • Handle: RePEc:inm:ortrsc:v:38:y:2004:i:1:p:42-70
    DOI: 10.1287/trsc.1030.0041
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/trsc.1030.0041
    Download Restriction: no
    File URL: https://libkey.io/10.1287/trsc.1030.0041?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Anton J. Kleywegt & Vijay S. Nori & Martin W. P. Savelsbergh, 2002. "The Stochastic Inventory Routing Problem with Direct Deliveries," Transportation Science, INFORMS, vol. 36(1), pages 94-118, February.
    2. Lawrence D. Burns & Randolph W. Hall & Dennis E. Blumenfeld & Carlos F. Daganzo, 1985. "Distribution Strategies that Minimize Transportation and Inventory Costs," Operations Research, INFORMS, vol. 33(3), pages 469-490, June.
    3. S. Anily & A. Federgruen, 1991. "Rejoinder to "Comments on One-Warehouse Multiple Retailer Systems with Vehicle Routing Costs"," Management Science, INFORMS, vol. 37(11), pages 1497-1499, November.
    4. Guillermo Gallego & David Simchi-Levi, 1990. "On the Effectiveness of Direct Shipping Strategy for the One-Warehouse Multi-Retailer R-Systems," Management Science, INFORMS, vol. 36(2), pages 240-243, February.
    5. Marielle Christiansen & Bjorn Nygreen, 1998. "A method for solving ship routing problemswith inventory constraints," Annals of Operations Research, Springer, vol. 81(0), pages 357-378, June.
    6. S. Anily & A. Federgruen, 1993. "Two-Echelon Distribution Systems with Vehicle Routing Costs and Central Inventories," Operations Research, INFORMS, vol. 41(1), pages 37-47, February.
    7. Donald M. Topkis, 1968. "Optimal Ordering and Rationing Policies in a Nonstationary Dynamic Inventory Model with n Demand Classes," Management Science, INFORMS, vol. 15(3), pages 160-176, November.
    8. Barnes-Schuster, Dawn & Bassok, Yehuda, 1997. "Direct shipping and the dynamic single-depot/multi-retailer inventory system," European Journal of Operational Research, Elsevier, vol. 101(3), pages 509-518, September.
    9. Barry L. Nelson & Frank J. Matejcik, 1995. "Using Common Random Numbers for Indifference-Zone Selection and Multiple Comparisons in Simulation," Management Science, INFORMS, vol. 41(12), pages 1935-1945, December.
    10. Martin I. Reiman & Rodrigo Rubio & Lawrence M. Wein, 1999. "Heavy Traffic Analysis of the Dynamic Stochastic Inventory-Routing Problem," Transportation Science, INFORMS, vol. 33(4), pages 361-380, November.
    11. Sila Çetinkaya & Chung-Yee Lee, 2000. "Stock Replenishment and Shipment Scheduling for Vendor-Managed Inventory Systems," Management Science, INFORMS, vol. 46(2), pages 217-232, February.
    12. Moshe Dror & Michael Ball, 1987. "Inventory/routing: Reduction from an annual to a short‐period problem," Naval Research Logistics (NRL), John Wiley & Sons, vol. 34(6), pages 891-905, December.
    13. Victoria C. P. Chen & David Ruppert & Christine A. Shoemaker, 1999. "Applying Experimental Design and Regression Splines to High-Dimensional Continuous-State Stochastic Dynamic Programming," Operations Research, INFORMS, vol. 47(1), pages 38-53, February.
    14. Richard C. Larson, 1988. "Transporting Sludge to the 106-Mile Site: An Inventory/Routing Model for Fleet Sizing and Logistics System Design," Transportation Science, INFORMS, vol. 22(3), pages 186-198, August.
    15. T. William Chien & Anantaram Balakrishnan & Richard T. Wong, 1989. "An Integrated Inventory Allocation and Vehicle Routing Problem," Transportation Science, INFORMS, vol. 23(2), pages 67-76, May.
    16. Peter J. Wong, 1970. "A New Decomposition Procedure for Dynamic Programming," Operations Research, INFORMS, vol. 18(1), pages 119-131, February.
    17. S. Anily & A. Federgruen, 1990. "One Warehouse Multiple Retailer Systems with Vehicle Routing Costs," Management Science, INFORMS, vol. 36(1), pages 92-114, January.
    18. Ward Whitt, 1979. "Approximations of Dynamic Programs, II," Mathematics of Operations Research, INFORMS, vol. 4(2), pages 179-185, May.
    19. Warren B. Powell & Tassio A. Carvalho, 1998. "Dynamic Control of Logistics Queueing Networks for Large-Scale Fleet Management," Transportation Science, INFORMS, vol. 32(2), pages 90-109, May.
    20. Marielle Christiansen, 1999. "Decomposition of a Combined Inventory and Time Constrained Ship Routing Problem," Transportation Science, INFORMS, vol. 33(1), pages 3-16, February.
    21. Pierre Trudeau & Moshe Dror, 1992. "Stochastic Inventory Routing: Route Design with Stockouts and Route Failures," Transportation Science, INFORMS, vol. 26(3), pages 171-184, August.
    22. David F. Rogers & Robert D. Plante & Richard T. Wong & James R. Evans, 1991. "Aggregation and Disaggregation Techniques and Methodology in Optimization," Operations Research, INFORMS, vol. 39(4), pages 553-582, August.
    23. Alan S. Minkoff, 1993. "A Markov Decision Model and Decomposition Heuristic for Dynamic Vehicle Dispatching," Operations Research, INFORMS, vol. 41(1), pages 77-90, February.
    24. Luca Bertazzi & Giuseppe Paletta & M. Grazia Speranza, 2002. "Deterministic Order-Up-To Level Policies in an Inventory Routing Problem," Transportation Science, INFORMS, vol. 36(1), pages 119-132, February.
    25. Jonathan F. Bard & Liu Huang & Patrick Jaillet & Moshe Dror, 1998. "A Decomposition Approach to the Inventory Routing Problem with Satellite Facilities," Transportation Science, INFORMS, vol. 32(2), pages 189-203, May.
    26. Marielle Christiansen & Bjørn Nygreen, 1998. "Modelling path flows for a combined ship routingand inventory management problem," Annals of Operations Research, Springer, vol. 82(0), pages 391-413, August.
    27. Walter J. Bell & Louis M. Dalberto & Marshall L. Fisher & Arnold J. Greenfield & R. Jaikumar & Pradeep Kedia & Robert G. Mack & Paul J. Prutzman, 1983. "Improving the Distribution of Industrial Gases with an On-Line Computerized Routing and Scheduling Optimizer," Interfaces, INFORMS, vol. 13(6), pages 4-23, December.
    28. Philip Kaminsky & David Simchi-Levi, 1998. "Probabilistic Analysis and Practical Algorithms for the Flow Shop Weighted Completion Time Problem," Operations Research, INFORMS, vol. 46(6), pages 872-882, December.
    29. Awi Federgruen & Paul Zipkin, 1984. "A Combined Vehicle Routing and Inventory Allocation Problem," Operations Research, INFORMS, vol. 32(5), pages 1019-1037, October.
    30. Ward Whitt, 1978. "Approximations of Dynamic Programs, I," Mathematics of Operations Research, INFORMS, vol. 3(3), pages 231-243, August.
    31. Peter J. Wong, 1970. "Letter to the Editor—An Approach to Reducing the Computing Time for Dynamic Programming," Operations Research, INFORMS, vol. 18(1), pages 181-185, February.
    32. Julien Bramel & David Simchi-Levi, 1995. "A Location Based Heuristic for General Routing Problems," Operations Research, INFORMS, vol. 43(4), pages 649-660, August.
    33. Yale Herer & Robin Roundy, 1997. "Heuristics for a One-Warehouse Multiretailer Distribution Problem with Performance Bounds," Operations Research, INFORMS, vol. 45(1), pages 102-115, February.
    34. Lap Mui Ann Chan & Awi Federgruen & David Simchi-Levi, 1998. "Probabilistic Analyses and Practical Algorithms for Inventory-Routing Models," Operations Research, INFORMS, vol. 46(1), pages 96-106, February.
    35. S. Viswanathan & Kamlesh Mathur, 1997. "Integrating Routing and Inventory Decisions in One-Warehouse Multiretailer Multiproduct Distribution Systems," Management Science, INFORMS, vol. 43(3), pages 294-312, March.
    36. D. P. De Farias & B. Van Roy, 2000. "On the Existence of Fixed Points for Approximate Value Iteration and Temporal-Difference Learning," Journal of Optimization Theory and Applications, Springer, vol. 105(3), pages 589-608, June.
    37. Webb, Ian R. & Larson, Richard C., 1995. "Period and phase of customer replenishment: A new approach to the Strategic Inventory/Routing problem," European Journal of Operational Research, Elsevier, vol. 85(1), pages 132-148, August.
    38. Yehuda Bassok & Ricardo Ernst, 1995. "Dynamic Allocations for Multi-Product Distribution," Transportation Science, INFORMS, vol. 29(3), pages 256-266, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Anton J. Kleywegt & Vijay S. Nori & Martin W. P. Savelsbergh, 2002. "The Stochastic Inventory Routing Problem with Direct Deliveries," Transportation Science, INFORMS, vol. 36(1), pages 94-118, February.
    2. Leandro C. Coelho & Jean-François Cordeau & Gilbert Laporte, 2014. "Thirty Years of Inventory Routing," Transportation Science, INFORMS, vol. 48(1), pages 1-19, February.
    3. Jin-Hwa Song & Martin Savelsbergh, 2007. "Performance Measurement for Inventory Routing," Transportation Science, INFORMS, vol. 41(1), pages 44-54, February.
    4. Vishal Gaur & Marshall L. Fisher, 2004. "A Periodic Inventory Routing Problem at a Supermarket Chain," Operations Research, INFORMS, vol. 52(6), pages 813-822, December.
    5. Paweł Hanczar, 2014. "Solving IRP using location based heuristics," Operations Research and Decisions, Wroclaw University of Science and Technology, Faculty of Management, vol. 24(2), pages 81-96.
    6. Patrick Jaillet & Jonathan F. Bard & Liu Huang & Moshe Dror, 2002. "Delivery Cost Approximations for Inventory Routing Problems in a Rolling Horizon Framework," Transportation Science, INFORMS, vol. 36(3), pages 292-300, August.
    7. Oğuz Solyalı & Haldun Süral, 2011. "A Branch-and-Cut Algorithm Using a Strong Formulation and an A Priori Tour-Based Heuristic for an Inventory-Routing Problem," Transportation Science, INFORMS, vol. 45(3), pages 335-345, August.
    8. N H Moin & S Salhi, 2007. "Inventory routing problems: a logistical overview," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(9), pages 1185-1194, September.
    9. Raa, Birger & Aghezzaf, El-Houssaine, 2009. "A practical solution approach for the cyclic inventory routing problem," European Journal of Operational Research, Elsevier, vol. 192(2), pages 429-441, January.
    10. Mohd Kamarul Irwan Abdul Rahim & El-Houssaine Aghezzaf & Veronique Limère & Birger Raa, 2016. "Analysing the effectiveness of vendor-managed inventory in a single-warehouse, multiple-retailer system," International Journal of Systems Science, Taylor & Francis Journals, vol. 47(8), pages 1953-1965, June.
    11. Ali Ekici & Okan Örsan Özener & Gültekin Kuyzu, 2015. "Cyclic Delivery Schedules for an Inventory Routing Problem," Transportation Science, INFORMS, vol. 49(4), pages 817-829, November.
    12. Fokkema, Jan Eise & Land, Martin J. & Coelho, Leandro C. & Wortmann, Hans & Huitema, George B., 2020. "A continuous-time supply-driven inventory-constrained routing problem," Omega, Elsevier, vol. 92(C).
    13. Oğuz Solyalı & Jean-François Cordeau & Gilbert Laporte, 2012. "Robust Inventory Routing Under Demand Uncertainty," Transportation Science, INFORMS, vol. 46(3), pages 327-340, August.
    14. Jaeheon Jung & Kamlesh Mathur, 2007. "An Efficient Heuristic Algorithm for a Two-Echelon Joint Inventory and Routing Problem," Transportation Science, INFORMS, vol. 41(1), pages 55-73, February.
    15. Luca Bertazzi, 2008. "Analysis of Direct Shipping Policies in an Inventory-Routing Problem with Discrete Shipping Times," Management Science, INFORMS, vol. 54(4), pages 748-762, April.
    16. Sonntag, Danja R. & Schrotenboer, Albert H. & Kiesmüller, Gudrun P., 2023. "Stochastic inventory routing with time-based shipment consolidation," European Journal of Operational Research, Elsevier, vol. 306(3), pages 1186-1201.
    17. Yves Crama & Mahmood Rezaei & Martin Savelsbergh & Tom Van Woensel, 2018. "Stochastic Inventory Routing for Perishable Products," Transportation Science, INFORMS, vol. 52(3), pages 526-546, June.
    18. Zhao, Qiu-Hong & Chen, Shuang & Zang, Cun-Xun, 2008. "Model and algorithm for inventory/routing decision in a three-echelon logistics system," European Journal of Operational Research, Elsevier, vol. 191(3), pages 623-635, December.
    19. Divsalar, Ali & Vansteenwegen, Pieter, 2016. "A two-phase algorithm for the cyclic inventory routing problemAuthor-Name: Chitsaz, Masoud," European Journal of Operational Research, Elsevier, vol. 254(2), pages 410-426.
    20. Aghezzaf, El-Houssaine & Raa, Birger & Van Landeghem, Hendrik, 2006. "Modeling inventory routing problems in supply chains of high consumption products," European Journal of Operational Research, Elsevier, vol. 169(3), pages 1048-1063, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ortrsc:v:38:y:2004:i:1:p:42-70. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.