IDEAS home Printed from https://ideas.repec.org/a/eee/jomega/v38y2010i1-2p20-32.html
   My bibliography  Save this article

Multi-time scale Markov decision process approach to strategic network growth of reverse supply chains

Author

Listed:
  • Wongthatsanekorn, Wuthichai
  • Realff, Matthew J.
  • Ammons, Jane C.

Abstract

This paper addresses a complex set of decisions that surround the growth over time of reverse supply chain networks that collect used products for reuse, refurbishment, and/or recycling by processors. The collection network growth problem is decomposed into strategic, tactical and operational problems. This paper focuses on the strategic problem which is to determine how to allocate capital budget resource effectively to grow the network to meet long term collection targets and collection cost constraints. We model the strategic problem as a Markov decision process which can also be posed as multi-time scale Markov decision problem. The recruitment problem in a tactical level appears as a sub-problem for the strategic model. Using dynamic programming, linear programming and Q-Learning approaches, an heuristic is implemented to solve realistically sized problems. A numerical study demonstrates that the heuristic can obtain a good solution for the large-scale problem in reasonable time which is not possible when trying to obtain the optimal solution with the exact DP approach.

Suggested Citation

  • Wongthatsanekorn, Wuthichai & Realff, Matthew J. & Ammons, Jane C., 2010. "Multi-time scale Markov decision process approach to strategic network growth of reverse supply chains," Omega, Elsevier, vol. 38(1-2), pages 20-32, February.
    • Handle: RePEc:eee:jomega:v:38:y:2010:i:1-2:p:20-32
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305-0483(09)00017-6
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Srivastava, Samir K., 2008. "Network design for reverse logistics," Omega, Elsevier, vol. 36(4), pages 535-548, August.
    2. Xia, Weijun & Wu, Zhiming, 2007. "Supplier selection with multiple criteria in volume discount environments," Omega, Elsevier, vol. 35(5), pages 494-504, October.
    3. Ruiz-Torres, Alex J. & Mahmoodi, Farzad, 2007. "The optimal number of suppliers considering the costs of individual supplier failures," Omega, Elsevier, vol. 35(1), pages 104-115, February.
    4. Listes, Ovidiu & Dekker, Rommert, 2005. "A stochastic approach to a case study for product recovery network design," European Journal of Operational Research, Elsevier, vol. 160(1), pages 268-287, January.
    5. Hans, E.W. & Herroelen, W. & Leus, R. & Wullink, G., 2007. "A hierarchical approach to multi-project planning under uncertainty," Omega, Elsevier, vol. 35(5), pages 563-577, October.
    6. Gérard P. Cachon & Marshall Fisher, 2000. "Supply Chain Inventory Management and the Value of Shared Information," Management Science, INFORMS, vol. 46(8), pages 1032-1048, August.
    7. Fiala, P., 2005. "Information sharing in supply chains," Omega, Elsevier, vol. 33(5), pages 419-423, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Juhong Chen & Di Wu & Peng Li, 2018. "Research on the Pricing Model of the Dual-Channel Reverse Supply Chain Considering Logistics Costs and Consumers’ Awareness of Sustainability Based on Regional Differences," Sustainability, MDPI, vol. 10(7), pages 1-31, June.
    2. Qiang, Qiang & Ke, Ke & Anderson, Trisha & Dong, June, 2013. "The closed-loop supply chain network with competition, distribution channel investment, and uncertainties," Omega, Elsevier, vol. 41(2), pages 186-194.
    3. Dingyue Zhang & Xuemei Zhang & Bin Shi & Jian Cao & Gengui Zhou, 2018. "Collection and Remanufacturing of Waste Products under Patent Protection and Government Regulation," Sustainability, MDPI, vol. 10(5), pages 1-22, May.
    4. Xiaoming Li, 2013. "Managing Dynamic Inventory Systems with Product Returns: A Markov Decision Process," Journal of Optimization Theory and Applications, Springer, vol. 157(2), pages 577-592, May.
    5. Hazen, Benjamin T. & Overstreet, Robert E. & Jones-Farmer, L. Allison & Field, Hubert S., 2012. "The role of ambiguity tolerance in consumer perception of remanufactured products," International Journal of Production Economics, Elsevier, vol. 135(2), pages 781-790.
    6. Agrawal, Saurabh & Singh, Rajesh K. & Murtaza, Qasim, 2015. "A literature review and perspectives in reverse logistics," Resources, Conservation & Recycling, Elsevier, vol. 97(C), pages 76-92.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Schweiger, Katharina & Sahamie, Ramin, 2013. "A hybrid Tabu Search approach for the design of a paper recycling network," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 50(C), pages 98-119.
    2. Prajogo, Daniel & Olhager, Jan, 2012. "Supply chain integration and performance: The effects of long-term relationships, information technology and sharing, and logistics integration," International Journal of Production Economics, Elsevier, vol. 135(1), pages 514-522.
    3. Eskandarpour, Majid & Zegordi, Seyed Hessameddin & Nikbakhsh, Ehsan, 2013. "A parallel variable neighborhood search for the multi-objective sustainable post-sales network design problem," International Journal of Production Economics, Elsevier, vol. 145(1), pages 117-131.
    4. Ayvaz, Berk & Bolat, Bersam & Aydın, Nezir, 2015. "Stochastic reverse logistics network design for waste of electrical and electronic equipment," Resources, Conservation & Recycling, Elsevier, vol. 104(PB), pages 391-404.
    5. Dimitris Zissis, 2023. "Information sharing through digitalisation in decentralised supply chains," Annals of Operations Research, Springer, vol. 327(2), pages 763-778, August.
    6. Toso, Eli Angela V. & Alem, Douglas, 2014. "Effective location models for sorting recyclables in public management," European Journal of Operational Research, Elsevier, vol. 234(3), pages 839-860.
    7. Gamberini, Rita & Gebennini, Elisa & Manzini, Riccardo & Ziveri, Andrea, 2010. "On the integration of planning and environmental impact assessment for a WEEE transportation network—A case study," Resources, Conservation & Recycling, Elsevier, vol. 54(11), pages 937-951.
    8. Dimitris Zissis & George Ioannou & Apostolos Burnetas, 2020. "Coordinating Lot Sizing Decisions Under Bilateral Information Asymmetry," Production and Operations Management, Production and Operations Management Society, vol. 29(2), pages 371-387, February.
    9. Wang, Chao & Lim, Ming K & Zhao, Longfeng & Tseng, Ming-Lang & Chien, Chen-Fu & Lev, Benjamin, 2020. "The evolution of Omega-The International Journal of Management Science over the past 40 years: A bibliometric overview," Omega, Elsevier, vol. 93(C).
    10. Alumur, Sibel A. & Nickel, Stefan & Saldanha-da-Gama, Francisco & Verter, Vedat, 2012. "Multi-period reverse logistics network design," European Journal of Operational Research, Elsevier, vol. 220(1), pages 67-78.
    11. Zissis, Dimitris & Ioannou, George & Burnetas, Apostolos, 2015. "Supply chain coordination under discrete information asymmetries and quantity discounts," Omega, Elsevier, vol. 53(C), pages 21-29.
    12. Tsai, Chih-Yang, 2011. "On delineating supply chain cash flow under collectionrisk," International Journal of Production Economics, Elsevier, vol. 129(1), pages 186-194, January.
    13. Kilic, Huseyin Selcuk & Cebeci, Ufuk & Ayhan, Mustafa Batuhan, 2015. "Reverse logistics system design for the waste of electrical and electronic equipment (WEEE) in Turkey," Resources, Conservation & Recycling, Elsevier, vol. 95(C), pages 120-132.
    14. Li, Tian & Zhang, Hongtao, 2015. "Information sharing in a supply chain with a make-to-stock manufacturer," Omega, Elsevier, vol. 50(C), pages 115-125.
    15. Agrawal, Saurabh & Singh, Rajesh K. & Murtaza, Qasim, 2015. "A literature review and perspectives in reverse logistics," Resources, Conservation & Recycling, Elsevier, vol. 97(C), pages 76-92.
    16. Sawik, Tadeusz, 2011. "Selection of supply portfolio under disruption risks," Omega, Elsevier, vol. 39(2), pages 194-208, April.
    17. Weidong Zhang & Fuqiang Wang, 2022. "Information Sharing in Competing Supply Chains with Carbon Emissions Reduction Incentives," Sustainability, MDPI, vol. 14(20), pages 1-25, October.
    18. Gunasekaran, Angappa & Lai, Kee-hung & Edwin Cheng, T.C., 2008. "Responsive supply chain: A competitive strategy in a networked economy," Omega, Elsevier, vol. 36(4), pages 549-564, August.
    19. Melo, M.T. & Nickel, S. & Saldanha-da-Gama, F., 2009. "Facility location and supply chain management - A review," European Journal of Operational Research, Elsevier, vol. 196(2), pages 401-412, July.
    20. Xiaoyi Liu & Jonghyun Lee & Peter Kitanidis & Jack Parker & Ungtae Kim, 2012. "Value of Information as a Context-Specific Measure of Uncertainty in Groundwater Remediation," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 26(6), pages 1513-1535, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jomega:v:38:y:2010:i:1-2:p:20-32. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/375/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.