IDEAS home Printed from https://ideas.repec.org/a/inm/ortrsc/v36y2002i1p40-54.html
   My bibliography  Save this article

An Adaptive Dynamic Programming Algorithm for Dynamic Fleet Management, II: Multiperiod Travel Times

Author

Listed:
  • Gregory A. Godfrey

    (Department of Operations Research and Financial Engineering, Princeton University, Princeton, New Jersey 08544)

  • Warren B. Powell

    (Department of Operations Research and Financial Engineering, Princeton University, Princeton, New Jersey 08544)

Abstract

In a companion paper (Godfrey and Powell 2002) we introduced an adaptive dynamic programming algorithm for stochastic dynamic resource allocation problems, which arise in the context of logistics and distribution, fleet management, and other allocation problems. The method depends on estimating separable nonlinear approximations of value functions, using a dynamic programming framework. That paper considered only the case in which the time to complete an action was always a single time period. Experiments with this technique quickly showed that when the basic algorithm was applied to problems with multiperiod travel times, the results were very poor. In this paper, we illustrate why this behavior arose, and propose a modified algorithm that addresses the issue. Experimental work demonstrates that the modified algorithm works on problems with multiperiod travel times, with results that are almost as good as the original algorithm applied to single period travel times.

Suggested Citation

  • Gregory A. Godfrey & Warren B. Powell, 2002. "An Adaptive Dynamic Programming Algorithm for Dynamic Fleet Management, II: Multiperiod Travel Times," Transportation Science, INFORMS, vol. 36(1), pages 40-54, February.
    • Handle: RePEc:inm:ortrsc:v:36:y:2002:i:1:p:40-54
    DOI: 10.1287/trsc.36.1.40.572
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/trsc.36.1.40.572
    Download Restriction: no
    File URL: https://libkey.io/10.1287/trsc.36.1.40.572?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Brian Rexing & Cynthia Barnhart & Tim Kniker & Ahmad Jarrah & Nirup Krishnamurthy, 2000. "Airline Fleet Assignment with Time Windows," Transportation Science, INFORMS, vol. 34(1), pages 1-20, February.
    2. Warren B. Powell & Tassio A. Carvalho, 1998. "Dynamic Control of Logistics Queueing Networks for Large-Scale Fleet Management," Transportation Science, INFORMS, vol. 32(2), pages 90-109, May.
    3. Gregory A. Godfrey & Warren B. Powell, 2002. "An Adaptive Dynamic Programming Algorithm for Dynamic Fleet Management, I: Single Period Travel Times," Transportation Science, INFORMS, vol. 36(1), pages 21-39, February.
    4. Gregory A. Godfrey & Warren B. Powell, 2001. "An Adaptive, Distribution-Free Algorithm for the Newsvendor Problem with Censored Demands, with Applications to Inventory and Distribution," Management Science, INFORMS, vol. 47(8), pages 1101-1112, August.
    5. Tassio A. Carvalho & Warren B. Powell, 2000. "A Multiplier Adjustment Method for Dynamic Resource Allocation Problems," Transportation Science, INFORMS, vol. 34(2), pages 150-164, May.
    6. Russell A. Rushmeier & Spyridon A. Kontogiorgis, 1997. "Advances in the Optimization of Airline Fleet Assignment," Transportation Science, INFORMS, vol. 31(2), pages 159-169, May.
    7. Warren B. Powell & Wayne Snow & Raymond K. Cheung, 2000. "Adaptive Labeling Algorithms for the Dynamic Assignment Problem," Transportation Science, INFORMS, vol. 34(1), pages 50-66, February.
    8. Warren B. Powell, 1989. "A Review of Sensitivity Results for Linear Networks and a New Approximation to Reduce the Effects of Degeneracy," Transportation Science, INFORMS, vol. 23(4), pages 231-243, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gregory A. Godfrey & Warren B. Powell, 2002. "An Adaptive Dynamic Programming Algorithm for Dynamic Fleet Management, I: Single Period Travel Times," Transportation Science, INFORMS, vol. 36(1), pages 21-39, February.
    2. Meissner, Joern & Senicheva, Olga V., 2018. "Approximate dynamic programming for lateral transshipment problems in multi-location inventory systems," European Journal of Operational Research, Elsevier, vol. 265(1), pages 49-64.
    3. G J King & H Topaloglu, 2007. "Incorporating the pricing decisions into the dynamic fleet management problem," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(8), pages 1065-1074, August.
    4. João P. Pita & Cynthia Barnhart & António P. Antunes, 2013. "Integrated Flight Scheduling and Fleet Assignment Under Airport Congestion," Transportation Science, INFORMS, vol. 47(4), pages 477-492, November.
    5. Belanger, Nicolas & Desaulniers, Guy & Soumis, Francois & Desrosiers, Jacques, 2006. "Periodic airline fleet assignment with time windows, spacing constraints, and time dependent revenues," European Journal of Operational Research, Elsevier, vol. 175(3), pages 1754-1766, December.
    6. Dall'Orto, Leonardo Campo & Crainic, Teodor Gabriel & Leal, Jose Eugenio & Powell, Warren B., 2006. "The single-node dynamic service scheduling and dispatching problem," European Journal of Operational Research, Elsevier, vol. 170(1), pages 1-23, April.
    7. Oliver Faust & Jochen Gönsch & Robert Klein, 2017. "Demand-Oriented Integrated Scheduling for Point-to-Point Airlines," Transportation Science, INFORMS, vol. 51(1), pages 196-213, February.
    8. Huseyin Topaloglu & Warren Powell, 2007. "Incorporating Pricing Decisions into the Stochastic Dynamic Fleet Management Problem," Transportation Science, INFORMS, vol. 41(3), pages 281-301, August.
    9. Okan Örsan Özener & Melda Örmeci Matoğlu & Güneş Erdoğan & Mohamed Haouari & Hasan Sözer, 2017. "Solving a large-scale integrated fleet assignment and crew pairing problem," Annals of Operations Research, Springer, vol. 253(1), pages 477-500, June.
    10. Cynthia Barnhart & Timothy S. Kniker & Manoj Lohatepanont, 2002. "Itinerary-Based Airline Fleet Assignment," Transportation Science, INFORMS, vol. 36(2), pages 199-217, May.
    11. Song, Haiqing & Huang, Huei-Chuen, 2008. "A successive convex approximation method for multistage workforce capacity planning problem with turnover," European Journal of Operational Research, Elsevier, vol. 188(1), pages 29-48, July.
    12. Ulmer, Marlin W. & Thomas, Barrett W., 2020. "Meso-parametric value function approximation for dynamic customer acceptances in delivery routing," European Journal of Operational Research, Elsevier, vol. 285(1), pages 183-195.
    13. Hanif Sherali & Ki-Hwan Bae & Mohamed Haouari, 2013. "A benders decomposition approach for an integrated airline schedule design and fleet assignment problem with flight retiming, schedule balance, and demand recapture," Annals of Operations Research, Springer, vol. 210(1), pages 213-244, November.
    14. Sherali, Hanif D. & Bish, Ebru K. & Zhu, Xiaomei, 2006. "Airline fleet assignment concepts, models, and algorithms," European Journal of Operational Research, Elsevier, vol. 172(1), pages 1-30, July.
    15. Cynthia Barnhart & Amy Cohn, 2004. "Airline Schedule Planning: Accomplishments and Opportunities," Manufacturing & Service Operations Management, INFORMS, vol. 6(1), pages 3-22, November.
    16. Luke Schenk & Diego Klabjan, 2008. "Intramarket Optimization for Express Package Carriers," Transportation Science, INFORMS, vol. 42(4), pages 530-545, November.
    17. George, David K. & Xia, Cathy H., 2011. "Fleet-sizing and service availability for a vehicle rental system via closed queueing networks," European Journal of Operational Research, Elsevier, vol. 211(1), pages 198-207, May.
    18. Stefano Coniglio & Mathias Sirvent & Martin Weibelzahl, 2021. "Airport capacity extension, fleet investment, and optimal aircraft scheduling in a multilevel market model: quantifying the costs of imperfect markets," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 43(2), pages 367-408, June.
    19. Cynthia Barnhart & Peter Belobaba & Amedeo R. Odoni, 2003. "Applications of Operations Research in the Air Transport Industry," Transportation Science, INFORMS, vol. 37(4), pages 368-391, November.
    20. Hanif D. Sherali & Ebru K. Bish & Xiaomei Zhu, 2005. "Polyhedral Analysis and Algorithms for a Demand-Driven Refleeting Model for Aircraft Assignment," Transportation Science, INFORMS, vol. 39(3), pages 349-366, August.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ortrsc:v:36:y:2002:i:1:p:40-54. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.