IDEAS home Printed from https://ideas.repec.org/a/spr/mathme/v70y2009i2p285-312.html

Random walk, birth-and-death process and their fluid approximations: absorbing case

Author

Listed:
  • A. Piunovskiy

Abstract

Fluid models are used to study functionals of the underlying random processes. Instead of analysing the trajectories, we investigate algebraic equations of the dynamic programming type which turn out to be discrete analogs of the corresponding differential equations. This analysis makes it possible to estimate the accuracy of approximation. Since the algebraic equations are the same for random walks and continuous time birth-and-death processes, we study the two cases in parallel. Several illustrative examples are also presented. Copyright Springer-Verlag 2009

Suggested Citation

  • A. Piunovskiy, 2009. "Random walk, birth-and-death process and their fluid approximations: absorbing case," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 70(2), pages 285-312, October.
    • Handle: RePEc:spr:mathme:v:70:y:2009:i:2:p:285-312
    DOI: 10.1007/s00186-008-0269-y
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s00186-008-0269-y
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s00186-008-0269-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Warburton, Roger D. H., 2004. "An exact analytical solution to the production inventory control problem," International Journal of Production Economics, Elsevier, vol. 92(1), pages 81-96, November.
    2. S. Gajrat & A. Hordijk, 2005. "On the structure of the optimal server control for fluid networks," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 62(1), pages 55-75, September.
    3. Constantinos Maglaras, 2006. "Revenue Management for a Multiclass Single-Server Queue via a Fluid Model Analysis," Operations Research, INFORMS, vol. 54(5), pages 914-932, October.
    4. A. B. Piunovskiy, 2004. "Multicriteria impulsive control of jump Markov processes," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 60(1), pages 125-144, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Erhan Bayraktar & Michael Ludkovski, 2014. "Liquidation In Limit Order Books With Controlled Intensity," Mathematical Finance, Wiley Blackwell, vol. 24(4), pages 627-650, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alexey Piunovskiy & Yi Zhang, 2011. "Accuracy of fluid approximations to controlled birth-and-death processes: absorbing case," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 73(2), pages 159-187, April.
    2. Yiwei Chen & Vivek F. Farias, 2013. "Simple Policies for Dynamic Pricing with Imperfect Forecasts," Operations Research, INFORMS, vol. 61(3), pages 612-624, June.
    3. Timothy C. Y. Chan & Simon Y. Huang & Vahid Sarhangian, 2025. "Dynamic Control of Service Systems with Returns: Application to Design of Postdischarge Hospital Readmission Prevention Programs," Operations Research, INFORMS, vol. 73(4), pages 2242-2263, July.
    4. Warburton, Roger D.H. & Hodgson, J.P.E. & Nielsen, E.H., 2014. "Exact solutions to the supply chain equations for arbitrary, time-dependent demands," International Journal of Production Economics, Elsevier, vol. 151(C), pages 195-205.
    5. Xinchang Wang & Sigrún Andradóttir & Hayriye Ayhan, 2019. "Optimal pricing for tandem queues with finite buffers," Queueing Systems: Theory and Applications, Springer, vol. 92(3), pages 323-396, August.
    6. Omar Besbes & Costis Maglaras, 2009. "Revenue Optimization for a Make-to-Order Queue in an Uncertain Market Environment," Operations Research, INFORMS, vol. 57(6), pages 1438-1450, December.
    7. Marketa Kubickova, 2022. "Revenue management in manufacturing: systematic review of literature," Journal of Revenue and Pricing Management, Palgrave Macmillan, vol. 21(2), pages 147-152, April.
    8. Lin, J. & Naim, M.M. & Purvis, L. & Gosling, J., 2017. "The extension and exploitation of the inventory and order based production control system archetype from 1982 to 2015," International Journal of Production Economics, Elsevier, vol. 194(C), pages 135-152.
    9. Vibhanshu Abhishek & Mustafa Dogan & Alexandre Jacquillat, 2021. "Strategic Timing and Dynamic Pricing for Online Resource Allocation," Management Science, INFORMS, vol. 67(8), pages 4880-4907, August.
    10. Dimitrios Logothetis & Athanasia Manou & Antonis Economou, 2023. "The impact of reneging on a fluid on-off queue with strategic customers," Annals of Operations Research, Springer, vol. 331(2), pages 629-647, December.
    11. Lun Yu & Seyed Iravani & Ohad Perry, 2025. "Asymptotically Optimal Clearing Control of Backlogs in Multiclass Processing Systems," Operations Research, INFORMS, vol. 73(4), pages 2061-2078, July.
    12. Constantinos Maglaras & Joern Meissner, 2006. "Dynamic Pricing Strategies for Multiproduct Revenue Management Problems," Manufacturing & Service Operations Management, INFORMS, vol. 8(2), pages 136-148, July.
    13. Zhu, Donghao & Minner, Stefan & Bichler, Martin, 2025. "Pricing policy and queue-length disclosure in on-demand service platforms," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 204(C).
    14. Boute, Robert N. & Disney, Stephen M. & Lambrecht, Marc R. & Van Houdt, Benny, 2007. "An integrated production and inventory model to dampen upstream demand variability in the supply chain," European Journal of Operational Research, Elsevier, vol. 178(1), pages 121-142, April.
    15. Huiwen Jia & Cong Shi & Siqian Shen, 2024. "Online Learning and Pricing for Service Systems with Reusable Resources," Operations Research, INFORMS, vol. 72(3), pages 1203-1241, May.
    16. Sipahi, Rifat & Delice, Ismail Ilker, 2010. "Stability of inventory dynamics in supply chains with three delays," International Journal of Production Economics, Elsevier, vol. 123(1), pages 107-117, January.
    17. Sabri Çelik & Costis Maglaras, 2008. "Dynamic Pricing and Lead-Time Quotation for a Multiclass Make-to-Order Queue," Management Science, INFORMS, vol. 54(6), pages 1132-1146, June.
    18. Mustafa Akan & Barı ş Ata & Tava Olsen, 2012. "Congestion-Based Lead-Time Quotation for Heterogenous Customers with Convex-Concave Delay Costs: Optimality of a Cost-Balancing Policy Based on Convex Hull Functions," Operations Research, INFORMS, vol. 60(6), pages 1505-1519, December.
    19. Shuo Wang & Xiuli Xu, 2021. "Equilibrium strategies of the fluid queue with working vacation," Operational Research, Springer, vol. 21(2), pages 1211-1228, June.
    20. Xinchang Wang & Sigrún Andradóttir & Hayriye Ayhan, 2026. "Optimal pricing and information sharing strategies in a single-server queue," Queueing Systems: Theory and Applications, Springer, vol. 110(1), pages 1-81, March.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:mathme:v:70:y:2009:i:2:p:285-312. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.