Inventory Management with Partially Observed Nonstationary Demand
We consider a continuous-time model for inventory management with Markov modulated non-stationary demands. We introduce active learning by assuming that the state of the world is unobserved and must be inferred by the manager. We also assume that demands are observed only when they are completely met. We first derive the explicit filtering equations and pass to an equivalent fully observed impulse control problem in terms of the sufficient statistics, the a posteriori probability process and the current inventory level. We then solve this equivalent formulation and directly characterize an optimal inventory policy. We also describe a computational procedure to calculate the value function and the optimal policy and present two numerical illustrations.
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Yossi Aviv & Amit Pazgal, 2005. "A Partially Observed Markov Decision Process for Dynamic Pricing," Management Science, INFORMS, vol. 51(9), pages 1400-1416, September.
- Martin A. Lariviere & Evan L. Porteus, 1999. "Stalking Information: Bayesian Inventory Management with Unobserved Lost Sales," Management Science, INFORMS, vol. 45(3), pages 346-363, March.
- Bayraktar, Erhan & Ludkovski, Michael, 2009. "Sequential tracking of a hidden Markov chain using point process observations," Stochastic Processes and their Applications, Elsevier, vol. 119(6), pages 1792-1822, June.
- James T. Treharne & Charles R. Sox, 2002. "Adaptive Inventory Control for Nonstationary Demand and Partial Information," Management Science, INFORMS, vol. 48(5), pages 607-624, May.
- William S. Lovejoy, 1990. "Myopic Policies for Some Inventory Models with Uncertain Demand Distributions," Management Science, INFORMS, vol. 36(6), pages 724-738, June.
- Arjas, Elja & Haara, Pentti & Norros, Ikka, 1992. "Filtering the histories of a partially observed marked point process," Stochastic Processes and their Applications, Elsevier, vol. 40(2), pages 225-250, March.
- Katy S. Azoury, 1985. "Bayes Solution to Dynamic Inventory Models Under Unknown Demand Distribution," Management Science, INFORMS, vol. 31(9), pages 1150-1160, September.
When requesting a correction, please mention this item's handle: RePEc:arx:papers:1206.6283. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (arXiv administrators)
If references are entirely missing, you can add them using this form.