IDEAS home Printed from
   My bibliography  Save this paper

Multitarget tracking via restless bandit marginal productivity indices and Kalman Filter in discrete time


  • Niño-Mora, José
  • Villar, Sofía S.


This paper designs, evaluates, and tests a tractable priority-index policy for scheduling target updates in a discrete-time multitarget tracking model, which aims to be close to optimal relative to a discounted or average performance objective accounting for tracking-error variance and measurement costs. The policy is to be used by a sensor system composed of M phased-array radars coordinated to track the positions of N targets moving according to independent scalar Gauss-Markov linear dynamics, which therefore allows for the use of the Kalman Filter for track estimation. The paper exploits the natural problem formulation as a multiarmed restless bandit problem (MARBP) with real-state projects subject to deterministic dynamics by deploying Whittle's (1988) index policy for the MARBP. The challenging issues of indexability (existence of the index) and index evaluation are resolved by applying a method recently introduced by the first author for the analysis of real-state restless bandits. Computational results are reported demonstrating the tractability of index evaluation, the substantial performance gains that the Whittle's marginal productivity (MP) index policy achieves against myopic policies advocated in previous work and the resulting index policies suboptimality gaps. Further, a preliminary small scale computational study shows that the (MP) index policy exhibits a nearly optimal behavior as the number of distinct objective targets grows with the number of radars per target constant.

Suggested Citation

  • Niño-Mora, José & Villar, Sofía S., 2010. "Multitarget tracking via restless bandit marginal productivity indices and Kalman Filter in discrete time," DES - Working Papers. Statistics and Econometrics. WS ws101506, Universidad Carlos III de Madrid. Departamento de Estadística.
  • Handle: RePEc:cte:wsrepe:ws101506

    Download full text from publisher

    File URL:
    Download Restriction: no

    References listed on IDEAS

    1. Solnik, B H, 1974. "The International Pricing of Risk: An Empirical Investigation of the World Capital Market Structure," Journal of Finance, American Finance Association, vol. 29(2), pages 365-378, May.
    2. Knut Anton Mork & Oystein Olsen & Hans Terje Mysen, 1994. "Macroeconomic Responses to Oil Price Increases and Decreases in Seven OECD Countries," The Energy Journal, International Association for Energy Economics, vol. 0(Number 4), pages 19-36.
    3. Mitchell A. Petersen, 2009. "Estimating Standard Errors in Finance Panel Data Sets: Comparing Approaches," Review of Financial Studies, Society for Financial Studies, vol. 22(1), pages 435-480, January.
    4. Wayne Ferson & Campbell R. Harvey, 1994. "An Exploratory Investigation of the Fundamental Determinants of National Equity Market Returns," NBER Chapters,in: The Internationalization of Equity Markets, pages 59-147 National Bureau of Economic Research, Inc.
    5. Karolyi, G. Andrew & Stulz, Rene M., 2003. "Are financial assets priced locally or globally?," Handbook of the Economics of Finance,in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, edition 1, volume 1, chapter 16, pages 975-1020 Elsevier.
    6. Chen, Nai-Fu & Roll, Richard & Ross, Stephen A, 1986. "Economic Forces and the Stock Market," The Journal of Business, University of Chicago Press, vol. 59(3), pages 383-403, July.
    7. Jones, Charles M & Kaul, Gautam, 1996. " Oil and the Stock Markets," Journal of Finance, American Finance Association, vol. 51(2), pages 463-491, June.
    8. Roger D. Huang & Ronald W. Masulis & Hans R. Stoll, 1996. "Energy shocks and financial markets," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 16(1), pages 1-27, February.
    9. Francesca Carrieri & Basma Majerbi, 2006. "The pricing of exchange risk in emerging stock markets," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 37(3), pages 372-391, May.
    10. Peter Ferderer, J., 1996. "Oil price volatility and the macroeconomy," Journal of Macroeconomics, Elsevier, vol. 18(1), pages 1-26.
    11. Leonid Kogan & Dmitry Livdan & Amir Yaron, 2009. "Oil Futures Prices in a Production Economy with Investment Constraints," Journal of Finance, American Finance Association, vol. 64(3), pages 1345-1375, June.
    12. Ferson, Wayne E. & Harvey, Campbell R., 1994. "Sources of risk and expected returns in global equity markets," Journal of Banking & Finance, Elsevier, vol. 18(4), pages 775-803, September.
    13. Nathan S. Balke & Stephen P.A. Brown & Mine K. Yucel, 2002. "Oil Price Shocks and the U.S. Economy: Where Does the Asymmetry Originate?," The Energy Journal, International Association for Energy Economics, vol. 0(Number 3), pages 27-52.
    14. Mork, Knut Anton, 1989. "Oil and Macroeconomy When Prices Go Up and Down: An Extension of Hamilton's Results," Journal of Political Economy, University of Chicago Press, vol. 97(3), pages 740-744, June.
    15. Meligkotsidou, Loukia & Vrontos, Ioannis D. & Vrontos, Spyridon D., 2009. "Quantile regression analysis of hedge fund strategies," Journal of Empirical Finance, Elsevier, vol. 16(2), pages 264-279, March.
    Full references (including those not matched with items on IDEAS)

    More about this item


    Multitarget tracking;

    NEP fields

    This paper has been announced in the following NEP Reports:


    Access and download statistics


    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cte:wsrepe:ws101506. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Ana Poveda). General contact details of provider: .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.