IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v317y2022i2d10.1007_s10479-021-04188-9.html
   My bibliography  Save this article

Bayesian sequential update for monitoring and control of high-dimensional processes

Author

Listed:
  • Sangahn Kim

    (Siena College)

  • Mehmet Turkoz

    (William Paterson University)

Abstract

Simultaneous monitoring of multi-dimensional processes becomes much more challenging as the dimension increases, especially when there are only a few or moderate number of process variables that are responsible for the process change, and when the size of change is particularly small. In this paper, we develop an efficient statistical process monitoring methodology in high-dimensional processes based on the Bayesian approach. The key idea of this paper is to sequentially update a posterior distribution of the process parameter of interest through the Bayesian rule. In particular, a sparsity promoting prior distribution of the parameter is applied properly under sparsity, and is sequentially updated in online processing. A Bayesian hierarchical model with a data-driven way of determining the hyperparameters enables the monitoring scheme to be effective to the detection of process shifts and to be efficient to the computational complexity in the high-dimensional processes. Comparison with recently proposed methods for monitoring high-dimensional processes demonstrates the superiority of the proposed method in detecting small shifts. In addition, graphical presentations in tracking the process parameter provide the information about decisions regarding whether a process needs to be adjusted before it triggers alarm.

Suggested Citation

  • Sangahn Kim & Mehmet Turkoz, 2022. "Bayesian sequential update for monitoring and control of high-dimensional processes," Annals of Operations Research, Springer, vol. 317(2), pages 693-715, October.
  • Handle: RePEc:spr:annopr:v:317:y:2022:i:2:d:10.1007_s10479-021-04188-9
    DOI: 10.1007/s10479-021-04188-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10479-021-04188-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10479-021-04188-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Robert Tibshirani & Michael Saunders & Saharon Rosset & Ji Zhu & Keith Knight, 2005. "Sparsity and smoothness via the fused lasso," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(1), pages 91-108, February.
    2. Sangahn Kim & Myong K. Jeong & Elsayed A. Elsayed, 2017. "Generalized smoothing parameters of a multivariate EWMA control chart," IISE Transactions, Taylor & Francis Journals, vol. 49(1), pages 58-69, January.
    3. Xia Pan & Jeffrey Jarrett, 2004. "Applying State Space to SPC: Monitoring Multivariate Time Series," Journal of Applied Statistics, Taylor & Francis Journals, vol. 31(4), pages 397-418.
    4. Zou, Changliang & Qiu, Peihua, 2009. "Multivariate Statistical Process Control Using LASSO," Journal of the American Statistical Association, American Statistical Association, vol. 104(488), pages 1586-1596.
    5. Durbin, James & Koopman, Siem Jan, 2012. "Time Series Analysis by State Space Methods," OUP Catalogue, Oxford University Press, edition 2, number 9780199641178, Decembrie.
    6. Xiong, Jie, 2008. "An Introduction to Stochastic Filtering Theory," OUP Catalogue, Oxford University Press, number 9780199219704.
    7. Tagaras, George, 2017. "New indices for the evaluation of the statistical properties of Bayesian x¯ control charts for short runsAuthor-Name: Nikolaidis, Yiannis," European Journal of Operational Research, Elsevier, vol. 259(1), pages 280-292.
    8. K. Triantafyllopoulos, 2007. "Feedback quality adjustment with Bayesian state‐space models," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 23(2), pages 145-156, March.
    9. Shichang Du & Xufeng Yao & Delin Huang, 2015. "Engineering model-based Bayesian monitoring of ramp-up phase of multistage manufacturing process," International Journal of Production Research, Taylor & Francis Journals, vol. 53(15), pages 4594-4613, August.
    10. Viliam Makis, 2008. "Multivariate Bayesian Control Chart," Operations Research, INFORMS, vol. 56(2), pages 487-496, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Molly C. Klanderman & Kathryn B. Newhart & Tzahi Y. Cath & Amanda S. Hering, 2020. "Fault isolation for a complex decentralized waste water treatment facility," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 69(4), pages 931-951, August.
    2. K. Triantafyllopoulos, 2008. "Multivariate stochastic volatility using state space models," Papers 0802.0223, arXiv.org.
    3. Jinho Kim & Myong K. Jeong & Elsayed A. Elsayed, 2017. "Monitoring multistage processes with autocorrelated observations," International Journal of Production Research, Taylor & Francis Journals, vol. 55(8), pages 2385-2396, April.
    4. Audrino, Francesco & Tetereva, Anastasija, 2019. "Sentiment spillover effects for US and European companies," Journal of Banking & Finance, Elsevier, vol. 106(C), pages 542-567.
    5. Amir Ahmadi-Javid & Mohsen Ebadi, 2017. "Remarks on Bayesian Control Charts," Papers 1712.02860, arXiv.org, revised Dec 2017.
    6. K. Triantafyllopoulos, 2008. "Multivariate stochastic volatility with Bayesian dynamic linear models," Papers 0802.0214, arXiv.org.
    7. Tutz, Gerhard & Pößnecker, Wolfgang & Uhlmann, Lorenz, 2015. "Variable selection in general multinomial logit models," Computational Statistics & Data Analysis, Elsevier, vol. 82(C), pages 207-222.
    8. Victor Bystrov, 2018. "Measuring the Natural Rates of Interest in Germany and Italy," Central European Journal of Economic Modelling and Econometrics, Central European Journal of Economic Modelling and Econometrics, vol. 10(4), pages 333-353, December.
    9. Yukai Yang & Luc Bauwens, 2018. "State-Space Models on the Stiefel Manifold with a New Approach to Nonlinear Filtering," Econometrics, MDPI, vol. 6(4), pages 1-22, December.
    10. Fernández-Macho, Javier, 2008. "Spectral estimation of a structural thin-plate smoothing model," Computational Statistics & Data Analysis, Elsevier, vol. 53(1), pages 189-195, September.
    11. Drew Creal & Siem Jan Koopman & Eric Zivot, 2008. "The Effect of the Great Moderation on the U.S. Business Cycle in a Time-varying Multivariate Trend-cycle Model," Tinbergen Institute Discussion Papers 08-069/4, Tinbergen Institute.
    12. Avanzi, Benjamin & Taylor, Greg & Vu, Phuong Anh & Wong, Bernard, 2020. "A multivariate evolutionary generalised linear model framework with adaptive estimation for claims reserving," Insurance: Mathematics and Economics, Elsevier, vol. 93(C), pages 50-71.
    13. François R. Velde, 2009. "Chronicle of a Deflation Unforetold," Journal of Political Economy, University of Chicago Press, vol. 117(4), pages 591-634, August.
    14. Chen, Peimin & Wu, Chunchi, 2014. "Default prediction with dynamic sectoral and macroeconomic frailties," Journal of Banking & Finance, Elsevier, vol. 40(C), pages 211-226.
    15. repec:zbw:bofitp:2019_008 is not listed on IDEAS
    16. Yue Zhao & Difang Wan, 2018. "Institutional high frequency trading and price discovery: Evidence from an emerging commodity futures market," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 38(2), pages 243-270, February.
    17. Wen Xu, 2016. "Estimation of Dynamic Panel Data Models with Stochastic Volatility Using Particle Filters," Econometrics, MDPI, vol. 4(4), pages 1-13, October.
    18. Scott Brave & R. Andrew Butters & Alejandro Justiniano, 2016. "Forecasting Economic Activity with Mixed Frequency Bayesian VARs," Working Paper Series WP-2016-5, Federal Reserve Bank of Chicago.
    19. Mkhadri, Abdallah & Ouhourane, Mohamed, 2013. "An extended variable inclusion and shrinkage algorithm for correlated variables," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 631-644.
    20. Eric Heyer & Frédéric Reynès & Henri Sterdyniak, 2004. "Observable and unobservable variables in the theory of the equilibrium rate of unemployment, a comparison between France and the United States," Working Papers hal-01027420, HAL.
    21. Hári, Norbert & De Waegenaere, Anja & Melenberg, Bertrand & Nijman, Theo E., 2008. "Estimating the term structure of mortality," Insurance: Mathematics and Economics, Elsevier, vol. 42(2), pages 492-504, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:317:y:2022:i:2:d:10.1007_s10479-021-04188-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.