IDEAS home Printed from https://ideas.repec.org/a/eee/matcom/v159y2019icp93-118.html
   My bibliography  Save this article

M-PCM-OFFD: An effective output statistics estimation method for systems of high dimensional uncertainties subject to low-order parameter interactions

Author

Listed:
  • Xie, Junfei
  • Wan, Yan
  • Mills, Kevin
  • Filliben, James J.
  • Lei, Yu
  • Lin, Zongli

Abstract

The evaluation of output performance statistics for systems of high-dimensional uncertain input parameters is crucial for robust real-time decision-making tasks of large-scale complex systems that operate in an uncertain environment. We develop a framework that integrates Multivariate Probabilistic Collocation Method (M-PCM) and Orthogonal Fractional Factorial Design (OFFD) to achieve an effective and scalable output statistics estimation. In this paper, we prove that when the degree of each uncertain parameter does not exceed 3 and under the widely held assumption for high-dimensional systems that the interactions among uncertain input parameters are negligible beyond certain order, the integrated M-PCM–OFFD method breaks the curse of dimensionality for correct output mean estimation by maximally reducing the number of simulations from 22m to 2log2(m+1) for a system mapping of m uncertain input parameters. In addition, the resulting reduced-size simulation set is the most robust to numerical truncation errors of simulators among all subsets of the same size in the M-PCM simulation set. The analysis also provides new insightful formal interpretations of the optimality of OFFDs.

Suggested Citation

  • Xie, Junfei & Wan, Yan & Mills, Kevin & Filliben, James J. & Lei, Yu & Lin, Zongli, 2019. "M-PCM-OFFD: An effective output statistics estimation method for systems of high dimensional uncertainties subject to low-order parameter interactions," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 159(C), pages 93-118.
  • Handle: RePEc:eee:matcom:v:159:y:2019:i:c:p:93-118
    DOI: 10.1016/j.matcom.2018.10.010
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378475418302817
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.matcom.2018.10.010?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Heiss, Florian & Winschel, Viktor, 2008. "Likelihood approximation by numerical integration on sparse grids," Journal of Econometrics, Elsevier, vol. 144(1), pages 62-80, May.
    2. Cheng, Haiyan & Sandu, Adrian, 2009. "Efficient uncertainty quantification with the polynomial chaos method for stiff systems," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 79(11), pages 3278-3295.
    3. Peter W. Glynn & Donald L. Iglehart, 1989. "Importance Sampling for Stochastic Simulations," Management Science, INFORMS, vol. 35(11), pages 1367-1392, November.
    4. Haritos, Nicholas, 1988. "Monte Carlo simulation of ocean beacon response to environmental loading," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 30(1), pages 87-92.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Philippe Jehiel & Jakub Steiner, 2020. "Selective Sampling with Information-Storage Constraints [On interim rationality, belief formation and learning in decision problems with bounded memory]," Economic Journal, Royal Economic Society, vol. 130(630), pages 1753-1781.
    2. S. Bogan Aruoba & Pablo Cuba-Borda & Kenji Higa-Flores & Frank Schorfheide & Sergio Villalvazo, 2021. "Piecewise-Linear Approximations and Filtering for DSGE Models with Occasionally Binding Constraints," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 41, pages 96-120, July.
    3. Helton, J.C. & Hansen, C.W. & Sallaberry, C.J., 2014. "Conceptual structure and computational organization of the 2008 performance assessment for the proposed high-level radioactive waste repository at Yucca Mountain, Nevada," Reliability Engineering and System Safety, Elsevier, vol. 122(C), pages 223-248.
    4. Florian Heiss, 2016. "Discrete Choice Methods with Simulation," Econometric Reviews, Taylor & Francis Journals, vol. 35(4), pages 688-692, April.
    5. Sándor Zsolt, 2013. "Monte Carlo Simulation in Random Coefficient Logit Models Involving Large Sums," Acta Universitatis Sapientiae, Economics and Business, Sciendo, vol. 1(1), pages 85-108, July.
    6. Pierre L’Ecuyer & Bruno Tuffin, 2011. "Approximating zero-variance importance sampling in a reliability setting," Annals of Operations Research, Springer, vol. 189(1), pages 277-297, September.
    7. Prusty, B Rajanarayan & Jena, Debashisha, 2017. "A critical review on probabilistic load flow studies in uncertainty constrained power systems with photovoltaic generation and a new approach," Renewable and Sustainable Energy Reviews, Elsevier, vol. 69(C), pages 1286-1302.
    8. Matthew Gentzkow & Jesse M. Shapiro & Michael Sinkinson, 2014. "Competition and Ideological Diversity: Historical Evidence from US Newspapers," American Economic Review, American Economic Association, vol. 104(10), pages 3073-3114, October.
    9. Dassios, Angelos & Jang, Jiwook & Zhao, Hongbiao, 2015. "A risk model with renewal shot-noise Cox process," Insurance: Mathematics and Economics, Elsevier, vol. 65(C), pages 55-65.
    10. Santiago Pereda Fernández, 2016. "Copula-based random effects models for clustered data," Temi di discussione (Economic working papers) 1092, Bank of Italy, Economic Research and International Relations Area.
    11. Samet, Haidar & Khorshidsavar, Morteza, 2018. "Analytic time series load flow," Renewable and Sustainable Energy Reviews, Elsevier, vol. 82(P3), pages 3886-3899.
    12. Bhat, Chandra R., 2018. "New matrix-based methods for the analytic evaluation of the multivariate cumulative normal distribution function," Transportation Research Part B: Methodological, Elsevier, vol. 109(C), pages 238-256.
    13. Joel L. Horowitz & Lars Nesheim, 2018. "Using penalized likelihood to select parameters in a random coefficients multinomial logit model," CeMMAP working papers CWP29/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    14. Sandeep Juneja & Perwez Shahabuddin, 2001. "Fast Simulation of Markov Chains with Small Transition Probabilities," Management Science, INFORMS, vol. 47(4), pages 547-562, April.
    15. Gaurav Khemka & Adam Butt, 2017. "Non-Parametric Integral Estimation Using Data Clustering in Stochastic dynamic Programming: An Introduction Using Lifetime Financial Modelling," Risks, MDPI, Open Access Journal, vol. 5(4), pages 1-17, October.
    16. Jean-Jacques Forneron, 2019. "A Sieve-SMM Estimator for Dynamic Models," Papers 1902.01456, arXiv.org, revised Jul 2020.
    17. Michael Chen & Sanjay Mehrotra & Dávid Papp, 2015. "Scenario generation for stochastic optimization problems via the sparse grid method," Computational Optimization and Applications, Springer, vol. 62(3), pages 669-692, December.
    18. Kaynar, Bahar & Ridder, Ad, 2010. "The cross-entropy method with patching for rare-event simulation of large Markov chains," European Journal of Operational Research, Elsevier, vol. 207(3), pages 1380-1397, December.
    19. Sarah Gelper & Ralf van der Lans & Gerrit van Bruggen, 2021. "Competition for Attention in Online Social Networks: Implications for Seeding Strategies," Management Science, INFORMS, vol. 67(2), pages 1026-1047, February.
    20. Reynaert, Mathias & Verboven, Frank, 2014. "Improving the performance of random coefficients demand models: The role of optimal instruments," Journal of Econometrics, Elsevier, vol. 179(1), pages 83-98.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:matcom:v:159:y:2019:i:c:p:93-118. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www.journals.elsevier.com/mathematics-and-computers-in-simulation/ .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/mathematics-and-computers-in-simulation/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.