IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v204y2020ics0951832020306220.html
   My bibliography  Save this article

Conditional formulation for the calibration of multi-level random fields with incomplete data

Author

Listed:
  • Xu, Hao
  • Gardoni, Paolo

Abstract

Random fields are widely used in the modeling of spatially varying quantities. As an extension, multi-level random fields capture not only the spatial variability, but also the relationship between inter-dependent quantities. To calibrate such a model, we need data of different variables measured at the same locations in each level. However, measurements of different quantities are usually made independently at inconsistent locations. Recent work addressed this issue by predicting the missing data first, and calibrating the model using the completed dataset. However, existing formulations cannot capture the spatial correlation and inter-level dependency. This paper proposes a conditional random field formulation that overcomes the limitations. Beginning from the lowest level, we calibrate the model using observed data and make predictions conditioned on the observations. The observed data and predictions are then used in the calibration and prediction of the higher levels. To propagate the uncertainties, we develop predictive distributions based on total probability rule for the predictions. We discuss how the formulation works for two missing data scenarios: 1) data partially missing, and 2) data completely missing at some levels. An example of the modeling of multi-level earthquake intensities is provided to illustrate how to implement the proposed formulation in practice.

Suggested Citation

  • Xu, Hao & Gardoni, Paolo, 2020. "Conditional formulation for the calibration of multi-level random fields with incomplete data," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
  • Handle: RePEc:eee:reensy:v:204:y:2020:i:c:s0951832020306220
    DOI: 10.1016/j.ress.2020.107121
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832020306220
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2020.107121?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. James P. LeSage & R. Kelley Pace, 2004. "Models for Spatially Dependent Missing Data," The Journal of Real Estate Finance and Economics, Springer, vol. 29(2), pages 233-254, September.
    2. Liu, Haibin & Davidson, Rachel A. & Apanasovich, Tatiyana V., 2008. "Spatial generalized linear mixed models of electric power outages due to hurricanes and ice storms," Reliability Engineering and System Safety, Elsevier, vol. 93(6), pages 897-912.
    3. Mark D. Risser & Catherine A. Calder, 2015. "Regression‐based covariance functions for nonstationary spatial modeling," Environmetrics, John Wiley & Sons, Ltd., vol. 26(4), pages 284-297, June.
    4. Nguyen, H.D. & Gouno, E., 2020. "Bayesian inference for Common cause failure rate based on causal inference with missing data," Reliability Engineering and System Safety, Elsevier, vol. 197(C).
    5. Mark D. Risser & Christopher J. Paciorek & Dáithí A. Stone, 2019. "Spatially Dependent Multiple Testing Under Model Misspecification, With Application to Detection of Anthropogenic Influence on Extreme Climate Events," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(525), pages 61-78, January.
    6. Dijoux, Yann & Fouladirad, Mitra & Nguyen, Dinh Tuan, 2016. "Statistical inference for imperfect maintenance models with missing data," Reliability Engineering and System Safety, Elsevier, vol. 154(C), pages 84-96.
    7. Patrick Royston, 2004. "Multiple imputation of missing values," Stata Journal, StataCorp LP, vol. 4(3), pages 227-241, September.
    8. Emir Shuford & Arthur Albert & H. Edward Massengill, 1966. "Admissible probability measurement procedures," Psychometrika, Springer;The Psychometric Society, vol. 31(2), pages 125-145, June.
    9. Fang, Xiaolei & Zhou, Rensheng & Gebraeel, Nagi, 2015. "An adaptive functional regression-based prognostic model for applications with missing data," Reliability Engineering and System Safety, Elsevier, vol. 133(C), pages 266-274.
    10. Malings, Carl & Pozzi, Matteo, 2016. "Value of information for spatially distributed systems: Application to sensor placement," Reliability Engineering and System Safety, Elsevier, vol. 154(C), pages 219-233.
    11. Jianqing Fan & Yuan Liao & Han Liu, 2016. "An overview of the estimation of large covariance and precision matrices," Econometrics Journal, Royal Economic Society, vol. 19(1), pages 1-32, February.
    12. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    13. Joshua D Woodard & Apurba Shee & Andrew Mude, 2016. "A Spatial Econometric Approach to Designing and Rating Scalable Index Insurance in the Presence of Missing Data," The Geneva Papers on Risk and Insurance - Issues and Practice, Palgrave Macmillan;The Geneva Association, vol. 41(2), pages 259-279, April.
    14. Martin, Andrew D. & Quinn, Kevin M. & Park, Jong Hee, 2011. "MCMCpack: Markov Chain Monte Carlo in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 42(i09).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhou, Daoqing & He, Jingjing & Du, Yi-Mu & Sun, C.P. & Guan, Xuefei, 2021. "Probabilistic information fusion with point, moment and interval data in reliability assessment," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    2. Zhang, Ruijing & Dai, Hongzhe, 2022. "A non-Gaussian stochastic model from limited observations using polynomial chaos and fractional moments," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    3. Wang, Tiao & Li, Chunhe & Zheng, Jian-jun & Hackl, Jürgen & Luan, Yao & Ishida, Tetsuya & Medepalli, Satya, 2023. "Consideration of coupling of crack development and corrosion in assessing the reliability of reinforced concrete beams subjected to bending," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    4. Jerez, D.J. & Jensen, H.A. & Beer, M., 2022. "An effective implementation of reliability methods for Bayesian model updating of structural dynamic models with multiple uncertain parameters," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    5. Tabandeh, Armin & Sharma, Neetesh & Gardoni, Paolo, 2022. "Uncertainty propagation in risk and resilience analysis of hierarchical systems," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
    6. Gao, Xing & Meng, Jing & Ling, Yantao & Liao, Maolin & Cao, Mengqiu, 2022. "Localisation economies, intellectual property rights protection and entrepreneurship in China: A Bayesian analysis of multi-level spatial correlation," Structural Change and Economic Dynamics, Elsevier, vol. 61(C), pages 156-165.
    7. He, Jingran & Gao, Ruofan & Chen, Jianbing, 2022. "A sparse data-driven stochastic damage model for seismic reliability assessment of reinforced concrete structures," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    8. Gao, Xing & Meng, Jing & Ling, Yantao & Liao, Maolin & Cao, Mengqiu, 2022. "Localisation economies, intellectual property rights protection and entrepreneurship in China: a Bayesian analysis of multi-level spatial correlation," LSE Research Online Documents on Economics 114290, London School of Economics and Political Science, LSE Library.
    9. Zheng, Yi-Xuan & Xiahou, Tangfan & Liu, Yu & Xie, Chaoyang, 2021. "Structure function learning of hierarchical multi-state systems with incomplete observation sequences," Reliability Engineering and System Safety, Elsevier, vol. 216(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Roberto Leon-Gonzalez & Blessings Majoni, 2023. "Exact Likelihood for Inverse Gamma Stochastic Volatility Models," Working Paper series 23-11, Rimini Centre for Economic Analysis.
    2. Geweke, John & Amisano, Gianni, 2011. "Optimal prediction pools," Journal of Econometrics, Elsevier, vol. 164(1), pages 130-141, September.
    3. Fabian Krüger & Sebastian Lerch & Thordis Thorarinsdottir & Tilmann Gneiting, 2021. "Predictive Inference Based on Markov Chain Monte Carlo Output," International Statistical Review, International Statistical Institute, vol. 89(2), pages 274-301, August.
    4. Karl Schlag & James Tremewan & Joël Weele, 2015. "A penny for your thoughts: a survey of methods for eliciting beliefs," Experimental Economics, Springer;Economic Science Association, vol. 18(3), pages 457-490, September.
    5. Werner Ehm & Tilmann Gneiting & Alexander Jordan & Fabian Krüger, 2016. "Of quantiles and expectiles: consistent scoring functions, Choquet representations and forecast rankings," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(3), pages 505-562, June.
    6. Jorge Castillo-Mateo & Miguel Lafuente & Jesús Asín & Ana C. Cebrián & Alan E. Gelfand & Jesús Abaurrea, 2022. "Spatial Modeling of Day-Within-Year Temperature Time Series: An Examination of Daily Maximum Temperatures in Aragón, Spain," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 27(3), pages 487-505, September.
    7. Yanwei Jia & Jussi Keppo & Ville Satopää, 2023. "Herding in Probabilistic Forecasts," Management Science, INFORMS, vol. 69(5), pages 2713-2732, May.
    8. Karl Schlag & James Tremewan & Joël Weele, 2015. "A penny for your thoughts: a survey of methods for eliciting beliefs," Experimental Economics, Springer;Economic Science Association, vol. 18(3), pages 457-490, September.
    9. Lambert, Nicolas S. & Langford, John & Wortman Vaughan, Jennifer & Chen, Yiling & Reeves, Daniel M. & Shoham, Yoav & Pennock, David M., 2015. "An axiomatic characterization of wagering mechanisms," Journal of Economic Theory, Elsevier, vol. 156(C), pages 389-416.
    10. Kenneth C. Lichtendahl & Yael Grushka-Cockayne & Robert L. Winkler, 2013. "Is It Better to Average Probabilities or Quantiles?," Management Science, INFORMS, vol. 59(7), pages 1594-1611, July.
    11. D. J. Hand & C. Anagnostopoulos, 2023. "Notes on the H-measure of classifier performance," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 17(1), pages 109-124, March.
    12. Azar, Pablo D. & Micali, Silvio, 2018. "Computational principal agent problems," Theoretical Economics, Econometric Society, vol. 13(2), May.
    13. Angelica Gianfreda & Francesco Ravazzolo & Luca Rossini, 2023. "Large Time‐Varying Volatility Models for Hourly Electricity Prices," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 85(3), pages 545-573, June.
    14. Davide Pettenuzzo & Francesco Ravazzolo, 2016. "Optimal Portfolio Choice Under Decision‐Based Model Combinations," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(7), pages 1312-1332, November.
    15. Rubio, F.J. & Steel, M.F.J., 2011. "Inference for grouped data with a truncated skew-Laplace distribution," Computational Statistics & Data Analysis, Elsevier, vol. 55(12), pages 3218-3231, December.
    16. Harald Schoen, 2008. "Identity, Instrumental Self-Interest and Institutional Evaluations," European Union Politics, , vol. 9(1), pages 5-29, March.
    17. Julia S. Goldberg, 2011. "Identity Salience and Involvement among Resident and Nonresident Fathers," Working Papers 1323, Princeton University, School of Public and International Affairs, Center for Research on Child Wellbeing..
    18. Hengtao Zhang & Guosheng Yin, 2021. "Response‐adaptive rerandomization," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 70(5), pages 1281-1298, November.
    19. Hilde Coffe & Catherine Bolzendahl, 2011. "Gender Gaps in Political Participation Across Sub-Saharan African Nations," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 102(2), pages 245-264, June.
    20. Hwang, Eunju, 2022. "Prediction intervals of the COVID-19 cases by HAR models with growth rates and vaccination rates in top eight affected countries: Bootstrap improvement," Chaos, Solitons & Fractals, Elsevier, vol. 155(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:204:y:2020:i:c:s0951832020306220. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.