IDEAS home Printed from https://ideas.repec.org/a/bla/inecol/v27y2023i4p1105-1122.html
   My bibliography  Save this article

Expert elicitation and data noise learning for material flow analysis using Bayesian inference

Author

Listed:
  • Jiayuan Dong
  • Jiankan Liao
  • Xun Huan
  • Daniel Cooper

Abstract

Bayesian inference allows the transparent communication and systematic updating of model uncertainty as new data become available. When applied to material flow analysis (MFA), however, Bayesian inference is undermined by the difficulty of defining proper priors for the MFA parameters and quantifying the noise in the collected data. We start to address these issues by first deriving and implementing an expert elicitation procedure suitable for generating MFA parameter priors. Second, we propose to learn the data noise concurrent with the parametric uncertainty. These methods are demonstrated using a case study on the 2012 US steel flow. Eight experts are interviewed to elicit distributions on steel flow uncertainty from raw materials to intermediate goods. The experts' distributions are combined and weighted according to the expertise demonstrated in response to seeding questions. These aggregated distributions form our model parameters' informative priors. Sensible, weakly informative priors are adopted for learning the data noise. Bayesian inference is then performed to update the parametric and data noise uncertainty given MFA data collected from the United States Geological Survey and the World Steel Association. The results show a reduction in MFA parametric uncertainty when incorporating the collected data. Only a modest reduction in data noise uncertainty was observed using 2012 data; however, greater reductions were achieved when using data from multiple years in the inference. These methods generate transparent MFA and data noise uncertainties learned from data rather than pre‐assumed data noise levels, providing a more robust basis for decision‐making that affects the system.

Suggested Citation

  • Jiayuan Dong & Jiankan Liao & Xun Huan & Daniel Cooper, 2023. "Expert elicitation and data noise learning for material flow analysis using Bayesian inference," Journal of Industrial Ecology, Yale University, vol. 27(4), pages 1105-1122, August.
  • Handle: RePEc:bla:inecol:v:27:y:2023:i:4:p:1105-1122
    DOI: 10.1111/jiec.13399
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/jiec.13399
    Download Restriction: no

    File URL: https://libkey.io/10.1111/jiec.13399?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Grant M. Kopec & Julian M. Allwood & Jonathan M. Cullen & Daniel Ralph, 2016. "A General Nonlinear Least Squares Data Reconciliation and Estimation Method for Material Flow Analysis," Journal of Industrial Ecology, Yale University, vol. 20(5), pages 1038-1049, October.
    2. Richard C. Lupton & Julian M. Allwood, 2018. "Incremental Material Flow Analysis with Bayesian Inference," Journal of Industrial Ecology, Yale University, vol. 22(6), pages 1352-1364, December.
    3. Danila Azzolina & Paola Berchialla & Dario Gregori & Ileana Baldi, 2021. "Prior Elicitation for Use in Clinical Trial Design and Analysis: A Literature Review," IJERPH, MDPI, vol. 18(4), pages 1-21, February.
    4. Cooke, Roger M. & ElSaadany, Susie & Huang, Xinzheng, 2008. "On the performance of social network and likelihood-based expert weighting schemes," Reliability Engineering and System Safety, Elsevier, vol. 93(5), pages 745-756.
    5. Rita Esther Zapata-V�zquez & Anthony O'Hagan & Leonardo Soares Bastos, 2014. "Eliciting expert judgements about a set of proportions," Journal of Applied Statistics, Taylor & Francis Journals, vol. 41(9), pages 1919-1933, September.
    6. Robert T. Clemen & Robert L. Winkler, 1999. "Combining Probability Distributions From Experts in Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 19(2), pages 187-203, April.
    7. Ryan Wiser & Karen Jenni & Joachim Seel & Erin Baker & Maureen Hand & Eric Lantz & Aaron Smith, 2016. "Expert elicitation survey on future wind energy costs," Nature Energy, Nature, vol. 1(10), pages 1-8, October.
    8. Rowe, Gene & Wright, George, 1999. "The Delphi technique as a forecasting tool: issues and analysis," International Journal of Forecasting, Elsevier, vol. 15(4), pages 353-375, October.
    9. Garthwaite, Paul H. & Kadane, Joseph B. & O'Hagan, Anthony, 2005. "Statistical Methods for Eliciting Probability Distributions," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 680-701, June.
    10. Ali E. Abbas & David V. Budescu & Hsiu-Ting Yu & Ryan Haggerty, 2008. "A Comparison of Two Probability Encoding Methods: Fixed Probability vs. Fixed Variable Values," Decision Analysis, INFORMS, vol. 5(4), pages 190-202, December.
    11. David M. Blei & Alp Kucukelbir & Jon D. McAuliffe, 2017. "Variational Inference: A Review for Statisticians," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(518), pages 859-877, April.
    12. Shannon M. Lloyd & Robert Ries, 2007. "Characterizing, Propagating, and Analyzing Uncertainty in Life‐Cycle Assessment: A Survey of Quantitative Approaches," Journal of Industrial Ecology, Yale University, vol. 11(1), pages 161-179, January.
    13. Oliver Schwab & Helmut Rechberger, 2018. "Information Content, Complexity, and Uncertainty in Material Flow Analysis," Journal of Industrial Ecology, Yale University, vol. 22(2), pages 263-274, April.
    14. Abigail R Colson & Roger M Cooke, 2018. "Expert Elicitation: Using the Classical Model to Validate Experts’ Judgments," Review of Environmental Economics and Policy, Association of Environmental and Resource Economists, vol. 12(1), pages 113-132.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Danila Azzolina & Paola Berchialla & Dario Gregori & Ileana Baldi, 2021. "Prior Elicitation for Use in Clinical Trial Design and Analysis: A Literature Review," IJERPH, MDPI, vol. 18(4), pages 1-21, February.
    2. Marcello Basili & Federico Crudu, 2021. "Aggregation of Experts Opinions and the Assessment of Tipping Points. Catastrophic Forecasts for Higher Temperature Changes," Department of Economics University of Siena 868, Department of Economics, University of Siena.
    3. Claire Copeland & Britta Turner & Gareth Powells & Kevin Wilson, 2022. "In Search of Complementarity: Insights from an Exercise in Quantifying Qualitative Energy Futures," Energies, MDPI, vol. 15(15), pages 1-21, July.
    4. Wilson, Kevin J., 2017. "An investigation of dependence in expert judgement studies with multiple experts," International Journal of Forecasting, Elsevier, vol. 33(1), pages 325-336.
    5. Erin Baker & Olaitan Olaleye, 2013. "Combining Experts: Decomposition and Aggregation Order," Risk Analysis, John Wiley & Sons, vol. 33(6), pages 1116-1127, June.
    6. Anca M. Hanea & Marissa F. McBride & Mark A. Burgman & Bonnie C. Wintle, 2018. "The Value of Performance Weights and Discussion in Aggregated Expert Judgments," Risk Analysis, John Wiley & Sons, vol. 38(9), pages 1781-1794, September.
    7. Yuyu Fan & David V. Budescu & David Mandel & Mark Himmelstein, 2019. "Improving Accuracy by Coherence Weighting of Direct and Ratio Probability Judgments," Decision Analysis, INFORMS, vol. 16(3), pages 197-217, September.
    8. Elena Verdolini & Laura Díaz Anadón & Erin Baker & Valentina Bosetti & Lara Aleluia Reis, 2018. "Future Prospects for Energy Technologies: Insights from Expert Elicitations," Review of Environmental Economics and Policy, Association of Environmental and Resource Economists, vol. 12(1), pages 133-153.
    9. Bolger, Fergus & Wright, George, 2017. "Use of expert knowledge to anticipate the future: Issues, analysis and directions," International Journal of Forecasting, Elsevier, vol. 33(1), pages 230-243.
    10. Biener, Christian, 2013. "Pricing in Microinsurance Markets," World Development, Elsevier, vol. 41(C), pages 132-144.
    11. Andrea Herrmann, 2013. "The Quantitative Estimation of IT‐Related Risk Probabilities," Risk Analysis, John Wiley & Sons, vol. 33(8), pages 1510-1531, August.
    12. Milford, James & Henrion, Max & Hunter, Chad & Newes, Emily & Hughes, Caroline & Baldwin, Samuel F., 2022. "Energy sector portfolio analysis with uncertainty," Applied Energy, Elsevier, vol. 306(PA).
    13. Gilberto Montibeller & Detlof von Winterfeldt, 2015. "Cognitive and Motivational Biases in Decision and Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 35(7), pages 1230-1251, July.
    14. Ibsen Chivatá Cárdenas & Saad S.H. Al‐jibouri & Johannes I.M. Halman & Frits A. van Tol, 2013. "Capturing and Integrating Knowledge for Managing Risks in Tunnel Works," Risk Analysis, John Wiley & Sons, vol. 33(1), pages 92-108, January.
    15. Julia R. Falconer & Eibe Frank & Devon L. L. Polaschek & Chaitanya Joshi, 2022. "Methods for Eliciting Informative Prior Distributions: A Critical Review," Decision Analysis, INFORMS, vol. 19(3), pages 189-204, September.
    16. Jesus Palomo & David Rios Insua & Fabrizio Ruggeri, 2007. "Modeling External Risks in Project Management," Risk Analysis, John Wiley & Sons, vol. 27(4), pages 961-978, August.
    17. Abhinav B. Agrawal & Kash Barker & Yacov Y. Haimes, 2011. "Adaptive multiplayer approach for risk‐based decision‐making: 2006 Virginia Gubernatorial Inauguration," Systems Engineering, John Wiley & Sons, vol. 14(4), pages 455-470, December.
    18. Mitchell J. Small, 2008. "Methods for Assessing Uncertainty in Fundamental Assumptions and Associated Models for Cancer Risk Assessment," Risk Analysis, John Wiley & Sons, vol. 28(5), pages 1289-1308, October.
    19. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    20. Hathout, Michel & Vuillet, Marc & Carvajal, Claudio & Peyras, Laurent & Diab, Youssef, 2019. "Expert judgments calibration and combination for assessment of river levee failure probability," Reliability Engineering and System Safety, Elsevier, vol. 188(C), pages 377-392.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:inecol:v:27:y:2023:i:4:p:1105-1122. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=1088-1980 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.