IDEAS home Printed from https://ideas.repec.org/a/inm/ordeca/v17y2020i2p134-153.html
   My bibliography  Save this article

Value of Information Analysis for Complex Simulator Models: Application to Wind Farm Maintenance

Author

Listed:
  • Hans Olav Vogt Myklebust

    (Department of Mathematical Sciences, Norwegian University of Science and Technology, 7491 Trondheim, Norway)

  • Jo Eidsvik

    (Department of Mathematical Sciences, Norwegian University of Science and Technology, 7491 Trondheim, Norway)

  • Iver Bakken Sperstad

    (SINTEF Energy Research, 7034 Trondheim, Norway)

  • Debarun Bhattacharjya

    (Research AI, IBM T.J. Watson Research Center, Yorktown Heights, New York 10598)

Abstract

Many domains require the use of sophisticated simulators to adequately model the effect of chosen alternatives on the decision maker’s value. Decision support in such complex systems brings unique challenges around efficiency, because simulating each combination of inputs can be time-consuming. In this paper, we conduct a value of information (VOI) analysis to study whether one should purchase information about critical input uncertainties in such complex systems. We propose a novel computational approach, where Gaussian processes are used to model the decision maker’s profit as a function of different alternatives and uncertainties. Under this modeling assumption, the expected improvement of the profit is analytically available, which we use to approximate the VOI effectively over batches of simulations, thus avoiding too many computer-intensive evaluations of the system. We illustrate the proposed computational approach with an offshore wind farm maintenance application, where the decision maker relies on outputs from large-scale simulations to determine the optimal vessel fleet mix and number of personnel for operation and maintenance. Such computer-intensive simulations mimic long-term energy production under different input conditions. It is often not possible to explore all the alternatives exhaustively, and one must therefore guide the simulations to run on promising alternatives. We conduct a VOI analysis to study whether one should purchase information about failure rates of wind turbines for this application. The proposed methodologies are general and apply to other domains involving expensive simulators.

Suggested Citation

  • Hans Olav Vogt Myklebust & Jo Eidsvik & Iver Bakken Sperstad & Debarun Bhattacharjya, 2020. "Value of Information Analysis for Complex Simulator Models: Application to Wind Farm Maintenance," Decision Analysis, INFORMS, vol. 17(2), pages 134-153, June.
  • Handle: RePEc:inm:ordeca:v:17:y:2020:i:2:p:134-153
    DOI: 10.1287/deca.2019.0405
    as

    Download full text from publisher

    File URL: https://doi.org/10.1287/deca.2019.0405
    Download Restriction: no

    File URL: https://libkey.io/10.1287/deca.2019.0405?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Mark Strong & Jeremy E. Oakley & Alan Brennan & Penny Breeze, 2015. "Estimating the Expected Value of Sample Information Using the Probabilistic Sensitivity Analysis Sample," Medical Decision Making, , vol. 35(5), pages 570-583, July.
    2. Scheu, Matti Niclas & Kolios, Athanasios & Fischer, Tim & Brennan, Feargal, 2017. "Influence of statistical uncertainty of component reliability estimations on offshore wind farm availability," Reliability Engineering and System Safety, Elsevier, vol. 168(C), pages 28-39.
    3. Fumie Yokota & Kimberly M. Thompson, 2004. "Value of Information Literature Analysis: A Review of Applications in Health Risk Management," Medical Decision Making, , vol. 24(3), pages 287-298, June.
    4. Roustant, Olivier & Ginsbourger, David & Deville, Yves, 2012. "DiceKriging, DiceOptim: Two R Packages for the Analysis of Computer Experiments by Kriging-Based Metamodeling and Optimization," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 51(i01).
    5. Jason R. W. Merrick, 2009. "Bayesian Simulation and Decision Analysis: An Expository Survey," Decision Analysis, INFORMS, vol. 6(4), pages 222-238, December.
    6. Nicky J. Welton & Howard H. Z. Thom, 2015. "Value of Information," Medical Decision Making, , vol. 35(5), pages 564-566, July.
    7. Sebastian Pfaffel & Stefan Faulstich & Kurt Rohrig, 2017. "Performance and Reliability of Wind Turbines: A Review," Energies, MDPI, vol. 10(11), pages 1-27, November.
    8. Gramacy, Robert B., 2016. "laGP: Large-Scale Spatial Modeling via Local Approximate Gaussian Processes in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 72(i01).
    9. Jeremy E. Oakley & Anthony O'Hagan, 2004. "Probabilistic sensitivity analysis of complex models: a Bayesian approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(3), pages 751-769, August.
    10. Jeffrey M. Keisler & Zachary A. Collier & Eric Chu & Nina Sinatra & Igor Linkov, 2014. "Value of information analysis: the state of application," Environment Systems and Decisions, Springer, vol. 34(1), pages 3-23, March.
    11. Debarun Bhattacharjya & Jo Eidsvik & Tapan Mukerji, 2013. "The Value of Information in Portfolio Problems with Dependent Projects," Decision Analysis, INFORMS, vol. 10(4), pages 341-351, December.
    12. J. Eric Bickel, 2008. "The Relationship Between Perfect and Imperfect Information in a Two-Action Risk-Sensitive Problem," Decision Analysis, INFORMS, vol. 5(3), pages 116-128, September.
    13. David M. Blum & M. Elisabeth Paté-Cornell, 2016. "Probabilistic Warnings in National Security Crises: Pearl Harbor Revisited," Decision Analysis, INFORMS, vol. 13(1), pages 1-25, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Toni Greif & Nikolai Stein & Christoph M. Flath, 2023. "Information Value Analysis for Real-Time Silo Fill-Level Monitoring," Interfaces, INFORMS, vol. 53(4), pages 283-294, July.
    2. Gordon Hazen & Emanuele Borgonovo & Xuefei Lu, 2023. "Information Density in Decision Analysis," Decision Analysis, INFORMS, vol. 20(2), pages 89-108, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Adam Fleischhacker & Pak-Wing Fok & Mokshay Madiman & Nan Wu, 2023. "A Closed-Form EVSI Expression for a Multinomial Data-Generating Process," Decision Analysis, INFORMS, vol. 20(1), pages 73-84, March.
    2. Zou, Guang & Faber, Michael Havbro & González, Arturo & Banisoleiman, Kian, 2021. "Computing the value of information from periodic testing in holistic decision making under uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 206(C).
    3. Peter I. Frazier & Warren B. Powell, 2010. "Paradoxes in Learning and the Marginal Value of Information," Decision Analysis, INFORMS, vol. 7(4), pages 378-403, December.
    4. L. Robin Keller & Ali Abbas & Manel Baucells & Vicki M. Bier & David Budescu & John C. Butler & Philippe Delquié & Jason R. W. Merrick & Ahti Salo & George Wu, 2010. "From the Editors..," Decision Analysis, INFORMS, vol. 7(4), pages 327-330, December.
      • L. Robin Keller & Manel Baucells & Kevin F. McCardle & Gregory S. Parnell & Ahti Salo, 2007. "From the Editors..," Decision Analysis, INFORMS, vol. 4(4), pages 173-175, December.
      • L. Robin Keller & Manel Baucells & John C. Butler & Philippe Delquié & Jason R. W. Merrick & Gregory S. Parnell & Ahti Salo, 2008. "From the Editors..," Decision Analysis, INFORMS, vol. 5(4), pages 173-176, December.
      • L. Robin Keller & Manel Baucells & John C. Butler & Philippe Delquié & Jason R. W. Merrick & Gregory S. Parnell & Ahti Salo, 2009. "From the Editors ..," Decision Analysis, INFORMS, vol. 6(4), pages 199-201, December.
    5. Xuefei Lu & Alessandro Rudi & Emanuele Borgonovo & Lorenzo Rosasco, 2020. "Faster Kriging: Facing High-Dimensional Simulators," Operations Research, INFORMS, vol. 68(1), pages 233-249, January.
    6. Zhiyuan Wang & Zhiqiang (Eric) Zheng & Wei Jiang & Shaojie Tang, 2021. "Blockchain‐Enabled Data Sharing in Supply Chains: Model, Operationalization, and Tutorial," Production and Operations Management, Production and Operations Management Society, vol. 30(7), pages 1965-1985, July.
    7. Oakley, Jeremy E. & Brennan, Alan & Tappenden, Paul & Chilcott, Jim, 2010. "Simulation sample sizes for Monte Carlo partial EVPI calculations," Journal of Health Economics, Elsevier, vol. 29(3), pages 468-477, May.
    8. Cevasco, D. & Koukoura, S. & Kolios, A.J., 2021. "Reliability, availability, maintainability data review for the identification of trends in offshore wind energy applications," Renewable and Sustainable Energy Reviews, Elsevier, vol. 136(C).
    9. Andrija S Grustam & Nasuh Buyukkaramikli & Ron Koymans & Hubertus J M Vrijhoef & Johan L Severens, 2019. "Value of information analysis in telehealth for chronic heart failure management," PLOS ONE, Public Library of Science, vol. 14(6), pages 1-23, June.
    10. Li, Mingxin & Jiang, Xiaoli & Carroll, James & Negenborn, Rudy R., 2022. "A multi-objective maintenance strategy optimization framework for offshore wind farms considering uncertainty," Applied Energy, Elsevier, vol. 321(C).
    11. Debarun Bhattacharjya & Léa A. Deleris, 2014. "The Value of Information in Some Variations of the Stopping Problem," Decision Analysis, INFORMS, vol. 11(3), pages 189-203, September.
    12. Niyazi Onur Bakir, 2015. "Monotonicity of the Selling Price of Information with Risk Aversion in Two Action Decision Problems," Central European Journal of Economic Modelling and Econometrics, Central European Journal of Economic Modelling and Econometrics, vol. 7(2), pages 71-90, June.
    13. Daniel W. Gladish & Daniel E. Pagendam & Luk J. M. Peeters & Petra M. Kuhnert & Jai Vaze, 2018. "Emulation Engines: Choice and Quantification of Uncertainty for Complex Hydrological Models," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 23(1), pages 39-62, March.
    14. Daneshkhah, A. & Stocks, N.G. & Jeffrey, P., 2017. "Probabilistic sensitivity analysis of optimised preventive maintenance strategies for deteriorating infrastructure assets," Reliability Engineering and System Safety, Elsevier, vol. 163(C), pages 33-45.
    15. Mostafa Reisi Gahrooei & Hao Yan & Kamran Paynabar, 2020. "Comments on: On Active Learning Methods for Manifold Data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 29(1), pages 38-41, March.
    16. Mayuran Sivapalan & Jerome Bowen, 2020. "Decision frameworks for restoration & adaptation investment–Applying lessons from asset-intensive industries to the Great Barrier Reef," PLOS ONE, Public Library of Science, vol. 15(11), pages 1-20, November.
    17. Whitney J. Trainor-Guitton, 2014. "A geophysical perspective of value of information: examples of spatial decisions for groundwater sustainability," Environment Systems and Decisions, Springer, vol. 34(1), pages 124-133, March.
    18. Liesiö, Juuso & Salo, Ahti & Keisler, Jeffrey M. & Morton, Alec, 2021. "Portfolio decision analysis: Recent developments and future prospects," European Journal of Operational Research, Elsevier, vol. 293(3), pages 811-825.
    19. Jill Bindels & Bram Ramaekers & Isaac Corro Ramos & Leyla Mohseninejad & Saskia Knies & Janneke Grutters & Maarten Postma & Maiwenn Al & Talitha Feenstra & Manuela Joore, 2016. "Use of Value of Information in Healthcare Decision Making: Exploring Multiple Perspectives," PharmacoEconomics, Springer, vol. 34(3), pages 315-322, March.
    20. Karine Hagesæther Foss & Gunhild Elisabeth Berget & Jo Eidsvik, 2022. "Using an autonomous underwater vehicle with onboard stochastic advection‐diffusion models to map excursion sets of environmental variables," Environmetrics, John Wiley & Sons, Ltd., vol. 33(1), February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ordeca:v:17:y:2020:i:2:p:134-153. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.