IDEAS home Printed from https://ideas.repec.org/a/sae/risrel/v230y2016i3p309-322.html
   My bibliography  Save this article

Reliability updating in linear opinion pooling for multiple decision makers

Author

Listed:
  • Donnacha Bolger
  • Brett Houlding

Abstract

Accurate information sources are vital prerequisites for good decision making. Here, we consider a multiple participant setting, where all decision makers have a collection of neighbours with whom they share their beliefs about some common relevant uncertain quantity. When determining which course of action to follow, a decision maker takes into account all the information received from her neighbours. Over time, in light of the returns observed from choices made, decision makers update their own beliefs over the uncertain event and also adjust the degree of consideration they afford to the opinions of each neighbour based on the level of reliability their information is ascertained to have. In this article, we derive and discuss a methodology, the plug-in approach, by which this can be done, and discuss some suitable justification for this. We include an illustrative risk-based example which further demonstrates the merits of the method, before concluding with a discussion on further work and potential alternatives.

Suggested Citation

  • Donnacha Bolger & Brett Houlding, 2016. "Reliability updating in linear opinion pooling for multiple decision makers," Journal of Risk and Reliability, , vol. 230(3), pages 309-322, June.
    • Handle: RePEc:sae:risrel:v:230:y:2016:i:3:p:309-322
    DOI: 10.1177/1748006X16631866
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/1748006X16631866
    Download Restriction: no
    File URL: https://libkey.io/10.1177/1748006X16631866?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Morris H. DeGroot & Julia Mortera, 1991. "Optimal Linear Opinion Pools," Management Science, INFORMS, vol. 37(5), pages 546-558, May.
    2. Mohamed N. Jouini & Robert T. Clemen, 1996. "Copula Models for Aggregating Expert Opinions," Operations Research, INFORMS, vol. 44(3), pages 444-457, June.
    3. A. Dawid & M. DeGroot & J. Mortera & R. Cooke & S. French & C. Genest & M. Schervish & D. Lindley & K. McConway & R. Winkler, 1995. "Coherent combination of experts' opinions," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 4(2), pages 263-313, December.
    4. Robin P. Nicolai & Rommert Dekker, 2008. "Optimal Maintenance of Multi-component Systems: A Review," Springer Series in Reliability Engineering, in: Complex System Maintenance Handbook, chapter 11, pages 263-286, Springer.
    5. Flandoli, F. & Giorgi, E. & Aspinall, W.P. & Neri, A., 2011. "Comparison of a new expert elicitation model with the Classical Model, equal weights and single experts, using a cross-validation technique," Reliability Engineering and System Safety, Elsevier, vol. 96(10), pages 1292-1310.
    6. Houlding, B. & Coolen, F.P.A., 2012. "Nonparametric predictive utility inference," European Journal of Operational Research, Elsevier, vol. 221(1), pages 222-230.
    7. Robert T. Clemen & Robert L. Winkler, 1999. "Combining Probability Distributions From Experts in Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 19(2), pages 187-203, April.
    8. Kenneth J. Arrow, 1950. "A Difficulty in the Concept of Social Welfare," Journal of Political Economy, University of Chicago Press, vol. 58, pages 328-328.
    9. Wisse, Bram & Bedford, Tim & Quigley, John, 2008. "Expert judgement combination using moment methods," Reliability Engineering and System Safety, Elsevier, vol. 93(5), pages 675-686.
    10. John C. Harsanyi, 1955. "Cardinal Welfare, Individualistic Ethics, and Interpersonal Comparisons of Utility," Journal of Political Economy, University of Chicago Press, vol. 63, pages 309-309.
    11. Chauncey Starr, 1981. "Risk Criteria for Nuclear Power Plants: A Pragmatic Proposal," Risk Analysis, John Wiley & Sons, vol. 1(2), pages 113-120, June.
    12. John Quigley & Kevin J. Wilson & Lesley Walls & Tim Bedford, 2013. "A Bayes Linear Bayes Method for Estimation of Correlated Event Rates," Risk Analysis, John Wiley & Sons, vol. 33(12), pages 2209-2224, December.
    13. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bolger, Donnacha & Houlding, Brett, 2017. "Deriving the probability of a linear opinion pooling method being superior to a set of alternatives," Reliability Engineering and System Safety, Elsevier, vol. 158(C), pages 41-49.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bolger, Donnacha & Houlding, Brett, 2017. "Deriving the probability of a linear opinion pooling method being superior to a set of alternatives," Reliability Engineering and System Safety, Elsevier, vol. 158(C), pages 41-49.
    2. Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
    3. Erin Baker & Olaitan Olaleye, 2013. "Combining Experts: Decomposition and Aggregation Order," Risk Analysis, John Wiley & Sons, vol. 33(6), pages 1116-1127, June.
    4. Federico Bassetti & Roberto Casarin & Francesco Ravazzolo, 2019. "Density Forecasting," BEMPS - Bozen Economics & Management Paper Series BEMPS59, Faculty of Economics and Management at the Free University of Bozen.
    5. Patrick Afflerbach & Christopher Dun & Henner Gimpel & Dominik Parak & Johannes Seyfried, 2021. "A Simulation-Based Approach to Understanding the Wisdom of Crowds Phenomenon in Aggregating Expert Judgment," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 63(4), pages 329-348, August.
    6. Makariou, Despoina & Barrieu, Pauline & Tzougas, George, 2021. "A finite mixture modelling perspective for combining experts’ opinions with an application to quantile-based risk measures," LSE Research Online Documents on Economics 110763, London School of Economics and Political Science, LSE Library.
    7. Despoina Makariou & Pauline Barrieu & George Tzougas, 2021. "A Finite Mixture Modelling Perspective for Combining Experts’ Opinions with an Application to Quantile-Based Risk Measures," Risks, MDPI, vol. 9(6), pages 1-25, June.
    8. Roopesh Ranjan & Tilmann Gneiting, 2010. "Combining probability forecasts," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(1), pages 71-91, January.
    9. Jason R. W. Merrick, 2008. "Getting the Right Mix of Experts," Decision Analysis, INFORMS, vol. 5(1), pages 43-52, March.
    10. Zahir, Sajjad, 1999. "Geometry of decision making and the vector space formulation of the analytic hierarchy process," European Journal of Operational Research, Elsevier, vol. 112(2), pages 373-396, January.
    11. Mongin, Philippe, 2019. "Interview of Peter J. Hammond," CRETA Online Discussion Paper Series 50, Centre for Research in Economic Theory and its Applications CRETA.
    12. Stephen Hora & Erim Kardeş, 2015. "Calibration, sharpness and the weighting of experts in a linear opinion pool," Annals of Operations Research, Springer, vol. 229(1), pages 429-450, June.
    13. Itzhak Gilboa, 2010. "Questions in Decision Theory," Annual Review of Economics, Annual Reviews, vol. 2(1), pages 1-19, September.
    14. James K. Hammitt & Yifan Zhang, 2013. "Combining Experts’ Judgments: Comparison of Algorithmic Methods Using Synthetic Data," Risk Analysis, John Wiley & Sons, vol. 33(1), pages 109-120, January.
    15. A. Philip Dawid & Julia Mortera, 2020. "Resolving some contradictions in the theory of linear opinion pools," Theory and Decision, Springer, vol. 88(3), pages 453-456, April.
    16. David Canning, 2007. "Valuing Lives Equally and Welfare Economics," PGDA Working Papers 2707, Program on the Global Demography of Aging.
    17. Kotaro Suzumura, 2002. "Introduction to social choice and welfare," Temi di discussione (Economic working papers) 442, Bank of Italy, Economic Research and International Relations Area.
    18. Kenichiro McAlinn & Knut Are Aastveit & Jouchi Nakajima & Mike West, 2020. "Multivariate Bayesian Predictive Synthesis in Macroeconomic Forecasting," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(531), pages 1092-1110, July.
    19. Taylor, James W. & Taylor, Kathryn S., 2023. "Combining probabilistic forecasts of COVID-19 mortality in the United States," European Journal of Operational Research, Elsevier, vol. 304(1), pages 25-41.
    20. S Mansoob Murshed, 2021. "Reformulating Jan Tinbergen’s normative vision on welfare and security," Journal of Peace Research, Peace Research Institute Oslo, vol. 58(5), pages 962-972, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:risrel:v:230:y:2016:i:3:p:309-322. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.