IDEAS home Printed from https://ideas.repec.org/a/wly/riskan/v35y2015i6p963-970.html

Introduction to the Special Series on Research Synthesis: A Cross‐Disciplinary Approach

Author

Listed:
  • Lisa A. Robinson
  • James K. Hammitt

Abstract

To estimate the effects of a policy change, analysts must often rely on available data as time and resource constraints limit their ability to commission new primary research. Research synthesis methods—including systematic review, meta‐analysis, and expert elicitation—play an important role in ensuring that this evidence is appropriately weighed and considered. We present the conclusions of a multidisciplinary Harvard Center for Risk Analysis project that evaluated and applied these methods, and introduce the resulting series of articles. The first step in any analysis is to clearly define the problem to be addressed; the second is a systematic review of the literature. Whether additional analysis is needed depends on the quality and relevance of the available data to the policy question, and the likely effect of uncertainty on the policy decision. Meta‐analysis promotes understanding the variation between studies and may be used to combine the estimates to develop values for application in policy analysis. Formal, structured expert elicitation promotes careful consideration of the evidence when data are limited or inconsistent, and aids in extrapolating to the policy context. Regardless of the methods used, clear communication of the approach, assumptions, and uncertainty is essential.

Suggested Citation

  • Lisa A. Robinson & James K. Hammitt, 2015. "Introduction to the Special Series on Research Synthesis: A Cross‐Disciplinary Approach," Risk Analysis, John Wiley & Sons, vol. 35(6), pages 963-970, June.
  • Handle: RePEc:wly:riskan:v:35:y:2015:i:6:p:963-970
    DOI: 10.1111/risa.12437
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/risa.12437
    Download Restriction: no

    File URL: https://libkey.io/10.1111/risa.12437?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Cooke, Roger M. & Goossens, Louis L.H.J., 2008. "TU Delft expert judgment data base," Reliability Engineering and System Safety, Elsevier, vol. 93(5), pages 657-674.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. World Health Organization, Foodborne Epidemiology Reference Group, Source Attribution Task Force, 2016. "Research Synthesis Methods in an Age of Globalized Risks: Lessons from the Global Burden of Foodborne Disease Expert Elicitation," Risk Analysis, John Wiley & Sons, vol. 36(2), pages 191-202, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Geovanna Hinojoza-Castro & Montserrat Gómez-Delgado & Wenseslao Plata-Rocha, 2022. "Real Estate Developers as Agents in the Simulation of Urban Sprawl," Sustainability, MDPI, vol. 14(15), pages 1-12, July.
    2. Fei Xiong & Yun Liu & Zhenjiang Zhang, 2011. "Dynamics With Co-Evolution Of Individual Inclination And Opinion," International Journal of Modern Physics C (IJMPC), World Scientific Publishing Co. Pte. Ltd., vol. 22(01), pages 51-62.
    3. Karner, Alex & Niemeier, Deb, 2013. "Civil rights guidance and equity analysis methods for regional transportation plans: a critical review of literature and practice," Journal of Transport Geography, Elsevier, vol. 33(C), pages 126-134.
    4. Hanea, A.M. & McBride, M.F. & Burgman, M.A. & Wintle, B.C. & Fidler, F. & Flander, L. & Twardy, C.R. & Manning, B. & Mascaro, S., 2017. "I nvestigate D iscuss E stimate A ggregate for structured expert judgement," International Journal of Forecasting, Elsevier, vol. 33(1), pages 267-279.
    5. Laura Diaz Anadon & Erin Baker & Valentina Bosetti & Lara Aleluia Reis, 2016. "Expert views - and disagreements - about the potential of energy technology R&D," Climatic Change, Springer, vol. 136(3), pages 677-691, June.
    6. Hanea, D.M. & Jagtman, H.M. & van Alphen, L.L.M.M. & Ale, B.J.M., 2010. "Quantitative and qualitative analysis of the expert and non-expert opinion in fire risk in buildings," Reliability Engineering and System Safety, Elsevier, vol. 95(7), pages 729-741.
    7. Colson, Abigail R. & Cooke, Roger M., 2017. "Cross validation for the classical model of structured expert judgment," Reliability Engineering and System Safety, Elsevier, vol. 163(C), pages 109-120.
    8. Erin Baker & Olaitan Olaleye, 2013. "Combining Experts: Decomposition and Aggregation Order," Risk Analysis, John Wiley & Sons, vol. 33(6), pages 1116-1127, June.
    9. Anca M. Hanea & Marissa F. McBride & Mark A. Burgman & Bonnie C. Wintle, 2018. "The Value of Performance Weights and Discussion in Aggregated Expert Judgments," Risk Analysis, John Wiley & Sons, vol. 38(9), pages 1781-1794, September.
    10. Gayan Dharmarathne & Gabriela F. Nane & Andrew Robinson & Anca M. Hanea, 2023. "Shrinking the Variance in Experts’ “Classical” Weights Used in Expert Judgment Aggregation," Forecasting, MDPI, vol. 5(3), pages 1-14, August.
    11. Flandoli, F. & Giorgi, E. & Aspinall, W.P. & Neri, A., 2011. "Comparison of a new expert elicitation model with the Classical Model, equal weights and single experts, using a cross-validation technique," Reliability Engineering and System Safety, Elsevier, vol. 96(10), pages 1292-1310.
    12. Stef Janssen & Alexei Sharpanskykh & Richard Curran, 2019. "AbSRiM: An Agent‐Based Security Risk Management Approach for Airport Operations," Risk Analysis, John Wiley & Sons, vol. 39(7), pages 1582-1596, July.
    13. Anil Gaba & Ilia Tsetlin & Robert L. Winkler, 2017. "Combining Interval Forecasts," Decision Analysis, INFORMS, vol. 14(1), pages 1-20, March.
    14. Cao, Quoc Dung & Miles, Scott B. & Choe, Youngjun, 2022. "Infrastructure recovery curve estimation using Gaussian process regression on expert elicited data," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    15. Rongen, G. & Morales-Nápoles, O. & Kok, M., 2022. "Expert judgment-based reliability analysis of the Dutch flood defense system," Reliability Engineering and System Safety, Elsevier, vol. 224(C).
    16. Eggstaff, Justin W. & Mazzuchi, Thomas A. & Sarkani, Shahram, 2014. "The effect of the number of seed variables on the performance of Cooke′s classical model," Reliability Engineering and System Safety, Elsevier, vol. 121(C), pages 72-82.
    17. Lisa A. Robinson & James K. Hammitt, 2015. "Research Synthesis and the Value per Statistical Life," Risk Analysis, John Wiley & Sons, vol. 35(6), pages 1086-1100, June.
    18. Marcelo Ramos Martins & Marco Aurélio Pestana & Enrique Andrés López Droguett, 2020. "A Methodology for Assessing the Probability of Occurrence of Undesired Events in the Tietê–Paraná Inland Waterway Based on Expert Opinion," Risk Analysis, John Wiley & Sons, vol. 40(6), pages 1279-1301, June.
    19. James K. Hammitt & Yifan Zhang, 2013. "Combining Experts’ Judgments: Comparison of Algorithmic Methods Using Synthetic Data," Risk Analysis, John Wiley & Sons, vol. 33(1), pages 109-120, January.
    20. Florian Pallas & Florian Böckermann & Oliver Goetz & Kirstin Tecklenburg, 2013. "Investigating Organisational Innovativeness: Developing A Multidimensional Formative Measure," International Journal of Innovation Management (ijim), World Scientific Publishing Co. Pte. Ltd., vol. 17(04), pages 1-41.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:riskan:v:35:y:2015:i:6:p:963-970. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1111/(ISSN)1539-6924 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.