IDEAS home Printed from https://ideas.repec.org/a/bla/jorssa/v168y2005i2p307-323.html
   My bibliography  Save this article

Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators

Author

Listed:
  • M. Saisana
  • A. Saltelli
  • S. Tarantola

Abstract

Composite indicators are increasingly used for bench-marking countries' performances. Yet doubts are often raised about the robustness of the resulting countries' rankings and about the significance of the associated policy message. We propose the use of uncertainty analysis and sensitivity analysis to gain useful insights during the process of building composite indicators, including a contribution to the indicators' definition of quality and an assessment of the reliability of countries' rankings. We discuss to what extent the use of uncertainty and sensitivity analysis may increase transparency or make policy inference more defensible by applying the methodology to a known composite indicator: the United Nations's technology achievement index. Copyright 2005 Royal Statistical Society.

Suggested Citation

  • M. Saisana & A. Saltelli & S. Tarantola, 2005. "Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 168(2), pages 307-323.
  • Handle: RePEc:bla:jorssa:v:168:y:2005:i:2:p:307-323
    as

    Download full text from publisher

    File URL: http://www.blackwell-synergy.com/doi/abs/10.1111/j.1467-985X.2005.00350.x
    File Function: link to full text
    Download Restriction: Access to full text is restricted to subscribers.

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-620, September.
    2. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    3. Jean-Yves Duclos & David E. Sahn & Stephen D. Younger, 2006. "Robust Multidimensional Poverty Comparisons," Economic Journal, Royal Economic Society, vol. 116(514), pages 943-968, October.
    4. de Vos, Klaas & Zaidi, M Asghar, 1997. "Equivalence Scale Sensitivity of Poverty Statistics for the Member States of the European Community," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 43(3), pages 319-333, September.
    5. A. B. Atkinson & F. Bourguignon, 1982. "The Comparison of Multi-Dimensioned Distributions of Economic Status," Review of Economic Studies, Oxford University Press, vol. 49(2), pages 183-201.
    6. Browning, Martin & Francois Bourguignon & Pierre-Andre Chiappori & Valerie Lechene, 1994. "Income and Outcomes: A Structural Model of Intrahousehold Allocation," Journal of Political Economy, University of Chicago Press, vol. 102(6), pages 1067-1096, December.
    7. Barbara Sianesi, 2001. "Propensity score matching," United Kingdom Stata Users' Group Meetings 2001 12, Stata Users Group, revised 23 Aug 2001.
    8. Nolan, Brian & Whelan, Christopher T., 1996. "Resources, Deprivation, and Poverty," OUP Catalogue, Oxford University Press, number 9780198287858.
    9. Richard Blundell & Lorraine Dearden & Barbara Sianesi, 2003. "Evaluating the impact of education on earnings in the UK: Models, methods and results from the NCDS," IFS Working Papers W03/20, Institute for Fiscal Studies.
    10. Maasoumi, Esfandiar & Nickelsburg, Gerald, 1988. "Multivariate Measures of Well-Being and an Analysis of Inequality in the Michigan Data," Journal of Business & Economic Statistics, American Statistical Association, vol. 6(3), pages 326-334, July.
    11. Rajeev H. Dehejia & Sadek Wahba, 1998. "Causal Effects in Non-Experimental Studies: Re-Evaluating the Evaluation of Training Programs," NBER Working Papers 6586, National Bureau of Economic Research, Inc.
    12. Shelly J. Lundberg & Robert A. Pollak & Terence J. Wales, 1997. "Do Husbands and Wives Pool Their Resources? Evidence from the United Kingdom Child Benefit," Journal of Human Resources, University of Wisconsin Press, vol. 32(3), pages 463-480.
    13. Rajeev H. Dehejia & Sadek Wahba, 2002. "Propensity Score-Matching Methods For Nonexperimental Causal Studies," The Review of Economics and Statistics, MIT Press, vol. 84(1), pages 151-161, February.
    14. Atkinson, Tony & Cantillon, Bea & Marlier, Eric & Nolan, Brian, 2002. "Social Indicators: The EU and Social Inclusion," OUP Catalogue, Oxford University Press, number 9780199253494.
    15. Richard Burkhauser & Greg Duncan & Richard Hauser & Roland Berntsen, 1991. "Wife or frau, women do worse: A comparison of men and women in the United States and Germany after marital dissolution," Demography, Springer;Population Association of America (PAA), vol. 28(3), pages 353-360, August.
    16. Maasoumi, Esfandiar, 1986. "The Measurement and Decomposition of Multi-dimensional Inequality," Econometrica, Econometric Society, vol. 54(4), pages 991-997, July.
    17. A. Atkinson, 2003. "Multidimensional Deprivation: Contrasting Social Welfare and Counting Approaches," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 1(1), pages 51-65, April.
    18. Greg J. Duncan & Saul D. Hoffman, 1985. "Economic Consequences of Marital Instability," NBER Chapters,in: Horizontal Equity, Uncertainty, and Economic Well-Being, pages 427-470 National Bureau of Economic Research, Inc.
    19. Ram, Rati, 1982. "Composite indices of physical quality of life, basic needs fulfilment, and income : A principal component representation," Journal of Development Economics, Elsevier, vol. 11(2), pages 227-247, October.
    20. Augurzky, Boris & Schmidt, Christoph M., 2001. "The Propensity Score: A Means to An End," IZA Discussion Papers 271, Institute for the Study of Labor (IZA).
    21. McElroy, Marjorie B & Horney, Mary Jean, 1981. "Nash-Bargained Household Decisions: Toward a Generalization of the Theory of Demand," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 22(2), pages 333-349, June.
    22. Edwin Leuven & Barbara Sianesi, 2003. "PSMATCH2: Stata module to perform full Mahalanobis and propensity score matching, common support graphing, and covariate imbalance testing," Statistical Software Components S432001, Boston College Department of Economics, revised 01 Feb 2018.
    Full references (including those not matched with items on IDEAS)

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssa:v:168:y:2005:i:2:p:307-323. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wiley-Blackwell Digital Licensing) or (Christopher F. Baum). General contact details of provider: http://edirc.repec.org/data/rssssea.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.