IDEAS home Printed from https://ideas.repec.org/a/bla/jorssa/v176y2013i3p609-634.html
   My bibliography  Save this article

Ratings and rankings: voodoo or science?

Author

Listed:
  • Paolo Paruolo
  • Michaela Saisana
  • Andrea Saltelli

Abstract

No abstract is available for this item.

Suggested Citation

  • Paolo Paruolo & Michaela Saisana & Andrea Saltelli, 2013. "Ratings and rankings: voodoo or science?," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(3), pages 609-634, June.
    • Handle: RePEc:bla:jorssa:v:176:y:2013:i:3:p:609-634
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1111/j.1467-985X.2012.01059.x
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Giuseppe Nicoletti & Stefano Scarpetta & Olivier Boylaud, 2000. "Summary Indicators of Product Market Regulation with an Extension to Employment Protection Legislation," OECD Economics Department Working Papers 226, OECD Publishing.
    2. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, December.
    3. Van de Kerk, Geurt & Manuel, Arthur R., 2008. "A comprehensive index for a sustainable society: The SSI -- the Sustainable Society Index," Ecological Economics, Elsevier, vol. 66(2-3), pages 228-242, June.
    4. Tarantola, S. & Gatelli, D. & Mara, T.A., 2006. "Random balance designs for the estimation of first order global sensitivity indices," Reliability Engineering and System Safety, Elsevier, vol. 91(6), pages 717-727.
    5. Yoram Wind & Thomas L. Saaty, 1980. "Marketing Applications of the Analytic Hierarchy Process," Management Science, INFORMS, vol. 26(7), pages 641-658, July.
    6. George Leckie & Harvey Goldstein, 2009. "The limitations of using school league tables to inform school choice," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(4), pages 835-851, October.
    7. Jean-Charles Billaut & Denis Bouyssou & Philippe Vincke, 2010. "Should you believe in the Shanghai ranking?," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(1), pages 237-263, July.
    8. Andrea Saltelli, 2007. "Composite Indicators between Analysis and Advocacy," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 81(1), pages 65-77, March.
    9. Ravallion, Martin, 2012. "Troubling tradeoffs in the Human Development Index," Journal of Development Economics, Elsevier, vol. 99(2), pages 201-209.
    10. Sheila M. Bird & Cox Sir David & Vern T. Farewell & Goldstein Harvey & Holt Tim & Smith Peter C., 2005. "Performance indicators: good, bad, and ugly," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 168(1), pages 1-27, January.
    11. repec:dau:papers:123456789/2947 is not listed on IDEAS
    12. M. Saisana & A. Saltelli & S. Tarantola, 2005. "Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 168(2), pages 307-323, March.
    13. Marco Ratto & Andrea Pagano, 2010. "Using recursive algorithms for the efficient identification of smoothing spline ANOVA models," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 94(4), pages 367-388, December.
    14. Giuseppe Munda & Michela Nardo, 2009. "Noncompensatory/nonlinear composite indicators for ranking countries: a defensible setting," Applied Economics, Taylor & Francis Journals, vol. 41(12), pages 1513-1523.
    15. Xu, Chonggang & Gertner, George, 2011. "Understanding and comparisons of different sampling approaches for the Fourier Amplitudes Sensitivity Test (FAST)," Computational Statistics & Data Analysis, Elsevier, vol. 55(1), pages 184-198, January.
    16. Plischke, Elmar, 2010. "An effective algorithm for computing global sensitivity indices (EASI)," Reliability Engineering and System Safety, Elsevier, vol. 95(4), pages 354-360.
    17. Saisana, Michaela & d'Hombres, Béatrice & Saltelli, Andrea, 2011. "Rickety numbers: Volatility of university rankings and policy implications," Research Policy, Elsevier, vol. 40(1), pages 165-177, February.
    18. Giuseppe Munda, 2008. "Social Multi-Criteria Evaluation for a Sustainable Economy," Springer Books, Springer, number 978-3-540-73703-2, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    2. Saisana, Michaela & d'Hombres, Béatrice & Saltelli, Andrea, 2011. "Rickety numbers: Volatility of university rankings and policy implications," Research Policy, Elsevier, vol. 40(1), pages 165-177, February.
    3. María del Carmen Bas & Stefano Tarantola & José Miguel Carot & Andrea Conchado, 2017. "Sensitivity Analysis: A Necessary Ingredient for Measuring the Quality of a Teaching Activity Index," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 131(3), pages 931-946, April.
    4. Marco Marozzi, 2015. "Measuring Trust in European Public Institutions," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 123(3), pages 879-895, September.
    5. Giuseppina Guagnano & Maria Rita Sebastiani, 2018. "Away from Dissatisfaction, Closer to Well-Being: A Multidimensional Synthetic Measure," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 136(3), pages 977-997, April.
    6. Milica Maricic & Jose A. Egea & Veljko Jeremic, 2019. "A Hybrid Enhanced Scatter Search—Composite I-Distance Indicator (eSS-CIDI) Optimization Approach for Determining Weights Within Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 497-537, July.
    7. Samira El Gibari & Trinidad Gómez & Francisco Ruiz, 2019. "Building composite indicators using multicriteria methods: a review," Journal of Business Economics, Springer, vol. 89(1), pages 1-24, February.
    8. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2018. "σ-µ efficiency analysis: A new methodology for evaluating units through composite indices," MPRA Paper 83569, University Library of Munich, Germany.
    9. Annalina Sarra & Eugenia Nissi, 2020. "A Spatial Composite Indicator for Human and Ecosystem Well-Being in the Italian Urban Areas," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 148(2), pages 353-377, April.
    10. Vincent Van Roy & Daniel Nepelski, 2016. "Assessment of Framework Conditions for the Creation and Growth of Firms in Europe," JRC Research Reports JRC103350, Joint Research Centre (Seville site).
    11. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2019. "Sigma-Mu efficiency analysis: A methodology for evaluating units through composite indicators," European Journal of Operational Research, Elsevier, vol. 278(3), pages 942-960.
    12. Ruiz, Francisco & El Gibari, Samira & Cabello, José M. & Gómez, Trinidad, 2020. "MRP-WSCI: Multiple reference point based weak and strong composite indicators," Omega, Elsevier, vol. 95(C).
    13. Giuseppe Munda, 2015. "Beyond Gdp: An Overview Of Measurement Issues In Redefining ‘Wealth’," Journal of Economic Surveys, Wiley Blackwell, vol. 29(3), pages 403-422, July.
    14. Rosalia Castellano & Antonella Rocca, 2015. "Assessing the gender gap in labour market index: volatility of results and reliability," International Journal of Social Economics, Emerald Group Publishing Limited, vol. 42(8), pages 749-772, August.
    15. Giuseppe Munda, 2012. "Choosing Aggregation Rules for Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 109(3), pages 337-354, December.
    16. Tissot, Jean-Yves & Prieur, Clémentine, 2012. "Bias correction for the estimation of sensitivity indices based on random balance designs," Reliability Engineering and System Safety, Elsevier, vol. 107(C), pages 205-213.
    17. Lozano-Oyola, Macarena & Contreras, Ignacio & Blancas, Francisco Javier, 2019. "An Operational Non-compensatory Composite Indicator: Measuring Sustainable Tourism in Andalusian Urban Destinations," Ecological Economics, Elsevier, vol. 159(C), pages 1-10.
    18. Papadimitri, Panagiota & Pasiouras, Fotios & Tasiou, Menelaos & Ventouri, Alexia, 2020. "The effects of board of directors’ education on firms’ credit ratings," Journal of Business Research, Elsevier, vol. 116(C), pages 294-313.
    19. Plischke, Elmar & Borgonovo, Emanuele & Smith, Curtis L., 2013. "Global sensitivity measures from given data," European Journal of Operational Research, Elsevier, vol. 226(3), pages 536-550.
    20. Marco Marozzi, 2016. "Construction, Robustness Assessment and Application of an Index of Perceived Level of Socio-Economic Threat from Immigrants: A Study of 47 European Countries and Regions," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 128(1), pages 413-437, August.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssa:v:176:y:2013:i:3:p:609-634. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.