IDEAS home Printed from https://ideas.repec.org/a/bla/jorssc/v69y2020i3p589-606.html
   My bibliography  Save this article

A joint confidence region for an overall ranking of populations

Author

Listed:
  • Martin Klein
  • Tommy Wright
  • Jerzy Wieczorek

Abstract

National statistical agencies lack statistical methodology to express uncertainty in their released estimated overall rankings. For example, the US Census Bureau produced an ‘explicit’ ranking of the states based on observed sample estimates during 2011 of mean travel time to work. Current literature provides measures of uncertainty in estimated individual ranks, but not a direct measure of uncertainty for the estimated overall ranking. We construct and visualize a joint confidence region for the true unknown overall ranking that provides a measure of uncertainty in the estimated overall ranking.

Suggested Citation

  • Martin Klein & Tommy Wright & Jerzy Wieczorek, 2020. "A joint confidence region for an overall ranking of populations," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 69(3), pages 589-606, June.
  • Handle: RePEc:bla:jorssc:v:69:y:2020:i:3:p:589-606
    DOI: 10.1111/rssc.12402
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/rssc.12402
    Download Restriction: no

    File URL: https://libkey.io/10.1111/rssc.12402?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Schenker N. & Gentleman J. F., 2001. "On Judging the Significance of Differences by Examining the Overlap Between Confidence Intervals," The American Statistician, American Statistical Association, vol. 55, pages 182-186, August.
    2. Tommy Wright & Martin Klein & Jerzy Wieczorek, 2019. "A Primer on Visualizations for Comparing Populations, Including the Issue of Overlapping Confidence Intervals," The American Statistician, Taylor & Francis Journals, vol. 73(2), pages 165-178, April.
    3. Harvey Goldstein & David J. Spiegelhalter, 1996. "League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 159(3), pages 385-409, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Magne Mogstad & Joseph P Romano & Azeem M Shaikh & Daniel Wilhelm, 2024. "Inference for Ranks with Applications to Mobility across Neighbourhoods and Academic Achievement across Countries," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 91(1), pages 476-518.
    2. Denis Chetverikov & Daniel Wilhelm, 2023. "Inference for rank-rank regressions," IFS Working Papers WCWP23/23, Institute for Fiscal Studies.
    3. Will Davis & Alexander Gordan & Rusty Tchernis, 2021. "Measuring the spatial distribution of health rankings in the United States," Health Economics, John Wiley & Sons, Ltd., vol. 30(11), pages 2921-2936, November.
    4. Bazylik, Sergei & Mogstad, Magne & Romano, Joseph P. & Shaikh, Azeem M. & Wilhelm, Daniel, 2025. "Finite- and large-sample inference for ranks using multinomial data with an application to ranking political parties," Journal of Econometrics, Elsevier, vol. 250(C).
    5. Wright, Tommy, 2025. "Optimal tightening of the KWW joint confidence region for a ranking," Statistics & Probability Letters, Elsevier, vol. 217(C).
    6. Denis Chetverikov & Daniel Wilhelm, 2023. "Inference for Rank-Rank Regressions," Papers 2310.15512, arXiv.org, revised Jul 2025.
    7. Denis Chetverikov & Daniel Wilhelm, 2023. "Inference for rank-rank regressions," CeMMAP working papers 23/23, Institute for Fiscal Studies.
    8. Denis Chetverikov & Daniel Wilhelm, 2024. "Inference for rank-rank regressions," IFS Working Papers WCWP11/24, Institute for Fiscal Studies.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Paul Hewson & Keming Yu, 2008. "Quantile regression for binary performance indicators," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 24(5), pages 401-418, September.
    2. Bornmann, Lutz & Leydesdorff, Loet & Wang, Jian, 2014. "How to improve the prediction based on citation impact percentiles for years shortly after the publication date?," Journal of Informetrics, Elsevier, vol. 8(1), pages 175-180.
    3. Arpino, Bruno & Varriale, Roberta, 2009. "Assessing the quality of institutions’ rankings obtained through multilevel linear regression models," MPRA Paper 19873, University Library of Munich, Germany.
    4. Domínguez-Torreiro, Marcos & Soliño, Mario, 2011. "Provided and perceived status quo in choice experiments: Implications for valuing the outputs of multifunctional rural areas," Ecological Economics, Elsevier, vol. 70(12), pages 2523-2531.
    5. Daraio, Cinzia & Bonaccorsi, Andrea & Simar, Léopold, 2015. "Rankings and university performance: A conditional multidimensional approach," European Journal of Operational Research, Elsevier, vol. 244(3), pages 918-930.
    6. Tim Goedemé & Karel Van den Bosch & Lina Salanauskaite & Gerlinde Verbist, 2013. "Testing the Statistical Significance of Microsimulation Results: Often Easier than You Think. A Technical Note," ImPRovE Working Papers 13/10, Herman Deleeck Centre for Social Policy, University of Antwerp.
    7. Nils Gutacker & Andrew Street, 2015. "Multidimensional performance assessment using dominance criteria," Working Papers 115cherp, Centre for Health Economics, University of York.
    8. Cristiano Varin & Manuela Cattelan & David Firth, 2016. "Statistical modelling of citation exchange between statistics journals," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 179(1), pages 1-63, January.
    9. Frank Eijkenaar & René C. J. A. van Vliet, 2014. "Performance Profiling in Primary Care," Medical Decision Making, , vol. 34(2), pages 192-205, February.
    10. John Robinson & Scott Zeger & Christopher Forrest, 2004. "A Hierarchical Multivariate Two-Part Model for Profiling Providers' Effects on Healthcare Charges," Johns Hopkins University Dept. of Biostatistics Working Paper Series 1052, Berkeley Electronic Press.
    11. Martini, Gianmaria & Berta, Paolo & Mullahy, John & Vittadini, Giorgio, 2014. "The effectiveness–efficiency trade-off in health care: The case of hospitals in Lombardy, Italy," Regional Science and Urban Economics, Elsevier, vol. 49(C), pages 217-231.
    12. Amy E. Wagler, 2014. "Confidence Intervals for Assessing Heterogeneity in Generalized Linear Mixed Models," Journal of Educational and Behavioral Statistics, , vol. 39(3), pages 167-179, June.
    13. Adnett, Nick & Bougheas, Spiros & Davies, Peter, 2002. "Market-based reforms of public schooling: some unpleasant dynamics," Economics of Education Review, Elsevier, vol. 21(4), pages 323-330, August.
    14. Laura Lindberg & Kathryn Kost & Isaac Maddow-Zimet & Sheila Desai & Mia Zolna, 2020. "Abortion Reporting in the United States: An Assessment of Three National Fertility Surveys," Demography, Springer;Population Association of America (PAA), vol. 57(3), pages 899-925, June.
    15. Francesca Giambona & Mariano Porcu & Isabella Sulis, 2017. "Students Mobility: Assessing the Determinants of Attractiveness Across Competing Territorial Areas," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 133(3), pages 1105-1132, September.
    16. Li Mingliang & Tobias Justin, 2005. "Bayesian Modeling of School Effects Using Hierarchical Models with Smoothing Priors," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 9(3), pages 1-33, September.
    17. Pier Ferrari & Laura Pagani & Carlo Fiorio, 2011. "A Two-Step Approach to Analyze Satisfaction Data," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 104(3), pages 545-554, December.
    18. Yuqing Feng & Jing Wei & Maogui Hu & Chengdong Xu & Tao Li & Jinfeng Wang & Wei Chen, 2022. "Lagged Effects of Exposure to Air Pollutants on the Risk of Pulmonary Tuberculosis in a Highly Polluted Region," IJERPH, MDPI, vol. 19(9), pages 1-13, May.
    19. Park, Minjung & Hunter, Jennifer & Kwon, Soonman, 2018. "Evaluating integrative medicine acute stroke inpatient care in South Korea," Health Policy, Elsevier, vol. 122(4), pages 373-379.
    20. Mathieu Goudard & Michel Lubrano, 2013. "Human Capital, Social Capital And Scientific Research In Europe: An Application Of Linear Hierarchical Models," Manchester School, University of Manchester, vol. 81(6), pages 876-903, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssc:v:69:y:2020:i:3:p:589-606. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.