IDEAS home Printed from https://ideas.repec.org/a/spr/soinre/v141y2019i1d10.1007_s11205-017-1821-z.html
   My bibliography  Save this article

Measurement Assessment in Cross-Country Comparative Analysis: Rasch Modelling on a Measure of Institutional Quality

Author

Listed:
  • Paola Annoni

    (Directorate General for Regional and Urban Policy)

  • Nicholas Charron

    (University of Gothenburg)

Abstract

The European Quality of Government Index (EQI) is the only measure of institutional quality available at the regional level in the European Union. The index, published in 2010 and again in 2013, is based on an ad-hoc survey that measures three different broad aspects of governance within countries: corruption, impartiality and quality. The EQI is assessed in this paper for the first time by means of Rasch modelling, a popular Item Response Theory method. It is demonstrated that Rasch modelling allows for a wide scope of validity and consistency tests of surveys of this kind. The analysis helped strengthening the survey, and consequently the index, by highlighting areas for improvement that can be applied to future rounds of the EQI survey. For instance, it allowed for testing the questions equivalence across different countries and respondents’ socio-demographic background, the validity and fit of each question’s measurement scale and the internal consistency of the EQI domains of corruption, impartiality and quality. Several of the shortcomings that were highlighted by the Rasch analysis will be addressed in the upcoming round of data collection for the third edition of the EQI. The analysis is then expected to have a positive impact on improving the first measure of quality of government in the European Union regions.

Suggested Citation

  • Paola Annoni & Nicholas Charron, 2019. "Measurement Assessment in Cross-Country Comparative Analysis: Rasch Modelling on a Measure of Institutional Quality," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 31-60, January.
    • Handle: RePEc:spr:soinre:v:141:y:2019:i:1:d:10.1007_s11205-017-1821-z
    DOI: 10.1007/s11205-017-1821-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11205-017-1821-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11205-017-1821-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Andr�s Rodr�guez-Pose & Enrique Garcilazo, 2015. "Quality of Government and the Returns of Investment: Examining the Impact of Cohesion Expenditure in European Regions," Regional Studies, Taylor & Francis Journals, vol. 49(8), pages 1274-1290, August.
    2. Lindqvist, Erik & ÖStling, Robert, 2010. "Political Polarization and the Size of Government," American Political Science Review, Cambridge University Press, vol. 104(3), pages 543-565, August.
    3. Weijters, Bert & Cabooter, Elke & Schillewaert, Niels, 2010. "The effect of rating scale format on response styles: The number of response categories and response category labels," International Journal of Research in Marketing, Elsevier, vol. 27(3), pages 236-247.
    4. Nicholas Charron & Lewis Dijkstra & Victor Lapuente, 2015. "Mapping the Regional Divide in Europe: A Measure for Assessing Quality of Government in 206 European Regions," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 122(2), pages 315-346, June.
    5. Gal Ariely & Eldad Davidov, 2011. "Can we Rate Public Support for Democracy in a Comparable Way? Cross-National Equivalence of Democratic Attitudes in the World Value Survey," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 104(2), pages 271-286, November.
    6. repec:cup:apsrev:v:98:y:2004:i:01:p:191-207_00 is not listed on IDEAS
    7. Henson, Spencer & Blandon, Jose & Cranfield, John, 2010. "Difficulty of healthy eating: A Rasch model approach," Social Science & Medicine, Elsevier, vol. 70(10), pages 1574-1580, May.
    8. Nicholas Charron & Lewis Dijkstra & Victor Lapuente, 2015. "Erratum to: Mapping the Regional Divide in Europe: A Measure for Assessing Quality of Government in 206 European Regions," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 124(3), pages 1059-1059, December.
    9. Paola Annoni & Rainer Brüggemann, 2009. "Exploring Partial Order of European Countries," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 92(3), pages 471-487, July.
    10. Chalmers, R. Philip, 2012. "mirt: A Multidimensional Item Response Theory Package for the R Environment," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(i06).
    11. James E. Foster & Mark McGillivray & Suman Seth, 2013. "Composite Indices: Rank Robustness, Statistical Association, and Redundancy," Econometric Reviews, Taylor & Francis Journals, vol. 32(1), pages 35-56, January.
    12. Justesen, Mogens K. & Bjørnskov, Christian, 2014. "Exploiting the Poor: Bureaucratic Corruption and Poverty in Africa," World Development, Elsevier, vol. 58(C), pages 106-115.
    13. Lars Carlsen & Rainer Bruggemann, 2017. "Fragile State Index: Trends and Developments. A Partial Order Data Analysis," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 133(1), pages 1-14, August.
    14. Vincenzo Mauro & Mario Biggeri & Filomena Maggino, 2018. "Measuring and Monitoring Poverty and Well-Being: A New Approach for the Synthesis of Multidimensionality," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 135(1), pages 75-89, January.
    15. Shawn Treier & Simon Jackman, 2008. "Democracy as a Latent Variable," American Journal of Political Science, John Wiley & Sons, vol. 52(1), pages 201-217, January.
    16. Davidov, Eldad, 2009. "Measurement Equivalence of Nationalism and Constructive Patriotism in the ISSP: 34 Countries in a Comparative Perspective," Political Analysis, Cambridge University Press, vol. 17(1), pages 64-82, January.
    17. Martin, Andrew D. & Quinn, Kevin M., 2002. "Dynamic Ideal Point Estimation via Markov Chain Monte Carlo for the U.S. Supreme Court, 1953–1999," Political Analysis, Cambridge University Press, vol. 10(2), pages 134-153, April.
    18. Guy Moors, 2008. "Exploring the effect of a middle response category on response style in attitude measurement," Quality & Quantity: International Journal of Methodology, Springer, vol. 42(6), pages 779-794, December.
    19. Sendhil Mullainathan & Marianne Bertrand, 2001. "Do People Mean What They Say? Implications for Subjective Survey Data," American Economic Review, American Economic Association, vol. 91(2), pages 67-72, May.
    20. Marco Fattore, 2016. "Partially Ordered Sets and the Measurement of Multidimensional Ordinal Deprivation," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 128(2), pages 835-858, September.
    21. Beugelsdijk, Sjoerd & Klasing, Mariko J., 2016. "Diversity and trust: The role of shared values," Journal of Comparative Economics, Elsevier, vol. 44(3), pages 522-540.
    22. Nicholas Charron & Lewis Dijkstra & Victor Lapuente, 2014. "Regional Governance Matters: Quality of Government within European Union Member States," Regional Studies, Taylor & Francis Journals, vol. 48(1), pages 68-90, January.
    23. Paola Annoni & Dorota Weziak-Bialowolska & Hania Farhan, 2013. "Measuring the impact of the Web: Rasch modelling for survey evaluation," Journal of Applied Statistics, Taylor & Francis Journals, vol. 40(8), pages 1831-1851, August.
    24. Robert Cummins, 1998. "The Second Approximation to an International Standard for Life Satisfaction," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 43(3), pages 307-334, March.
    25. Clinton, Joshua & Jackman, Simon & Rivers, Douglas, 2004. "The Statistical Analysis of Roll Call Data," American Political Science Review, Cambridge University Press, vol. 98(2), pages 355-370, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. T. W. G. Meer & E. Ouattara, 2019. "Putting ‘political’ back in political trust: an IRT test of the unidimensionality and cross-national equivalence of political trust measures," Quality & Quantity: International Journal of Methodology, Springer, vol. 53(6), pages 2983-3002, November.
    2. Joseph Pozsgai-Alvarez & Iván Pastor Sanz, 2021. "Mapping the (anti-)corruption field: key topics and changing trends, 1968–2020," Journal of Computational Social Science, Springer, vol. 4(2), pages 851-881, November.
    3. Nicholas Charron & Paola Annoni, 2021. "What is the Influence of News Media on People’s Perception of Corruption? Parametric and Non-Parametric Approaches," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 153(3), pages 1139-1165, February.
    4. Alice Medioli & Pier Luigi Marchini & Tatiana Mazza, 2024. "The impact of corruption and public governance quality on family firm business strategy," Business Strategy and the Environment, Wiley Blackwell, vol. 33(1), pages 55-69, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrés Rodríguez‐Pose, 2020. "Institutions and the fortunes of territories," Regional Science Policy & Practice, Wiley Blackwell, vol. 12(3), pages 371-386, June.
    2. Andrés Rodríguez-Pose & Vinko Muštra, 2022. "The economic returns of decentralisation: Government quality and the role of space," Environment and Planning A, , vol. 54(8), pages 1604-1622, November.
    3. Javier Barbero & Giovanni Mandras & Ernesto Rodríguez-Crespo & Andrés Rodríguez-Pose, 2021. "Quality of government and regional trade: evidence from European Union regions," Regional Studies, Taylor & Francis Journals, vol. 55(7), pages 1240-1251, July.
    4. Javier Barbero & Martin Christensen & Andrea Conte & Patrizio Lecca & Andrés Rodríguez‐Pose & Simone Salotti, 2023. "Improving Government Quality in the Regions of the EU and its System‐Wide Benefits for Cohesion Policy," Journal of Common Market Studies, Wiley Blackwell, vol. 61(1), pages 38-57, January.
    5. Enrico Bertacchini & Federico Revelli, 2021. "Kalòs kai agathòs? government quality and cultural heritage in the regions of Europe," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 67(2), pages 513-539, October.
    6. Jonathan Muringani, 2022. "Trust as a catalyst for regional growth in a decentralized Europe: The interplay between informal and formal institutions in driving economic growth," Journal of Regional Science, Wiley Blackwell, vol. 62(5), pages 1229-1249, November.
    7. Marina Cavalieri & Calogero Guccio & Domenico Lisi & Ilde Rizzo, 2020. "Does Institutional Quality Matter for Infrastructure Provision? A Non-parametric Analysis for Italian Municipalities," Italian Economic Journal: A Continuation of Rivista Italiana degli Economisti and Giornale degli Economisti, Springer;Società Italiana degli Economisti (Italian Economic Association), vol. 6(3), pages 521-562, November.
    8. Mario Quaranta, 2018. "The Meaning of Democracy to Citizens Across European Countries and the Factors Involved," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 136(3), pages 859-880, April.
    9. Bianchini, Stefano & Llerena, Patrick & Martino, Roberto, 2019. "The impact of R&D subsidies under different institutional frameworks," Structural Change and Economic Dynamics, Elsevier, vol. 50(C), pages 65-78.
    10. Guarini, Giulio & Laureti, Tiziana & Garofalo, Giuseppe, 2020. "Socio-institutional determinants of educational resource efficiency according to the capability approach: An endogenous stochastic frontier analysis," Socio-Economic Planning Sciences, Elsevier, vol. 71(C).
    11. Juan Cándido Gómez‐Gallego & María del Rocío Moreno‐Enguix & María Gómez‐Gallego, 2022. "The relation between the index of economic freedom and good governance with efficiency of the European Structural Funds," Papers in Regional Science, Wiley Blackwell, vol. 101(2), pages 327-349, April.
    12. Ivana Tomankova, 2022. "The EU Structural Funds and trust in politicians: another unwanted outcome?," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 49(2), pages 439-460, May.
    13. Eleonora Cutrini, 2023. "Postcrisis recovery in the regions of Europe: Does institutional quality matter?," Journal of Regional Science, Wiley Blackwell, vol. 63(1), pages 5-29, January.
    14. Sébastien BOURDIN, 2018. "Géographie de la résilience des régions européennes face à la crise (2008-2013)," Region et Developpement, Region et Developpement, LEAD, Universite du Sud - Toulon Var, vol. 48, pages 53-70.
    15. Vinko Muštra & Blanka Šimundić & Zvonimir Kuliš, 2020. "Does innovation matter for regional labour resilience? The case of EU regions," Regional Science Policy & Practice, Wiley Blackwell, vol. 12(5), pages 955-970, October.
    16. Corrado, Germana & Rossetti, Fiammetta, 2018. "Public corruption: A study across regions in Italy," Journal of Policy Modeling, Elsevier, vol. 40(6), pages 1126-1139.
    17. Julia Bachtrögler & Christoph Hammer & Wolf Heinrich Reuter & Florian Schwendinger, 2019. "Guide to the galaxy of EU regional funds recipients: evidence from new data," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 46(1), pages 103-150, February.
    18. Leonardo Salvatore Alaimo & Alberto Arcagni & Marco Fattore & Filomena Maggino, 2021. "Synthesis of Multi-indicator System Over Time: A Poset-based Approach," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 157(1), pages 77-99, August.
    19. Alaimo, Leonardo Salvatore & Ivaldi, Enrico & Landi, Stefano & Maggino, Filomena, 2022. "Measuring and evaluating socio-economic inequality in small areas: An application to the urban units of the Municipality of Genoa," Socio-Economic Planning Sciences, Elsevier, vol. 83(C).
    20. Andrés Rodríguez-Pose & Roberto Ganau, 2022. "Institutions and the productivity challenge for European regions," Journal of Economic Geography, Oxford University Press, vol. 22(1), pages 1-25.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:soinre:v:141:y:2019:i:1:d:10.1007_s11205-017-1821-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.