IDEAS home Printed from https://ideas.repec.org/a/cog/poango/v6y2018i1p105-116.html
   My bibliography  Save this article

Different Types of Data and the Validity of Democracy Measures

Author

Listed:
  • Svend-Erik Skaaning

    (Department of Political Science, Aarhus University, Denmark)

Abstract

Different measures of democracy rely on different types of data. Some exclusively rely on observational data, others rely on judgement-based data in the form of in-house coded indicators or expert surveys. A third set of democracy measures combines information from indicators based on different types of data, some of them also data from representative surveys of the mass public. This article discusses the advantages and disadvantages of these different types of data for the measurement of electoral and liberal democracy. The discussion is based on the premise that the main priorities must be to establish a high degree of concept-measure consistency, i.e. indicators capture relevant aspects of the core concept of interest in a precise and unbiased manner, and to provide high coverage. The basic argument of the article is that no type of data is superior to others in all respects. The article draws on examples from extant datasets to illustrate the tradeoffs and it offers suggestions about how to reduce some of the potential drawbacks.

Suggested Citation

  • Svend-Erik Skaaning, 2018. "Different Types of Data and the Validity of Democracy Measures," Politics and Governance, Cogitatio Press, vol. 6(1), pages 105-116.
    • Handle: RePEc:cog:poango:v:6:y:2018:i:1:p:105-116
    as

    Download full text from publisher

    File URL: https://www.cogitatiopress.com/politicsandgovernance/article/view/1183
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Daniel Kaufmann & Aart Kraay, 2008. "Governance Indicators: Where Are We, Where Should We Be Going?," The World Bank Research Observer, World Bank, vol. 23(1), pages 1-30, January.
    2. Nancy Qian & David Yanagizawa, 2009. "The Strategic Determinants of U.S. Human Rights Reporting: Evidence from The Cold War," Journal of the European Economic Association, MIT Press, vol. 7(2-3), pages 446-457, 04-05.
    3. Adcock, Robert & Collier, David, 2001. "Measurement Validity: A Shared Standard for Qualitative and Quantitative Research," American Political Science Review, Cambridge University Press, vol. 95(3), pages 529-546, September.
    4. Pemstein, Daniel & Meserve, Stephen A. & Melton, James, 2010. "Democratic Compromise: A Latent Variable Analysis of Ten Measures of Regime Type," Political Analysis, Cambridge University Press, vol. 18(4), pages 426-449.
    5. Przeworski,Adam & Alvarez,Michael E. & Cheibub,Jose Antonio & Limongi,Fernando, 2000. "Democracy and Development," Cambridge Books, Cambridge University Press, number 9780521793797.
    6. Herrera, Yoshiko M. & Kapur, Devesh, 2007. "Improving Data Quality: Actors, Incentives, and Capabilities," Political Analysis, Cambridge University Press, vol. 15(4), pages 365-386.
    7. Charles P. Oman & Christiane Arndt, 2006. "Governance Indicators for Development," OECD Development Centre Policy Insights 33, OECD Publishing.
    8. Fariss, Christopher J., 2014. "Respect for Human Rights has Improved Over Time: Modeling the Changing Standard of Accountability," American Political Science Review, Cambridge University Press, vol. 108(2), pages 297-318, May.
    9. Tatu Vanhanen, 2000. "A New Dataset for Measuring Democracy, 1810-1998," Journal of Peace Research, Peace Research Institute Oslo, vol. 37(2), pages 251-265, March.
    10. Przeworski,Adam & Alvarez,Michael E. & Cheibub,Jose Antonio & Limongi,Fernando, 2000. "Democracy and Development," Cambridge Books, Cambridge University Press, number 9780521790321.
    11. Joe Foweraker & Roman Krznaric, 2000. "Measuring Liberal Democratic Performance: an Empirical and Conceptual Critique," Political Studies, Political Studies Association, vol. 48(4), pages 759-787, September.
    12. repec:dau:papers:123456789/4352 is not listed on IDEAS
    13. Razafindrakoto, Mireille & Roubaud, François, 2010. "Are International Databases on Corruption Reliable? A Comparison of Expert Opinion Surveys and Household Surveys in Sub-Saharan Africa," World Development, Elsevier, vol. 38(8), pages 1057-1069, August.
    14. José Cheibub & Jennifer Gandhi & James Vreeland, 2010. "Democracy and dictatorship revisited," Public Choice, Springer, vol. 143(1), pages 67-101, April.
    15. Nils B. Weidmann, 2016. "A Closer Look at Reporting Bias in Conflict Event Data," American Journal of Political Science, John Wiley & Sons, vol. 60(1), pages 206-218, January.
    16. Mayne, Quinton & Geissel, Brigitte, 2016. "Putting the Demos Back Into the Concept of Democratic Quality," Scholarly Articles 25286593, Harvard Kennedy School of Government.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jonathan E. Ogbuabor & Anthony Orji & Charles O. Manasseh & Onyinye I. Anthony-Orji, 2020. "Institutional Quality and Growth in West Africa: What Happened after the Great Recession?," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 26(4), pages 343-361, November.
    2. Sutirtha Bagchi & Matthew J. Fagerstrom, 2023. "Wealth inequality and democracy," Public Choice, Springer, vol. 197(1), pages 89-136, October.
    3. Giebler, Heiko & Ruth, Saskia P. & Tanneberg, Dag, 2018. "Why Choice Matters: Revisiting and Comparing Measures of Democracy," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 6(1), pages 1-10.
    4. Samir Makdisi, 2022. "The Arab region: Development without democracya," Scottish Journal of Political Economy, Scottish Economic Society, vol. 69(1), pages 23-36, February.
    5. Martina Berrocal & Michael Kranert & Paola Attolino & Júlio Antonio Bonatti Santos & Sara Garcia Santamaria & Nancy Henaku & Aimée Danielle Lezou Koffi & Camilla Marziani & Viktorija Mažeikienė & Dasn, 2021. "Constructing collective identities and solidarity in premiers’ early speeches on COVID-19: a global perspective," Palgrave Communications, Palgrave Macmillan, vol. 8(1), pages 1-12, December.
    6. Bruno Arpino & Anastassia V. Obydenkova, 2020. "Democracy and Political Trust Before and After the Great Recession 2008: The European Union and the United Nations," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 148(2), pages 395-415, April.
    7. Rachel M. Gisselquist & Patricia Justino & Andrea Vaccaro, 2024. "Do the principles of effective development co‐operation improve development outcomes? The case for clearer definitions and measurement," Development Policy Review, Overseas Development Institute, vol. 42(1), January.
    8. Vanessa Alexandra Boese & Matthew Charles Wilson, 2023. "Contestation and participation: Concepts, measurement, and inference," International Area Studies Review, Center for International Area Studies, Hankuk University of Foreign Studies, vol. 26(2), pages 89-106, June.
    9. Heiko Giebler & Saskia P. Ruth & Dag Tanneberg, 2018. "Why Choice Matters: Revisiting and Comparing Measures of Democracy," Politics and Governance, Cogitatio Press, vol. 6(1), pages 1-10.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Todd Landman, 2018. "Democracy and Human Rights: Concepts, Measures, and Relationships," Politics and Governance, Cogitatio Press, vol. 6(1), pages 48-59.
    2. Giebler, Heiko & Ruth, Saskia P. & Tanneberg, Dag, 2018. "Why Choice Matters: Revisiting and Comparing Measures of Democracy," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 6(1), pages 1-10.
    3. Heiko Giebler & Saskia P. Ruth & Dag Tanneberg, 2018. "Why Choice Matters: Revisiting and Comparing Measures of Democracy," Politics and Governance, Cogitatio Press, vol. 6(1), pages 1-10.
    4. Alberto Batinti & Joan Costa‐Font & Timothy J. Hatton, 2022. "Voting Up? The Effects of Democracy and Franchise Extension on Human Stature," Economica, London School of Economics and Political Science, vol. 89(353), pages 161-190, January.
    5. Rachel M. Gisselquist, 2012. "Good Governance as a Concept, and Why This Matters for Development Policy," WIDER Working Paper Series wp-2012-030, World Institute for Development Economic Research (UNU-WIDER).
    6. Marta Guerriero, 2019. "Democracy and the Labor Share of Income: A Cross-Country Analysis," ADB Institute Series on Development Economics, in: Gary Fields & Saumik Paul (ed.), Labor Income Share in Asia, chapter 0, pages 151-176, Springer.
    7. Vanessa A Boese, 2019. "How (not) to measure democracy," International Area Studies Review, Center for International Area Studies, Hankuk University of Foreign Studies, vol. 22(2), pages 95-127, June.
    8. Broich, Tobias, 2017. "Do authoritarian regimes receive more Chinese development finance than democratic ones? Empirical evidence for Africa," China Economic Review, Elsevier, vol. 46(C), pages 180-207.
    9. Kammas, Pantelis & Sarantides, Vassilis, 2019. "Do dictatorships redistribute more?," Journal of Comparative Economics, Elsevier, vol. 47(1), pages 176-195.
    10. Espen Geelmuyden Rød & Carl Henrik Knutsen & Håvard Hegre, 2020. "The determinants of democracy: a sensitivity analysis," Public Choice, Springer, vol. 185(1), pages 87-111, October.
    11. repec:unu:wpaper:wp2012-30 is not listed on IDEAS
    12. Christian Bjørnskov & Martin Rode, 2020. "Regime types and regime change: A new dataset on democracy, coups, and political institutions," The Review of International Organizations, Springer, vol. 15(2), pages 531-551, April.
    13. Gisselquist, Rachel M., 2012. "Good Governance as a Concept, and Why This Matters for Development Policy," WIDER Working Paper Series 030, World Institute for Development Economic Research (UNU-WIDER).
    14. Sajad Rahimian, 2021. "The Determinants of Democracy Revisited: An Instrumental Variable Bayesian Model Averaging Approach," Papers 2103.04255, arXiv.org.
    15. Jule Krüger & Ragnhild Nordås, 2020. "A latent variable approach to measuring wartime sexual violence," Journal of Peace Research, Peace Research Institute Oslo, vol. 57(6), pages 728-739, November.
    16. Rose, Richard, 2007. "Evaluating democratic governance: A bottom up approach to European Union enlargement," Discussion Papers, Research Unit: Inequality and Social Integration SP I 2007-201, WZB Berlin Social Science Center.
    17. Gisselquist, Rachel & Niño-Zarazúa, Miguel, 2013. "What can experiments tell us about how to improve governance?," MPRA Paper 49300, University Library of Munich, Germany.
    18. Jennifer Raymond Dresden, 2017. "From combatants to candidates: Electoral competition and the legacy of armed conflict," Conflict Management and Peace Science, Peace Science Society (International), vol. 34(3), pages 240-263, May.
    19. Daron Acemoglu & Suresh Naidu & Pascual Restrepo & James A. Robinson, 2019. "Democracy Does Cause Growth," Journal of Political Economy, University of Chicago Press, vol. 127(1), pages 47-100.
    20. Lewis Davis & Claudia R. Williamson, 2018. "Open Borders for Business? Causes and Consequences of the Regulation of Foreign Entry," Southern Economic Journal, John Wiley & Sons, vol. 85(2), pages 508-536, October.
    21. Axel Dreher & Matthew Gould & Matthew Rablen & James Vreeland, 2014. "The determinants of election to the United Nations Security Council," Public Choice, Springer, vol. 158(1), pages 51-83, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cog:poango:v:6:y:2018:i:1:p:105-116. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: António Vieira (email available below). General contact details of provider: https://www.cogitatiopress.com/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.