IDEAS home Printed from https://ideas.repec.org/p/hal/journl/hal-03355118.html
   My bibliography  Save this paper

Fear of the state in governance surveys? Empirical evidence from African countries

Author

Listed:
  • Thomas Calvo

    (DIAL - Développement, institutions et analyses de long terme, LEDa - Laboratoire d'Economie de Dauphine - IRD - Institut de Recherche pour le Développement - Université Paris Dauphine-PSL - PSL - Université Paris Sciences et Lettres - CNRS - Centre National de la Recherche Scientifique)

  • Mireille Razafindrakoto

    (DIAL - Développement, institutions et analyses de long terme, LEDa - Laboratoire d'Economie de Dauphine - IRD - Institut de Recherche pour le Développement - Université Paris Dauphine-PSL - PSL - Université Paris Sciences et Lettres - CNRS - Centre National de la Recherche Scientifique)

  • François Roubaud

    (DIAL - Développement, institutions et analyses de long terme, LEDa - Laboratoire d'Economie de Dauphine - IRD - Institut de Recherche pour le Développement - Université Paris Dauphine-PSL - PSL - Université Paris Sciences et Lettres - CNRS - Centre National de la Recherche Scientifique)

Abstract

The need to collect data on governance-related issues has been growing since the 1990s. Demand gained momentum in 2015 with the adoption of SDG16 worldwide and Agenda 2063 in Africa. African countries played a key role in the adoption of SDG16 and are now leading the process of collecting harmonised household data on Governance, Peace and Security (GPS). Yet the possibility has recently been raised that sensitive survey data collected by government institutions are potentially biased due to self-censorship by respondents. This paper studies the potential bias in responses to what are seen as sensitive questions, here governance issues, in surveys conducted by public organisations. We compare Afrobarometer (AB) survey data, collected in eight African countries by self-professed independent institutions, with first-hand harmonised GPS survey data collected by National Statistics Offices (NSOs). We identify over 20 similarly worded questions on democracy, trust in institutions and perceived corruption. We first compare responses from AB survey respondents based on who they believe the survey sponsor to be. No systematic response bias is found between respondents who believe the government to be behind the AB survey and those who consider it to be conducted by an independent institution. Our estimations suggest that the observed residual differences are due to a selection bias on the observables, which is mitigated by propensity score matching procedures. The absence of a systematic self-censorship or attenuation bias is further evidenced by means of an experimental design, whereby responses from GPS surveys conducted by NSOs (the treatment) are compared with AB surveys sponsored by reportedly independent bodies. Our results provide evidence, at much higher levels of precision than other existing data sources, of the capacity and legitimacy of government-related organisations to collect data on governance as a matter of national interest and sovereignty.

Suggested Citation

  • Thomas Calvo & Mireille Razafindrakoto & François Roubaud, 2019. "Fear of the state in governance surveys? Empirical evidence from African countries," Post-Print hal-03355118, HAL.
    • Handle: RePEc:hal:journl:hal-03355118
    Note: View the original document on HAL open archive server: https://hal.science/hal-03355118v1
    as

    Download full text from publisher

    File URL: https://hal.science/hal-03355118v1/document
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Angus Deaton, 2010. "Instruments, Randomization, and Learning about Development," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 424-455, June.
    2. Razafindrakoto, Mireille & Roubaud, François, 2010. "Are International Databases on Corruption Reliable? A Comparison of Expert Opinion Surveys and Household Surveys in Sub-Saharan Africa," World Development, Elsevier, vol. 38(8), pages 1057-1069, August.
    3. Peterson, Robert A., 1975. "An experimental investigation of mail-survey responses," Journal of Business Research, Elsevier, vol. 3(3), pages 199-210, July.
    4. Brass, Jennifer N. & Longhofer, Wesley & Robinson, Rachel S. & Schnable, Allison, 2018. "NGOs and international development: A review of thirty-five years of scholarship," World Development, Elsevier, vol. 112(C), pages 136-149.
    5. Calvo, Thomas & Lavallée, Emmanuelle & Razafindrakoto, Mireille & Roubaud, François, 2020. "Fear Not For Man? Armed conflict and social capital in Mali," Journal of Comparative Economics, Elsevier, vol. 48(2), pages 251-276.
    6. Mireille Razafindrakoto & François Roubaud, 2018. "Responding to the SDG16 Measurement Challenge: The Governance, Peace and Security Survey Modules in Africa," Global Policy, London School of Economics and Political Science, vol. 9(3), pages 336-351, September.
    7. Virginie Comblon & Anne-Sophie Robilliard, 2015. "Are female employment statistics more sensitive than male ones to questionnaire design? Evidence from Cameroon, Mali and Senegal," Working Papers DT/2015/22, DIAL (Développement, Institutions et Mondialisation).
    8. United Nations UN, 2015. "Transforming our World: the 2030 Agenda for Sustainable Development," Working Papers id:7559, eSocialSciences.
    9. Fisher, Robert J, 1993. "Social Desirability Bias and the Validity of Indirect Questioning," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 20(2), pages 303-315, September.
    10. Javier Herrera & Mireille Razafindrakoto & François Roubaud, 2007. "Governance, Democracy and Poverty Reduction: Lessons Drawn from Household Surveys in Sub‐Saharan Africa and Latin America," International Statistical Review, International Statistical Institute, vol. 75(1), pages 70-95, April.
    11. Daron Acemoglu & Simon Johnson & James A. Robinson, 2001. "The Colonial Origins of Comparative Development: An Empirical Investigation," American Economic Review, American Economic Association, vol. 91(5), pages 1369-1401, December.
    12. Charles P. Oman & Christiane Arndt, 2006. "Governance Indicators for Development," OECD Development Centre Policy Insights 33, OECD Publishing.
    13. Banks, Nicola & Hulme, David & Edwards, Michael, 2015. "NGOs, States, and Donors Revisited: Still Too Close for Comfort?," World Development, Elsevier, vol. 66(C), pages 707-718.
    14. Richard Williams, 2006. "Generalized ordered logit/partial proportional odds models for ordinal dependent variables," Stata Journal, StataCorp LP, vol. 6(1), pages 58-82, March.
    15. repec:dau:papers:123456789/4352 is not listed on IDEAS
    16. Robert Mattes & Michael Bratton, 2007. "Learning about Democracy in Africa: Awareness, Performance, and Experience," American Journal of Political Science, John Wiley & Sons, vol. 51(1), pages 192-217, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jorge M. Agüero & Veronica Frisancho, 2022. "Measuring Violence against Women with Experimental Methods," Economic Development and Cultural Change, University of Chicago Press, vol. 70(4), pages 1565-1590.
    2. Marc Oliver Rieger & Mei Wang, 2022. "Trust in Government Actions During the COVID-19 Crisis," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 159(3), pages 967-989, February.
    3. Yunus Zengin & Serkan Naktiyok & Erdoğan Kaygın & Onur Kavak & Ethem Topçuoğlu, 2021. "An Investigation upon Industry 4.0 and Society 5.0 within the Context of Sustainable Development Goals," Sustainability, MDPI, vol. 13(5), pages 1-16, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kaufmann, Daniel & Kraay, Aart & Mastruzzi, Massimo, 2007. "The worldwide governance indicators project : answering the critics," Policy Research Working Paper Series 4149, The World Bank.
    2. Mireille Razafindrakoto & François Roubaud, 2018. "Responding to the SDG16 Measurement Challenge: The Governance, Peace and Security Survey Modules in Africa," Global Policy, London School of Economics and Political Science, vol. 9(3), pages 336-351, September.
    3. Mireille Razafindrakoto & François Roubaud, 2015. "The Governance, Peace and Security modules of the Strategy for the Harmonisation of Statistics in Africa (GPS-SHaSA): development of an innovative statistical survey methodology," Working Papers DT/2015/20, DIAL (Développement, Institutions et Mondialisation).
    4. Razafindrakoto, Mireille & Roubaud, François, 2010. "Are International Databases on Corruption Reliable? A Comparison of Expert Opinion Surveys and Household Surveys in Sub-Saharan Africa," World Development, Elsevier, vol. 38(8), pages 1057-1069, August.
    5. Jean-Pierre Cling & Mireille Razafindrakoto & François Roubaud, 2018. "SDG 16 on Governance and its measurement: Africa in the Lead," Working Papers DT/2018/02, DIAL (Développement, Institutions et Mondialisation).
    6. Knack, Steve & Xu, Lixin Colin, 2017. "Unbundling institutions for external finance: Worldwide firm-level evidence," Journal of Corporate Finance, Elsevier, vol. 44(C), pages 215-232.
    7. Mireille Razafindrakoto & François Roubaud & Jean-Michel Wachsberger, 2013. "Institutions, gouvernance et croissance de long terme à Madagascar : l'enigme et le paradoxe," Working Papers DT/2013/13, DIAL (Développement, Institutions et Mondialisation).
    8. Michael Breen & Robert Gillanders, 2012. "Corruption, institutions and regulation," Economics of Governance, Springer, vol. 13(3), pages 263-285, September.
    9. Mare Sarr & Timothy Swanson, 2012. "Corruption and the Curse: The Dictator's choice," CIES Research Paper series 17-2012, Centre for International Environmental Studies, The Graduate Institute.
    10. Hafsa Qaiser & Hafeez ur Rehman & Noman Arshed, 2023. "Role of institutional quality on women's empowerment—A case of highly gender unequal Asian countries," Poverty & Public Policy, John Wiley & Sons, vol. 15(1), pages 48-75, March.
    11. Brendan Whitty & Jessica Sklair & Paul Robert Gilbert & Emma Mawdsley & Jo‐Anna Russon & Olivia Taylor, 2023. "Outsourcing the Business of Development: The Rise of For‐profit Consultancies in the UK Aid Sector," Development and Change, International Institute of Social Studies, vol. 54(4), pages 892-917, July.
    12. Mauricio Cárdenas, 2007. "Economic Growth in Colombia : a reversal of "fortune"?," Revista ESPE - Ensayos sobre Política Económica, Banco de la Republica de Colombia, vol. 25(53), pages 220-259, January.
    13. Dreher, Axel & Kotsogiannis, Christos & McCorriston, Steve, 2007. "Corruption around the world: Evidence from a structural model," Journal of Comparative Economics, Elsevier, vol. 35(3), pages 443-466, September.
    14. Abel Gwaindepi, 2022. "Fiscal capacity in ‘‘responsible government’’ colonies: the Cape Colony in comparative perspective, c. 1865–1910 [The spread of empire: Clio and the measurement of colonial borrowing costs]," European Review of Economic History, European Historical Economics Society, vol. 26(3), pages 340-369.
    15. Daniel Kaufmann & Aart Kraay, 2008. "Governance Indicators: Where Are We, Where Should We Be Going?," The World Bank Research Observer, World Bank, vol. 23(1), pages 1-30, January.
    16. Morck, Randall & Yeung, Bernard, 2011. "Economics, History, and Causation," Business History Review, Cambridge University Press, vol. 85(1), pages 39-63, April.
    17. Nichols, Carly, 2020. "Nutrition sensitive agriculture: An equity-based analysis from India," World Development, Elsevier, vol. 133(C).
    18. Jean Cartier-Bresson, 2013. "Le pouvoir du positivisme et ses limites : microéconométrie et macroéconométrie actuelles du développement," Working Papers hal-00847005, HAL.
    19. Rachel M. Gisselquist, 2013. "Evaluating Governance Indexes: Critical and Less Critical Questions," WIDER Working Paper Series wp-2013-068, World Institute for Development Economic Research (UNU-WIDER).
    20. Svend-Erik Skaaning, 2018. "Different Types of Data and the Validity of Democracy Measures," Politics and Governance, Cogitatio Press, vol. 6(1), pages 105-116.

    More about this item

    Keywords

    Survey sponsor effect; Governance data; Official statistics; SDG16; Africa;
    All these keywords.

    JEL classification:

    • D02 - Microeconomics - - General - - - Institutions: Design, Formation, Operations, and Impact
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • O10 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - General
    • O55 - Economic Development, Innovation, Technological Change, and Growth - - Economywide Country Studies - - - Africa

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:journl:hal-03355118. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.