IDEAS home Printed from https://ideas.repec.org/a/eee/socmed/v68y2009i2p368-379.html
   My bibliography  Save this article

How reliable are surveys of client satisfaction with healthcare services? Evidence from matched facility and household data in Madagascar

Author

Listed:
  • Glick, Peter

Abstract

Client satisfaction surveys in developing countries are increasingly being promoted as a means of understanding healthcare service quality and the demand for these services. However, concerns have been raised about the reliability of responses in such surveys: for example, 'courtesy bias' may lead clients, especially if interviewed upon exiting clinics, to provide misleadingly favorable responses. This study investigates this and other issues using unusual data from Madagascar in which identical questions about satisfaction with local health care centers were asked in user exit surveys and in a population-based household survey, the latter being less contaminated by courtesy bias as well as changes in provider behavior in response to being observed. The findings suggest that reported satisfaction in exit surveys is biased strongly upward for subjective questions regarding (for example) treatment by staff and consultation quality, but not for relatively objective questions about facility condition and supplies. The surveys do provide useful information on the determinants of consumer satisfaction with various dimensions of provider quality. Still, to obtain reliable estimates of consumer perceptions of health service quality, household-based sampling is strongly preferred.

Suggested Citation

  • Glick, Peter, 2009. "How reliable are surveys of client satisfaction with healthcare services? Evidence from matched facility and household data in Madagascar," Social Science & Medicine, Elsevier, vol. 68(2), pages 368-379, January.
  • Handle: RePEc:eee:socmed:v:68:y:2009:i:2:p:368-379
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0277-9536(08)00517-0
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. David E. Sahn & David Stifel, 2003. "Exploring Alternative Measures of Welfare in the Absence of Expenditure Data," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 49(4), pages 463-489, December.
    2. Leonard, Kenneth L. & Masatu, Melkiory C., 2005. "The use of direct clinician observation and vignettes for health services quality evaluation in developing countries," Social Science & Medicine, Elsevier, vol. 61(9), pages 1944-1951, November.
    3. Leonard, Kenneth L., 2008. "Is patient satisfaction sensitive to changes in the quality of care? An exploitation of the Hawthorne effect," Journal of Health Economics, Elsevier, vol. 27(2), pages 444-459, March.
    4. Hall, Judith A. & Dornan, Michael C., 1990. "Patient sociodemographic characteristics as predictors of satisfaction with medical care: A meta-analysis," Social Science & Medicine, Elsevier, vol. 30(7), pages 811-818, January.
    5. Das, Jishnu & Sohnesen, Thomas Pave, 2006. "Patient satisfaction, doctor effort, and interview location : evidence from Paraguay," Policy Research Working Paper Series 4086, The World Bank.
    6. Avis, Mark & Bond, Meg & Arthur, Antony, 1997. "Questioning patient satisfaction: An empirical investigation in two outpatient clinics," Social Science & Medicine, Elsevier, vol. 44(1), pages 85-92, January.
    7. Leonard, Kenneth & Masatu, Melkiory C., 2006. "Outpatient process quality evaluation and the Hawthorne Effect," Social Science & Medicine, Elsevier, vol. 63(9), pages 2330-2340, November.
    8. Like, Robert & Zyzanski, Stephen J., 1987. "Patient satisfaction with the clinical encounter: Social psychological determinants," Social Science & Medicine, Elsevier, vol. 24(4), pages 351-357, January.
    9. Sitzia, John & Wood, Neil, 1997. "Patient satisfaction: A review of issues and concepts," Social Science & Medicine, Elsevier, vol. 45(12), pages 1829-1843, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. David K. Evans & Anna Welander Tärneberg, 2018. "Health‐care quality and information failure: Evidence from Nigeria," Health Economics, John Wiley & Sons, Ltd., vol. 27(3), pages 90-93, March.
    2. DeVolder, Russell & Serra-Sastre, Victoria & Zamora, Bernarda, 2020. "Examining the variation across acute trusts in patient delayed discharge," Health Policy, Elsevier, vol. 124(11), pages 1226-1232.
    3. Pérotin, Virginie & Zamora, Bernarda & Reeves, Rachel & Bartlett, Will & Allen, Pauline, 2013. "Does hospital ownership affect patient experience? An investigation into public–private sector differences in England," Journal of Health Economics, Elsevier, vol. 32(3), pages 633-646.
    4. Trani, Jean-Francois & Bakhshi, Parul & Noor, Ayan A. & Lopez, Dominique & Mashkoor, Ashraf, 2010. "Poverty, vulnerability, and provision of healthcare in Afghanistan," Social Science & Medicine, Elsevier, vol. 70(11), pages 1745-1755, June.
    5. Evan D Peet & Edward N Okeke, 2019. "Utilization and quality: How the quality of care influences demand for obstetric care in Nigeria," PLOS ONE, Public Library of Science, vol. 14(2), pages 1-18, February.
    6. Mitchell, Ellen M.H. & Kwizera, Amata & Usta, Momade & Gebreselassie, Hailemichael, 2010. "Choosing early pregnancy termination methods in Urban Mozambique," Social Science & Medicine, Elsevier, vol. 71(1), pages 62-70, July.
    7. Thor-Erik Hanssen, 2012. "The influence of interview location on the value of travel time savings," Transportation, Springer, vol. 39(6), pages 1133-1145, November.
    8. Bromley, Elizabeth, 2012. "Building patient-centeredness: Hospital design as an interpretive act," Social Science & Medicine, Elsevier, vol. 75(6), pages 1057-1066.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hekkert, Karin Dorieke & Cihangir, Sezgin & Kleefstra, Sophia Martine & van den Berg, Bernard & Kool, Rudolf Bertijn, 2009. "Patient satisfaction revisited: A multilevel approach," Social Science & Medicine, Elsevier, vol. 69(1), pages 68-75, July.
    2. Leonard, Kenneth L. & Masatu, Melkiory C., 2010. "Using the Hawthorne effect to examine the gap between a doctor's best possible practice and actual performance," Journal of Development Economics, Elsevier, vol. 93(2), pages 226-234, November.
    3. Jishnu Das & Jeffrey Hammer & Kenneth Leonard, 2008. "The Quality of Medical Advice in Low-Income Countries," Journal of Economic Perspectives, American Economic Association, vol. 22(2), pages 93-114, Spring.
    4. Leonard, Kenneth L., 2008. "Is patient satisfaction sensitive to changes in the quality of care? An exploitation of the Hawthorne effect," Journal of Health Economics, Elsevier, vol. 27(2), pages 444-459, March.
    5. Hyojung Tak & Gregory Ruhnke & Ya-Chen Shih, 2015. "The Association between Patient-Centered Attributes of Care and Patient Satisfaction," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 8(2), pages 187-197, April.
    6. Lannes, Laurence, 2015. "Improving health worker performance: The patient-perspective from a PBF program in Rwanda," Social Science & Medicine, Elsevier, vol. 138(C), pages 1-11.
    7. Atkinson, Sarah & Medeiros, Regianne L., 2009. "Explanatory models of influences on the construction and expression of user satisfaction," Social Science & Medicine, Elsevier, vol. 68(11), pages 2089-2096, June.
    8. Fuhai Hong & Tanjim Hossain & John A. List & Migiwa Tanaka, 2018. "Testing The Theory Of Multitasking: Evidence From A Natural Field Experiment In Chinese Factories," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 59(2), pages 511-536, May.
    9. Costa-Font, Joan & Ferrer-i-Carbonell, Ada, 2022. "Does devolution influence the choice and quality of public (vs private) health care?," Journal of Economic Behavior & Organization, Elsevier, vol. 202(C), pages 632-653.
    10. Radin, Dagmar, 2013. "Does corruption undermine trust in health care? Results from public opinion polls in Croatia," Social Science & Medicine, Elsevier, vol. 98(C), pages 46-53.
    11. Leonard, Kenneth L., 2009. "The cost of imperfect agency in health care: Evidence from rural Cameroun," Journal of Development Economics, Elsevier, vol. 88(2), pages 282-291, March.
    12. David K. Evans & Anna Welander Tärneberg, 2018. "Health‐care quality and information failure: Evidence from Nigeria," Health Economics, John Wiley & Sons, Ltd., vol. 27(3), pages 90-93, March.
    13. World Bank & Oxford Policy Management, 2015. "Health Worker Survey in Timor-Leste," World Bank Publications - Reports 23879, The World Bank Group.
    14. Eduardo Fe & Timothy Powell‐Jackson & Winnie Yip, 2017. "Doctor Competence and the Demand for Healthcare: Evidence from Rural China," Health Economics, John Wiley & Sons, Ltd., vol. 26(10), pages 1177-1190, October.
    15. Joan Costa-Font & Ada Ferrer-i-Carbonell, 2019. "Regional Decentralisation and the Demand for Public Health Care," Studies on the Spanish Economy eee2019-41, FEDEA.
    16. Banuri, Sheheryar & de Walque, Damien & Keefer, Philip & Haidara, Ousmane Diadie & Robyn, Paul Jacob & Ye, Maurice, 2018. "The use of video vignettes to measure health worker knowledge. Evidence from Burkina Faso," Social Science & Medicine, Elsevier, vol. 213(C), pages 173-180.
    17. Rosen, Per & Anell, Anders & Hjortsberg, Catharina, 2001. "Patient views on choice and participation in primary health care," Health Policy, Elsevier, vol. 55(2), pages 121-128, February.
    18. Aida Isabel Tavares & Pedro Lopes Ferreira, 2020. "Public satisfaction with health system coverage, empirical evidence from SHARE data," International Journal of Health Economics and Management, Springer, vol. 20(3), pages 229-249, September.
    19. Leonard, Kenneth L. & Masatu, Melkiory C., 2008. "Moving from the lab to the field: Exploring scrutiny and duration effects in lab experiments," Economics Letters, Elsevier, vol. 100(2), pages 284-287, August.
    20. Smaranda Adina Cosma & Marius Bota & Cristina Fleșeriu & Claudiu Morgovan & Mădălina Văleanu & Dan Cosma, 2020. "Measuring Patients’ Perception and Satisfaction with the Romanian Healthcare System," Sustainability, MDPI, vol. 12(4), pages 1-16, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:socmed:v:68:y:2009:i:2:p:368-379. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/315/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.