IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/27678.html
   My bibliography  Save this paper

Data and Policy Decisions: Experimental Evidence from Pakistan

Author

Listed:
  • Michael Callen
  • Saad Gulzar
  • Syed Ali Hasanain
  • Muhammad Yasir Khan
  • Arman B. Rezaee

Abstract

We evaluate a program in Pakistan that equips government health inspectors with a smartphone app which channels data on rural clinics to senior policy makers. The system led to rural clinics being inspected 104% more often after 6 months, but only 43.8% more often after a year, with the latter estimate not attaining significance at conventional levels. There is also no clear evidence that the increase in inspections led to increases in general staff attendance. In addition, we test whether senior officials act on the information provided by the system. Focusing only on districts where the app is deployed, we find that highlighting poorly performing facilities on a dashboard viewed by supervisors raises doctor attendance by 75%. Our results indicate that technology may be able to mobilize data to useful effect, even in low capacity settings

Suggested Citation

  • Michael Callen & Saad Gulzar & Syed Ali Hasanain & Muhammad Yasir Khan & Arman B. Rezaee, 2020. "Data and Policy Decisions: Experimental Evidence from Pakistan," NBER Working Papers 27678, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:27678
    Note: DEV POL
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w27678.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Jonas Hjort & Diana Moreira & Gautam Rao & Juan Francisco Santini, 2021. "How Research Affects Policy: Experimental Evidence from 2,150 Brazilian Municipalities," American Economic Review, American Economic Association, vol. 111(5), pages 1442-1480, May.
    2. Nazmul Chaudhury & Jeffrey Hammer & Michael Kremer & Karthik Muralidharan & F. Halsey Rogers, 2006. "Missing in Action: Teacher and Health Worker Absence in Developing Countries," Journal of Economic Perspectives, American Economic Association, vol. 20(1), pages 91-116, Winter.
    3. Abhijit Banerjee & Esther Duflo, 2006. "Addressing Absence," Journal of Economic Perspectives, American Economic Association, vol. 20(1), pages 117-132, Winter.
    4. Callen, Michael & Long, James D., 2015. "Institutional corruption and election fraud: evidence from a field experiment in Afghanistan," LSE Research Online Documents on Economics 102931, London School of Economics and Political Science, LSE Library.
    5. Sebastian Calonico & Matias D. Cattaneo & Rocio Titiunik, 2014. "Robust data-driven inference in the regression-discontinuity design," Stata Journal, StataCorp LP, vol. 14(4), pages 909-946, December.
    6. Esther Duflo & Rema Hanna & Stephen P. Ryan, 2012. "Incentives Work: Getting Teachers to Come to School," American Economic Review, American Economic Association, vol. 102(4), pages 1241-1278, June.
    7. Ernesto Dal Bó & Frederico Finan & Martín A. Rossi, 2013. "Strengthening State Capabilities: The Role of Financial Incentives in the Call to Public Service," The Quarterly Journal of Economics, Oxford University Press, vol. 128(3), pages 1169-1218.
    8. Imran Rasul & Daniel Rogger, 2018. "Management of Bureaucrats and Public Service Delivery: Evidence from the Nigerian Civil Service," Economic Journal, Royal Economic Society, vol. 128(608), pages 413-446, February.
    9. Callen, Michael & Gibson, Clark C. & Jung, Danielle F. & Long, James D., 2016. "Improving Electoral Integrity with Information and Communications Technology," Journal of Experimental Political Science, Cambridge University Press, vol. 3(1), pages 4-17, April.
    10. Karthik Muralidharan & Paul Niehaus & Sandip Sukhtankar, 2020. "Identity Verification Standards in Welfare Programs: Experimental Evidence from India," NBER Working Papers 26744, National Bureau of Economic Research, Inc.
    11. Karthik Muralidharan & Paul Niehaus & Sandip Sukhtankar, 2016. "Building State Capacity: Evidence from Biometric Smartcards in India," American Economic Review, American Economic Association, vol. 106(10), pages 2895-2929, October.
    12. Michael Callen & James D. Long, 2015. "Institutional Corruption and Election Fraud: Evidence from a Field Experiment in Afghanistan," American Economic Review, American Economic Association, vol. 105(1), pages 354-381, January.
    13. Karthik Muralidharan & Paul Niehaus, 2017. "Experimentation at Scale," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 103-124, Fall.
    14. Adnan Q. Khan & Asim I. Khwaja & Benjamin A. Olken, 2016. "Tax Farming Redux: Experimental Evidence on Performance Pay for Tax Collectors," The Quarterly Journal of Economics, Oxford University Press, vol. 131(1), pages 219-271.
    15. Imran Rasul & Daniel Rogger, 2018. "Management of Bureaucrats and Public Service Delivery: Evidence from the Nigerian Civil Service," Economic Journal, Royal Economic Society, vol. 128(608), pages 413-446, February.
    16. Ashraf, Nava & Bandiera, Oriana & Jack, B. Kelsey, 2014. "No margin, no mission? A field experiment on incentives for public service delivery," Journal of Public Economics, Elsevier, vol. 120(C), pages 1-17.
    17. Abhijit V. Banerjee & Esther Duflo & Rachel Glennerster, 2008. "Putting a Band-Aid on a Corpse: Incentives for Nurses in the Indian Public Health Care System," Journal of the European Economic Association, MIT Press, vol. 6(2-3), pages 487-500, 04-05.
    18. Gulzar, Saad & Pasquale, Benjamin J., 2017. "Politicians, Bureaucrats, and Development: Evidence from India," American Political Science Review, Cambridge University Press, vol. 111(1), pages 162-183, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kalaj, Jozefina & Rogger, Daniel & Somani, Ravi, 2022. "Bureaucrat time-use: Evidence from a survey experiment," World Development, Elsevier, vol. 152(C).
    2. Andrew Dustan & Juan Manuel Hernandez-Agramonte & Stanislao Maldonado, 2018. "Motivating bureaucrats with non-monetary incentives when state capacity is weak: Evidence from large-scale," Natural Field Experiments 00664, The Field Experiments Website.
    3. Sultan Mehmood, 2020. "Judicial Independence and Development: Evidence from Pakistan," Working Papers halshs-03054106, HAL.
    4. Sultan Mehmood, 2021. "The impact of Presidential appointment of judges: Montesquieu or the Federalists?," Working Papers halshs-03161933, HAL.
    5. Karthik Muralidharan & Paul Niehaus & Sandip Sukhtankar & Jeffrey Weaver, 2021. "Improving Last-Mile Service Delivery Using Phone-Based Monitoring," American Economic Journal: Applied Economics, American Economic Association, vol. 13(2), pages 52-82, April.
    6. Donna Harris & Oana Borcan & Danila Serra & Henry Telli & Bruno Schettini & Stefan Dercon, 2022. "Proud to belong: The impact of ethics training on police officers," CSAE Working Paper Series 2022-05, Centre for the Study of African Economies, University of Oxford.
    7. Ernesto Dal Bó & Frederico Finan & Nicholas Y. Li & Laura Schechter, 2021. "Information Technology and Government Decentralization: Experimental Evidence From Paraguay," Econometrica, Econometric Society, vol. 89(2), pages 677-701, March.
    8. Dustan, Andrew & Maldonado, Stanislao & Hernandez-Agramonte, Juan Manuel, 2018. "Motivating bureaucrats with non-monetary incentives when state capacity is weak: Evidence from large-scale field experiments in Peru," MPRA Paper 90952, University Library of Munich, Germany.
    9. Sultan Mehmood, 2020. "Judicial Independence and Development: Evidence from Pakistan," AMSE Working Papers 2041, Aix-Marseille School of Economics, France.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Frederico Finan & Benjamin A. Olken & Rohini Pande, 2015. "The Personnel Economics of the State," NBER Working Papers 21825, National Bureau of Economic Research, Inc.
    2. Andrew Dustan & Stanislao Maldonado & Juan Manuel Hernandez-Agramonte, 2018. "Motivating bureaucrats with non-monetary incentives when state capacity is weak: Evidence from large-scale field experiments in Peru," Working Papers 136, Peruvian Economic Association.
    3. Michael Callen & Saad Gulzar & Syed Ali Hasanain & Muhammad Yasir Khan, 2016. "The Political Economy of Public Sector Absence: Experimental Evidence from Pakistan," NBER Working Papers 22340, National Bureau of Economic Research, Inc.
    4. Andrew Dustan & Juan Manuel Hernandez-Agramonte & Stanislao Maldonado, 2018. "Motivating bureaucrats with non-monetary incentives when state capacity is weak: Evidence from large-scale," Natural Field Experiments 00664, The Field Experiments Website.
    5. Andreoni, James & Callen, Michael & Hussain Jaffar, Karrar & Khan, Muhammad Yasir & Sprenger, Charles, 2016. "Using Preference Estimates to Customize Incentives: An Application to Polio Vaccination Drives in Pakistan," CEPR Discussion Papers 11137, C.E.P.R. Discussion Papers.
    6. Oriana Bandiera & Michael Carlos Best & Adnan Qadir Khan & Andrea Prat, 2021. "The Allocation of Authority in Organizations: A Field Experiment with Bureaucrats," The Quarterly Journal of Economics, Oxford University Press, vol. 136(4), pages 2195-2242.
    7. James Andreoni & Michael Callen & Muhammad Karrar Hussain & Muhammad Yasir Khan & Charles Sprenger, 2017. "Creating Investment Scheme with State Space Modeling ," CIRJE F-Series CIRJE-F-1039, CIRJE, Faculty of Economics, University of Tokyo.
    8. Benjamin A. Olken, 2020. "Banerjee, Duflo, Kremer, and the Rise of Modern Development Economics," Scandinavian Journal of Economics, Wiley Blackwell, vol. 122(3), pages 853-878, July.
    9. Amodio, Francesco & Choi, Jieun & De Giorgi, Giacomo & Rahman, Aminur, 2022. "Bribes vs. taxes: Market structure and incentives," Journal of Comparative Economics, Elsevier, vol. 50(2), pages 435-453.
    10. Dizon-Ross, Rebecca & Dupas, Pascaline & Robinson, Jonathan, 2017. "Governance and the effectiveness of public health subsidies: Evidence from Ghana, Kenya and Uganda," Journal of Public Economics, Elsevier, vol. 156(C), pages 150-169.
    11. Donna Harris & Oana Borcan & Danila Serra & Henry Telli & Bruno Schettini & Stefan Dercon, 2022. "Proud to belong: The impact of ethics training on police officers," CSAE Working Paper Series 2022-05, Centre for the Study of African Economies, University of Oxford.
    12. Berry, James & Mehta, Saurabh & Mukherjee, Priya & Ruebeck, Hannah & Shastry, Gauri Kartini, 2020. "Implementation and effects of India's national school-based iron supplementation program," Journal of Development Economics, Elsevier, vol. 144(C).
    13. Ruben Enikolopov, 2011. "Are Bureaucrats Really Paid Like Bureaucrats?," Working Papers w0165, Center for Economic and Financial Research (CEFIR).
    14. Abhijit Banerjee & Esther Duflo & Clément Imbert & Santhosh Mathew & Rohini Pande, 2020. "E-governance, Accountability, and Leakage in Public Programs: Experimental Evidence from a Financial Management Reform in India," American Economic Journal: Applied Economics, American Economic Association, vol. 12(4), pages 39-72, October.
    15. Clare Leaver & Owen Ozier & Pieter Serneels & Andrew Zeitlin, 2021. "Recruitment, Effort, and Retention Effects of Performance Contracts for Civil Servants: Experimental Evidence from Rwandan Primary Schools," American Economic Review, American Economic Association, vol. 111(7), pages 2213-2246, July.
    16. Nicholas Barton & Tessa Bold & Justin Sandefur, 2017. "Measuring Rents from Public Employment: Regression Discontinuity Evidence from Kenya - Working Paper 457," Working Papers 457, Center for Global Development.
    17. Berlinski, Samuel & Ramos, Alejandra, 2020. "Teacher mobility and merit pay: Evidence from a voluntary public award program," Journal of Public Economics, Elsevier, vol. 186(C).
    18. Karthik Muralidharan & Paul Niehaus, 2017. "Experimentation at Scale," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 103-124, Fall.
    19. Valsecchi, Michele, 2016. "Corrupt Bureaucrats: The Response of Non-Elected Officials to Electoral Accountability," Working Papers in Economics 684, University of Gothenburg, Department of Economics.
    20. Barton, Nicholas & Bold, Tessa & Sandefur, Justin, 2017. "Measuring Rents from Public Employment: Regression discontinuity evidence from Kenya," CEPR Discussion Papers 12105, C.E.P.R. Discussion Papers.

    More about this item

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • D02 - Microeconomics - - General - - - Institutions: Design, Formation, Operations, and Impact
    • D73 - Microeconomics - - Analysis of Collective Decision-Making - - - Bureaucracy; Administrative Processes in Public Organizations; Corruption
    • K42 - Law and Economics - - Legal Procedure, the Legal System, and Illegal Behavior - - - Illegal Behavior and the Enforcement of Law
    • O17 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Formal and Informal Sectors; Shadow Economy; Institutional Arrangements

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:27678. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.