Improving the Quality of Data and Impact-Evaluation Studies in Developing Countries
AbstractWhile the science of program evaluation has come a tremendous distance in the past couple of decades, measurement error remains a serious concern and its implications are often poorly understood by both data collectors and data analysts. The primary aim here is to offer a type of "back-to-basics" approach to minimizing error in developing country settings, particularly in relation to impactevaluation studies. Overall, the report calls for a two-stage approach to dealing with mismeasurement. In the first stage, researchers should attempt to minimize mismeasurement during data collection, but also incorporate elements into the study that allow them to estimate its overall dimensions and effects on analysis with more confidence. Econometric fixes for mismeasurement¿whose purview is limited to a smaller subset of errors¿then serve as a secondary line of defense. Such a complementary strategy can help to ensure that decisions are made based on the most accurate empirical evaluations.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Inter-American Development Bank in its series IDB Publications with number 8468.
Date of creation: May 2010
Date of revision:
Environment & Natural Resources; Poverty; Social Development; development effectiveness; impact evaluation; randomization; survey design; measurement error; evaluation design; evaluation process; approaches to error; bias and variance; survey nonresponse problems; mismeasurement effects; survey administration;
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Bound, John & Brown, Charles & Mathiowetz, Nancy, 2001. "Measurement error in survey data," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 59, pages 3705-3843 Elsevier.
- Guy Stecklov & Paul Winters & Marco Stampini & Benjamin Davis, 2005. "Do conditional cash transfers influence migration? A study using experimental data from the Mexican progresa program," Demography, Springer, vol. 42(4), pages 769-790, November.
- Gneezy, U. & Rustichini, A., 1998.
"Pay Enough - Or Don't Pay at All,"
1998-57, Tilburg University, Center for Economic Research.
- Meijer, Erik & Wansbeek, Tom, 2000.
"Measurement error in a single regressor,"
Elsevier, vol. 69(3), pages 277-284, December.
- Robert Ferber & Seymore Sudman, 1974. "Effects of Compensation in Consumer Expenditure Studies," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 3, number 2, pages 21-34 National Bureau of Economic Research, Inc.
- Geert Ridder & Yingyao Hu, 2004. "Estimation of Nonlinear Models with Measurement Error Using Marginal Information," Econometric Society 2004 North American Summer Meetings 21, Econometric Society.
- Griliches, Zvi & Hausman, Jerry A., 1986.
"Errors in variables in panel data,"
Journal of Econometrics,
Elsevier, vol. 31(1), pages 93-118, February.
- Manuela Angelucci & Giacomo De Giorgi, 2009. "Indirect Effects of an Aid Program: How Do Cash Transfers Affect Ineligibles' Consumption?," American Economic Review, American Economic Association, vol. 99(1), pages 486-508, March.
- Heckman, James J, 1979.
"Sample Selection Bias as a Specification Error,"
Econometric Society, vol. 47(1), pages 153-61, January.
- Jerry Hausman, 2001. "Mismeasured Variables in Econometric Analysis: Problems from the Right and Problems from the Left," Journal of Economic Perspectives, American Economic Association, vol. 15(4), pages 57-67, Fall.
- FFF1Simona NNN1Bignami-Van Assche & FFF2Georges NNN2Reniers & FFF2Alexander A. NNN2Weinreb, 2003. "An Assessment of the KDICP and MDICP Data Quality," Demographic Research Special Collections, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 1(2), pages 31-76, September.
- Grosh, Margaret E & Glewwe, Paul, 1996. "Household Survey Data from Developing Countries: Progress and Prospects," American Economic Review, American Economic Association, vol. 86(2), pages 15-19, May.
- Yingyao Hu & Susanne M. Schennach, 2008. "Instrumental Variable Treatment of Nonclassical Measurement Error Models," Econometrica, Econometric Society, vol. 76(1), pages 195-216, 01.
- Ai, Chunrong & Norton, Edward C., 2003. "Interaction terms in logit and probit models," Economics Letters, Elsevier, vol. 80(1), pages 123-129, July.
- Susanne M. Schennach, 2004. "Estimation of Nonlinear Models with Measurement Error," Econometrica, Econometric Society, vol. 72(1), pages 33-75, 01.
- Skoufias, Emmanuel & Davis, Benjamin & de la Vega, Sergio, 2001. "Targeting the Poor in Mexico: An Evaluation of the Selection of Households into PROGRESA," World Development, Elsevier, vol. 29(10), pages 1769-1784, October.
- Skoufias, Emmanuel, 2005. "PROGRESA and its impacts on the welfare of rural households in Mexico:," Research reports 139, International Food Policy Research Institute (IFPRI).
- Alexander Weinreb & Mariano Sana, 2009. "The Effects of Questionnaire Translation on Demographic Data and Analysis," Population Research and Policy Review, Springer, vol. 28(4), pages 429-454, August.
- Paul Winters & Lina Salazar & Alessandro Maffioli, 2010.
"Designing Impact Evaluations for Agricultural Projects,"
SPD Working Papers
1007, Inter-American Development Bank, Office of Strategic Planning and Development Effectiveness (SPD).
- Paul Winters & Lina Salazar & Alessandro Maffioli, 2010. "Designing Impact Evaluations for Agricultural Projects," IDB Publications 8378, Inter-American Development Bank.
- González-Flores, Mario & Heracleous, Maria & Winters, Paul, 2012. "Leaving the Safety Net: An Analysis of Dropouts in an Urban Conditional Cash Transfer Program," World Development, Elsevier, vol. 40(12), pages 2505-2521.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Luis Daniel Martinez).
If references are entirely missing, you can add them using this form.