IDEAS home Printed from https://ideas.repec.org/p/ehl/lserod/88481.html

The analysis of survey data with framing effects

Author

Listed:
  • Goldin, Jacob
  • Reck, Daniel

Abstract

A well-known difficulty in survey research is that respondents’ answers to questions can depend on arbitrary features of a survey’s design, such as the wording of questions or the ordering of answer choices. In this paper, we describe a novel set of tools for analyzing survey data characterized by such framing effects. We show that the conventional approach to analyzing data with framing effects—randomizing survey-takers across frames and pooling the responses—generally does not identify a useful parameter. In its place, we propose an alternative approach and provide conditions under which it identifies the responses that are unaffected by framing. We also present several results for shedding light on the population distribution of the individual characteristic the survey is designed to measure.

Suggested Citation

  • Goldin, Jacob & Reck, Daniel, 2018. "The analysis of survey data with framing effects," LSE Research Online Documents on Economics 88481, London School of Economics and Political Science, LSE Library.
    • Handle: RePEc:ehl:lserod:88481
    as

    Download full text from publisher

    File URL: https://researchonline.lse.ac.uk/id/eprint/88481/
    File Function: Open access version.
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Charles F. Manski, 1989. "Anatomy of the Selection Problem," Journal of Human Resources, University of Wisconsin Press, vol. 24(3), pages 343-360.
    2. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    3. Angus Deaton, 2012. "The financial crisis and the well-being of Americans," Oxford Economic Papers, Oxford University Press, vol. 64(1), pages 1-26, January.
    4. Abadie, Alberto, 2003. "Semiparametric instrumental variable estimation of treatment response models," Journal of Econometrics, Elsevier, vol. 113(2), pages 231-263, April.
    5. Lambdin, Charles & Shaffer, Victoria A., 2009. "Are within-subjects designs transparent?," Judgment and Decision Making, Cambridge University Press, vol. 4(7), pages 554-566, December.
    6. Charles Lambdin & Victoria A. Shaffer, 2009. "Are within-subjects designs transparent?," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 4(7), pages 554-566, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guilhem Bascle, 2008. "Controlling for endogeneity with instrumental variables in strategic management research," Post-Print hal-00576795, HAL.
    2. Mogstad, Magne & Torgovitsky, Alexander, 2024. "Instrumental variables with unobserved heterogeneity in treatment effects," Handbook of Labor Economics,, Elsevier.
    3. Markus Frölich & Martin Huber, 2014. "Treatment Evaluation With Multiple Outcome Periods Under Endogeneity and Attrition," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(508), pages 1697-1711, December.
    4. Pedro H. C. Sant'Anna & Xiaojun Song & Qi Xu, 2022. "Covariate distribution balance via propensity scores," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(6), pages 1093-1120, September.
    5. Guillermo Cruces & Sebastian Galiani, 2003. "Generalizing the Causal Effect of Fertility on Female Labor Supply," Labor and Demography 0310002, University Library of Munich, Germany.
    6. Elizabeth O. Ananat & Guy Michaels, 2008. "The Effect of Marital Breakup on the Income Distribution of Women with Children," Journal of Human Resources, University of Wisconsin Press, vol. 43(3), pages 611-629.
    7. Ygué Patrice Adegbola1 & Baudelaire YF Kouton Bognon & Pélagie M Hessavi, 2020. "Economic Impact Assessment of Improved Maize Adoption on Poverty: Case Study of Four West African Countries," International Journal of Environmental Sciences & Natural Resources, Juniper Publishers Inc., vol. 26(4), pages 134-141, November.
    8. Manuel Arellano & Stéphane Bonhomme, 2017. "Quantile Selection Models With an Application to Understanding Changes in Wage Inequality," Econometrica, Econometric Society, vol. 85, pages 1-28, January.
    9. Gracious M. Diiro & Abdoul G. Sam & David Kraybill, 2017. "Heterogeneous Effects of Maternal Labor Market Participation on the Nutritional Status of Children: Empirical Evidence from Rural India," Child Indicators Research, Springer;The International Society of Child Indicators (ISCI), vol. 10(3), pages 609-632, September.
    10. Adrian Chadi & Matthias Krapf, 2017. "The Protestant Fiscal Ethic: Religious Confession And Euro Skepticism In Germany," Economic Inquiry, Western Economic Association International, vol. 55(4), pages 1813-1832, October.
    11. Sloczynski, Tymon, 2018. "A General Weighted Average Representation of the Ordinary and Two-Stage Least Squares Estimands," IZA Discussion Papers 11866, Institute of Labor Economics (IZA).
    12. Altındağ, Onur & Bakış, Ozan & Rozo, Sandra V., 2020. "Blessing or burden? Impacts of refugees on businesses and the informal economy," Journal of Development Economics, Elsevier, vol. 146(C).
    13. Aassve, Arnstein & Arpino, Bruno, 2008. "Estimation of causal effects of fertility on economic wellbeing: evidence from rural Vietnam," ISER Working Paper Series 2007-27, Institute for Social and Economic Research.
    14. Jing You & Miguel Niño‐Zarazúa, 2019. "The Intergenerational Impact of China's New Rural Pension Scheme," Population and Development Review, The Population Council, Inc., vol. 45(S1), pages 47-95, December.
    15. Markus Frölich & Martin Huber, 2017. "Direct and indirect treatment effects–causal chains and mediation analysis with instrumental variables," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(5), pages 1645-1666, November.
    16. McLaughlin, Joanne Song, 2017. "Does Communist party membership pay? Estimating the economic returns to party membership in the labor market in China," Journal of Comparative Economics, Elsevier, vol. 45(4), pages 963-983.
    17. Yu‐Chang Chen & Haitian Xie, 2022. "Global Representation of the Conditional LATE Model: A Separability Result," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 84(4), pages 789-798, August.
    18. Alexandre Belloni & Victor Chernozhukov & Ivan Fernandez-Val & Christian Hansen, 2013. "Program evaluation with high-dimensional data," CeMMAP working papers CWP77/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    19. Guido W. Imbens, 2022. "Causality in Econometrics: Choice vs Chance," Econometrica, Econometric Society, vol. 90(6), pages 2541-2566, November.
    20. Byeong Yeob Choi, 2024. "Instrumental variable estimation of weighted local average treatment effects," Statistical Papers, Springer, vol. 65(2), pages 737-770, April.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    JEL classification:

    • J1 - Labor and Demographic Economics - - Demographic Economics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ehl:lserod:88481. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: LSERO Manager (email available below). General contact details of provider: https://edirc.repec.org/data/lsepsuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.