IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp13350.html
   My bibliography  Save this paper

The CPS Citizenship Question and Survey Refusals: Causal and Semi-Causal Evidence Featuring a Two-Stage Regression Discontinuity Design

Author

Listed:
  • Bernhardt, Robert

    (Federal Reserve Bank of Chicago)

  • Wunnava, Phanindra V.

    (Middlebury College)

Abstract

The unsuccessful attempt to add a citizenship question to the Census has drawn attention to citizenship questions on other surveys. Simultaneously, researchers have noted a recent increase in Current Population Survey non-response. We combine these topics, studying the effect of the CPS citizenship question on refusals. We use the question's sudden introduction in 1994 as a natural experiment and obtain causal estimates via a regression discontinuity design (RDD). In January 1994, we find an immediate and sustained 20-50% jump in refusals. However, this cannot be attributed to the question alone, as numerous other survey characteristics were revised. We employ a two-stage RDD to relate state-specific refusal discontinuities to state characteristics. Discontinuity size is positively related to non-citizen and Hispanic populations, and a proxy for citizenship question item non-response. An 8% increase in refusals is potentially attributable to the question. Moreover, at the threshold, there is weak evidence of a discrete decrease in states' reported Hispanic populations. When non-citizenship is observable, state non-citizen population is positively related with refusals. These results imply the question makes non-citizens and Hispanics reluctant to take the survey. We recommend there be a trial to precisely estimate the question's effects, and decide if it merits continuation.

Suggested Citation

  • Bernhardt, Robert & Wunnava, Phanindra V., 2020. "The CPS Citizenship Question and Survey Refusals: Causal and Semi-Causal Evidence Featuring a Two-Stage Regression Discontinuity Design," IZA Discussion Papers 13350, Institute of Labor Economics (IZA).
  • Handle: RePEc:iza:izadps:dp13350
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp13350.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. J. David Brown & Misty L. Heggeness & Suzanne M. Dorinski & Lawrence Warren & Moises Yi, 2019. "Predicting the Effect of Adding a Citizenship Question to the 2020 Census," Demography, Springer;Population Association of America (PAA), vol. 56(4), pages 1173-1194, August.
    2. Alan B. Krueger & Alexandre Mas & Xiaotong Niu, 2017. "The Evolution of Rotation Group Bias: Will the Real Unemployment Rate Please Stand Up?," The Review of Economics and Statistics, MIT Press, vol. 99(2), pages 258-264, May.
    3. Luc Behaghel & Bruno Crépon & Marc Gurgand & Thomas Le Barbanchon, 2015. "Please Call Again: Correcting Nonresponse Bias in Treatment Effect Models," The Review of Economics and Statistics, MIT Press, vol. 97(5), pages 1070-1080, December.
    4. James D. Bachmeier & Jennifer Van Hook & Frank D. Bean, 2014. "Can We Measure Immigrants' Legal Status? Lessons from Two U.S. Surveys," International Migration Review, Wiley Blackwell, vol. 48(2), pages 538-566, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Catalina Amuedo‐Dorantes & Francisca M. Antman, 2022. "De facto immigration enforcement, ICE raid awareness, and worker engagement," Economic Inquiry, Western Economic Association International, vol. 60(1), pages 373-391, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ori Heffetz & Daniel B. Reeves, 2016. "Difficulty to Reach Respondents and Nonresponse Bias: Evidence from Large Government Surveys," NBER Working Papers 22333, National Bureau of Economic Research, Inc.
    2. Chodorow-Reich, Gabriel & Coglianese, John, 2021. "Projecting unemployment durations: A factor-flows simulation approach with application to the COVID-19 recession," Journal of Public Economics, Elsevier, vol. 197(C).
    3. McGovern, Mark E. & Canning, David & Bärnighausen, Till, 2018. "Accounting for non-response bias using participation incentives and survey design: An application using gift vouchers," Economics Letters, Elsevier, vol. 171(C), pages 239-244.
    4. David McKenzie, 2017. "Identifying and Spurring High-Growth Entrepreneurship: Experimental Evidence from a Business Plan Competition," American Economic Review, American Economic Association, vol. 107(8), pages 2278-2307, August.
    5. Borgschulte, Mark & Cho, Heepyung & Lubotsky, Darren, 2022. "Partisanship and survey refusal," Journal of Economic Behavior & Organization, Elsevier, vol. 200(C), pages 332-357.
    6. Walter Distaso & Rustam Ibragimov & Alexander Semenov & Anton Skrobotov, 2020. "COVID-19: Tail Risk and Predictive Regressions," Papers 2009.02486, arXiv.org, revised Oct 2021.
    7. Hie Joo Ahn & James Hamilton, 2022. "Measuring Labor-Force Participation and the Incidence and Duration of Unemployment," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 44, pages 1-32, April.
    8. Joseph-Simon Görlach, 2023. "Borrowing Constraints and the Dynamics of Return and Repeat Migration," Journal of Labor Economics, University of Chicago Press, vol. 41(1), pages 205-243.
    9. Teresa Molina Millan & Karen Macours, 2017. "Attrition in randomized control trials: Using tracking information to correct bias," NOVAFRICA Working Paper Series wp1702, Universidade Nova de Lisboa, Nova School of Business and Economics, NOVAFRICA.
    10. Heng Chen & Geoffrey Dunbar & Q. Rallye Shen, 2020. "The Mode is the Message: Using Predata as Exclusion Restrictions to Evaluate Survey Design," Advances in Econometrics, in: Essays in Honor of Cheng Hsiao, volume 41, pages 341-357, Emerald Group Publishing Limited.
    11. Gazeaud, Jules & Khan, Nausheen & Mvukiyehe, Eric & Sterck, Olivier, 2023. "With or without him? Experimental evidence on cash grants and gender-sensitive trainings in Tunisia," Journal of Development Economics, Elsevier, vol. 165(C).
    12. Clément de Chaisemartin, 2017. "Tolerating defiance? Local average treatment effects without monotonicity," Quantitative Economics, Econometric Society, vol. 8(2), pages 367-396, July.
    13. Matthew Hall & Kelly Musick & Youngmin Yi, 2019. "Living Arrangements and Household Complexity among Undocumented Immigrants," Population and Development Review, The Population Council, Inc., vol. 45(1), pages 81-101, March.
    14. Ahmed Mushfiq Mobarak & Iffath Sharif & Maheshwor Shrestha, 2023. "Returns to International Migration: Evidence from a Bangladesh-Malaysia Visa Lottery," American Economic Journal: Applied Economics, American Economic Association, vol. 15(4), pages 353-388, October.
    15. Luc Behaghel & Karen Macours & Julie Subervie, 2019. "How can randomised controlled trials help improve the design of the common agricultural policy?," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 46(3), pages 473-493.
    16. J. David Brown & Misty L. Heggeness & Suzanne M. Dorinski & Lawrence Warren & Moises Yi, 2019. "Predicting the Effect of Adding a Citizenship Question to the 2020 Census," Demography, Springer;Population Association of America (PAA), vol. 56(4), pages 1173-1194, August.
    17. Ybarra, Marci & Ha, Yoonsook & Chang, Jina, 2017. "Health insurance coverage and routine health care use among children by family immigration status," Children and Youth Services Review, Elsevier, vol. 79(C), pages 97-106.
    18. Jessica Gallant & Kory Kroft & Fabian Lange & Matthew J. Notowidigdo, 2020. "Temporary Unemployment and Labor Market Dynamics during the COVID-19 Recession," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 51(3 (Fall)), pages 167-226.
    19. Xavier Cirera & Diego A. Comin & Marcio Cruz & Kyung Min Lee, 2020. "Anatomy of Technology in the Firm," NBER Working Papers 28080, National Bureau of Economic Research, Inc.
    20. Possebom, Vitor, 2018. "Sharp bounds on the MTE with sample selection," MPRA Paper 89785, University Library of Munich, Germany.

    More about this item

    Keywords

    current population survey; non-response; survey refusal; citizenship status; immigration; Regression Discontinuity; panel data;
    All these keywords.

    JEL classification:

    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models
    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • J15 - Labor and Demographic Economics - - Demographic Economics - - - Economics of Minorities, Races, Indigenous Peoples, and Immigrants; Non-labor Discrimination

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp13350. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.