IDEAS home Printed from https://ideas.repec.org/p/car/carecp/16-10.html
   My bibliography  Save this paper

Response Bias in Voluntary Surveys: An Empirical Analysis of the Canadian Census

Author

Abstract

In 2011, the National Household Survey replaced the traditional Long Form Census in Canada. The questions in the National Household Survey were similar to the Long Form Census, but responding to this survey was no longer mandatory. This paper provides an empirical analysis of the information loss arising from the change to a voluntary response policy. Comparisons of the differences between the non-mandatory 2011 National Household Survey and the 1996, 2001, and 2006 mandatory Long Form Census are used to identify changes related to the response policy. Using two-sample Kolgomov-Smirnov tests, differences in income distributions are tested to find that high income earners are underrepresented in the voluntary survey. This finding is corroborated by comparisons of various inequality measures across these time periods. Differences in discrete variables are tested using differences in proportions and Pearsons chi-squared tests. Systematic misrepresentation of certain groups is found in the voluntary survey. The switch to a voluntary response policy in 2011 likely led to an over representation of women and married individuals.

Suggested Citation

  • Kerry Nield & Ardyn T. Nordstrom, 2016. "Response Bias in Voluntary Surveys: An Empirical Analysis of the Canadian Census," Carleton Economic Papers 16-10, Carleton University, Department of Economics, revised 09 Aug 2016.
    • Handle: RePEc:car:carecp:16-10
    as

    Download full text from publisher

    File URL: http://www.carleton.ca/economics/wp-content/uploads/cep16-10.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ronald R. Rindfuss & Minja K. Choe & Noriko O. Tsuya & Larry L. Bumpass & Emi Tamaki, 2015. "Do low survey response rates bias results? Evidence from Japan," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 32(26), pages 797-828.
    2. Hou, Feng & Picot, Garnett, 2014. "Immigration, Low Income and Income Inequality in Canada: What?s New in the 2000s?," Analytical Studies Branch Research Paper Series 2014364e, Statistics Canada, Analytical Studies Branch.
    3. David A. Green & Kevin Milligan, 2010. "The Importance of the Long Form Census to Canada," Canadian Public Policy, University of Toronto Press, vol. 36(3), pages 383-388, September.
    4. Michael R. Veall, 2010. "2B or Not 2B? What Should Have Happened with the Canadian Long Form Census? What Should Happen Now?," Canadian Public Policy, University of Toronto Press, vol. 36(3), pages 395-399, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pierre Brochu & Till Gross & Christopher Worswick, 2020. "Temporary foreign workers and firms: Theory and Canadian evidence," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 53(3), pages 871-915, August.
    2. Morin, Louis-Philippe, 2015. "Cohort size and youth earnings: Evidence from a quasi-experiment," Labour Economics, Elsevier, vol. 32(C), pages 99-111.
    3. Dilmaghani, Maryam & Dean, Jason, 2020. "Sexual orientation and homeownership in Canada," Journal of Housing Economics, Elsevier, vol. 49(C).
    4. Jean-Yves Duclos & Mathieu Pellerin, 2015. "The Evolution of Hourly Compensation in Canada between 1980 and 2010," CIRANO Working Papers 2015s-15, CIRANO.
    5. Kirsten Barnicot & Rose McCabe & Angeliki Bogosian & Renos Papadopoulos & Mike Crawford & Peter Aitken & Tanja Christensen & Jonathan Wilson & Bonnie Teague & Ravi Rana & Donna Willis & Ryan Barclay &, 2023. "Predictors of Post-Traumatic Growth in a Sample of United Kingdom Mental and Community Healthcare Workers during the COVID-19 Pandemic," IJERPH, MDPI, vol. 20(4), pages 1-20, February.
    6. Nicole S. Bernhardt, 2015. "Racialized Precarious Employment and the Inadequacies of the Canadian Welfare State," SAGE Open, , vol. 5(2), pages 21582440155, April.
    7. Atanu Ghoshray & Issam Malki & Javier Ordóñez, 2022. "On the long-run dynamics of income and wealth inequality," Empirical Economics, Springer, vol. 62(2), pages 375-408, February.
    8. Annabella Ansah & Richard E. Mueller, 2021. "Public and Private Sector Earnings of Immigrants and the Canadian-Born: Evidence from the Labour Force Survey," Journal of International Migration and Integration, Springer, vol. 22(4), pages 1403-1429, December.
    9. Jean-Yves Duclos & Mathieu Pellerin, 2015. "The Evolution of Hourly Compensation in Canada between 1980 and 2010," Cahiers de recherche 1506, Chaire de recherche Industrielle Alliance sur les enjeux économiques des changements démographiques.
    10. Ali Bakdur & Fumito Masui & Michal Ptaszynski, 2021. "Predicting Increase in Demand for Public Buses in University Students Daily Life Needs: Case Study Based on a City in Japan," Sustainability, MDPI, vol. 13(9), pages 1-28, May.
    11. Lotte De Schrijver & Elizaveta Fomenko & Barbara Krahé & Kristien Roelens & Tom Vander Beken & Ines Keygnaert, 2022. "Minority Identity, Othering-Based Stress, and Sexual Violence," IJERPH, MDPI, vol. 19(7), pages 1-19, April.
    12. Reynaud, Arnaud & Lanzanova, Denis & Liquete, Camino & Grizzetti, Bruna, 2017. "Going green? Ex-post valuation of a multipurpose water infrastructure in Northern Italy," Ecosystem Services, Elsevier, vol. 27(PA), pages 70-81.
    13. David Antonio Sánchez-Páez & José Antonio Ortega, 2018. "Adolescent contraceptive use and its effects on fertility," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 38(45), pages 1359-1388.
    14. Rueyling Tzeng & Ming-Chang Tsai, 2020. "Good for the Common Good: Sociotropic Concern and Double Standards toward High- and Low-Skilled Immigrants in Six Wealthy Countries," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 152(2), pages 473-493, November.
    15. Ulrich J Frey & Frauke Pirscher, 2019. "Distinguishing protest responses in contingent valuation: A conceptualization of motivations and attitudes behind them," PLOS ONE, Public Library of Science, vol. 14(1), pages 1-20, January.
    16. Benoit Dostie, 2018. "Polarisation du marché du travail, structure industrielle et croissance économique," CIRANO Project Reports 2018rp-02, CIRANO.
    17. Herberholz, Chantal, 2020. "Risk attitude, time preference and health behaviours in the Bangkok Metropolitan Area," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 87(C).
    18. Turi Reiten Finserås & Børge Sivertsen & Ståle Pallesen & Tony Leino & Rune Aune Mentzoni & Jens Christoffer Skogen, 2022. "Different Typologies of Gamers Are Associated with Mental Health: Are Students DOOMed?," IJERPH, MDPI, vol. 19(22), pages 1-13, November.
    19. Okamoto, Shohei & Avendano, Mauricio & Kawachi, Ichiro, 2019. "Intergenerational income mobility and health in Japan: A quasi-experimental approach," Social Science & Medicine, Elsevier, vol. 230(C), pages 37-48.
    20. Martin Piotrowski & Erik Bond & Ann Beutel, 2020. "Marriage counterfactuals in Japan: Variation by gender, marital status, and time," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 43(37), pages 1081-1118.

    More about this item

    Keywords

    Census; Demographics; Nonresponse Bias;
    All these keywords.

    JEL classification:

    • C42 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Survey Methods
    • D31 - Microeconomics - - Distribution - - - Personal Income and Wealth Distribution
    • J11 - Labor and Demographic Economics - - Demographic Economics - - - Demographic Trends, Macroeconomic Effects, and Forecasts

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:car:carecp:16-10. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Court Lindsay (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.