IDEAS home Printed from https://ideas.repec.org/p/ets/wpaper/3.html
   My bibliography  Save this paper

Sensitive Questions in Online Surveys: Experimental Results for the Randomized Response Technique (RRT) and the Unmatched Count Technique (UCT)

Author

Listed:
  • Elisabeth Coutts
  • Ben Jann

Abstract

Gaining valid answers to so-called sensitive questions is an age-old problem in survey research. Various techniques have been developed to guarantee anonymity and minimize the respondent's feelings of jeopardy. Two such techniques are the randomized response technique (RRT) and the unmatched count technique (UCT). In this study we evaluate the effectiveness of different implementations of the RRT (using a forced-response design) in a computer-assisted setting and also compare the use of the RRT to that of the UCT. The techniques are evaluated according to various quality criteria, such as the prevalence estimates they provide, the ease of their use, and respondent trust in the techniques. Our results indicate that the RRTs are problematic with respect to several domains, such as the limited trust they inspire and non-response, and that the RRT estimates are unreliable due to a strong false "no" bias, especially for the more sensitive questions. The UCT, however, performed well compared to the RRTs on all the evaluated measures. The UCT estimates also had more face validity than the RRT estimates. We conclude that the UCT is a promising alternative to RRT in self-administered surveys and that future research should be directed towards evaluating and improving the technique.

Suggested Citation

  • Elisabeth Coutts & Ben Jann, 2008. "Sensitive Questions in Online Surveys: Experimental Results for the Randomized Response Technique (RRT) and the Unmatched Count Technique (UCT)," ETH Zurich Sociology Working Papers 3, ETH Zurich, Chair of Sociology.
    • Handle: RePEc:ets:wpaper:3
    as

    Download full text from publisher

    File URL: http://repec.ethz.ch/ets/papers/coutts_jann_online_rrt.pdf
    File Function: First version, 2008
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Andrei Postoaca, 2006. "The Anonymous Elect," Springer Books, Springer, number 978-3-540-29030-8, June.
    2. Gerty J. L. M. Lensvelt‐Mulders & Peter G. M. Van Der Heijden & Olav Laudy & Ger Van Gils, 2006. "A validation of a computer‐assisted randomized response survey to estimate the prevalence of fraud in social security," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 169(2), pages 305-318, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. van den Hout, Ardo & van der Heijden, Peter G.M. & Gilchrist, Robert, 2007. "The logistic regression model with response variables subject to randomized response," Computational Statistics & Data Analysis, Elsevier, vol. 51(12), pages 6060-6069, August.
    2. Maarten J. L. F. Cruyff & Ardo van den Hout & Peter G. M. van der Heijden & Ulf Böckenholt, 2007. "Log-Linear Randomized-Response Models Taking Self-Protective Response Behavior Into Account," Sociological Methods & Research, , vol. 36(2), pages 266-282, November.
    3. Heiko Groenitz, 2015. "Using prior information in privacy-protecting survey designs for categorical sensitive variables," Statistical Papers, Springer, vol. 56(1), pages 167-189, February.
    4. Mühlböck Monika & Steiber Nadia & Kittel Bernhard, 2017. "Less Supervision, More Satisficing? Comparing Completely Self-Administered Web-Surveys and Interviews Under Controlled Conditions," Statistics, Politics and Policy, De Gruyter, vol. 8(1), pages 13-28, October.
    5. Truong-Nhat Le & Shen-Ming Lee & Phuoc-Loc Tran & Chin-Shang Li, 2023. "Randomized Response Techniques: A Systematic Review from the Pioneering Work of Warner (1965) to the Present," Mathematics, MDPI, vol. 11(7), pages 1-26, April.
    6. Ulf Böckenholt & Peter van der Heijden, 2007. "Item Randomized-Response Models for Measuring Noncompliance: Risk-Return Perceptions, Social Influences, and Self-Protective Responses," Psychometrika, Springer;The Psychometric Society, vol. 72(2), pages 245-262, June.
    7. María del Mar García Rueda & Pier Francesco Perri & Beatriz Rodríguez Cobo, 2018. "Advances in estimation by the item sum technique using auxiliary information in complex surveys," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 102(3), pages 455-478, July.
    8. Sabrina Giordano & Pier Perri, 2012. "Efficiency comparison of unrelated question models based on same privacy protection degree," Statistical Papers, Springer, vol. 53(4), pages 987-999, November.
    9. Andreas Quatember, 2019. "A discussion of the two different aspects of privacy protection in indirect questioning designs," Quality & Quantity: International Journal of Methodology, Springer, vol. 53(1), pages 269-282, January.
    10. Leif Appelgren, 2019. "Optimal auditing of social benefit fraud: a case study," Empirical Economics, Springer, vol. 56(1), pages 203-231, January.
    11. Carel F. W. Peeters & Gerty J. L. M. Lensvelt-Mulders & Karin Lasthuizen, 2010. "A Note on a Simple and Practical Randomized Response Framework for Eliciting Sensitive Dichotomous and Quantitative Information," Sociological Methods & Research, , vol. 39(2), pages 283-296, November.
    12. Pier Francesco Perri & Elvira Pelle & Manuela Stranges, 2016. "Estimating Induced Abortion and Foreign Irregular Presence Using the Randomized Response Crossed Model," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 129(2), pages 601-618, November.
    13. Groenitz, Heiko, 2016. "A covariate nonrandomized response model for multicategorical sensitive variables," Computational Statistics & Data Analysis, Elsevier, vol. 103(C), pages 124-138.

    More about this item

    Keywords

    sensitive questions; online survey; randomized response technique; unmatched count technique; item count technique; methodological experiment;
    All these keywords.

    JEL classification:

    • C42 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Survey Methods
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ets:wpaper:3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Heidi Bruderer (email available below). General contact details of provider: http://www.socio.ethz.ch/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.