IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2006.16214.html
   My bibliography  Save this paper

Estimation of Covid-19 Prevalence from Serology Tests: A Partial Identification Approach

Author

Listed:
  • Panos Toulis

Abstract

We propose a partial identification method for estimating disease prevalence from serology studies. Our data are results from antibody tests in some population sample, where the test parameters, such as the true/false positive rates, are unknown. Our method scans the entire parameter space, and rejects parameter values using the joint data density as the test statistic. The proposed method is conservative for marginal inference, in general, but its key advantage over more standard approaches is that it is valid in finite samples even when the underlying model is not point identified. Moreover, our method requires only independence of serology test results, and does not rely on asymptotic arguments, normality assumptions, or other approximations. We use recent Covid-19 serology studies in the US, and show that the parameter confidence set is generally wide, and cannot support definite conclusions. Specifically, recent serology studies from California suggest a prevalence anywhere in the range 0%-2% (at the time of study), and are therefore inconclusive. However, this range could be narrowed down to 0.7%-1.5% if the actual false positive rate of the antibody test was indeed near its empirical estimate (~0.5%). In another study from New York state, Covid-19 prevalence is confidently estimated in the range 13%-17% in mid-April of 2020, which also suggests significant geographic variation in Covid-19 exposure across the US. Combining all datasets yields a 5%-8% prevalence range. Our results overall suggest that serology testing on a massive scale can give crucial information for future policy design, even when such tests are imperfect and their parameters unknown.

Suggested Citation

  • Panos Toulis, 2020. "Estimation of Covid-19 Prevalence from Serology Tests: A Partial Identification Approach," Papers 2006.16214, arXiv.org.
  • Handle: RePEc:arx:papers:2006.16214
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2006.16214
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Manski, Charles F. & Molinari, Francesca, 2021. "Estimating the COVID-19 infection rate: Anatomy of an inference problem," Journal of Econometrics, Elsevier, vol. 220(1), pages 181-192.
    2. Beresteanu, Arie & Molchanov, Ilya & Molinari, Francesca, 2012. "Partial identification using random set theory," Journal of Econometrics, Elsevier, vol. 166(1), pages 17-32.
    3. Hiroaki Kaido & Francesca Molinari & Jörg Stoye, 2019. "Confidence Intervals for Projections of Partially Identified Parameters," Econometrica, Econometric Society, vol. 87(4), pages 1397-1432, July.
    4. Fernando Alvarez & David Argente, 2020. "A Simple Planning Problem for COVID-19 Lockdown," Working Papers 2020-34, Becker Friedman Institute for Research In Economics.
    5. Tamer, Elie, 2010. "Partial Identification in Econometrics," Scholarly Articles 34728615, Harvard University Department of Economics.
    6. Xiaohong Chen & Timothy M. Christensen & Elie Tamer, 2018. "Monte Carlo Confidence Sets for Identified Sets," Econometrica, Econometric Society, vol. 86(6), pages 1965-2018, November.
    7. Guido W. Imbens & Charles F. Manski, 2004. "Confidence Intervals for Partially Identified Parameters," Econometrica, Econometric Society, vol. 72(6), pages 1845-1857, November.
    8. Jorg Stoye, 2009. "More on Confidence Intervals for Partially Identified Parameters," Econometrica, Econometric Society, vol. 77(4), pages 1299-1315, July.
    9. Bo E. Honoré & Elie Tamer, 2006. "Bounds on Parameters in Panel Dynamic Discrete Choice Models," Econometrica, Econometric Society, vol. 74(3), pages 611-629, May.
    10. Hortaçsu, Ali & Liu, Jiarui & Schwieg, Timothy, 2021. "Estimating the fraction of unreported infections in epidemics with a known epicenter: An application to COVID-19," Journal of Econometrics, Elsevier, vol. 220(1), pages 106-129.
    11. Charles F. Manski, 2007. "Partial Identification Of Counterfactual Choice Probabilities," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 48(4), pages 1393-1410, November.
    12. Victor Chernozhukov & Han Hong & Elie Tamer, 2007. "Estimation and Confidence Regions for Parameter Sets in Econometric Models," Econometrica, Econometric Society, vol. 75(5), pages 1243-1284, September.
    13. Andrew Gelman & Bob Carpenter, 2020. "Bayesian analysis of tests with unknown specificity and sensitivity," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 69(5), pages 1269-1283, November.
    14. Elie Tamer, 2010. "Partial Identification in Econometrics," Annual Review of Economics, Annual Reviews, vol. 2(1), pages 167-195, September.
    15. Ali Hortaçsu & Jiarui Liu & Timothy Schwieg, 2020. "Estimating the Fraction of Unreported Infections in Epidemics with a Known Epicenter: An Application to COVID-19," Working Papers 2020-37, Becker Friedman Institute for Research In Economics.
    16. Joseph P. Romano & Azeem M. Shaikh, 2010. "Inference for the Identified Set in Partially Identified Econometric Models," Econometrica, Econometric Society, vol. 78(1), pages 169-211, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jörg Stoye, 2022. "Bounding infection prevalence by bounding selectivity and accuracy of tests: with application to early COVID-19 [False-negative results of initial RT-PCR assays for COVID-19: a systematic review]," The Econometrics Journal, Royal Economic Society, vol. 25(1), pages 1-14.
    2. Bollinger, Christopher R. & van Hasselt, Martijn, 2020. "Estimating the cumulative rate of SARS-CoV-2 infection," Economics Letters, Elsevier, vol. 197(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Toulis, Panos, 2021. "Estimation of Covid-19 prevalence from serology tests: A partial identification approach," Journal of Econometrics, Elsevier, vol. 220(1), pages 193-213.
    2. Panos Toulis, 2020. "Estimation of COVID-19 Prevalence from Serology Tests: A Partial Identification Approach," Working Papers 2020-54_Revised, Becker Friedman Institute for Research In Economics.
    3. Lukáš Lafférs, 2019. "Identification in Models with Discrete Variables," Computational Economics, Springer;Society for Computational Economics, vol. 53(2), pages 657-696, February.
    4. Raffaella Giacomini & Toru Kitagawa, 2021. "Robust Bayesian Inference for Set‐Identified Models," Econometrica, Econometric Society, vol. 89(4), pages 1519-1556, July.
    5. Yuan Liao & Anna Simoni, 2012. "Semi-parametric Bayesian Partially Identified Models based on Support Function," Papers 1212.3267, arXiv.org, revised Nov 2013.
    6. Yuichi Kitamura & Jörg Stoye, 2018. "Nonparametric Analysis of Random Utility Models," Econometrica, Econometric Society, vol. 86(6), pages 1883-1909, November.
    7. Semenova, Vira, 2023. "Debiased machine learning of set-identified linear models," Journal of Econometrics, Elsevier, vol. 235(2), pages 1725-1746.
    8. Sasaki, Yuya & Takahashi, Yuya & Xin, Yi & Hu, Yingyao, 2023. "Dynamic discrete choice models with incomplete data: Sharp identification," Journal of Econometrics, Elsevier, vol. 236(1).
    9. Brendan Kline & Elie Tamer, 2016. "Bayesian inference in a class of partially identified models," Quantitative Economics, Econometric Society, vol. 7(2), pages 329-366, July.
    10. Liao, Yuan & Simoni, Anna, 2019. "Bayesian inference for partially identified smooth convex models," Journal of Econometrics, Elsevier, vol. 211(2), pages 338-360.
    11. Christian Bontemps & Thierry Magnac, 2017. "Set Identification, Moment Restrictions, and Inference," Annual Review of Economics, Annual Reviews, vol. 9(1), pages 103-129, September.
    12. Donald S. Poskitt & Xueyan Zhao, 2023. "Bootstrap Hausdorff Confidence Regions for Average Treatment Effect Identified Sets," Monash Econometrics and Business Statistics Working Papers 9/23, Monash University, Department of Econometrics and Business Statistics.
    13. Ho, Kate & Rosen, Adam M., 2015. "Partial Identification in Applied Research: Benefits and Challenges," CEPR Discussion Papers 10883, C.E.P.R. Discussion Papers.
    14. Xiaohong Chen & Timothy M. Christensen & Elie Tamer, 2018. "Monte Carlo Confidence Sets for Identified Sets," Econometrica, Econometric Society, vol. 86(6), pages 1965-2018, November.
    15. James L. Powell, 2017. "Identification and Asymptotic Approximations: Three Examples of Progress in Econometric Theory," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 107-124, Spring.
    16. Wenlong Ji & Lihua Lei & Asher Spector, 2023. "Model-Agnostic Covariate-Assisted Inference on Partially Identified Causal Effects," Papers 2310.08115, arXiv.org.
    17. Xiaohong Chen & Timothy M. Christensen & Keith O'Hara & Elie Tamer, 2016. "MCMC confidence sets for identified sets," CeMMAP working papers 28/16, Institute for Fiscal Studies.
    18. Yuan Liao & Anna Simoni, 2016. "Bayesian Inference for Partially Identified Convex Models: Is it Valid for Frequentist Inference?," Departmental Working Papers 201607, Rutgers University, Department of Economics.
    19. Wooyoung Kim & Koohyun Kwon & Soonwoo Kwon & Sokbae Lee, 2018. "The identification power of smoothness assumptions in models with counterfactual outcomes," Quantitative Economics, Econometric Society, vol. 9(2), pages 617-642, July.
    20. Nirav Mehta, 2022. "A Partial Identification Approach to Identifying the Determinants of Human Capital Accumulation: An Application to Teachers," University of Western Ontario, Departmental Research Report Series 20221, University of Western Ontario, Department of Economics.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2006.16214. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.