IDEAS home Printed from https://ideas.repec.org/p/ifs/cemmap/38-11.html
   My bibliography  Save this paper

Identification, data combination and the risk of disclosure

Author

Listed:
  • Tatiana V. Komarova

    (Institute for Fiscal Studies and London School of Economics and Political Science)

  • Denis Nekipelov

    (Institute for Fiscal Studies and Berkeley)

  • Evgeny Yakovlev

    (Institute for Fiscal Studies)

Abstract

Businesses routinely rely on econometric models to analyze and predict consumer behavior. Estimation of such models may require combining a firm's internal data with external datasets to take into account sample selection, missing observations, omitted variables and errors in measurement within the existing data source. In this paper we point out that these data problems can be addressed when estimating econometric models from combined data using the data mining techniques under mild assumptions regarding the data distribution. However, data combination leads to serious threats to security of consumer data: we demonstrate that point identification of an econometric model from combined data is incompatible with restrictions on the risk of individual disclosure. Consequently, if a consumer model is point identified, the firm would (implicitly or explicitly) reveal the identity of at least some of consumers in its internal data. More importantly, we provide an argument that unless the firm places a restriction on the individual disclosure risk when combining data, even if the raw combined dataset is not shared with a third party, an adversary or a competitor can gather confidential information regarding some individuals from the estimated model.

Suggested Citation

  • Tatiana V. Komarova & Denis Nekipelov & Evgeny Yakovlev, 2011. "Identification, data combination and the risk of disclosure," CeMMAP working papers CWP38/11, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  • Handle: RePEc:ifs:cemmap:38/11
    as

    Download full text from publisher

    File URL: http://cemmap.ifs.org.uk/wps/cwp3811.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Thierry Magnac & Eric Maurin, 2008. "Partial Identification in Monotone Binary Models: Discrete Regressors and Interval Data," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 75(3), pages 835-864.
    2. Manuel A. Domínguez & Ignacio N. Lobato, 2004. "Consistent Estimation of Models Defined by Conditional Moment Restrictions," Econometrica, Econometric Society, vol. 72(5), pages 1601-1615, September.
    3. Goldfarb, Avi & Greenstein, Shane M. & Tucker, Catherine E. (ed.), 2015. "Economic Analysis of the Digital Economy," National Bureau of Economic Research Books, University of Chicago Press, number 9780226206981, December.
    4. Charles F. Manski & Elie Tamer, 2002. "Inference on Regressions with Interval Data on a Regressor or Outcome," Econometrica, Econometric Society, vol. 70(2), pages 519-546, March.
    5. Ridder, Geert & Moffitt, Robert, 2007. "The Econometrics of Data Combination," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 75, Elsevier.
    6. Avi Goldfarb & Catherine Tucker, 2011. "Online Display Advertising: Targeting and Obtrusiveness," Marketing Science, INFORMS, vol. 30(3), pages 389-404, 05-06.
    7. Calzolari, Giacomo & Pavan, Alessandro, 2006. "On the optimality of privacy in sequential contracting," Journal of Economic Theory, Elsevier, vol. 130(1), pages 168-204, September.
    8. P. Lahiri & Michael D. Larsen, 2005. "Regression Analysis With Linked Data," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 222-230, March.
    9. Horowitz, Joel L & Manski, Charles F, 1995. "Identification and Robustness with Contaminated and Corrupted Data," Econometrica, Econometric Society, vol. 63(2), pages 281-302, March.
    10. Alessandro Acquisti & Hal R. Varian, 2005. "Conditioning Prices on Purchase History," Marketing Science, INFORMS, vol. 24(3), pages 367-381, May.
    11. Amalia R. Miller & Catherine Tucker, 2009. "Privacy Protection and Technology Diffusion: The Case of Electronic Medical Records," Management Science, INFORMS, vol. 55(7), pages 1077-1093, July.
    12. Horowitz, Joel L. & Manski, Charles F., 2006. "Identification and estimation of statistical functionals using incomplete data," Journal of Econometrics, Elsevier, vol. 132(2), pages 445-459, June.
    13. Curtis R. Taylor, 2004. "Consumer Privacy and the Market for Customer Information," RAND Journal of Economics, The RAND Corporation, vol. 35(4), pages 631-650, Winter.
    14. Satkartar K. Kinney & Jerome P. Reiter & Arnold P. Reznek & Javier Miranda & Ron S. Jarmin & John M. Abowd, 2011. "Towards Unrestricted Public Use Business Microdata: The Synthetic Longitudinal Business Database," International Statistical Review, International Statistical Institute, vol. 79(3), pages 362-384, December.
    15. Tatiana Komarova & Denis Nekipelov & Evgeny Yakovlev, 2015. "Estimation of Treatment Effects from Combined Data: Identification versus Data Security," NBER Chapters, in: Economic Analysis of the Digital Economy, pages 279-308, National Bureau of Economic Research, Inc.
    16. Molinari, Francesca, 2008. "Partial identification of probability distributions with misclassified data," Journal of Econometrics, Elsevier, vol. 144(1), pages 81-117, May.
    17. Philip J. Cross & Charles F. Manski, 2002. "Regressions, Short and Long," Econometrica, Econometric Society, vol. 70(1), pages 357-368, January.
    18. Kim, Gunky & Chambers, Raymond, 2012. "Regression analysis under incomplete linkage," Computational Statistics & Data Analysis, Elsevier, vol. 56(9), pages 2756-2770.
    19. Karr, A.F. & Kohnen, C.N. & Oganian, A. & Reiter, J.P. & Sanil, A.P., 2006. "A Framework for Evaluating the Utility of Data Altered to Protect Confidentiality," The American Statistician, American Statistical Association, vol. 60, pages 224-232, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Komarova, Tatiana & Nekipelov, Denis & Al Rafi , Ahnaf & Yakovlev, Evgeny, 2017. "K-anonymity: A note on the trade-off between data utility and data security," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 48, pages 44-62.
    2. Tatiana Komarova & Denis Nekipelov, 2020. "Identification and Formal Privacy Guarantees," Papers 2006.14732, arXiv.org, revised May 2021.
    3. David Pacini, 2012. "Least Square Linear Prediction with Two-Sample Data," Bristol Economics Discussion Papers 12/631, School of Economics, University of Bristol, UK.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Francesca Molinari, 2020. "Microeconometrics with Partial Identi?cation," CeMMAP working papers CWP15/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    2. Francesca Molinari, 2019. "Econometrics with Partial Identification," CeMMAP working papers CWP25/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    3. Morlok, Tina & Matt, Christian & Hess, Thomas, 2017. "Privatheitsforschung in den Wirtschaftswissenschaften: Entwicklung, Stand und Perspektiven," Working Papers 1/2017, University of Munich, Munich School of Management, Institute for Information Systems and New Media.
    4. Christian Bontemps & Thierry Magnac & Eric Maurin, 2012. "Set Identified Linear Models," Econometrica, Econometric Society, vol. 80(3), pages 1129-1155, May.
    5. Jin-Hyuk Kim & Liad Wagman, 2015. "Screening incentives and privacy protection in financial markets: a theoretical and empirical analysis," RAND Journal of Economics, RAND Corporation, vol. 46(1), pages 1-22, March.
    6. Magnac, Thierry, 2013. "Identification partielle : méthodes et conséquences pour les applications empiriques," L'Actualité Economique, Société Canadienne de Science Economique, vol. 89(4), pages 233-258, Décembre.
    7. Alessandro Acquisti & Curtis Taylor & Liad Wagman, 2016. "The Economics of Privacy," Journal of Economic Literature, American Economic Association, vol. 54(2), pages 442-492, June.
    8. Potoglou, Dimitris & Palacios, Juan & Feijoo, Claudio & Gómez Barroso, Jose-Luis, 2015. "The supply of personal information: A study on the determinants of information provision in e-commerce scenarios," 26th European Regional ITS Conference, Madrid 2015 127174, International Telecommunications Society (ITS).
    9. Dengler, Sebastian & Prüfer, Jens, 2021. "Consumers' privacy choices in the era of big data," Games and Economic Behavior, Elsevier, vol. 130(C), pages 499-520.
    10. Bouckaert, J.M.C. & Degryse, H.A., 2006. "Opt In versus Opt Out : A Free-Entry Analysis of Privacy Policies," Other publications TiSEM 17393c5d-1ed2-47ec-bc96-9, Tilburg University, School of Economics and Management.
    11. Piccolo, Salvatore & Pagnozzi, Marco, 2013. "Information sharing between vertical hierarchies," Games and Economic Behavior, Elsevier, vol. 79(C), pages 201-222.
    12. Guido W. Imbens & Charles F. Manski, 2004. "Confidence Intervals for Partially Identified Parameters," Econometrica, Econometric Society, vol. 72(6), pages 1845-1857, November.
    13. Daron Acemoglu & Ali Makhdoumi & Azarakhsh Malekian & Asu Ozdaglar, 2022. "Too Much Data: Prices and Inefficiencies in Data Markets," American Economic Journal: Microeconomics, American Economic Association, vol. 14(4), pages 218-256, November.
    14. Arie Beresteanu & Francesca Molinari, 2008. "Asymptotic Properties for a Class of Partially Identified Models," Econometrica, Econometric Society, vol. 76(4), pages 763-814, July.
    15. Byung‐Cheol Kim & Jay Pil Choi, 2010. "Customer Information Sharing: Strategic Incentives and New Implications," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 19(2), pages 403-433, June.
    16. Lagerlöf, Johan N.M., 2023. "Surfing incognito: Welfare effects of anonymous shopping," International Journal of Industrial Organization, Elsevier, vol. 87(C).
    17. Avi Goldfarb, 2014. "What is Different About Online Advertising?," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 44(2), pages 115-129, March.
    18. S. Nageeb Ali & Gregory Lewis & Shoshana Vasserman, 2019. "Voluntary Disclosure and Personalized Pricing," NBER Working Papers 26592, National Bureau of Economic Research, Inc.
    19. Xiaohong Chen & Yingyao Hu, 2006. "Identification and Inference of Nonlinear Models Using Two Samples with Arbitrary Measurement Errors," Cowles Foundation Discussion Papers 1590, Cowles Foundation for Research in Economics, Yale University.
    20. Juan Carlos Escanciano & Lin Zhu, 2013. "Set inferences and sensitivity analysis in semiparametric conditionally identified models," CeMMAP working papers CWP55/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.

    More about this item

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C25 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Discrete Regression and Qualitative Choice Models; Discrete Regressors; Proportions; Probabilities
    • C35 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Discrete Regression and Qualitative Choice Models; Discrete Regressors; Proportions

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ifs:cemmap:38/11. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Emma Hyman (email available below). General contact details of provider: https://edirc.repec.org/data/cmifsuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.