IDEAS home Printed from https://ideas.repec.org/p/cpr/ceprdp/12202.html
   My bibliography  Save this paper

Strategic Sample Selection

Author

Listed:
  • Di Tillio, Alfredo
  • Ottaviani, Marco
  • Sorensen, Peter Norman

Abstract

What is the impact of sample selection on the inference payoff of an evaluator testing a simple hypothesis based on the outcome of a location experiment? We show that anticipated selection locally reduces noise dispersion and thus increases informativeness if and only if the noise distribution is double logconvex, as with normal noise. The results are applied to the analysis of strategic sample selection by a biased researcher and extended to the case of uncertain and unanticipated selection. Our theoretical analysis offers applied research a new angle on the problem of selection in empirical studies, by characterizing when selective assignment based on untreated outcomes benefits or hurts the evaluator.

Suggested Citation

  • Di Tillio, Alfredo & Ottaviani, Marco & Sorensen, Peter Norman, 2017. "Strategic Sample Selection," CEPR Discussion Papers 12202, C.E.P.R. Discussion Papers.
    • Handle: RePEc:cpr:ceprdp:12202
    as

    Download full text from publisher

    File URL: http://www.cepr.org/active/publications/discussion_papers/dp.php?dpno=12202
    Download Restriction: CEPR Discussion Papers are free to download for our researchers, subscribers and members. If you fall into one of these categories but have trouble downloading our papers, please contact us at subscribers@cepr.org
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Emeric Henry, 2009. "Strategic Disclosure of Research Results: The Cost of Proving Your Honesty," Economic Journal, Royal Economic Society, vol. 119(539), pages 1036-1064, July.
    2. John K.-H. Quah & Bruno Strulovici, 2009. "Comparative Statics, Informativeness, and the Interval Dominance Order," Econometrica, Econometric Society, vol. 77(6), pages 1949-1992, November.
    3. Emir Kamenica & Matthew Gentzkow, 2011. "Bayesian Persuasion," American Economic Review, American Economic Association, vol. 101(6), pages 2590-2615, October.
    4. Grossman, Sanford J, 1981. "The Informational Role of Warranties and Private Disclosure about Product Quality," Journal of Law and Economics, University of Chicago Press, vol. 24(3), pages 461-483, December.
    5. Emeric Henry & Marco Ottaviani, 2019. "Research and the Approval Process: The Organization of Persuasion," American Economic Review, American Economic Association, vol. 109(3), pages 911-955, March.
    6. Luis Rayo & Ilya Segal, 2010. "Optimal Information Disclosure," Journal of Political Economy, University of Chicago Press, vol. 118(5), pages 949-987.
    7. Florian Hoffmann & Roman Inderst & Marco Ottaviani, 2020. "Persuasion Through Selective Disclosure: Implications for Marketing, Campaigning, and Privacy Regulation," Management Science, INFORMS, vol. 66(11), pages 4958-4979, November.
    8. Sylvain Chassang & Gerard Padro I Miquel & Erik Snowberg, 2012. "Selective Trials: A Principal-Agent Approach to Randomized Controlled Experiments," American Economic Review, American Economic Association, vol. 102(4), pages 1279-1309, June.
    9. Paul R. Milgrom, 1981. "Good News and Bad News: Representation Theorems and Applications," Bell Journal of Economics, The RAND Corporation, vol. 12(2), pages 380-391, Autumn.
    10. repec:hal:wpspec:info:hdl:2441/eu4vqp9ompqllr09iatr74eao is not listed on IDEAS
    11. Paul Milgrom & Ilya Segal, 2002. "Envelope Theorems for Arbitrary Choice Sets," Econometrica, Econometric Society, vol. 70(2), pages 583-601, March.
    12. Khaledi, Baha-Eldin & Kochar, Subhash, 2000. "On dispersive ordering between order statistics in one-sample and two-sample problems," Statistics & Probability Letters, Elsevier, vol. 46(3), pages 257-261, February.
    13. Mike Felgenhauer & Elisabeth Schulte, 2014. "Strategic Private Experimentation," American Economic Journal: Microeconomics, American Economic Association, vol. 6(4), pages 74-105, November.
    14. Steven Matthews & Andrew Postlewaite, 1985. "Quality Testing and Disclosure," RAND Journal of Economics, The RAND Corporation, vol. 16(3), pages 328-340, Autumn.
    15. Karlin, Samuel & Rinott, Yosef, 1980. "Classes of orderings of measures and related correlation inequalities. I. Multivariate totally positive distributions," Journal of Multivariate Analysis, Elsevier, vol. 10(4), pages 467-498, December.
    16. Kasy, Maximilian, 2016. "Why Experimenters Might Not Always Want to Randomize, and What They Could Do Instead," Political Analysis, Cambridge University Press, vol. 24(3), pages 324-338, July.
    17. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    18. Dahm, Matthias & González, Paula & Porteiro, Nicolás, 2009. "Trials, tricks and transparency: How disclosure rules affect clinical knowledge," Journal of Health Economics, Elsevier, vol. 28(6), pages 1141-1153, December.
    19. Mark Bagnoli & Ted Bergstrom, 2006. "Log-concave probability and its applications," Studies in Economic Theory, in: Charalambos D. Aliprantis & Rosa L. Matzkin & Daniel L. McFadden & James C. Moore & Nicholas C. Yann (ed.), Rationality and Equilibrium, pages 217-241, Springer.
    20. Müller, Samuel & Rufibach, Kaspar, 2008. "On the max-domain of attraction of distributions with log-concave densities," Statistics & Probability Letters, Elsevier, vol. 78(12), pages 1440-1444, September.
    21. Hunt Allcott, 2015. "Site Selection Bias in Program Evaluation," The Quarterly Journal of Economics, Oxford University Press, vol. 130(3), pages 1117-1165.
    22. Francis X. Flanagan, 2015. "Peremptory Challenges and Jury Selection," Journal of Law and Economics, University of Chicago Press, vol. 58(2), pages 385-416.
    23. Milgrom, Paul R, 1979. "A Convergence Theorem for Competitive Bidding with Differential Information," Econometrica, Econometric Society, vol. 47(3), pages 679-688, May.
    24. Thomas Noe, 2020. "Comparing the Chosen: Selection Bias When Selection Is Competitive," Journal of Political Economy, University of Chicago Press, vol. 128(1), pages 342-390.
    25. An, Mark Yuying, 1998. "Logconcavity versus Logconvexity: A Complete Characterization," Journal of Economic Theory, Elsevier, vol. 80(2), pages 350-369, June.
    26. Aleksey Tetenov, 2016. "An economic theory of statistical testing," CeMMAP working papers CWP50/16, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    27. A. Mitchell Polinsky & Steven Shavell, 2012. "Mandatory Versus Voluntary Disclosure of Product Risks," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 28(2), pages 360-379.
    28. Robert Wilson, 1977. "A Bidding Model of Perfect Competition," Review of Economic Studies, Oxford University Press, vol. 44(3), pages 511-518.
    29. repec:hal:spmain:info:hdl:2441/eu4vqp9ompqllr09iatr74eao is not listed on IDEAS
    30. Emeric Henry, 2009. "Disclosure of research results: the cost of proving your honesty," SciencePo Working papers Main hal-01023670, HAL.
    31. Nicola Persico, 2000. "Information Acquisition in Auctions," Econometrica, Econometric Society, vol. 68(1), pages 135-148, January.
    32. Arthur F. Veinott, 1965. "Optimal Policy in a Dynamic, Single Product, Nonstationary Inventory Model with Several Demand Classes," Operations Research, INFORMS, vol. 13(5), pages 761-778, October.
    33. Alfredo Di Tillio & Marco Ottaviani & Peter Norman Sørensen, 2017. "Persuasion Bias in Science: Can Economics Help?," Economic Journal, Royal Economic Society, vol. 127(605), pages 266-304, October.
    34. Arthur Roth & Joseph B. Kadane & Morris H. Degroot, 1977. "Optimal Peremptory Challenges in Trials by Juries: A Bilateral Sequential Process," Operations Research, INFORMS, vol. 25(6), pages 901-919, December.
    35. Schwartz, Edward P & Schwartz, Warren F, 1996. "The Challenge of Peremptory Challenges," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 12(2), pages 325-360, October.
    36. Michael J. Fishman & Kathleen M. Hagerty, 1990. "The Optimal Amount of Discretion to Allow in Disclosure," The Quarterly Journal of Economics, Oxford University Press, vol. 105(2), pages 427-444.
    37. repec:hal:spmain:info:hdl:2441/1gr6n3t28b94tafji6op8tlqs1 is not listed on IDEAS
    38. Herresthal, C., 2017. "Hidden Testing and Selective Disclosure of Evidence," Cambridge Working Papers in Economics 1712, Faculty of Economics, University of Cambridge.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Maximilian Kasy & Jann Spiess, 2022. "Rationalizing Pre-Analysis Plans:Statistical Decisions Subject to Implementability," Economics Series Working Papers 975, University of Oxford, Department of Economics.
    2. Maximilian Kasy & Jann Spiess, 2022. "Rationalizing Pre-Analysis Plans: Statistical Decisions Subject to Implementability," Papers 2208.09638, arXiv.org.
    3. Herresthal, Claudia, 2022. "Hidden testing and selective disclosure of evidence," Journal of Economic Theory, Elsevier, vol. 200(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Herresthal, Claudia, 2022. "Hidden testing and selective disclosure of evidence," Journal of Economic Theory, Elsevier, vol. 200(C).
    2. Dahm, Matthias & González, Paula & Porteiro, Nicolás, 2018. "The enforcement of mandatory disclosure rules," Journal of Public Economics, Elsevier, vol. 167(C), pages 21-32.
    3. Alfredo Di Tillio & Marco Ottaviani & Peter Norman Sørensen, 2017. "Persuasion Bias in Science: Can Economics Help?," Economic Journal, Royal Economic Society, vol. 127(605), pages 266-304, October.
    4. Florian Hoffmann & Roman Inderst & Marco Ottaviani, 2013. "Hypertargeting, Limited Attention, and Privacy: Implications for Marketing and Campaigning," Working Papers 479, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    5. Arnaud Dellis & Mandar Oak, 2020. "Subpoena power and informational lobbying," Journal of Theoretical Politics, , vol. 32(2), pages 188-234, April.
    6. Felgenhauer, Mike, 2021. "Experimentation and manipulation with preregistration," Games and Economic Behavior, Elsevier, vol. 130(C), pages 400-408.
    7. Florian Hoffmann & Roman Inderst & Marco Ottaviani, 2020. "Persuasion Through Selective Disclosure: Implications for Marketing, Campaigning, and Privacy Regulation," Management Science, INFORMS, vol. 66(11), pages 4958-4979, November.
    8. Levent Celik, 2014. "Information Unraveling Revisited: Disclosure of Horizontal Attributes," Journal of Industrial Economics, Wiley Blackwell, vol. 62(1), pages 113-136, March.
    9. Hedlund, Jonas, 2015. "Persuasion with communication costs," Games and Economic Behavior, Elsevier, vol. 92(C), pages 28-40.
    10. Herresthal, C., 2017. "Hidden Testing and Selective Disclosure of Evidence," Cambridge Working Papers in Economics 1712, Faculty of Economics, University of Cambridge.
    11. Glode, Vincent & Opp, Christian C. & Zhang, Xingtan, 2018. "Voluntary disclosure in bilateral transactions," Journal of Economic Theory, Elsevier, vol. 175(C), pages 652-688.
    12. Gregor Martin, 2015. "To Invite or Not to Invite a Lobby, That Is the Question," The B.E. Journal of Theoretical Economics, De Gruyter, vol. 15(2), pages 143-166, July.
    13. Emeric Henry & Marco Ottaviani, 2019. "Research and the Approval Process: The Organization of Persuasion," American Economic Review, American Economic Association, vol. 109(3), pages 911-955, March.
    14. Claude Fluet & Thomas Lanzi, 2021. "Cross-Examination," Working Papers of BETA 2021-40, Bureau d'Economie Théorique et Appliquée, UDS, Strasbourg.
    15. Martin Gregor, 2014. "Receiver's access fee for a single sender," Working Papers IES 2014/17, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised May 2014.
    16. Davide Viviano & Kaspar Wuthrich & Paul Niehaus, 2021. "(When) should you adjust inferences for multiple hypothesis testing?," Papers 2104.13367, arXiv.org, revised Apr 2023.
    17. Jeremy Bertomeu & Davide Cianciaruso, 2018. "Verifiable disclosure," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 65(4), pages 1011-1044, June.
    18. Hedlund, Jonas, 2017. "Bayesian persuasion by a privately informed sender," Journal of Economic Theory, Elsevier, vol. 167(C), pages 229-268.
    19. Mensch, Jeffrey, 2021. "Rational inattention and the monotone likelihood ratio property," Journal of Economic Theory, Elsevier, vol. 196(C).
    20. Rosar, Frank, 2017. "Test design under voluntary participation," Games and Economic Behavior, Elsevier, vol. 104(C), pages 632-655.

    More about this item

    Keywords

    Comparison of experiments; Dispersion; Persuasion; Strategic selection; welfare;
    All these keywords.

    JEL classification:

    • C72 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Noncooperative Games
    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
    • D82 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Asymmetric and Private Information; Mechanism Design
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cpr:ceprdp:12202. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://www.cepr.org .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (email available below). General contact details of provider: https://www.cepr.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.