IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2505.21909.html
   My bibliography  Save this paper

Causal Inference for Experiments with Latent Outcomes: Key Results and Their Implications for Design and Analysis

Author

Listed:
  • Jiawei Fu
  • Donald P. Green

Abstract

How should researchers analyze randomized experiments in which the main outcome is measured in multiple ways but each measure contains some degree of error? We describe modeling approaches that enable researchers to identify causal parameters of interest, suggest ways that experimental designs can be augmented so as to make linear latent variable models more credible, and discuss empirical tests of key modeling assumptions. We show that when experimental researchers invest appropriately in multiple outcome measures, an optimally weighted index of the outcome measures enables researchers to obtain efficient and interpretable estimates of causal parameters by applying standard regression methods, and that weights may be obtained using instrumental variables regression. Maximum likelihood and generalized method of moments estimators can be used to obtain estimates and standard errors in a single step. An empirical application illustrates the gains in precision and robustness that multiple outcome measures can provide.

Suggested Citation

  • Jiawei Fu & Donald P. Green, 2025. "Causal Inference for Experiments with Latent Outcomes: Key Results and Their Implications for Design and Analysis," Papers 2505.21909, arXiv.org, revised Jun 2025.
  • Handle: RePEc:arx:papers:2505.21909
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2505.21909
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Anderson, Michael L., 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1481-1495.
    2. Ke-Hai Yuan & Wai Chan, 2005. "On Nonequivalence of Several Procedures of Structural Equation Modeling," Psychometrika, Springer;The Psychometric Society, vol. 70(4), pages 791-798, December.
    3. Xinran Li & Peng Ding, 2017. "General Forms of Finite Population Central Limit Theorems with Applications to Causal Inference," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(520), pages 1759-1769, October.
    4. Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769.
    5. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881, September.
    6. Kalla, Joshua L. & Broockman, David E., 2020. "Reducing Exclusionary Attitudes through Interpersonal Conversation: Evidence from Three Field Experiments," American Political Science Review, Cambridge University Press, vol. 114(2), pages 410-425, May.
    7. Ansolabehere, Stephen & Rodden, Jonathan & Snyder, James M., 2008. "The Strength of Issues: Using Multiple Measures to Gauge Preference Stability, Ideological Constraint, and Issue Voting," American Political Science Review, Cambridge University Press, vol. 102(2), pages 215-232, May.
    8. Broockman, David E. & Kalla, Joshua L. & Sekhon, Jasjeet S., 2017. "The Design of Field Experiments With Survey Outcomes: A Framework for Selecting More Efficient, Robust, and Ethical Designs," Political Analysis, Cambridge University Press, vol. 25(4), pages 435-464, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Capuno, Joseph & Kraft, Aleli & O'Donnell, Owen, 2021. "Effectiveness of clinic-based cardiovascular disease prevention: A randomized encouragement design experiment in the Philippines," Social Science & Medicine, Elsevier, vol. 283(C).
    2. Jeffrey D. Michler & Anna Josephson, 2022. "Recent developments in inference: practicalities for applied economics," Chapters, in: A Modern Guide to Food Economics, chapter 11, pages 235-268, Edward Elgar Publishing.
    3. Yuehao Bai & Azeem M. Shaikh & Max Tabord-Meehan, 2024. "A Primer on the Analysis of Randomized Experiments and a Survey of some Recent Advances," Papers 2405.03910, arXiv.org, revised Apr 2025.
    4. Sant’Anna, Pedro H.C. & Zhao, Jun, 2020. "Doubly robust difference-in-differences estimators," Journal of Econometrics, Elsevier, vol. 219(1), pages 101-122.
    5. Marie Bjørneby & Annette Alstadsæter & Kjetil Telle, 2018. "Collusive tax evasion by employers and employees. Evidence from a randomized fi eld experiment in Norway," Discussion Papers 891, Statistics Norway, Research Department.
    6. Emilio Depetris-Chauvin & Ömer Özak, 2020. "The origins of the division of labor in pre-industrial times," Journal of Economic Growth, Springer, vol. 25(3), pages 297-340, September.
    7. Dennis Shen & Peng Ding & Jasjeet Sekhon & Bin Yu, 2022. "Same Root Different Leaves: Time Series and Cross-Sectional Methods in Panel Data," Papers 2207.14481, arXiv.org, revised Oct 2022.
    8. Bernard, Tanguy & Dercon, Stefan & Orkin, Kate & Schinaia, Giulio & Seyoum Taffesse, Alemayehu, 2023. "The Future in Mind: Aspirations and Long-term Outcomes in Rural Ethiopia," CEPR Discussion Papers 18492, C.E.P.R. Discussion Papers.
    9. Art B. Owen & Hal Varian, 2018. "Optimizing the tie-breaker regression discontinuity design," Papers 1808.07563, arXiv.org, revised Jul 2020.
    10. Cristian Mardones & Pablo Herreros, 2023. "Ex post evaluation of voluntary environmental policies on the energy intensity in Chilean firms," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 25(9), pages 9111-9136, September.
    11. Tymon Słoczyński, 2022. "Interpreting OLS Estimands When Treatment Effects Are Heterogeneous: Smaller Groups Get Larger Weights," The Review of Economics and Statistics, MIT Press, vol. 104(3), pages 501-509, May.
    12. John A. List, 2024. "Field Experiments: Here Today Gone Tomorrow?," The American Economist, Sage Publications, vol. 69(2), pages 214-234, October.
    13. Clément de Chaisemartin, 2022. "Trading-off Bias and Variance in Stratified Experiments and in Staggered Adoption Designs, Under a Boundedness Condition on the Magnitude of the Treatment Effect," Working Papers hal-03873919, HAL.
    14. Colnet Bénédicte & Josse Julie & Varoquaux Gaël & Scornet Erwan, 2022. "Causal effect on a target population: A sensitivity analysis to handle missing covariates," Journal of Causal Inference, De Gruyter, vol. 10(1), pages 372-414, January.
    15. Ashesh Rambachan & Jonathan Roth, 2020. "Design-Based Uncertainty for Quasi-Experiments," Papers 2008.00602, arXiv.org, revised Jun 2025.
    16. Derksen, Laura & Kerwin, Jason Theodore & Reynoso, Natalia Ordaz & Sterck, Olivier, 2021. "Appointments: A More Effective Commitment Device for Health Behaviors," SocArXiv y8gh7, Center for Open Science.
    17. Tian, Jianchi & Li, Yang & Sun, Yan & Yang, Bo & Chen, Xuefeng, 2024. "Warming climate apathy to mitigate the disparity in climate policy support across distinct income strata," Energy Policy, Elsevier, vol. 192(C).
    18. Kunze, Lars & Suppa, Nicolai, 2017. "Bowling alone or bowling at all? The effect of unemployment on social participation," Journal of Economic Behavior & Organization, Elsevier, vol. 133(C), pages 213-235.
    19. Sloczynski, Tymon, 2018. "A General Weighted Average Representation of the Ordinary and Two-Stage Least Squares Estimands," IZA Discussion Papers 11866, Institute of Labor Economics (IZA).
    20. Hao, Shiming, 2021. "True structure change, spurious treatment effect? A novel approach to disentangle treatment effects from structure changes," MPRA Paper 108679, University Library of Munich, Germany.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2505.21909. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.