IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/32348.html

Examiner and Judge Designs in Economics: A Practitioner's Guide

Author

Listed:
  • Eric Chyn
  • Brigham Frandsen
  • Emily C. Leslie

Abstract

This article provides empirical researchers with an introduction and guide to research designs based on variation in judge and examiner tendencies to administer treatments or other interventions. We review the basic theory behind the research design, outline the assumptions under which the design identifies causal effects, describe empirical tests of those assumptions, and discuss tradeoffs associated with choices researchers must make for estimation. We demonstrate concepts and best practices concretely in an empirical case study that uses an examiner tendency research design to study the effects of pre-trial detention.

Suggested Citation

  • Eric Chyn & Brigham Frandsen & Emily C. Leslie, 2024. "Examiner and Judge Designs in Economics: A Practitioner's Guide," NBER Working Papers 32348, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:32348
    Note: CH ED LS PE
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w32348.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mogstad, Magne & Torgovitsky, Alexander, 2024. "Instrumental variables with unobserved heterogeneity in treatment effects," Handbook of Labor Economics,, Elsevier.
    2. Jonathan Cohen & Geoffrey C. Schnorr, 2024. "Efficiency Costs of Unemployment Insurance Denial: Evidence from Randomly Assigned Examiners," Upjohn Working Papers 24-404, W.E. Upjohn Institute for Employment Research.
    3. Bjerk, David J., 2025. "Understanding IV Versus OLS Estimates of Treatment Effects and the Coefficient Difference Check," IZA Discussion Papers 18274, Institute of Labor Economics (IZA).
    4. Ofek-Shanny, Yuval & Strulov-Shlain, Avner & Zeltzer, Dan, 2025. "Impacts of home-care subsidies: Evidence from quasi-random assignment," Journal of Public Economics, Elsevier, vol. 248(C).
    5. repec:ucl:cepeow:25-12 is not listed on IDEAS
    6. Alexander Chudik & Cameron M. Ellis & Johannes G. Jaspersen, 2025. "Lags, Leave-Outs and Fixed Effects," Working Papers 2536, Federal Reserve Bank of Dallas.
    7. Jason B. Cook & Chloe N. East, 2023. "The Effect of Means-Tested Transfers on Work: Evidence from Quasi-Randomly Assigned SNAP Caseworkers," NBER Working Papers 31307, National Bureau of Economic Research, Inc.
    8. Dennis Lim & Wenjie Wang & Yichong Zhang, 2024. "A Dimension-Agnostic Bootstrap Anderson-Rubin Test For Instrumental Variable Regressions," Papers 2412.01603, arXiv.org, revised Sep 2025.

    More about this item

    JEL classification:

    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C26 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Instrumental Variables (IV) Estimation
    • C31 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models; Quantile Regressions; Social Interaction Models
    • C54 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Quantitative Policy Modeling
    • K14 - Law and Economics - - Basic Areas of Law - - - Criminal Law

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:32348. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.