IDEAS home Printed from https://ideas.repec.org/a/aea/jeclit/v63y2025i2p401-39.html

Examiner and Judge Designs in Economics: A Practitioner's Guide

Author

Listed:
  • Eric Chyn
  • Brigham Frandsen
  • Emily Leslie

Abstract

This article provides empirical researchers with an introduction and guide to research designs based on variation in judge and examiner tendencies to administer treatments or other interventions. We review the basic theory behind this research design, outline the assumptions under which the design identifies causal effects, describe empirical tests of the conditions for identification, and discuss trade-offs associated with choices researchers must make for estimation. We demonstrate concepts and best practices in an empirical case study that uses an examiner tendency research design to study the effects of pretrial detention.

Suggested Citation

  • Eric Chyn & Brigham Frandsen & Emily Leslie, 2025. "Examiner and Judge Designs in Economics: A Practitioner's Guide," Journal of Economic Literature, American Economic Association, vol. 63(2), pages 401-439, June.
    • Handle: RePEc:aea:jeclit:v:63:y:2025:i:2:p:401-39
    DOI: 10.1257/jel.20241719
    as

    Download full text from publisher

    File URL: https://www.aeaweb.org/doi/10.1257/jel.20241719
    Download Restriction: Access to full text is restricted to AEA members and institutional subscribers.
    File URL: https://doi.org/10.3886/E209883V1
    Download Restriction: no
    File URL: https://www.aeaweb.org/articles/materials/23315
    Download Restriction: no
    File URL: https://www.aeaweb.org/articles/materials/23316
    Download Restriction: no
    File URL: https://libkey.io/10.1257/jel.20241719?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or

    for a different version of it.

    Other versions of this item:

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bjerk, David J., 2025. "Understanding IV Versus OLS Estimates of Treatment Effects and the Coefficient Difference Check," IZA Discussion Papers 18274, IZA Network @ LISER.
    2. Alexander Chudik & Cameron M. Ellis & Johannes G. Jaspersen, 2025. "Lags, Leave-Outs and Fixed Effects," Working Papers 2536, Federal Reserve Bank of Dallas.
    3. Mogstad, Magne & Torgovitsky, Alexander, 2024. "Instrumental variables with unobserved heterogeneity in treatment effects," Handbook of Labor Economics,, Elsevier.
    4. Jason B. Cook & Chloe N. East, 2023. "The Effect of Means-Tested Transfers on Work: Evidence from Quasi-Randomly Assigned SNAP Caseworkers," NBER Working Papers 31307, National Bureau of Economic Research, Inc.
    5. Dennis Lim & Wenjie Wang & Yichong Zhang, 2024. "A Dimension-Agnostic Bootstrap Anderson-Rubin Test For Instrumental Variable Regressions," Papers 2412.01603, arXiv.org, revised Sep 2025.
    6. Kikuta, Kyosuke & Kurosawa, Hiroki, 2026. "Quieted by Questions: The Unintended Consequences of Survey Interviews on Protest in Africa," SocArXiv xvk6n_v2, Center for Open Science.
    7. Ofek-Shanny, Yuval & Strulov-Shlain, Avner & Zeltzer, Dan, 2025. "Impacts of home-care subsidies: Evidence from quasi-random assignment," Journal of Public Economics, Elsevier, vol. 248(C).
    8. Moslem Rashidi & Luke B. Connelly & Gianluca Fiorentini, 2026. "Heart Failure's First Shock and Nurse-Led Chronic Care," Papers 2603.23024, arXiv.org.
    9. Jonathan Cohen & Geoffrey C. Schnorr, 2024. "Efficiency Costs of Unemployment Insurance Denial: Evidence from Randomly Assigned Examiners," Upjohn Working Papers 24-404, W.E. Upjohn Institute for Employment Research.
    10. Oliver Cassagneau-Francis & Lindsey Macmillan & Richard Murphy & Gill Wyness, 2025. "Measuring systematic gaps in teacher judgement: A new approach," CEPEO Working Paper Series 25-12, UCL Centre for Education Policy and Equalising Opportunities, revised Oct 2025.

    More about this item

    JEL classification:

    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C26 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Instrumental Variables (IV) Estimation
    • K14 - Law and Economics - - Basic Areas of Law - - - Criminal Law
    • K41 - Law and Economics - - Legal Procedure, the Legal System, and Illegal Behavior - - - Litigation Process

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aea:jeclit:v:63:y:2025:i:2:p:401-39. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Michael P. Albert (email available below). General contact details of provider: https://edirc.repec.org/data/aeaaaea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.