Author
Listed:
- Saanvi Chawla
- Vasilis Syrgkanis
Abstract
Interference between participants in two-sided marketplace experiments can severely bias conventional A/B tests. While two-sided randomization (TSR), which randomizes both supply and demand, enables estimators that mitigate this bias, existing analyses offer limited guidance on which estimator to prefer for the balanced market conditions common in practice, as they largely focus on extreme supply- or demand-constrained regimes. We introduce the Double Diagonal (DD) estimator, a novel method for interference-robust treatment effect estimation. The DD estimator contrasts the outcomes of treated-treated and control-control pairs and uses the off-diagonal interactions (treated-control and control-treated) to correct for interference-induced bias. We provide the first theoretical comparison between the DD and the standard naive TSR (TSRN) estimator under a simplifying mean-field market model, proving two key results: (i) DD's bias is strictly smaller than the standard estimator's below a critical threshold of the outside-option parameter; in particular, DD's bias is smaller whenever the outside option is at most twice as attractive as platform options; and (ii) the two estimators exhibit biases in opposite directions, with DD underestimating and the standard estimator overestimating the true effect, respectively. Extensive numerical experiments in realistic market settings--spanning heterogeneous treatment effects, supply-demand imbalances, and varied market structures--corroborate our theoretical findings. Across a wide range of configurations, the DD estimator demonstrates the lowest bias, establishing it as a robust and often superior choice for reliable experimentation in two-sided marketplaces.
Suggested Citation
Saanvi Chawla & Vasilis Syrgkanis, 2026.
"The Double Diagonal Estimator: Reducing Bias in Two-Sided Marketplace Experiments,"
Papers
2610.41294, arXiv.org.
Handle:
RePEc:arx:papers:2610.41294
Download full text from publisher
Corrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2610.41294. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
We have no bibliographic references for this item. You can help adding them by using this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .
Please note that corrections may take a couple of weeks to filter through
the various RePEc services.