IDEAS home Printed from https://ideas.repec.org/a/sae/evarev/v38y2014i3p217-250.html
   My bibliography  Save this article

Pairwise Cluster Randomization

Author

Listed:
  • William Rhodes

Abstract

Background: Cluster randomization (CR) is often used for program evaluation when simple random assignment is inappropriate or infeasible. Pairwise cluster random (PCR) assignment is a more efficient alternative, but evaluators seemed to be deterred from PCR because of bias and identification problems. This article explains the problems, argues that they can be mitigated through design choices, and demonstrates that the suitability of PCR can be tested using Monte Carlo procedures. Research Design: The article presents simple formulas showing how the PCR estimator is biased and explains why its standard error is not identified. Formal derivations appear in a longer companion article. Using those formulas, this article discusses how good design can mitigate the problems with bias and identification. Using Monte Carol simulation, this article also shows how to choose between CR and PCR at the design stage. Conclusions: This article advocates for wider use of the PCR design. PCR loses its appeal when the investigator lacks baseline data for matching the clusters. Its use is less compelling when there are a large number of clusters. But when the evaluator is working with a fairly small number of clusters—26 in the running example used in this article—PCR is an attractive alternative to CR.

Suggested Citation

  • William Rhodes, 2014. "Pairwise Cluster Randomization," Evaluation Review, , vol. 38(3), pages 217-250, June.
  • Handle: RePEc:sae:evarev:v:38:y:2014:i:3:p:217-250
    DOI: 10.1177/0193841X14540654
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0193841X14540654
    Download Restriction: no

    File URL: https://libkey.io/10.1177/0193841X14540654?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Heller, Ruth & Rosenbaum, Paul R. & Small, Dylan S., 2009. "Split Samples and Design Sensitivity in Observational Studies," Journal of the American Statistical Association, American Statistical Association, vol. 104(487), pages 1090-1101.
    2. Roger Newson, 2002. "Parameters behind "nonparametric" statistics: Kendall's tau,Somers' D and median differences," Stata Journal, StataCorp LP, vol. 2(1), pages 45-64, February.
    3. Donner, A. & Klar, N., 2004. "Pitfalls of and Controversies in Cluster Randomization Trials," American Journal of Public Health, American Public Health Association, vol. 94(3), pages 416-422.
    4. repec:mpr:mprres:5863 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. John, Katrin & Thomsen, Stephan L., 2015. "School-track environment or endowment: What determines different other-regarding behavior across peer groups?," Games and Economic Behavior, Elsevier, vol. 94(C), pages 122-141.
    2. Benjamin Lu & Eli Ben-Michael & Avi Feller & Luke Miratrix, 2023. "Is It Who You Are or Where You Are? Accounting for Compositional Differences in Cross-Site Treatment Effect Variation," Journal of Educational and Behavioral Statistics, , vol. 48(4), pages 420-453, August.
    3. Roger B. Newson, 2010. "Comparing the predictive powers of survival models using Harrell’s C or Somers’ D," Stata Journal, StataCorp LP, vol. 10(3), pages 339-358, September.
    4. Chakrabarty, Manisha & Hildenbrand, Werner, 2011. "Engel's Law Reconsidered," Journal of Mathematical Economics, Elsevier, vol. 47(3), pages 289-299.
    5. Sophie Song and Katsushi S. Imai, 2018. "Does the Hunger Safety Net Programme Reduce Multidimensional Poverty? Evidence from Kenya," OPHI Working Papers ophiwp124.pdf, Queen Elizabeth House, University of Oxford.
    6. Susan Athey & Dean Eckles & Guido W. Imbens, 2018. "Exact p-Values for Network Interference," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(521), pages 230-240, January.
    7. Guerra, Alice & Zhuravleva, Tatyana, 2021. "Do bystanders react to bribery?," Journal of Economic Behavior & Organization, Elsevier, vol. 185(C), pages 442-462.
    8. Bernard Black & José-Antonio Espín-Sánchez & Eric French & Kate Litvak, 2017. "The Long-Term Effect of Health Insurance on Near-Elderly Health and Mortality," American Journal of Health Economics, University of Chicago Press, vol. 3(3), pages 281-311, Summer.
    9. Anubhav Gupta & Thomas Luke Spreen, 2024. "Do tax credits benefit charities? Evidence from two states," Contemporary Economic Policy, Western Economic Association International, vol. 42(1), pages 94-109, January.
    10. Philipp Chapkovski & Luca Corazzini & Valeria Maggian, 2021. "Does Whistleblowing on Tax Evaders Reduce Ingroup Cooperation?," Working Papers 2021:20, Department of Economics, University of Venice "Ca' Foscari".
    11. Benjamin F. Arnold & Francois Rerolle & Christine Tedijanto & Sammy M. Njenga & Mahbubur Rahman & Ayse Ercumen & Andrew Mertens & Amy J. Pickering & Audrie Lin & Charles D. Arnold & Kishor Das & Chris, 2024. "Geographic pair matching in large-scale cluster randomized trials," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    12. Cingl, Lubomír & Lichard, Tomáš & Miklánek, Tomáš, 2023. "Tax designation effects on compliance: An online experiment with taxpayers," Journal of Economic Behavior & Organization, Elsevier, vol. 214(C), pages 615-633.
    13. Bas van der Klaauw & Sandra Vriend, 2015. "A Nonparametric Method for Predicting Survival Probabilities," Tinbergen Institute Discussion Papers 15-126/V, Tinbergen Institute.
    14. Moonseong Heo & Andrew C. Leon, 2008. "Statistical Power and Sample Size Requirements for Three Level Hierarchical Cluster Randomized Trials," Biometrics, The International Biometric Society, vol. 64(4), pages 1256-1262, December.
    15. Lukasz Prorokowski, 2016. "Rank-order statistics for validating discriminative power of credit risk models," Bank i Kredyt, Narodowy Bank Polski, vol. 47(3), pages 227-250.
    16. Stefanie Behncke, 2012. "How Do Shocks to Non-Cognitive Skills Affect Test Scores?," Annals of Economics and Statistics, GENES, issue 107-108, pages 155-173.
    17. Newson, Roger, 2005. "Efficient Calculation of Jackknife Confidence Intervals for Rank Statistics," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 15(i01).
    18. Vivek F. Farias & Andrew A. Li & Tianyi Peng & Andrew Zheng, 2022. "Markovian Interference in Experiments," Papers 2206.02371, arXiv.org, revised Jun 2022.
    19. Jeannette Brosig‐Koch & Heike Hennig‐Schmidt & Nadja Kairies‐Schwarz & Daniel Wiesen, 2017. "The Effects of Introducing Mixed Payment Systems for Physicians: Experimental Evidence," Health Economics, John Wiley & Sons, Ltd., vol. 26(2), pages 243-262, February.
    20. Löschel, Andreas & Sturm, Bodo & Uehleke, Reinhard, 2013. "Revealed preferences for climate protection when the purely individual perspective is relaxed: Evidence from a framed field experiment," ZEW Discussion Papers 13-006, ZEW - Leibniz Centre for European Economic Research.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:38:y:2014:i:3:p:217-250. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.