We develop a framework to analyze partial population experiments, a generalization of the cluster experimental design where clusters are assigned to different treatment intensities. Our framework allows for heterogeneity in cluster sizes and outcome distributions. We study the large-sample behavior of OLS estimators and cluster-robust variance estimators and show that (i) ignoring cluster heterogeneity may result in severely underpowered experiments and (ii) the cluster-robust variance estimator may be upward-biased when clusters are heterogeneous. We derive formulas for power, minimum detectable effects, and optimal cluster assignment probabilities. All our results apply to cluster experiments, a particular case of our framework. We set up a potential outcomes framework to interpret the OLS estimands as causal effects. We implement our methods in a large-scale experiment to estimate the direct and spillover effects of a communication campaign on property tax compliance. We find an increase in tax compliance among individuals directly targeted with our mailing, as well as compliance spillovers on untreated individuals in clusters with a high proportion of treated taxpayers.
Repository name | URI |
---|---|
Reproducible Research Repository (World Bank) | https://reproducibility.worldbank.org |
– OS: Windows 10 Enterprise 22H2
– Processor: Intel(R) Xeon(R) CPU E7- 4860 @ 2.27GHz 2.26 GHz (2 processors)
– Memory available: 16 GB
– Software version: Stata 17 MP Parallel Edition for Windows (64-bit x86-64), R version 4.4.2
The code takes approximately 75 minutes to run.
Since not all the data is publicly available, the package includes the code outputs in the folder "Results", which contains the results produced by replicators. These files can be used to review the results presented in the paper.
Some data is restricted and has not been included in the reproducibility package. For more details, please refer to the README file.
Author | Affiliation | |
---|---|---|
Guillermo Cruces | University of Nottingham & CONICET-CEDLAS-UNLP | guillermo.cruces@nottingham.ac.uk |
Gonzalo Vazquez-Bare | UC Santa Barbara | gvazquez@econ.ucsb.edu |
Dario Tortarolo | World Bank | dtortarolo@worldbank.org |
2025-01-27
Location | Code |
---|---|
Argentina | ARG |
The materials in the reproducibility packages are distributed as they were prepared by the staff of the International Bank for Reconstruction and Development/The World Bank. The findings, interpretations, and conclusions expressed in this event do not necessarily reflect the views of the World Bank, the Executive Directors of the World Bank, or the governments they represent. The World Bank does not guarantee the accuracy of the materials included in the reproducibility package.
Name | URI |
---|---|
Modified BSD3 | https://opensource.org/license/bsd-3-clause/ |
Name | Affiliation | |
---|---|---|
Guillermo Cruces | U. of Nottingham & CONICET-CEDLAS-UNLP | guillermo.cruces@nottingham.ac.uk |
Reproducibility WBG | World Bank | reproducibility@worldbank.org |
Name | Abbreviation | Affiliation | Role |
---|---|---|---|
Reproducibility WBG | DIME | World Bank - Development Impact Department | Verification and preparation of metadata |
2025-01-27
1