Reproducibility package for Doing Better At Doing Good: Lessons From A Bayesian Meta-Analysis After 20-Years Of Poverty Graduation Programs

Multi-faceted poverty Graduation programs that aim to increase income generating activities for low-income households are being rapidly adopted and scaled by nonprofit organizations and governments. We conduct a Bayesian hierarchical meta-analysis of 49 studies (encompassing 81 treatment variations) on poverty Graduation programs, defined as containing at least three of five components: consumption support, savings facilitation, skills training, coaching, and a lump-sum transfer. We find large, sustained gains across economic and psychosocial outcomes: monthly consumption rises by 38 USD PPP (11%), income by 28 USD PPP (15%), alongside improvements in savings, assets, food security, mental health, and women’s empowerment. Beyond these average treatment effects, three particular results stand out. First, programs with large transfers (at least 400 USD PPP) have larger treatment effects but are not more cost-effective. Second, more expensive programs generate larger treatment effects, but the improvements are not commensurate with the cost increases; thus, lower cost programs tend to be more cost-effective. Third, programs implemented 2016 onward perform considerably better than those implemented prior to 2016. Benefit-cost ratios from 2016 onward are 4.85, compared to 2.88 through 2015. Neither changes in cost nor in high-level design (i.e., components) explain this upward trend. Considering other heavily-studied interventions, we find a similar upward trend for treatment effects on behavior change from financial education but not for unconditional cash transfers. We hypothesize a mechanism of continuous sector-community learning and improved implementation quality.