Reproducibility package for Nudging At Scale: Evidence From A Government Text Messaging Campaign During School Shutdowns In Punjab, Pakistan

Text and voice messages have emerged as a low cost and popular tool to nudge recipients to change behavior. This paper presents findings from a randomized control trial (RCT) designed to evaluate the impact of an information campaign using text and voice messages implemented in Punjab, Pakistan during the COVID-19-induced school closures. This campaign sought to increase study time and provide academic support while schools were closed and to encourage re-enrollment when they opened to reduce dropout. The campaign targeted girls enrolled in grades 5-7. Messages were sent out by a government institution, and the campaign lasted from October, 2020 until November, 2021, when schools had permanently re-opened. Households were randomized across three treatment groups and a control group that did not receive any messages. The first treatment group received gender-specific messages that explicitly referenced daughters in their households, whereas the second treatment group received gender-neutral messages. A third group was cross-randomized across the first two treatment arms and received academic support messages (practice math problems and solutions). Results show that messages increased re-enrollment by 6.0 percentage points approximately three months after the intervention finished. The message program also increased learning outcomes by 0.2 S.D. for Urdu and 0.2 S.D. for math. The paper also finds a small positive effect on the intensive margin of remote learning and an (equivalent) small negative effect on the intensive margin of outside tutoring. In line with similar studies on pandemic remediation efforts, the paper finds no effect of the academic support intervention on learning. The findings suggest that increased school enrolment played a large role in supporting the observed increase in learning outcomes.