Reproducible Research Repository
Reproducible Research Repository
  • Home
  • Repository
  • Collections
  • About
    Home / Repository / PRWP / RR_DOM_2026_688
PRWP

Reproducibility package for Improving Student Outcomes Through Adaptive Learning Platforms: Experimental Evidence From The Dominican Republic

2026
Get Reproducibility Package
Reference ID
RR_DOM_2026_688
Author(s)
Carolina Lopez, Astrid Pineda
Collections
World Bank Policy Research Working Papers
Metadata
JSON
Created on
Jun 24, 2026
Last modified
Jun 24, 2026
Page views
14
Downloads
1
  • Project Description
  • Downloads
  • Overview
  • Reproducibility Package
  • Description
  • Scope and coverage
  • Disclaimer
  • Access and rights
  • Contacts
  • Information on metadata
  • Overview

    Abstract

    Most students in developing countries receive grade-level instruction despite lacking prerequisite skills, a mismatch that widens learning gaps as students progress. We conducted a randomized controlled trial across 38 classrooms and 1,333 night-grade students in the Dominican Republic, randomly assigning classrooms to one of three arms: computer-adaptive learning (CAL) software replacing two of seven weekly mathematics hours, CAL combined with small-group tutoring, or a business-as-usual control. CAL improved test scores by 0.29-0.31 standard deviations over 6 months, among the larger effects documented for education technology interventions in developing countries. We find no evidence that adding small-group tutoring enhanced these benefits; if anything, classrooms assigned to both interventions showed smaller gains than those receiving CAL alone, though this difference is not statistically significant. We document implementation challenges and explore potential mechanisms, showing that tutoring classrooms exhibited reduced engagement with the CAL platform. These results suggest computer-adaptive learning software can be effectively integrated into classroom instruction to improve learning at scale, but that combining multiple interventions is not guaranteed to produce additive benefits and may instead generate unintended behavioral responses that offset their effectiveness.

    Reproducibility Package

    Scripts
    Readme Get Reproducibility Package
    Link: https://reproducibility.worldbank.org/catalog/587/download/1748/README.pdf
    Reproducibility package for Improving Student Outcomes Through Adaptive Learning Platforms: Experimental Evidence From The Dominican Republic
    File name
    RR_DOM_2026_688
    Zip package
    RR_DOM_2026_688.zip
    Title
    Reproducibility package for Improving Student Outcomes Through Adaptive Learning Platforms: Experimental Evidence From The Dominican Republic
    Date
    2026-06
    Dependencies
    Stata dependencies are listed in the ado folder.
    Instructions
    See README in reproducibility package.
    Notes
    Computational reproducibility verified by Development Impact (DECDI) Analytics team, World Bank.
    Source code repository
    Repository name URI
    Reproducible Research Repository (World Bank) https://reproducibility.worldbank.org
    Software
    Stata
    Name
    Stata
    Version
    19.5 MP

    Reproducibility

    Technology environment

    Paper exhibits were reproduced on a computer with the following specifications:
    • OS: Windows 11 Enterprise
    • Processor: Intel(R) Xeon(R) Gold 5218 CPU @ 2.30GHz (2.30 GHz) (2 processors)
    • Memory available: 16 GB

    Technology requirements

    Run time ~ 2 hours

    Reproduction instructions

    To reproduce the findings in this paper, a replicator must:

    1. Access the datasets since they are not included in the package. See the Datasets section for more details.
    2. Update the working directory in line 28 of the do-file 00_master_replication, and run it.

    Since the data is temporarily embargoed, the package includes the outputs produced by the authors, which can be used to review the results presented in the paper.

    Data

    Datasets
    Improving Student Outcomes through Adaptive Learning Platforms
    Name
    Improving Student Outcomes through Adaptive Learning Platforms
    Note
    Data collection took place September 2023 - May 2024. Includes two datasets: (1) CAL_DR_Data_deposit.dta: student-level analysis dataset combining baseline, midline, and endline survey data, administrative records (grades, attendance, enrollment), and ALEKS platform usage data for 1,333 ninth-grade students across 38 classrooms in 9 schools; (2) cal_tutoring_merged_long_deposit.dta: section-week-level dataset with weekly records of CAL sessions delivered and tutoring sessions delivered, covering 19 CAL classrooms over 21 weeks of implementation, including session counts, rescheduling flags, and reasons for cancelled sessions. Both datasets have been de-identified: open-text responses, phone numbers, school names, and direct school identifiers have been removed, with school_id replaced with an anonymous sequential code. Researchers must apply through the World Bank Microdata Library to access. File location: Data/CAL_DR_Data_deposit.dta; cal_tutoring_merged_long_deposit.dta.",
    Access policy
    Data is forthcoming in the World Bank Microdata Library.
    Citation
    Lopez Carolina and Astrid Pineda (2024). "Improving Student Outcomes through Adaptive Learning Platforms: Experimental Evidence from the Dominican Republic" [dataset]. AEA RCT Registry: AEARCTR-0012383.
    Data statement

    All data is not yet publicly available but is expected to be made available through the World Bank Microdata Library in the future.

    Description

    Output
    Improving Student Outcomes Through Adaptive Learning Platforms: Experimental Evidence From The Dominican Republic
    Type
    Working Paper
    Title
    Improving Student Outcomes Through Adaptive Learning Platforms: Experimental Evidence From The Dominican Republic
    Description
    Policy Research Working Papers (PRWP)
    Authors
    Author Affiliation Email
    Carolina Lopez World Bank carolina_lopez@worldbank.org
    Astrid Pineda World Bank apineda@worldbank.org
    Date of production

    2026-06-24

    Scope and coverage

    Geographic locations
    Location Code
    Dominican Republic DOM

    Disclaimer

    Disclaimer

    The materials in the reproducibility packages are distributed as they were prepared by the staff of the International Bank for Reconstruction and Development/The World Bank. The findings, interpretations, and conclusions expressed in this event do not necessarily reflect the views of the World Bank, the Executive Directors of the World Bank, or the governments they represent. The World Bank does not guarantee the accuracy of the materials included in the reproducibility package.

    Access and rights

    License
    Name URI
    MIT License https://opensource.org/license/mit
    World Bank IGO Rider https://github.com/worldbank/metadata-editor/blob/main/WB-IGO-RIDER.md

    Contacts

    Contacts
    Name Affiliation Email
    Carolina Lopez World Bank carolina_lopez@worldbank.org
    Reproducibility WBG World Bank reproducibility@worldbank.org

    Information on metadata

    Producers
    Name Abbreviation Affiliation Role
    Reproducibility WBG DECDI World Bank - Development Impact Department Verification and preparation of metadata
    Date of Production

    2026-06-24

    Document version

    1

    Back to Catalog
    The World Bank Working for a World Free of Poverty
    • IBRD IDA IFC MIGA ICSID

    © The World Bank Group, All Rights Reserved.