Reproducible Research Repository
Reproducible Research Repository
  • Home
  • Repository
  • Collections
  • About
    Home / Repository / RR_WLD_2026_736
central

Reproducibility package for Validation Of A Cross-Linguistic Pictorial Socioeconomic Status Instrument For Illiterate And Diverse Global Populations In The Technological Age

2026
Get Reproducibility Package
Reference ID
RR_WLD_2026_736
Author(s)
Boshi Wang, Audrey J. Leroux, Niyati Malhotra, Tomas Koutecky, Victor Orozco, Stephanie Gottwald, Tinsley Galyean
Metadata
JSON
Created on
Oct 01, 2026
Last modified
Oct 01, 2026
Page views
10
Downloads
5
  • Project Description
  • Downloads
  • Overview
  • Reproducibility Package
  • Description
  • Scope and coverage
  • Disclaimer
  • Access and rights
  • Contacts
  • Information on metadata
  • Overview

    Abstract

    Measuring socioeconomic status (SES) remains a challenge in educational assessment, as text-based instruments often introduce construct-irrelevant variance among low-literacy populations. This study validates a novel pictorial SES instrument designed to mitigate these barriers. Data were collected via a digital app from 1,101 users across three linguistic groups: Bangla (n = 645), French (n = 280), and Zulu (n = 176). Methodologically, multiple nominal pictorial responses were collapsed into binary “Low” and “High” SES levels based on substantive economic meaning to address cross-cultural heterogeneity. Confirmatory factor analysis (CFA) using Weighted Least Squares Mean and Variance Adjusted estimation established a 6-item factor structure with good model fit (χ^2 (9)=4.97,p=0.84, RMSEA = 0.00 [90% CI: 0.00, 0.02], CFI = 1.00, SRMR = 0.03). Mean inter-item tetrachoric correlation (.23) confirmed ideal internal consistency. Nomological validity was supported by a moderate correlation (r = .34) with early literacy skills, consistent with existing educational research. A multiple-group CFA established scalar measurement invariance across all three languages, confirming that the items function equivalently across diverse linguistic backgrounds. Substantively, the validated scale captures the transition to entry-level modernity, distinguishing between levels of poverty through infrastructural access rather than subjective social ranking. By removing the literacy-based barriers inherent in traditional surveys, this low-cost, digitally scalable tool offers a dignity-affirming and methodologically sound mechanism to help ensure accurate representation of economically disadvantaged populations in global educational research.

    Reproducibility Package

    Scripts
    Readme Get Reproducibility Package
    Link: https://reproducibility.worldbank.org/catalog/663/download/1994/README.pdf
    Reproducibility package for Validation Of A Cross-Linguistic Pictorial Socioeconomic Status Instrument For Illiterate And Diverse Global Populations In The Technological Age
    File name
    RR_WLD_2026_736
    Zip package
    RR_WLD_2026_736.zip
    Title
    Reproducibility package for Validation Of A Cross-Linguistic Pictorial Socioeconomic Status Instrument For Illiterate And Diverse Global Populations In The Technological Age
    Date
    2026-09
    Dependencies
    R dependencies are listed in the file renv.lock.
    Instructions
    See README in reproducibility package.
    Notes
    Computational reproducibility verified by Development Impact (DECDI) Analytics team, World Bank.
    Source code repository
    Repository name URI
    Reproducible Research Repository (World Bank) https://reproducibility.worldbank.org
    Software
    R
    Name
    R
    Version
    4.5.3
    Mplus
    Name
    Mplus
    Version
    9.1.1 Demo

    Reproducibility

    Technology environment

    Paper exhibits were reproduced on a computer with the following specifications:
    • OS: Windows 11 Enterprise
    • Processor: Intel(R) Xeon(R) Gold 5218 CPU @ 2.30GHz (2.30 GHz) (2 processors)
    • Memory available: 16.0 GB
    • Software version: R 4.5.3, Mplus 9.1.1 Demo

    Technology requirements

    Run time: ~15 minutes

    Reproduction instructions

    To reproduce the findings in this paper, a replicator must:

    1. Run the Package:
    • R: Open the R project "Replication.Rproj" and restore the environment by running renv::restore(). Update the working directory in line 22 of the script main.R, and run it.
    1. Mplus: Open the standalone Mplus application and sequentially run the following files located in the "02_Code" folder: 04_01_CFA_6Items.inp, 04_02_MI_Testing.inp, 05_SEM Correlation.inp.

    Data

    Datasets
    Pictorial Socioeconomic Status Surveys (2022-2024)
    Name
    Pictorial Socioeconomic Status Surveys (2022-2024)
    Note
    The authors obtained the data used in this study through a data sharing agreement with Curious Learning. It is collected and owned by Curious Learning, with World Bank’s DECDI team providing technical assistance on survey instrument design and analysis and the psychometrics analysis led by Georgia State University and Georgia Institute of Technology. For more information on the data, replicators can contact Tinsley Galyean (tgalyean@curiouslearning.org) or Stephanie Gottwald (sgottwald@curiouslearning.org).
    Access policy
    Data access was granted directly to the study authors by the data owners. It was obtained with a custom data license that allows for redistribution and is included in the reproducibility package.
    License
    Custom license
    Citation
    Curious Learning. "Pictorial Socioeconomic Status Surveys (2022-2024)" [dataset]. Unpublished. Accessed 2024.
    Data statement

    Data is obtained through a custom data license that allows for redistribution and is included in the reproducibility package. For more details, refer to the README file.

    Description

    Output
    Validation Of A Cross-Linguistic Pictorial Socioeconomic Status Instrument For Illiterate And Diverse Global Populations In The Technological Age
    Type
    Working Paper
    Title
    Validation Of A Cross-Linguistic Pictorial Socioeconomic Status Instrument For Illiterate And Diverse Global Populations In The Technological Age
    Authors
    Boshi Wang, Audrey J. Leroux, Niyati Malhotra, Tomas Koutecky, Victor H. Orozco-Olvera, Stephanie Gottwald, Tinsley Galyean
    Description
    Policy Research Working Paper (PRWP)
    Authors
    Author Affiliation Email
    Boshi Wang Georgia State University bwang30@student.gsu.edu
    Audrey J. Leroux Georgia Institute of Technology aleroux@gatech.edu
    Niyati Malhotra World Bank nmalhotra4@worldbank.org
    Tomas Koutecky World Bank tkoutecky@worldbank.org
    Victor Orozco World Bank vorozco@worldbank.org
    Stephanie Gottwald Curious Learning sgottwald@curiouslearning.org
    Tinsley Galyean Curious Learning tgalyean@curiouslearning.org
    Date of production

    2026-09-22

    Scope and coverage

    Geographic locations
    Location Code
    World WLD
    Keywords
    Socioeconomic Status (Ses) Measurement Invariance Pictorial Assessment Confirmatory Factor Analysis Measurement Equity Cross-Linguistic Validation
    Topics
    ID Topic Parent topic ID Vocabulary Vocabulary URI
    I32 Measurement and Analysis of Poverty I3 Journal of Economic Literature (JEL)
    I24 Education and Inequality I2 Journal of Economic Literature (JEL)
    C38 Classification Methods • Cluster Analysis • Principal Components • Factor Models C3 Journal of Economic Literature (JEL)
    C83 Survey Methods • Sampling Methods C8 Journal of Economic Literature (JEL)
    I21 Analysis of Education I2 Journal of Economic Literature (JEL)
    O15 Human Resources • Human Development • Income Distribution • Migration O1 Journal of Economic Literature (JEL)

    Disclaimer

    Disclaimer

    The materials in the reproducibility packages are distributed as they were prepared by the staff of the International Bank for Reconstruction and Development/The World Bank. The findings, interpretations, and conclusions expressed in this event do not necessarily reflect the views of the World Bank, the Executive Directors of the World Bank, or the governments they represent. The World Bank does not guarantee the accuracy of the materials included in the reproducibility package.

    Access and rights

    License
    Name URI
    MIT License https://opensource.org/license/mit
    World Bank IGO Rider https://github.com/worldbank/metadata-editor/blob/main/WB-IGO-RIDER.md

    Contacts

    Contacts
    Name Affiliation Email
    Tomas Koutecky World Bank tkoutecky@worldbank.org
    Reproducibility WBG World Bank reproducibility@worldbank.org

    Information on metadata

    Producers
    Name Abbreviation Affiliation Role
    Reproducibility WBG DECDI World Bank - Development Impact Department Verification and preparation of metadata
    Date of Production

    2026-09-22

    Document version

    1

    Back to Catalog
    The World Bank Working for a World Free of Poverty
    • IBRD IDA IFC MIGA ICSID

    © The World Bank Group, All Rights Reserved.