Reproducible Research Repository
Reproducible Research Repository
  • Home
  • Repository
  • Collections
  • About
    Home / Repository / PRWP / RR_JOR_2024_127
PRWP

Reproducibility package for Find the Fake: Boosting Resistance to Health Misinformation in Jordan with a WhatsApp Chatbot Game

2024
Get Reproducibility Package
Reference ID
RR_JOR_2024_127
DOI
https://doi.org/10.60572/wffr-jp71
Author(s)
Daniel Pinzón, JungKyu Rhys Lim, Michelle Dugas, Renos Vakis, Zeina Afif, Takahiro Hasumi, Diya Elfadel
Collections
World Bank Policy Research Working Papers
Metadata
JSON
Created on
May 14, 2024
Last modified
Oct 22, 2024
  • Project Description
  • Downloads
  • Overview
  • Reproducibility Package
  • Description
  • Scope and coverage
  • Disclaimer
  • Access and rights
  • Contacts
  • Information on metadata
  • Citation
  • Overview

    Abstract

    The proliferation of mis- and disinformation threatens to erode the credibility of public institutions and limit their capacity to implement policies that enhance public well-being. While misinformation represents an urgent global challenge, relatively little research has examined solutions in low- and middle-income countries. We experimentally test the impact of a novel WhatsApp chatbot game prebunking inoculation intervention in Jordan to boost capacity to identify common misinformation techniques and reduce the likelihood of sharing misleading headlines with others−effectively ‘inoculating’ them against misinformation. A sample of 2,851 participants was recruited online and randomly assigned to five study arms: (1) comprehensive game-based inoculation, (2) brief game-based inoculation that highlighted examples of only misinformation, (3) infographics-based inoculation, (4) exposure to placebo infographics unrelated to misinformation, and (5) pure control. To evaluate the impact of our intervention, we assess two main outcomes: (i) ability to accurately discern headlines using misinformation techniques and headlines that do not use misinformation techniques, and (ii) discernment in sharing the two types of headlines. Compared to the placebo group, the comprehensive game significantly improved discernment of misinformation and reduced likelihood of sharing misleading headlines. A brief version of the game yielded weaker effects on discernment of misinformation, but similarly reduced intentions to share misleading headlines. In contrast, exposure to infographics teaching similar techniques showed no significant impacts on discernment of misinformation, and marginal effects on intention to share misleading headlines. These findings suggest that games can effectively inoculate the public against misinformation in the context of a middle-income country in the short term. Future research is also needed to explore the boundary conditions of our findings.

    Reproducibility Package

    Scripts
    Readme Get Reproducibility Package
    Link: https://reproducibility.worldbank.org/index.php/catalog/138/download/507/README.pdf
    Reproducibility package for Find the Fake: Boosting Resistance to Misinformation in Jordan with a WhatsApp Chatbot Game
    Title
    Reproducibility package for Find the Fake: Boosting Resistance to Misinformation in Jordan with a WhatsApp Chatbot Game
    Date
    2024-05
    Dependencies
    Stata: outreg2, missings, wyoung, coefplot, violinplot, dstat, moremata, ipfraking (from SSC); grc1leg (from the Stata website). Dependency files for Stata are included in the folder "ado".
    Instructions
    See README in reproducibility package.
    Notes
    Computational reproducibility verified by Development Impact (DIME) Analytics team, World Bank.
    Source code repository
    Repository name URI
    Reproducible Research Repository (World Bank) https://reproducibility.worldbank.org
    Software
    Stata
    Name
    Stata
    Version
    17

    Reproducibility

    Technology environment

    Paper exhibits were reproduced on a computer with the following specifications:
    – OS: Windows 11 Enterprise
    – Processor: Intel(R) Core(TM) i5-1145G7 CPU @ 2.60GHz
    – Memory available: 15.7 GB
    – Software version: Stata version 17

    Technology requirements

    Runtime: 4 hours

    Data

    Datasets
    Experiment data on the detection of health misinformation and misinformation tactics in Jordan
    Name
    Experiment data on the detection of health misinformation and misinformation tactics in Jordan
    Note
    The authors collected data on the detection of misinformation and misinformation tactics through a randomized experiment using WhatsApp during October and November 2022 in Jordan.
    Access policy
    The dataset is confidential. Researchers interested in access to the data may contact the World Bank’s Mind, Behavior, and Development (eMBeD) at eMBeD@worldbank.org.
    Data statement

    All data is confidential and has not been included in the reproducibility package.

    Description

    Output
    Find the Fake: Boosting Resistance to Health Misinformation in Jordan with a WhatsApp Chatbot Game
    Type
    Working paper
    Title
    Find the Fake: Boosting Resistance to Health Misinformation in Jordan with a WhatsApp Chatbot Game
    Description
    Policy Research Working Paper (PRWP) 10933
    URL
    http://documents.worldbank.org/curated/en/099227409302412051/IDU113ce23951c3cc145541a19c1152b035fd129
    DOI
    https://doi.org/10.1596/1813-9450-10933
    Authors
    Author Affiliation Email
    Daniel Pinzón World Bank dpinzonhernandez@worldbank.org
    JungKyu Rhys Lim World Bank rhyslim@worldbank.org
    Michelle Dugas World Bank mdugas@worldbank.org
    Renos Vakis World Bank rvakis@worldbank.org
    Zeina Afif World Bank zafif@worldbankgroup.org
    Takahiro Hasumi World Bank thasumi@worldbank.org
    Diya Elfadel World Bank delfadel@worldbank.org
    Date of production

    2024-05

    Scope and coverage

    Geographic locations
    Location Code
    Jordan JOR
    Topics
    ID Topic Parent topic ID Vocabulary Vocabulary URI
    D90 Micro-Based Behavioral Economics - General D9 Journal of Economic Literature (JEL)

    Disclaimer

    Disclaimer

    The materials in the reproducibility packages are distributed as they were prepared by the staff of the International Bank for Reconstruction and Development/The World Bank. The findings, interpretations, and conclusions expressed in this event do not necessarily reflect the views of the World Bank, the Executive Directors of the World Bank, or the governments they represent. The World Bank does not guarantee the accuracy of the materials included in the reproducibility package.

    Access and rights

    License
    Name URI
    MIT https://opensource.org/license/MIT

    Contacts

    Contacts
    Name Affiliation Email
    Daniel Pinzon World Bank dpinzonhernandez@worldbank.org
    Reproducibility WBG World Bank reproducibility@worldbank.org

    Information on metadata

    Producers
    Name Abbreviation Affiliation Role
    Reproducibility WBG DIME World Bank - Development Impact Department Verification and preparation of metadata
    Date of Production

    2024-05-09

    Document version

    1

    Citation

    Citation
    loading, please wait...
    Citation format
    Export citation: RIS | BibTeX | Plain text
    Back to Catalog
    The World Bank Working for a World Free of Poverty
    • IBRD IDA IFC MIGA ICSID

    © The World Bank Group, All Rights Reserved.