{"type":"script","doc_desc":{"producers":[{"name":"Reproducibility WBG","abbr":"DIME","affiliation":"World Bank - Development Impact Department","role":"Verification and preparation of metadata"}],"version":"1","prod_date":"2024-05-09"},"project_desc":{"authoring_entity":[{"name":"Daniel Pinz\u00f3n","email":"dpinzonhernandez@worldbank.org","affiliation":"World Bank"},{"name":"JungKyu Rhys Lim","email":"rhyslim@worldbank.org","affiliation":"World Bank"},{"name":"Michelle Dugas","email":"mdugas@worldbank.org","affiliation":"World Bank"},{"name":"Renos Vakis","email":"rvakis@worldbank.org","affiliation":"World Bank"},{"name":"Zeina Afif","email":"zafif@worldbankgroup.org","affiliation":"World Bank"},{"name":"Takahiro Hasumi","email":"thasumi@worldbank.org","affiliation":"World Bank"},{"name":"Diya Elfadel","email":"delfadel@worldbank.org","affiliation":"World Bank"}],"output":[{"type":"Working paper","title":"Find the Fake: Boosting Resistance to Health Misinformation in Jordan with a WhatsApp Chatbot Game","description":"Policy Research Working Paper (PRWP) 10933","uri":"http:\/\/documents.worldbank.org\/curated\/en\/099227409302412051\/IDU113ce23951c3cc145541a19c1152b035fd129","doi":"https:\/\/doi.org\/10.1596\/1813-9450-10933"}],"title_statement":{"idno":"RR_JOR_2024_127","title":"Reproducibility package for Find the Fake: Boosting Resistance to Health Misinformation in Jordan with a WhatsApp Chatbot Game"},"production_date":"2024-05","abstract":"The proliferation of mis- and disinformation threatens to erode the credibility of public institutions and limit their capacity to implement policies that enhance public well-being. While misinformation represents an urgent global challenge, relatively little research has examined solutions in low- and middle-income countries. We experimentally test the impact of a novel WhatsApp chatbot game prebunking inoculation intervention in Jordan to boost capacity to identify common misinformation techniques and reduce the likelihood of sharing misleading headlines with others\u2212effectively \u2018inoculating\u2019 them against misinformation. A sample of 2,851 participants was recruited online and randomly assigned to five study arms: (1) comprehensive game-based inoculation, (2) brief game-based inoculation that highlighted examples of only misinformation, (3) infographics-based inoculation, (4) exposure to placebo infographics unrelated to misinformation, and (5) pure control. To evaluate the impact of our intervention, we assess two main outcomes: (i) ability to accurately discern headlines using misinformation techniques and headlines that do not use misinformation techniques, and (ii) discernment in sharing the two types of headlines. Compared to the placebo group, the comprehensive game significantly improved discernment of misinformation and reduced likelihood of sharing misleading headlines. A brief version of the game yielded weaker effects on discernment of misinformation, but similarly reduced intentions to share misleading headlines. In contrast, exposure to infographics teaching similar techniques showed no significant impacts on discernment of misinformation, and marginal effects on intention to share misleading headlines. These findings suggest that games can effectively inoculate the public against misinformation in the context of a middle-income country in the short term. Future research is also needed to explore the boundary conditions of our findings.","geographic_units":[{"name":"Jordan","code":"JOR"}],"topics":[{"id":"D90","name":"Micro-Based Behavioral Economics - General","parent_id":"D9","vocabulary":"Journal of Economic Literature (JEL)","uri":"https:\/\/www.aeaweb.org\/econlit\/jelCodes.php?view=jel"}],"data_statement":"All data is confidential and has not been included in the reproducibility package.","datasets":[{"name":"Experiment data on the detection of health misinformation and misinformation tactics in Jordan","access_type":"The dataset is confidential. Researchers interested in access to the data may contact the World Bank\u2019s Mind, Behavior, and Development (eMBeD) at eMBeD@worldbank.org.","note":"The authors collected data on the detection of misinformation and misinformation tactics through a randomized experiment using WhatsApp during October and November 2022 in Jordan."}],"software":[{"name":"Stata","version":"17"}],"scripts":[{"file_name":"RR_JOR_2024_127","zip_package":"RR_JOR_2024_127.zip","title":"Reproducibility package for Find the Fake: Boosting Resistance to Misinformation in Jordan with a WhatsApp Chatbot Game","date":"2024-05","dependencies":"Stata: outreg2, missings, wyoung, coefplot, violinplot, dstat, moremata, ipfraking (from SSC); grc1leg (from the Stata website). Dependency files for Stata are included in the folder \"ado\".","instructions":"See README in reproducibility package.","notes":"Computational reproducibility verified by Development Impact (DIME) Analytics team, World Bank."}],"repository_uri":[{"name":"Reproducible Research Repository (World Bank)","uri":"https:\/\/reproducibility.worldbank.org"}],"technology_requirements":"Runtime: 4 hours","technology_environment":"Paper exhibits were reproduced on a computer with the following specifications:\n\u2013 OS: Windows 11 Enterprise\n\u2013 Processor: Intel(R) Core(TM) i5-1145G7 CPU @ 2.60GHz\n\u2013 Memory available: 15.7 GB\n\u2013 Software version: Stata version 17","disclaimer":"The materials in the reproducibility packages are distributed as they were prepared by the staff of the International Bank for Reconstruction and Development\/The World Bank. The findings, interpretations, and conclusions expressed in this event do not necessarily reflect the views of the World Bank, the Executive Directors of the World Bank, or the governments they represent. The World Bank does not guarantee the accuracy of the materials included in the reproducibility package.","license":[{"name":"MIT","uri":"https:\/\/opensource.org\/license\/MIT"}],"contacts":[{"name":"Daniel Pinzon","affiliation":"World Bank","email":"dpinzonhernandez@worldbank.org"},{"affiliation":"World Bank","name":"Reproducibility WBG","email":"reproducibility@worldbank.org"}]},"tags":[{"tag":"DOI"}],"schematype":"script"}