{"type":"script","doc_desc":{"producers":[{"name":"Reproducibility WBG","abbr":"DECDI","affiliation":"World Bank - Development Impact Department","role":"Verification and preparation of metadata"}],"prod_date":"2026-05-01","version":"1"},"project_desc":{"authoring_entity":[{"name":"Natalia Agapitova","affiliation":"World Bank Group","email":"nagapitova@worldbank.org"},{"name":"Anastasia Nedayvoda","affiliation":"World Bank Group","email":"anedayvoda@ifc.org"},{"name":"Stephen Winkler","affiliation":"World Bank Group","email":"swinkler2@worldbank.org"},{"name":"Amschel de Rothschild","affiliation":"World Bank Group","email":"aderothschild@worldbank.org"},{"name":"Ergun Ertekin","affiliation":"World Bank Group","email":"eertekin@ifc.org"},{"name":"Sarah Lenoble","affiliation":"World Bank Group","email":"slenoble@worldbank.org"}],"title_statement":{"title":"Reproducibility package for Innovation Patterns In The World Bank Group Portfolio","idno":"RR_WLD_2026_639"},"data_statement":"All data sources are publicly available and included in the reproducibility package.","software":[{"name":"Python","version":"3.13.2"}],"scripts":[{"title":"Reproducibility package for Innovation Patterns In The World Bank Group Portfolio","date":"2026-05","notes":"Computational reproducibility verified by Development Impact (DECDI) Analytics team, World Bank.","instructions":"See README in reproducibility package.","file_name":"RR_WLD_2026_639","zip_package":"RR_WLD_2026_639.zip"}],"repository_uri":[{"name":"Reproducible Research Repository (World Bank)","uri":"https:\/\/reproducibility.worldbank.org"}],"production_date":"2026-05-01","abstract":"This paper employs large-scale text analytics and generative-AI methods to analyze innovation patterns within the World Bank Group (WBG) portfolio. It draws on over 7,500 Independent Evaluation Group (IEG) project evaluations completed between 1998 and 2025. The study finds that, on average, innovative projects are associated with higher performance outcomes. It also identifies several key enabling factors for innovation at the WBG, including: disciplined experimentation, flexible and adaptive project designs, contextualization to local settings, participatory approaches in the design and piloting of new solutions, and visionary and supportive internal leadership. The analysis reveals that innovation within the WBG has evolved over time from sporadic experimentation to an embedded organizational capability. However, significant constraints persist such as bureaucratic fragmentation, capacity gaps, overly complex project designs, lack of continuity in scaling innovations, and insufficient incentives for learning and adaptation.","geographic_units":[{"name":"World","code":"WLD"}],"topics":[{"id":"C45","uri":"https:\/\/www.aeaweb.org\/econlit\/jelCodes.php?view=jel","vocabulary":"Journal of Economic Literature (JEL)","name":"Neural Networks and Related Topics","parent_id":"C4"},{"id":" O19","uri":"https:\/\/www.aeaweb.org\/econlit\/jelCodes.php?view=jel","vocabulary":"Journal of Economic Literature (JEL)","name":"International Linkages to Development \u2022 Role of International Organizations","parent_id":"O1"},{"id":"C55","vocabulary":"Journal of Economic Literature (JEL)","name":" Large Data Sets: Modeling and Analysis ","url":"https:\/\/www.aeaweb.org\/econlit\/jelCodes.php?view=jel","parent_id":"C5","uri":"https:\/\/www.aeaweb.org\/econlit\/jelCodes.php?view=jel"},{"id":"O31","vocabulary":"Journal of Economic Literature (JEL)","name":" Innovation and Invention: Processes and Incentives ","url":"https:\/\/www.aeaweb.org\/econlit\/jelCodes.php?view=jel","parent_id":"O3","uri":"https:\/\/www.aeaweb.org\/econlit\/jelCodes.php?view=jel"}],"output":[{"type":"Working Paper","description":"Policy Research Working Papers (PRWP)","title":"Innovation Patterns In The World Bank Group Portfolio"}],"language":[{"name":"English","code":"EN"}],"technology_requirements":"Run time: ~ 1 minute","disclaimer":"The materials in the reproducibility packages are distributed as they were prepared by the staff of the International Bank for Reconstruction and Development\/The World Bank. The findings, interpretations, and conclusions expressed in this event do not necessarily reflect the views of the World Bank, the Executive Directors of the World Bank, or the governments they represent. The World Bank does not guarantee the accuracy of the materials included in the reproducibility package.","license":[{"name":"Modified BSD3","uri":"https:\/\/opensource.org\/license\/bsd-3-clause\/"}],"contacts":[{"name":"Natalia Agapitova","affiliation":"World Bank","email":"nagapitova@worldbank.org"},{"name":"Reproducibility WBG","affiliation":"World Bank","email":"reproducibility@worldbank.org"}],"reproduction_instructions":"To reproduce the findings in this paper, a replicator must:\n1. Restore the environment in `requirements.txt`.\n2. Run the script `scripts\/run_analysis.py`\nRefer to the README for detailed instructions. \n\n","technology_environment":"Paper exhibits were reproduced on a computer with the following specifications:\n\u2022 OS: Windows 11 Enterprise\n\u2022 Processor: INTEL(R) XEON(R) PLATINUM 8562Y+ (2.80 GHz) (4 processors)\n\u2022 Memory available: 32.0 GB","datasets":[{"note":"Data accessed on March 12, 2025. Contains lessons learned text and evaluation metadata from IEG's Implementation Completion Report Reviews (ICRRs) and Project Performance Assessment Reports (PPARs), covering World Bank lending projects evaluated from approximately 1995 to the present. Files: data\/raw\/IEG_ICRR-PPAR_Lessons_2025-03-12.xlsx; data\/raw\/IEG_ICRR-PPAR_Lessons_2025-03-12_patches.csv.","name":"IEG Data: World Bank Project Lessons","access_type":"Data is publicly available and included in the reproducibility package.","uri":"https:\/\/ieg.worldbankgroup.org\/sites\/default\/files\/Data\/IEG_ICRR-PPAR_Lessons_2025-03-12.xlsx","license_uri":"https:\/\/www.worldbank.org\/en\/about\/legal\/terms-of-use-for-datasets","license":"Creative Commons Attribution 4.0 International (CC BY 4.0)","citation":"Independent Evaluation Group (IEG), World Bank Group. 2025. IEG Data: World Bank Project Lessons [dataset]. File: IEG_ICRR-PPAR_Lessons_2025-03-12.xlsx. Retrieved March 12, 2025, from https:\/\/ieg.worldbankgroup.org\/page\/ieg-data-world-bank-project-lessons"},{"name":"Harmonized List of Fragile and Conflict-Affected Situations (FCS)","note":"Data accessed in January 2026. World Bank Harmonized List of Fragile and Conflict-affected Situations (FCS), published annually. Used to classify projects by the FCS status of the borrowing country for fiscal years 2015\u20132025. Files: data\/reference\/FCS\/FCS.xlsx.","access_type":"Data is publicly available and included in the reproducibility package.","license":"Creative Commons Attribution 4.0 International (CC BY 4.0)","license_uri":"https:\/\/www.worldbank.org\/en\/about\/legal\/terms-of-use-for-datasets","uri":"https:\/\/www.worldbank.org\/en\/topic\/fragilityconflictviolence\/brief\/harmonized-list-of-fragile-situations","citation":"World Bank Group. 2025. Harmonized List of Fragile and Conflict-Affected Situations: FY06 to FY25 [dataset]. Retrieved January 2026, from https:\/\/www.worldbank.org\/en\/topic\/fragilityconflictviolence\/brief\/harmonized-list-of-fragile-situations"},{"note":"Author-constructed JSON keyword dictionaries used for innovation tagging and taxonomy classification. Developed using a combination of LLM assistance and expert review (see methodology\/ folder for prompt records and review protocols). Files: data\/reference\/keywords\/*.json. Files, pipeline steps, and LLMs used: (1) innovation_keywords.json - Step 2, ChatGPT (GPT-4o) and DeepSeek (V3); (2) taxonomy_keywords.json - Step 7, ChatGPT (GPT-4o) and DeepSeek (V3); (3) pilot_scale_keywords.json, (4) ifc_keywords.json, and (5) pcm_keywords.json - Step 10, ChatGPT (GPT-4o); (6) top_models_keywords.json - Step 15, ChatGPT (GPT-5) and DeepSeek (V3). All developed June-October 2025.","name":"Innovation Keyword Dictionaries","access_type":"Data is publicly available and included in the reproducibility package.","citation":"Authors' compilation. 2025. \"Innovation Keyword Dictionaries\" [dataset]. Constructed using LLM assistance and expert review for the analysis of innovation patterns in World Bank Group project evaluations"}]},"datacite":{"creators":[{"givenName":"Natalia","familyName":"Agapitova","nameType":"Personal","affiliation":[{"name":"World Bank Group"}]},{"givenName":"Anastasia","familyName":"Nedayvoda","nameType":"Personal","affiliation":[{"name":"World Bank Group"}]},{"givenName":"Stephen","familyName":"Winkler","nameType":"Personal","affiliation":[{"name":"World Bank Group"}]},{"givenName":"Amschel de","familyName":"Rothschild","nameType":"Personal","affiliation":[{"name":"World Bank Group"}]},{"givenName":"Ergun","familyName":"Ertekin","nameType":"Personal","affiliation":[{"name":"World Bank Group"}]},{"givenName":"Sarah","familyName":"Lenoble","nameType":"Personal","affiliation":[{"name":"World Bank Group"}]}],"titles":[{"lang":"en","title":"Reproducibility package for Innovation Patterns In The World Bank Group Portfolio"},{"title":"RR_WLD_2026_639","titleType":"Other"}],"publisher":"World Bank","publicationYear":"2026","types":{"resourceType":"Reproducibility package","resourceTypeGeneral":"Other"},"url":"https:\/\/reproducibility.worldbank.org\/index.php\/catalog\/study\/RR_WLD_2026_639","language":"en"},"tags":[{"tag":"DOI"},{"tag":"Open Code"},{"tag":"Open Data"}],"schematype":"script"}