Submission Instructions

The Reproducible Research Repository publishes reproducibility packages from World Bank staff and consultants. All packages must correspond to either a) a Policy Research Working Paper, b) a published journal article with a World Bank author, or c) a World Bank report or flagship.

• To submit a reproducibility package for a Policy Research Working Paper, please visit http://prwp/ on the World Bank Intranet.
• To submit a reproducibility package for a published journal article:
• If your article has been published in a journal that verifies the reproducibility package, please email a link to the published reproducibility package to reproducibility@worldbank.org and the team will create a repository entry.
• If your article has been published in a journal that does not require a verified reproducibility package, please visit http://prwp/ on the World Bank Intranet and follow the same steps as for a Policy Research Working Paper.
• To submit a reproducibility package for a World Bank report, please email reproducibility@worldbank.org .

Submission Checklist for World Bank Reproducibility Packages

To initiate a reproducibility verification, the authors will complete a short request form at www.reproducibility.worldbank.org. Before submitting the request, authors should prepare a reproducibility package that includes all components in the checklist below. In the submission form, authors will provide a link to the complete reproducibility package (OneDrive or GitHub), information on programming language(s) and software version(s), OS used, and approximate run time. Questions should be directed to reproducibility@worldbank.org. The reproducibility package will include:

• A link to the complete reproducibility package on either OneDrive or GitHub. The directory should include all the below components:
• A Data Availability Statement with a link to the dataset(s) (if public) or a description of how/where/when a third party could access the data (if confidential or embargoed) .
• All data files required for the analysis (for purpose of reproducibility verification only, see here for publication guidelines and embargo options for reproducibility packages)
  • Data should be shared via OneDrive. If the data cannot be shared via OneDrive (due to size or confidentiality), please email reproducibility@worldbank.org to discuss alternatives.
  • A brief description of any restrictions to data access, publication or storage/ retention period based on data terms of use.
  • If the data can be published, and you prefer to publish them directly in the reproducibility package (rather than in a separate repository), you may indicate that on submission. This is useful for derivative datasets that have limited independent value outside of the reproducibility package.
• All code files required to go from the original data to the results in the paper.
  • We strongly recommend a main script that runs all code files. The main script should be in the root directory and should set directory path(s) in one location only. If the package does not include a main script, it must have a readme that specifies the order of execution of code files.
  • Code should create all figures and in-text numerical citations not drawn directly from tables.
• The outputs used for the paper (e.g. tables and figures) in raw form
• The final manuscript. The manuscript should be included directly if the paper is not yet published. If the paper is already published, please provide the DOI for the paper.
• Recommended: a readme file that guides future readers through the package and how to proceed with replication. A recommended template is available at: https://social-science-data-editors.github.io/template_README/

The reproducibility package should not include:

• Any code or datasets that are not necessary for the set of results included in the paper (or appendices)
• Any extraneous documentation (such as project notes or internal communication)