Reproducible Research Repository
Reproducible Research Repository
  • Home
  • Repository
  • Collections
  • About
    Home / Repository / PRWP / RR_WLD_2024_226
PRWP

Reproducibility package for Rigging The Scores: Corruption Through Scoring Rule Manipulation In Public Procurement Auctions

2025
Reference ID
RR_WLD_2024_226
DOI
https://doi.org/10.60572/bkq1-2m68
Author(s)
Qianmiao (Michelle) Chen
Collections
World Bank Policy Research Working Papers
Metadata
JSON
Created on
Apr 14, 2025
Last modified
Apr 14, 2025
  • Project Description
  • Downloads
  • Overview
  • Reproducibility Package
  • Description
  • Scope and coverage
  • Disclaimer
  • Access and rights
  • Contacts
  • Information on metadata
  • Citation
  • Overview

    Abstract

    Public procurement is highly susceptible to corruption, especially in developing countries. Although open auctions are widely adopted to curb it, I document that corruption remains prevalent even within this procurement format. Procurement officers can collaborate with firms to manipulate scoring rules, ensuring predetermined winners, while corrupt firms submit non-competitive bids to meet minimum bidder requirements. Using extensive data from Chinese public procurement auctions, I introduce model-driven statistical tools to detect such corruption, identifying a corruption rate of 65%. A procurement expert audit survey confirms the tools’ reliability, with a 91% probability that experts recognize suspicious scoring rules when flagged. Firm-level analysis reveals that local, state-owned, and less productive firms are favored in corrupt auctions. Lastly, I explore policy implications. Analysis of the national anti-corruption campaign since 2012 suggests that general investigations may be insufficient to address deeply ingrained corrupt practices. Using counterfactuals based on an estimated structural model, I find that implementing anonymous call-for-tender evaluations could improve social welfare by 10% by eliminating suspicious rues and encouraging broader participation.

    Reproducibility Package

    Source code repository
    Repository name URI
    Reproducible Research Repository (World Bank) https://reproducibility.worldbank.org
    Software
    R
    Name
    R
    Version
    4.4.2
    Stata
    Name
    Stata
    Version
    18.0 MP
    Mosek
    Name
    Mosek
    Version
    10.2

    Reproducibility

    Technology environment

    Machine 1

    • OS: Windows Server 2019 Standard
    • Processor: Intel(R) Core(TM) i5-1145G7 CPU @ 2.60GHz
    • Memory available: 10 GB
    • Software version: Stata 18.0 MP, R Version 4.4.2

    Machine 2

    • OS: Windows 10 Enterprise 22H2
    • Processor: Intel(R) Xeon(R) CPU E7-4890 v2 @ 2.80GHz 2.79 GHz (16 processors)
    • Memory available: 64 GB
    • Software version: Stata 18.0 MP, R Version 4.4.2

    Machine 3

    • OS: Windows 10 Enterprise 22H2
    • Processor: Intel(R) Xeon(R) CPU E7- 4860 @ 2.27GHz 2.26 GHz (2 processors)
    • Memory available: 1TB
    • Software version: Stata 18.0 MP, R 4.4.2
    Technology requirements

    The package takes approximately 360 hours to run.
    This code is computationally intensive and executes multiple parallel processing operations. It requires a minimum of 32 GB of available memory and at least 64 GB of RAM, although more is recommended for optimal performance.

    Reproduction instructions

    To successfully reproduce this package:

    1. Install Mosek as outlined in the README and acquire a Mosek license
    2. Open the pp_corruption.Rproj file
    3. From RStudio, open and run the rcode/Main.R script
    4. Adjusts the paths to Mosek (line 11) and Stata (line 51) and run the script
    5. Open statacode/main do file.
    6. Adjust the ado path (line 3) and the directory path (line 11) and run the script
    7. From RStudio, open and run the rcode/Appendix.R script (remember to re-initialized the pp_corruption.Rproj, if it was closed)
    8. Open statacode/Appendix do file.
    9. Adjust the ado path (line 3) and the directory path (line 7) and run the script

    Data

    Datasets
    Public procurement data: Auction results with auction variables
    Name
    Public procurement data: Auction results with auction variables
    Note
    Dataset: scores.Rdata, Source: the dataset was constructed by the author with data from the Guangdong Government Procurement Office. For more information, please refer to the README file.
    Access policy
    Publicly available and included in the reproducibility package.
    Firm registration data of bidders
    Name
    Firm registration data of bidders
    Note
    Dataset: firms.Rdata, Source: the dataset was constructed by the author with data from qcc.com For more information, please refer to the README file.
    Access policy
    Publicly available and included in the reproducibility package.
    Public procurement data: Call-For-Proposals variables and results variables together
    Name
    Public procurement data: Call-For-Proposals variables and results variables together
    Note
    Dataset: outcome_announce.Rdata, Source: the dataset was constructed by the author with data from the Guangdong Government Procurement Office. For more information, please refer to the README file.
    Access policy
    Publicly available and included in the reproducibility package.
    Public procurement data: Bids and auction chart indicators for estimations and tests
    Name
    Public procurement data: Bids and auction chart indicators for estimations and tests
    Note
    Dataset: df.Rdata, Source: the dataset was constructed by the author with data from the Guangdong Government Procurement Office. For more information, please refer to the README file.
    Access policy
    Publicly available and included in the reproducibility package.
    Expert audit survey data
    Name
    Expert audit survey data
    Note
    Dataset: evaluation.Rdata, Source: Author
    Access policy
    Publicly available and included in the reproducibility package.
    Public procurement data: Price bids of bidders
    Name
    Public procurement data: Price bids of bidders
    Note
    Dataset: price.Rdata, Source: the dataset was constructed by the author with data from the Guangdong Government Procurement Office. For more information, please refer to the README file.
    Access policy
    Publicly available and included in the reproducibility package.
    Public procurement data: Region info of auctions
    Name
    Public procurement data: Region info of auctions
    Note
    Dataset: region.Rdata, Source: the dataset was constructed by the author with data from the Guangdong Government Procurement Office. For more information, please refer to the README file.
    Access policy
    Publicly available and included in the reproducibility package.
    Bid evaluation with expert randomness
    Name
    Bid evaluation with expert randomness
    Note
    Dataset: random.Rdata, Source: the dataset was constructed by the author with a subsample of data from the Shenzhen Public Resources Trading Center. The subsample includes procurement projects from October 1, 2022, to February 23, 2023. For more information, please refer to the README file.
    Access policy
    Publicly available and included in the reproducibility package.
    Data URL
    https://www.szggzy.com/jygg/list.html?id=zfcg
    Firm registration data: Firm local/small indicators for asymmetry
    Name
    Firm registration data: Firm local/small indicators for asymmetry
    Note
    Dataset: covariates.Rdata, Source: the dataset was constructed by the author with data from qcc.com For more information, please refer to the README file.
    Access policy
    Publicly available and included in the reproducibility package.
    Call-For-Proposals variables with corruption investigation for all departments
    Name
    Call-For-Proposals variables with corruption investigation for all departments
    Note
    Dataset: announce_cor_full.dta, Source: the dataset was constructed by the author with data from the Guangdong Government Procurement Office, the Commission for Discipline Inspection and Wang, Y., & Dickson, B. J. (2022). How corruption investigations undermine regime support: evidence from China. Political Science Research and Methods, 10(1), 33-48. For more information, please refer to the README file.
    Access policy
    Publicly available and included in the reproducibility package.
    Call-For-Proposals variables with corruption investigation for departments only ever under investigation
    Name
    Call-For-Proposals variables with corruption investigation for departments only ever under investigation
    Note
    Dataset: announce_cor.dta, Source: the dataset was constructed by the author with data from the Guangdong Government Procurement Office, the Commission for Discipline Inspection and Wang, Y., & Dickson, B. J. (2022). How corruption investigations undermine regime support: evidence from China. Political Science Research and Methods, 10(1), 33-48. For more information, please refer to the README file.
    Access policy
    Publicly available and included in the reproducibility package.
    Auction outcomes with corruption investigation for all departments
    Name
    Auction outcomes with corruption investigation for all departments
    Note
    Dataset: nbidders_cor_full.dta, Source: the dataset was constructed by the author with data from the Guangdong Government Procurement Office the Commission for Discipline Inspection and Wang, Y., & Dickson, B. J. (2022). How corruption investigations undermine regime support: evidence from China. Political Science Research and Methods, 10(1), 33-48. For more information, please refer to the README file.
    Access policy
    Publicly available and included in the reproducibility package.
    Auction outcomes with corruption investigation for all departments only ever under investigation
    Name
    Auction outcomes with corruption investigation for all departments only ever under investigation
    Note
    Dataset: nbidders_cor.dta, Source: the dataset was constructed by the author with data from the Guangdong Government Procurement Office the Commission for Discipline Inspection and Wang, Y., & Dickson, B. J. (2022). How corruption investigations undermine regime support: evidence from China. Political Science Research and Methods, 10(1), 33-48. For more information, please refer to the README file.
    Access policy
    Publicly available and included in the reproducibility package.
    New supplier for the local indicator with corruption investigation for all departments
    Name
    New supplier for the local indicator with corruption investigation for all departments
    Note
    Dataset: newfirm.dta, Source: the dataset was constructed by the author with data from qcc.com, the Commission for Discipline Inspection and Wang, Y., & Dickson, B. J. (2022). How corruption investigations undermine regime support: evidence from China. Political Science Research and Methods, 10(1), 33-48. For more information, please refer to the README file.
    Access policy
    Publicly available and included in the reproducibility package.
    Firm registration data: Firm characteristics
    Name
    Firm registration data: Firm characteristics
    Note
    Dataset: firms.dta, Source: the dataset was constructed by the author with data from qcc.com For more information, please refer to the README file.
    Access policy
    Publicly available and included in the reproducibility package.
    Firm registration data: Firm TFP with characteristics
    Name
    Firm registration data: Firm TFP with characteristics
    Note
    Dataset: dffirm.dta, Source: the dataset was constructed by the author with data from qcc.com For more information, please refer to the README file.
    Access policy
    Publicly available and included in the reproducibility package.
    County level panel statistics data: Linkage of region and county id
    Name
    County level panel statistics data: Linkage of region and county id
    Note
    Dataset: countyid.dta, Source: the dataset was constructed by the author using county-level panel statistics data from the China National Knowledge Infrastructure. For more information, please refer to the README file.
    Access policy
    Publicly available and included in the reproducibility package.
    County level panel statistics data: County panel variables
    Name
    County level panel statistics data: County panel variables
    Note
    Dataset: county_covs.dta, Source: the dataset was constructed by the author using county-level panel statistics data from the China National Knowledge Infrastructure. For more information, please refer to the README file.
    Access policy
    Publicly available and included in the reproducibility package.
    Kang and Miller (2022) - US federal public procurement contracts
    Name
    Kang and Miller (2022) - US federal public procurement contracts
    Note
    Dataset: final_data.dta, Source: Kang, K., & Miller, R. A. (2021). Winning by Default: Why is There So Little Competition in Government Procurement? [Data set]. Zenodo. Version 2
    Access policy
    Publicly available and included in the reproducibility package.
    License
    Creative Commons Attribution 4.0 International
    License URL
    https://creativecommons.org/licenses/by/4.0/legalcode
    Data URL
    https://zenodo.org/records/5108920
    Data statement

    All data sources are publicly available and included in the reproducibility package.

    Description

    Output
    Rigging The Scores: Corruption Through Scoring Rule Manipulation In Public Procurement Auctions
    Type
    Working Paper
    Title
    Rigging The Scores: Corruption Through Scoring Rule Manipulation In Public Procurement Auctions
    Description
    Policy Research Working Papers (PRWP)
    Authors
    Author Affiliation Email
    Qianmiao (Michelle) Chen World Bank qianmiao@worldbank.org
    Date of production

    2025-04-08

    Scope and coverage

    Geographic locations
    Location Code
    World WLD
    Keywords
    Public Procurement Open Scoring Auction Corruption
    Topics
    ID Topic Parent topic ID Vocabulary Vocabulary URI
    H57 Procurement H5 Journal of Economic Literature (JEL)
    D73 Bureaucracy • Administrative Processes in Public Organizations • Corruption D7 Journal of Economic Literature (JEL)
    D44 Auctions D4 Journal of Economic Literature (JEL)
    L44 Antitrust Policy and Public Enterprises, Nonprofit Institutions, and Professional Organizations L4 Journal of Economic Literature (JEL)

    Disclaimer

    Disclaimer

    The materials in the reproducibility packages are distributed as they were prepared by the staff of the International Bank for Reconstruction and Development/The World Bank. The findings, interpretations, and conclusions expressed in this event do not necessarily reflect the views of the World Bank, the Executive Directors of the World Bank, or the governments they represent. The World Bank does not guarantee the accuracy of the materials included in the reproducibility package.

    Access and rights

    License
    Name URI
    Modified BSD3 https://opensource.org/license/bsd-3-clause/

    Contacts

    Contacts
    Name Affiliation Email
    Qianmiao (Michelle) Chen World Bank qianmiao@worldbank.org
    Reproducibility WBG World Bank reproducibility@worldbank.org

    Information on metadata

    Producers
    Name Abbreviation Affiliation Role
    Reproducibility WBG DIME World Bank - Development Impact Department Verification and preparation of metadata
    Date of Production

    2025-04-08

    Document version

    1

    Citation

    Citation
    loading, please wait...
    Citation format
    Export citation: RIS | BibTeX | Plain text
    Back to Catalog
    The World Bank Working for a World Free of Poverty
    • IBRD IDA IFC MIGA ICSID

    © The World Bank Group, All Rights Reserved.